plano/docs/source/observability/stats.rst

.. _monitoring:

Monitoring
==========

Arch offers several monitoring metrics that help you understand three critical aspects of your application: 
latency, token usage, and error rates by an upstream LLM provider. Latency measures the speed at which your 
application is responding to users, which includes metrics like time to first token (TFT), time per output 
token (TOT) metrics, and the total latency as perceived by users.
Salmanap/docs v1 push (#92) * updated model serving, updated the config references, architecture docs and added the llm_provider section * several documentation changes to improve sections like life_of_a_request, model serving subsystem --------- Co-authored-by: Salman Paracha <salmanparacha@MacBook-Pro-261.local> 2024-09-27 15:37:49 -07:00			`.. _monitoring:`

V1 docs push (#86) * updated docs (again) * updated the LLMs section, prompt processing section and the RAG section of the docs --------- Co-authored-by: Salman Paracha <salmanparacha@MacBook-Pro-261.local> 2024-09-25 23:43:34 -07:00			`Monitoring`
			`==========`
Adil/fix salman docs (#75) * added the first set of docs for our technical docs * more docuemtnation changes * added support for prompt processing and updated life of a request * updated docs to including getting help sections and updated life of a request * committing local changes for getting started guide, sample applications, and full reference spec for prompt-config * updated configuration reference, added sample app skeleton, updated favico * fixed the configuration refernce file, and made minor changes to the intent detection. commit v1 for now * Updated docs with use cases and example code, updated what is arch, and made minor changes throughout * fixed imaged and minor doc fixes * add sphinx_book_theme * updated README, and make some minor fixes to documetnation * fixed README.md * fixed image width --------- Co-authored-by: Salman Paracha <salmanparacha@MacBook-Pro-261.local> Co-authored-by: Adil Hafeez <adil@katanemo.com> 2024-09-24 13:54:17 -07:00
V1 docs push (#86) * updated docs (again) * updated the LLMs section, prompt processing section and the RAG section of the docs --------- Co-authored-by: Salman Paracha <salmanparacha@MacBook-Pro-261.local> 2024-09-25 23:43:34 -07:00			`Arch offers several monitoring metrics that help you understand three critical aspects of your application:`
			`latency, token usage, and error rates by an upstream LLM provider. Latency measures the speed at which your`
			`application is responding to users, which includes metrics like time to first token (TFT), time per output`
			`token (TOT) metrics, and the total latency as perceived by users.`