plano/docs/source/guides/observability/monitoring.rst

.. _monitoring:

Monitoring
==========

Arch offers several monitoring metrics that help you understand three critical aspects of your application:
latency, token usage, and error rates by an upstream LLM provider. Latency measures the speed at which your
application is responding to users, which includes metrics like time to first token (TFT), time per output
token (TOT) metrics, and the total latency as perceived by users.
Salmanap/docs v1 push (#92) * updated model serving, updated the config references, architecture docs and added the llm_provider section * several documentation changes to improve sections like life_of_a_request, model serving subsystem --------- Co-authored-by: Salman Paracha <salmanparacha@MacBook-Pro-261.local> 2024-09-27 15:37:49 -07:00			`.. _monitoring:`

V1 docs push (#86) * updated docs (again) * updated the LLMs section, prompt processing section and the RAG section of the docs --------- Co-authored-by: Salman Paracha <salmanparacha@MacBook-Pro-261.local> 2024-09-25 23:43:34 -07:00			`Monitoring`
			`==========`
Adil/fix salman docs (#75) * added the first set of docs for our technical docs * more docuemtnation changes * added support for prompt processing and updated life of a request * updated docs to including getting help sections and updated life of a request * committing local changes for getting started guide, sample applications, and full reference spec for prompt-config * updated configuration reference, added sample app skeleton, updated favico * fixed the configuration refernce file, and made minor changes to the intent detection. commit v1 for now * Updated docs with use cases and example code, updated what is arch, and made minor changes throughout * fixed imaged and minor doc fixes * add sphinx_book_theme * updated README, and make some minor fixes to documetnation * fixed README.md * fixed image width --------- Co-authored-by: Salman Paracha <salmanparacha@MacBook-Pro-261.local> Co-authored-by: Adil Hafeez <adil@katanemo.com> 2024-09-24 13:54:17 -07:00
add precommit check (#97) * add precommit check * remove check * Revert "remove check" This reverts commit 9987b62b9b97dca46ce2499b3ff2f6eb589097ec. * fix checks * fix whitespace errors 2024-09-30 14:54:01 -07:00			`Arch offers several monitoring metrics that help you understand three critical aspects of your application:`
			`latency, token usage, and error rates by an upstream LLM provider. Latency measures the speed at which your`
			`application is responding to users, which includes metrics like time to first token (TFT), time per output`
			`token (TOT) metrics, and the total latency as perceived by users.`