mirror of
https://github.com/katanemo/plano.git
synced 2026-05-02 04:12:56 +02:00
9 lines
429 B
ReStructuredText
9 lines
429 B
ReStructuredText
.. _monitoring:
|
|
|
|
Monitoring
|
|
==========
|
|
|
|
Arch offers several monitoring metrics that help you understand three critical aspects of your application:
|
|
latency, token usage, and error rates by an upstream LLM provider. Latency measures the speed at which your
|
|
application is responding to users, which includes metrics like time to first token (TFT), time per output
|
|
token (TOT) metrics, and the total latency as perceived by users.
|