aayushwhiz
|
6fc32b0152
|
update weather_forecast demo to spin up grafana and prometheus when using monitoring profile
has full dashboard with total requests, time per output token, time to
first token, total latency, output sequence length, and input sequence
length.
|
2024-11-11 17:00:48 -08:00 |
|