Commit graph

4 commits

Author SHA1 Message Date
Adil Hafeez
9e2fd2ee58 Merge branch 'main' into adil/llm_tracing 2024-11-14 22:13:20 -08:00
Aayush
1d229cba8f
Add in tpot (#269)
* add in tpot and tokens per second

* add in debug logs for new stats and update integration tests

* update shared dashboard to include new stats
2024-11-14 15:03:08 -08:00
Adil Hafeez
7c8205abc2 move custom tracer to llm filter 2024-11-13 16:55:23 -08:00
Adil Hafeez
31749bfc74
move grafana and prometheus to shared (#265) 2024-11-12 15:23:30 -08:00