11 commits

Author	SHA1	Message	Date
aayushwhiz	a01c1c61bd	change to not ignore time to first token in tpot calculation	2024-11-14 14:23:28 -08:00
aayushwhiz	312b21ef7d	add in debug logs for new stats and update integration tests	2024-11-14 13:56:56 -08:00
aayushwhiz	1e6d25a90e	add in tpot and tokens per second	2024-11-14 13:49:08 -08:00
Aayush	5993e36f22	Update arch stats (#250)	2024-11-12 15:03:26 -08:00
Adil Hafeez	9081eb0f7f	obfuscate auth header (#254)	2024-11-08 15:17:39 -06:00
Adil Hafeez	a72bb804eb	add support for jaeger tracing (#229)	2024-11-07 22:11:00 -06:00
José Ulises Niño Rivera	662a840ac5	Add support for streaming and fixes few issues (see description) (#202)	2024-10-28 17:05:06 -07:00
Adil Hafeez	1719b7d5f8	Send back developer error correctly (#195)	2024-10-18 13:14:18 -07:00
Adil Hafeez	c6ba28dfcc	Code refactor and some improvements - see description (#194)	2024-10-18 12:53:44 -07:00
Adil Hafeez	21e7fe2cef	Split arch wasm filter code into prompt and llm gateway filters (#190)	2024-10-17 10:16:40 -07:00
Adil Hafeez	3bd2ffe9fb	split wasm filter (#186) ... * split wasm filter * fix int and unit tests * rename public_types => common and move common code there * rename * fix int test	2024-10-16 14:20:26 -07:00