12 commits

Author	SHA1	Message	Date
Adil Hafeez	36489b4adc	use envoy to publish traces (#270)	2024-11-18 17:55:39 -08:00
Adil Hafeez	097513ee60	fix start time of llm filter (#278) ... * fix start time of llm filter * fix int tests	2024-11-17 17:01:19 -08:00
Adil Hafeez	d3c17c7abd	move custom tracer to llm filter (#267)	2024-11-15 10:44:01 -08:00
Aayush	1d229cba8f	Add in tpot (#269) ... * add in tpot and tokens per second * add in debug logs for new stats and update integration tests * update shared dashboard to include new stats	2024-11-14 15:03:08 -08:00
Aayush	5993e36f22	Update arch stats (#250)	2024-11-12 15:03:26 -08:00
Adil Hafeez	9081eb0f7f	obfuscate auth header (#254)	2024-11-08 15:17:39 -06:00
Adil Hafeez	a72bb804eb	add support for jaeger tracing (#229)	2024-11-07 22:11:00 -06:00
José Ulises Niño Rivera	662a840ac5	Add support for streaming and fixes few issues (see description) (#202)	2024-10-28 17:05:06 -07:00
Adil Hafeez	1719b7d5f8	Send back developer error correctly (#195)	2024-10-18 13:14:18 -07:00
Adil Hafeez	c6ba28dfcc	Code refactor and some improvements - see description (#194)	2024-10-18 12:53:44 -07:00
Adil Hafeez	21e7fe2cef	Split arch wasm filter code into prompt and llm gateway filters (#190)	2024-10-17 10:16:40 -07:00
Adil Hafeez	3bd2ffe9fb	split wasm filter (#186) ... * split wasm filter * fix int and unit tests * rename public_types => common and move common code there * rename * fix int test	2024-10-16 14:20:26 -07:00