13 commits

Author	SHA1	Message	Date
aayushwhiz	a01c1c61bd	change to not ignore time to first token in tpot calculation	2024-11-14 14:23:28 -08:00
aayushwhiz	312b21ef7d	add in debug logs for new stats and update integration tests	2024-11-14 13:56:56 -08:00
aayushwhiz	1e6d25a90e	add in tpot and tokens per second	2024-11-14 13:49:08 -08:00
Aayush	5993e36f22	Update arch stats (#250)	2024-11-12 15:03:26 -08:00
Adil Hafeez	d87105882b	update rust toolchain to 1.82 (#255) ... * update rust to 1.82 pin it, also update envoy to 1.32 and python to 3.13 * use python:3.12	2024-11-12 10:35:14 -08:00
Adil Hafeez	9081eb0f7f	obfuscate auth header (#254)	2024-11-08 15:17:39 -06:00
Adil Hafeez	a72bb804eb	add support for jaeger tracing (#229)	2024-11-07 22:11:00 -06:00
José Ulises Niño Rivera	662a840ac5	Add support for streaming and fixes few issues (see description) (#202)	2024-10-28 17:05:06 -07:00
Adil Hafeez	1719b7d5f8	Send back developer error correctly (#195)	2024-10-18 13:14:18 -07:00
Adil Hafeez	c6ba28dfcc	Code refactor and some improvements - see description (#194)	2024-10-18 12:53:44 -07:00
José Ulises Niño Rivera	aa30353c85	Add cargo workspace to allow rust-analyzer to work correctly (#197) ... Signed-off-by: José Ulises Niño Rivera <junr03@users.noreply.github.com>	2024-10-18 15:44:52 -04:00
Adil Hafeez	21e7fe2cef	Split arch wasm filter code into prompt and llm gateway filters (#190)	2024-10-17 10:16:40 -07:00
Adil Hafeez	3bd2ffe9fb	split wasm filter (#186) ... * split wasm filter * fix int and unit tests * rename public_types => common and move common code there * rename * fix int test	2024-10-16 14:20:26 -07:00