8 commits

Author	SHA1	Message	Date
cotran	e30bbe39e7	address comments	2024-11-26 09:45:27 -08:00
cotran	b5b56a9468	fix bug	2024-11-22 12:17:04 -08:00
cotran	b91b776874	fix bug	2024-11-22 11:24:27 -08:00
cotran	abfc81b0e7	new implemenetation	2024-11-22 11:11:26 -08:00
CTran	fb67788be0	add prefill and test (#236) ... * add prefill and test * fix stream * fix * feedback * address comments * update * add e2e test * fix e2e test * update fix * fix * address cmt * address cmt	2024-11-07 11:59:29 -08:00
CTran	8e54ac20d8	Refactor model server hardware config + add unit tests to load/request to the server (#189) ... * remove mode/hardware * add test and pre commit hook * add pytest dependieces * fix format * fix lint * fix precommit * fix pre commit * fix pre commit * fix precommit * fix precommit * fix precommit * fix precommit * fix precommit * fix precommit * fix precommit * fix precommit * fix precommit * fix precommit	2024-10-16 16:58:10 -07:00
Adil Hafeez	7d5f760884	Improve cli (#179)	2024-10-10 17:44:41 -07:00
Shuguang Chen	3b7c58698f	Update model_server (#164) ... * Update model server * Delete model_server/.vscode/settings.json * Update loader.py * Fix errors * Update log mode	2024-10-09 18:04:52 -07:00