7 commits

Author	SHA1	Message	Date
cotran	b2ef3f7266	fix test	2024-12-10 19:31:02 -08:00
cotran	5439e07e0e	new thd	2024-12-09 15:22:02 -08:00
cotran	f13947732c	add more test	2024-12-09 13:48:30 -08:00
cotran	7bb6c8c750	add test and fix bug	2024-12-09 13:21:28 -08:00
Shuguang Chen	95e167c2f6	Refacotr model configs	2024-12-08 16:00:25 -08:00
Shuguang Chen	320f4612b8	Update cli and related utils	2024-12-08 11:16:34 -08:00
Shuguang Chen	b4f4695f16	Reorganize model_server	2024-12-08 09:21:53 -08:00