5 commits

Author	SHA1	Message	Date
Shuguang Chen	818ec0a9db	Fix the issue of Arch-Intent	2024-12-06 11:53:46 -08:00
Shuguang Chen	09f7e1e604	Update guardrail_handler and its associated tests	2024-12-05 11:30:58 -08:00
Shuguang Chen	b686cf8b87	refactor model_handler	2024-12-05 11:00:22 -08:00
Shuguang Chen	afe1410b37	Init update on model_server	2024-12-04 16:41:30 -08:00
CTran	fb67788be0	add prefill and test (#236) ... * add prefill and test * fix stream * fix * feedback * address comments * update * add e2e test * fix e2e test * update fix * fix * address cmt * address cmt	2024-11-07 11:59:29 -08:00