8 commits

Author	SHA1	Message	Date
Adil Hafeez	c80a04eb39	add warning if first/last message is not from user	2025-05-27 19:18:39 -07:00
Adil Hafeez	a39ef5f215	ensure that recent and last message is from user role	2025-05-27 19:12:45 -07:00
Adil Hafeez	a74118238c	Use heuristic based tokenizer	2025-05-27 17:35:43 -07:00
Adil Hafeez	d1542b988a	trim conversation if it exceed max limit of what router model can handle	2025-05-27 14:37:29 -07:00
Adil Hafeez	99dd900a34	fix panic in brightstaff (#485) ... make router section optional in arch_config	2025-05-23 09:37:25 -07:00
Adil Hafeez	d050dfb85a	When router usage is defined ensure that router model is defined too (#481)	2025-05-23 08:46:12 -07:00
Adil Hafeez	218e9c540d	Add support for json based content types in Message (#480)	2025-05-23 00:51:53 -07:00
Adil Hafeez	27c0f2fdce	Introduce brightstaff a new terminal service for llm routing (#477)	2025-05-19 09:59:22 -07:00