plano/crates/prompt_gateway/src
Salman Paracha 88c2bd1851
removing model_server python module to brightstaff (function calling) (#615)
* adding function_calling functionality via rust

* fixed rendered YAML file

* removed model_server from envoy.template and forwarding traffic to bright_staff

* fixed bugs in function_calling.rs that were breaking tests. All good now

* updating e2e test to clean up disk usage

* removing Arch* models to be used as a default model if one is not specified

* if the user sets arch-function base_url we should honor it

* fixing demos as we needed to pin to a particular version of huggingface_hub else the chatbot ui wouldn't build

* adding a constant for Arch-Function model name

* fixing some edge cases with calls made to Arch-Function

* fixed JSON parsing issues in function_calling.rs

* fixed bug where the raw response from Arch-Function was re-encoded

* removed debug from supervisord.conf

* commenting out disk cleanup

* adding back disk space

---------

Co-authored-by: Salman Paracha <salmanparacha@MacBook-Pro-288.local>
Co-authored-by: Salman Paracha <salmanparacha@MacBook-Pro-342.local>
2025-11-22 12:55:00 -08:00
..
context.rs log improvements and some code refactor (#379) 2025-01-31 10:37:53 -08:00
filter_context.rs add preliminary support for llm agents (#432) 2025-03-19 15:21:34 -07:00
http_context.rs Add support for updating model preferences (#510) 2025-07-02 14:08:19 -07:00
lib.rs Encode parameter values in http path and ... (#395) 2025-02-06 11:00:47 -08:00
metrics.rs Break apart metrics into their own module (#335) 2024-12-09 10:46:46 -08:00
stream_context.rs removing model_server python module to brightstaff (function calling) (#615) 2025-11-22 12:55:00 -08:00
tools.rs add preliminary support for llm agents (#432) 2025-03-19 15:21:34 -07:00