apunkt/plano
1
0
Fork 0
mirror of https://github.com/katanemo/plano.git synced 2026-05-15 11:02:39 +02:00
Code Issues Projects Releases Packages Wiki Activity

fixed issue with groq LLMs that require the openai in the /v1/chat/co… (#460)

Browse source 
* fixed issue with groq LLMs that require the openai in the /v1/chat/completions path. My first change

* updated the GH actions with keys for Groq

* adding missing groq API keys

* add llama-3.2-3b-preview to the model based on addin groq to the demo

---------

Co-authored-by: Salman Paracha <salmanparacha@MacBook-Pro-261.local>
This commit is contained in:
Salman Paracha 2025-04-13 14:00:16 -07:00 • committed by GitHub
parent e7b0de2a72
commit f31aa59fac
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
9 changed files with 35 additions and 16 deletions
Download patch file Download diff file Expand all files Collapse all files

2
crates/prompt_gateway/src/http_context.rs
View file

@ -61,7 +61,7 @@ impl HttpContext for StreamContext {
return Action::Continue;
}
self.is_chat_completions_request = request_path == CHAT_COMPLETIONS_PATH;
self.is_chat_completions_request = CHAT_COMPLETIONS_PATH.contains(&request_path.as_str());
debug!(
"on_http_request_headers S[{}] req_headers={:?}",