apunkt/plano
1
0
Fork 0
mirror of https://github.com/katanemo/plano.git synced 2026-04-29 10:56:35 +02:00
Code Issues Projects Releases Packages Wiki Activity Actions

fix fc integration (#110)

Browse source 
* fix fc integration

* fix integration

* remove file

* Update arch_fc.py
This commit is contained in:
Co Tran 2024-10-01 19:20:28 -07:00 • committed by GitHub
parent f0fb4a48cd
commit ed50d29ccf
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
3 changed files with 4 additions and 5 deletions
Download patch file Download diff file Expand all files Collapse all files

2
model_server/app/arch_fc/arch_fc.py
View file

@ -19,7 +19,7 @@ fc_url = os.getenv("FC_URL", ollama_endpoint)
mode = os.getenv("MODE", "cloud")
if mode not in ["cloud", "local-gpu", "local-cpu"]:
raise ValueError(f"Invalid mode: {mode}")
arch_api_key = os.getenv("ARCH_API_KEY", "")
arch_api_key = os.getenv("ARCH_API_KEY", "vllm")
logger = logging.getLogger("uvicorn.error")
handler = None