Add support for multiple LLM Providers (#60)

Signed-off-by: José Ulises Niño Rivera <junr03@users.noreply.github.com>
This commit is contained in:
José Ulises Niño Rivera 2024-09-24 17:13:55 -07:00 committed by GitHub
parent 87900beddd
commit bd8206742a
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
12 changed files with 456 additions and 127 deletions

View file

@ -108,6 +108,7 @@ services:
- "18080:8080"
environment:
- OPENAI_API_KEY=${OPENAI_API_KEY:?error}
- MISTRAL_API_KEY=${MISTRAL_API_KEY:?error}
- CHAT_COMPLETION_ENDPOINT=http://bolt:10000/v1
prometheus: