apunkt/plano
1
0
Fork 0
mirror of https://github.com/katanemo/plano.git synced 2026-05-30 14:25:15 +02:00
Code Issues Projects Releases Packages Wiki Activity

add support for custom llm with ssl support (#380)

Browse source 
* add support for custom llm with ssl support

Add support for using custom llm that are served through https protocol.

* add instructions on how to add custom inference endpoint

* fix formatting

* add more details

* Apply suggestions from code review

Co-authored-by: Salman Paracha <salman.paracha@gmail.com>

* Apply suggestions from code review

* fix precommit

---------

Co-authored-by: Salman Paracha <salman.paracha@gmail.com>
This commit is contained in:
Adil Hafeez 2025-01-24 17:14:24 -08:00 • committed by GitHub
parent 2c67fa3bc0
commit 38f7691163
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
4 changed files with 43 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

1
demos/currency_exchange_ollama/arch_config.yaml
View file

@ -7,6 +7,7 @@ listener:
connect_timeout: 0.005s
llm_providers:
- name: local-llama
provider_interface: openai
model: llama3.2