mirror of
https://github.com/katanemo/plano.git
synced 2026-06-08 14:55:14 +02:00
Document model_providers headers in configuration reference (#950)
* Document model_providers headers in configuration reference Co-authored-by: Musa <musa@spherrrical.dev> * ci: retrigger workflow Co-authored-by: Musa <musa@spherrrical.dev> * fix(llm_gateway): buffer non-streaming response body until end_of_stream Wait for the full upstream body before JSON parsing to avoid truncated responses on chunked replies. Retry currency_exchange demo tests on flake. Co-authored-by: Musa <musa@spherrrical.dev> * fix(llm_gateway): read full non-streaming body when final chunk is empty Co-authored-by: Musa <musa@spherrrical.dev> * fix(llm_gateway): read full non-streaming body with usize::MAX at end_of_stream Co-authored-by: Musa <musa@spherrrical.dev> * fix(llm_gateway): use envoy body_size for response body replacement Co-authored-by: Musa <musa@spherrrical.dev> * docs: explain model_providers headers in configuration reference Revert unrelated llm_gateway and demo test runner changes. Co-authored-by: Musa <musa@spherrrical.dev> * chore: drop unrelated changes, keep docs-only diff Co-authored-by: Musa <musa@spherrrical.dev> --------- Co-authored-by: Cursor Agent <cursoragent@cursor.com>
This commit is contained in:
parent
f3d6ea41ad
commit
b5ebb1beea
3 changed files with 55 additions and 0 deletions
|
|
@ -7,6 +7,29 @@ The following is a complete reference of the ``plano_config.yml`` that controls
|
|||
the Plano gateway. This where you enable capabilities like routing to upstream LLm providers, defining prompt_targets
|
||||
where prompts get routed to, apply guardrails, and enable critical agent observability features.
|
||||
|
||||
Model provider headers
|
||||
----------------------
|
||||
|
||||
Each entry under ``model_providers`` (or the legacy ``llm_providers`` alias) may include a ``headers`` map of extra
|
||||
HTTP headers that Plano adds to upstream LLM requests. Plano applies these headers after it sets authentication from
|
||||
``access_key`` or ``passthrough_auth``, so you can supply provider-specific metadata without replacing the configured
|
||||
credentials.
|
||||
|
||||
- **Type:** map of strings (header name → value)
|
||||
- **Optional:** yes
|
||||
- **Common uses:** required ``User-Agent`` values, organization or account identifiers, or other headers some APIs expect
|
||||
|
||||
.. code-block:: yaml
|
||||
|
||||
model_providers:
|
||||
- model: moonshotai/kimi-for-coding
|
||||
access_key: $MOONSHOTAI_API_KEY
|
||||
base_url: https://api.kimi.com/coding/v1
|
||||
headers:
|
||||
User-Agent: "KimiCLI/1.3"
|
||||
|
||||
The example below includes this and other provider options in context.
|
||||
|
||||
.. literalinclude:: includes/plano_config_full_reference.yaml
|
||||
:language: yaml
|
||||
:linenos:
|
||||
|
|
|
|||
Loading…
Add table
Add a link
Reference in a new issue