mirror of
https://github.com/katanemo/plano.git
synced 2026-04-25 00:36:34 +02:00
743d074184
Some checks are pending
CI / pre-commit (push) Waiting to run
CI / plano-tools-tests (push) Waiting to run
CI / native-smoke-test (push) Waiting to run
CI / docker-build (push) Waiting to run
CI / validate-config (push) Waiting to run
CI / security-scan (push) Blocked by required conditions
CI / test-prompt-gateway (push) Blocked by required conditions
CI / test-model-alias-routing (push) Blocked by required conditions
CI / test-responses-api-with-state (push) Blocked by required conditions
CI / e2e-plano-tests (3.10) (push) Blocked by required conditions
CI / e2e-plano-tests (3.11) (push) Blocked by required conditions
CI / e2e-plano-tests (3.12) (push) Blocked by required conditions
CI / e2e-plano-tests (3.13) (push) Blocked by required conditions
CI / e2e-plano-tests (3.14) (push) Blocked by required conditions
CI / e2e-demo-preference (push) Blocked by required conditions
CI / e2e-demo-currency (push) Blocked by required conditions
Publish docker image (latest) / build-arm64 (push) Waiting to run
Publish docker image (latest) / build-amd64 (push) Waiting to run
Publish docker image (latest) / create-manifest (push) Blocked by required conditions
Build and Deploy Documentation / build (push) Waiting to run
* feat: add initial documentation for Plano Agent Skills * feat: readme with examples * feat: add detailed skills documentation and examples for Plano --------- Co-authored-by: Adil Hafeez <adil.hafeez@gmail.com>
64 lines
2.2 KiB
Markdown
64 lines
2.2 KiB
Markdown
---
|
|
title: Register Model Providers with Correct Format Identifiers
|
|
impact: CRITICAL
|
|
impactDescription: Incorrect provider format causes request translation failures — Plano must know the wire format each provider expects
|
|
tags: config, model-providers, llm, api-format
|
|
---
|
|
|
|
## Register Model Providers with Correct Format Identifiers
|
|
|
|
Plano translates requests between its internal format and each provider's API. The `model` field uses `provider/model-name` syntax which determines both the upstream endpoint and the request/response translation layer. Some providers require an explicit `provider_interface` override.
|
|
|
|
**Provider format reference:**
|
|
|
|
| Model prefix | Wire format | Example |
|
|
|---|---|---|
|
|
| `openai/*` | OpenAI | `openai/gpt-4o` |
|
|
| `anthropic/*` | Anthropic | `anthropic/claude-sonnet-4-20250514` |
|
|
| `gemini/*` | Google Gemini | `gemini/gemini-2.0-flash` |
|
|
| `mistral/*` | Mistral | `mistral/mistral-large-latest` |
|
|
| `groq/*` | Groq | `groq/llama-3.3-70b-versatile` |
|
|
| `deepseek/*` | DeepSeek | `deepseek/deepseek-chat` |
|
|
| `xai/*` | Grok (OpenAI-compat) | `xai/grok-2` |
|
|
| `together_ai/*` | Together.ai | `together_ai/meta-llama/Llama-3` |
|
|
| `custom/*` | Requires `provider_interface` | `custom/my-local-model` |
|
|
|
|
**Incorrect (missing provider prefix, ambiguous format):**
|
|
|
|
```yaml
|
|
model_providers:
|
|
- model: gpt-4o # Missing openai/ prefix — Plano cannot route this
|
|
access_key: $OPENAI_API_KEY
|
|
|
|
- model: claude-3-5-sonnet # Missing anthropic/ prefix
|
|
access_key: $ANTHROPIC_API_KEY
|
|
```
|
|
|
|
**Correct (explicit provider prefixes):**
|
|
|
|
```yaml
|
|
model_providers:
|
|
- model: openai/gpt-4o
|
|
access_key: $OPENAI_API_KEY
|
|
default: true
|
|
|
|
- model: anthropic/claude-sonnet-4-20250514
|
|
access_key: $ANTHROPIC_API_KEY
|
|
|
|
- model: gemini/gemini-2.0-flash
|
|
access_key: $GOOGLE_API_KEY
|
|
```
|
|
|
|
**For local or self-hosted models (Ollama, LiteLLM, vLLM):**
|
|
|
|
```yaml
|
|
model_providers:
|
|
- model: custom/llama3
|
|
base_url: http://host.docker.internal:11434/v1 # Ollama endpoint
|
|
provider_interface: openai # Ollama speaks OpenAI format
|
|
default: true
|
|
```
|
|
|
|
Always set `default: true` on exactly one provider per listener so Plano has a fallback when routing preferences do not match.
|
|
|
|
Reference: https://github.com/katanemo/archgw
|