mirror of
https://github.com/katanemo/plano.git
synced 2026-04-25 00:36:34 +02:00
Add support for Amazon Bedrock Converse and ConverseStream (#588)
* first commit to get Bedrock Converse API working. Next commit support for streaming and binary frames * adding translation from BedrockBinaryFrameDecoder to AnthropicMessagesEvent * Claude Code works with Amazon Bedrock * added tests for openai streaming from bedrock * PR comments fixed * adding support for bedrock in docs as supported provider * cargo fmt * revertted to chatgpt models for claude code routing --------- Co-authored-by: Salman Paracha <salmanparacha@MacBook-Pro-288.local> Co-authored-by: Adil Hafeez <adil.hafeez@gmail.com>
This commit is contained in:
parent
ba826b1961
commit
9407ae6af7
35 changed files with 7362 additions and 1493 deletions
|
|
@ -517,6 +517,36 @@ Azure OpenAI
|
|||
access_key: $AZURE_OPENAI_API_KEY
|
||||
base_url: https://your-resource.openai.azure.com
|
||||
|
||||
Amazon Bedrock
|
||||
~~~~~~~~~~~~~~
|
||||
|
||||
**Provider Prefix:** ``amazon_bedrock/``
|
||||
|
||||
**API Endpoint:** Arch automatically constructs the endpoint as:
|
||||
- Non-streaming: ``/model/{model-id}/converse``
|
||||
- Streaming: ``/model/{model-id}/converse-stream``
|
||||
|
||||
**Authentication:** AWS Bearer Token + Base URL - Get your API Keys from `AWS Bedrock Console <https://console.aws.amazon.com/bedrock/>`_ → Discover → API Keys.
|
||||
|
||||
**Supported Chat Models:** All Amazon Bedrock foundation models including Claude (Anthropic), Nova (Amazon), Llama (Meta), Mistral AI, and Cohere Command models.
|
||||
|
||||
.. code-block:: yaml
|
||||
|
||||
llm_providers:
|
||||
# Amazon Nova models
|
||||
- model: amazon_bedrock/us.amazon.nova-premier-v1:0
|
||||
access_key: $AWS_BEARER_TOKEN_BEDROCK
|
||||
base_url: https://bedrock-runtime.us-west-2.amazonaws.com
|
||||
default: true
|
||||
|
||||
- model: amazon_bedrock/us.amazon.nova-pro-v1:0
|
||||
access_key: $AWS_BEARER_TOKEN_BEDROCK
|
||||
base_url: https://bedrock-runtime.us-west-2.amazonaws.com
|
||||
|
||||
# Claude on Bedrock
|
||||
- model: amazon_bedrock/us.anthropic.claude-3-5-sonnet-20241022-v2:0
|
||||
access_key: $AWS_BEARER_TOKEN_BEDROCK
|
||||
base_url: https://bedrock-runtime.us-west-2.amazonaws.com
|
||||
|
||||
Qwen (Alibaba)
|
||||
~~~~~~~~~~~~~~
|
||||
|
|
@ -540,8 +570,7 @@ Qwen (Alibaba)
|
|||
# Multiple deployments
|
||||
- model: qwen/qwen3-coder
|
||||
access_key: $DASHSCOPE_API_KEY
|
||||
base_url: "https://dashscope-intl.aliyuncs.com",
|
||||
|
||||
base_url: "https://dashscope-intl.aliyuncs.com"
|
||||
|
||||
Ollama
|
||||
~~~~~~
|
||||
|
|
|
|||
Loading…
Add table
Add a link
Reference in a new issue