apunkt/plano
1
0
Fork 0
mirror of https://github.com/katanemo/plano.git synced 2026-04-29 02:46:28 +02:00
Code Issues Projects Releases Packages Wiki Activity Actions

Remove top level container and start snake-case for config files (#27)

Browse source 
t
This commit is contained in:
Adil Hafeez 2024-07-31 14:05:52 -07:00 • committed by GitHub
parent b8ea65d858
commit 9774148c75
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
6 changed files with 71 additions and 133 deletions
Download patch file Download diff file Expand all files Collapse all files

31
envoyfilter/envoy.yaml
View file

@ -58,31 +58,31 @@ static_resources:
configuration:
"@type": "type.googleapis.com/google.protobuf.StringValue"
value: |
katanemo-prompt-config:
default-prompt-endpoint: "127.0.0.1"
load-balancing: "round-robin"
timeout-ms: 5000
katanemo_prompt_config:
default_prompt_endpoint: "127.0.0.1"
load_balancing: "round_robin"
timeout_ms: 5000
embedding-provider:
embedding_provider:
name: "SentenceTransformer"
model: "all-MiniLM-L6-v2"
llm-providers:
llm_providers:
- name: "open-ai-gpt-4"
api-key: "$OPEN_AI_API_KEY"
api_key: "$OPEN_AI_API_KEY"
model: gpt-4
system-prompt: |
system_prompt: |
You are a helpful weather forecaster. Use weater data that is provided to you. Please following following guidelines when responding to user queries:
- Use farenheight for temperature
- Use miles per hour for wind speed
prompt-targets:
prompt_targets:
- type: context-resolver
name: weather-forecast
few-shot-examples:
- type: context_resolver
name: weather_forecast
few_shot_examples:
- what is the weather in New York?
- how is the weather in San Francisco?
- what is the forecast in Seattle?
@ -91,12 +91,7 @@ static_resources:
endpoint:
cluster: weatherhost
path: /weather
cache-response: true
cache-response-settings:
- cache-ttl-secs: 3600 # cache expiry in seconds
- cache-max-size: 1000 # in number of items
- cache-eviction-strategy: LRU
system-prompt: |
system_prompt: |
You are a helpful weather forecaster. Use weater data that is provided to you. Please following following guidelines when responding to user queries:
- Use farenheight for temperature
- Use miles per hour for wind speed