trustgraph/trustgraph_configurator/resources/dialog/docs/model/vllm-k8s.md at 74cc8a4685823b3c561a15a3bc71bc5fcc650f86

mirror of https://github.com/trustgraph-ai/trustgraph.git synced 2026-07-02 02:58:10 +02:00

elpresidank 74cc8a4685 Squashed 'ai-context/trustgraph-templates/' content from commit 42a5fd1b

git-subtree-dir: ai-context/trustgraph-templates
git-subtree-split: 42a5fd1b678f32be378062e30451e2052ccb95dd

2026-04-05 21:09:49 -05:00

The vLLM service URL must be provided in a Kubernetes secret.

kubectl -n {{namespace}} \
    create secret generic vllm-credentials \
    --from-literal=vllm-url=http://vllm:8000/v1

Replace the URL with the URL of your vLLM service.