issue: api/version not found #24

New issue

Closed

opened 2026-04-16 10:40:03 +02:00 by JTHesse · 2 comments

JTHesse commented

2026-04-16 10:40:03 +02:00

For openai compatible endpoints, in my case vllm, each health request will trigger:

[fetch.endpoint_details] Error while contacting http://0.0.0.0:8000/v1/api/version: 404: {"detail":"Not Found"}

I think the issue is that the health route is not distinguishing between ollama and openai endpoints:

tasks = [fetch.endpoint_details(ep, "/api/version", "version", skip_error_cache=True) for ep in config.endpoints] # if not is_ext_openai_endpoint(ep)]

For openai compatible endpoints, in my case vllm, each health request will trigger: `[fetch.endpoint_details] Error while contacting http://0.0.0.0:8000/v1/api/version: 404: {"detail":"Not Found"}` I think the issue is that the health route is not distinguishing between ollama and openai endpoints: `tasks = [fetch.endpoint_details(ep, "/api/version", "version", skip_error_cache=True) for ep in config.endpoints] # if not is_ext_openai_endpoint(ep)] `

alpha-nerd self-assigned this 2026-04-16 11:02:41 +02:00

alpha-nerd commented

2026-04-16 11:05:27 +02:00

Owner

as ollama also provides a /v1 endpoint there is logic to seperate ollama endpoints and "regular" openai compatible endpoints.
it seems to not be triggered successfully in this case.

can you please provide information how you configured the vllm endpoint in config?
It will help debugging.
many thanks.

as ollama also provides a /v1 endpoint there is logic to seperate ollama endpoints and "regular" openai compatible endpoints. it seems to not be triggered successfully in this case. can you please provide information how you configured the vllm endpoint in config? It will help debugging. many thanks.

alpha-nerd referenced this issue from a commit

2026-04-16 12:18:45 +02:00

fix: health check all endpoints with right per enpoint path

alpha-nerd referenced this issue

2026-04-16 12:26:49 +02:00

dev-v0.7.x -> main #25

alpha-nerd commented

2026-04-16 12:32:47 +02:00

Owner

refactored code should work now for all endpoints reliably.
feel free to re-open if it doesn't work with your specific config.
thanks for reporting this @JTHesse - highly appreaciated!

refactored code should work now for all endpoints reliably. feel free to re-open if it doesn't work with your specific config. thanks for reporting this @JTHesse - highly appreaciated!

👍 1

alpha-nerd

2026-04-16 12:32:49 +02:00