feat: completion errors on an endpoint:model key a caught, cached and rerouted (openai compatible endpoints) #87
No reviewers
Labels
No labels
bug
dependencies
duplicate
enhancement
help wanted
invalid
question
renovate: stop-updating
wontfix
bug
duplicate
enhancement
help wanted
invalid
question
renovate: stop-updating
security
wontfix
No milestone
No project
No assignees
1 participant
Notifications
Due date
No due date set.
Dependencies
No dependencies set.
Reference: nomyo-ai/nomyo-router#87
Loading…
Add table
Add a link
Reference in a new issue
No description provided.
Delete branch "dev-0.9.x-completion-error-cache"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
propagates completion errors on openai endpoints upstream to flag model errors but healthy endpoints