Commit graph

19 commits

Author SHA1 Message Date
fbce181a81
Add files via upload
herding ollamas
- added management functions to dashboard and updated routes in backend
2025-09-04 15:00:50 +02:00
2f09dbe22c
Add files via upload
adding dashboard copy link
adding copy get route for dashboard
2025-09-04 10:39:10 +02:00
2ead1112e7
Add files via upload
centralizing remote endpoint secrets management for unified endpoints
2025-09-03 18:01:39 +02:00
d257073cb1
Add files via upload
preparations for /v1 endpoints with auth
2025-09-03 16:34:41 +02:00
0a456e6e21
Add files via upload
fixing v1/models
2025-09-02 16:24:00 +02:00
9f32fcf75d
Add files via upload
fixing /v1/models:
- relabel model.id with model.name for OpenAI compliance
2025-09-02 14:44:21 +02:00
7ed872379b
Add files via upload
adding missing authorization headers for open ai endpoints
2025-09-02 13:30:04 +02:00
2c82e5964f
Add files via upload
minor updates
2025-09-01 16:35:22 +02:00
caca498f49
Add files via upload
switching to custom cache logic for faster cache invalidation in faulty cache scenarios
removing aiocache dependency
2025-09-01 13:38:49 +02:00
0c6387f5af
Add files via upload
adding persistent connections for endpoints
adding cache to available models routine
2025-09-01 11:07:07 +02:00
9f19350f55
Add files via upload
improving high load endpoint selection by moving from rr to lc algorithm for connections > max_concurrent_connections
2025-09-01 09:30:23 +02:00
64549b4e1c
Add files via upload
Increasing timeout for heavy load situatuions
2025-09-01 09:01:41 +02:00
295ace0401
Add files via upload
fixing a result type bug in exception handleer
2025-08-31 11:40:13 +02:00
cb7224c030
Add files via upload
Adding:
- health endpoint
- extended /api/config
- frontend extension of backend server viz
2025-08-30 12:43:35 +02:00
9e0b53bba3
Additions
- Frontend
- Internal Monitoring Endpoints
- External OpenAI compatible backends
2025-08-30 00:12:56 +02:00
1403c08a81
enhance routing logic
add a pre-routing model check:
allows for different configs on the ollama backend servers
2025-08-29 13:13:25 +02:00
516ec8b102
Adding OpenAI compatibility
New Endpoints
New Requirements
2025-08-28 09:40:33 +02:00
cdb4485334
Update router.py
added t.b.d. OpenAI API compatible endpoints
2025-08-27 09:23:59 +02:00
5f1f3f7b57
Initial commit 2025-08-26 18:19:43 +02:00