Commit graph

17 commits

Author SHA1 Message Date
Salman Paracha
8654d3d5c5
simplify developer getting started experience (#102)
* Fixed build. Now, we have a bare bones version of the docker-compose file with only two services, archgw and archgw-model-server. Tested using CLI

* some pre-commit fixes

* fixed cargo formatting issues

* fixed model server conflict changes

---------

Co-authored-by: Salman Paracha <salmanparacha@MacBook-Pro-261.local>
2024-10-01 10:02:23 -07:00
Adil Hafeez
f4395d39f9
Fold function_resolver into model_server (#103) 2024-10-01 09:13:50 -07:00
Adil Hafeez
bb746e237a
add support for 3b model (#96) 2024-09-30 09:54:58 -07:00
Adil Hafeez
ea86f73605
rename envoyfilter => arch (#91)
* rename envoyfilter => arch

* fix more files

* more fixes

* more renames
2024-09-27 16:41:39 -07:00
Adil Hafeez
75cf5e5304
Add supported parameter type, validation and tests (#88)
* Add supported parameter type and validation

* make the tools format more compliant with openai

* more updates

* fix more

* fix unit test
2024-09-27 13:33:05 -07:00
Adil Hafeez
774c389951
add bolt support (#90)
* add support for bolt

* improve logging

* add support for bolt-fc

* fix int tests
2024-09-26 17:47:01 -07:00
Adil Hafeez
e3a835e5d3
expose access logs from envoy (#89) 2024-09-26 16:03:48 -07:00
Adil Hafeez
3511798fa8
Integrate Arch-Function-Calling-1.5B model (#85)
* add arch support

* add missing file

* e2e tests

* delete old files and fix response

* fmt
2024-09-25 23:30:50 -07:00
José Ulises Niño Rivera
9ea6bb0d73
Revert "Revert "Add support for multiple LLM Providers (#60)"" (#83)
* Revert "Revert "Add support for multiple LLM Providers (#60)""

This reverts commit 43d6bc80e9.

* wip

Signed-off-by: José Ulises Niño Rivera <junr03@users.noreply.github.com>

* Revert "wip"

This reverts commit 7c4dde5d1f.

* fix parameter name

Signed-off-by: José Ulises Niño Rivera <junr03@users.noreply.github.com>

* force use openai

---------

Signed-off-by: José Ulises Niño Rivera <junr03@users.noreply.github.com>
Co-authored-by: Adil Hafeez <adil@katanemo.com>
2024-09-25 23:15:17 -07:00
Adil Hafeez
43d6bc80e9 Revert "Add support for multiple LLM Providers (#60)"
This reverts commit bd8206742a.
2024-09-25 08:15:22 -07:00
José Ulises Niño Rivera
bd8206742a
Add support for multiple LLM Providers (#60)
Signed-off-by: José Ulises Niño Rivera <junr03@users.noreply.github.com>
2024-09-24 17:13:55 -07:00
Adil Hafeez
eff4cd9826
improve response handling (#71) 2024-09-23 22:56:35 -07:00
Adil Hafeez
31f26ef7ac
move demo functions out of model_server (#67)
* pending

* remove

* fix docker build
2024-09-20 14:38:10 -07:00
Adil Hafeez
3215d81e58
fix webui url and dependencies (#66) 2024-09-19 17:48:50 -07:00
Adil Hafeez
118bff7c7e add open-webui 2024-09-17 16:08:13 -07:00
Adil Hafeez
b8841fb8f4 rename bolt-config => bolt_config 2024-09-17 08:56:47 -07:00
Adil Hafeez
060a0d665e
improve service names (#54)
- embedding-server => model_server
- public-types => public_types
- chatbot-ui => chatbot_ui
- function-calling => function_calling
2024-09-17 08:47:35 -07:00
Renamed from demos/function-calling/docker-compose.yaml (Browse further)