Adil Hafeez
285aa1419b
Split listener ( #141 )
2024-10-08 16:24:08 -07:00
Salman Paracha
82fc91495e
Salmanap/fix demos ( #140 )
...
* Comitting to bring in main
* insurance agent updated
* updated the insurance agent
---------
Co-authored-by: Salman Paracha <salmanparacha@MacBook-Pro-261.local>
2024-10-07 20:27:07 -07:00
Co Tran
b1fa127704
Hallucination integration with rust ( #122 )
2024-10-07 18:38:55 -07:00
Shuguang Chen
5bfccd3959
Update arch_config.yaml ( #137 )
2024-10-07 16:01:12 -07:00
Adil Hafeez
2a747df7c0
don't compute embeddings for names and other fixes see description ( #126 )
...
* serialize tools - 2
* fix int tests
* fix int test
* fix unit tests
2024-10-05 19:25:16 -07:00
Salman Paracha
0e5ea3d6db
Salmanap/fix config generator ( #124 )
...
* fixed environment variables issue with build. Now llm provider access keys are being written correctly
* fixed and verified that keys are being properly set when archgw is booted up
* removing leaf reference to a staged config file. not needed anymore
* minor fixes to get the build in more stable state
* minor fixes based on feedback
---------
Co-authored-by: Salman Paracha <salmanparacha@MacBook-Pro-261.local>
2024-10-05 10:49:47 -07:00
Salman Paracha
dc57f119a0
archgw cli ( #117 )
...
* initial commit of the insurange agent demo, with the CLI tool
* committing the cli
* fixed some field descriptions for generate-prompt-targets
* CLI works with buil, up and down commands. Function calling example works stand-alone
* fixed README to install archgw cli
* fixing based on feedback
* fixing based on feedback
---------
Co-authored-by: Salman Paracha <salmanparacha@MacBook-Pro-261.local>
2024-10-03 18:21:27 -07:00
José Ulises Niño Rivera
8ea917aae5
Add the ability to use LLM Providers from the Arch config ( #112 )
...
Signed-off-by: José Ulises Niño Rivera <junr03@users.noreply.github.com>
2024-10-03 10:57:01 -07:00
Adil Hafeez
1b57a49c9d
add support for default target ( #111 )
...
* add support for default target
* add more fixes
2024-10-02 20:43:16 -07:00
Co Tran
ed50d29ccf
fix fc integration ( #110 )
...
* fix fc integration
* fix integration
* remove file
* Update arch_fc.py
2024-10-01 19:20:28 -07:00
Aayush
f0fb4a48cd
change root to config in config_generator as well as remove old line 17 from function calling docker compose ( #108 )
2024-10-01 15:40:55 -07:00
Adil Hafeez
dbb8f87787
update path for arch_config.yaml file ( #107 )
2024-10-01 13:28:53 -07:00
Co Tran
17a643c410
ArchFC endpoint integration ( #94 )
...
* integration
* mopdify docker file
* add params and fix python lint
* fix empty context and tool calls
* address comments
* revert port
* fix bug merge
* fix environment
* fix bug
* fix compose
* fix merge
2024-10-01 12:47:26 -07:00
Adil Hafeez
1a7c1ad0a5
rename archgw_model_sever => model_server ( #106 )
2024-10-01 11:24:43 -07:00
Salman Paracha
8654d3d5c5
simplify developer getting started experience ( #102 )
...
* Fixed build. Now, we have a bare bones version of the docker-compose file with only two services, archgw and archgw-model-server. Tested using CLI
* some pre-commit fixes
* fixed cargo formatting issues
* fixed model server conflict changes
---------
Co-authored-by: Salman Paracha <salmanparacha@MacBook-Pro-261.local>
2024-10-01 10:02:23 -07:00
Adil Hafeez
41cdef590a
arch schema validator ( #105 )
...
* add arch schema validator
* schema validator
2024-10-01 09:22:08 -07:00
Adil Hafeez
15869825e3
add messages in params when making api calls ( #104 )
2024-10-01 09:14:01 -07:00
Adil Hafeez
f4395d39f9
Fold function_resolver into model_server ( #103 )
2024-10-01 09:13:50 -07:00
Adil Hafeez
cc35eb0cd7
update config ( #93 )
2024-09-30 17:49:05 -07:00
Aayush
1e61452310
changes prometheus config target to arch so that data collection works ( #98 )
2024-09-30 14:35:21 -07:00
Adil Hafeez
bb746e237a
add support for 3b model ( #96 )
2024-09-30 09:54:58 -07:00
Adil Hafeez
4d7c07a63c
update ctx size to 4k
2024-09-29 17:13:05 -07:00
Adil Hafeez
ea86f73605
rename envoyfilter => arch ( #91 )
...
* rename envoyfilter => arch
* fix more files
* more fixes
* more renames
2024-09-27 16:41:39 -07:00
Adil Hafeez
8a4e11077c
update arch-fc parameters
2024-09-27 13:34:10 -07:00
Adil Hafeez
75cf5e5304
Add supported parameter type, validation and tests ( #88 )
...
* Add supported parameter type and validation
* make the tools format more compliant with openai
* more updates
* fix more
* fix unit test
2024-09-27 13:33:05 -07:00
Adil Hafeez
774c389951
add bolt support ( #90 )
...
* add support for bolt
* improve logging
* add support for bolt-fc
* fix int tests
2024-09-26 17:47:01 -07:00
Adil Hafeez
e3a835e5d3
expose access logs from envoy ( #89 )
2024-09-26 16:03:48 -07:00
Adil Hafeez
3511798fa8
Integrate Arch-Function-Calling-1.5B model ( #85 )
...
* add arch support
* add missing file
* e2e tests
* delete old files and fix response
* fmt
2024-09-25 23:30:50 -07:00
José Ulises Niño Rivera
9ea6bb0d73
Revert "Revert "Add support for multiple LLM Providers ( #60 )"" ( #83 )
...
* Revert "Revert "Add support for multiple LLM Providers (#60 )""
This reverts commit 43d6bc80e9 .
* wip
Signed-off-by: José Ulises Niño Rivera <junr03@users.noreply.github.com>
* Revert "wip"
This reverts commit 7c4dde5d1f .
* fix parameter name
Signed-off-by: José Ulises Niño Rivera <junr03@users.noreply.github.com>
* force use openai
---------
Signed-off-by: José Ulises Niño Rivera <junr03@users.noreply.github.com>
Co-authored-by: Adil Hafeez <adil@katanemo.com>
2024-09-25 23:15:17 -07:00
Adil Hafeez
43d6bc80e9
Revert "Add support for multiple LLM Providers ( #60 )"
...
This reverts commit bd8206742a .
2024-09-25 08:15:22 -07:00
José Ulises Niño Rivera
bd8206742a
Add support for multiple LLM Providers ( #60 )
...
Signed-off-by: José Ulises Niño Rivera <junr03@users.noreply.github.com>
2024-09-24 17:13:55 -07:00
Adil Hafeez
685144bbd7
fix demos code ( #76 )
2024-09-24 14:34:22 -07:00
Adil Hafeez
16a8927889
add details on how to use grafana dashboards ( #72 )
2024-09-24 11:51:31 -07:00
Adil Hafeez
eff4cd9826
improve response handling ( #71 )
2024-09-23 22:56:35 -07:00
Adil Hafeez
31f26ef7ac
move demo functions out of model_server ( #67 )
...
* pending
* remove
* fix docker build
2024-09-20 14:38:10 -07:00
Adil Hafeez
97b47c2ab4
Include param default in parameters ( #68 )
...
* Include param default in parameters
* improve default param pr
* fix integration tests
2024-09-20 09:02:24 -07:00
Adil Hafeez
4438dc7979
remove embeddings config from config ( #64 )
...
* remove embeddings config from config
* remove embedding provider
2024-09-19 17:49:42 -07:00
Adil Hafeez
3215d81e58
fix webui url and dependencies ( #66 )
2024-09-19 17:48:50 -07:00
Adil Hafeez
a91fbdbf1c
Add ability to define clusters in config ( #61 )
2024-09-18 20:03:26 -07:00
Adil Hafeez
215d276acf
send all tools when sending request to arch-fc ( #59 )
2024-09-18 15:54:40 -07:00
Adil Hafeez
3135ba8eae
add ability to override default values from config ( #58 )
2024-09-17 22:37:58 -07:00
Adil Hafeez
118bff7c7e
add open-webui
2024-09-17 16:08:13 -07:00
Adil Hafeez
b8841fb8f4
rename bolt-config => bolt_config
2024-09-17 08:56:47 -07:00
Adil Hafeez
060a0d665e
improve service names ( #54 )
...
- embedding-server => model_server
- public-types => public_types
- chatbot-ui => chatbot_ui
- function-calling => function_calling
2024-09-17 08:47:35 -07:00