Adil Hafeez
eff4cd9826
improve response handling ( #71 )
2024-09-23 22:56:35 -07:00
Co Tran
79b1c5415f
[Kan-103] add support toxic/jailbreak model ( #49 )
...
* add toxic/jailbreak model
* fix path loading model
* fix syntax
* fix bug,lint, format
* fix bug
* formatting
* add parallel + chunking
* fix bug
* working version
* fix onnnx name erorr
* device
* fix jailbreak config
* fix syntax error
* format
* add requirement + cli download for dockerfile
* add task
* add skeleton change for envoy filter for prompt guard
* fix hardware config
* fix bug
* add config changes
* add gitignore
* merge main
* integrate arch-guard with filter
* add hardware config
* nothing
* add hardware config feature
* fix requirement
* fix chat ui
* fix onnx
* fix lint
* remove non intel cpu
* remove onnx
* working version
* modify docker
* fix guard time
* add nvidia support
* remove nvidia
* add gpu
* add gpu
* add gpu support
* add gpu support for compose
* add gpu support for compose
* add gpu support for compose
* add gpu support for compose
* add gpu support for compose
* fix docker file
* fix int test
* correct gpu docker
* upgrad python 10
* fix logits to be gpu compatible
* default to cpu dockerfile
* resolve comments
* fix lint + unused parameters
* fix
* remove eetq install for cpu
* remove deploy gpu
---------
Co-authored-by: Adil Hafeez <adil@katanemo.com>
2024-09-23 12:07:31 -07:00
Adil Hafeez
31f26ef7ac
move demo functions out of model_server ( #67 )
...
* pending
* remove
* fix docker build
2024-09-20 14:38:10 -07:00
Sampreeth Sarma
ed6a9139e6
demos for network copilot and sql analyzer ( #57 )
...
* pulled from main branch after adding enums and made changes
* added sql_analyzer folder and built a demo for Employee stats function calling. "top_employees" and "aggregate_stats".
* sql_anayzer
* After addressing PR comments
* PR comments
* PR comments
* Addeed Network Analyzer FC Code
* Added network Analyzer code for diff timeframes
* Network Copilot and Employee Details demos are updated with their descriptions and resolved the PR comments
* Added 2nd function in network copilot
* Added 2nd function in network copilot
* Added 2nd function in network copilot
* Added 2nd function in network copilot
* Added 2nd function in network copilot
2024-09-19 11:40:31 -07:00
Adil Hafeez
215d276acf
send all tools when sending request to arch-fc ( #59 )
2024-09-18 15:54:40 -07:00
Adil Hafeez
060a0d665e
improve service names ( #54 )
...
- embedding-server => model_server
- public-types => public_types
- chatbot-ui => chatbot_ui
- function-calling => function_calling
2024-09-17 08:47:35 -07:00
