Commit graph

307 commits

Author SHA1 Message Date
Adil Hafeez
774c389951
add bolt support (#90)
* add support for bolt

* improve logging

* add support for bolt-fc

* fix int tests
2024-09-26 17:47:01 -07:00
Adil Hafeez
e3a835e5d3
expose access logs from envoy (#89) 2024-09-26 16:03:48 -07:00
Salman Paracha
48a2c1800c
V1 docs push (#86)
* updated docs (again)

* updated the LLMs section, prompt processing section and the RAG section of the docs

---------

Co-authored-by: Salman Paracha <salmanparacha@MacBook-Pro-261.local>
2024-09-25 23:43:34 -07:00
Adil Hafeez
3511798fa8
Integrate Arch-Function-Calling-1.5B model (#85)
* add arch support

* add missing file

* e2e tests

* delete old files and fix response

* fmt
2024-09-25 23:30:50 -07:00
José Ulises Niño Rivera
9ea6bb0d73
Revert "Revert "Add support for multiple LLM Providers (#60)"" (#83)
* Revert "Revert "Add support for multiple LLM Providers (#60)""

This reverts commit 43d6bc80e9.

* wip

Signed-off-by: José Ulises Niño Rivera <junr03@users.noreply.github.com>

* Revert "wip"

This reverts commit 7c4dde5d1f.

* fix parameter name

Signed-off-by: José Ulises Niño Rivera <junr03@users.noreply.github.com>

* force use openai

---------

Signed-off-by: José Ulises Niño Rivera <junr03@users.noreply.github.com>
Co-authored-by: Adil Hafeez <adil@katanemo.com>
2024-09-25 23:15:17 -07:00
José Ulises Niño Rivera
370f3bb2c5
Fix bug in PromptGuard configuration (#80)
Signed-off-by: José Ulises Niño Rivera <junr03@users.noreply.github.com>
2024-09-25 23:36:55 -05:00
Adil Hafeez
7d130e102a remove open-message-format 2024-09-25 13:30:40 -07:00
Sampreeth Sarma
7f0fcb372b
Added Float type to the function parameter values (#77) 2024-09-25 13:29:20 -07:00
Adil Hafeez
7505a0fc1f
Update build_docs.sh 2024-09-25 12:07:06 -07:00
Adil Hafeez
bfaabe75f4
send history to bolt fc model (#84) 2024-09-25 12:03:44 -07:00
Adil Hafeez
425a080c96
add readme and docker build (#81) 2024-09-25 10:05:59 -07:00
Adil Hafeez
43d6bc80e9 Revert "Add support for multiple LLM Providers (#60)"
This reverts commit bd8206742a.
2024-09-25 08:15:22 -07:00
Adil Hafeez
d970b214f4
improve logging of api failure (#79) 2024-09-24 23:56:24 -07:00
José Ulises Niño Rivera
bd8206742a
Add support for multiple LLM Providers (#60)
Signed-off-by: José Ulises Niño Rivera <junr03@users.noreply.github.com>
2024-09-24 17:13:55 -07:00
Adil Hafeez
87900beddd
Remove OMF (#78)
* Remove OMF

* remove submodule from github workflow
2024-09-24 15:18:20 -07:00
Adil Hafeez
685144bbd7
fix demos code (#76) 2024-09-24 14:34:22 -07:00
Salman Paracha
13dff3089d
Adil/fix salman docs (#75)
* added the first set of docs for our technical docs

* more docuemtnation changes

* added support for prompt processing and updated life of a request

* updated docs to including getting help sections and updated life of a request

* committing local changes for getting started guide, sample applications, and full reference spec for prompt-config

* updated configuration reference, added sample app skeleton, updated favico

* fixed the configuration refernce file, and made minor changes to the intent detection. commit v1 for now

* Updated docs with use cases and example code, updated what is arch, and made minor changes throughout

* fixed imaged and minor doc fixes

* add sphinx_book_theme

* updated README, and make some minor fixes to documetnation

* fixed README.md

* fixed image width

---------

Co-authored-by: Salman Paracha <salmanparacha@MacBook-Pro-261.local>
Co-authored-by: Adil Hafeez <adil@katanemo.com>
2024-09-24 13:54:17 -07:00
Adil Hafeez
2d31aeaa36 fix debug log 2024-09-24 13:45:30 -07:00
Co Tran
d5d79256b0
remove guard config json (#70)
* remove guard config json

* formating
2024-09-24 13:33:31 -07:00
Adil Hafeez
dd8c43a392
improve cluster not configured error (#73)
* improve cluster not configured error

* dont panic

* update format

* Merge branch 'main' into adil/fix_salman_docs
2024-09-24 13:24:26 -07:00
Adil Hafeez
16a8927889
add details on how to use grafana dashboards (#72) 2024-09-24 11:51:31 -07:00
Adil Hafeez
eff4cd9826
improve response handling (#71) 2024-09-23 22:56:35 -07:00
Co Tran
79b1c5415f
[Kan-103] add support toxic/jailbreak model (#49)
* add toxic/jailbreak model

* fix path loading model

* fix syntax

* fix bug,lint, format

* fix bug

* formatting

* add parallel + chunking

* fix bug

* working version

* fix onnnx name erorr

* device

* fix jailbreak config

* fix syntax error

* format

* add requirement + cli download for dockerfile

* add task

* add skeleton change for envoy filter for prompt guard

* fix hardware config

* fix bug

* add config changes

* add gitignore

* merge main

* integrate arch-guard with filter

* add hardware config

* nothing

* add hardware config feature

* fix requirement

* fix chat ui

* fix onnx

* fix lint

* remove non intel cpu

* remove onnx

* working version

* modify docker

* fix guard time

* add nvidia support

* remove nvidia

* add gpu

* add gpu

* add gpu support

* add gpu support for compose

* add gpu support for compose

* add gpu support for compose

* add gpu support for compose

* add gpu support for compose

* fix docker file

* fix int test

* correct gpu docker

* upgrad python 10

* fix logits to be gpu compatible

* default to cpu dockerfile

* resolve comments

* fix lint + unused parameters

* fix

* remove eetq install for cpu

* remove deploy gpu

---------

Co-authored-by: Adil Hafeez <adil@katanemo.com>
2024-09-23 12:07:31 -07:00
Salman Paracha
80c554ce1a
Docs branch - v1 of our tech docs (#69)
* added the first set of docs for our technical docs

* more docuemtnation changes

* added support for prompt processing and updated life of a request

* updated docs to including getting help sections and updated life of a request

* committing local changes for getting started guide, sample applications, and full reference spec for prompt-config

* updated configuration reference, added sample app skeleton, updated favico

* fixed the configuration refernce file, and made minor changes to the intent detection. commit v1 for now

---------

Co-authored-by: Salman Paracha <salmanparacha@MacBook-Pro-261.local>
Co-authored-by: Adil Hafeez <adil@katanemo.com>
2024-09-20 17:08:42 -07:00
Adil Hafeez
233976a568 comment required param check 2024-09-20 15:49:49 -07:00
Adil Hafeez
31f26ef7ac
move demo functions out of model_server (#67)
* pending

* remove

* fix docker build
2024-09-20 14:38:10 -07:00
Adil Hafeez
ca5c9e4824 improve logging 2024-09-20 10:16:58 -07:00
Sampreeth Sarma
941869ad24
fix similarity bug (#63) 2024-09-20 09:49:28 -07:00
Adil Hafeez
97b47c2ab4
Include param default in parameters (#68)
* Include param default in parameters

* improve default param pr

* fix integration tests
2024-09-20 09:02:24 -07:00
Adil Hafeez
aa73a5aaae
Update Dockerfile 2024-09-19 20:06:38 -07:00
Adil Hafeez
4438dc7979
remove embeddings config from config (#64)
* remove embeddings config from config

* remove embedding provider
2024-09-19 17:49:42 -07:00
José Ulises Niño Rivera
7568507764
Delete unused envoy.yaml file (#65)
Signed-off-by: José Ulises Niño Rivera <junr03@users.noreply.github.com>
2024-09-19 17:49:26 -07:00
Adil Hafeez
3215d81e58
fix webui url and dependencies (#66) 2024-09-19 17:48:50 -07:00
Adil Hafeez
2cd5ec5adf
use openai standard response in arch-fc and in gradio client (#62)
* use openai standard response in arch-fc and in gradio client

also fix code bug in usage

* fix int test
2024-09-19 12:19:14 -07:00
Sampreeth Sarma
ed6a9139e6
demos for network copilot and sql analyzer (#57)
* pulled from main branch after adding enums and made changes

* added sql_analyzer folder and built a demo for Employee stats function calling. "top_employees" and "aggregate_stats".

* sql_anayzer

* After addressing PR comments

* PR comments

* PR comments

* Addeed Network Analyzer FC Code

* Added network Analyzer code for diff timeframes

* Network Copilot and Employee Details demos are updated with their descriptions and resolved the PR comments

* Added 2nd function in network copilot

* Added 2nd function in network copilot

* Added 2nd function in network copilot

* Added 2nd function in network copilot

* Added 2nd function in network copilot
2024-09-19 11:40:31 -07:00
Adil Hafeez
a91fbdbf1c
Add ability to define clusters in config (#61) 2024-09-18 20:03:26 -07:00
Adil Hafeez
215d276acf
send all tools when sending request to arch-fc (#59) 2024-09-18 15:54:40 -07:00
Adil Hafeez
3135ba8eae
add ability to override default values from config (#58) 2024-09-17 22:37:58 -07:00
José Ulises Niño Rivera
9f3c845610
Add ability to stream a response (#50)
Signed-off-by: José Ulises Niño Rivera <junr03@users.noreply.github.com>
2024-09-17 16:12:41 -07:00
Adil Hafeez
118bff7c7e add open-webui 2024-09-17 16:08:13 -07:00
Adil Hafeez
8a265de7c6
Propagate enums from prompt-target to bolt-fc (#56) 2024-09-17 12:03:21 -07:00
Adil Hafeez
63143fbd01
add bolt guard config (#55) 2024-09-17 10:59:50 -07:00
Adil Hafeez
dd35e77a73 add streaming chatbot-ui 2024-09-17 09:01:45 -07:00
Adil Hafeez
b8841fb8f4 rename bolt-config => bolt_config 2024-09-17 08:56:47 -07:00
Adil Hafeez
060a0d665e
improve service names (#54)
- embedding-server => model_server
- public-types => public_types
- chatbot-ui => chatbot_ui
- function-calling => function_calling
2024-09-17 08:47:35 -07:00
Adil Hafeez
215f96e273
rename envoy-1 => bolt-1 (#53) 2024-09-16 23:20:26 -07:00
Adil Hafeez
a0d132f5b6 remove unused demos 2024-09-16 19:21:59 -07:00
Adil Hafeez
ed329bd419 improve docker build speed 2024-09-16 19:20:27 -07:00
Adil Hafeez
9e50957f22
Improve prompt target intent matching (#51) 2024-09-16 19:20:07 -07:00
José Ulises Niño Rivera
8565462ec4
Resetting instead of resuming (#39)
Signed-off-by: José Ulises Niño Rivera <junr03@users.noreply.github.com>
2024-09-14 10:58:25 -07:00