apunkt/plano
1
0
Fork 0
mirror of https://github.com/katanemo/plano.git synced 2026-05-05 05:42:49 +02:00
Code Issues Projects Releases Packages Wiki Activity Actions

simplify developer getting started experience (#102)

Browse source 
* Fixed build. Now, we have a bare bones version of the docker-compose file with only two services, archgw and archgw-model-server. Tested using CLI

* some pre-commit fixes

* fixed cargo formatting issues

* fixed model server conflict changes

---------

Co-authored-by: Salman Paracha <salmanparacha@MacBook-Pro-261.local>
This commit is contained in:
Salman Paracha 2024-10-01 10:02:23 -07:00 • committed by GitHub
parent 41cdef590a
commit 8654d3d5c5
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
20 changed files with 53 additions and 407 deletions
Download patch file Download diff file Expand all files Collapse all files

3
model_server/guard_model_config.yaml
View file

@ -1,6 +1,3 @@
toxic:
cpu: "katanemolabs/toxic_ovn_4bit"
gpu: "katanemolabs/Bolt-Toxic-v1-eetq"
jailbreak:
cpu: "katanemolabs/jailbreak_ovn_4bit"
gpu: "katanemolabs/Bolt-Guard-EEtq"