apunkt/plano
1
0
Fork 0
mirror of https://github.com/katanemo/plano.git synced 2026-06-23 15:38:07 +02:00
Code Issues Projects Releases Packages Wiki Activity

Cotran/onnx conversion (#145)

Browse source 
* onnx replacement

* onnx conversion for nli and embedding model

* fix naming

* fix naming

* fix naming

* pin version
This commit is contained in:
Co Tran 2024-10-08 14:37:48 -07:00 • committed by GitHub
parent b30ad791f7
commit 80d2229053
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
7 changed files with 61 additions and 42 deletions
Download patch file Download diff file Expand all files Collapse all files

2
model_server/Dockerfile
View file

@ -15,7 +15,7 @@ WORKDIR /src
# specify list of models that will go into the image as a comma separated list
# following models have been tested to work with this image
# "sentence-transformers/all-MiniLM-L6-v2,sentence-transformers/all-mpnet-base-v2,thenlper/gte-base,thenlper/gte-large,thenlper/gte-small"
ENV MODELS="BAAI/bge-large-en-v1.5"
ENV MODELS="katanemo/bge-large-en-v1.5-onnx"
COPY ./app ./app
COPY ./app/guard_model_config.yaml .