Added vLLM support, untested (#410)

* Added vLLM support
This commit is contained in:
cybermaggedon 2025-06-10 15:37:37 +01:00 committed by GitHub
parent 5364b1fad5
commit 35b0d80013
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
5 changed files with 155 additions and 0 deletions

View file

@ -0,0 +1,6 @@
#!/usr/bin/env python3
from trustgraph.model.text_completion.vllm import run
run()