apunkt/trustgraph
1
0
Fork 0
mirror of https://github.com/trustgraph-ai/trustgraph.git synced 2026-04-27 09:26:22 +02:00
Code Issues Projects Releases Packages Wiki Activity Actions

Implement system in text completion API (#137)

Browse source 
* Add system prompt to LLM invocation

* Added system parameter to LLMs

* Added to Bedrock and VertexAI
This commit is contained in:
cybermaggedon 2024-11-05 22:46:17 +00:00 • committed by GitHub
parent 53c958aaff
commit 65cda7b276
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
13 changed files with 24 additions and 13 deletions
Download patch file Download diff file Expand all files Collapse all files

6
trustgraph-base/trustgraph/clients/llm_client.py
View file

@ -35,6 +35,8 @@ class LlmClient(BaseClient):
output_schema=TextCompletionResponse,
)
def request(self, prompt, timeout=300):
return self.call(prompt=prompt, timeout=timeout).response
def request(self, system, prompt, timeout=300):
return self.call(
system=system, prompt=prompt, timeout=timeout
).response

1
trustgraph-base/trustgraph/schema/models.py
View file

@ -9,6 +9,7 @@ from . types import Error
# LLM text completion
class TextCompletionRequest(Record):
system = String()
prompt = String()
class TextCompletionResponse(Record):