mirror of
https://github.com/trustgraph-ai/trustgraph.git
synced 2026-07-24 04:31:02 +02:00
More docs
This commit is contained in:
parent
ebcd5fe902
commit
0c598dc096
1 changed files with 61 additions and 3 deletions
64
README.md
64
README.md
|
|
@ -50,6 +50,10 @@ Pulsar provides two types of connectivity:
|
||||||
processed, the output is delivered to a separate queue so that the caller
|
processed, the output is delivered to a separate queue so that the caller
|
||||||
can collect the data.
|
can collect the data.
|
||||||
|
|
||||||
|
All the code is bundled into a single Python package which can be used to
|
||||||
|
use all the functionality. There is also a container image with the
|
||||||
|
package installed which can be used to run everything.
|
||||||
|
|
||||||
## Included modules
|
## Included modules
|
||||||
|
|
||||||
- `chunker-recursive` - Accepts text documents and uses LangChain recurse
|
- `chunker-recursive` - Accepts text documents and uses LangChain recurse
|
||||||
|
|
@ -108,9 +112,63 @@ Using the Docker Compose you should be able to...
|
||||||
- Run a query which uses the vector and graph stores to produce a prompt
|
- Run a query which uses the vector and graph stores to produce a prompt
|
||||||
which is answered using an LLM.
|
which is answered using an LLM.
|
||||||
|
|
||||||
If you get a Graph RAG response to the query, everything is working
|
If you get a Graph RAG response to the query, everything is working.
|
||||||
|
|
||||||
|
### Docker compose files
|
||||||
|
|
||||||
|
There are 4 docker compose files to choose from depending on the LLM you
|
||||||
|
wish to use:
|
||||||
|
|
||||||
|
- `docker-compose-azure.yaml`. This is for a serverless AI endpoint
|
||||||
|
hosted on Azure. Set `AZURE_TOKEN` to the secret token and
|
||||||
|
`AZURE_ENDPOINT` to the endpoint address.
|
||||||
|
- `docker-compose-claude.yaml`. This is for using Anthropic Claude LLM.
|
||||||
|
Set `CLAUDE_KEY` to the API key.
|
||||||
|
- `docker-compose-ollama.yaml`. This is for a local LLM - gemma2 hosted
|
||||||
|
using Ollama. Set `OLLAMA_HOST` to the host running Ollama (e.g.
|
||||||
|
`localhost` to talk to a locally hosted Ollama.
|
||||||
|
- `docker-compose-vertexai.yaml`. This is for using Google Cloud VertexAI.
|
||||||
|
You need a private.json authentication file for your Google Cloud.
|
||||||
|
Should be at path `vertexai/private.json`.
|
||||||
|
|
||||||
|
### docker-compose-azure.yaml
|
||||||
|
|
||||||
|
```
|
||||||
|
export AZURE_ENDPOINT=https://ENDPOINT.HOST.GOES.HERE/
|
||||||
|
export AZURE_TOKEN=TOKEN-GOES-HERE
|
||||||
|
docker-compose -f docker-compose-azure.yaml up -d
|
||||||
|
```
|
||||||
|
|
||||||
|
### docker-compose-claude.yaml
|
||||||
|
|
||||||
|
```
|
||||||
|
export CLAUDE_KEY=TOKEN-GOES-HERE
|
||||||
|
docker-compose -f docker-compose-claude.yaml up -d
|
||||||
|
```
|
||||||
|
|
||||||
|
### docker-compose-ollama.yaml
|
||||||
|
|
||||||
|
```
|
||||||
|
export OLLAMA_HOST=localhost # Set to hostname of Ollama host
|
||||||
|
docker-compose -f docker-compose-ollama.yaml up -d
|
||||||
|
```
|
||||||
|
|
||||||
|
|
||||||
|
### docker-compose-azure.yaml
|
||||||
|
|
||||||
|
```
|
||||||
|
mkdir -p vertexai
|
||||||
|
cp {whatever} vertexai/private.json
|
||||||
|
docker-compose -f docker-compose-vertexai.yaml up -d
|
||||||
|
```
|
||||||
|
|
||||||
|
On Linux if running SELinux you may need to set the permissions on the
|
||||||
|
VertexAI directory so that the key file can be mounted on a docker
|
||||||
|
container...
|
||||||
|
|
||||||
|
```
|
||||||
|
chcon -Rt svirt_sandbox_file_t vertexai/
|
||||||
|
```
|
||||||
|
|
||||||
### Docker compose
|
|
||||||
|
|
||||||
TBD
|
|
||||||
|
|
||||||
|
|
|
||||||
Loading…
Add table
Add a link
Reference in a new issue