cybermaggedon
a922852017
Fix async/sync load issues with knowledge streaming APIs ( #315 )
2025-03-15 12:38:10 +00:00
Jack Colquitt
c08779ff3c
Merge pull request #313 from trustgraph-ai/feature/mistral-support
...
Added support for Mistral API
2025-03-14 18:18:03 -07:00
JackColquitt
a46de297c1
More Mistral pieces
2025-03-14 18:12:33 -07:00
JackColquitt
d676804107
Added Mistral jsonnet templates
2025-03-14 18:07:51 -07:00
JackColquitt
5f5cf8fd07
Added basic Mistral API support
2025-03-14 17:47:59 -07:00
cybermaggedon
88768a791b
Tweak GraphRAG and DocRAG params, path hops == 2 ( #312 )
2025-03-13 00:44:25 +00:00
cybermaggedon
ef845d6c9b
Feature/rag parameters ( #311 )
...
* Change document-rag and graph-rag processing so that the user can
specify parameters. Changes in Pulsar services, Pulsar message
schemas, gateway and command-line tools. User-visible changes in
new parameters on command-line tools.
* Fix bugs, graph-rag working
* Get subgraph truncation in the right place
* Graph RAG and document RAG working and configurable
* Multi-hop path traversal GraphRAG
* Add safety valve for path_size set too high
2025-03-13 00:38:18 +00:00
cybermaggedon
f1559c5944
Feature/librarian ( #310 )
...
* Add fields to library schema
* Added list function, incomplete
* Librarian list operation
2025-03-11 16:52:59 +00:00
cybermaggedon
5575e885e5
Fix merge issues with api-key, conflicts with librarian changes ( #309 )
2025-02-15 12:25:26 +00:00
cybermaggedon
617eb7efd5
Feature/pulsar api key support ( #308 )
...
* Add pulsar API token check
* Added missing api_key references
---------
Co-authored-by: Tyler O <4535788+toliver38@users.noreply.github.com>
2025-02-15 11:22:48 +00:00
cybermaggedon
f7df2df266
Feature/librarian ( #307 )
...
* Bring QDrant up-to-date
* Tables for data from queue outputs
- Pass single Pulsar client to everything in gateway & librarian
- Pulsar listener-name support in gateway
- PDF and text load working in librarian
* Complete Cassandra schema
* Add librarian support to templates
2025-02-12 23:39:24 +00:00
cybermaggedon
f350abb415
Maint/asyncio ( #305 )
...
* Move to asyncio services, even though everything is largely sync
2025-02-11 23:24:46 +00:00
cybermaggedon
a0bf2362f6
Librarian ( #304 )
2025-02-11 16:01:03 +00:00
Tyler Oliver
e99c0ac238
Add support for Qdrant API Auth ( #300 )
...
Added the necessary changes to support API Key in Qdrant Client Query+Storage
- Doc Embeddings
- Graph Embeddings
2025-02-08 11:46:22 +00:00
Tyler Oliver
41ccb6c976
Add user and password auth for Cassandra ( #301 )
2025-02-08 11:42:14 +00:00
cybermaggedon
1000a9de8f
Add missing aiohttp dep to trustgraph-cli, needed for knowledge cores ( #297 )
...
* Add missing aiohttp dep to trustgraph-cli, needed for knowledge cores
2025-02-04 12:24:46 +00:00
cybermaggedon
5029ab7ad9
Fix AWS env vars in templates ( #296 )
2025-01-31 12:40:23 +00:00
Cyber MacGeddon
15c8afa97b
Changed setup.py for 0.21 release branch
2025-01-30 21:40:44 +00:00
cybermaggedon
d1e9577e7f
Fix rate limit handler, incomplete ( #293 )
2025-01-29 21:13:17 +00:00
cybermaggedon
701ec1e27e
Fix startup error on import ( #292 )
2025-01-29 19:11:08 +00:00
cybermaggedon
1543a0650d
Better aws integration ( #291 )
...
* - More AWS Boto3 settings (profile and session key)
- Align environment variable and profile setting names with AWS
conventions.
Hopefully this should be able to run from an EC2 instance just with role
setting.
* Tweak naming to all make sense, added rate limit detect
2025-01-29 14:38:16 +00:00
cybermaggedon
2c5289765d
Updated prometheus targets for current flows ( #289 )
2025-01-29 12:41:01 +00:00
cybermaggedon
34bde24086
Update generate script to handle more cases ( #290 )
2025-01-29 12:40:46 +00:00
cybermaggedon
edcdc4d59d
Feature/separate containers ( #287 )
...
* Separate containerfiles
* Add push to Makefile
* Update image names in the templates
2025-01-28 19:36:05 +00:00
cybermaggedon
6c3d2e7f97
Feature/fastembed ( #286 )
...
* Copied in base files for fastembed
* Added fastembed implementation
* Added template support for fastembed
2025-01-28 18:26:17 +00:00
cybermaggedon
75a72b0d2d
Fix ollama embeddings client to work ( #285 )
2025-01-27 23:47:15 +00:00
cybermaggedon
552637c1f7
Fix deps ( #284 )
...
* Add cryptography module back in
* Lock in known working version of the AI modules, suspecting a problem
in sentence-transformers with Python 3.12?
2025-01-27 21:57:22 +00:00
cybermaggedon
5a5daa527f
Load default embeddings model into container ( #283 )
2025-01-27 19:59:08 +00:00
cybermaggedon
0ebd770cb5
Back out cryptography ( #282 )
2025-01-27 19:58:38 +00:00
cybermaggedon
0e03bc05a4
Refactor rate limit handling ( #280 )
...
* - Refactored retry for rate limits into the base class
- ConsumerProducer is derived from Consumer to simplify code
- Added rate_limit_count metrics for rate limit events
* Add rate limit events to VertexAI and Google AI Studio
* Added Grafana rate limit dashboard
* Add rate limit handling to all LLMs
2025-01-27 17:04:49 +00:00
cybermaggedon
26a586034c
Add cryptography dep ( #281 )
2025-01-27 17:04:09 +00:00
Jack Colquitt
477fd1420e
Merge pull request #279 from trustgraph-ai/add-memgraph-volume
...
Added memgraph volume
2025-01-23 15:46:47 -08:00
JackColquitt
605ade84f0
Added memgraph volume
2025-01-23 15:29:16 -08:00
cybermaggedon
8e227e256e
Fix bookie & pulsar service naming in K8s ( #276 )
2025-01-20 23:54:33 +00:00
cybermaggedon
ac7bf6bfd5
Fix Minikube launch issues ( #275 )
...
- Fix Pulsar service naming - broker -> pulsar
- Fix Google AI Studio secret name for RAG to be consistent with other
text-completion.
2025-01-20 19:17:43 +00:00
cybermaggedon
8fc22155dd
Agent tweaks ( #272 )
...
- Removed unused LLM client configuration from agent-manager-react
- Change agent-manager-react template to use prompt-rag instead of
prompt
- Changed TextCompletion tool to use 'question' instead of 'computation'
for its parameter.
2025-01-20 14:05:51 +00:00
Cyber MacGeddon
9bf916f3c6
Update Python files for 0.20
2025-01-16 00:02:18 +00:00
cybermaggedon
bed7423c26
- Added load/save API for document embeddings ( #269 )
...
- tg-load-doc-embeds and tg-save-doc-embeds command line utils
2025-01-16 00:00:59 +00:00
cybermaggedon
acdd3efe51
Fix argument usage not overriding defaults in Google AI Studio & VertexAI templates ( #268 )
2025-01-15 23:59:50 +00:00
cybermaggedon
1280af3eff
Fix/kg core save ( #267 )
...
* Add a 'localhost' Pulsar endpoint for docker env
* - Fix broken socket endpoint streamers
- Add unused listener endpoints for publisher/subscriber
- Fix graph embedding serialisation
* Fix GE load
* Remove Gossip settling delay, this is single-node Cassandra.
2025-01-13 14:42:33 +00:00
cybermaggedon
cd9a208432
Processors use shared queues, means there can be more than process on a queue to share load ( #265 )
2025-01-11 18:10:04 +00:00
cybermaggedon
c603caa3cc
Fix neo4j: container doesn't start currently ( #264 )
...
* Adjust Neo4j memory settings to avoid startup fail
* Upgrade Neo4j to community 5.26.0
* Add Neo4j indexes
2025-01-11 12:44:49 +00:00
cybermaggedon
cec9e29222
Dual model templates ( #263 )
...
* Dual-mode templates
* Fixed generate-all so that works
* Fix ability to specify Claude model
2025-01-11 11:40:42 +00:00
Jack Colquitt
1bb1112569
Merge pull request #262 from trustgraph-ai/googleaistudio-creds
...
Fixed creds for GoogleAIStudio in K8s
2025-01-07 12:25:35 -08:00
JackColquitt
8f769b1e73
Fixed creds for GoogleAIStudio in K8s
2025-01-07 12:24:57 -08:00
cybermaggedon
08d24bf5aa
Fix k8s with_user invocation ( #261 )
2025-01-07 18:50:56 +00:00
Jack Colquitt
c7e76ffc2f
Merge pull request #260 from trustgraph-ai/claude-token-fix
...
Fix for Claude key envvar
2025-01-07 08:55:23 -08:00
JackColquitt
ffacf84c79
Fix for Claude key envvar
2025-01-07 08:54:35 -08:00
cybermaggedon
ceff3f0e34
Remove 2nd push ( #258 )
2025-01-06 21:52:25 +00:00
cybermaggedon
dc2b599fda
Fix/release broken ( #257 )
...
* Break release into 3 jobs
* Replace Github action with podman command
2025-01-06 21:45:42 +00:00