Commit graph

509 commits

Author SHA1 Message Date
cybermaggedon
75a72b0d2d
Fix ollama embeddings client to work (#285) 2025-01-27 23:47:15 +00:00
cybermaggedon
552637c1f7
Fix deps (#284)
* Add cryptography module back in

* Lock in known working version of the AI modules, suspecting a problem
in sentence-transformers with Python 3.12?
2025-01-27 21:57:22 +00:00
cybermaggedon
5a5daa527f
Load default embeddings model into container (#283) 2025-01-27 19:59:08 +00:00
cybermaggedon
0ebd770cb5
Back out cryptography (#282) 2025-01-27 19:58:38 +00:00
cybermaggedon
0e03bc05a4
Refactor rate limit handling (#280)
* - Refactored retry for rate limits into the base class
- ConsumerProducer is derived from Consumer to simplify code
- Added rate_limit_count metrics for rate limit events

* Add rate limit events to VertexAI and Google AI Studio

* Added Grafana rate limit dashboard

* Add rate limit handling to all LLMs
2025-01-27 17:04:49 +00:00
cybermaggedon
26a586034c
Add cryptography dep (#281) 2025-01-27 17:04:09 +00:00
Jack Colquitt
477fd1420e
Merge pull request #279 from trustgraph-ai/add-memgraph-volume
Added memgraph volume
2025-01-23 15:46:47 -08:00
JackColquitt
605ade84f0 Added memgraph volume 2025-01-23 15:29:16 -08:00
cybermaggedon
8e227e256e
Fix bookie & pulsar service naming in K8s (#276) 2025-01-20 23:54:33 +00:00
cybermaggedon
ac7bf6bfd5
Fix Minikube launch issues (#275)
- Fix Pulsar service naming - broker -> pulsar
- Fix Google AI Studio secret name for RAG to be consistent with other
  text-completion.
2025-01-20 19:17:43 +00:00
cybermaggedon
8fc22155dd
Agent tweaks (#272)
- Removed unused LLM client configuration from agent-manager-react
- Change agent-manager-react template to use prompt-rag instead of
  prompt
- Changed TextCompletion tool to use 'question' instead of 'computation'
  for its parameter.
2025-01-20 14:05:51 +00:00
Cyber MacGeddon
9bf916f3c6 Update Python files for 0.20 2025-01-16 00:02:18 +00:00
cybermaggedon
bed7423c26
- Added load/save API for document embeddings (#269)
- tg-load-doc-embeds and tg-save-doc-embeds command line utils
2025-01-16 00:00:59 +00:00
cybermaggedon
acdd3efe51
Fix argument usage not overriding defaults in Google AI Studio & VertexAI templates (#268) 2025-01-15 23:59:50 +00:00
cybermaggedon
1280af3eff
Fix/kg core save (#267)
* Add a 'localhost' Pulsar endpoint for docker env

* - Fix broken socket endpoint streamers
- Add unused listener endpoints for publisher/subscriber
- Fix graph embedding serialisation

* Fix GE load

* Remove Gossip settling delay, this is single-node Cassandra.
2025-01-13 14:42:33 +00:00
cybermaggedon
cd9a208432
Processors use shared queues, means there can be more than process on a queue to share load (#265) 2025-01-11 18:10:04 +00:00
cybermaggedon
c603caa3cc
Fix neo4j: container doesn't start currently (#264)
* Adjust Neo4j memory settings to avoid startup fail

* Upgrade Neo4j to community 5.26.0

* Add Neo4j indexes
2025-01-11 12:44:49 +00:00
cybermaggedon
cec9e29222
Dual model templates (#263)
* Dual-mode templates

* Fixed generate-all so that works

* Fix ability to specify Claude model
2025-01-11 11:40:42 +00:00
Jack Colquitt
1bb1112569
Merge pull request #262 from trustgraph-ai/googleaistudio-creds
Fixed creds for GoogleAIStudio in K8s
2025-01-07 12:25:35 -08:00
JackColquitt
8f769b1e73 Fixed creds for GoogleAIStudio in K8s 2025-01-07 12:24:57 -08:00
cybermaggedon
08d24bf5aa
Fix k8s with_user invocation (#261) 2025-01-07 18:50:56 +00:00
Jack Colquitt
c7e76ffc2f
Merge pull request #260 from trustgraph-ai/claude-token-fix
Fix for Claude key envvar
2025-01-07 08:55:23 -08:00
JackColquitt
ffacf84c79 Fix for Claude key envvar 2025-01-07 08:54:35 -08:00
cybermaggedon
ceff3f0e34
Remove 2nd push (#258) 2025-01-06 21:52:25 +00:00
cybermaggedon
dc2b599fda
Fix/release broken (#257)
* Break release into 3 jobs

* Replace Github action with podman command
2025-01-06 21:45:42 +00:00
Jack Colquitt
542209423b
Merge pull request #256 from trustgraph-ai/more-docker-updates
Updated docker login and checkout versions
2025-01-06 12:43:55 -08:00
JackColquitt
5946c47d3d Updated docker login and checkout versions 2025-01-06 12:43:01 -08:00
Jack Colquitt
dd9fd007a7
Merge pull request #255 from trustgraph-ai/docker-update
Docker push action update
2025-01-06 12:34:38 -08:00
JackColquitt
6a27de22db Updated docker push action 2025-01-06 12:33:57 -08:00
Jack Colquitt
4797d5c624
Merge pull request #254 from trustgraph-ai/zookeeper-startup-fix
Fixed Zookeeper startup delay
2025-01-06 12:07:52 -08:00
JackColquitt
970e824589 Fixed Zookeeper startup delay 2025-01-06 12:06:51 -08:00
Jack Colquitt
37a220d447
Merge pull request #253 from trustgraph-ai/pulsar-hot-fix
Hot fix for pulsar user issue
2025-01-06 10:10:57 -08:00
JackColquitt
bb0d48c1b2 Hot fix for pulsar user issue 2025-01-06 10:03:22 -08:00
cybermaggedon
dbdf65b84d
Added a metrics endpoint /api/v1/metrics/X which proxies to Prometheus (#251) 2025-01-05 19:24:43 +00:00
cybermaggedon
ae00831e39
Added missing file (#249) 2025-01-04 22:08:24 +00:00
cybermaggedon
6aa212061d
Fix/document embeddings (#247)
* Update schema for doc embeddings

* Rename embeddings-vectorize to graph-embeddings

* Added document-embeddings processor (broken, needs fixing)

* Added scripts

* Fixed DE queue schema

* Add missing DE process

* Fix doc RAG processing, put graph-rag and doc-rag in appropriate component files.
2025-01-04 21:51:28 +00:00
Jack Colquitt
c633652fd2
Merge pull request #248 from trustgraph-ai/feature/workbench-dark-mode
Push Workbench to 0.2.4
2025-01-04 13:28:25 -08:00
JackColquitt
39ec7b6353 Push Workbench to 0.2.4 2025-01-04 13:27:04 -08:00
cybermaggedon
e8f7600d74
Upgrade workbench (#240) 2025-01-02 19:52:47 +00:00
cybermaggedon
fed7e4ca08
Pulsar resilience refactor (#238)
* Add userID control over compose containers
* Split Pulsar out, non-standalone
* Added bookie & zookeeper to Prometheus stats
2025-01-02 19:50:23 +00:00
cybermaggedon
44f8ce8834
Migrate cli utils to REST API (#239)
* Port a number of commands to use API gateway instead of Pulsar

* Ported tg-invoke-agent to websockets API

* Rename the 2 RAG commands: tg-query-... to tg-invoke-...
2025-01-02 19:49:22 +00:00
cybermaggedon
44c0d6f347
Updated workbench to 0.2.0, search facility (#236) 2024-12-31 19:58:31 +00:00
cybermaggedon
a458d57af2
Feature/refactor entity embeddings (#235)
* Make schema changes
* Core entity context flow in place
* extract-def outputs entity contexts
* Refactored qdrant write
* Refactoring of all vector stores in place
2024-12-30 12:53:19 +00:00
cybermaggedon
9942f63773
tg-dump-msgpack previously output Python 'representation', now does JSON. (#233) 2024-12-30 10:51:35 +00:00
Cyber MacGeddon
cff90cada1 Prepare for 0.19 2024-12-30 10:44:33 +00:00
Cyber MacGeddon
a0487fcb28 Workbench to 0.1.9 2024-12-30 00:39:20 +00:00
cybermaggedon
cb3272bba2
Upgrade workbench (#232) 2024-12-29 20:21:16 +00:00
cybermaggedon
9a71ff6521
Fix ingested metadata (#231) 2024-12-29 20:02:12 +00:00
cybermaggedon
187b0e6581
Fix/websocket capacity increase (#230)
* Fix invalid variable name invocation
* Fix error responses in websockets
* Increase websocket limits to 50MB max message.  Turn on Pulsar chunking by default.
2024-12-29 18:08:12 +00:00
cybermaggedon
21e7b856c4
- Added missing document-load / text-load response on websocket (#228) 2024-12-29 11:32:10 +00:00