apunkt/trustgraph
1
0
Fork 0
mirror of https://github.com/trustgraph-ai/trustgraph.git synced 2026-04-25 08:26:21 +02:00
Code Issues Projects Releases Packages Wiki Activity Actions 1
431 commits 76 branches 497 tags 113 MiB
Commit graph

54 commits

Author SHA1 Message Date
cybermaggedon
a714221b22
Add memgraph cypher LIMIT support (#200) 2024-12-07 00:16:52 +00:00
cybermaggedon
656dcb22a9
Feature/general websocket (#199) 
* Split API endpoint into endpoint and requestor
* Service/endpoint separation
* Call out to multiple services working
* Add ID field
* Add mux service on websocket, calls out to all services
 2024-12-06 23:56:10 +00:00
cybermaggedon
55c5c398b6
Fix relative imports (#197) 2024-12-06 13:37:44 +00:00
cybermaggedon
67d69b5285
Fixed a problem with the packages, api/__init__.py appeared in both (#196) 
trustgraph-flow and trustgraph-base, moved the gateway stuff into a
different directory.
 2024-12-06 13:05:56 +00:00
cybermaggedon
bffaf62490
Feature/memgraph optim (#193) 
* Separate memgraph query/write modules to optimise for memgraph
* Used 1GB memory for Memgraph
* Deployed specialised memgraph query/write processors, created memgraph indexes
* One triple is loaded as a single transaction
* Fixed index creation
 2024-12-06 00:12:49 +00:00
cybermaggedon
5770af51ef
Fix async problem on text load (#191) 2024-12-03 21:30:14 +00:00
cybermaggedon
26865a515c
Fix/async problem (#190) 
* Back out previous change
* To multithreads
* Remove aiopulsar dependency
 2024-12-03 18:03:00 +00:00
cybermaggedon
7e78aa6d91
Reduc pulsar connections (#189) 2024-12-03 14:13:40 +00:00
cybermaggedon
df23e29971
Add debug to endpoint (#188) 2024-12-03 09:52:00 +00:00
cybermaggedon
f24eed3023
Fix/pinecone de (#187) 
* Fix Goog AI studio settings
* Fix pinecone startup params
 2024-12-03 09:51:33 +00:00
cybermaggedon
1b9c6be4fc
Feature/gateway auth (#186) 
* Added auth module, just a simple token at this stage
* Pass auth token GATEWAY_SECRET through
* Auth token not mandatory, can be provided in env var
 2024-12-02 19:57:21 +00:00
cybermaggedon
6d200c79c5
Feature/wikipedia ddg (#185) 
API-side support for Wikipedia, DBpedia and internet search functions  This incorporates a refactor of the API code to break it up, separate classes for endpoints to reduce duplication
 2024-12-02 17:41:30 +00:00
Cyber MacGeddon
c844d805e5 Setup for release 0.17 branch 2024-11-29 17:03:31 +00:00
cybermaggedon
9c97ca32f6
Feature/memgraph (#182) 
* Add database override to bolt output, default is neo4j

* Add memgraph templates
 2024-11-28 19:21:28 +00:00
cybermaggedon
b2f7b34529
Fix/pinecone integration (#180) 
* Add missing pinecone references

* Add missing Pinecone executables
 2024-11-27 17:36:15 +00:00
cybermaggedon
2f7ccb2ef8
- Reduce back-pressure on tg-load-kg-core (#179) 
- Save entity in correct format in tg-save-core
 2024-11-27 17:24:27 +00:00
cybermaggedon
887fafcf8c
Fix/core save api (#172) 
* Acknowledge messaages from Pulsar, doh!
* Change API to deliver a boolean e if value is an entity
* Change loaders to use new API
* Changes, entity-aware API is complete
 2024-11-26 16:46:38 +00:00
cybermaggedon
340d7a224f
Feature/rework kg core (#171) 
* Knowledge cores with msgpack
* Put it in the cli package
* Tidy up msgpack dumper
* Created a loader
 2024-11-25 20:46:35 +00:00
cybermaggedon
319f9ac04a
Feature/pinecone integration (#170) 
* Added Pinecone for GE write & query

* Add templates

* Doc embedding support
 2024-11-22 23:48:21 +00:00
cybermaggedon
7a64385a57
Fix graph query in Cassandra (#168) 2024-11-21 18:02:49 +00:00
cybermaggedon
dc0f54f236
API supports doc & text load (#167) 2024-11-21 14:53:53 +00:00
cybermaggedon
a1e0edd96f
API gateway in a proper module, restarting publishers & subscribers as appropriate (#166) 2024-11-20 23:17:55 +00:00
cybermaggedon
ba6d6c13af
Fix API gateway integration, added to templates (#165) 2024-11-20 20:56:23 +00:00
cybermaggedon
92b84441eb
Feature/api gateway (#164) 
* Bare bones API gateway
* Working for LLM + prompt
* RAG query works
* Triples query
* Added agent API
* Embeddings API
* Put API tests in a subdir
 2024-11-20 19:55:40 +00:00
Cyber MacGeddon
b536d78b57 Prepare for 0.16: Change Python dep restrictions and Gitlab merge criteria 2024-11-20 19:55:05 +00:00
cybermaggedon
f2c78b701e
- Increased max-iterations to 15 default, and made it a configurable (#163) 
parameter with --max-iterations.  Was previously hard-coded at 10.
- Fixed arg passing causing pull the wrong tool name
 2024-11-19 21:28:47 +00:00
cybermaggedon
0253281727
Confusion between OPENAI_KEY and OPENAI_TOKEN: settled on OPENAI_TOKEN. (#161) 2024-11-15 18:54:54 +00:00
cybermaggedon
081dd697c4
- Moved the agent-react template from hard-coded in agent_manager.py to (#151) 
a template prompt managed by prompt manager.  The prompt is called
  agent-react.
 2024-11-12 19:04:15 +00:00
cybermaggedon
f654d72515
Fix setup deps (#149) 2024-11-11 22:29:03 +00:00
cybermaggedon
36cdeab588
Feature/agent manager (#146) 
* Agent schema
* Agent working through client
* Add agent-manager-react command line
* test-agent test script
* Add tg-invoke-agent CLI
 2024-11-10 11:44:01 +00:00
cybermaggedon
9c6c6c9843
Fix neo4j loader (#141) 2024-11-06 00:27:35 +00:00
cybermaggedon
65cda7b276
Implement system in text completion API (#137) 
* Add system prompt to LLM invocation

* Added system parameter to LLMs

* Added to Bedrock and VertexAI
 2024-11-05 22:46:17 +00:00
cybermaggedon
53c958aaff
Fix: prompt template overrides (#136) 
* Added single-target command-line config generator.  Mainly using for
testing ATM.

* Slightly tweak the config decode so that components can over-ride the
'with' method which injects parameters.

* Deliberately break the prompt-generic template.  Could do better, this
is temporary.

* Add 'prompt-overrides' component, injects new prompts.

* Removed prompt generic reference, not used

* prompt-generic is no longer supported
 2024-11-05 21:17:34 +00:00
cybermaggedon
8a2126bba5
Fix neo4j schema - incompatible with extractors (#135) 
- Fixed schema invocation on Neo4j writer
- Fixed confusing typo name in cassandra template
- Unnecessary import on Cassandra removed
 2024-11-02 10:51:26 +00:00
cybermaggedon
24d099793d
Feature/doc metadata labels (#130) 
* Add schema load util

* Added a sample schema turtle file will be useful for future testing and
tutorials.

* Fixed graph label metadata confusion, was created incorrect subjectOf
edges.
 2024-10-29 21:18:02 +00:00
cybermaggedon
1e137768ca
Prompt refactor (#125) 
* Prompt manager integrated and working with 6 tests
* Updated templates to for prompt-template update
 2024-10-26 22:17:43 +01:00
Cyber MacGeddon
51aef6c730 Update setup.py files for 0.14 dependencies 2024-10-25 15:15:03 +01:00
cybermaggedon
db4e1df0fb
Catch rate limit (#124) 2024-10-25 00:01:40 +01:00
cybermaggedon
7954e863cc
Feature: document metadata (#123) 
* Rework metadata structure in processing messages to be a subgraph
* Add subgraph creation for tg-load-pdf and tg-load-text based on command-line passing of doc attributes
* Document metadata is added to knowledge graph with subjectOf linkage to extracted entities
 2024-10-23 18:04:04 +01:00
cybermaggedon
04617a81f7
Fix env var passing (#120) 2024-10-15 20:02:21 +01:00
cybermaggedon
86288339cf
Feature/environment var creds (#116) 
- Change templates to interpolate environment variables in docker compose
- Change templates to invoke secrets for environment variable credentials in K8s configuration
- Update LLMs to pull in credentials from environment variables if not specified
 2024-10-15 00:34:52 +01:00
Cyber MacGeddon
43756d872b Set dependencies up for the 0.13 branch. Set version=0.0.0 in Makefile 
to spot build errors.
 2024-10-15 00:31:08 +01:00
cybermaggedon
4ef8332c6f
Lock 0.12 to 0.12 packages min (#115) 2024-10-14 19:31:30 +01:00
cybermaggedon
eface26fe1
Move to 0.12 deps in Python packages (#114) 2024-10-13 08:38:56 +01:00
JackColquitt
063acc6a21 Fixed HarmCategory API 2024-10-10 11:37:21 -07:00
Cyber MacGeddon
5850b6c136 Merge branch 'release/v0.11' into release/v0.12 2024-10-09 19:38:13 +01:00
cybermaggedon
942eedb7b0
Google AI Studio (#110) 
* Testing GoogleAIStudio support
---------

Co-authored-by: JackColquitt <daniel@kalntera.ai>
 2024-10-09 15:34:46 +01:00
cybermaggedon
148092a6af
Fix/lock 0.11 version (#108) 
* - Locked 0.11 packages to 0.11 deps
- Added 'trustgraph' uber-package which installs the rest
- Added dependency to set package versions before building packages

* Bump version
 2024-10-04 22:12:39 +01:00
cybermaggedon
aea30ae0d3
Fix API version in azure-openai (#107) 2024-10-04 21:19:39 +01:00
Jack Colquitt
d96ef8269a
AzureOpenAI support (#102) 
* Readme text tweak
* Added support for OpenAI in Azure
* Based AzureOpenAI support
 2024-10-04 14:44:50 +01:00