cybermaggedon
8c1b468eb0
Fix async error ( #212 )
2024-12-17 12:43:16 +00:00
cybermaggedon
07f9b1f244
From vector DB, often get dupes, which means when end up returning ( #210 )
...
less then top_k elements. So, fetch top_k=(2 * limit) and limit to
just (limit)
2024-12-10 22:37:54 +00:00
cybermaggedon
cd8d0c8cbc
Graph embedding query exposed through gateway ( #208 )
2024-12-10 22:15:56 +00:00
cybermaggedon
8d326d34b3
Use Cosine similarity ( #209 )
2024-12-10 22:15:42 +00:00
Cyber MacGeddon
d6cdce8391
Open 0.18 branch
2024-12-10 22:13:10 +00:00
cybermaggedon
61031270e4
Fix loop logic flaws in loader ( #203 )
2024-12-09 12:44:30 +00:00
cybermaggedon
803f110891
Timeout alias error ( #202 )
2024-12-09 00:31:03 +00:00
cybermaggedon
cf8c76b5c6
Fix/save core hang ( #201 )
...
* Working around an exception class change in Python 3.11
2024-12-09 00:01:01 +00:00
cybermaggedon
a714221b22
Add memgraph cypher LIMIT support ( #200 )
2024-12-07 00:16:52 +00:00
cybermaggedon
656dcb22a9
Feature/general websocket ( #199 )
...
* Split API endpoint into endpoint and requestor
* Service/endpoint separation
* Call out to multiple services working
* Add ID field
* Add mux service on websocket, calls out to all services
2024-12-06 23:56:10 +00:00
cybermaggedon
fd3db3c925
Feature/tidy kg load save ( #198 )
...
* Clean exit on ctrl-C
* More functionality in dump
* Dump some metadata
2024-12-06 15:16:09 +00:00
cybermaggedon
55c5c398b6
Fix relative imports ( #197 )
2024-12-06 13:37:44 +00:00
cybermaggedon
67d69b5285
Fixed a problem with the packages, api/__init__.py appeared in both ( #196 )
...
trustgraph-flow and trustgraph-base, moved the gateway stuff into a
different directory.
2024-12-06 13:05:56 +00:00
cybermaggedon
7df7843dad
Main/remove parquet ( #195 )
...
* Remove Parquet code, and package build
2024-12-06 08:51:10 +00:00
cybermaggedon
2818ec9f23
Fix header ( #194 )
2024-12-06 08:50:49 +00:00
cybermaggedon
bffaf62490
Feature/memgraph optim ( #193 )
...
* Separate memgraph query/write modules to optimise for memgraph
* Used 1GB memory for Memgraph
* Deployed specialised memgraph query/write processors, created memgraph indexes
* One triple is loaded as a single transaction
* Fixed index creation
2024-12-06 00:12:49 +00:00
cybermaggedon
e3d06ab80b
Fix isinstance test on null values ( #192 )
...
Co-authored-by: Mark Adams <mark.adams@surevine.com>
2024-12-04 14:42:55 +00:00
cybermaggedon
5770af51ef
Fix async problem on text load ( #191 )
2024-12-03 21:30:14 +00:00
cybermaggedon
26865a515c
Fix/async problem ( #190 )
...
* Back out previous change
* To multithreads
* Remove aiopulsar dependency
2024-12-03 18:03:00 +00:00
cybermaggedon
7e78aa6d91
Reduc pulsar connections ( #189 )
2024-12-03 14:13:40 +00:00
cybermaggedon
df23e29971
Add debug to endpoint ( #188 )
2024-12-03 09:52:00 +00:00
cybermaggedon
f24eed3023
Fix/pinecone de ( #187 )
...
* Fix Goog AI studio settings
* Fix pinecone startup params
2024-12-03 09:51:33 +00:00
cybermaggedon
1b9c6be4fc
Feature/gateway auth ( #186 )
...
* Added auth module, just a simple token at this stage
* Pass auth token GATEWAY_SECRET through
* Auth token not mandatory, can be provided in env var
2024-12-02 19:57:21 +00:00
cybermaggedon
6d200c79c5
Feature/wikipedia ddg ( #185 )
...
API-side support for Wikipedia, DBpedia and internet search functions This incorporates a refactor of the API code to break it up, separate classes for endpoints to reduce duplication
2024-12-02 17:41:30 +00:00
cybermaggedon
212102c61c
Tweak queue names ( #184 )
2024-11-29 17:17:20 +00:00
Cyber MacGeddon
c844d805e5
Setup for release 0.17 branch
2024-11-29 17:03:31 +00:00
cybermaggedon
cf564ed147
PDF loader symbol error fixed ( #183 )
2024-11-28 21:26:36 +00:00
cybermaggedon
c52b70c286
Fix metadata load format ( #181 )
2024-11-28 19:21:41 +00:00
cybermaggedon
9c97ca32f6
Feature/memgraph ( #182 )
...
* Add database override to bolt output, default is neo4j
* Add memgraph templates
2024-11-28 19:21:28 +00:00
cybermaggedon
b2f7b34529
Fix/pinecone integration ( #180 )
...
* Add missing pinecone references
* Add missing Pinecone executables
2024-11-27 17:36:15 +00:00
cybermaggedon
2f7ccb2ef8
- Reduce back-pressure on tg-load-kg-core ( #179 )
...
- Save entity in correct format in tg-save-core
2024-11-27 17:24:27 +00:00
cybermaggedon
99e3e43f7b
Fix/kg cli help ( #173 )
...
* Fix kg-core-help
2024-11-26 16:58:47 +00:00
cybermaggedon
887fafcf8c
Fix/core save api ( #172 )
...
* Acknowledge messaages from Pulsar, doh!
* Change API to deliver a boolean e if value is an entity
* Change loaders to use new API
* Changes, entity-aware API is complete
2024-11-26 16:46:38 +00:00
cybermaggedon
340d7a224f
Feature/rework kg core ( #171 )
...
* Knowledge cores with msgpack
* Put it in the cli package
* Tidy up msgpack dumper
* Created a loader
2024-11-25 20:46:35 +00:00
cybermaggedon
319f9ac04a
Feature/pinecone integration ( #170 )
...
* Added Pinecone for GE write & query
* Add templates
* Doc embedding support
2024-11-22 23:48:21 +00:00
cybermaggedon
ae1264f5c4
Add Python support to calling the API ( #169 )
2024-11-22 15:55:32 +00:00
cybermaggedon
7a64385a57
Fix graph query in Cassandra ( #168 )
2024-11-21 18:02:49 +00:00
cybermaggedon
dc0f54f236
API supports doc & text load ( #167 )
2024-11-21 14:53:53 +00:00
cybermaggedon
a1e0edd96f
API gateway in a proper module, restarting publishers & subscribers as appropriate ( #166 )
2024-11-20 23:17:55 +00:00
cybermaggedon
ba6d6c13af
Fix API gateway integration, added to templates ( #165 )
2024-11-20 20:56:23 +00:00
cybermaggedon
92b84441eb
Feature/api gateway ( #164 )
...
* Bare bones API gateway
* Working for LLM + prompt
* RAG query works
* Triples query
* Added agent API
* Embeddings API
* Put API tests in a subdir
2024-11-20 19:55:40 +00:00
Cyber MacGeddon
b536d78b57
Prepare for 0.16: Change Python dep restrictions and Gitlab merge criteria
2024-11-20 19:55:05 +00:00
cybermaggedon
f2c78b701e
- Increased max-iterations to 15 default, and made it a configurable ( #163 )
...
parameter with --max-iterations. Was previously hard-coded at 10.
- Fixed arg passing causing pull the wrong tool name
2024-11-19 21:28:47 +00:00
cybermaggedon
0253281727
Confusion between OPENAI_KEY and OPENAI_TOKEN: settled on OPENAI_TOKEN. ( #161 )
2024-11-15 18:54:54 +00:00
cybermaggedon
081dd697c4
- Moved the agent-react template from hard-coded in agent_manager.py to ( #151 )
...
a template prompt managed by prompt manager. The prompt is called
agent-react.
2024-11-12 19:04:15 +00:00
Cyber MacGeddon
58d3665947
Add missing README
2024-11-12 00:27:22 +00:00
cybermaggedon
efd13ae5f1
Added agent support to templates ( #150 )
2024-11-12 00:22:18 +00:00
cybermaggedon
f654d72515
Fix setup deps ( #149 )
2024-11-11 22:29:03 +00:00
cybermaggedon
7aab42a054
Fix prompt overrides ( #147 )
2024-11-10 18:24:19 +00:00
cybermaggedon
36cdeab588
Feature/agent manager ( #146 )
...
* Agent schema
* Agent working through client
* Add agent-manager-react command line
* test-agent test script
* Add tg-invoke-agent CLI
2024-11-10 11:44:01 +00:00