apunkt/trustgraph
1
0
Fork 0
mirror of https://github.com/trustgraph-ai/trustgraph.git synced 2026-04-25 16:36:21 +02:00
Code Issues Projects Releases Packages Wiki Activity Actions 1
869 commits 76 branches 497 tags 113 MiB
Commit graph

111 commits

Author SHA1 Message Date
cybermaggedon
6c681967ab
Validate librarian collection (#453) 2025-08-07 21:36:24 +01:00
cybermaggedon
98022d6af4
Migrate from setup.py to pyproject.toml (#440) 
* Converted setup.py to pyproject.toml

* Modern package infrastructure as recommended by py docs
 2025-07-23 21:22:08 +01:00
cybermaggedon
ac977d18f4
Add MCP container push (#425) 2025-07-03 17:00:59 +01:00
cybermaggedon
f907ea7db8
PoC MCP server (#419) 
* Very initial MCP server PoC for TrustGraph

* Put service on port 8000

* Add MCP container and packages to buildout
 2025-07-02 18:19:23 +01:00
cybermaggedon
4461d7b289
Feature/persist config (#370) 
* Cassandra tables for config

* Config is backed by Cassandra
 2025-05-07 12:58:32 +01:00
cybermaggedon
d0da122bed
Fix/llms (#366) 
* Fix LMStudio, cache documents with tg-load-sample-documents

* Fix Mistral
 2025-05-06 16:17:16 +01:00
cybermaggedon
a9197d11ee
Feature/configure flows (#345) 
- Keeps processing in different flows separate so that data can go to different stores / collections etc.
- Potentially supports different processing flows
- Tidies the processing API with common base-classes for e.g. LLMs, and automatic configuration of 'clients' to use the right queue names in a flow
 2025-04-22 20:21:38 +01:00
cybermaggedon
1d222235d3
Configuration initialisation (#335) 
* - Fixed error reporting in config
- Updated tg-init-pulsar to be able to load initial config to config-svc
- Tweaked API naming and added more config calls

* Tools to dump out prompts and agent tools
 2025-04-02 13:52:33 +01:00
cybermaggedon
c759d55734
Added module which does OCR for PDF, pdf-ocr in a separate package (#324) 
(has a lot of dependencies).  Uses Tesseract.
 2025-03-20 09:29:40 +00:00
JackColquitt
5f5cf8fd07 Added basic Mistral API support 2025-03-14 17:47:59 -07:00
cybermaggedon
edcdc4d59d
Feature/separate containers (#287) 
* Separate containerfiles

* Add push to Makefile

* Update image names in the templates
 2025-01-28 19:36:05 +00:00
cybermaggedon
dc2b599fda
Fix/release broken (#257) 
* Break release into 3 jobs

* Replace Github action with podman command
 2025-01-06 21:45:42 +00:00
Avi Avni
1ab2a7ff6b
wip integrate falkordb (#211) 2024-12-18 21:01:24 +00:00
cybermaggedon
7df7843dad
Main/remove parquet (#195) 
* Remove Parquet code, and package build
 2024-12-06 08:51:10 +00:00
Cyber MacGeddon
43756d872b Set dependencies up for the 0.13 branch. Set version=0.0.0 in Makefile 
to spot build errors.
 2024-10-15 00:31:08 +01:00
Cyber MacGeddon
5850b6c136 Merge branch 'release/v0.11' into release/v0.12 2024-10-09 19:38:13 +01:00
cybermaggedon
a711bc1dde
Fix trustgraph broken linkage (#109) 2024-10-08 20:33:14 +01:00
cybermaggedon
148092a6af
Fix/lock 0.11 version (#108) 
* - Locked 0.11 packages to 0.11 deps
- Added 'trustgraph' uber-package which installs the rest
- Added dependency to set package versions before building packages

* Bump version
 2024-10-04 22:12:39 +01:00
cybermaggedon
dda29bb663
Workflows (#105) 
* Some basic structure for workflows
* Add PyPI publication for 0.12
* Bump version
* Test bundle generation
* Install jsonnet
* Use release action to automate release creation
 2024-10-04 17:28:07 +01:00
cybermaggedon
222dc9982c
Feature/azure openai templates (#104) 
* Azure OpenAI LLM templates
* Bump version, fix package versions
* Add azure-openai to template generation
 2024-10-04 15:47:46 +01:00
Cyber MacGeddon
adba99f270 Bump version 2024-10-02 22:25:48 +01:00
cybermaggedon
db9ed06b1c
Fix/broken kg extract topics (#97) 
* Add missing kg-extract-topics service

* Bump version
 2024-10-02 22:23:00 +01:00
cybermaggedon
14672f7f0e
Fix/processor state specify prom (#93) 
* Provide mean to specify -p prometheus server
* Bump version
 2024-10-01 22:14:28 +01:00
Cyber MacGeddon
2e6be5cdce Bump version 2024-10-01 21:06:07 +01:00
cybermaggedon
56a9ac3ba9
Change LLM latency dashboard to be rate & bump version (#92) 2024-10-01 21:04:55 +01:00
cybermaggedon
ef1b8b5a13
Feature/metering dashboard (#89) 
* Bump version

* Added Prom metrics to metering, added dashboard

* Update YAMLs

* Add $ on axis

* Tweak dashboard
 2024-10-01 06:46:41 +01:00
cybermaggedon
88a7dfa126
Maint/rename pkg (#88) 
* Rename trustgraph-utils -> trustgraph-cli
* Update YAMLs
 2024-09-30 22:20:26 +01:00
cybermaggedon
771d9fc2c7
Make util pathnames have tg- prefix (#87) 2024-09-30 21:24:22 +01:00
cybermaggedon
0e4c9c69ee
Add twine upload target (#86) 2024-09-30 21:07:18 +01:00
cybermaggedon
c26ada08c2
Fix VertexAI package. Add Python packaging to Makefile. (#85) 
Bump version & generate templates.
 2024-09-30 20:50:20 +01:00
cybermaggedon
f00baab1b8
Maint/fix build env (#84) 
* Put README placeholders for packages in place
* Bump version
 2024-09-30 19:47:09 +01:00
cybermaggedon
9b91d5eee3
Feature/pkgsplit (#83) 
* Starting to spawn base package
* More package hacking
* Bedrock and VertexAI
* Parquet split
* Updated templates
* Utils
 2024-09-30 19:36:09 +01:00
cybermaggedon
3fb75c617b
Maint/auto pkg versions (#82) 
* Remove need to manage setup.py version

* Update YAMLs
 2024-09-30 16:38:50 +01:00
cybermaggedon
cdace22ee4
Feature/simpler subpackages (#81) 
* Back to simpler directory structure

* Bump version, update templates
 2024-09-30 16:16:20 +01:00
cybermaggedon
f081933217
Feature/subpackages (#80) 
* Renaming what will become the core package

* Tweaking to get  package build working

* Fix metering merge

* Rename to core directory

* Bump version.  Use namespace searching for packaging trustgraph-core

* Change references to trustgraph-core

* Forming embeddings-hf package

* Reference modules in core package.

* Build both packages to one container, bump version

* Update YAMLs
 2024-09-30 14:00:29 +01:00
cybermaggedon
14d79ef9f1
Streamline startup (#79) 
* Separate Prom metrics, different processors as different jobs

* Create producers before consumers, may streamline startup.

* Bump version

* Add Pulsar init command, will replace pulsar-admin invocations.

* Integrate tg-init-pulsar with YAMLs

* Update YAMLs
 2024-09-30 12:19:22 +01:00
Cyber MacGeddon
5e8a1520ee Bump version & update templates 2024-09-30 00:00:36 +01:00
cybermaggedon
74a14639bd
Feature/track processor state (#78) 
* Add a Prom metric to consumers & consumer/producers to track the running
state.

* New script, gets processor state using prometheus

* Bump version, add tg-processor-state to package

* Update templates
 2024-09-29 23:50:57 +01:00
cybermaggedon
efc364583b
Fix/graph rag uses wrong prompt (#77) 
* Fix queue name invocation, use correct names, not defaults

* Bump version

* Update templates
 2024-09-29 20:38:50 +01:00
Cyber MacGeddon
5951fb4e56 Bump version to 0.11.1 2024-09-29 18:15:34 +01:00
cybermaggedon
fa30544999
Fix/revert template change (#71) 
* Ditched the deploy directory (going away in 0.11) and putting
YAML files in top-dir of Github (for now).

* Update Makefile for the template change
 2024-09-29 18:13:34 +01:00
Cyber MacGeddon
e5249c2bac Bump version 2024-09-29 18:03:32 +01:00
Cyber MacGeddon
1d89e466d5 Docker hub login 2024-09-28 11:55:30 +01:00
Cyber MacGeddon
d6cacd3fb7 Bump version 2024-09-28 11:50:57 +01:00
Cyber MacGeddon
39cf256f5c Merge branch 'master' into release/v0.10. Includes llamafile and 
prompt modifications.
 2024-09-28 11:26:52 +01:00
Jack Colquitt
9612a11581
Added basic Llamafile integration (#63) 
* Added basic Llamafile integration
* Added llamafile template support
* New templates following llamafile addition
---------
Co-authored-by: Cyber MacGeddon <cybermaggedon@gmail.com>
 2024-09-16 16:18:01 +01:00
cybermaggedon
6af86fa09f
Topic templates for extractor (#62) 
* Add topic prompt to templates
* Bump version
* Updated templates
 2024-09-15 23:40:37 +01:00
cybermaggedon
0ae6feddb0
Added GCP and Minikube output (#59) 
* Added a config to create Minikube k8s, uses hostpath volumes
* Reworked templater to produce docker compose and minikube output
* Fix config templates
 2024-09-09 17:16:50 +01:00
cybermaggedon
f661791bbf
K8s (#58) 
Added templates which produce K8s resources.  With the provided GCP wrapper, it works on GCP K8s cluster.  This isn't stable enough for other folks to use so will need more piloting before it can be documented and released.
 2024-09-07 18:59:38 +01:00
cybermaggedon
375b213a54
Fix replace strings for JSON (#57) 
* Fix replace strings for JSON
* Add JSON markdown preamble/postamble in prompts
* Remove JSON chicanery in LLM  handling
* Bump version
 2024-09-05 20:49:32 +01:00