JackColquitt
86a46ea19b
Updated architecture diagram
2024-08-27 19:10:13 -07:00
JackColquitt
09c6dcc4b3
Updated readme for Qdrant
2024-08-27 18:36:39 -07:00
Cyber MacGeddon
937dad3381
Version to 0.8.0
2024-08-27 23:40:40 +01:00
cybermaggedon
32b087fbf6
Switch Milvus for Qdrant in YAMLs ( #43 )
...
* Qdrant working
* - Fix missing prompt templates
- Bump version
- Add Qdrant to packages
* Switch Milvus for Qdrant in config files
2024-08-27 23:37:24 +01:00
JackColquitt
2622c48690
Documenting Podman support
2024-08-27 14:41:31 -07:00
cybermaggedon
e4c4774b5d
Extract rows and apply object embeddings ( #42 )
...
* - Restructured the extract directories
- Added an extractor for 'rows' == a row of a table
- Added a row extractor prompt to prompter.
* Add row support to template prompter
* Row extraction working
* Bump version
* Emit extracted info
* Object embeddings store
* Invocation script
* Add script to package, remove cruft output
* Write rows to Cassandra
* Remove output cruft
2024-08-27 21:55:12 +01:00
Cyber MacGeddon
b574ba26a8
Update templates
2024-08-26 23:47:05 +01:00
cybermaggedon
669aed0f8a
Added doc embedding support ( #41 )
...
* document embedding writer & query
* Added test query for doc embeddings
* Bump version
* Added doc rag prompt
* Document RAG service
2024-08-26 23:45:23 +01:00
cybermaggedon
0159e938a2
Update LLM text-completion duration metric ( #40 )
...
* Added LLM duration metric, better buckets
* Added heatmap to dashboard to replace 95/97/99 chart
* Bump version
2024-08-26 11:46:36 +01:00
cybermaggedon
d0e3fcf019
Catch LLM mismatches ( #39 )
...
* Catch more upstream LLM issues
* Bump version
2024-08-26 10:58:02 +01:00
cybermaggedon
acd60e95ec
Catch llm errors ( #38 )
...
* Catch 'null' output from prompt for some values, presumably this is
caused by an upstream LLM error.
* Bump version
2024-08-26 10:52:39 +01:00
cybermaggedon
cea8562ecf
Fix timeouts ( #37 )
...
* Fix other timeout default settings
* Add storage-only YAML output
* Bump version
2024-08-25 23:57:30 +01:00
Cyber MacGeddon
a83c623ca3
Update templates
2024-08-25 20:47:29 +01:00
cybermaggedon
3ca1defc88
Increase timeout ( #36 )
...
* Increase timeout
* Bump version
2024-08-25 20:45:04 +01:00
Jack Colquitt
980a4c5b93
Jamba and Cohere support for Bedrock ( #34 )
2024-08-25 20:44:00 +01:00
cybermaggedon
d69de52b04
Increase resources ( #35 )
...
* More memory for Cassandra
* More memory/CPU for embeddings
* Bump version, regenerate templates
2024-08-25 20:38:19 +01:00
cybermaggedon
6edc3f0ee1
Prompt templates ( #33 )
...
* Added prompt-template, allows definiton, relationships and kg query
to be specified in config / command-line.
* Bump version & add prompt-templates to YAMLs
* Apply to graph rag flow
* Break out different templates
2024-08-23 23:34:16 +01:00
JackColquitt
e1ecf9f356
Added banner image
2024-08-23 11:40:49 -07:00
JackColquitt
5bd2a51dfc
Added links in the readme
2024-08-23 11:16:19 -07:00
JackColquitt
639701a18c
Updated QuickStart
2024-08-23 10:51:20 -07:00
cybermaggedon
6d0776c7bb
Fix OpenAI reporting ( #32 )
...
* Fix OpenAI reporting
* bump version
2024-08-23 14:02:06 +01:00
cybermaggedon
380bddeb90
Fix LLM output reporting ( #31 )
...
* Fix LLM output reporting
* Bump version
2024-08-23 13:44:42 +01:00
cybermaggedon
1e92b2048a
Fix client missing exception import ( #30 )
...
* Fix missing import, remove cruft imports
* Bump version
2024-08-23 12:59:14 +01:00
cybermaggedon
e7c498be92
Fix neo4j ( #29 )
...
* - Fix Neo4j memory
- Fix neo4j query
* Version to 0.7.6
2024-08-23 12:49:42 +01:00
cybermaggedon
8372ff0eb6
Fix exception import fail ( #28 )
...
* Fix a missing import
* Fix missing import, bump version
2024-08-22 23:59:26 +01:00
cybermaggedon
b1b26a3f55
- Updated dashboard ( #27 )
...
- Adjusted limits everything works
- Bump version
2024-08-22 23:23:11 +01:00
cybermaggedon
2bc602fdcf
Fix, was putting Neo in Cassandra config ( #26 )
2024-08-22 22:02:57 +01:00
cybermaggedon
25c390469f
Update dashboard with resources ( #25 )
2024-08-22 21:54:00 +01:00
cybermaggedon
a2ae1d8820
Generate all YAML files ( #24 )
...
* All templates generated, added missing file
* Up version
2024-08-22 21:20:17 +01:00
cybermaggedon
305dda4463
Fix errors in previous update ( #23 )
...
* Increase some limits
* Fix msg errors and update version
2024-08-22 20:58:44 +01:00
cybermaggedon
a01a72ba00
Set resource limits ( #22 )
...
* Added resource limits to resources.
* Boost version number, rebuild YAMLs
2024-08-22 17:54:00 +01:00
cybermaggedon
86cbe7f929
- Version to 0.7.0 ( #19 )
...
- Tweak Containerfile to add more dependencies, speed up container
build.
2024-08-22 17:02:36 +01:00
cybermaggedon
1297cdb1d0
Improve request/response handling ( #18 )
...
* Request/response error handling with common client
* Fixup error handling change
2024-08-22 17:02:18 +01:00
cybermaggedon
19c826c387
Update dashboard for chunks & errors ( #21 )
2024-08-22 17:02:06 +01:00
cybermaggedon
ada7c405df
Update dependencies ( #20 )
2024-08-22 17:01:47 +01:00
JackColquitt
f96781d920
Typo fix
2024-08-21 18:37:41 -07:00
JackColquitt
092dcf770b
Updated README and QuickStart
2024-08-21 18:36:34 -07:00
Cyber MacGeddon
f09618081e
Version 0.6.10
2024-08-22 00:21:42 +01:00
cybermaggedon
0043b871ff
Added chunk_size metrics, and added metrics to dashboard ( #16 )
2024-08-22 00:20:24 +01:00
cybermaggedon
d3cdb97528
Fix auto-templates ( #17 )
2024-08-22 00:19:55 +01:00
Jack Colquitt
c4bfd9fc8c
Parameters, Parsing, renaming YAMLs and Neo4j YAMLS ( #15 )
...
* Added some params
* Parameter updates
* Fixed Neo4j issue
2024-08-22 00:03:56 +01:00
Cyber MacGeddon
7d00a53711
Some default values in yaml file
2024-08-21 17:17:24 +01:00
cybermaggedon
7113d04f21
Add token chunker ( #14 )
2024-08-21 16:51:33 +01:00
cybermaggedon
0e2db095e3
Add a docker-compose for just the stores ( #13 )
...
* - Added docker-compose-storage.yaml, just the infrastructure bits
- Tidied storage invocation
* Util, sits on chunker output and reports histogram of chunk sizes
2024-08-21 16:20:21 +01:00
Cyber MacGeddon
b0fdb4f314
Version to 0.6.6
2024-08-20 22:14:13 +01:00
Cyber MacGeddon
4cee446920
Fix timing issue in 2 other client fetches
2024-08-20 22:13:08 +01:00
Cyber MacGeddon
ba056b93ed
Catch JSON parse errors in prompt processor
2024-08-20 20:51:32 +01:00
Cyber MacGeddon
20f983eec9
- Change flawed _client timeout logic which was causing major lags
...
- Moved clients to trustgraph.clients to tidy the parent directory
- Version bump
2024-08-20 17:54:11 +01:00
cybermaggedon
bdf4bc2bf5
Error is a heatmap ( #12 )
2024-08-19 23:35:16 +01:00
cybermaggedon
a38f530c5f
Rate limit handling ( #11 )
...
* Added a rate limit exception
* Reduce request/response timeouts because looks like there are major issues
* Add rate limit exception catch to all consumers
* Version to 0.6.3
2024-08-19 22:15:32 +01:00