Commit graph

23 commits

Author SHA1 Message Date
Cyber MacGeddon
8819bbc467 Add JSON markdown preamble/postamble in prompts 2024-09-05 20:44:46 +01:00
Cyber MacGeddon
a50efe901e Fix replace strings for JSON 2024-09-05 20:38:21 +01:00
cybermaggedon
3445759598
Fix bedrock replace (#56)
* Fix replace ignoring first output

* Bump version
2024-09-05 20:00:38 +01:00
cybermaggedon
e4c4774b5d
Extract rows and apply object embeddings (#42)
* - Restructured the extract directories
- Added an extractor for 'rows' == a row of a table
- Added a row extractor prompt to prompter.
* Add row support to template prompter
* Row extraction working
* Bump version
* Emit extracted info
* Object embeddings store
* Invocation script
* Add script to package, remove cruft output
* Write rows to Cassandra
* Remove output cruft
2024-08-27 21:55:12 +01:00
cybermaggedon
669aed0f8a
Added doc embedding support (#41)
* document embedding writer & query
* Added test query for doc embeddings
* Bump version
* Added doc rag prompt
* Document RAG service
2024-08-26 23:45:23 +01:00
cybermaggedon
0159e938a2
Update LLM text-completion duration metric (#40)
* Added LLM duration metric, better buckets

* Added heatmap to dashboard to replace 95/97/99 chart

* Bump version
2024-08-26 11:46:36 +01:00
cybermaggedon
d0e3fcf019
Catch LLM mismatches (#39)
* Catch more upstream LLM issues

* Bump version
2024-08-26 10:58:02 +01:00
Jack Colquitt
980a4c5b93
Jamba and Cohere support for Bedrock (#34) 2024-08-25 20:44:00 +01:00
cybermaggedon
6edc3f0ee1
Prompt templates (#33)
* Added prompt-template, allows definiton, relationships and kg query
to be specified in config / command-line.

* Bump version & add prompt-templates to YAMLs

* Apply to graph rag flow

* Break out different templates
2024-08-23 23:34:16 +01:00
cybermaggedon
6d0776c7bb
Fix OpenAI reporting (#32)
* Fix OpenAI reporting

* bump version
2024-08-23 14:02:06 +01:00
cybermaggedon
380bddeb90
Fix LLM output reporting (#31)
* Fix LLM output reporting

* Bump version
2024-08-23 13:44:42 +01:00
cybermaggedon
305dda4463
Fix errors in previous update (#23)
* Increase some limits
* Fix msg errors and update version
2024-08-22 20:58:44 +01:00
cybermaggedon
1297cdb1d0
Improve request/response handling (#18)
* Request/response error handling with common client

* Fixup error handling change
2024-08-22 17:02:18 +01:00
Jack Colquitt
c4bfd9fc8c
Parameters, Parsing, renaming YAMLs and Neo4j YAMLS (#15)
* Added some params
* Parameter updates
* Fixed Neo4j issue
2024-08-22 00:03:56 +01:00
Cyber MacGeddon
ba056b93ed Catch JSON parse errors in prompt processor 2024-08-20 20:51:32 +01:00
Cyber MacGeddon
20f983eec9 - Change flawed _client timeout logic which was causing major lags
- Moved clients to trustgraph.clients to tidy the parent directory
- Version bump
2024-08-20 17:54:11 +01:00
cybermaggedon
a38f530c5f
Rate limit handling (#11)
* Added a rate limit exception
* Reduce request/response timeouts because looks like there are major issues
* Add rate limit exception catch to all consumers
* Version to 0.6.3
2024-08-19 22:15:32 +01:00
cybermaggedon
a3ea1301d6
Breakout store queries (#8)
- Break out store queries, so not locked into a Milvus/Cassandra backend
- Break out prompting into a separate module, so that prompts can be tailored to other LLMs
- Jsonnet used to generate docker compose templates
- Version to 0.6.0
2024-08-13 17:30:59 +01:00
cybermaggedon
fd547f7762
OpenAI integration (#7)
* Preliminary OpenAI support
* Version to 0.5.9

---------

Co-authored-by: JackColquitt <daniel@kalntera.ai>
2024-08-12 15:37:04 +01:00
JackColquitt
4584464e69 Added quick Cohere fix 2024-08-11 13:42:24 -07:00
Cyber MacGeddon
90fe017240 Bedrock LLM fix 2024-08-07 20:37:24 +01:00
Jack Colquitt
f349c8a72e
Bedrock, Cohere, and Mixed Support (#6)
* Added Cohere support
* Tweaks to rag prompt
* Bedrock support
* Version to 0.5.7
2024-08-07 19:27:37 +01:00
cybermaggedon
3947920ee8
Refactor names (#4)
- Downsize embeddings model to mini-lm in docker-compose files
- Rename for structure
- Default queues defined in schema file
- Standardize naming: graph embeddings, chunk embeddings, triples
2024-07-23 21:34:03 +01:00