Commit graph

195 commits

Author SHA1 Message Date
JackColquitt
e23e5d4813 Updated readme table 2024-10-02 18:31:28 -07:00
JackColquitt
63cf8a27d2 Updated banner image 2024-10-02 18:26:45 -07:00
JackColquitt
81a1447907 Fixed typo 2024-10-02 18:25:20 -07:00
JackColquitt
ce9d21b65f Readme updates 2024-10-02 18:22:09 -07:00
JackColquitt
a2a93ebaff Updated agent messaging in readme 2024-09-24 14:24:16 -07:00
JackColquitt
78e3418dcb Readme tweaks 2024-09-23 15:01:23 -07:00
JackColquitt
e2c326c626 Added sample files 2024-09-23 14:21:50 -07:00
JackColquitt
124cb20932 More readme tweaks 2024-09-23 14:14:30 -07:00
JackColquitt
74094d4471 Link tweak in readme 2024-09-23 14:07:17 -07:00
JackColquitt
99370670de Readme tweaks 2024-09-23 14:05:01 -07:00
JackColquitt
a6f38fc214 Tidy up readme 2024-09-23 13:59:02 -07:00
JackColquitt
543c10090f Readme tweaks 2024-09-22 10:41:49 -07:00
JackColquitt
28c2815ac3 Fixed readme typos 2024-09-16 17:53:47 -07:00
JackColquitt
28a28b9f0a Updated readme 2024-09-16 17:52:02 -07:00
JackColquitt
7818178f41 Updated readme 2024-09-16 10:37:53 -07:00
Jack Colquitt
9612a11581
Added basic Llamafile integration (#63)
* Added basic Llamafile integration
* Added llamafile template support
* New templates following llamafile addition
---------
Co-authored-by: Cyber MacGeddon <cybermaggedon@gmail.com>
2024-09-16 16:18:01 +01:00
cybermaggedon
6af86fa09f
Topic templates for extractor (#62)
* Add topic prompt to templates
* Bump version
* Updated templates
2024-09-15 23:40:37 +01:00
Jack Colquitt
728ff7542a
Extraction upgrade (#61)
* Added KG Topics
* Updated prompt-template
* Fixed prompt-generic
2024-09-15 22:47:57 +01:00
JackColquitt
13f6b5d87f Updated readme 2024-09-11 10:10:39 -07:00
JackColquitt
7af32b0eef Doc updates for v0.9.3 2024-09-05 14:01:41 -07:00
cybermaggedon
375b213a54
Fix replace strings for JSON (#57)
* Fix replace strings for JSON
* Add JSON markdown preamble/postamble in prompts
* Remove JSON chicanery in LLM  handling
* Bump version
2024-09-05 20:49:32 +01:00
cybermaggedon
3445759598
Fix bedrock replace (#56)
* Fix replace ignoring first output

* Bump version
2024-09-05 20:00:38 +01:00
cybermaggedon
ddd8cc90e5
Fix templates (#55)
* Fix template import problem

* Bump version
2024-09-05 18:24:51 +01:00
cybermaggedon
f7429f2f9b
Fix remaining templates (#54) 2024-09-05 18:17:47 +01:00
Cyber MacGeddon
6fb118ba95 Bump version 2024-09-05 16:47:49 +01:00
cybermaggedon
6e4534e35c
Tidied scripts, added 2 query scripts (#53) 2024-09-05 16:45:22 +01:00
cybermaggedon
65d7f6d261
Refactor templates (#52)
* Switching from docker compose to abstract form - should be easier to k8s later
* Text loader util
* Recreate templates
2024-09-05 16:40:47 +01:00
cybermaggedon
af5508ff68
Cannot access s error (#50)
* Fix order of statements error
* Bump version
* Update templates
* Add missing script files
* Added missing DE support init
* Fixed bugs preventing definition extraction from working (#49).
2024-09-03 22:10:48 +01:00
cybermaggedon
208c219962
Template rejig (#48)
* document-rag / graph-rag refactor of templates

* Tweaking the docs and categories

* Clarify triple store vs RAG

* Tweak knowledge graph linkage

* Doc embedding for Qdrant

* Fix document RAG on Qdrant

* Fix templates

* Bump version

* Updated templates
2024-09-03 00:09:15 +01:00
cybermaggedon
121f7bb776
Updates for config util repo (#47)
* Fix pulsar manager template import
* Add pattern categories.  Update parameters with new schema.
* Add more parameters to config
2024-09-01 21:29:29 +01:00
cybermaggedon
06a9e913dc
Enable model overrides, added a null option in config-loader (#45)
Enable model overrides, added a null option in config-loader
2024-08-30 21:33:03 +01:00
cybermaggedon
f7a30006ad
Make templating work more flexibly (#44)
* Restructure directory
* Config loading
* Variable override points in JSONNET templates, separate pulsar-manager template
* Bump version
* Tidy chunking
* Simplified prompt overrides
* Update config loader
* Fix recursive chunker template
2024-08-30 17:47:35 +01:00
JackColquitt
f10c2822f4 Fixed typo 2024-08-27 19:11:36 -07:00
JackColquitt
86a46ea19b Updated architecture diagram 2024-08-27 19:10:13 -07:00
JackColquitt
09c6dcc4b3 Updated readme for Qdrant 2024-08-27 18:36:39 -07:00
Cyber MacGeddon
937dad3381 Version to 0.8.0 2024-08-27 23:40:40 +01:00
cybermaggedon
32b087fbf6
Switch Milvus for Qdrant in YAMLs (#43)
* Qdrant working

* - Fix missing prompt templates
- Bump version
- Add Qdrant to packages

* Switch Milvus for Qdrant in config files
2024-08-27 23:37:24 +01:00
JackColquitt
2622c48690 Documenting Podman support 2024-08-27 14:41:31 -07:00
cybermaggedon
e4c4774b5d
Extract rows and apply object embeddings (#42)
* - Restructured the extract directories
- Added an extractor for 'rows' == a row of a table
- Added a row extractor prompt to prompter.
* Add row support to template prompter
* Row extraction working
* Bump version
* Emit extracted info
* Object embeddings store
* Invocation script
* Add script to package, remove cruft output
* Write rows to Cassandra
* Remove output cruft
2024-08-27 21:55:12 +01:00
Cyber MacGeddon
b574ba26a8 Update templates 2024-08-26 23:47:05 +01:00
cybermaggedon
669aed0f8a
Added doc embedding support (#41)
* document embedding writer & query
* Added test query for doc embeddings
* Bump version
* Added doc rag prompt
* Document RAG service
2024-08-26 23:45:23 +01:00
cybermaggedon
0159e938a2
Update LLM text-completion duration metric (#40)
* Added LLM duration metric, better buckets

* Added heatmap to dashboard to replace 95/97/99 chart

* Bump version
2024-08-26 11:46:36 +01:00
cybermaggedon
d0e3fcf019
Catch LLM mismatches (#39)
* Catch more upstream LLM issues

* Bump version
2024-08-26 10:58:02 +01:00
cybermaggedon
acd60e95ec
Catch llm errors (#38)
* Catch 'null' output from prompt for some values, presumably this is
caused by an upstream LLM error.

* Bump version
2024-08-26 10:52:39 +01:00
cybermaggedon
cea8562ecf
Fix timeouts (#37)
* Fix other timeout default settings

* Add storage-only YAML output

* Bump version
2024-08-25 23:57:30 +01:00
Cyber MacGeddon
a83c623ca3 Update templates 2024-08-25 20:47:29 +01:00
cybermaggedon
3ca1defc88
Increase timeout (#36)
* Increase timeout
* Bump version
2024-08-25 20:45:04 +01:00
Jack Colquitt
980a4c5b93
Jamba and Cohere support for Bedrock (#34) 2024-08-25 20:44:00 +01:00
cybermaggedon
d69de52b04
Increase resources (#35)
* More memory for Cassandra
* More memory/CPU for embeddings
* Bump version, regenerate templates
2024-08-25 20:38:19 +01:00
cybermaggedon
6edc3f0ee1
Prompt templates (#33)
* Added prompt-template, allows definiton, relationships and kg query
to be specified in config / command-line.

* Bump version & add prompt-templates to YAMLs

* Apply to graph rag flow

* Break out different templates
2024-08-23 23:34:16 +01:00