Jack Colquitt
9612a11581
Added basic Llamafile integration ( #63 )
...
* Added basic Llamafile integration
* Added llamafile template support
* New templates following llamafile addition
---------
Co-authored-by: Cyber MacGeddon <cybermaggedon@gmail.com>
2024-09-16 16:18:01 +01:00
cybermaggedon
6af86fa09f
Topic templates for extractor ( #62 )
...
* Add topic prompt to templates
* Bump version
* Updated templates
2024-09-15 23:40:37 +01:00
cybermaggedon
375b213a54
Fix replace strings for JSON ( #57 )
...
* Fix replace strings for JSON
* Add JSON markdown preamble/postamble in prompts
* Remove JSON chicanery in LLM handling
* Bump version
2024-09-05 20:49:32 +01:00
cybermaggedon
3445759598
Fix bedrock replace ( #56 )
...
* Fix replace ignoring first output
* Bump version
2024-09-05 20:00:38 +01:00
cybermaggedon
ddd8cc90e5
Fix templates ( #55 )
...
* Fix template import problem
* Bump version
2024-09-05 18:24:51 +01:00
Cyber MacGeddon
6fb118ba95
Bump version
2024-09-05 16:47:49 +01:00
cybermaggedon
65d7f6d261
Refactor templates ( #52 )
...
* Switching from docker compose to abstract form - should be easier to k8s later
* Text loader util
* Recreate templates
2024-09-05 16:40:47 +01:00
cybermaggedon
af5508ff68
Cannot access s error ( #50 )
...
* Fix order of statements error
* Bump version
* Update templates
* Add missing script files
* Added missing DE support init
* Fixed bugs preventing definition extraction from working (#49 ).
2024-09-03 22:10:48 +01:00
cybermaggedon
208c219962
Template rejig ( #48 )
...
* document-rag / graph-rag refactor of templates
* Tweaking the docs and categories
* Clarify triple store vs RAG
* Tweak knowledge graph linkage
* Doc embedding for Qdrant
* Fix document RAG on Qdrant
* Fix templates
* Bump version
* Updated templates
2024-09-03 00:09:15 +01:00
cybermaggedon
f7a30006ad
Make templating work more flexibly ( #44 )
...
* Restructure directory
* Config loading
* Variable override points in JSONNET templates, separate pulsar-manager template
* Bump version
* Tidy chunking
* Simplified prompt overrides
* Update config loader
* Fix recursive chunker template
2024-08-30 17:47:35 +01:00
Cyber MacGeddon
937dad3381
Version to 0.8.0
2024-08-27 23:40:40 +01:00
cybermaggedon
32b087fbf6
Switch Milvus for Qdrant in YAMLs ( #43 )
...
* Qdrant working
* - Fix missing prompt templates
- Bump version
- Add Qdrant to packages
* Switch Milvus for Qdrant in config files
2024-08-27 23:37:24 +01:00
cybermaggedon
e4c4774b5d
Extract rows and apply object embeddings ( #42 )
...
* - Restructured the extract directories
- Added an extractor for 'rows' == a row of a table
- Added a row extractor prompt to prompter.
* Add row support to template prompter
* Row extraction working
* Bump version
* Emit extracted info
* Object embeddings store
* Invocation script
* Add script to package, remove cruft output
* Write rows to Cassandra
* Remove output cruft
2024-08-27 21:55:12 +01:00
cybermaggedon
669aed0f8a
Added doc embedding support ( #41 )
...
* document embedding writer & query
* Added test query for doc embeddings
* Bump version
* Added doc rag prompt
* Document RAG service
2024-08-26 23:45:23 +01:00
cybermaggedon
0159e938a2
Update LLM text-completion duration metric ( #40 )
...
* Added LLM duration metric, better buckets
* Added heatmap to dashboard to replace 95/97/99 chart
* Bump version
2024-08-26 11:46:36 +01:00
cybermaggedon
d0e3fcf019
Catch LLM mismatches ( #39 )
...
* Catch more upstream LLM issues
* Bump version
2024-08-26 10:58:02 +01:00
cybermaggedon
acd60e95ec
Catch llm errors ( #38 )
...
* Catch 'null' output from prompt for some values, presumably this is
caused by an upstream LLM error.
* Bump version
2024-08-26 10:52:39 +01:00
cybermaggedon
cea8562ecf
Fix timeouts ( #37 )
...
* Fix other timeout default settings
* Add storage-only YAML output
* Bump version
2024-08-25 23:57:30 +01:00
