JackColquitt
99370670de
Readme tweaks
2024-09-23 14:05:01 -07:00
JackColquitt
a6f38fc214
Tidy up readme
2024-09-23 13:59:02 -07:00
JackColquitt
543c10090f
Readme tweaks
2024-09-22 10:41:49 -07:00
JackColquitt
28c2815ac3
Fixed readme typos
2024-09-16 17:53:47 -07:00
JackColquitt
28a28b9f0a
Updated readme
2024-09-16 17:52:02 -07:00
JackColquitt
7818178f41
Updated readme
2024-09-16 10:37:53 -07:00
Jack Colquitt
9612a11581
Added basic Llamafile integration ( #63 )
...
* Added basic Llamafile integration
* Added llamafile template support
* New templates following llamafile addition
---------
Co-authored-by: Cyber MacGeddon <cybermaggedon@gmail.com>
2024-09-16 16:18:01 +01:00
cybermaggedon
6af86fa09f
Topic templates for extractor ( #62 )
...
* Add topic prompt to templates
* Bump version
* Updated templates
2024-09-15 23:40:37 +01:00
Jack Colquitt
728ff7542a
Extraction upgrade ( #61 )
...
* Added KG Topics
* Updated prompt-template
* Fixed prompt-generic
2024-09-15 22:47:57 +01:00
JackColquitt
13f6b5d87f
Updated readme
2024-09-11 10:10:39 -07:00
cybermaggedon
054ea6c76a
Fix Docker Compose relative directory problem ( #60 )
...
- Fix Docker Compose relative directory problem
- Added CONFIGDIR environment variable for docker compose
- Correct Pulsar URL defaults for graph utils to be localhost again
2024-09-09 22:03:10 +01:00
cybermaggedon
0ae6feddb0
Added GCP and Minikube output ( #59 )
...
* Added a config to create Minikube k8s, uses hostpath volumes
* Reworked templater to produce docker compose and minikube output
* Fix config templates
2024-09-09 17:16:50 +01:00
cybermaggedon
f661791bbf
K8s ( #58 )
...
Added templates which produce K8s resources. With the provided GCP wrapper, it works on GCP K8s cluster. This isn't stable enough for other folks to use so will need more piloting before it can be documented and released.
2024-09-07 18:59:38 +01:00
JackColquitt
7af32b0eef
Doc updates for v0.9.3
2024-09-05 14:01:41 -07:00
cybermaggedon
375b213a54
Fix replace strings for JSON ( #57 )
...
* Fix replace strings for JSON
* Add JSON markdown preamble/postamble in prompts
* Remove JSON chicanery in LLM handling
* Bump version
2024-09-05 20:49:32 +01:00
cybermaggedon
3445759598
Fix bedrock replace ( #56 )
...
* Fix replace ignoring first output
* Bump version
2024-09-05 20:00:38 +01:00
cybermaggedon
ddd8cc90e5
Fix templates ( #55 )
...
* Fix template import problem
* Bump version
2024-09-05 18:24:51 +01:00
cybermaggedon
f7429f2f9b
Fix remaining templates ( #54 )
2024-09-05 18:17:47 +01:00
Cyber MacGeddon
6fb118ba95
Bump version
2024-09-05 16:47:49 +01:00
cybermaggedon
6e4534e35c
Tidied scripts, added 2 query scripts ( #53 )
2024-09-05 16:45:22 +01:00
cybermaggedon
65d7f6d261
Refactor templates ( #52 )
...
* Switching from docker compose to abstract form - should be easier to k8s later
* Text loader util
* Recreate templates
2024-09-05 16:40:47 +01:00
cybermaggedon
af5508ff68
Cannot access s error ( #50 )
...
* Fix order of statements error
* Bump version
* Update templates
* Add missing script files
* Added missing DE support init
* Fixed bugs preventing definition extraction from working (#49 ).
2024-09-03 22:10:48 +01:00
cybermaggedon
208c219962
Template rejig ( #48 )
...
* document-rag / graph-rag refactor of templates
* Tweaking the docs and categories
* Clarify triple store vs RAG
* Tweak knowledge graph linkage
* Doc embedding for Qdrant
* Fix document RAG on Qdrant
* Fix templates
* Bump version
* Updated templates
2024-09-03 00:09:15 +01:00
cybermaggedon
121f7bb776
Updates for config util repo ( #47 )
...
* Fix pulsar manager template import
* Add pattern categories. Update parameters with new schema.
* Add more parameters to config
2024-09-01 21:29:29 +01:00
cybermaggedon
06a9e913dc
Enable model overrides, added a null option in config-loader ( #45 )
...
Enable model overrides, added a null option in config-loader
2024-08-30 21:33:03 +01:00
cybermaggedon
f7a30006ad
Make templating work more flexibly ( #44 )
...
* Restructure directory
* Config loading
* Variable override points in JSONNET templates, separate pulsar-manager template
* Bump version
* Tidy chunking
* Simplified prompt overrides
* Update config loader
* Fix recursive chunker template
2024-08-30 17:47:35 +01:00
JackColquitt
f10c2822f4
Fixed typo
2024-08-27 19:11:36 -07:00
JackColquitt
86a46ea19b
Updated architecture diagram
2024-08-27 19:10:13 -07:00
JackColquitt
09c6dcc4b3
Updated readme for Qdrant
2024-08-27 18:36:39 -07:00
Cyber MacGeddon
937dad3381
Version to 0.8.0
2024-08-27 23:40:40 +01:00
cybermaggedon
32b087fbf6
Switch Milvus for Qdrant in YAMLs ( #43 )
...
* Qdrant working
* - Fix missing prompt templates
- Bump version
- Add Qdrant to packages
* Switch Milvus for Qdrant in config files
2024-08-27 23:37:24 +01:00
JackColquitt
2622c48690
Documenting Podman support
2024-08-27 14:41:31 -07:00
cybermaggedon
e4c4774b5d
Extract rows and apply object embeddings ( #42 )
...
* - Restructured the extract directories
- Added an extractor for 'rows' == a row of a table
- Added a row extractor prompt to prompter.
* Add row support to template prompter
* Row extraction working
* Bump version
* Emit extracted info
* Object embeddings store
* Invocation script
* Add script to package, remove cruft output
* Write rows to Cassandra
* Remove output cruft
2024-08-27 21:55:12 +01:00
Cyber MacGeddon
b574ba26a8
Update templates
2024-08-26 23:47:05 +01:00
cybermaggedon
669aed0f8a
Added doc embedding support ( #41 )
...
* document embedding writer & query
* Added test query for doc embeddings
* Bump version
* Added doc rag prompt
* Document RAG service
2024-08-26 23:45:23 +01:00
cybermaggedon
0159e938a2
Update LLM text-completion duration metric ( #40 )
...
* Added LLM duration metric, better buckets
* Added heatmap to dashboard to replace 95/97/99 chart
* Bump version
2024-08-26 11:46:36 +01:00
cybermaggedon
d0e3fcf019
Catch LLM mismatches ( #39 )
...
* Catch more upstream LLM issues
* Bump version
2024-08-26 10:58:02 +01:00
cybermaggedon
acd60e95ec
Catch llm errors ( #38 )
...
* Catch 'null' output from prompt for some values, presumably this is
caused by an upstream LLM error.
* Bump version
2024-08-26 10:52:39 +01:00
cybermaggedon
cea8562ecf
Fix timeouts ( #37 )
...
* Fix other timeout default settings
* Add storage-only YAML output
* Bump version
2024-08-25 23:57:30 +01:00
Cyber MacGeddon
a83c623ca3
Update templates
2024-08-25 20:47:29 +01:00
cybermaggedon
3ca1defc88
Increase timeout ( #36 )
...
* Increase timeout
* Bump version
2024-08-25 20:45:04 +01:00
Jack Colquitt
980a4c5b93
Jamba and Cohere support for Bedrock ( #34 )
2024-08-25 20:44:00 +01:00
cybermaggedon
d69de52b04
Increase resources ( #35 )
...
* More memory for Cassandra
* More memory/CPU for embeddings
* Bump version, regenerate templates
2024-08-25 20:38:19 +01:00
cybermaggedon
6edc3f0ee1
Prompt templates ( #33 )
...
* Added prompt-template, allows definiton, relationships and kg query
to be specified in config / command-line.
* Bump version & add prompt-templates to YAMLs
* Apply to graph rag flow
* Break out different templates
2024-08-23 23:34:16 +01:00
JackColquitt
e1ecf9f356
Added banner image
2024-08-23 11:40:49 -07:00
JackColquitt
5bd2a51dfc
Added links in the readme
2024-08-23 11:16:19 -07:00
JackColquitt
639701a18c
Updated QuickStart
2024-08-23 10:51:20 -07:00
cybermaggedon
6d0776c7bb
Fix OpenAI reporting ( #32 )
...
* Fix OpenAI reporting
* bump version
2024-08-23 14:02:06 +01:00
cybermaggedon
380bddeb90
Fix LLM output reporting ( #31 )
...
* Fix LLM output reporting
* Bump version
2024-08-23 13:44:42 +01:00
cybermaggedon
1e92b2048a
Fix client missing exception import ( #30 )
...
* Fix missing import, remove cruft imports
* Bump version
2024-08-23 12:59:14 +01:00
