* Bring QDrant up-to-date
* Tables for data from queue outputs
- Pass single Pulsar client to everything in gateway & librarian
- Pulsar listener-name support in gateway
- PDF and text load working in librarian
* Complete Cassandra schema
* Add librarian support to templates
API-side support for Wikipedia, DBpedia and internet search functions This incorporates a refactor of the API code to break it up, separate classes for endpoints to reduce duplication
* Add metering-rag for RAG token metrics
* Make metering executable
* Add metering-rag to Prom metrics
* Metricate the right queue
* Update templates to include metering-rag
Added templates which produce K8s resources. With the provided GCP wrapper, it works on GCP K8s cluster. This isn't stable enough for other folks to use so will need more piloting before it can be documented and released.
* Added prompt-template, allows definiton, relationships and kg query
to be specified in config / command-line.
* Bump version & add prompt-templates to YAMLs
* Apply to graph rag flow
* Break out different templates
* - Added docker-compose-storage.yaml, just the infrastructure bits
- Tidied storage invocation
* Util, sits on chunker output and reports histogram of chunk sizes
