mirror of
https://github.com/trustgraph-ai/trustgraph.git
synced 2026-04-25 08:26:21 +02:00
2bf4af294e
- Silence pika, cassandra etc. logging at INFO (too much chatter) - Add per processor log tags so that logs can be understood in processor group. - Deal with RabbitMQ lag weirdness - Added more processor group examples
31 lines
773 B
YAML
31 lines
773 B
YAML
# Embeddings. Memory-hungry — fastembed loads an ML model at startup.
|
|
# Keep isolated from other groups so its memory footprint and restart
|
|
# latency don't affect siblings.
|
|
|
|
_defaults: &defaults
|
|
pubsub_backend: rabbitmq
|
|
rabbitmq_host: localhost
|
|
log_level: INFO
|
|
|
|
processors:
|
|
|
|
- class: trustgraph.embeddings.fastembed.Processor
|
|
params:
|
|
<<: *defaults
|
|
id: embeddings
|
|
concurrency: 1
|
|
|
|
- class: trustgraph.embeddings.document_embeddings.Processor
|
|
params:
|
|
<<: *defaults
|
|
id: document-embeddings
|
|
|
|
- class: trustgraph.embeddings.graph_embeddings.Processor
|
|
params:
|
|
<<: *defaults
|
|
id: graph-embeddings
|
|
|
|
- class: trustgraph.embeddings.row_embeddings.Processor
|
|
params:
|
|
<<: *defaults
|
|
id: row-embeddings
|