cybermaggedon 1740e315f4 feat: batch row imports and split index configuration (#1055) ... Adds batching to structured data row imports. Previously each row was sent as a separate WebSocket message, causing one embeddings service call per row. The bulk import clients now accumulate rows into batches (default 40) before sending, and the --batch-size CLI argument is wired through from tg-load-structured-data to the import call. Splits the schema "indexes" field into two separate configurations: - "query-indexes": fields for Cassandra exact-match retrieval - "vector-indexes": fields for vector embedding and semantic search This avoids wasting compute embedding primary key integers that only need exact lookup, while allowing each field to independently opt in to either or both retrieval patterns. Adds row_id (the primary key value) as a clustering column in the Cassandra rows table so multiple rows sharing the same index value no longer silently overwrite each other. Tests updated for new Cassandra schema.		2026-07-22 10:20:06 +01:00
..
sample_documents	feat: replace external sample documents with bundled demo content (#956)	2026-05-28 11:06:52 +01:00
__init__.py	Migrate from setup.py to pyproject.toml (#440)	2025-07-23 21:22:08 +01:00
_iam.py	feat: IAM service, gateway auth middleware, capability model, and CLIs (#849)	2026-04-24 17:29:10 +01:00
add_library_document.py	feat: workspace-based multi-tenancy, replacing user as tenancy axis (#840)	2026-04-21 23:23:01 +01:00
bootstrap_iam.py	feat: IAM service, gateway auth middleware, capability model, and CLIs (#849)	2026-04-24 17:29:10 +01:00
change_password.py	feat: IAM service, gateway auth middleware, capability model, and CLIs (#849)	2026-04-24 17:29:10 +01:00
create_api_key.py	feat: IAM service, gateway auth middleware, capability model, and CLIs (#849)	2026-04-24 17:29:10 +01:00
create_user.py	feat: global usernames and rename workspace to default_workspace (#1001)	2026-06-25 16:34:31 +01:00
create_workspace.py	feat: IAM service, gateway auth middleware, capability model, and CLIs (#849)	2026-04-24 17:29:10 +01:00
delete_collection.py	feat: workspace-based multi-tenancy, replacing user as tenancy axis (#840)	2026-04-21 23:23:01 +01:00
delete_config_item.py	feat: workspace-based multi-tenancy, replacing user as tenancy axis (#840)	2026-04-21 23:23:01 +01:00
delete_flow_blueprint.py	feat: workspace-based multi-tenancy, replacing user as tenancy axis (#840)	2026-04-21 23:23:01 +01:00
delete_kg_core.py	feat: workspace-based multi-tenancy, replacing user as tenancy axis (#840)	2026-04-21 23:23:01 +01:00
delete_mcp_tool.py	feat: workspace-based multi-tenancy, replacing user as tenancy axis (#840)	2026-04-21 23:23:01 +01:00
delete_tool.py	feat: workspace-based multi-tenancy, replacing user as tenancy axis (#840)	2026-04-21 23:23:01 +01:00
delete_user.py	feat: IAM service, gateway auth middleware, capability model, and CLIs (#849)	2026-04-24 17:29:10 +01:00
describe_image.py	feat: pluggable image-to-text service with OpenAI vision backend (#1038)	2026-07-12 12:47:04 +01:00
disable_user.py	feat: IAM service, gateway auth middleware, capability model, and CLIs (#849)	2026-04-24 17:29:10 +01:00
dump_msgpack.py	Migrate from setup.py to pyproject.toml (#440)	2025-07-23 21:22:08 +01:00
dump_queues.py	RabbitMQ pub/sub backend with topic exchange architecture (#752)	2026-04-02 12:47:16 +01:00
enable_user.py	feat: IAM service, gateway auth middleware, capability model, and CLIs (#849)	2026-04-24 17:29:10 +01:00
export_workspace.py	feat: export/import workspace knowledge in .tgx bundles (#877 Phase 2) (#1024)	2026-07-06 10:48:41 +01:00
export_workspace_config.py	feat: workspace-based multi-tenancy, replacing user as tenancy axis (#840)	2026-04-21 23:23:01 +01:00
get_config_item.py	feat: workspace-based multi-tenancy, replacing user as tenancy axis (#840)	2026-04-21 23:23:01 +01:00
get_de_core.py	CLI auth migration, document embeddings core lifecycle (#913)	2026-05-14 10:30:21 +01:00
get_document_content.py	fix: large document handling and Cassandra query pagination (#969)	2026-06-01 22:39:30 +01:00
get_flow_blueprint.py	feat: workspace-based multi-tenancy, replacing user as tenancy axis (#840)	2026-04-21 23:23:01 +01:00
get_kg_core.py	fix: knowledge core round-trip for workspace-scoped librarian and all term types (#1049)	2026-07-16 00:31:47 +01:00
graph_to_turtle.py	feat: workspace-based multi-tenancy, replacing user as tenancy axis (#840)	2026-04-21 23:23:01 +01:00
import_workspace.py	feat: export/import workspace knowledge in .tgx bundles (#877 Phase 2) (#1024)	2026-07-06 10:48:41 +01:00
import_workspace_config.py	feat: workspace-based multi-tenancy, replacing user as tenancy axis (#840)	2026-04-21 23:23:01 +01:00
init_pulsar_manager.py	Migrate from setup.py to pyproject.toml (#440)	2025-07-23 21:22:08 +01:00
invoke_agent.py	feat: workspace-based multi-tenancy, replacing user as tenancy axis (#840)	2026-04-21 23:23:01 +01:00
invoke_document_embeddings.py	feat: workspace-based multi-tenancy, replacing user as tenancy axis (#840)	2026-04-21 23:23:01 +01:00
invoke_document_rag.py	feat: add cross-encoder reranking to Document-RAG with two-limit control (#878) (#1011)	2026-07-02 09:50:13 +01:00
invoke_embeddings.py	feat: workspace-based multi-tenancy, replacing user as tenancy axis (#840)	2026-04-21 23:23:01 +01:00
invoke_graph_embeddings.py	feat: workspace-based multi-tenancy, replacing user as tenancy axis (#840)	2026-04-21 23:23:01 +01:00
invoke_graph_rag.py	feat: structured source document references in graph-rag responses (#1035)	2026-07-08 23:59:56 +01:00
invoke_llm.py	feat: workspace-based multi-tenancy, replacing user as tenancy axis (#840)	2026-04-21 23:23:01 +01:00
invoke_mcp_tool.py	feat: workspace-based multi-tenancy, replacing user as tenancy axis (#840)	2026-04-21 23:23:01 +01:00
invoke_nlp_query.py	feat: workspace-based multi-tenancy, replacing user as tenancy axis (#840)	2026-04-21 23:23:01 +01:00
invoke_prompt.py	feat: workspace-based multi-tenancy, replacing user as tenancy axis (#840)	2026-04-21 23:23:01 +01:00
invoke_reranker.py	feat: replace LLM edge scoring with cross-encoder reranker in GraphRAG (#1005)	2026-06-30 14:36:37 +01:00
invoke_row_embeddings.py	feat: workspace-based multi-tenancy, replacing user as tenancy axis (#840)	2026-04-21 23:23:01 +01:00
invoke_rows_query.py	feat: workspace-based multi-tenancy, replacing user as tenancy axis (#840)	2026-04-21 23:23:01 +01:00
invoke_sparql_query.py	feat: workspace-based multi-tenancy, replacing user as tenancy axis (#840)	2026-04-21 23:23:01 +01:00
invoke_structured_query.py	feat: workspace-based multi-tenancy, replacing user as tenancy axis (#840)	2026-04-21 23:23:01 +01:00
list_api_keys.py	feat: IAM service, gateway auth middleware, capability model, and CLIs (#849)	2026-04-24 17:29:10 +01:00
list_collections.py	feat: workspace-based multi-tenancy, replacing user as tenancy axis (#840)	2026-04-21 23:23:01 +01:00
list_config_items.py	feat: workspace-based multi-tenancy, replacing user as tenancy axis (#840)	2026-04-21 23:23:01 +01:00
list_explain_traces.py	feat: workspace-based multi-tenancy, replacing user as tenancy axis (#840)	2026-04-21 23:23:01 +01:00
list_my_workspaces.py	feat: add list-my-workspaces operation and document IAM in API specs (#961)	2026-05-29 19:17:37 +01:00
list_users.py	feat: IAM service, gateway auth middleware, capability model, and CLIs (#849)	2026-04-24 17:29:10 +01:00
list_workspaces.py	feat: IAM service, gateway auth middleware, capability model, and CLIs (#849)	2026-04-24 17:29:10 +01:00
load_doc_embeds.py	feat: workspace-based multi-tenancy, replacing user as tenancy axis (#840)	2026-04-21 23:23:01 +01:00
load_kg_core.py	feat: workspace-based multi-tenancy, replacing user as tenancy axis (#840)	2026-04-21 23:23:01 +01:00
load_knowledge.py	feat: preserve RDF language tags and datatypes through ingestion and query (#1046)	2026-07-15 10:12:46 +01:00
load_sample_documents.py	feat: replace external sample documents with bundled demo content (#956)	2026-05-28 11:06:52 +01:00
load_structured_data.py	feat: batch row imports and split index configuration (#1055)	2026-07-22 10:20:06 +01:00
load_turtle.py	feat: preserve RDF language tags and datatypes through ingestion and query (#1046)	2026-07-15 10:12:46 +01:00
login.py	feat: global usernames and rename workspace to default_workspace (#1001)	2026-06-25 16:34:31 +01:00
monitor_prompts.py	Refactor: Derive consumer behaviour from queue class (#772)	2026-04-09 09:55:41 +01:00
nquads.py	feat: export/import workspace knowledge in .tgx bundles (#877 Phase 2) (#1024)	2026-07-06 10:48:41 +01:00
put_config_item.py	feat: workspace-based multi-tenancy, replacing user as tenancy axis (#840)	2026-04-21 23:23:01 +01:00
put_de_core.py	CLI auth migration, document embeddings core lifecycle (#913)	2026-05-14 10:30:21 +01:00
put_flow_blueprint.py	feat: workspace-based multi-tenancy, replacing user as tenancy axis (#840)	2026-04-21 23:23:01 +01:00
put_kg_core.py	feat: complete knowledge core storage — named graphs, provenance, source material (#973)	2026-06-03 10:46:52 +01:00
query_graph.py	feat: workspace-based multi-tenancy, replacing user as tenancy axis (#840)	2026-04-21 23:23:01 +01:00
remove_library_document.py	feat: workspace-based multi-tenancy, replacing user as tenancy axis (#840)	2026-04-21 23:23:01 +01:00
reset_password.py	feat: IAM service, gateway auth middleware, capability model, and CLIs (#849)	2026-04-24 17:29:10 +01:00
revoke_api_key.py	feat: IAM service, gateway auth middleware, capability model, and CLIs (#849)	2026-04-24 17:29:10 +01:00
save_doc_embeds.py	feat: workspace-based multi-tenancy, replacing user as tenancy axis (#840)	2026-04-21 23:23:01 +01:00
set_collection.py	feat: workspace-based multi-tenancy, replacing user as tenancy axis (#840)	2026-04-21 23:23:01 +01:00
set_mcp_tool.py	feat: workspace-based multi-tenancy, replacing user as tenancy axis (#840)	2026-04-21 23:23:01 +01:00
set_prompt.py	fix: CLI tools ignoring -w flag for workspace routing (#964)	2026-06-01 09:53:28 +01:00
set_token_costs.py	feat: workspace-based multi-tenancy, replacing user as tenancy axis (#840)	2026-04-21 23:23:01 +01:00
set_tool.py	feat: workspace-based multi-tenancy, replacing user as tenancy axis (#840)	2026-04-21 23:23:01 +01:00
show_config.py	feat: workspace-based multi-tenancy, replacing user as tenancy axis (#840)	2026-04-21 23:23:01 +01:00
show_explain_trace.py	feat: replace LLM edge scoring with cross-encoder reranker in GraphRAG (#1005)	2026-06-30 14:36:37 +01:00
show_extraction_provenance.py	feat: workspace-based multi-tenancy, replacing user as tenancy axis (#840)	2026-04-21 23:23:01 +01:00
show_flow_blueprints.py	fix: CLI tools ignoring -w flag for workspace routing (#964)	2026-06-01 09:53:28 +01:00
show_flow_state.py	Per-workspace queue routing for workspace-scoped services (#862)	2026-05-04 10:30:03 +01:00
show_flows.py	fix: CLI tools ignoring -w flag for workspace routing (#964)	2026-06-01 09:53:28 +01:00
show_graph.py	feat: workspace-based multi-tenancy, replacing user as tenancy axis (#840)	2026-04-21 23:23:01 +01:00
show_kg_cores.py	feat: workspace-based multi-tenancy, replacing user as tenancy axis (#840)	2026-04-21 23:23:01 +01:00
show_library_documents.py	feat: workspace-based multi-tenancy, replacing user as tenancy axis (#840)	2026-04-21 23:23:01 +01:00
show_library_processing.py	feat: workspace-based multi-tenancy, replacing user as tenancy axis (#840)	2026-04-21 23:23:01 +01:00
show_mcp_tools.py	feat: workspace-based multi-tenancy, replacing user as tenancy axis (#840)	2026-04-21 23:23:01 +01:00
show_parameter_types.py	fix: CLI tools ignoring -w flag for workspace routing (#964)	2026-06-01 09:53:28 +01:00
show_processor_state.py	Per-workspace queue routing for workspace-scoped services (#862)	2026-05-04 10:30:03 +01:00
show_prompts.py	feat: workspace-based multi-tenancy, replacing user as tenancy axis (#840)	2026-04-21 23:23:01 +01:00
show_token_costs.py	feat: workspace-based multi-tenancy, replacing user as tenancy axis (#840)	2026-04-21 23:23:01 +01:00
show_token_rate.py	Per-workspace queue routing for workspace-scoped services (#862)	2026-05-04 10:30:03 +01:00
show_tools.py	feat: workspace-based multi-tenancy, replacing user as tenancy axis (#840)	2026-04-21 23:23:01 +01:00
start_flow.py	feat: workspace-based multi-tenancy, replacing user as tenancy axis (#840)	2026-04-21 23:23:01 +01:00
start_library_processing.py	feat: workspace-based multi-tenancy, replacing user as tenancy axis (#840)	2026-04-21 23:23:01 +01:00
stop_flow.py	feat: workspace-based multi-tenancy, replacing user as tenancy axis (#840)	2026-04-21 23:23:01 +01:00
stop_library_processing.py	feat: workspace-based multi-tenancy, replacing user as tenancy axis (#840)	2026-04-21 23:23:01 +01:00
unload_kg_core.py	feat: workspace-based multi-tenancy, replacing user as tenancy axis (#840)	2026-04-21 23:23:01 +01:00
update_user.py	feat: global usernames and rename workspace to default_workspace (#1001)	2026-06-25 16:34:31 +01:00
verify_system_status.py	feat: workspace-based multi-tenancy, replacing user as tenancy axis (#840)	2026-04-21 23:23:01 +01:00
whoami.py	iam: self-service ops, optional workspace filters, Mux service routing (#855)	2026-04-28 22:13:12 +01:00