feat(connections): add execute-only warehouses; stop silent full-project scans

A configured warehouse was always a scan/ingest target. The only way to use a
connection purely for SQL execution (ktx sql / sql_execution) was the leaky
workaround of an empty setup.database_connection_ids — which actually re-includes
every warehouse via the 'fall back to all' branch — so e.g. a BigQuery connection
meant only for read-only queries triggered a full-billing-project scan.

- Add a per-connection scan_enabled flag (default true) to warehouse connections.
  scan_enabled: false registers the connection for execution only and never as a
  scan target.
- Route every scan-target selection path through one predicate
  (isScanTargetWarehouse): both ingest (primaryWarehouseConnectionIds, including
  the all-warehouses fallback) and setup (configuredPrimaryConnectionIds) now
  exclude execute-only connections. Setup validates the credential but skips
  scope discovery and scan for them. Execution paths are untouched — the warehouse
  descriptor still resolves, so ktx sql / sql_execution keep working.
- Scripted setup with no --database-schema no longer silently scopes the scan to
  every discovered schema/dataset: it warns with the count and names how to narrow
  (--database-schema) or opt out (scan_enabled: false).
This commit is contained in:
Andrey Avtomonov 2026-06-09 13:05:15 +02:00
parent a02fcab487
commit ece0dfb2c8
10 changed files with 187 additions and 3 deletions

View file

@ -129,6 +129,18 @@ connections:
expect(serialized).not.toContain('completed_steps:');
});
it('parses and serializes a warehouse connection marked execute-only (scan_enabled: false)', () => {
const config = parseKtxProjectConfig(`
connections:
public_bq:
driver: bigquery
scan_enabled: false
`);
expect(config.connections.public_bq).toMatchObject({ driver: 'bigquery', scan_enabled: false });
expect(serializeKtxProjectConfig(config)).toContain('scan_enabled: false');
});
it('parses global direct Anthropic LLM config', () => {
const config = parseKtxProjectConfig(`
llm: