feat: merge ingest and scan

* docs: add CLI component reuse guidance

* docs: add unified ingest ux design

* Refine unified ingest UX design after adversarial review iteration 1

* Refine unified ingest UX design after adversarial review iteration 2

* Refine unified ingest UX design after adversarial review iteration 3

* feat(cli): route public connection ingest command

* feat(cli): hide standalone scan from public help

* feat(cli): plan public ingest depth and query history

* feat(cli): execute public database ingest facets

* feat(ingest): read connection query history config

* fix(cli): use public ingest wording

* fix(config): stop generating ingest adapter allow lists

* docs: document public ingest command

* test: align ingest surface expectations

* docs: add unified ingest public CLI surface plan

* feat(cli): preflight deep public ingest readiness

* feat(setup): store query history in connection context

* feat(setup): store database context depth

* feat(setup): verify context readiness by database depth

* fix(setup): keep context build foreground only

* fix(config): reject reserved ingest connection ids

* test: close unified ingest v1 expectations

* docs: add unified ingest v1 closure plan

* fix(ingest): bypass adapter allow-list for public source ingest

* fix(ingest): honor query history window intent

* fix(ingest): hide scan internals from public database ingest

* feat(ingest): use foreground view for interactive public ingest

* fix(setup): use schema context and query history wording

* test(cli): verify unified ingest public output

* docs: add unified ingest v1 public output closure plan

* fix(setup): forward query history flags

* fix(setup): prompt for postgres query history

* fix(status): report query history readiness

* fix(ingest): remove legacy public guidance

* fix(ingest): polish foreground retry copy

* docs(examples): use unified query history wording

* chore(ingest): finish public query history cleanup

* docs: add unified ingest v1 query history status cleanup plan

* test(docs): cover unified ingest public docs

* docs: align ingest CLI reference with unified UX

* docs: update context build guides for unified ingest

* docs: update setup and primary source ingest wording

* docs: stop advertising adapter-backed example ingest

* docs: close unified ingest public docs gaps

* docs: add unified ingest v1 docs site closure plan

* fix: render unified ingest foreground warnings

* fix: explain query history schema order

* fix: add public ingest retry guidance

* fix: align setup next steps with unified ingest

* fix: remove scan wording from demo progress

* test: verify unified ingest ux closure

* docs: add unified ingest v1 foreground and retry closure plan

* fix(cli): preserve query-history pull config in public ingest

* fix(cli): omit hidden commands from docs command tree

* test(cli): close unified ingest final public surface checks

* docs: add unified ingest v1 final public surface closure plan

* fix(cli): use public source labels in ingest reports

* fix(cli): suppress low-level public ingest output

* test(cli): verify unified ingest public plain output

* docs: add unified ingest v1 public plain output closure plan

* fix(cli): add public ingest copy sanitizers

* fix(cli): sanitize public ingest progress copy

* fix(cli): rename setup schema scope prompt

* docs(plan): add progress copy closure; test: align setup back-nav fixture

Adds the iter9 plan and updates the setup back-navigation test fixture
to pass disableQueryHistory plus listSchemas/listTables stubs that the
unified ingest setup step now requires.

* docs(plan): add final ux labels plan with narrowed label scans

* fix(cli): aggregate unsupported query-history warnings

* fix(cli): align setup database labels

* test(cli): fix setup database test type-check

* fix(cli): remove primary-source wording from setup output

* test(cli): verify unified ingest setup closure

* docs(plan): add unified ingest v1 verification copy closure plan

* fix(cli): remove top-level scan command

* fix(cli): remove legacy ingest and wiki commands

* Merge scan into ingest flow

* feat(cli): split ingest progress into per-phase rows, rename work units to tasks

Each database target in the unified ingest dashboard now renders one row per
real subprocess (Schema, then Query history when enabled) instead of a single
combined bar. Each phase has its own monotonic 0-100% bar so the progress
never snaps back to zero when historic-sql starts after scan completes.
Completed phases keep their final bar, summary, and elapsed time visible as
an inline audit trail; queued and skipped phases are shown explicitly.

Also rename user-facing "work units" / "Failed work units" to "tasks" /
"Failed tasks" in ingest output and parseIngestSummary. The parser still
accepts the legacy "Work units:" wording in captured output for backward
compat. Internal memory-flow event names and type fields are left alone.

* Fix test harness failures

* Fix CI smoke checks

---------

Co-authored-by: Andrey Avtomonov <7889985+andreybavt@users.noreply.github.com>

scripts/examples-docs.test.mjs

@@ -63,11 +63,17 @@ describe('standalone example docs', () => {
     const smoke = await readText('examples/postgres-historic/scripts/smoke.sh');
 
     assert.match(examples, /postgres-historic/);
-    assert.match(examples, /unified Historic SQL artifacts/);
-    assert.match(readme, /--enable-historic-sql/);
-    assert.match(readme, /--historic-sql-min-executions 2/);
+    assert.doesNotMatch(examples, /Historic SQL/);
+    assert.doesNotMatch(examples, /historic-SQL/);
+    assert.match(examples, /query-history ingest via `pg_stat_statements`/);
+    assert.doesNotMatch(readme, new RegExp(['--enable-historic', 'sql'].join('-')));
+    assert.doesNotMatch(readme, new RegExp(['--historic', 'sql-min-executions'].join('-')));
+    assert.doesNotMatch(readme, /ktx ingest run --project-dir/);
+    assert.doesNotMatch(readme, /--adapter historic-sql/);
+    assert.match(readme, /--enable-query-history/);
+    assert.match(readme, /--query-history-min-executions 2/);
     assert.match(readme, /ktx status --project-dir/);
-    assert.match(readme, /Postgres Historic SQL/);
+    assert.match(readme, /Postgres query history/);
     assert.match(readme, /manifest\.json/);
     assert.match(readme, /tables\/\*\.json/);
     assert.match(readme, /patterns-input\.json/);
@@ -89,7 +95,7 @@ describe('standalone example docs', () => {
     assert.match(smoke, /historic-sql-patterns-part-/);
     assert.match(smoke, /patterns-input\/part-/);
     assert.doesNotMatch(smoke, new RegExp(["unitKey === 'historic", 'sql', "patterns'"].join('-')));
-    assert.match(smoke, /--historic-sql-min-executions 2/);
+    assert.match(smoke, /--query-history-min-executions 2/);
     assert.match(smoke, /KTX_RUNTIME_ROOT/);
     assert.match(smoke, /managedDaemon/);
     assert.match(smoke, /installPolicy: 'auto'/);
@@ -129,6 +135,15 @@ describe('standalone example docs', () => {
     );
   });
 
+  it('checked-in example configs do not include public database adapters', async () => {
+    const localWarehouseConfig = await readFile('examples/local-warehouse/ktx.yaml', 'utf8');
+    const orbitConfig = await readFile('examples/orbit-relationship-verification/ktx.yaml', 'utf8');
+    const legacyPublicAdapter = new RegExp(['live', 'database'].join('-'));
+
+    assert.doesNotMatch(localWarehouseConfig, legacyPublicAdapter);
+    assert.doesNotMatch(orbitConfig, legacyPublicAdapter);
+  });
+
   it('lists every workspace package in the contributor docs', async () => {
     const contributing = await readText('docs-site/content/docs/community/contributing.mdx');
 
@@ -222,18 +237,64 @@ describe('standalone example docs', () => {
     assert.doesNotMatch(readme, /python -m ktx_daemon semantic-validate/);
   });
 
-  it('documents scan workflows in the docs site', async () => {
+  it('documents unified public ingest workflows in the docs site', async () => {
     const rootReadme = await readText('README.md');
+    const cliMeta = await readText('docs-site/content/docs/cli-reference/meta.json');
+    const ingestReference = await readText('docs-site/content/docs/cli-reference/ktx-ingest.mdx');
+    const devReference = await readText('docs-site/content/docs/cli-reference/ktx-dev.mdx');
+    const setupReference = await readText('docs-site/content/docs/cli-reference/ktx-setup.mdx');
     const buildingContext = await readText('docs-site/content/docs/guides/building-context.mdx');
-    const scanReference = await readText('docs-site/content/docs/cli-reference/ktx-scan.mdx');
+    const contextSources = await readText('docs-site/content/docs/integrations/context-sources.mdx');
+    const contextAsCode = await readText('docs-site/content/docs/concepts/context-as-code.mdx');
+    const quickstart = await readText('docs-site/content/docs/getting-started/quickstart.mdx');
+    const primarySources = await readText('docs-site/content/docs/integrations/primary-sources.mdx');
+    const examplesIndex = await readText('examples/README.md');
+    const localWarehouseReadme = await readText('examples/local-warehouse/README.md');
+
+    assert.match(ingestReference, /ktx ingest <connectionId>/);
+    assert.match(ingestReference, /ktx ingest --all --deep/);
+    assert.match(ingestReference, /--query-history-window-days <days>/);
+    assert.match(buildingContext, /ktx ingest <connection-id>/);
+    assert.match(buildingContext, /ktx ingest --all/);
+    assert.match(contextSources, /ktx ingest <connectionId>/);
+    assert.match(contextAsCode, /ktx ingest --all --no-input/);
+    assert.match(quickstart, /schema context/);
+    assert.match(primarySources, /context:\n      queryHistory:/);
+    assert.match(rootReadme, /Databases configured: yes \(postgres-warehouse\)/);
+    assert.match(quickstart, /Databases:\n  postgres-warehouse: deep context complete/);
+    assert.match(quickstart, /Databases configured: yes \(postgres-warehouse\)/);
+    assert.match(setupReference, /Databases configured: yes \(postgres-warehouse\)/);
+    assert.doesNotMatch(rootReadme, new RegExp(['Primary sources', 'configured'].join(' ')));
+    assert.doesNotMatch(quickstart, new RegExp(['Primary', 'sources'].join(' ')));
+    assert.doesNotMatch(setupReference, new RegExp(['Primary sources', 'configured'].join(' ')));
+
+    assert.doesNotMatch(cliMeta, /ktx-scan/);
+    assert.doesNotMatch(ingestReference, /ktx ingest run/);
+    assert.doesNotMatch(ingestReference, /ktx ingest status/);
+    assert.doesNotMatch(ingestReference, /ktx ingest replay/);
+    assert.doesNotMatch(ingestReference, /--adapter/);
+    assert.doesNotMatch(ingestReference, /ktx ingest watch/);
+    assert.doesNotMatch(ingestReference, /live-database/);
+    assert.doesNotMatch(devReference, /ktx scan/);
+    assert.doesNotMatch(buildingContext, /ktx ingest watch/);
+    assert.doesNotMatch(buildingContext, /ktx ingest status/);
+    assert.doesNotMatch(buildingContext, /ktx ingest replay/);
+    assert.doesNotMatch(buildingContext, /historic-sql/);
+    assert.doesNotMatch(buildingContext, /live-database/);
+    assert.doesNotMatch(contextSources, /ktx ingest run --connection-id/);
+    assert.doesNotMatch(contextSources, /--adapter <adapter>/);
+    assert.doesNotMatch(contextAsCode, /ktx ingest run --connection-id/);
+    assert.doesNotMatch(quickstart, /Historic SQL/);
+    assert.doesNotMatch(quickstart, /--enable-historic-sql/);
+    assert.doesNotMatch(quickstart, /press <kbd>d<\/kbd> to detach/);
+    assert.doesNotMatch(primarySources, /historicSql/);
+    assert.doesNotMatch(primarySources, /Historic SQL/);
+    assert.doesNotMatch(examplesIndex, /ktx ingest run --project-dir/);
+    assert.doesNotMatch(localWarehouseReadme, /ktx ingest run --project-dir/);
 
-    assert.match(buildingContext, /ktx scan <connection-id>/);
-    assert.match(buildingContext, /ktx status/);
-    assert.doesNotMatch(buildingContext, /ktx scan status <run-id>/);
-    assert.doesNotMatch(buildingContext, /ktx scan report <run-id>/);
-    assert.match(scanReference, /ktx scan <connectionId> \[options\]/);
     assert.match(rootReadme, /raw-sources\//);
-    assert.match(rootReadme, /live-database\//);
+    assert.doesNotMatch(rootReadme, new RegExp(`${['live', 'database'].join('-')}/`));
+    assert.doesNotMatch(rootReadme, /ktx scan/);
     assert.doesNotMatch(rootReadme, /Run a local ingest smoke test/);
     assert.doesNotMatch(rootReadme, /ktx ingest run --project-dir/);
     assert.doesNotMatch(rootReadme, /ktx ingest status --project-dir/);