Commit graph

71 commits

Author SHA1 Message Date
Andrey Avtomonov
18a9122875 Merge origin/main into drop-legacy-migration-code 2026-05-13 15:07:09 +02:00
Andrey Avtomonov
e1e9c4af91
fix(cli): clean up connection commands (#62)
* fix(cli): clean up connection commands

* test(cli): update connection smoke coverage

* Fix setup output formatting

* fix notion setup picker exit
2026-05-13 15:04:50 +02:00
Andrey Avtomonov
f750f3e6c3 test: use canonical semantic layer descriptions 2026-05-13 14:59:40 +02:00
Andrey Avtomonov
e22c7704d8 Merge origin/main into drop-legacy-migration-code 2026-05-13 14:45:59 +02:00
Luca Martial
4973ca562f
Restore Vertex AI LLM setup (#56)
* feat(context): resolve Vertex AI config references

* feat(cli): restore Vertex AI LLM setup

---------

Co-authored-by: Andrey Avtomonov <andreybavt@gmail.com>
2026-05-13 14:42:38 +02:00
Andrey Avtomonov
8620b9ed08 fix: support legacy metabase native queries 2026-05-13 14:39:04 +02:00
Andrey Avtomonov
a517c834fe refactor: remove legacy compatibility paths 2026-05-13 14:37:05 +02:00
Andrey Avtomonov
b75576279c
fix: store Metabase mappings in ktx.yaml (#61)
* fix: store Metabase mappings in ktx.yaml

* docs: note KTX has no public users

* refactor: drop setup progress compatibility
2026-05-13 13:55:21 +02:00
Andrey Avtomonov
c22248dabf
feat(context): add warehouse verification tools (#46)
* feat(context): add warehouse dialect dispatch

* feat(context): read warehouse scan catalog

* feat(context): add entity details verification tool

* feat(context): add ingest SQL verification tool

* feat(context): add raw warehouse discovery tool

* feat(context): expose warehouse verification tools to ingest

* docs(context): add ingest identifier verification protocol

* test(context): guard ingest identifier verification prompts

* chore(context): verify warehouse verification tools

* docs: add warehouse verification tools plan and spec

* fix(context): expose target warehouses to Notion ingest

* fix(context): update ingest prompts for warehouse verification tools

* fix(context): scope raw schema discovery to allowed connections

* fix(context): verify warehouse column display targets

* docs: add notion warehouse verification gap closure plan

* fix(context): include raw discovery connection names

* fix(context): expose warehouse targets for LookML and MetricFlow

* fix(context): pass connection config to ingest query executors

* fix(cli): enable read-only SQL probes for local ingest

* docs: add warehouse verification final v1 closure plan

* fix(context): align warehouse sql probe prompt shape

* docs: add warehouse verification prompt shape closure plan

* test(context): catch connectionless sql execution prompt examples

* fix(context): include connection name in sl capture sql example

* docs: add warehouse verification sql example closure plan

* fix(context): report structured entity detail misses

* docs: add warehouse verification structured target miss closure plan

* fix: report untracked squash merge conflicts

* feat: require ingest verification ledger

* fix: stabilize ingest wiki references
2026-05-13 13:43:23 +02:00
Andrey Avtomonov
bcb0d2f8f7
chore: add TypeScript dead-code checks (#60)
* chore: add TypeScript dead-code checks

* chore: trim stale Knip ignores

* Fix CI smoke and artifact checks
2026-05-13 13:33:28 +02:00
Andrey Avtomonov
721f1a998f
feat(cli)!: remove ktx agent command (#58)
* feat(cli)!: remove ktx agent command

* test(context): update PGlite boundary guardrail
2026-05-13 13:01:56 +02:00
Andrey Avtomonov
b9e0a746af
feat(cli): clean up dev command surface (#57)
* feat(cli): clean up dev command surface

* test: align CI expectations with CLI cleanup

* test(cli): update slow test command expectations
2026-05-13 12:00:08 +02:00
Luca Martial
9a8cb08192 Refine setup table selection flow 2026-05-12 21:31:11 -07:00
Luca Martial
52ddb061a4 Add scan table filtering 2026-05-12 18:22:03 -07:00
Luca Martial
e13350c970
Merge pull request #47 from Kaelio/luca-martial/save-setup-in-dot-ktx
Save setup completion state in .ktx/setup/state.json
2026-05-12 19:27:26 -04:00
Luca Martial
f70271152b feat(context): add local .ktx/setup/state.json for setup completion tracking
Move setup step completion state out of ktx.yaml into a gitignored local
state file so it is not committed or shared across machines.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-05-12 16:26:13 -07:00
Andrey Avtomonov
85fc408054
chore(deps): refresh workspace dependencies (#43)
* chore(deps): refresh workspace dependencies

* Fix pnpm artifact smoke build approvals
2026-05-13 01:15:35 +02:00
Luca Martial
60457e9407
Improve schema setup and Notion ingest UX (#14)
* Improve schema setup and Notion ingest UX

* Handle Postgres network scan failures

* WIP: save local changes before main merge

* Refine setup prompt choices

* Tighten ingest reconciliation guidance

* Commit setup config updates

* Canonicalize unmapped fallback details

* Count reconciliation actions in reports

* Harden semantic layer source validation

* Return wiki content after edits

* Validate SL sources against manifests

* Validate wiki refs before writes

* Simplify CLI next steps

* Clarify agent setup summary

* Surface dbt target SL sources

* Recover SL write fallbacks

* Preserve failed context build metadata

* Track raw paths for ingest actions

* test(cli): update seeded demo expectations

* fix(ingest): scope fallback recovery checks

* fix(sl): tighten source validation guards

* fix(wiki): ignore empty embedding vectors

* Improve Notion ingest UX

* Enforce flat wiki keys

* test(context): update wiki key assertion

---------

Co-authored-by: Andrey Avtomonov <andreybavt@gmail.com>
2026-05-12 22:56:58 +02:00
Andrey Avtomonov
7a315d580f Merge remote-tracking branch 'origin/main' into andreybavt/execute-context7-plan
# Conflicts:
#	packages/cli/src/ingest.test.ts
#	packages/cli/src/ingest.ts
2026-05-12 14:37:51 +02:00
Andrey Avtomonov
366933c755 perf: parallelize scan description generation 2026-05-12 14:34:59 +02:00
Andrey Avtomonov
4d4441ccd5
fix(context): avoid saving scan error descriptions (#37) 2026-05-12 14:34:15 +02:00
Andrey Avtomonov
15f433930e
Merge branch 'main' into andreybavt/execute-context7-plan 2026-05-12 13:04:16 +02:00
Andrey Avtomonov
d830e8c46e docs: standardize env variable examples 2026-05-12 12:24:25 +02:00
Andrey Avtomonov
d7fb092cb0 feat(cli): route ingest adapter logs through operational logger 2026-05-12 11:26:34 +02:00
Andrey Avtomonov
d5f484eb7e fix: standardize KTX environment variables 2026-05-12 11:21:37 +02:00
Andrey Avtomonov
9e80add72c fix(context): make ingest adapter logging explicit 2026-05-12 11:21:29 +02:00
Andrey Avtomonov
a2dcd4eb08
fix: guide dev ingest llm setup (#15)
Co-authored-by: Andrey Avtomonov <7889985+andreybavt@users.noreply.github.com>
2026-05-12 10:26:07 +02:00
Andrey Avtomonov
9d3b1015cc
fix: allow dbt ingest to discover warehouse schemas (#20)
Co-authored-by: Andrey Avtomonov <7889985+andreybavt@users.noreply.github.com>
2026-05-12 10:25:56 +02:00
Andrey Avtomonov
b981cabdc6 Include historic SQL projection in memory counts 2026-05-11 22:52:47 +02:00
Andrey Avtomonov
1bd29c7eb1 Fix historic SQL ingest setup and progress 2026-05-11 22:35:07 +02:00
Andrey Avtomonov
2d1efda176 test: verify historic sql pattern shard work units 2026-05-11 20:23:37 +02:00
Andrey Avtomonov
8deac9d530 test: align historic sql pattern skill with shards 2026-05-11 20:21:39 +02:00
Andrey Avtomonov
3e11e33b8a feat: emit historic sql pattern shard work units 2026-05-11 20:20:58 +02:00
Andrey Avtomonov
02b621be72 feat: write historic sql pattern shards 2026-05-11 20:20:22 +02:00
Andrey Avtomonov
2a91ea521f feat: shard historic sql pattern inputs 2026-05-11 20:19:47 +02:00
Andrey Avtomonov
06163452b4 feat: redact historic sql staged artifacts 2026-05-11 20:10:17 +02:00
Andrey Avtomonov
7b38418900 feat: add historic sql redaction helper 2026-05-11 20:09:46 +02:00
Andrey Avtomonov
9c615fcb79 test: cover historic sql retrieval acceptance 2026-05-11 20:02:01 +02:00
Andrey Avtomonov
e39aea7e33 test: cover historic sql projection cleanup 2026-05-11 19:50:08 +02:00
Andrey Avtomonov
c2b2356e5e fix: keep historic sql archived patterns stable 2026-05-11 19:49:48 +02:00
Andrey Avtomonov
5d72c1f240 feat: allow generic historic sql readers locally 2026-05-11 19:25:29 +02:00
Andrey Avtomonov
1b1b32d717 fix: normalize historic sql probe results 2026-05-11 19:24:27 +02:00
Andrey Avtomonov
109dd8d836 refactor: remove legacy historic sql reader fetch surface 2026-05-11 19:13:16 +02:00
Andrey Avtomonov
d47826a234 refactor: remove legacy historic sql pipeline 2026-05-11 19:06:08 +02:00
Andrey Avtomonov
b3ebba9f88 feat: cut over historic sql adapter 2026-05-11 19:00:01 +02:00
Andrey Avtomonov
da263c0957 feat: run historic sql deterministic projection 2026-05-11 18:58:19 +02:00
Andrey Avtomonov
fb541cb9e5 feat: project historic sql evidence 2026-05-11 18:53:45 +02:00
Andrey Avtomonov
954426289d feat: add historic sql evidence skills 2026-05-11 18:48:31 +02:00
Andrey Avtomonov
ef9358beb7 feat: add historic sql evidence emission 2026-05-11 18:44:24 +02:00
Andrey Avtomonov
80fffcd8a1 test: verify historic sql unified hot path 2026-05-11 18:18:35 +02:00