apunkt/mike
1
0
Fork 0
mirror of https://github.com/willchen96/mike.git synced 2026-07-26 23:51:08 +02:00
Code Issues Projects Releases Packages Wiki Activity Actions 1

docs(e2e): mark the model-selection gap fixed — specs pick a Claude model when the key is set

Browse source 
The "Known gap" paragraph predicted the 4 LLM specs would fail with the
secret set because they selected the fork-only "Demo (no key needed)"
model. That is now fixed on the e2e suite branch (#220): the helper
selects "Claude Sonnet 4.6" and the critical-path assertion checks for a
nonempty streamed assistant answer. Update the paragraph accordingly:
setting ANTHROPIC_API_KEY now yields 27 passed / 0 skipped (verified
locally; keyless stays 23 passed / 4 skipped).

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
This commit is contained in:
QA Runner 2026-07-20 21:22:01 -07:00
parent 282b2dd271
commit 0cc635bd5e
1 changed files with 11 additions and 8 deletions
Download patch file Download diff file Expand all files Collapse all files

19
docs/e2e-ci.md
View file

@ -105,16 +105,19 @@ Open the **Run Playwright** step in the Actions log:
The uploaded `playwright-report` artifact shows the same per-spec statuses. The uploaded `playwright-report` artifact shows the same per-spec statuses.
### Known gap: model selection ### Model selection (gap fixed on the e2e suite branch)
As of this branch the four specs drive the model picker to a keyless Earlier revisions of the four specs drove the model picker to a keyless
**"Demo (no key needed)"** entry that exists in the amal66 fork but **not in **"Demo (no key needed)"** entry that exists in the amal66 fork but **not in
this repository** (no `mike-demo` model id, no demo provider). With the secret this repository** (no `mike-demo` model id, no demo provider), so setting the
set they therefore unskip and then fail at model selection. Before the secret secret unskipped them and they then failed at model selection. This is fixed on
turns them green, one of two follow-ups must land: point the specs' the e2e suite branch (#220): the specs' `selectClaudeModel` helper picks
`selectDemoModel` helper at a Claude model when the key is present, or upstream **Claude Sonnet 4.6** in the ModelToggle whenever the key is set, and the
the fork's keyless demo provider. The secret setup above is correct and ready critical-path response assertion checks for a nonempty streamed assistant
either way. answer instead of the fork's canned demo reply. With that fix, setting the
`ANTHROPIC_API_KEY` secret yields **27 passed / 0 skipped** (verified locally:
keyless 23 passed / 4 skipped; with the key 27 / 0). The secret setup above is
all that is needed.
## Make it merge-blocking ## Make it merge-blocking