Sam Valladares c2d0606f2c fix(silent-rotation): recount first-call rates across all 25 trials and publish the method ... The first-call figures in QUOTES.md were computed on the five-model set before kimi-k2.7-code was restored and before mem0 and Zep were re-run on the repaired harness. Recounted directly from results/*/transcript-*.json by walking turns[].tool_results[], taking the first entry whose name is a memory tool, and testing whether manifest.json's correct_kid appears in its output: arm correct n rate sync (Vestige, no query) 65 65 100% rag (dense cosine) 6 66 9.1% supermemory 1 18 5.6% mem0 0 15 0% hindsight 0 9 0% zep 0 6 0% all query-based combined 7 114 6.1% Previously published as 56/56 and 6/87. Vestige is perfect on a larger denominator; the query-based aggregate moves 6.9% -> 6.1% on 114 calls instead of 87. The anarchy arm has no memory tool and is excluded, which accounts for the 67 transcripts with no memory call. EVIDENCE.md now carries the table and the exact recount procedure so a reader can reproduce it without rerunning any trials. Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>		2026-07-22 00:14:51 +07:00
..
silent-rotation	fix(silent-rotation): recount first-call rates across all 25 trials and publish the method	2026-07-22 00:14:51 +07:00