Sam Valladares fa7250d522 fix(silent-rotation): correct the outcome tables to match the committed results JSON ... The tables in EVIDENCE.md and SHOW-HN.md were written before the sixth model run (kimi-k2.7-code) was added back and before the mem0 and Zep arms were re-run on the repaired harness. They reported 5 models and 22 trials while results/ holds 6 models and 25 trials, so the docs contradicted the data sitting beside them - anyone running harness/aggregate-experiment.py got different numbers than the writeup claimed. Every figure below is now generated from the per-trial <arm>.json files using the aggregator's own definition (fixed_correctly = correct, green_but_voids_prod = converged wrong, failed_merge_conflict = split): arm CORRECT WRONG SPLIT n anarchy 0 21 4 25 rag 4 12 7 23 sync (Vestige) 20 0 3 23 supermemory 5 0 1 6 mem0 2 1 2 5 hindsight 0 0 3 3 zep 0 1 1 2 The corrections run in both directions: the no-memory control failed more than claimed (21 vs 16), dense cosine failed more (12 vs 10), Vestige won one more (20 vs 19), and Zep has one converged-wrong that was previously reported as a split. The headline is unchanged - Vestige has zero converged-wrong across 23 trials. Transcript count corrected 210 -> 246 (verified by file count). Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>		2026-07-21 23:43:35 +07:00
..
silent-rotation	fix(silent-rotation): correct the outcome tables to match the committed results JSON	2026-07-21 23:43:35 +07:00