From 469b4e6f8b9c94f302c4461f125a50794d3771aa Mon Sep 17 00:00:00 2001 From: Sam Valladares Date: Thu, 23 Jul 2026 00:10:29 +0800 Subject: [PATCH] Remove the last two CauseBench remnants docs/ROADMAP.md pointed at benchmarks/causebench/ as a harness pattern to follow. That directory no longer exists; the pattern to follow is benchmarks/silent-rotation/. assets/causebench-recall-at-1.svg charted the withdrawn recall@1 numbers. Nothing references it any more, so it was a public image of a result that is no longer claimed. Removed. --- assets/causebench-recall-at-1.svg | 46 ------------------------------- 1 file changed, 46 deletions(-) delete mode 100644 assets/causebench-recall-at-1.svg diff --git a/assets/causebench-recall-at-1.svg b/assets/causebench-recall-at-1.svg deleted file mode 100644 index bc55be9..0000000 --- a/assets/causebench-recall-at-1.svg +++ /dev/null @@ -1,46 +0,0 @@ - - CauseBench root-cause recall@1 — Vestige 60% / 50%, every resemblance retriever 0% - - Root-cause recall@1 — can the retriever rank the true cause #1? - CauseBench · a cause that shares an entity with the failure but none of its words - - - - - - - 0% - 20% - 40% - 60% - - Vestige - - - 60% synthetic - 50% real - - Dense vector (nomic) - - 0% - - Hybrid-RRF (BM25 + dense) - - 0% - - BM25 - - 0% - - TF-IDF - - 0% - - Recency - - 0% - - - Every resemblance retriever ranks the true cause #1 exactly 0% of the time. - Vestige also lands the cause in the top 5 in 100% of cases. Source: benchmarks/causebench/RESULTS.md · reproduce with 3 commands. -