mirror of
https://github.com/samvallad33/vestige.git
synced 2026-07-26 23:51:02 +02:00
That caveat was written when the benchmark had two Kimi K3 trials, both of
which rag and sync passed. With 23 shared trials it is no longer true:
same 23 trials rag 4 correct / 12 wrong / 7 split
sync 20 correct / 0 wrong / 3 split
kimi-k3 only (5) rag 3 correct / 0 wrong / 2 split
sync 5 correct / 0 wrong / 0 split
cost per run rag $0.2860 vs sync $0.3076
What remains true and is now stated instead: on Kimi K3 the dense cosine
baseline never converged wrong, and it costs less per run. The gap is
model-dependent rather than uniform. Corrected in README.md, QUOTES.md,
FINDING.md and SHOW-HN.md.
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
|
||
|---|---|---|
| .. | ||
| silent-rotation | ||