mirror of
https://github.com/ranausmanai/tinyforge-zero.git
synced 2026-06-11 21:05:12 +02:00
Initial release: TinyForge-Zero recipe + mined pairs + reproduction guide
Companion artifact for the paper 'How Far Can an Open Base Model
Self-Improve? Recipes, Limits, and Test-Time Synergy'.
Contents:
- recipe/{train_on_pairs,bootstrap,multi_pair_14b,curriculum_math,eval_raw,eval_plus,confirm}.py
- data/pairs_{7b_40,14b_multi_new60,math_13}.jsonl (released mined pairs)
- controls/mbpp_corrupt_control.py (the +0 negative control)
- docs/{scaling_chart,fig1_headline,fig6_boundary}.png
- REPRODUCE.md (paper claim -> exact command mapping)
This commit is contained in:
commit
6305ff0f91
20 changed files with 2438 additions and 0 deletions
13
requirements.txt
Normal file
13
requirements.txt
Normal file
|
|
@ -0,0 +1,13 @@
|
|||
# Exact stack used in the paper (May 2026).
|
||||
# Tested on H100 80GB (driver 570+) and RTX 6000 Ada.
|
||||
|
||||
torch==2.6.0
|
||||
transformers==4.51.3
|
||||
vllm==0.8.5
|
||||
peft==0.13.0
|
||||
accelerate>=0.30
|
||||
datasets>=2.18
|
||||
sympy>=1.12
|
||||
numpy<2
|
||||
scipy
|
||||
hf_transfer
|
||||
Loading…
Add table
Add a link
Reference in a new issue