Commit graph

5 commits

Author SHA1 Message Date
51616
0c1a8bb3e8 update data gen/def 2025-09-06 08:44:11 +00:00
51616
8bbb5d91a1 fix compact builder (import) 2025-08-11 14:59:03 +09:00
ShinnosukeUesakaSakana
d99fa8732b
Add distillation training (#5)
- work with vllm self-gen data (everything is tokenized during self-gen)
- fix chat template!
- not use liger kernel for distillation (for both training and eval)
2025-07-29 15:32:06 +09:00
51616
28eb85a2f3 tiny configs + fix dataset gen (remove repeated response + qa template for compact ds) + add ropes and drop eval ds 2025-06-30 16:10:52 +09:00
51616
1457981348 compact ds + self_gen + update rope + drop multi answer eval 2025-06-26 16:04:33 +00:00