mirror of
https://github.com/SakanaAI/doc-to-lora.git
synced 2026-07-26 17:11:02 +02:00
891c0bd256
* faster slice * add facts + ctx_qa * new configs * new scripts * intx_sft.py to train.py * add kaggle for downloading facts * max_new_tokens cli for eval * generate negative_nq * scripts + configs * default vals * max_val_samples_per_ds=500 * more efficient layer-to-layer ctx encoder * use_per_ctx_average_loss * faster processing * small exp distill * scripts * more robust watcher * per-module l1_norm avg * per-ctx average loss * clear_gpu |
||
|---|---|---|
| .. | ||
| qa_short_ctx_self_gen_lv1_closed_qa_1.yaml | ||
| qa_short_ctx_self_gen_lv1_closed_qa_1_and_lv3.yaml | ||
| qa_short_ctx_self_gen_lv1_closed_qa_1_l2l.yaml | ||
| qa_short_ctx_self_gen_lv1_closed_qa_1_next_token_pred.yaml | ||