doc-to-lora/scripts
Rujikorn Charakorn 891c0bd256
Refactor_and_improve_data (#7)
* faster slice

* add facts + ctx_qa

* new configs

* new scripts

* intx_sft.py to train.py

* add kaggle for downloading facts

* max_new_tokens cli for eval

* generate negative_nq

* scripts + configs

* default vals

* max_val_samples_per_ds=500

* more efficient layer-to-layer ctx encoder

* use_per_ctx_average_loss

* faster processing

* small exp distill

* scripts

* more robust watcher

* per-module l1_norm avg

* per-ctx average loss

* clear_gpu
2025-08-04 20:52:37 +09:00
..
short_ctx Refactor_and_improve_data (#7) 2025-08-04 20:52:37 +09:00
submit_tiny_exp_jobs.sh tiny exp 2025-07-03 16:26:26 +00:00