apunkt/doc-to-lora
1
0
Fork 0
mirror of https://github.com/SakanaAI/doc-to-lora.git synced 2026-07-23 17:01:04 +02:00
Code Issues Projects Releases Packages Wiki Activity Actions

remove label_smoothing

Browse source
This commit is contained in:
51616 2024-12-21 15:57:11 +00:00
parent c87c10aaf1
commit c6f69fb438
1 changed files with 0 additions and 1 deletions
Download patch file Download diff file Expand all files Collapse all files

1
configs/default.yaml
View file

@ -15,7 +15,6 @@ remove_unused_columns: false
optim: schedule_free_adamw
learning_rate: 0.0001
neftune_noise_alpha: 5
label_smoothing_factor: 0.1
weight_decay: 0.01
warmup_ratio: 0.1