mirror of
https://github.com/SakanaAI/doc-to-lora.git
synced 2026-07-26 17:11:02 +02:00
context distillation eval + timer
This commit is contained in:
parent
f2efe22cba
commit
7d95db6672
17 changed files with 1840 additions and 51 deletions
|
|
@ -292,4 +292,4 @@ This bug causes the self-generated data to have two `<bos>` tokens (only the `in
|
|||
|
||||
NOTE: previously we were using `vllm==0.8.5` which does not have the double `<bos>` problem.
|
||||
However it has another bug that randomly causes some detokenization error (see https://github.com/vllm-project/vllm/issues/17448)
|
||||
Therefore we, not knowing about the double `<bos>` bug, degraded `vllm` to `0.8.4`.
|
||||
Therefore we, not knowing about the double `<bos>` bug, recently downgraded `vllm` to `0.8.4`.
|
||||
|
|
|
|||
Loading…
Add table
Add a link
Reference in a new issue