apunkt/doc-to-lora
1
0
Fork 0
mirror of https://github.com/SakanaAI/doc-to-lora.git synced 2026-07-23 17:01:04 +02:00
Code Issues Projects Releases Packages Wiki Activity Actions

no_grad for ctx_encoder model

Browse source
This commit is contained in:
51616 2025-01-07 16:57:37 +00:00
parent 6c579fa373
commit 541ef37c64
1 changed files with 1 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

1
hyperlora/modeling_utils.py
View file

@ -321,6 +321,7 @@ class EarlyExit(nn.Module):
self.base_model = base_model
self.exit_layer = exit_layer
@torch.no_grad()
def forward(self, **kwargs):
# if len(kwargs["input_ids"].shape) == 1:
# kwargs["input_ids"] = kwargs["input_ids"].unsqueeze(0)