apunkt/doc-to-lora
1
0
Fork 0
mirror of https://github.com/SakanaAI/doc-to-lora.git synced 2026-07-23 17:01:04 +02:00
Code Issues Projects Releases Packages Wiki Activity Actions

fix for vision llama

Browse source
This commit is contained in:
51616 2025-01-13 17:49:00 +00:00
parent 273b35378f
commit 7c5fe3bc5b
1 changed files with 1 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

1
hyperlora/model_loading.py
View file

@ -138,6 +138,7 @@ def get_model(
model = AutoModelForCausalLM.from_pretrained(**model_init_kwargs)
else:
model = MllamaForConditionalGeneration.from_pretrained(**model_init_kwargs)
model = model.language_model
if peft_config is not None:
model = PeftModel(model, peft_config)
model.train(train)