From 495833e3e6fd27c75c97df277e0161ca84fea03e Mon Sep 17 00:00:00 2001 From: 51616 Date: Thu, 29 May 2025 15:24:05 +0000 Subject: [PATCH] fix readme --- README.md | 5 +++-- 1 file changed, 3 insertions(+), 2 deletions(-) diff --git a/README.md b/README.md index 76d095e..68e258e 100644 --- a/README.md +++ b/README.md @@ -1,5 +1,6 @@ -# `Ctx-to-LoRA`: Compressing Context Information to LoRAs 🧠
+

Ctx-to-LoRA

+
@@ -13,7 +14,7 @@ WANDB_MODE=disabled python hyperlora/intx_sft.py configs/default.yaml --model_name_or_path=meta-llama/Llama-3.2-1B-Instruct --num_train_epochs=50 --per_device_train_batch_size=128 --per_device_eval_batch_size=128 --exp_setup=lora --train_ds_name=data/raw_datasets/context_numbers_small ``` --> -## 🚀 `Ctx-to-LoRA` API +## 🚀 API Usage [WIP] ```python from ctx_to_lora.modeling import ModulatedPretrainedModel model = ModulatedPretrainedModel.from_state_dict(...)