Commit graph

395 commits

Author SHA1 Message Date
51616
696b45c51b icml rebuttal 2026-06-15 04:31:47 +00:00
51616
22267c7666 Update README 2026-02-13 08:55:01 +00:00
51616
32b5d2a197 video update 2026-02-13 08:49:48 +00:00
51616
8beaa905e7 Update README demo video section for GitHub rendering 2026-02-13 08:43:49 +00:00
51616
ec16f545c1 add bib gif video (waiting for arxiv id) 2026-02-13 08:30:08 +00:00
51616
8093817c34 icml cleaned 2026-02-13 06:02:29 +00:00
51616
c4c1ac6eaa cd minibatch working 2025-11-25 04:58:12 +00:00
51616
2e88a18bd2 make ctx encoder vlm compatible 2025-11-10 16:54:55 +09:00
51616
6f857a2dca add generative adapter 2025-11-10 16:54:45 +09:00
51616
d6c7e3ab03 fix tracker + recall/precision logging + add generative adapter 2025-11-10 16:54:25 +09:00
51616
2ed418bc22 vlm ctx-encoder + slrum scripts + qwen self-gen 2025-10-27 06:20:26 +00:00
51616
178822b7d3 mistral config + script 2025-10-13 07:45:47 +00:00
51616
cddb1238ff self-gen data viewer 2025-10-10 08:09:46 +00:00
51616
fc086356b4 add qwen3-4b and mistral-7b (niah working) 2025-10-10 06:31:20 +00:00
51616
a074fd3305 self-gen data misaligned fixed + niah reproducible + vllm-tokenizers version combo 2025-10-08 05:17:50 +00:00
51616
39ed1b3d75 basic gradio app 2025-10-02 06:35:33 +00:00
51616
3b798c670c python api + remove generate_multi_lora + rename config path + test eval scripts 2025-10-01 13:11:54 +00:00
51616
530fcd46cc permission + remove copilot intx + remove monkey patch 2025-09-30 15:18:09 +00:00
51616
b6679ba755 iclr cleanup 2025-09-30 14:53:21 +00:00
51616
8745db6e11 iclr 2026 (tmp 2) 2025-09-28 15:46:47 +00:00
51616
ad18d38374 iclr 2026 (3) 2025-09-28 15:46:09 +00:00
51616
4b1e00fcce Merge branch 'main' of https://github.com/SakanaAI/ctx-to-lora 2025-09-29 00:40:54 +09:00
51616
4f9ba49c04 iclr 2026 (tmp) 2025-09-29 00:40:51 +09:00
51616
c21ba2b481 iclr 2026 2025-09-29 00:39:17 +09:00
51616
67e73d0fc7 allow use_bias=False 2025-09-19 06:52:18 +00:00
51616
76bf6981ba scaling gen lora + q gen round for cd + gsm8k 2025-09-18 16:02:22 +09:00
51616
2af651fa41 gsm8k 2025-09-18 16:00:34 +09:00
51616
5d348a4004 truncated eval 2025-09-18 16:00:26 +09:00
51616
8a6c2cfd42 add t2l 2025-09-15 04:04:32 +09:00
51616
3105fac6dc remove num_gen_q 2025-09-15 01:37:28 +09:00
51616
b77aa4a9f6 recursive q gen for cd baseline 2025-09-15 01:29:35 +09:00
51616
f0721b82a1 old data mix + remove double bos 2025-09-14 16:37:52 +09:00
51616
86ba2bc4a5 self-gen data import 2025-09-13 23:52:24 +09:00
51616
0e46a7c568 add llmlingua + different q model for cd 2025-09-13 23:52:07 +09:00
51616
0e05644d6a iterative mode for hypernet 2025-09-12 19:05:05 +09:00
51616
7d95db6672 context distillation eval + timer 2025-09-12 16:34:03 +09:00
51616
f2efe22cba Merge branch 'main' of https://github.com/SakanaAI/ctx-to-lora 2025-09-07 17:16:40 +09:00
51616
650395874f toy exp w/ self-gen + use double bos for eval (following vllm 0.8.4) 2025-09-07 17:16:20 +09:00
51616
0c1a8bb3e8 update data gen/def 2025-09-06 08:44:11 +00:00
51616
a4f4dfd522 magic num eval upto 128k 2025-09-06 02:21:15 +09:00
51616
cfe737d106 Merge branch 'main' of https://github.com/SakanaAI/ctx-to-lora 2025-09-05 17:53:42 +09:00
51616
23e502aa65 cleaner merger + use_per_ctx_avg_loss=True as default 2025-09-05 17:52:03 +09:00
51616
f02ae874f3 sparse kl 2025-09-05 17:51:37 +09:00
51616
e2e7f45472 per-ctx-avg loss for ce 2025-09-05 16:28:30 +09:00
51616
237b6dc6fa Merge branch 'main' of https://github.com/SakanaAI/ctx-to-lora into main 2025-09-04 13:54:54 +00:00
51616
1201fcf7bc watcher save state 2025-09-04 13:54:49 +00:00
51616
a17d2532c2 fix logging + l1norm div by num ctx (work correctly w/ grad accum) 2025-09-04 21:18:47 +09:00
51616
41a1cfb90a AB scaler + use bias for generation 2025-09-04 21:15:42 +09:00
51616
3364a25591 gcp watcher w/ time filter 2025-09-03 08:51:16 +00:00
51616
563ecf4273 magic alpha! 2025-09-03 17:43:44 +09:00