13 commits

Author	SHA1	Message	Date
Yizhou Chi	d179982949	allow special-instruction for mle-bench	2024-10-15 14:14:29 +08:00
Yizhou Chi	3a57060e25	1. add eval_func for sela and compatibility to others ... 2. llm extract score (use all code block and execution results) 3. add argument for custom dataset dir 4. dataset custom requirement support	2024-10-12 17:16:51 +08:00
Yizhou Chi	f80ebc4d67	1. add role level timeout 限制是1000s ... 2. 修改log的层级逻辑 3. data.yaml 只用于存路径	2024-10-10 16:30:07 +08:00
Yizhou Chi	8dbcd46bfc	copy notebook to result after mcts	2024-09-20 15:53:10 +08:00
Yizhou Chi	eaf1b62343	add timeout to client	2024-09-11 16:14:50 +08:00
Yizhou Chi	60e8e3eab8	fix hfdataset; make dirs when save notebook	2024-09-10 13:51:54 +08:00
Yizhou Chi	294d0fe709	fix nbclient	2024-09-09 16:59:39 +08:00
Yizhou Chi	93ff1f8f2b	update datasets.yaml	2024-09-09 13:50:36 +08:00
Yizhou Chi	9728b3a891	add greedy to run_experiment; add save_notebook to experimenter.py	2024-09-09 13:44:38 +08:00
Yizhou Chi	ab8a1d6824	format code	2024-09-04 17:52:02 +08:00
Yizhou Chi	32759f031c	add experimenter	2024-08-30 19:55:40 +08:00
Yizhou Chi	d14f07f9b1	1. change data.yaml to more generalized path ... 2. correct import	2024-08-30 16:59:38 +08:00
Yizhou Chi	95d7160c0e	add expo	2024-08-30 16:26:05 +08:00