37 commits

Author	SHA1	Message	Date
Yizhou Chi	6f437bb76d	automatically change low_is_better for rmse	2024-10-17 17:49:31 +08:00
Yizhou Chi	a46f575361	clean up input argument	2024-10-17 10:11:31 +08:00
Yizhou Chi	989a3b4299	allow max depth passing in	2024-10-16 10:53:37 +08:00
Yizhou Chi	7794b99005	fix: role timeout not passing in	2024-10-16 09:50:24 +08:00
Yizhou Chi	d179982949	allow special-instruction for mle-bench	2024-10-15 14:14:29 +08:00
Yizhou Chi	1d4a845120	支持跑通mle bench	2024-10-14 16:12:26 +08:00
Yizhou Chi	3a57060e25	1. add eval_func for sela and compatibility to others ... 2. llm extract score (use all code block and execution results) 3. add argument for custom dataset dir 4. dataset custom requirement support	2024-10-12 17:16:51 +08:00
Yizhou Chi	eda9322361	1. dynamically add insight ... 2. insight from scratch in real time	2024-10-11 18:37:35 +08:00
Yizhou Chi	56e7a08a1c	insight pool is now able to dynamically increase	2024-10-11 14:48:56 +08:00
Yizhou Chi	eb460d3e19	make timeout as argument	2024-10-10 18:54:40 +08:00
Yizhou Chi	f80ebc4d67	1. add role level timeout 限制是1000s ... 2. 修改log的层级逻辑 3. data.yaml 只用于存路径	2024-10-10 16:30:07 +08:00
Yizhou Chi	2b67355358	add step score	2024-09-26 20:25:36 +08:00
Yizhou Chi	8dbcd46bfc	copy notebook to result after mcts	2024-09-20 15:53:10 +08:00
Yizhou Chi	3c50575ff7	make dir at start	2024-09-14 21:16:40 +08:00
Yizhou Chi	8c6dd480dc	remove pdb	2024-09-14 21:10:37 +08:00
Yizhou Chi	24db19fa13	fix start task id consistency	2024-09-14 20:33:40 +08:00
Yizhou Chi	5e7cac7e6e	fix fixed_insights bug	2024-09-14 17:51:32 +08:00
Yizhou Chi	8beca0fadd	1. add special instruction ... 2. add fixed insights	2024-09-14 15:17:42 +08:00
Yizhou Chi	9ba0d217fc	update mcts logic	2024-09-09 14:52:25 +08:00
Yizhou Chi	c0262bcd8f	1. add support to hf dataset ... 2. add support to datasets that have both train and test 3. create data folder 4. fix new instruction bug	2024-09-06 19:05:10 +08:00
Yizhou Chi	a6f71f4498	1. avoid circular reference ... 2. add greedy	2024-09-06 13:09:18 +08:00
Yizhou Chi	e07ed0df8b	fix mcts bug	2024-09-06 10:42:24 +08:00
Yizhou Chi	c16286a006	Refactor MCTS class to handle role running errors and improve error logging	2024-09-05 10:12:37 +08:00
Yizhou Chi	ab8a1d6824	format code	2024-09-04 17:52:02 +08:00
Yizhou Chi	fcd1ba66a6	增加try catch	2024-09-04 16:38:33 +08:00
Yizhou Chi	72bd1665b1	ensure experimenter not evaluating csv from other experiments	2024-09-04 10:41:10 +08:00
Yizhou Chi	6972afb755	update prompt (specify whether each set has target label)	2024-09-03 16:31:03 +08:00
Yizhou Chi	3ec6dcd5df	update readme	2024-09-03 13:40:23 +08:00
Yizhou Chi	a1668a1d9d	add custom experimenter	2024-09-02 20:00:46 +08:00
Yizhou Chi	f28908e4c5	1. role.py - 如果已经有plan，便不再重复生成 ... 2. 修改prompt，让predictions.csv生成的格式与原gt格式一样	2024-09-02 15:15:53 +08:00
Yizhou Chi	0e5db1c364	1. add ml module ... 2. fix bug	2024-09-02 14:07:14 +08:00
Yizhou Chi	27bbc927b0	1. Rewrite logger message ... 2. fix import	2024-09-02 10:21:30 +08:00
Yizhou Chi	16d1bf0da0	Rename insight generate to instruction generator	2024-09-02 09:59:47 +08:00
Yizhou Chi	ae6a195750	fix bug - make rollout more consistent	2024-08-30 20:35:17 +08:00
Yizhou Chi	32759f031c	add experimenter	2024-08-30 19:55:40 +08:00
Yizhou Chi	d14f07f9b1	1. change data.yaml to more generalized path ... 2. correct import	2024-08-30 16:59:38 +08:00
Yizhou Chi	95d7160c0e	add expo	2024-08-30 16:26:05 +08:00