Commit graph

4592 commits

Author SHA1 Message Date
Yizhou Chi
5eaa072d8d add an instruction to avoid splitting instruction being replaced 2024-10-18 16:05:24 +08:00
Yizhou Chi
345d79979d Merge remote-tracking branch 'origin/expo' into optimize-mle-bench-prompt 2024-10-18 16:02:57 +08:00
林义章
2ce186c226 Merge branch 'insight-pool-improve' into 'expo'
add support to run mle-bench

See merge request agents/exp_optimizer!25
2024-10-18 07:42:44 +00:00
Yizhou Chi
f97ad720b0 add task arg for tree visualization 2024-10-18 14:29:36 +08:00
Yizhou Chi
3646feb08c Merge remote-tracking branch 'origin/expo' into insight-pool-improve 2024-10-18 14:10:06 +08:00
Yizhou Chi
7a38165e6b add seed 2024-10-18 14:04:57 +08:00
Yizhou Chi
358a97e34c modify prompt 2024-10-18 11:16:28 +08:00
林义章
2762c1278c Merge branch 'fix-aide-readme' into 'expo'
update aide readme

See merge request agents/exp_optimizer!26
2024-10-17 13:50:30 +00:00
duiyipan
1915d19f24 update aide readme 2024-10-17 21:28:49 +08:00
Yizhou Chi
de42e32b8e automatically update low_is_better for our task 2024-10-17 17:55:24 +08:00
Yizhou Chi
6f437bb76d automatically change low_is_better for rmse 2024-10-17 17:49:31 +08:00
Yizhou Chi
852fbc58ee automatically update args.low_is_better for mle-bench 2024-10-17 17:47:41 +08:00
Yizhou Chi
06710fbc18 fix typo in readme.md 2024-10-17 15:24:22 +08:00
Yizhou Chi
510136ab17 allowing whether to show instructions 2024-10-17 10:37:16 +08:00
Yizhou Chi
6646983a25 fix visualization bug 2024-10-17 10:34:05 +08:00
Yizhou Chi
1d22466ac5 change dir for tree fig 2024-10-17 10:29:46 +08:00
Yizhou Chi
0f01c07b83 add tree visualization script and function 2024-10-17 10:27:33 +08:00
Yizhou Chi
a46f575361 clean up input argument 2024-10-17 10:11:31 +08:00
Yizhou Chi
38daf24c33 rename task if custom_data_dir is used 2024-10-17 09:55:37 +08:00
Yizhou Chi
df7a04dd19 output dev set score 2024-10-16 14:28:27 +08:00
Yizhou Chi
989a3b4299 allow max depth passing in 2024-10-16 10:53:37 +08:00
Yizhou Chi
7794b99005 fix: role timeout not passing in 2024-10-16 09:50:24 +08:00
Yizhou Chi
541f8a1b10 fix path bug 2024-10-15 19:18:30 +08:00
Yizhou Chi
02b4f0aa13 add timout to mlebench readme instruction 2024-10-15 16:41:28 +08:00
Yizhou Chi
0166834ce4 fix special instruction bug 2024-10-15 16:19:02 +08:00
Yizhou Chi
d179982949 allow special-instruction for mle-bench 2024-10-15 14:14:29 +08:00
Yizhou Chi
07800be441 allow datasets to be prepared by users 2024-10-15 14:13:25 +08:00
林义章
7cb307aef5 Merge branch 'prepare-for-opensource' into 'expo'
开源准备

See merge request agents/exp_optimizer!24
2024-10-15 03:53:30 +00:00
Yizhou Chi
1d4a845120 支持跑通mle bench 2024-10-14 16:12:26 +08:00
Yizhou Chi
a91003a7fe disable submission 2024-10-14 09:56:55 +08:00
Yizhou Chi
3a57060e25 1. add eval_func for sela and compatibility to others
2. llm extract score (use all code block and execution results)
3. add argument for custom dataset dir
4. dataset custom requirement support
2024-10-12 17:16:51 +08:00
Yizhou Chi
eda9322361 1. dynamically add insight
2. insight from scratch in real time
2024-10-11 18:37:35 +08:00
Yizhou Chi
f7374c03af rename analysis pool to insight pool 2024-10-11 14:55:45 +08:00
Yizhou Chi
56e7a08a1c insight pool is now able to dynamically increase 2024-10-11 14:48:56 +08:00
Yizhou Chi
ae12d73747 remove dependency 2024-10-11 13:12:03 +08:00
Yizhou Chi
9c54113f77 make sure image task starting from datapreprocessing 2024-10-11 10:41:33 +08:00
Yizhou Chi
cdfb413f9d 去掉role装饰器 2024-10-11 10:05:15 +08:00
Yizhou Chi
e1c2683038 删除图片 2024-10-11 10:03:08 +08:00
Yizhou Chi
9f4eba7f60 add scripts 2024-10-10 19:43:56 +08:00
Yizhou Chi
eb460d3e19 make timeout as argument 2024-10-10 18:54:40 +08:00
Yizhou Chi
2fc8f20de6 can change timeout through data.yaml 2024-10-10 16:38:19 +08:00
Yizhou Chi
f80ebc4d67 1. add role level timeout 限制是1000s
2. 修改log的层级逻辑
3. data.yaml 只用于存路径
2024-10-10 16:30:07 +08:00
林义章
573e9b6d9e Merge branch 'improve-multimodal' into 'expo'
Improve multimodal

See merge request agents/exp_optimizer!22
2024-10-10 02:17:38 +00:00
Yizhou Chi
788e42ea55 update model list 2024-09-30 16:06:48 +08:00
Yizhou Chi
1589a04cdb clarify prediction saving prompt 2024-09-28 18:27:23 +08:00
Yizhou Chi
db247d9ff4 save result order 2024-09-28 15:01:01 +08:00
Yizhou Chi
06702db6d1 update pet 2024-09-28 10:39:12 +08:00
Yizhou Chi
bd26e900e6 update target label 2024-09-28 10:07:35 +08:00
Yizhou Chi
af844693b1 change label column 2024-09-27 15:13:23 +08:00
Yizhou Chi
1654174b15 Merge branch 'expo' into improve-multimodal 2024-09-27 12:58:47 +08:00