Commit graph

4861 commits

Author SHA1 Message Date
Yizhou Chi
c0262bcd8f 1. add support to hf dataset
2. add support to datasets that have both train and test
3. create data folder
4. fix new instruction bug
2024-09-06 19:05:10 +08:00
Yizhou Chi
376d1b7661 allow new instruction even if there's no insights 2024-09-06 17:02:49 +08:00
Yizhou Chi
6d40ec463f update result key 2024-09-06 14:18:04 +08:00
Yizhou Chi
a6f71f4498 1. avoid circular reference
2. add greedy
2024-09-06 13:09:18 +08:00
Yizhou Chi
e07ed0df8b fix mcts bug 2024-09-06 10:42:24 +08:00
Yizhou Chi
0e27e3d8be 使用code block做reflection 2024-09-06 10:31:01 +08:00
Yizhou Chi
defca81ebb fix time calculation 2024-09-06 10:24:49 +08:00
林义章
3583e2af63 Merge branch 'experimenter' into 'expo'
增加dataset_info到提示词

See merge request agents/exp_optimizer!4
2024-09-05 06:35:16 +00:00
Yizhou Chi
96ffcd285f 更新Prompt相关readme 2024-09-05 14:30:36 +08:00
Yizhou Chi
d27a48adb2 update prompt to include dataset info path 2024-09-05 13:01:00 +08:00
Yizhou Chi
45d176b48b remove deprecated scripts 2024-09-05 11:00:07 +08:00
Yizhou Chi
c16286a006 Refactor MCTS class to handle role running errors and improve error logging 2024-09-05 10:12:37 +08:00
林义章
d9bce92156 Merge branch 'experimenter' into 'expo'
fix import

See merge request agents/exp_optimizer!3
2024-09-04 11:06:16 +00:00
Yizhou Chi
58d7b14007 fix import 2024-09-04 18:46:16 +08:00
Yizhou Chi
2c43944ec0 fix import 2024-09-04 18:08:59 +08:00
林义章
697deb97db Merge branch 'experimenter' into 'expo'
Experimenter

See merge request agents/exp_optimizer!2
2024-09-04 10:00:56 +00:00
Yizhou Chi
ab8a1d6824 format code 2024-09-04 17:52:02 +08:00
Yizhou Chi
fcd1ba66a6 增加try catch 2024-09-04 16:38:33 +08:00
Yizhou Chi
aea524b4ea 1. update readme
2. fix duration
2024-09-04 14:49:18 +08:00
Yizhou Chi
72bd1665b1 ensure experimenter not evaluating csv from other experiments 2024-09-04 10:41:10 +08:00
Yizhou Chi
f23d2a72c9 add autogluon 2024-09-04 10:39:28 +08:00
Yizhou Chi
6972afb755 update prompt (specify whether each set has target label) 2024-09-03 16:31:03 +08:00
Yizhou Chi
df877c973e update readme 2024-09-03 14:03:07 +08:00
林义章
1a833dc3a9 Merge branch 'experimenter' into 'expo'
add experimenter

See merge request agents/exp_optimizer!1
2024-09-03 05:55:19 +00:00
Yizhou Chi
3ec6dcd5df update readme 2024-09-03 13:40:23 +08:00
Yizhou Chi
6aafe680c1 1. 暂时在expo文件夹里单独放一个requirements.txt
2. Dummy CustomExperimenter
2024-09-02 20:23:45 +08:00
Yizhou Chi
a1668a1d9d add custom experimenter 2024-09-02 20:00:46 +08:00
Yizhou Chi
ab8be7a183 update readme 2024-09-02 17:01:25 +08:00
Yizhou Chi
f2603a9d31 remove deprecated comments 2024-09-02 16:51:33 +08:00
didi
c3903412b4 Update Operator Optimize Method. 2024-09-02 16:47:03 +08:00
Yizhou Chi
f28908e4c5 1. role.py - 如果已经有plan,便不再重复生成
2. 修改prompt,让predictions.csv生成的格式与原gt格式一样
2024-09-02 15:15:53 +08:00
Yizhou Chi
0e5db1c364 1. add ml module
2. fix bug
2024-09-02 14:07:14 +08:00
Yizhou Chi
0b30866d10 fix prompt's json format 2024-09-02 10:39:08 +08:00
Yizhou Chi
27bbc927b0 1. Rewrite logger message
2. fix import
2024-09-02 10:21:30 +08:00
Yizhou Chi
16d1bf0da0 Rename insight generate to instruction generator 2024-09-02 09:59:47 +08:00
Yizhou Chi
ae6a195750 fix bug - make rollout more consistent 2024-08-30 20:35:17 +08:00
Yizhou Chi
32759f031c add experimenter 2024-08-30 19:55:40 +08:00
Yizhou Chi
d14f07f9b1 1. change data.yaml to more generalized path
2. correct import
2024-08-30 16:59:38 +08:00
Yizhou Chi
211f758b53 add openml to requirement 2024-08-30 16:58:31 +08:00
Yizhou Chi
fab1293cab ignore expo/results 2024-08-30 16:26:56 +08:00
Yizhou Chi
95d7160c0e add expo 2024-08-30 16:26:05 +08:00
Maximilian Knoll
fa7e3ae24e
add authorization header to support open webui 2024-08-27 13:27:47 +02:00
didi
d97f90f9c7 Update 2024-08-26 08:40:10 +08:00
didi
7c2501e08b Update 2024-08-26 08:30:24 +08:00
didi
6a01a679ce test for multi llm 2024-08-25 22:17:27 +08:00
didi
1593e98c45 Update Multi LLM Config & Basic Evaluator 2024-08-25 22:16:39 +08:00
didi
a3ff25430e Update ConText Fill 2024-08-23 20:43:29 +08:00
didi
02c7c4ea47 Update 混乱版本 2024-08-23 14:21:04 +08:00
didi
2937d9a13a Update 粗糙版本 优化 2024-08-23 13:57:35 +08:00
莘权 马
5bec4bbaa0 fixbug: qianfan timeout 2024-08-21 14:07:10 +08:00