From 776ee4455cc59e49b46d0cda1c965c4b9a789328 Mon Sep 17 00:00:00 2001 From: Cyzus Chi Date: Thu, 31 Oct 2024 00:05:44 +0800 Subject: [PATCH] remove mlebench --- metagpt/ext/sela/runner/README.md | 32 +------------------------------ 1 file changed, 1 insertion(+), 31 deletions(-) diff --git a/metagpt/ext/sela/runner/README.md b/metagpt/ext/sela/runner/README.md index 7c031f1ee..4867aa4f0 100644 --- a/metagpt/ext/sela/runner/README.md +++ b/metagpt/ext/sela/runner/README.md @@ -165,34 +165,4 @@ ### 5. Custom Baselines To run additional baselines: - Each baseline must produce `dev_predictions.csv` and `test_predictions.csv` with a `target` column. -- Use the `evaluate_score` function for evaluation. - ---- - -## MLE-Bench - -**Note:** MLE-Bench requires Python 3.11 or higher. - -#### Setup - -Clone the repository and install: - -```bash -git clone https://github.com/openai/mle-bench.git -cd mle-bench -pip install -e . -``` - -Prepare the data: - -```bash -mlebench prepare -c --data-dir -``` - -#### Run the MLE-Bench Experiment - -Run the following command to execute the experiment: - -```bash -python run_experiment.py --exp_mode mcts --custom_dataset_dir --rollouts 10 --from_scratch --role_timeout 3600 -``` \ No newline at end of file +- Use the `evaluate_score` function for evaluation. \ No newline at end of file