apunkt/MetaGPT
1
0
Fork 0
mirror of https://github.com/FoundationAgents/MetaGPT.git synced 2026-06-08 15:05:17 +02:00
Code Issues Projects Releases Packages Wiki Activity Actions

remove mlebench

Browse source
This commit is contained in:
Cyzus Chi 2024-10-31 00:05:44 +08:00
parent 261a39d547
commit 776ee4455c
1 changed files with 1 additions and 31 deletions
Download patch file Download diff file Expand all files Collapse all files

32
metagpt/ext/sela/runner/README.md
View file

@ -165,34 +165,4 @@ ### 5. Custom Baselines
To run additional baselines:
- Each baseline must produce `dev_predictions.csv` and `test_predictions.csv` with a `target` column.
- Use the `evaluate_score` function for evaluation.
---
## MLE-Bench
**Note:** MLE-Bench requires Python 3.11 or higher.
#### Setup
Clone the repository and install:
```bash
git clone https://github.com/openai/mle-bench.git
cd mle-bench
pip install -e .
```
Prepare the data:
```bash
mlebench prepare -c <competition-id> --data-dir <dataset-dir-save-path>
```
#### Run the MLE-Bench Experiment
Run the following command to execute the experiment:
```bash
python run_experiment.py --exp_mode mcts --custom_dataset_dir <dataset-dir-save-path/prepared/public> --rollouts 10 --from_scratch --role_timeout 3600
```
- Use the `evaluate_score` function for evaluation.