update readme

This commit is contained in:
Yizhou Chi 2024-09-03 14:03:07 +08:00
parent 3ec6dcd5df
commit df877c973e

View file

@ -42,11 +42,7 @@ ## 3. Evaluation
运行各个框架运行后框架需要提供Dev和Test的`dev_predictions.csv``test_predictions.csv` column name为target
两种评估方式
1. `evaluation.py` 提供pred和原始的gt1D iterable以及需要使用的metric返回evaluation score
2. 使用`CustomExperimenter`
- 使用`CustomExperimenter`
```
experimenter = CustomExperimenter(task="titanic")
score_dict = experimenter.evaluate_pred_files(dev_pred_path, test_pred_path)