|
a |
|
b/examples/cinc17/README.md |
|
|
1 |
|
|
|
2 |
# The Physionet 2017 Challenge |
|
|
3 |
|
|
|
4 |
Before following this guide first follow the setup instructions in the top-level |
|
|
5 |
[README](../../README.md). |
|
|
6 |
|
|
|
7 |
These instructions go through the training and evaluation of a model on the |
|
|
8 |
[Physionet 2017 challenge](https://www.physionet.org/challenge/2017/) dataset. |
|
|
9 |
|
|
|
10 |
## Data |
|
|
11 |
|
|
|
12 |
To download and build the datasets run: |
|
|
13 |
|
|
|
14 |
``` |
|
|
15 |
./setup.sh |
|
|
16 |
``` |
|
|
17 |
|
|
|
18 |
## Training |
|
|
19 |
|
|
|
20 |
Change directory to the repo root directory (`ecg`) and run |
|
|
21 |
|
|
|
22 |
``` |
|
|
23 |
python ecg/train.py examples/cinc17/config.json -e cinc17 |
|
|
24 |
``` |
|
|
25 |
|
|
|
26 |
## Evaluation |
|
|
27 |
|
|
|
28 |
The test dataset for the Physionet 2017 challenge is hidden and maintained by |
|
|
29 |
the challenge organizers. To evaluate on this dataset requires packaging and |
|
|
30 |
submitting the code, dependencies and model to a test server. In general you |
|
|
31 |
will need to be familiar with the instructions on the challenge |
|
|
32 |
[website](https://www.physionet.org/challenge/2017/), but we have included some |
|
|
33 |
scripts to make this as simple as possible. |
|
|
34 |
|
|
|
35 |
First change the file in `entry/AUTHORS.txt` to be your name and institution. |
|
|
36 |
|
|
|
37 |
Next, from the `entry` directory, run |
|
|
38 |
|
|
|
39 |
``` |
|
|
40 |
./prepare-entry.sh <path_to_model> |
|
|
41 |
``` |
|
|
42 |
|
|
|
43 |
The model path should be in |
|
|
44 |
`<path_to_repo>/ecg/saved/cinc17/<timestamp>/<best_model>.hdf5`. The dev set |
|
|
45 |
loss is the first number in the model file name, so the best model (as |
|
|
46 |
evaluated by dev set loss) is the model with the smallest first number in its |
|
|
47 |
name. |
|
|
48 |
|
|
|
49 |
Note that this script is quite slow since every time the model is run on a |
|
|
50 |
record it has to be reloaded. Once complete, a zip file should be created in |
|
|
51 |
`entry/entry/entry.zip`. This is the submission. |