Diff of /README.md [000000] .. [bca7a0]

Switch to unified view

a b/README.md
1
# Musculoskeletal Radiographs Abnormality Classifier
2
3
## Experiments
4
5
| Network                | Accuracy (encounter) | Precision (encounter) | Recall (encounter) | F1 (encounter) | Kappa (encounter) |
6
| ---------------------- | -------------------- | --------------------- | ------------------ | -------------- | ----------------- |
7
| DenseNet169 (baseline) | .83 (.84)            | .82 (.82)             | .87 (.90)          | .84 (.86)      | .65 (.65)         |
8
| MobileNet              | .81 (.83)            | .80 (.82)             | .85 (.89)          | .82 (.85)      | .62 (.62)         |
9
| NASNetMobile           | .82 (.83)            | .78 (.80)             | .89 (.92)          | .83 (.86)      | .63 (.63)         |
10
11
Also, ResNet50 in pytorch which achieved equivalent results.
12
13
## The [Mura](https://arxiv.org/abs/1712.06957) Dataset
14
15
```latex
16
@misc{1712.06957,
17
Author = {Pranav Rajpurkar and Jeremy Irvin and Aarti Bagul and Daisy Ding and Tony Duan and Hershel Mehta and Brandon Yang and Kaylie Zhu and Dillon Laird and Robyn L. Ball and Curtis Langlotz and Katie Shpanskaya and Matthew P. Lungren and Andrew Ng},
18
Title = {MURA Dataset: Towards Radiologist-Level Abnormality Detection in Musculoskeletal Radiographs},
19
Year = {2017},
20
Eprint = {arXiv:1712.06957},}
21
```
22
23
|     Study | Normal    | Abnormal  |      Total |
24
| --------: | :-------- | :-------- | ---------: |
25
|     Elbow | 1,203     | 768       |      1,971 |
26
|    Finger | 1,389     | 753       |      2,142 |
27
|   Forearm | 677       | 380       |      1,057 |
28
|      Hand | 1,613     | 602       |      2,215 |
29
|   Humerus | 411       | 367       |        778 |
30
|  Shoulder | 1,479     | 1,594     |      3,073 |
31
|     Wrist | 2,295     | 1,451     |      3,746 |
32
| **Total** | **9,067** | **5,915** | **14,982** |
33
34
- Each study contains 1-N views (images)
35
- 40,895 multi-view radiographic images
36
37
### Their results (DenseNet169)
38
39
|                  | Radiologists (95% CI)    | Model (95% CI)           |
40
| ---------------: | :----------------------- | :----------------------- |
41
|            Elbow | **0.858** (0.707, 0.959) | 0.848 (0.691, 0.955)     |
42
|           Finger | 0.781 (0.638, 0.871)     | **0.792** (0.588, 0.933) |
43
|          Forearm | **0.899** (0.804, 0.960) | 0.814 (0.633, 0.942)     |
44
|             Hand | 0.854 (0.676, 0.958)     | **0.858** (0.658, 0.978) |
45
|          Humerus | **0.895** (0.774, 0.976) | 0.862 (0.709, 0.968)     |
46
|         Shoulder | **0.925** (0.811, 0.989) | 0.857 (0.667, 0.974)     |
47
|            Wrist | 0.958 (0.908, 0.988)     | **0.968** (0.889, 1.000) |
48
| **Aggregate F1** | **0.884** (0.843, 0.918) | 0.859 (0.804, 0.905)     |