Diff of /doc/validation.md [000000] .. [85e7ae]

Switch to unified view

a b/doc/validation.md
1
### TigerBx: Tissue Mask Generation for Brain Extration
2
3
### Validation pipeline (after v0.1.16)
4
5
    import tigerbx
6
    import time
7
    t = time.time()
8
    # tigerbx.val(argstring, input_dir, output_dir=None, model=None, GPU=False, debug=False)
9
    df, metric1 = tigerbx.val('bet_NFBS', 'NFBS_Dataset','temp', GPU=True)
10
    df, metric2 = tigerbx.val('bet_synstrip', 'synthstrip_data_v1.4','temp', GPU=True)
11
    df, metric3 = tigerbx.val('aseg_123', 'aseg', 'temp', GPU=True)
12
    df, metric4 = tigerbx.val('dgm_123', 'aseg', 'temp', GPU=True)
13
    df, metric5 = tigerbx.val('syn_123', 'aseg', 'temp', GPU=True)
14
    df, metric6 = tigerbx.val('reg_60', 'aseg', 'temp', GPU=True, template='Template_T1_tbet.nii.gz')
15
16
    
17
    print('bet_NFBS', metric1)
18
    print('bet_synstrip', metric2)
19
    print('aseg_123', metric3)
20
    print('dgm_123', metric4)
21
    print('syn_123', metric5)
22
    print('reg_60', metric6)
23
    print('Time', time.time() - t)
24
25
### Validation Datasets
26
1. Skull Stripping: [NFBS_Dataset](http://preprocessed-connectomes-project.org/NFB_skullstripped)
27
2. Skull Stripping: [Synstrip](https://surfer.nmr.mgh.harvard.edu/docs/synthstrip)
28
3. Deep gray matter: [MindBoggle-101](https://mindboggle.info/)
29
4. Deep gray matter: [CANDI](https://www.nitrc.org/projects/candi_share/)
30
5. Registration: [ABIDE](https://fcon_1000.projects.nitrc.org/indi/abide/)
31
32
33
### Internal Validation Sets:
34
1. aseg: A combination of MindBoggle-101 and CANDI (N = 123) with DGM labels
35
36
### Validation Results of Verion 0.1.16
37
#### Deep Gray matter: Dice coefficients
38
39
    | Structure  | L/R | aseg  | dgm  | syn  | L/R | aseg  | dgm  | syn  |
40
    |------------|-----|-------|------|------|-----|-------|------|------|
41
    | Thalamus   | L   | 0.879 | 0.898| 0.890| R   | 0.889 | 0.902| 0.884|
42
    | Caudate    | L   | 0.875 | 0.874| 0.850| R   | 0.875 | 0.872| 0.845|
43
    | Putamen    | L   | 0.873 | 0.885| 0.847| R   | 0.862 | 0.880| 0.829|
44
    | Pallidum   | L   | 0.827 | 0.827| 0.828| R   | 0.814 | 0.815| 0.794|
45
    | Hippocampus| L   | 0.808 | 0.828| 0.789| R   | 0.810 | 0.831| 0.779|
46
    | Amygdala   | L   | 0.737 | 0.764| 0.716| R   | 0.727 | 0.750| 0.711|
47
    | Mean       | L   | 0.833 | 0.846| 0.820| R   | 0.829 | 0.841| 0.807|
48
#### Registration:
49
    mean dice: 0.797
50
    mean dice: 0.804(FuseMorph)
51
52
#### Skull Stripping
53
    bet_NFBS: 0.973
54
    bet_synstrip: 0.971
55
56
57
58
59