|
a |
|
b/docs/1.model_zoo.md |
|
|
1 |
# Model Zoo |
|
|
2 |
|
|
|
3 |
## [CASIA-B](http://www.cbsr.ia.ac.cn/english/Gait%20Databases.asp) |
|
|
4 |
|
|
|
5 |
| Model | `Rank@1.NM` | `Rank@1.BG` | `Rank@1.CL` | `mAP.NM` | `mAP.BG` | `mAP.CL` | Configuration | Input Size | Download checkpoint | |
|
|
6 |
| :----------------------------------------------------------: | :---------: | :---------: | :---------: | :------: | :------: | :------: | :----------------------------------------------------------: | :--------: | :-----------------: | |
|
|
7 |
| [GaitSet(AAAI2019)](https://arxiv.org/pdf/1811.06186.pdf) | 95.8(95.0) | 90.0(87.2) | 75.4(70.4) | 85.9 | 81.4 | 77.0 | [gaitset.yaml](../configs/gaitset/gaitset.yaml) | 64x44 | - | |
|
|
8 |
| [GaitPart(CVPR2020)](https://openaccess.thecvf.com/content_CVPR_2020/papers/Fan_GaitPart_Temporal_Part-Based_Model_for_Gait_Recognition_CVPR_2020_paper.pdf) | 96.1(96.2) | 90.7(91.5) | 78.7(78.7) | 84.8 | 81.1 | 75.5 | [gaitpart.yaml](../configs/gaitpart/gaitpart.yaml) | 64x44 | - | |
|
|
9 |
| [GLN*(ECCV2020)](http://home.ustc.edu.cn/~saihui/papers/eccv2020_gln.pdf) | 96.4(95.6) | 93.1(92.0) | 81.0(77.2) | 89.3 | 87.0 | 82.6 | [gln_phase1.yaml](../configs/gln/gln_phase1.yaml), [gln_phase2.yaml](../configs/gln/gln_phase2.yaml) | 128x88 | - | |
|
|
10 |
| [GaitGL(ICCV2021)](https://openaccess.thecvf.com/content/ICCV2021/papers/Lin_Gait_Recognition_via_Effective_Global-Local_Feature_Representation_and_Local_Temporal_ICCV_2021_paper.pdf) | 97.4(97.4) | 94.5(94.5) | 83.8(83.6) | 86.2 | 84.4 | 79.8 | [gaitgl.yaml](../configs/gaitgl/gaitgl.yaml) | 64x44 | - | |
|
|
11 |
| [GaitBase(CVPR2023)](https://arxiv.org/abs/2211.06597) | 97.6 | 94.0 | 77.4 | - | - | - | [gaitbase_da_casiab.yaml](../configs/gaitbase/gaitbase_da_casiab.yaml) | 64x44 | - | |
|
|
12 |
|
|
|
13 |
## [CASIA-B*](http://www.cbsr.ia.ac.cn/english/Gait%20Databases.asp) |
|
|
14 |
|
|
|
15 |
| Model | `Rank@1.NM` | `Rank@1.BG` | `Rank@1.CL` | Input modality | Configuration | |
|
|
16 |
| :-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------: | :---------: | :---------: | :---------: | :-------------: | :--------------------------------------------------------------: | |
|
|
17 |
| [GaitSet(AAAI2019)](https://arxiv.org/pdf/1811.06186.pdf) | 92.3 | 86.1 | 73.36 | Silhouette | [gaitset.yaml](../configs/gaitset/gaitset.yaml) | |
|
|
18 |
| [GaitPart(CVPR2020)](https://openaccess.thecvf.com/content_CVPR_2020/papers/Fan_GaitPart_Temporal_Part-Based_Model_for_Gait_Recognition_CVPR_2020_paper.pdf) | 93.1 | 86.0 | 75.1 | Silhouette | [gaitpart.yaml](../configs/gaitpart/gaitpart.yaml) | |
|
|
19 |
| [GaitGL(ICCV2021)](https://openaccess.thecvf.com/content/ICCV2021/papers/Lin_Gait_Recognition_via_Effective_Global-Local_Feature_Representation_and_Local_Temporal_ICCV_2021_paper.pdf) | 94.2 | 90.0 | 81.4 | Silhouette | [gaitgl.yaml](../configs/gaitgl/gaitgl.yaml) | |
|
|
20 |
| [GaitEdge(ECCV2022)](https://arxiv.org/abs/2203.03972) | 97.9 | 96.1 | 86.4 | RGB, Silhouette | [phase2_gaitedge.yaml](../configs/gaitedge/phase2_gaitedge.yaml) | |
|
|
21 |
| [GaitBase(CVPR2023)](https://arxiv.org/abs/2211.06597) | 96.5 | 91.5 | 78.0 | Silhouette | - | |
|
|
22 |
|
|
|
23 |
## [SUSTech1K](http://lidargait.github.io) |
|
|
24 |
|
|
|
25 |
| Model | Input modality | Rank@1.NM | Rank@1.BG | Rank@1.CL | Rank@1.CR | Rank@1.UB | Rank@1.UF | Rank@1.OC | Rank@1.NT | Rank@1.ALL | Rank@5.ALL | Download checkpoint | |
|
|
26 |
| ------------------------------------------------------------ | ------------------- | :-------: | :-------: | :-------: | :-------: | :-------: | :-------: | :-------: | :-------: | :--------: | :--------: | :----------------------------------------------------------: | |
|
|
27 |
| PointNet | PointCloud | 43.6 | 37.3 | 25.7 | 28.8 | 19.9 | 30.1 | 44.3 | 27.4 | 31.3 | 59.8 | - | |
|
|
28 |
| PointNet++ | PointCloud | 55.9 | 52.2 | 41.6 | 49.6 | 47.8 | 45.9 | 54.2 | 52.5 | 50.8 | 82.4 | - | |
|
|
29 |
| PointTransformer | PointCloud | 53.2 | 48.1 | 32.1 | 43.2 | 39.1 | 41.8 | 47.9 | 47.1 | 44.4 | 76.7 | - | |
|
|
30 |
| SimpleView | PointCloud | 72.3 | 68.8 | 57.2 | 63.3 | 49.2 | 62.5 | 79.7 | 66.5 | 64.8 | 85.8 | - | |
|
|
31 |
| [LidarGait(CVPR2023)](https://lidargait.github.io) | PointCloud | 91.8 | 88.6 | 74.6 | 89 | 67.5 | 80.9 | 94.5 | 90.4 | 86.8 | 96.1 | - | |
|
|
32 |
| [DeepGaitV2-P3D]((https://arxiv.org/pdf/2303.03301.pdf)) | Silhouette | 87.5 | 84.1 | 53.4 | 81.3 | 86.2 | 84.8 | 88.5 | 28.8 | 82.4 | 92.6 | [model](https://huggingface.co/opengait/OpenGait/blob/main/SUSTech1K/DeepGaitV2/DeepGaitV2/checkpoints/DeepGaitV2_30_DA-50000.pt) | |
|
|
33 |
| [SkeletonGait++(AAAI2024)](https://ojs.aaai.org/index.php/AAAI/article/view/27933/27887) | Silhouette+Skeleton | 89.1 | 87.2 | 55.3 | 85.3 | 87.3 | 87.6 | 91.3 | 47.9 | 85.6 | 95.0 | [model](https://huggingface.co/opengait/OpenGait/blob/main/SUSTech1K/SkeletonGaitPP/SkeletonGaitPP/checkpoints/SkeletonGaitPP_30_DA-50000.pt) | |
|
|
34 |
| [SwinGait]((https://arxiv.org/pdf/2303.03301.pdf)) | Silhouette | 86.2 | 81.3 | 47.4 | 79.3 | 81.6 | 83.1 | 85.6 | 28.5 | 79.7 | 91.8 | - | |
|
|
35 |
|
|
|
36 |
## [OUMVLP](http://www.am.sanken.osaka-u.ac.jp/BiometricDB/GaitMVLP.html) |
|
|
37 |
| Model | `Rank@1` | `mAP` | Configuration | Input Size | Inference Time | Model Size | Download checkpoint | |
|
|
38 |
| :-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------: | :--------: | :---: | :-------------------------------------------------------: | :--------: | :------------: | :--------: | :--------: | |
|
|
39 |
| [GaitSet(AAAI2019)](https://arxiv.org/pdf/1811.06186.pdf) | 87.2(87.1) | 92.2 | [gaitset.yaml](../configs/gaitset/gaitset_OUMVLP.yaml) | 64x44 | 1m26s | 6.31M | - | |
|
|
40 |
| [GaitPart(CVPR2020)](https://openaccess.thecvf.com/content_CVPR_2020/papers/Fan_GaitPart_Temporal_Part-Based_Model_for_Gait_Recognition_CVPR_2020_paper.pdf) | 88.6(88.7) | 93.3 | [gaitpart.yaml](../configs/gaitpart/gaitpart_OUMVLP.yaml) | 64x44 | 8m04s | 3.78M | - | |
|
|
41 |
| [GaitGL(ICCV2021)](https://openaccess.thecvf.com/content/ICCV2021/papers/Lin_Gait_Recognition_via_Effective_Global-Local_Feature_Representation_and_Local_Temporal_ICCV_2021_paper.pdf) | 89.9(89.7) | 93.3 | [gaitgl.yaml](../configs/gaitgl/gaitgl_OUMVLP.yaml) | 64x44 | 5m23s | 95.62M | - | |
|
|
42 |
| [GaitBase(CVPR2023)](https://openaccess.thecvf.com/content/CVPR2023/papers/Fan_OpenGait_Revisiting_Gait_Recognition_Towards_Better_Practicality_CVPR_2023_paper.pdf) | 90.8 | - | [gaitbase_oumvlp.yaml](../configs/gaitbase/gaitbase_oumvlp.yaml) | 64x44 | - | - | - | |
|
|
43 |
| [DeepGaitV2-3D](https://arxiv.org/pdf/2303.03301.pdf) | 92.0 | - | - | 64x44 | - | - | - | |
|
|
44 |
|
|
|
45 |
## [GREW](https://www.grew-benchmark.org) |
|
|
46 |
| Model | `Rank@1` | Configuration | Input Size | Input modality | Inference Time | Model Size | |
|
|
47 |
| :----------------------------------------------------------: | :------: | :----------------------------------------------------------: | :--------: | :-----------------: | :------------: | :--------: | |
|
|
48 |
| [GaitSet(AAAI2019)](https://arxiv.org/pdf/1811.06186.pdf) | 48.4 | [gaitset.yaml](../configs/gaitset/gaitset_GREW.yaml) | 64x44 | Silhouette | - | - | |
|
|
49 |
| [GaitPart(CVPR2020)](https://openaccess.thecvf.com/content_CVPR_2020/papers/Fan_GaitPart_Temporal_Part-Based_Model_for_Gait_Recognition_CVPR_2020_paper.pdf) | 47.6 | [gaitpart.yaml](../configs/gaitpart/gaitpart_GREW.yaml) | 64x44 | Silhouette | - | - | |
|
|
50 |
| [GaitGL(ICCV2021)](https://openaccess.thecvf.com/content/ICCV2021/papers/Lin_Gait_Recognition_via_Effective_Global-Local_Feature_Representation_and_Local_Temporal_ICCV_2021_paper.pdf) | 41.5 | [gaitgl.yaml](../configs/gaitgl/gaitgl_GREW.yaml) | 64x44 | Silhouette | - | - | |
|
|
51 |
| [GaitGL(BNNeck)(ICCV2021)](https://openaccess.thecvf.com/content/ICCV2021/papers/Lin_Gait_Recognition_via_Effective_Global-Local_Feature_Representation_and_Local_Temporal_ICCV_2021_paper.pdf) | 51.7 | [gaitgl.yaml](../configs/gaitgl/gaitgl_GREW_BNNeck.yaml) | 64x44 | Silhouette | - | - | |
|
|
52 |
| [GaitBase(CVPR2023)](https://openaccess.thecvf.com/content/CVPR2023/papers/Fan_OpenGait_Revisiting_Gait_Recognition_Towards_Better_Practicality_CVPR_2023_paper.pdf) | 60.1 | [gaitbase_da_grew.yaml](../configs/gaitbase/gaitbase_da_grew.yaml) | 64x44 | Silhouette | - | - | |
|
|
53 |
| [DeepGaitV2-3D](https://arxiv.org/pdf/2303.03301.pdf) | 79.4 | - | 64x44 | Silhouette | - | - | |
|
|
54 |
| [SwinGait(Transformer-based)](https://arxiv.org/pdf/2303.03301.pdf) | 79.3 | [swingait3D_B1442C2_GREW.yaml](../configs/swingait/swingait3D_B1442C2_GREW.yaml) | 64x44 | Silhouette | - | - | |
|
|
55 |
| [SkeletonGait++(AAAI2024)](https://ojs.aaai.org/index.php/AAAI/article/view/27933/27887) | 85.8 | [skeletongait++_GREW.yaml](../configs/skeletongait/skeletongait++_GREW.yaml) | 64x44 | Silhouette+Skeleton | - | - | |
|
|
56 |
|
|
|
57 |
|
|
|
58 |
## [Gait3D](https://github.com/Gait3D/Gait3D-Benchmark) |
|
|
59 |
| Model | `Rank@1` | Configuration | Input Size | Input modality | Download checkpoint | |
|
|
60 |
| :-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------: | :------: | :-----------: | :--------: | :--------: | --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | |
|
|
61 |
| [GaitSet(AAAI2019)](https://arxiv.org/pdf/1811.06186.pdf) | 36.7 | - | 64x44 | Silhouette | - | |
|
|
62 |
| [GaitPart(CVPR2020)](https://openaccess.thecvf.com/content_CVPR_2020/papers/Fan_GaitPart_Temporal_Part-Based_Model_for_Gait_Recognition_CVPR_2020_paper.pdf) | 28.2 | - | 64x44 | Silhouette | - | |
|
|
63 |
| [GaitGL(ICCV2021)](https://openaccess.thecvf.com/content/ICCV2021/papers/Lin_Gait_Recognition_via_Effective_Global-Local_Feature_Representation_and_Local_Temporal_ICCV_2021_paper.pdf) | 29.7 | - | 64x44 | Silhouette | - | |
|
|
64 |
| [SMPLGait(CVPR 2022)](https://gait3d.github.io/) | 48.3(46.3) | [smplgait.yaml](../configs/smplgait/smplgait.yaml) | 64x44 | Silhouette + SMPL| - | |
|
|
65 |
| [GaitBase(CVPR2023)](https://openaccess.thecvf.com/content/CVPR2023/papers/Fan_OpenGait_Revisiting_Gait_Recognition_Towards_Better_Practicality_CVPR_2023_paper.pdf) | 64.6 | [gaitbase_da_gait3d.yaml](../configs/gaitbase/gaitbase_da_gait3d.yaml) | 64x44 | Silhouette | - | |
|
|
66 |
| [DeepGaitV2-P3D](https://arxiv.org/pdf/2303.03301.pdf) | 74.4 | [DeepGaitV2_gait3d.yaml](../configs/deepgaitv2/DeepGaitV2_gait3d.yaml) | 64x44 | Silhouette | - | |
|
|
67 |
| [SwinGait(Transformer-based)](https://arxiv.org/pdf/2303.03301.pdf) | 75.0 | [swingait3D_B1442C2_Gait3D.yaml](../configs/swingait/swingait3D_B1442C2_Gait3D.yaml) | 64x44 | Silhouette | - | |
|
|
68 |
| [SkeletonGait++(AAAI2024)](https://ojs.aaai.org/index.php/AAAI/article/view/27933/27887) | 77.6 | [skeletongait++_Gait3D.yaml](../configs/skeletongait/skeletongait++_Gait3D.yaml) | 64x44 | Silhouette+Skeleton | - | |
|
|
69 |
|
|
|
70 |
|
|
|
71 |
## [Gait3D-Parsing](https://github.com/Gait3D/Gait3D-Benchmark) |
|
|
72 |
| Model | `Rank@1` | `mAP` | Configuration | Input Size | Download checkpoint | |
|
|
73 |
|:-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------:|:----------:|:---------------:|:-----------------------------------------------------------------------------------------------------------------------------------------------------------------:|:------------:|:-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------:| |
|
|
74 |
| [GaitSet(AAAI2019)](https://arxiv.org/pdf/1811.06186.pdf) | 55.9 | 46.7 | [gaitset_gait3d_parsing.yaml](../configs/gaitset/gaitset_gait3d_parsing.yaml) | 64x44 | [model](https://huggingface.co/opengait/OpenGait/resolve/main/Gait3D-Parsing/GaitSet/GaitSet/checkpoints/GaitSet-180000.pt) | |
|
|
75 |
| [GaitPart(CVPR2020)](https://openaccess.thecvf.com/content_CVPR_2020/papers/Fan_GaitPart_Temporal_Part-Based_Model_for_Gait_Recognition_CVPR_2020_paper.pdf) | 43.0 | 33.9 | [gaitpart_gait3d_parsing.yaml](../configs/gaitpart/gaitpart_gait3d_parsing.yaml) | 64x44 | [model](https://huggingface.co/opengait/OpenGait/resolve/main/Gait3D-Parsing/GaitPart/GaitPart/checkpoints/GaitPart-180000.pt) | |
|
|
76 |
| [GLN(ECCV2020)](http://home.ustc.edu.cn/~saihui/papers/eccv2020_gln.pdf) | 45.7 | 38.6 | [gln_phase1_gait3d_parsing.yaml](../configs/gln/gln_phase1_gait3d_parsing.yaml), [gln_phase2_gait3d_parsing.yaml](../configs/gln/gln_phase2_gait3d_parsing.yaml) | 64x44 | [model](https://huggingface.co/opengait/OpenGait/blob/main/Gait3D-Parsing/GLN/GLN/checkpoints/GLN_P2-180000.pt) | |
|
|
77 |
| [GaitGL(ICCV2021)](https://openaccess.thecvf.com/content/ICCV2021/papers/Lin_Gait_Recognition_via_Effective_Global-Local_Feature_Representation_and_Local_Temporal_ICCV_2021_paper.pdf) | 47.7 | 36.2 | [gaitgl_gait3d_parsing.yaml](../configs/gaitgl/gaitgl_gait3d_parsing.yaml) | 64x44 | [model](https://huggingface.co/opengait/OpenGait/resolve/main/Gait3D-Parsing/GaitGL/GaitGL/checkpoints/GaitGL-180000.pt) | |
|
|
78 |
| [SMPLGait(CVPR 2022)](https://gait3d.github.io/) | 60.6 | 52.3 | [smplgait_gait3d_parsing.yaml](../configs/smplgait/smplgait_gait3d_parsing.yaml) | 64x44 | [model](https://huggingface.co/opengait/OpenGait/resolve/main/Gait3D-Parsing/SMPLGait/SMPLGait/checkpoints/SMPLGait-180000.pt) | |
|
|
79 |
| [GaitBase(CVPR2023)](https://openaccess.thecvf.com/content/CVPR2023/papers/Fan_OpenGait_Revisiting_Gait_Recognition_Towards_Better_Practicality_CVPR_2023_paper.pdf) | 71.2 | 64.1 | [gaitbase_gait3d_parsing_btz32x2_fixed.yaml](../configs/gaitbase/gaitbase_gait3d_parsing_btz32x2_fixed.yaml) | 64x44 | [model](https://huggingface.co/opengait/OpenGait/resolve/main/Gait3D-Parsing/Baseline/GaitBase_btz32x2_fixed/checkpoints/GaitBase_btz32x2_fixed-120000.pt) | |
|
|
80 |
| [ParsingGait(ACMMM2023)](https://arxiv.org/abs/2308.16739) | 76.2 | 68.2 | [parsinggait_gait3d_parsing.yaml](../configs/parsinggait/parsinggait_gait3d_parsing.yaml) | 64x44 | [model](https://huggingface.co/opengait/OpenGait/resolve/main/Gait3D-Parsing/ParsingGait/ParsingGait/checkpoints/ParsingGait-120000.pt) | |
|
|
81 |
|
|
|
82 |
|
|
|
83 |
## [CASIA-E](https://www.scidb.cn/en/detail?dataSetId=57be0e918db743279baf44a38d013a06) |
|
|
84 |
|
|
|
85 |
| Model | `Rank@1.NM` | `Rank@1.BG` | `Rank@1.CL` | Input size| Configuration | |
|
|
86 |
| :-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------: | :---------: | :---------:| :----: | :-------------: | :--------------------------------------------------------------: | |
|
|
87 |
| [GaitSet(AAAI2019)](https://arxiv.org/pdf/1811.06186.pdf) | 82.54 | 75.26 | 62.53 | 64x44 | [gaitset_casiae.yaml](../configs/gaitset/gaitset_casiae.yaml) |
|
|
88 |
| [GaitPart(CVPR2020)](https://openaccess.thecvf.com/content_CVPR_2020/papers/Fan_GaitPart_Temporal_Part-Based_Model_for_Gait_Recognition_CVPR_2020_paper.pdf) | 82.92 | 74.36 | 60.48 | 64x44 | [gaitpart_casiae.yaml](../configs/gaitpart/gaitpart_casiae.yaml) |
|
|
89 |
| [GaitBase(CVPR2023)](https://openaccess.thecvf.com/content/CVPR2023/papers/Fan_OpenGait_Revisiting_Gait_Recognition_Towards_Better_Practicality_CVPR_2023_paper.pdf) | 91.59 | 86.65 | 74.73 | 64x44 | [gaitbase_casiae.yaml](../configs/gaitbase/gaitbase_casiae.yaml) |
|
|
90 |
|
|
|
91 |
------------------------------------------ |
|
|
92 |
|
|
|
93 |
The results in the parentheses are mentioned in the papers. |
|
|
94 |
|
|
|
95 |
**Note**: |
|
|
96 |
- The checkpoint files can be found [here](https://github.com/ShiqiYu/OpenGait/releases). |
|
|
97 |
- [GaitBase](https://openaccess.thecvf.com/content/CVPR2023/papers/Fan_OpenGait_Revisiting_Gait_Recognition_Towards_Better_Practicality_CVPR_2023_paper.pdf) and [DeepGaitV2](https://arxiv.org/pdf/2303.03301.pdf) series are the officially recommended CNN-based baseline models. |
|
|
98 |
- [SwinGait](https://arxiv.org/pdf/2303.03301.pdf) series are the officially recommended Transformer-based baseline models. |
|
|
99 |
- All results exclude identical-view cases in CASIA-B(*) and OUMVLP. |
|
|
100 |
- The shown result of GLN is implemented without the compact block. |
|
|
101 |
- The mAP is calculated by the new evaluation protocol proposed in [A Comprehensive Study on the Evaluation of Silhouette-based Gait Recognition](https://ieeexplore.ieee.org/document/9928336). |