Skip to content

Instantly share code, notes, and snippets.

@szrxiao
Last active November 22, 2017 07:01
Show Gist options
  • Save szrxiao/69c05e11a834480ece5c2a8f4e0f5b8d to your computer and use it in GitHub Desktop.
Save szrxiao/69c05e11a834480ece5c2a8f4e0f5b8d to your computer and use it in GitHub Desktop.
voc20 baselines
## ZF
| IOU | MAP | Th@0.8 | Prec@0.8 | Rec@0.8 | Th@0.9 | Prec@0.9 | Rec@0.9 | Th@0.95 | Prec@0.95 | Rec@0.95 |
| :-- | :----: | :----: | :------: | :-----: | :----: | :------: | :-----: | :-----: | :-------: | :------: |
| 0.3 | 0.7018 | 0.7302 | 0.8001 | 0.6708 | 0.9111 | 0.9001 | 0.5757 | 0.9704 | 0.9501 | 0.4715 |
| 0.4 | 0.6693 | 0.7833 | 0.8001 | 0.6362 | 0.9359 | 0.9001 | 0.5345 | 0.981 | 0.9501 | 0.4205 |
| 0.5 | 0.6114 | 0.8611 | 0.8001 | 0.5695 | 0.9721 | 0.9 | 0.44 | 0.9934 | 0.9502 | 0.3044 |
## Resnet 18bn
| IOU | MAP | Th@0.8 | Prec@0.8 | Rec@0.8 | Th@0.9 | Prec@0.9 | Rec@0.9 | Th@0.95 | Prec@0.95 | Rec@0.95 |
| :-- | :----: | :----: | :------: | :-----: | :----: | :------: | :-----: | :-----: | :-------: | :------: |
| 0.3 | 0.7416 | 0.6899 | 0.8 | 0.7202 | 0.8991 | 0.9 | 0.6346 | 0.9686 | 0.95 | 0.5358 |
| 0.4 | 0.7157 | 0.7343 | 0.8001 | 0.6965 | 0.9251 | 0.9 | 0.6009 | 0.9795 | 0.95 | 0.4915 |
| 0.5 | 0.6625 | 0.8223 | 0.8 | 0.6378 | 0.9628 | 0.9001 | 0.5263 | 0.992 | 0.95 | 0.3918 |
## Resnet 18
## Resnet 18
Results on overall objects (12032)
| IOU | MAP | Th@0.8 | Prec@0.8 | Rec@0.8 | Th@0.9 | Prec@0.9 | Rec@0.9 | Th@0.95 | Prec@0.95 | Rec@0.95 |
| :-- | :----: | :----: | :------: | :-----: | :----: | :------: | :-----: | :-----: | :-------: | :------: |
| 0.3 | 0.7571 | 0.7273 | 0.8 | 0.7335 | 0.9073 | 0.9 | 0.6426 | 0.9668 | 0.9501 | 0.544 |
| 0.4 | 0.7305 | 0.771 | 0.8001 | 0.7027 | 0.9281 | 0.9001 | 0.6116 | 0.9789 | 0.95 | 0.4851 |
| 0.5 | 0.6749 | 0.8459 | 0.8 | 0.6437 | 0.9623 | 0.9001 | 0.533 | 0.9904 | 0.9501 | 0.3833 |
## Resnet 34
| IOU | MAP | Th@0.8 | Prec@0.8 | Rec@0.8 | Th@0.9 | Prec@0.9 | Rec@0.9 | Th@0.95 | Prec@0.95 | Rec@0.95 |
| :-- | :----: | :----: | :------: | :-----: | :----: | :------: | :-----: | :-----: | :-------: | :------: |
| 0.3 | 0.777 | 0.6468 | 0.8 | 0.7811 | 0.9077 | 0.9001 | 0.7173 | 0.9786 | 0.95 | 0.6307 |
| 0.4 | 0.7564 | 0.6954 | 0.8001 | 0.7609 | 0.9332 | 0.9 | 0.6907 | 0.9881 | 0.9501 | 0.5757 |
| 0.5 | 0.7111 | 0.7948 | 0.8001 | 0.7141 | 0.9715 | 0.9001 | 0.6228 | 0.9956 | 0.9501 | 0.4761 |
## Resnet 50
| IOU | MAP | Th@0.8 | Prec@0.8 | Rec@0.8 | Th@0.9 | Prec@0.9 | Rec@0.9 | Th@0.95 | Prec@0.95 | Rec@0.95 |
| :-- | :----: | :----: | :------: | :-----: | :----: | :------: | :-----: | :-----: | :-------: | :------: |
| 0.3 | 0.7806 | 0.7097 | 0.8 | 0.7744 | 0.9255 | 0.9001 | 0.6923 | 0.9761 | 0.95 | 0.6083 |
| 0.4 | 0.7574 | 0.76 | 0.8 | 0.7492 | 0.9435 | 0.9001 | 0.6656 | 0.9852 | 0.95 | 0.5623 |
| 0.5 | 0.7082 | 0.8497 | 0.8 | 0.6912 | 0.9718 | 0.9 | 0.5957 | 0.9938 | 0.9501 | 0.465 |
## Resnet 101
| IOU | MAP | Th@0.8 | Prec@0.8 | Rec@0.8 | Th@0.9 | Prec@0.9 | Rec@0.9 | Th@0.95 | Prec@0.95 | Rec@0.95 |
| :-- | :----: | :----: | :------: | :-----: | :----: | :------: | :-----: | :-----: | :-------: | :------: |
| 0.3 | 0.7761 | 0.5936 | 0.8001 | 0.7835 | 0.9158 | 0.9 | 0.7243 | 0.9829 | 0.95 | 0.6462 |
| 0.4 | 0.7556 | 0.6571 | 0.8001 | 0.7632 | 0.9444 | 0.9001 | 0.6968 | 0.9904 | 0.95 | 0.6005 |
| 0.5 | 0.7062 | 0.7898 | 0.8 | 0.7165 | 0.9794 | 0.9 | 0.627 | 0.9973 | 0.95 | 0.4802 |
@szrxiao
Copy link
Author

szrxiao commented Nov 22, 2017

FPN2 (new anchors)

stage6 truth.w*truth.h >= 0.05, anchors 4x4 5x10 10x5 10x10
Results on small objects (567)

IOU MAP Th@0.8 Prec@0.8 Rec@0.8 Th@0.9 Prec@0.9 Rec@0.9
0.3 0.0 0.9694 1.0 0.0 0.9694 1.0 0.0
0.5 0.0 0.9694 1.0 0.0 0.9694 1.0 0.0

Results on large objects (7641)

IOU MAP Th@0.8 Prec@0.8 Rec@0.8 Th@0.9 Prec@0.9 Rec@0.9
0.3 0.8289 0.2086 0.8001 0.8279 0.3717 0.9 0.7578
0.5 0.7713 0.265 0.8 0.7718 0.4782 0.9001 0.6824

Results on medium objects (3824)

IOU MAP Th@0.8 Prec@0.8 Rec@0.8 Th@0.9 Prec@0.9 Rec@0.9
0.3 0.0293 0.9694 1.0 0.0 0.9694 1.0 0.0
0.5 0.0078 0.9694 1.0 0.0 0.9694 1.0 0.0

Results on overall objects (12032)

IOU MAP Th@0.8 Prec@0.8 Rec@0.8 Th@0.9 Prec@0.9 Rec@0.9
0.3 0.6182 0.2029 0.8 0.5447 0.3695 0.9001 0.4918
0.5 0.5604 0.2588 0.8001 0.5012 0.4756 0.9001 0.4387

stage5 truth.w*truth.h<0.05 anchors 2x2 3x6 6x3 6x6
Results on small objects (567)

IOU MAP Th@0.8 Prec@0.8 Rec@0.8 Th@0.9 Prec@0.9 Rec@0.9
0.3 0.093 0.889 1.0 0.0 0.889 1.0 0.0
0.5 0.0401 0.9482 1.0 0.0 0.9482 1.0 0.0

Results on large objects (7641)

IOU MAP Th@0.8 Prec@0.8 Rec@0.8 Th@0.9 Prec@0.9 Rec@0.9
0.3 0.1083 0.6101 0.8013 0.0311 0.7439 0.9007 0.0178
0.5 0.0627 0.7534 0.8025 0.0165 0.7958 0.902 0.012

Results on medium objects (3824)

IOU MAP Th@0.8 Prec@0.8 Rec@0.8 Th@0.9 Prec@0.9 Rec@0.9
0.3 0.4349 0.3916 0.8002 0.4116 0.5362 0.9003 0.2858
0.5 0.3272 0.5465 0.8002 0.2576 0.704 0.9002 0.1344

Results on overall objects (12032)

IOU MAP Th@0.8 Prec@0.8 Rec@0.8 Th@0.9 Prec@0.9 Rec@0.9
0.3 0.2686 0.3357 0.8001 0.2083 0.4796 0.9001 0.143
0.5 0.1888 0.4879 0.8002 0.1258 0.6606 0.9006 0.0693

overall

Results on small objects (567)

IOU MAP Th@0.8 Prec@0.8 Rec@0.8 Th@0.9 Prec@0.9 Rec@0.9
0.3 0.0611 0.9694 1.0 0.0 0.9694 1.0 0.0
0.5 0.025 0.9694 1.0 0.0 0.9694 1.0 0.0

Results on large objects (7641)

IOU MAP Th@0.8 Prec@0.8 Rec@0.8 Th@0.9 Prec@0.9 Rec@0.9
0.3 0.806 0.3111 0.8001 0.8087 0.4551 0.9001 0.7419
0.5 0.7454 0.4015 0.8001 0.7385 0.5713 0.9 0.648

Results on medium objects (3824)

IOU MAP Th@0.8 Prec@0.8 Rec@0.8 Th@0.9 Prec@0.9 Rec@0.9
0.3 0.3457 0.5893 0.8002 0.2471 0.796 0.9006 0.0758
0.5 0.2398 0.7961 0.8011 0.0748 0.976 1.0 0.0003

Results on overall objects (12032)

IOU MAP Th@0.8 Prec@0.8 Rec@0.8 Th@0.9 Prec@0.9 Rec@0.9
0.3 0.7569 0.277 0.8001 0.7064 0.4215 0.9 0.6159
0.5 0.6801 0.3519 0.8001 0.6197 0.5348 0.9001 0.5158

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment