Skip to content

Instantly share code, notes, and snippets.

@dblalock
Last active June 14, 2023 16:32
Show Gist options
  • Star 1 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save dblalock/a9011b1a0bf533d75b53f466e09946d2 to your computer and use it in GitHub Desktop.
Save dblalock/a9011b1a0bf533d75b53f466e09946d2 to your computer and use it in GitHub Desktop.
Machine learning papers/articles that combine many small improvements together

Papers

Revisiting ResNets: Improved Training and Scaling Strategies

Bello, Irwan, William Fedus, Xianzhi Du, Ekin D. Cubuk, Aravind Srinivas, Tsung-Yi Lin, Jonathon Shlens, and Barret Zoph. "Revisiting resnets: Improved training and scaling strategies." arXiv preprint arXiv:2103.07579 (2021).

@article{bello2021revisiting,
  title={Revisiting resnets: Improved training and scaling strategies},
  author={Bello, Irwan and Fedus, William and Du, Xianzhi and Cubuk, Ekin D and Srinivas, Aravind and Lin, Tsung-Yi and Shlens, Jonathon and Zoph, Barret},
  journal={arXiv preprint arXiv:2103.07579},
  year={2021}
}

Compounding the Performance Improvements of Assembled Techniques in a Convolutional Neural Network

Lee, Jungkyu, Taeryun Won, Tae Kwan Lee, Hyemin Lee, Geonmo Gu, and Kiho Hong. "Compounding the performance improvements of assembled techniques in a convolutional neural network." arXiv preprint arXiv:2001.06268 (2020).

@article{lee2020compounding,
  title={Compounding the performance improvements of assembled techniques in a convolutional neural network},
  author={Lee, Jungkyu and Won, Taeryun and Lee, Tae Kwan and Lee, Hyemin and Gu, Geonmo and Hong, Kiho},
  journal={arXiv preprint arXiv:2001.06268},
  year={2020}
}

Bag of tricks for image classification

He, Tong, Zhi Zhang, Hang Zhang, Zhongyue Zhang, Junyuan Xie, and Mu Li. "Bag of tricks for image classification with convolutional neural networks." In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 558-567. 2019.

@inproceedings{he2019bag,
  title={Bag of tricks for image classification with convolutional neural networks},
  author={He, Tong and Zhang, Zhi and Zhang, Hang and Zhang, Zhongyue and Xie, Junyuan and Li, Mu},
  booktitle={Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition},
  pages={558--567},
  year={2019}
}

Bag of freebies for training object detection neural networks

Zhang, Zhi, Tong He, Hang Zhang, Zhongyue Zhang, Junyuan Xie, and Mu Li. "Bag of freebies for training object detection neural networks." arXiv preprint arXiv:1902.04103 (2019).

  title={Bag of freebies for training object detection neural networks},
  author={Zhang, Zhi and He, Tong and Zhang, Hang and Zhang, Zhongyue and Xie, Junyuan and Li, Mu},
  journal={arXiv preprint arXiv:1902.04103},
  year={2019}
}

Bag of tricks and a strong baseline for deep person re-identification

Luo, Hao, Youzhi Gu, Xingyu Liao, Shenqi Lai, and Wei Jiang. "Bag of tricks and a strong baseline for deep person re-identification." In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, pp. 0-0. 2019.

  title={Bag of tricks and a strong baseline for deep person re-identification},
  author={Luo, Hao and Gu, Youzhi and Liao, Xingyu and Lai, Shenqi and Jiang, Wei},
  booktitle={Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops},
  pages={0--0},
  year={2019}
}

Yolov4: Optimal speed and accuracy of object detection

Bochkovskiy, Alexey, Chien-Yao Wang, and Hong-Yuan Mark Liao. "Yolov4: Optimal speed and accuracy of object detection." arXiv preprint arXiv:2004.10934 (2020).

  title={Yolov4: Optimal speed and accuracy of object detection},
  author={Bochkovskiy, Alexey and Wang, Chien-Yao and Liao, Hong-Yuan Mark},
  journal={arXiv preprint arXiv:2004.10934},
  year={2020}
}

Bag of Tricks for Optimizing Transformer Efficiency

Lin, Ye, Yanyang Li, Tong Xiao, and Jingbo Zhu. "Bag of Tricks for Optimizing Transformer Efficiency." arXiv preprint arXiv:2109.04030 (2021).

  title={Bag of Tricks for Optimizing Transformer Efficiency},
  author={Lin, Ye and Li, Yanyang and Xiao, Tong and Zhu, Jingbo},
  journal={arXiv preprint arXiv:2109.04030},
  year={2021}
}

Blog posts

Now anyone can train Imagenet in 18 minutes

How to Train Your ResNet 8: Bag of Tricks

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment