While working as a Postdoc I've written code contributing to other projects:
- Contributed a pull request to "SMPL-X: A new joint 3D model of the human body, face and hands together" to make the transfer utilities work
- Written a reference implementation for PCA in Pytorch that operates identically to the Scikit-learn implementation
- Partial replication of "VPoser: Variational Human Pose Prior for Body Inverse Kinematics"
- Contributed pull request to modularize "Monocular, One-stage, Regression of Multiple 3D People"
- Added video processing to a Pytorch replication of OpenPose
- Created a minimal wrapper for
scipy.optimize.minimizeto use it as a PyTorch Optimizer
While doing my PhD, I've written code replicating other papers or contributing to other projects:
- Collaborated on the code for "Moonshine: Distilling with Cheap Convolutions"
- Replication of "Variational Dropout and the Local Reparameterization Trick"
- Replication of "Variational Dropout Sparsifies Deep Neural Networks"
- Replication of "The Shattered Gradients Problem: If resnets are the answer, then what is the question?".
- Replication of "SGDR: Stochastic Gradient Descent with Warm Restarts" (predating its inclusion in PyTorch)
- Replication of "Adaptive dropout for training deep neural networks"
- Replication of "Hyperband: A Novel Bandit-Based Approach to Hyperparameter Optimization"
- Contributed code speeding up an implementation of relational networks by 10 times and later reviewed the pull request to add it to pytorch, which was never merged. Much later wrote a minimal implementation using einops here with tests written using nbdev.
- Replication of "ACDC: A Structured Efficient Linear Layer"
- A PyTorch interface to load ImageNet disk-sequentially.
- A way to use Autograd inside Tensorflow
- Notes showing relational networks can be used for few-shot learning (didn't follow this up, but later found it would have been concurrent with "Learning to Compare: Relation Network for Few-Shot Learning")
- A JupyterHub deployment for a University of Edinburgh course Data, Design and Society
- Contributed to Neuroglycerin's entries to the AES seizure prediction competition and the first National Data Science Bowl
- A tutorial on Black Box Stochastic Variational Inference for a postgrad study group
- Ordered discrete distributions with nested Gumbel-softmaxes