{{ message }}

Instantly share code, notes, and snippets.

# Tim Vieira timvieira

Last active Jun 12, 2019
Notebook accompanying blog post http://timvieira.github.io/blog/post/2019/06/11/faster-reservoir-sampling-by-waiting/
View Exponential-jumps.ipynb
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Last active Mar 4, 2018
Don't use scipy.special.digamma, if you care about speed.
View Notes-on-scipy.special.digamma.ipynb
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Last active Oct 23, 2020
Automatic differentiation as the method of Lagrange multipliers. Code accompanies this blog post: http://timvieira.github.io/blog/post/2017/08/18/backprop-is-not-just-the-chain-rule/
View lagrangeprop.py
 # -*- coding: utf-8 -*- """ Backprop as the method of Lagrange multiplers (and even the implicit function theorem). """ from __future__ import division import numpy as np from arsenal.alphabet import Alphabet from arsenal.math.checkgrad import finite_difference
Last active Jul 17, 2021
Simple example of manually performing "automatic" differentiation.
View simple-backprop.py
 """ Simple example of manually performing "automatic" differentiation """ import numpy as np from numpy import exp, sin, cos def f(x, with_grad=False): # Need to cache intermediates from forward pass (might not use all of them). a = exp(x)
Last active Aug 22, 2017
View squishing_multiclass.py
 # Efficient passive aggressive updates for multi-class classification # # Original article: # "Column squishing for multiclass updates" # https://nlpers.blogspot.com/2017/08/column-squishing-for-multiclass-updates.html from __future__ import division import numpy as np import scipy.optimize
Created Aug 8, 2017
Memory-efficient backpropagation in an RNN. Accompanies blog post: http://timvieira.github.io/blog/post/2016/10/01/reversing-a-sequence-with-sublinear-space/
View memory-efficient-backprop.py
 """ Memory-efficient backpropagation in an RNN. Accompanies blog post: http://timvieira.github.io/blog/post/2016/10/01/reversing-a-sequence-with-sublinear-space/ """ import numpy as np from arsenal.math.checkgrad import fdcheck
Created Aug 8, 2017
Memory efficient backpropagation thru time in a recurrent neural network. Accompanies blog post: http://timvieira.github.io/blog/post/2016/10/01/reversing-a-sequence-with-sublinear-space/
View memory-efficient-backprop.py
 """ Memory-efficient backpropagation in an RNN. Accompanies blog post: http://timvieira.github.io/blog/post/2016/10/01/reversing-a-sequence-with-sublinear-space/ """ import numpy as np from arsenal.math.checkgrad import fdcheck
Created Feb 18, 2017
Cartoon version of Jiawei's optimization problem.
View jiawei.py
 """ Cartoon version of Jiawei's optimization problem. Created [2017-02-17 Fri] """ import numpy as np from scipy.optimize import fmin_bfgs import autograd
Last active Aug 19, 2021
Counterfactual reasoning demo. Accompanies blog post "Counterfactual reasoning and learning from logged data" http://timvieira.github.io/blog/post/2016/12/19/counterfactual-reasoning-and-learning-from-logged-data/
View counterfactual-demo.ipynb