Skip to content

Instantly share code, notes, and snippets.

View ilyarudyak's full-sized avatar
🏎️
Forza Ferrari!

ilyarudyak

🏎️
Forza Ferrari!
View GitHub Profile
@ilyarudyak
ilyarudyak / grad-vis-long.ipynb
Created January 31, 2022 22:12
Illustration of different gradient descent methods
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@ilyarudyak
ilyarudyak / batch_norm_debugging_v1.ipynb
Last active January 31, 2022 11:55
Deriving gradient for batch norm (cs231n)
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@ilyarudyak
ilyarudyak / embedding_backwards_debug_v1.ipynb
Last active November 4, 2021 10:38
`np.add.at` examples and explanation (based on assignment 3 of cs231n)
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@ilyarudyak
ilyarudyak / conv_nets_debugging_v2_medium.ipynb
Created October 20, 2021 17:28
convolution layer backprop (cs231n assignment2)
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@ilyarudyak
ilyarudyak / softmax.py
Created September 9, 2021 18:22
Gist for medium post "Just another post about grad descend"
from builtins import range
import numpy as np
from random import shuffle
# from past.builtins import xrange
def softmax_loss_naive(W, X, y, reg=0.0):
"""
Softmax loss function, naive implementation (with loops)
@ilyarudyak
ilyarudyak / bias_initializer.ipynb
Created July 8, 2020 13:47
bias_initializer.ipynb
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.