Skip to content

Instantly share code, notes, and snippets.

View ilyarudyak's full-sized avatar
💻
Data Science Retreat

ilyarudyak

💻
Data Science Retreat
View GitHub Profile
@ilyarudyak
ilyarudyak / adjacent_numbers.ipynb
Created July 2, 2024 17:03
A counterexample to the exercise
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@ilyarudyak
ilyarudyak / grad-vis-long.ipynb
Created January 31, 2022 22:12
Illustration of different gradient descent methods
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@ilyarudyak
ilyarudyak / batch_norm_debugging_v1.ipynb
Last active January 31, 2022 11:55
Deriving gradient for batch norm (cs231n)
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@ilyarudyak
ilyarudyak / embedding_backwards_debug_v1.ipynb
Last active November 4, 2021 10:38
`np.add.at` examples and explanation (based on assignment 3 of cs231n)
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@ilyarudyak
ilyarudyak / conv_nets_debugging_v2_medium.ipynb
Created October 20, 2021 17:28
convolution layer backprop (cs231n assignment2)
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@ilyarudyak
ilyarudyak / softmax.py
Created September 9, 2021 18:22
Gist for medium post "Just another post about grad descend"
from builtins import range
import numpy as np
from random import shuffle
# from past.builtins import xrange
def softmax_loss_naive(W, X, y, reg=0.0):
"""
Softmax loss function, naive implementation (with loops)
@ilyarudyak
ilyarudyak / bias_initializer.ipynb
Created July 8, 2020 13:47
bias_initializer.ipynb
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.