Skip to content

Instantly share code, notes, and snippets.

Last active February 27, 2018 05:38
What would you like to do?
learning_rate = 0.01 #Some human-chosen learning rate
gradient_for_weight_1 = ... #Compute gradient
weight_1 = weight_1 + (-gradient_for_weight1 * learning_rate) #Technically, the gradient tells us how to INCREASE cost, so we go the opposite direction by negating it
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment