Skip to content

Instantly share code, notes, and snippets.

@JoshVarty
Last active Feb 27, 2018
Embed
What would you like to do?
learning_rate = 0.01 #Some human-chosen learning rate
gradient_for_weight_1 = ... #Compute gradient
weight_1 = weight_1 + (-gradient_for_weight1 * learning_rate) #Technically, the gradient tells us how to INCREASE cost, so we go the opposite direction by negating it
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment