Skip to content

Instantly share code, notes, and snippets.

@JoshVarty
Last active February 27, 2018 05:38
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save JoshVarty/dd467347a2e742cf263fdb938c5a49e0 to your computer and use it in GitHub Desktop.
Save JoshVarty/dd467347a2e742cf263fdb938c5a49e0 to your computer and use it in GitHub Desktop.
learning_rate = 0.01 #Some human-chosen learning rate
gradient_for_weight_1 = ... #Compute gradient
weight_1 = weight_1 + (-gradient_for_weight1 * learning_rate) #Technically, the gradient tells us how to INCREASE cost, so we go the opposite direction by negating it
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment