Skip to content

Instantly share code, notes, and snippets.

What would you like to do?
Simple-Train-of-New-Dense-Layers.ipynb not training!
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Copy link

markddesimone commented Dec 9, 2017


So the problem was the learning rate. It was too high. I had to reduce the learning rate to 0.001 or better still 0.0001 to get good results
Here are the 50 iterations with lr=0.001

note the convergence is jumping around
0.0001 give a better result and is overfitting the sample data set as expected:

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment