Skip to content

Instantly share code, notes, and snippets.

@eamartin
Last active November 6, 2022 18:53
Show Gist options
  • Star 62 You must be signed in to star a gist
  • Fork 16 You must be signed in to fork a gist
  • Save eamartin/d7f1f71e5ce54112fe05e2f2f17ebedf to your computer and use it in GitHub Desktop.
Save eamartin/d7f1f71e5ce54112fe05e2f2f17ebedf to your computer and use it in GitHub Desktop.
Understanding & Visualizing Self-Normalizing Neural Networks
Display the source blob
Display the rendered blob
Raw
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@wtesler
Copy link

wtesler commented Jul 17, 2017

Awesome

@gklambauer
Copy link

Nice work!

@smoussa
Copy link

smoussa commented Jul 19, 2017

Brilliant :) Very clear.

@gngdb
Copy link

gngdb commented Jul 28, 2017

Was wondering if this also worked for convolutional networks, so added a section to this notebook with a conv2d experiment. It's here: https://gist.github.com/gngdb/a122ae86c0b897cffebdb9481e321c9d

@mschulkind
Copy link

Recall the special property of the activation function is to map ... Var[h] = 0

Don't you mean Var[h] = 1?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment