Skip to content

Instantly share code, notes, and snippets.

@abarciauskas-bgse
Last active April 15, 2016 12:33
Show Gist options
  • Save abarciauskas-bgse/aae0039c4190102d75c3608d0be8c29d to your computer and use it in GitHub Desktop.
Save abarciauskas-bgse/aae0039c4190102d75c3608d0be8c29d to your computer and use it in GitHub Desktop.

Visualizing Neural Networks

Though neural networks have been around for a while, I have whittled down the list of players in the game of visualizing them to the following:

Motiviations

  • Little understanding of why neural networks work
    • We have learned that there is some learning going on at intermediate layers, sort of like intermediate classification because of like objects (example of text)
  • Improving performance (Zeiler & Fergus)

By the way these things were achieved

The Players

This is the mostly academic work of

  • Zeiler and Fergus: Deconvnet
  • Jason Yosinski et. al.: DeepVis
  • Andrej Karpathy: A Neural Network Playground

Zeiler and Fergus, Deconvnet, 2014...

...published a paper on visualizing and understanding convolutional networks in 2014, founded in their work deconvolutional networks in 2011

Jason Yosinski, DeepVis, 2015...

...published a paper and open source tool for visualizing a neural network in real time, with an image or camera feed. This builds on deconvnet.

Andrej Karpathy, A Neural Netowrk Playground, 201??

Additional tools

Papers

Visualizations

What is missing?

  • These have been produced from viewpoint of the nn engineer or professor, is there an interest for non comp-sci population to visualize NN?
  • How to improve interactivity
  • Showing how they work
  • multiple dimensions
  • hook up something like A neual network playground thing with something in real time
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment