Skip to content

Instantly share code, notes, and snippets.

@jeremy886
Created August 27, 2017 05:46
Show Gist options
  • Save jeremy886/1e4312224787a870eabb624356ef045b to your computer and use it in GitHub Desktop.
Save jeremy886/1e4312224787a870eabb624356ef045b to your computer and use it in GitHub Desktop.
deep learning equation
\begin{align*}
\frac{dL}{dz^{[1]}} = & \frac{dL}{da^{[1]}} \times \frac{da^{[1]}}{dz^{[1]}} \\
& = \frac{dz^{[2]}}{da^{[1]}} \frac{dL}{dz^{[2]}} \times \frac{da^{[1]}}{dz^{[1]}} \\
& = \frac{d(W^{[2]}{^T}a^{[1]})}{d a^{[1]}} {\bf dz^{[2]}} \times \frac{da^{[1]}}{dz^{[1]}} \\
& = W^{[2]}{^T} {\bf dz^{[2]}} \times \frac{da^{[1]}}{dz^{[1]}} \\
& = \frac{W^{[2]}{^T}}{dz^{[2]}} \times \frac{d}{dz^{[1]}}g^{[1]}(z^{[1]}) \\
& = \frac{W^{[2]}{^T}}{dz^{[2]}} \times g^{[1]}{'}(z^{[1]})
\end{align*}
@jeremy886
Copy link
Author

image

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment