Skip to content

Instantly share code, notes, and snippets.

@gidim
Created June 13, 2017 08:11
Show Gist options
  • Save gidim/0b72def5c03381c312c437bf45e4353f to your computer and use it in GitHub Desktop.
Save gidim/0b72def5c03381c312c437bf45e4353f to your computer and use it in GitHub Desktop.
First network (what you want)
computed(c,d) |targets(c,d) |correct?
---------------------------------------------
0.66 0.33 | 1 0 | yes
0.66 0.33 | 1 0 | yes
0.66 0.33 | 0 1 | no
avg cross-entropy loss:
-(ln(0.66) + ln(0.66) + ln(0.3)) / 3 = 0.678335
Second network (what you said will yield a better network in terms of avg cross entropy)
computed(c,d) |targets(c,d) |correct?
---------------------------------------------
1.0 0.0 | 1 0 | yes
1.0 0.0 | 1 0 | yes
1.0 0.0 | 0 1 | no
avg cross-entropy loss:
-(ln(1) + ln(1) + ln(0.0001)) / 3 = 3.070113
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment