Skip to content

Instantly share code, notes, and snippets.

@sholland1
Last active February 21, 2018 03:24
Show Gist options
  • Save sholland1/e4c9047ea683f4bf8dbc6516006f85ad to your computer and use it in GitHub Desktop.
Save sholland1/e4c9047ea683f4bf8dbc6516006f85ad to your computer and use it in GitHub Desktop.
grenade example results
$~/Documents/grenade/examples/dist/build/gan-mnist$ ./gan-mnist ~/Downloads/mnist_train.csv
Training stupidly simply GAN
-#= ##-##### # # # # # #=##.
--# = # # # # # # # # # # #
# # # # # # # # # # # # #.#
- = # - # # .-
# # # # # # # # # ##### #
# # # # ## # # #.##
# # # # # # # # # # # # = #
# = ### # # ## # # # #
# # # # # # # # # # #.==# #
# = # ### # #.# ##= ####
# # # # # # # # # # # # = #
# # ### ##-####
# # # # # # # # # # # # # #
- = # # - # # ## ## # ###=
# # # # # # # # # # # # # #
= - # # # ### ### # # #.##
#-# # # # # # # # # # # # #
# # # = # ### ## ### # .#
# # # # # # # # # # # # # #
# # # ## =### -## ####
# # # # # # # # # # # ### #
# # # ### # # #. .### ##.-
# # # # # # # # # # #.# =
.# # ### # ######### -#.##
# # - # # # # - # # # #
# # -######## # # ###-# ##
.# # # # . # # # # .=# #
# ##### # # # #.-## # #=#=.
.==-==.####.==.-==-=-#-#-=.=
.-. = # #-# -##.-=# #.#.-===
#-#.#.= # # #.- #.#.=-=
-. . . # . .## .##-=#-=
. = # # # . # # # #.#=#-#
- - # ##= ## ###=#######=
# - # # # # # # # = # #=#-#
- = ..-### ### ##########==
= # # # # # # # # # #######
- ####= ###.############
.= # # # # # # # # # # ...=#
. .#-##-########## ####-###
# = . # # # # #.# # # =##.#
-===#=### ### ############
# # # # # # # ## # # #=#==
# -- ####.##=#### ########
. . # # # # #=# # #-#=#-=
= . =-###.##############-#
# # # # # # # # # # ##### #
=. ################=########
. # # # #=# = # # # #####==
=.######### ####=##=###=#
=- # # #.# # . # # # ###=#==
== ###-# ##### ############-
.- - - #=# = = = ####-#-==
--###########.###=###==##--
# - . . #=# # = - =---#.=-=
#-#=#-#-###.#######=#-#=---
--=.-...=.= =-. -#..--=-===-
--... = =-= ---.=-=.-.#-
-=. . =.=-- ## =##..== =--=
-- . #- .#= .-= .=--
-- . #-= =--.##--=-=-
. # . .# =-. .#=.###=
.- = ###=##= ###==##=##-=
#. #### ###-##=#####
-- # . -.# --=.######=-
. # ### ### ###-=##=
-. =. ## ### ### ###=##-#
- # ##- ###=###-######==
. - # -##- ##. #######=
. ## ###= ##==### ####
= .#. #=#-### ###.### ####
.. = #=#-###- #.# ###=-#==
- .=- =#- ## #= #=#=##=#
. # ###=#= #. ######--
.= ==- =###-##-.##########-#
. . ###-###= ###.#####-##
.. . =###.## ############=
.= . #.##=#### ###=####
=-.#= ##. ##= ##=#########=
-- == =#..##. ############=
--. #-=#################=
...-..-###-### ########=#--=
---= ##-.=#- ##. #=--=#==#--
-=.=-###-###=### ###-#=#----
-------.---.-.= =.-.--------
------..-...-.. ..-.-.-.----
-------.--. ... .=.--==--=--
--.... . - -==--=--
--... . . . .-=#-=#==
--... . . --# =##.-=#=
--...- .-=. === ###.###-##=#
-. . - =## #=#.###.=###
.. . #-. #.# ###.=##=
.. = #=. #-# ###.###=
-- =- ##. ###.###.###=##=#
. #.= ###-###=###=####
.. .# ##= #.# ######==
.. =-= ##..### ######==
-- -- ###.################
. . ###=###=############
. ##=-### ###=######==
-###-##..###=###=##==
-. - =###-##############==
- ==. ###################==
.. . .--###.##############=-
-- =.-.###=-###=#######=#==-
.-.-.-.-#=##############====
-- =--.################====-
--.--.=-##=###########=====-
--.=--=##############=====--
-------======-=#=-===--=----
---=---#=#-#=#-#==-==-------
---.--...-..-...------------
------..--....-.-------.----
---.---.-.. --..---.-==-----
--........ .....--.-==--=--
-.... -. .-=-===-
...... . .-= -==.===-
--. .. -.. =#-.=#=-=##==#==
-..... -. #=-.###=#######=
-- ==. -=# ###==##=
-- . ##= ###.###-###=
-- =. ==- ###.###=########
.. #=.-################
.. -.. ###.###-########
-. =#- ###-###-#######=
-- . ##=-##############==
-. . -###################=
. . #==-###=##########==
. . ##--###-##########==
-- .- =##################==
-. -=..####################=
-....--###################==
...----################=##==
--.-=.-##==###############=-
----=--###=#############====
--.----=#==#############==--
-------##=-###=#######====--
------==================-=--
-------=====-==========-----
---.........---...-..-------
--......-...---..--.--------
--......---.---.---..----=--
--......-...---.---.-==--==-
-. .. .. ..- -==--===
-- . --. .-. .==.=##-===-
-- .. ==-.##-.##=.=##==#==
-. -. .==-.#==-###-####=#==
-. -.. -=..=##.####=#==
-. .. ==..##=.###-###=##==
-- -. ##=.###=##########==
-. .-. -###=##############==
-. . #=--##############==
-. .. ##=-###=###=######=-
-- .-. .##=-###=##########==
-. .-. -##==##############==
-. .. ##==############=#==
-. .-. .##=-###=#######==#=-
--..=. -################=#==
-- .-. =###############=====
-..... -###############=====
..... .-##########==###====-
--.---.=##########==###===--
--.----###########===#====--
--.----=######=======#====--
-------###=##==========-=---
------==================----
------========--==-===------
------..-........-----------
------..-....-..------------
------..--..--..------------
-----...-...---.-==--==-----
---... . ... -=-.-==-----
-----. .-. -=-.=#=-===-----
--..-. .=- ##=-##=-=#=--=--
--.--. .=-..###=###==#==-=--
--... . =#=-###-=#=--=--
--.... -...###-###-=#=--=--
--..-. .#=--###=###=##====--
--..-. -#==########=###====-
-. .. =---##=-###-=#==-=--
-. .-. .#=--##=-###-##=-==--
--..-. .##=-###=###=###====-
-...-..-##==#######=###====-
-. . .===-##=-###=###===--
-. .....###=##=-###=###===--
--..-..-#######=#######===--
-...=--################===--
--.--.-=#######=###=##====--
--.----=######==###=##=-=---
--.-=-==######==##======----
----===#######===#=====-----
------==##============------
-------========-=====-------
-------=======--------------
-------=====----------------
----------..-...------------
----------.---..------------
----------..--..------------
------.---.---.------=------
-----..... .. .-..--------
------..-. .--..==---=------
------..-- .==.-=#=====-----
------.-=-.-##==##=====-----
--.-.. ... .==--##====------
--.--. .-. -##==##=-==------
--.--. .=-.=#######===------
--.--..-#=-########===------
--.... .=-.=######==--------
--.--. -##=#######=---------
--..-. -##=#######=---------
--.---.=##########=---------
--..-. -#######===----------
--.---.=#######===----------
--.-=--########===----------
--.-===########===----------
--.---=#######====----------
----===####====-=-----------
----===####====-------------
---====###====--------------
----=========---------------
-----======-----------------
----------------------------
----------------------------
----------..-...------------
----------..--..------------
----------..--..------------
------.---..--.--=----------
-----..... .. ---.--------
------.... --..==-.--------
------..-. ==..=#=--=------
------..-- .##-=##=-==------
--.... . =-..=#----------
--.... .-. .##=-##=--=------
--..-. =- -##==##=-==------
--..-. -#=-#######====------
--... -- -###=##=---------
--.... .=#-=###=##=---------
-- .-. .##=#######=-=-------
--..--.=##########=---------
-. ... -##=#######=---------
-- .--.=#######=##=---------
--..---###########=---------
--.-===########=#==---------
--.---=#######====----------
--.-===#######=-==----------
----===######====-----------
---====####====-------------
----==========--------------
----=======-----------------
-----======-----------------
-----====-------------------
-----------.-...------------
----------..--..------------
----------..-...------------
----------..--..-=---=------
------.... .. -----=------
------.... ....===-==------
------.... .-..=#====------
------ .-. .==-=###===------
--.... .-.-###===------
--.... .. =#==###===------
--.... .. .########==------
--..-. .-- =#######===------
--... .. -#######===------
--.... -=.=#######==-------
--.... .-=-########==-------
--.... -##=########---------
--.... .=#=#######=---------
--.... -##########=---------
--.-.-.=##########=---------
--.---.##########==---------
--.-.-.=########==----------
--.----########===----------
-----==########==-----------
-----==#######==------------
------=========-------------
-----==========-------------
-------=====----------------
-------====-----------------
-----------......-----------
----------......------------
----------......-----=------
----------......-=-===------
------.... -======-----
------.... .=#=====-----
------... . -######=-----
------.. .--#######=-----
-----. --#######=-----
-----. -########==-----
----.. =########==-----
----.. -########==------
--... -########==------
--.. ..########==-------
--.. --########==-------
--.. .=#########=--------
--.. .=########==--------
--.. .=#########=---------
--.. . -=########==---------
-......=#########=----------
-......=########==----------
-....--########==-----------
--.---=#######==------------
--.--==######==-------------
-----=========--------------
-----========---------------
------======----------------
------=====-----------------
-------------....-----------
------------....------------
----------......---===------
----------......-=====------
--------.. .-======-----
-------... ..-=####==-----
------... ..=######==----
------... .--#######=-----
------. -=#######=-----
-----. .#########=-----
-----. -#########=-----
----.. -#########==-----
----.. -########==------
----. .#########==------
---.. ..#########==------
--.. .==########==-------
--.. .==########==-------
--.. .-##########=--------
--.. . -=#########==--------
--.....=##########=---------
--.....==########==---------
--...--#########===---------
--.-.--########===----------
-----==########==-----------
------====#=====------------
-----==========-------------
------=======---------------
------======----------------
-------------...------------
------------....------------
----------......---===------
----------......-=====------
--------.. .-==#====----
--------.. ..-=###====----
------... ..=######==----
------... .-=#######==----
------. -=#######==----
-----. -#########=-----
-----. .=#########=-----
----.. -#########==-----
----.. =#########==-----
----. .#########==------
---.. .-#########==------
--.. .=##########==------
--.. .=#########==-------
--.. .-##########==-------
--.. . -=#########==--------
--.. ..=##########==--------
--.....==########==---------
-....--#########===---------
--.-.-=########===----------
-----==########==-----------
------==========------------
-----==========-------------
------=======---------------
------======----------------
-------------....-----------
------------....-----=------
-----------.....---===------
----------......-=====------
---------.. .-==#====----
--------.. ..-=####==-----
-------.. ..=######==----
------... -=#######=-----
------.. -=#######=-----
------.. .########==-----
-----.. .-########==-----
-----. -#########=------
----.. -########==------
----.. .#########==------
----. .-#########==------
---. -#########==-------
--.. -#########=--------
--.. .-##########=--------
--.. . .-#########==--------
--.. ..-=#########=---------
--.....==########==---------
--...--=########===---------
--.-.--=########==----------
------=########==-----------
------====##====------------
-----==========-------------
------========--------------
------=======---------------
-------------...------------
------------....---=-=------
-----------.....---===------
----------......-=====------
---------.. ..-###===-----
--------.. ..==####==-----
-------.. .-#######==----
-------.. -=#######=-----
------.. -########=-----
------.. .########==-----
-----.. .=########==-----
-----. -#########=------
----.. =########==------
----.. .#########==------
----. .-#########==------
---. -#########==-------
--.. =#########=--------
--.. .-#########==--------
--.. . --#########==--------
--.. ..-#########==---------
--.....==########==---------
--...--=########==----------
--.-.--=#######===----------
------=########==-----------
------====#=====------------
-----==========-------------
------=======---------------
------=======---------------
$~/Documents/grenade/examples/dist/build/mnist$ ./mnist ~/Downloads/mnist_train.csv ~/Downloads/mnist_test.csv
Training convolutional neural network...
Reshape
~>
Concat
Trivial
Concat
Pad
~>
### | # | # | |
### | | # | . |
### | | # | | .-
~>
NNil
Pad
~>
| ### | | # | - .# | | | ## |
# | ## | | # | .- ## | #= | | |
# | #= | . | # | ## | = | | |
- | # | | # | - ### | -- | | |
=# | | | ## | #### | | | |
~>
NNil
~>
NNil
~>
Pooling
~>
Relu
~>
Concat
| |
Concat
Pad
~>
-- | | . | #. | . =
| . - | - | - | .
= | | | | .-
~>
NNil
Pad
~>
- | - = | - | # .. | . ==- | -= - | = | - = | -= | =.-
. -.- | .. | .. - | - . | . . | | -#= | | | .=
| . | = | - - | . . | . | =-# | = = | . - - | - -
. | . | = =- | | . | = . | .###. | - | - . | =-
== | . = | . .. | -= | .. . | | -### | -- | ##= | - .
~>
NNil
~>
NNil
~>
Crop
~>
Pooling
~>
Relu
~>
Reshape
~>
FullyConnected
~>
Logit
~>
NNil
~>
FullyConnected
~>
Logit
~>
NNil
~>
NNil
Iteration 1: 5702 of 10000
Reshape
~>
Concat
Trivial
Concat
Pad
~>
| = | # | |
| | # | . |
| | # | | -
~>
NNil
Pad
~>
| ## | | | # # | | | -# |
| ## | | | # | =- | | |
| #= | . | | | - | | |
| # | | # | # - | .- | | |
- | | | # | #=- | | | |
~>
NNil
~>
NNil
~>
Pooling
~>
Relu
~>
Concat
| |
Concat
Pad
~>
-- | | | = | . -
| . | | - |
- | | | | .
~>
NNil
Pad
~>
- | - # | - | # .. | . --. | -- . | = | - - | -= | - .
. ... | -- | . | . . | . . | | .=- | | | --
| . | - | . . | . | . | =.= | - - | . . - | - -
. | - | - -- | | . | - . | .### | - | . | =.
-- | . # | . .. | .- | .. | | -### | .- | ==- | .
~>
NNil
~>
NNil
~>
Crop
~>
Pooling
~>
Relu
~>
Reshape
~>
FullyConnected
~>
Logit
~>
NNil
~>
FullyConnected
~>
Logit
~>
NNil
~>
NNil
Iteration 2: 5533 of 10000
Reshape
~>
Concat
Trivial
Concat
Pad
~>
| = | .# | |
| | # | |
| | # | | -
~>
NNil
Pad
~>
| ## | | = | # = | | | =# |
| ## | | | # | -. | | |
| # | | | # | . | | |
| | | - | # | .. | | |
| | | | ##. | | | |
~>
NNil
~>
NNil
~>
Pooling
~>
Relu
~>
Concat
| |
Concat
Pad
~>
-- | | . | .. | .
| . | | - |
- | | | | .
~>
NNil
Pad
~>
. | - = | - . | = . | . -. | .- . | #.. | . - | .. | - .
. . | -- | . . | . | . | | .## | | | -.
| .. | - | . . | . | | .=.= | - | . | = .
. | -. | -.-- | | | - | ###. | | | =.
.- | . # | - -- | . | . | | .### | .. | --. | .
~>
NNil
~>
NNil
~>
Crop
~>
Pooling
~>
Relu
~>
Reshape
~>
FullyConnected
~>
Logit
~>
NNil
~>
FullyConnected
~>
Logit
~>
NNil
~>
NNil
Iteration 3: 5167 of 10000
Reshape
~>
Concat
Trivial
Concat
Pad
~>
| = | . | |
| | | |
| | | | .
~>
NNil
Pad
~>
| ## | | # | # = | | | =# |
| ## | | | # | -. | | |
| ## | | | # | . | | |
| ## | | . | ## | .. | | |
| # | | | .## # | | | |
~>
NNil
~>
NNil
~>
Pooling
~>
Relu
~>
Concat
| |
Concat
Pad
~>
.- | | | . |
| . | | = |
- | | | . |
~>
NNil
Pad
~>
. | . - | - | = | .. | .. . | -.. | . . | . | - .
. . | .. | . | . | | | =- | | | -.
| .. | | . . | . | | =.= | . | | = .
| .. | =--. | | | . | =##. | | | =.
.. | # | - .. | . | | | ### | .. | ... | .
~>
NNil
~>
NNil
~>
Crop
~>
Pooling
~>
Relu
~>
Reshape
~>
FullyConnected
~>
Logit
~>
NNil
~>
FullyConnected
~>
Logit
~>
NNil
~>
NNil
Iteration 4: 4119 of 10000
Reshape
~>
Concat
Trivial
Concat
Pad
~>
| - | . | |
| | | |
| | | | .
~>
NNil
Pad
~>
| ## | | # | # = | | | -= |
| ## | | | # | . | | |
| ## | | | = | . | | |
| ## | | . | ## | .. | | |
| # | | | .## = | | | |
~>
NNil
~>
NNil
~>
Pooling
~>
Relu
~>
Concat
| |
Concat
Pad
~>
.. | | | . |
| . | | - |
- | | | |
~>
NNil
Pad
~>
. | . - | - | - | .. | .. . | - . | . . | . | -
. | .. | . | | | | =- | | | -.
| . | | . | | | -.= | . | | = .
| .. | -.-. | | | . | -=#. | | | -
.. | = | . .. | . | | | =## | . | .. | .
~>
NNil
~>
NNil
~>
Crop
~>
Pooling
~>
Relu
~>
Reshape
~>
FullyConnected
~>
Logit
~>
NNil
~>
FullyConnected
~>
Logit
~>
NNil
~>
NNil
Iteration 5: 3588 of 10000
Reshape
~>
Concat
Trivial
Concat
Pad
~>
| - | . | |
| | | |
| | | |
~>
NNil
Pad
~>
| ## | | = | # - | | | -- |
| ## | | | # | . | | |
| ## | | | = | . | | |
| ## | | . | ## | | | |
| # | | | .## = | | | |
~>
NNil
~>
NNil
~>
Pooling
~>
Relu
~>
Concat
| |
Concat
Pad
~>
.. | | | . |
| . | | - |
. | | | |
~>
NNil
Pad
~>
| . . | - | - | .. | .. | - . | . | | .
| .. | . | | | | -- | | | -.
| . | | | | | -.- | . | | -
| .. | -... | | | . | -==. | | | -
.. | = | . .. | | | | -== | | .. |
~>
NNil
~>
NNil
~>
Crop
~>
Pooling
~>
Relu
~>
Reshape
~>
FullyConnected
~>
Logit
~>
NNil
~>
FullyConnected
~>
Logit
~>
NNil
~>
NNil
Iteration 6: 3288 of 10000
Reshape
~>
Concat
Trivial
Concat
Pad
~>
| . | . | |
| | | |
| | | |
~>
NNil
Pad
~>
| ## | | = | # - | | | .- |
| ## | | | # | . | | |
| ## | | | - | | | |
| ## | | . | #= | | | |
| # | | | .## - | | | |
~>
NNil
~>
NNil
~>
Pooling
~>
Relu
~>
Concat
| |
Concat
Pad
~>
.. | | | |
| | | - |
. | | | |
~>
NNil
Pad
~>
| . . | . | . | . | . | . | . | | .
| .. | . | | | | -. | | | .
| . | | | | | -.- | . | | -
| .. | ... | | | . | .-=. | | | .
. | - | . . | | | | -== | | . |
~>
NNil
~>
NNil
~>
Crop
~>
Pooling
~>
Relu
~>
Reshape
~>
FullyConnected
~>
Logit
~>
NNil
~>
FullyConnected
~>
Logit
~>
NNil
~>
NNil
Iteration 7: 2990 of 10000
Reshape
~>
Concat
Trivial
Concat
Pad
~>
| . | | |
| | | |
| | | |
~>
NNil
Pad
~>
| ### | | = | #- . | | | .- |
| ## | | | #- | . | | |
| ## | | | # | | | |
| ## | | . | -#- | | | |
| #. | | | .## . | | | |
~>
NNil
~>
NNil
~>
Pooling
~>
Relu
~>
Concat
| |
Concat
Pad
~>
| | | |
| | | - |
. | | | |
~>
NNil
Pad
~>
| . | ... | . | . | | . | | | .
| . | .. | | | | -. | | | .
| . | | | | | . . | | | . .
| .. | ---. | | | . | .--. | | | .
| - | - .. | | | | .-- | | |
~>
NNil
~>
NNil
~>
Crop
~>
Pooling
~>
Relu
~>
Reshape
~>
FullyConnected
~>
Logit
~>
NNil
~>
FullyConnected
~>
Logit
~>
NNil
~>
NNil
Iteration 8: 2762 of 10000
Reshape
~>
Concat
Trivial
Concat
Pad
~>
| . | | |
| | | |
| | | |
~>
NNil
Pad
~>
| ### | | = | #= . | | | .. |
| ## | | | #= | | | |
| ## | | | # | | | |
| ## | | . | =#= | | | |
| # | | | .## . | | | |
~>
NNil
~>
NNil
~>
Pooling
~>
Relu
~>
Concat
| |
Concat
Pad
~>
| | | |
| | | - |
. | | | |
~>
NNil
Pad
~>
| . | ... | . | | | . | | | .
| | .. | | | | -. | | | .
| . | | | | | . . | | | . .
| . | -.-. | | | . | ..- | | | .
| - | - .. | | | | ..- | | |
~>
NNil
~>
NNil
~>
Crop
~>
Pooling
~>
Relu
~>
Reshape
~>
FullyConnected
~>
Logit
~>
NNil
~>
FullyConnected
~>
Logit
~>
NNil
~>
NNil
Iteration 9: 2794 of 10000
Reshape
~>
Concat
Trivial
Concat
Pad
~>
| . | | |
| | | |
| | | |
~>
NNil
Pad
~>
| ### | | # | # | | | .- |
| ## | | | # | | | |
| ## | | | = | | | |
| ## | | | # | | | |
| ## | | | #- | | | |
~>
NNil
~>
NNil
~>
Pooling
~>
Relu
~>
Concat
| |
Concat
Pad
~>
| | | |
| | | . |
| | | |
~>
NNil
Pad
~>
| . | ... | . | | | . | | | .
| | .. | | | | .. | | | .
| | | | | | . . | | | .
| | -... | | | | ..- | | | .
| . | . . | | | | ..- | | |
~>
NNil
~>
NNil
~>
Crop
~>
Pooling
~>
Relu
~>
Reshape
~>
FullyConnected
~>
Logit
~>
NNil
~>
FullyConnected
~>
Logit
~>
NNil
~>
NNil
Iteration 10: 1801 of 10000
Reshape
~>
Concat
Trivial
Concat
Pad
~>
| . | | |
| | | |
| | | |
~>
NNil
Pad
~>
| ##= | | = | # | | | .. |
| ## | | | # | | | |
| ## | | | = | | | |
| ## | | | # | | | |
| #= | | | #- | | | |
~>
NNil
~>
NNil
~>
Pooling
~>
Relu
~>
Concat
| |
Concat
Pad
~>
| | | |
| | | . |
| | | |
~>
NNil
Pad
~>
| . | ... | . | | | . | | | .
| | .. | | | | . | | | .
| | | | | | . . | | | .
| | .... | | | | ... | | | .
| . | . | | | | ... | | |
~>
NNil
~>
NNil
~>
Crop
~>
Pooling
~>
Relu
~>
Reshape
~>
FullyConnected
~>
Logit
~>
NNil
~>
FullyConnected
~>
Logit
~>
NNil
~>
NNil
Iteration 11: 1043 of 10000
Reshape
~>
Concat
Trivial
Concat
Pad
~>
| . | | |
| | | |
| | | |
~>
NNil
Pad
~>
| ##= | | = | # | | | .. |
| ## | | | # | | | |
| ## | | | = | | | |
| ## | | | # | | | |
| #= | | | #. | | | |
~>
NNil
~>
NNil
~>
Pooling
~>
Relu
~>
Concat
| |
Concat
Pad
~>
| | | |
| | | . |
| | | |
~>
NNil
Pad
~>
| | . . | . | | | . | | |
| | .. | | | | . | | | .
| | | | | | . . | | | .
| | .... | | | | ... | | | .
| . | . | | | | ... | | |
~>
NNil
~>
NNil
~>
Crop
~>
Pooling
~>
Relu
~>
Reshape
~>
FullyConnected
~>
Logit
~>
NNil
~>
FullyConnected
~>
Logit
~>
NNil
~>
NNil
Iteration 12: 1055 of 10000
Reshape
~>
Concat
Trivial
Concat
Pad
~>
| . | | |
| | | |
| | | |
~>
NNil
Pad
~>
| ##- | | = | = | | | . |
| ## | | | # | | | |
| ## | | | - | | | |
| ## | | | # | | | |
| #= | | | #. | | | |
~>
NNil
~>
NNil
~>
Pooling
~>
Relu
~>
Concat
| |
Concat
Pad
~>
| | | |
| | | . |
| | | |
~>
NNil
Pad
~>
| | . . | | | | . | | |
| | .. | | | | . | | |
| | | | | | . . | | | .
| | ... | | | | ... | | | .
| . | . | | | | ... | | |
~>
NNil
~>
NNil
~>
Crop
~>
Pooling
~>
Relu
~>
Reshape
~>
FullyConnected
~>
Logit
~>
NNil
~>
FullyConnected
~>
Logit
~>
NNil
~>
NNil
Iteration 13: 971 of 10000
Reshape
~>
Concat
Trivial
Concat
Pad
~>
| | | |
| | | |
| | | |
~>
NNil
Pad
~>
| ##- | | = | = | | | . |
| ## | | | = | | | |
| ## | | | - | | | |
| ## | | | # | | | |
| #- | | | =. | | | |
~>
NNil
~>
NNil
~>
Pooling
~>
Relu
~>
Concat
| |
Concat
Pad
~>
| | | |
| | | . |
| | | |
~>
NNil
Pad
~>
| | . . | | | | | | |
| | . | | | | . | | |
| | | | | | . . | | | .
| | ... | | | | ... | | |
| . | . | | | | ... | | |
~>
NNil
~>
NNil
~>
Crop
~>
Pooling
~>
Relu
~>
Reshape
~>
FullyConnected
~>
Logit
~>
NNil
~>
FullyConnected
~>
Logit
~>
NNil
~>
NNil
Iteration 14: 962 of 10000
Reshape
~>
Concat
Trivial
Concat
Pad
~>
| | | |
| | | |
| | | |
~>
NNil
Pad
~>
| ##- | | - | = | | | . |
| ## | | | = | | | |
| ## | | | - | | | |
| ## | | | # | | | |
| #- | | | =. | | | |
~>
NNil
~>
NNil
~>
Pooling
~>
Relu
~>
Concat
| |
Concat
Pad
~>
| | | |
| | | . |
| | | |
~>
NNil
Pad
~>
| | . | | | | | | |
| | . | | | | . | | |
| | | | | | . | | |
| | ... | | | | .. | | |
| . | . | | | | ... | | |
~>
NNil
~>
NNil
~>
Crop
~>
Pooling
~>
Relu
~>
Reshape
~>
FullyConnected
~>
Logit
~>
NNil
~>
FullyConnected
~>
Logit
~>
NNil
~>
NNil
Iteration 15: 962 of 10000
$~/Documents/grenade/examples/dist/build/mnist$ ./mnist ~/Downloads/mnist_train.csv ~/Downloads/mnist_test.csv
Training convolutional neural network...
Reshape
~>
Concat
Trivial
Concat
Pad
~>
| ## | # | ## | ###
| ## | - | .## | ###
# | ## | | ## | ##
~>
NNil
Pad
~>
| -#. | | ## | # | ## | = | # -# |
| ## | | ## | # | ### | # | - # | #
| #. | | ## | # | #### | # | ## | =# #
. | | #= | # | #= | ##### | ## | ## | =
. . | | #. | | --### | ####. | =### | ##. |
~>
NNil
~>
NNil
~>
Pooling
~>
Relu
~>
Concat
| |
Concat
Pad
~>
. | | . | | .
- | - | | =# | -
=- | . | | #=. | -
~>
NNil
Pad
~>
. | -- | -.= | = | = - | - . | .- | -. - | . - | .
| - == | . | | #### | - | . | . . | =-= | ..
- . | | - | # - | - #. | .- - | | ### | . . | .
. = - | - | -=- | # - - | - | - | | = | - #. | .
. = | | .. - | = .- | =. . | = | | ### # | # | - . .
~>
NNil
~>
NNil
~>
Crop
~>
Pooling
~>
Relu
~>
Reshape
~>
FullyConnected
~>
Logit
~>
NNil
~>
FullyConnected
~>
Logit
~>
NNil
~>
NNil
Iteration 1: 5064 of 10000
Reshape
~>
Concat
Trivial
Concat
Pad
~>
| ##- | # | ## | ###
| ## | - | ### | ###
= | ## | | ## | #=#
~>
NNil
Pad
~>
| ##- | | ### | | ##. | #. -# | .#### |
| ## | | ## | | ## | ## | ##### | #
| ## | | ## - | | #### | -# | #### | # #
| # | .. | # | | #### | ### | =## |
| # | # | | | .#### | =### | ### |
~>
NNil
~>
NNil
~>
Pooling
~>
Relu
~>
Concat
| |
Concat
Pad
~>
| | | | .
- | . | | .# | .
-. | . | | --. | .
~>
NNil
Pad
~>
. | -. | . - | = | -.- | . . | - | .. - | . . | .
| . -- | | | #### | - | | . | #.- | ..
. . | | - | = - | - .# | .. . | | ### | . | .
. - . | . | --- | = -.- | -. | . | | - . | - .#. |
- | | .. . | = .-. | #. | - | | =#= # | . - | .
~>
NNil
~>
NNil
~>
Crop
~>
Pooling
~>
Relu
~>
Reshape
~>
FullyConnected
~>
Logit
~>
NNil
~>
FullyConnected
~>
Logit
~>
NNil
~>
NNil
Iteration 2: 4854 of 10000
Reshape
~>
Concat
Trivial
Concat
Pad
~>
| ## | | | ###
| ## | | ### | ###
- | ## | | ## | ###
~>
NNil
Pad
~>
| ## | | | | ## | - | |
| #= | | | | ### | # . | | #
| # | | ## | | ##### | #-# | | # #
| # | .. | ## | | ##### | | - |
| # | # | # | - | ##### | ## | . |
~>
NNil
~>
NNil
~>
Pooling
~>
Relu
~>
Concat
| |
Concat
Pad
~>
| | | |
. | . | | -# | .
.. | . | | -- | .
~>
NNil
Pad
~>
. | .. | . - | -.- | . | . . | . | .. | .. . |
| . -. | | -= | .-.. | . | | | #.- |
. . | | - | - #. | - = | .. | | #== | |
. . | . | -=- | -.=-# | | . | | - | . .= |
- | | .- . | #---- | = | | | -=#.# | ... - | .
~>
NNil
~>
NNil
~>
Crop
~>
Pooling
~>
Relu
~>
Reshape
~>
FullyConnected
~>
Logit
~>
NNil
~>
FullyConnected
~>
Logit
~>
NNil
~>
NNil
Iteration 3: 5499 of 10000
Reshape
~>
Concat
Trivial
Concat
Pad
~>
| ##- | | | ###
| ## | | ### | ###
. | ## | | ## | ###
~>
NNil
Pad
~>
| -# | | | | ## | - | |
| .- | | | | ### | # | | #
| # | | ##.## | | ##### | #-# | | # #
| # | .. | ##- | | ##### | | - |
| # | # | # | . | ##### | ## | . |
~>
NNil
~>
NNil
~>
Pooling
~>
Relu
~>
Concat
| |
Concat
Pad
~>
| | | |
. | . | | -# | .
.. | . | | .- | .
~>
NNil
Pad
~>
| .. | . | -.- | | . | . | .. | .. |
| . .. | | -- | .... | . | | | #.- |
. | | . | - #. | . - | . | | =-= | |
. . | . | --. | ..--# | | . | | - | . .- |
. | | . . | #.--. | - | | | --#.= | ... - | .
~>
NNil
~>
NNil
~>
Crop
~>
Pooling
~>
Relu
~>
Reshape
~>
FullyConnected
~>
Logit
~>
NNil
~>
FullyConnected
~>
Logit
~>
NNil
~>
NNil
Iteration 4: 5284 of 10000
Reshape
~>
Concat
Trivial
Concat
Pad
~>
| =#- | | - | ###
| ## | | -## | ###
. | ### | | ##= | ###
~>
NNil
Pad
~>
| | | | | ## | # | |
| | | | | -## | # | | #
| # | | # | | #### | #== | | # #
| # | .. | #.## | | ##### | # | . |
| # . | = | #### | | ##### | ##. | # |
~>
NNil
~>
NNil
~>
Pooling
~>
Relu
~>
Concat
| |
Concat
Pad
~>
| | | |
. | . | | .= | .
. | . | | .. | .
~>
NNil
Pad
~>
| . | . | ... | | | | . | . |
| .. | | -- | ... | . | | | -.. |
. | | . | . #. | . - | . | | =-- | |
. . | . | .-. | . -.= | | | | . | - |
. | | . | -..-. | . | | | .-=.= | ... . | .
~>
NNil
~>
NNil
~>
Crop
~>
Pooling
~>
Relu
~>
Reshape
~>
FullyConnected
~>
Logit
~>
NNil
~>
FullyConnected
~>
Logit
~>
NNil
~>
NNil
Iteration 5: 4786 of 10000
Reshape
~>
Concat
Trivial
Concat
Pad
~>
| =## | | # | ###
| #= | | ## | ###
| ### | | ### | ###
~>
NNil
Pad
~>
| | | | | ## | # | |
| | | | | ## | # # | | -
| = | | -# | | .## | ### | | # =
| # .- | | ##### | | ## | ### | . |
| #-#- | - | ##### | | #=## | ### | . |
~>
NNil
~>
NNil
~>
Pooling
~>
Relu
~>
Concat
| |
Concat
Pad
~>
| | | |
. | | | .- |
. | | | .. |
~>
NNil
Pad
~>
| | . | ... | | | | | .. | .
| .. | | -- | ... | | | | =.. | . ..
| | . | =. | . . | | | =-- | | ...
. | | ... | -.# | | | | . | . . | .
. | | | . .-. | . | | | ..-.- | .. . | -.
~>
NNil
~>
NNil
~>
Crop
~>
Pooling
~>
Relu
~>
Reshape
~>
FullyConnected
~>
Logit
~>
NNil
~>
FullyConnected
~>
Logit
~>
NNil
~>
NNil
Iteration 6: 5387 of 10000
Reshape
~>
Concat
Trivial
Concat
Pad
~>
| ## | | # | ##
| #= | | ## | =##
| =## | | ### | ###
~>
NNil
Pad
~>
| | | | | ## | # | |
| | | | | ## | # = | | -
| - | | # | | ## | #-# | | # =
| - . | | -### | | ## | # # | . |
| - = | . | ##### | | # ## | ### | . |
~>
NNil
~>
NNil
~>
Pooling
~>
Relu
~>
Concat
| |
Concat
Pad
~>
| | | |
| | | .- |
. | | | .. |
~>
NNil
Pad
~>
| | . | . . | | | | | .. | .
| . | | -- | .. | | | | -.. | .
| | . | =. | . . | | | --. | | .
. | | ... | ..= | | | | . | . | .
. | | | . ... | . | | | ..- . | . | .
~>
NNil
~>
NNil
~>
Crop
~>
Pooling
~>
Relu
~>
Reshape
~>
FullyConnected
~>
Logit
~>
NNil
~>
FullyConnected
~>
Logit
~>
NNil
~>
NNil
Iteration 7: 5741 of 10000
Reshape
~>
Concat
Trivial
Concat
Pad
~>
| .## | | # | ##
| .## | | ## | ###
| ### | | ### | ###
~>
NNil
Pad
~>
| | | | | ## | # | |
| | | ## | | ## | # # | | -
| - | | .## | | ## | #=# | | # =
| - .- | | -#### | | ## | # # | . |
| -.#. | . | ##### | | ## | ### | . |
~>
NNil
~>
NNil
~>
Pooling
~>
Relu
~>
Concat
| |
Concat
Pad
~>
| | | |
| | | .- |
| | | .. |
~>
NNil
Pad
~>
| | | . . | | | | | .. |
| . | | -- | | | | | -.. |
| | | -. | . | | | -.. | | .
| | .. | ..= | | | | | . . | .
| | | . ... | . | | | ..- . | .. | .
~>
NNil
~>
NNil
~>
Crop
~>
Pooling
~>
Relu
~>
Reshape
~>
FullyConnected
~>
Logit
~>
NNil
~>
FullyConnected
~>
Logit
~>
NNil
~>
NNil
Iteration 8: 3788 of 10000
Reshape
~>
Concat
Trivial
Concat
Pad
~>
| ### | | # | ###
| ### | | -## | ###
| ### | | ### | ###
~>
NNil
Pad
~>
| | | #. ## | | ##### | | |
| | | # .## | | ## | # # | | -
| #-. | | ##### | | ### | ### | | # =
| #=== | | ##### | | #### | ### | . |
| =-#- | . | ##### | | ##### | ### | |
~>
NNil
~>
NNil
~>
Pooling
~>
Relu
~>
Concat
| |
Concat
Pad
~>
| | | |
| | | . |
| | | |
~>
NNil
Pad
~>
| | . | . . | | | | | .. |
| | | -. | | | | | =.. | .
| | . | -. | . | | | -.. | |
| | .. | ..= | | | | | . .. |
| | | ... | . | | | ... . | .. | .
~>
NNil
~>
NNil
~>
Crop
~>
Pooling
~>
Relu
~>
Reshape
~>
FullyConnected
~>
Logit
~>
NNil
~>
FullyConnected
~>
Logit
~>
NNil
~>
NNil
Iteration 9: 3058 of 10000
Reshape
~>
Concat
Trivial
Concat
Pad
~>
| ### | | # | ###
| ### | | .## | ###
| ### | | ### | ###
~>
NNil
Pad
~>
| | | ..### | | . ## | = | |
| | | . ### | | # | = # | | -
| #=- | | ##### | | =# | ### | | = =
| #==- | | ##### | | # ## | ### | . |
| -.=. | . | ##### | | #.## | ### | |
~>
NNil
~>
NNil
~>
Pooling
~>
Relu
~>
Concat
| |
Concat
Pad
~>
| | | |
| | | . |
| | | |
~>
NNil
Pad
~>
| | . | . | | | . | | .. |
| | | -. | | | | | -.. | .
| | . | -. | . | | | ... | |
| | ... | ..= | | | | | . . |
| | | ... | | | | ... . | .. | .
~>
NNil
~>
NNil
~>
Crop
~>
Pooling
~>
Relu
~>
Reshape
~>
FullyConnected
~>
Logit
~>
NNil
~>
FullyConnected
~>
Logit
~>
NNil
~>
NNil
Iteration 10: 3205 of 10000
Reshape
~>
Concat
Trivial
Concat
Pad
~>
| ### | | # | ###
| ### | | .## | ###
| ### | | ### | ###
~>
NNil
Pad
~>
| | | ..### | | . ## | = | |
| | | . ### | | # | = # | | .
| #=- | | ##### | | =# | =## | | = -
| #==- | | ##### | | # ## | ### | |
| -.=. | . | ##### | | # ## | ### | |
~>
NNil
~>
NNil
~>
Pooling
~>
Relu
~>
Concat
| |
Concat
Pad
~>
| | | |
| | | . |
| | | |
~>
NNil
Pad
~>
| | . | . | | | . | | .. |
| | | .. | | | | | -.. |
| | . | -. | . | | | .. | |
| | ... | ..- | | | | | . |
| | | ... | | | | . . | .. | .
~>
NNil
~>
NNil
~>
Crop
~>
Pooling
~>
Relu
~>
Reshape
~>
FullyConnected
~>
Logit
~>
NNil
~>
FullyConnected
~>
Logit
~>
NNil
~>
NNil
Iteration 11: 3252 of 10000
Reshape
~>
Concat
Trivial
Concat
Pad
~>
| ### | | # | ###
| ### | | .## | ###
| ### | | ### | ###
~>
NNil
Pad
~>
| | | ..### | | . ## | = | |
| | | . ### | | # | = # | | .
| =-. | | ##### | | -# | =## | | = -
| #=-- | | ##### | | # ## | ### | |
| -.=. | . | ##### | | # ## | ### | |
~>
NNil
~>
NNil
~>
Pooling
~>
Relu
~>
Concat
| |
Concat
Pad
~>
| | | |
| | | . |
| | | |
~>
NNil
Pad
~>
| | . | . | | | | | .. |
| | | .. | | | | | -.. |
| | | - | . | | | .. | |
| | .. | ..- | | | | | |
| | | .. | | | | . . | .. | .
~>
NNil
~>
NNil
~>
Crop
~>
Pooling
~>
Relu
~>
Reshape
~>
FullyConnected
~>
Logit
~>
NNil
~>
FullyConnected
~>
Logit
~>
NNil
~>
NNil
Iteration 12: 3263 of 10000
Reshape
~>
Concat
Trivial
Concat
Pad
~>
| ### | | # | ###
| ### | | .## | ###
| ### | | ### | ###
~>
NNil
Pad
~>
| | | ..### | | . ## | - | |
| | | ### | | # | - # | | .
| =-. | | ##### | | -# | =## | | - -
| #--- | | ##### | | # ## | ### | |
| -.-. | | ##### | | # ## | ### | |
~>
NNil
~>
NNil
~>
Pooling
~>
Relu
~>
Concat
| |
Concat
Pad
~>
| | | |
| | | . |
| | | |
~>
NNil
Pad
~>
| | . | . | | | | | . |
| | | .. | | | | | -. |
| | | . | | | | .. | |
| | .. | . - | | | | | |
| | | . | | | | . | .. | .
~>
NNil
~>
NNil
~>
Crop
~>
Pooling
~>
Relu
~>
Reshape
~>
FullyConnected
~>
Logit
~>
NNil
~>
FullyConnected
~>
Logit
~>
NNil
~>
NNil
Iteration 13: 3263 of 10000
Reshape
~>
Concat
Trivial
Concat
Pad
~>
| ### | | # | ###
| ### | | .## | ###
| ### | | ### | ###
~>
NNil
Pad
~>
| | | ..### | | . ## | - | |
| | | ### | | # | - # | | .
| =-. | | ##### | | -# | -## | | - -
| =--- | | ##### | | # ## | ### | |
| -.-. | | ##### | | # ## | ### | |
~>
NNil
~>
NNil
~>
Pooling
~>
Relu
~>
Concat
| |
Concat
Pad
~>
| | | |
| | | |
| | | |
~>
NNil
Pad
~>
| | | | | | | | . |
| | | .. | | | | | -. |
| | | . | | | | . | |
| | .. | . - | | | | | |
| | | . | | | | . | . | .
~>
NNil
~>
NNil
~>
Crop
~>
Pooling
~>
Relu
~>
Reshape
~>
FullyConnected
~>
Logit
~>
NNil
~>
FullyConnected
~>
Logit
~>
NNil
~>
NNil
Iteration 14: 3312 of 10000
Reshape
~>
Concat
Trivial
Concat
Pad
~>
| ### | | # | ###
| ### | | .## | ###
| ### | | ### | ###
~>
NNil
Pad
~>
| | | ..### | | ## | - | |
| | | ..### | | # | - # | | .
| =-. | | ##### | | -# | -## | | - -
| =--. | | ##### | | # ## | ### | |
| ..-. | | ##### | | # ## | ### | |
~>
NNil
~>
NNil
~>
Pooling
~>
Relu
~>
Concat
| |
Concat
Pad
~>
| | | |
| | | |
| | | |
~>
NNil
Pad
~>
| | | | | | | | . |
| | | .. | | | | | .. |
| | | . | | | | . | |
| | .. | - | | | | | |
| | | . | | | | . | |
~>
NNil
~>
NNil
~>
Crop
~>
Pooling
~>
Relu
~>
Reshape
~>
FullyConnected
~>
Logit
~>
NNil
~>
FullyConnected
~>
Logit
~>
NNil
~>
NNil
Iteration 15: 2163 of 10000
$~/Documents/grenade/examples/dist/build/shakespeare$ ./shakespeare ~/Downloads/input.txt
TRAINING STEP WITH SIZE: 50
ahv;yanjah'pe mx eyepeyy
m'y'xypm
&ye&m emmy;' '&hh''x'&mm
&py'eyhyyx'emmm
e'&p&pyypey'
xeh;pp;xh;y;m
ehh &y;;ph'p h 'hyh
p;
x'&yxhxymx&p'x; &e';xmy&'heyx
yx;pm
hp;mh'y;hy y;;' xxp;py
xx' hp&hp yp
m' mxm'eee'; '
e'e&p'pm&;xmxx'eepm'e
;p';xxy&;
y
hy'hem &mhy&p
h&py; yex&
h&pemhyp
mp;'
e'm xy&e''xx&'xyy h'e;x&'p'h &;;
ex
h&yhym &;xxm
pp
xxe yey;x&&emxp &mm&
e ymmh' m ;ex
'x xym ;&ph'
emx
ypyy'hyyhemy;p'
&mp'm p& mhe&'&x;m& yh;
m'
xm;&yey'x'&hpph ''yp'mxhe;&&
&x;mxx; x;exe;mp yxyx
&ehye p''
xe'
&''x';h;yh
ym&h&p;;h&;
;;hme;
hm;yhex
exy' ee;pex&
ymeexh&y
&'yh
'h& pp'mm;ppe;';x'he;;
;hxpy;&
xx mey
&p h e'e'xymyxmem ;'''mpx&xph'x & hp;xe&;&&x&
'y
hy'ymx
p xy
e;xemh'
e&exh
h;
mp;
m
y&m&
xhp hehym
p&'
'
me
h
y;emxye' xpphpm
&;e &y;xphee&m;'hyxex'php ee
pp;h'xe'
';&pmh;&&y'h
pmeehy'xx
&hmymym;&x;ey & hm&&m m
ey he phhm'px&'
;' e
ymy'ephxx&
pe&
' x ymy
xxpp
hee e&'x;y p'xpxy
x'''e e
xp exy'e
x x;epxh'p'
&;hhexyp&mmp'em&;&
e
e
'
p&xxxx
';' & 'py'y
hpx
TRAINING STEP WITH SIZE: 50
vmeeeyaeyapm&exhxe &p e&yhmh 'p''&&yme e&'xmyehxmmem' hpyyy phxyh&m ' &mxp ' x hx&&my&ex'h'pyhyhxpmyexmepyxpypx &h'xx'&hpmh'x&pppy& pmm&my hepyx m& 'hmhpyeyxh'yxe x&ehyhe m&em&x& m yx&hxxem&e 'hxe'myp emmm y'yxpeyh'm y xypex ''& emxxyymyhhyhpemmp hx m'my'p&h yy&x pppy'hehmx'&&eeeyxypp' mhhm & m hyxh'&mxphmxmhhpyye'xe'myemh ex' px'xyxexphxe xmm'y yy'mey m yy&m'x'y'xepx' m&h me &pyxm m' 'pe ''h'xpy'ph& yxp'mhhxyh'hmy meeex xxpyp'hpyee&'x'hexhyyxxxmxp'x &pexmem&xemm'x&myyyh''&mymm'&xm myymy'ey &ppyhpyy &yhpy' mex&xemymeme hpmh hy xe mm &&mpp'ehehxh'y&x&xm 'x &pxpmheey yxe x &h &'' p 'xmyxx&mmyxpme'emmpmh&h&xp 'pmmppp py &h&xxehxh' yxeehpe'e&'xpx&p m 'm xyem' myme'm''phxhxexp xp' em'&emhmmpey ' ex'y'm&x x'hem''xepye x ee'mxpex ypxye&h'e&hpmx'&p 'mpe&h&m'&xxeem''he&&xp&&mpey pphe 'mp 'py& h&&ppm&xy&h mppxhme&mx'&ehxy&emmmxmxyhh&&'emp&''me & yh&hmem ex&epex&'pm'py mmp yym& yhy epxh&yp''hhxhxpxyp yyxyppp'xeex &pp&xxpm&hy&&m&&h'yp&xhm my&eep hhm''ey h yp &p 'ye me''e&hehy hxy eepy'
TRAINING STEP WITH SIZE: 50
a!'my han'mm mx xex'y emph&pxp&yxh&pxmx'm'&ye y 'ehp mp hx'&xxpyxey'exympmxhyp&m&&ph y x m' 'hx'&&hyphm &emhx&pep xy yyy'''&yxm phpmm 'm'mehx mmemx&&'myymme h hpmehye&x'yxxx'x&p&ehe&h' mh p&mxmhh&x&p'hp y pyhyym'mphep&h&&& 'xmmphmpepph ' ppxyme&'xhxmh'yex'' ' m&em m'hhxem e&'&e'y&y&x hypmpm&exmphmhyep yem&&expepy &hm&hy 'eyp&p &my x'hxphpp 'eh &hxmhyye xy&'eeyeeeee'ex ' xpyph peempey' ye '&'pxyx&p&xem&ppy'pympy'& mymmexxxh'hhxm& x'x p & 'pyxh xp'p x'ype y' m&yphp 'hmyhp' e'ye'y&my&pxyypy'e& m mxxp y'xpm ehphhyhm' e&h '''x hxy hee pxx hm'm&'e xm&y'xhppxmxy'yyehxye xx'&ppyh ''xyy'pmepp mmeyem&&m'y eph&'mpex& h''h&mhyxp' h&hpy&yxyxmh'' hhpy x''hphx&ph&y 'y&'xhm'xxxe'&emh'e&meh' y ppyp&m'h yxmme meh'hyp'pehpymmymmpeyh p hyxm y&&yymxxem&myehee &yy'&&xpex''xm p yh &yhxe''yp'ymyppe'exp eymmey&'p&h mee'y'm&'y'&xp'hx&&y 'pyxpxx ppyyyy memhex&hh'exyphxe xm hepm'''hex'phh&yype& 'y'heexehyhy x&'p&m& m&x x' &px& xhhmy'emm&me'xpppxm'&xxyehyyemyxpmempy pp&hyhy&&ph& p''peypy'emmye ex phepm
TRAINING STEP WITH SIZE: 50
o
&aaee 'epp'h' p pe'mppp'xp mhme&hm xppppehxheyp'&y'hxyp&e'mhpy mpmpeyyhm'hp eemhm'eyy yxhyyxxyeey'''m'ppp 'e'hx''ey &myxe h&' &p&h'ph''y mx''epexyphep'p& me' p& my my&x'&&y&&&&x' hhpex'hee'phe'xhyeyy'xypxxe&x&ee&yemx &'pyy'ex&'py&y ey pmxpm ypymx & ' eyhxm &&ype yx em&xexpyhmyypemhe'hm'x hxexpy xym&hp hp mmxp&h & h'y yphp&e p p'm&x&yhyyxexyeh & & mem m'& h'hpmp yyxm yxm'hy h&&h&'m&h&em& hhxph'xep 'mp'e x''heyxh&e x&xypypxehympmh &e'ymp 'hyppypmpy&ye&p'eh ph'p &eexxp &xy&hpmyh emyeymyyhp' e 'yxxhmpeym&' x hyhe emxxm'hh exp'&ye'& pxpy&x'm&hxp'pppyph h p yyye xpxx yh'pxh y e&pe p yeh mmhxxyxh'&p'ymyphmpm'eehyhye&y p & hepp pe'mmy&yhhm'mex ymee&hey' mh'&'&ehyme xm'pep&'hye xpp& 'x ' m&e my p'& hy'hph&hhx'hp&x'x&'xyhhxe'mhye h&yeme 'y'xy'pm&hxx 'e'ph yyy'h &'e&&he&x yxpe mp xp 'emee'yxpp'm&y'ememxxph&ey 'pep'peyxymxpyx'&xhpphehmhhx'xm e mep& &xxm'heemhehhy'xpyhp''mhypxyhepmyhyxe m&h p e'h'emypehe'&yxx e x&'y&e'he p p' x&'my'xxx 'hx'ymmh h &x pxmmxp hxmeppmphmxmmhx x'e&p 'm ''yy
TRAINING STEP WITH SIZE: 50
eeem&jhapyaaxpy ee&'ym & 'pphxehp'eep ppmm'& ymm'mh&'eh&yy&yhp'm''ppphh'pyhm'y& 'y&'pe phh''m'x&ym 'x hmmhph &pp'y''&hhxemxhxeyeee&yh hx'mx'pe' mh&&y&hh meemy&pephhp hmy &'&hee& ey& p pph&emxxmp''e m hhyy he'&yppm'empyeyhx e'&&y'my hypmyey&&mm&&hhhm''''ey'yym& heppe& p&h&emee'pmpyhe e'yem 'yh ph&'y'e&hee hxmp mpy&m'myymy'ehym ym &yyp pmph'ppx'mhe'ep&x' p&&x'emxhe&eyem'ym'h&y&m&mmmmh&m hxpepe &eyx &mp p&ppe'x'y'x ph h 'pe'mx hy&'p&'xhphxyxymexxympymepye'mym&e 'y'mhe&&e&py''p xhh'ex'exe' y'xe&p hxpx y' xyhh p&m mh xx xp'yp'xm'''pex xyhem&h'&y mm&ep 'ehmxe p mypyhp'e &ep m ey&xpepxyxex&xepe&mem&&y' pe&x&xeme'mexp'eme yxehymm&hx phmex&hmepmx&e&e'exphmhm'xhxxxypxe&xeh xhpm'&pm hhx h&meep'y''yyxx&ym&eh&mmhmmxpp&pe&&'pme&'xe'phhxpxxphyx'eh 'pme'ym'yyh&h mheee e m e&'pxxxx'pyph x&&&'xxxmyxx' hepyyp&'peyhe'm&hx&&'& mxpp''hhmeh''e yyeh&me&mp'&&p&'xpm'em xxme&pxy mhmpey' &ye''& e''&'&yx xp&h&xypp 'yye'&xmxpphpyp'mmmxmxhem epmeyhpxxhm' p&xxphm&pmxe&e&hyy&hx'x&xepmpy'hx xxexx&xp&mhymypmex
TRAINING STEP WITH SIZE: 50
xnhmmmnahae 'm ypxyxy pmepxxy p ye&m' x''x'eh&'m&p''hxpxyhy'''&ee&xe'&hxhep&my&'&emmmxym&pyxhmxehmm &&ehxxhpe& mpeme& 'ph' xhpem&mmhhxyp'&yyhxx&&&xhx&ehhxee exyx& &x'mehpxehex'pyy&&e&ym&p ph'pxh'&p&xxhmhme ppp&&xxm'h&hmhex'&x yhhhhpx& xyhxep'ppxh xpx&p&ymy&mpx 'ehy mh eh&mypmm&yy&xpmm p&h&e'h'e&ym&h'exxypmye hy'hp&p hxe&hhxe'pmm' hm'&&he&h&epheep&&x'xpmmep xx em&'p'xpmmh' &e'&'yhypmm& 'hp ymm p&&xe e&'e&yy h'xm&me&yy' em'ee' ehhp&yxyymeph& pe'y'mhe'hhxeyhx&&ymyh mehp'm epe&xpe'mx 'xymxexm'y 'p' emh&p pyyxeh'yxeemxpm&''e'xmpp&xepex&xhh'pxpmhhyhe&hmyxhpep '&m em'xhxpy'eem'eyyxyx&'e' xh '& mh''y hy'yp'ehxeyyxmx m&&hh&ymxx '&p hxyx'mp&& &hmp'y&h'mmype pmhmpxp'p&mehxhep' pmyhm &pmyypmy&xe&'x m&x hmyxh &h mmpxyhm'x'y&'&m'mymeh'xmp&ey&hmyeye'mm''mhm&mp&&yymm&'ymhxxmy' mh&mhxhpp mmyep &'hm &p' hhm pmxx exyxhy epmp&xhe hx' ye&xyx h'm e y& ppxxxy&yxeh&mh& hpmmex'epy'yymehhy&xx&'ey&yyh&mhpxpe&&eh ypym&mhe&mehym mhe ''&''xypyepe'xx&m&'xyyx ehxpxx pyy ' y''eh''h'ye ympyexxmxm'&my'yhyp
TRAINING STEP WITH SIZE: 50
onmhee'hnae&& me pmm&x 'expy&yp'meh & ephmh&&phehmxpm&&&p' e''mhppe'y'&ypx&yyp&pepe'e 'x &m&ep' ''& yypey&e' &y'& &yxmyp&'pmmmyxy eepxhe'& ehphxphe&x''xp'yyemx hye hxph m y& hmpmymp ehe &yymp hh'xexyyh&ppxyp yp yhp'xemm m'hp em&x'&'hepehepeemhyyp& ' mmhx xxy'x'xm myemy''&xpphmx p'mx' mh'm' xey&ee&phx'px'&p pe'pyxmhy h&p 'eyeyypeyxpyy'yym' eppepxhehy&p' mx&&xy xhxp meepmhx&'xhh'&hy &'hmh'p&exhh&me phxmm &mxex mmm'&ymey&mx pph h'ppm&e 'x yhyex' xeyx' &'p&e&em yxehyypyyxy'hyx m x'yeh ''&x ep' hyyyp&y&mehx eh&m&m&&''p&xxhm&xe yypem&ph mhe'& ' y yhmhmyhyep&xy'p'm x'yp pp emm'xe'hyey& &phhh & &yyyppxh&hyxey&xmmh''&ypmx'&&e&'x'h m&y&yh&e ppy&ymxxy'p myx y' yxhhe''&m e &xyhxym ppxe xx'xx'mem'h emxxyhy &mpxyme exxy'mh&ypphxxee'x&ey yhpx pep&hxhhxxhyme&xph&exp pppph m x'&empe&e &m&m&y&me&'xp&m'x'hhh'p&p'yhyhh& yhh'h&pyxpxxxxyxmh'he'e&he'x&&p'y hpp y'mpx''&mphxph'pym&'&h&pp'ey ex'&xpx'x & pepyp''ey'x'ym hxp'ppxy'hm 'm&eypm&&xxe yeeee&epxyxh&yx h hh'hxhy&m& he& pye p&ymh epmhmey&h mpm
TRAINING STEP WITH SIZE: 50
ceeeyj'pemmpm& hhphehmemx'pxh&ym'em'e&pmpexme'&eypeymxexxpmm yehe& '&xhmhmmmhh&pmppym&'y'mhphxhyhmymhx'xepmy&'&xepmmp p'yyeyh pxhex'' 'eyhx'mp me&'y&xp'e& ' hp'hmyep&'xmx&hp y&xx'&&xyp expph p&e &m' h &hmpemphe'pmhyph x' m'pem&epmye'p&ypxxx'&&hyhmm e'm'y'ypx e& p'pyxp&ymp' yhpeee'yx'mhem &yhm&mxhxxp'y'yx&y exxxeehmxmm'&mehpy 'y&''xempxyxxm&'mp'ph'pphyy&'pm'heypyxx y&pehxhpyhe'me'pexp&mxh''y h& eeepx e&&expp&x'p 'em'p&xp'xh' mx&my'epeymy ehyppeyyhme&he'hhehppyx'ppm& x &ehxhmxex'&p&e x ex ypm''y&xypym xm'y&xemmy ymppp'xeyyppme mpexmpmhhhe ''yyp'hemx'hxp h' x& 'exp&x&&x'x mpxp e&p'y' hmphxxheyy&&mm yex'hxxy&h&mmymhxmhhmy'&hxhxyyxhy'&&h& xhm hxxh'xmpyp exe'p h&x& '&&& pym& pphemhxmyxepxh&hxhmxx''pp y' ph'hmm'e&emxxxex xye'yh &&'yyxp eehhexp'& yp&xppeh m&epm&''mee&heppymy''&y'eexp&x& ex''&eex'xmxhx 'x'memhp'mmppmh 'yehy hm' y'hy'mhpxm p&yhx&&' pm ex 'y'x'pxmey&ypxy&'pmxehxey y&p'hyp m'phppe&he 'yehhpx& 'xyy'e&ee xhyyeeyppy'h&ym&&ex&'eee'pp&p &y pm'yemyeh'yx myh xp&mh pm''& eeyh
TRAINING STEP WITH SIZE: 50
;hxh 'yp'ehmpy yehhp''m&'hhy&y&yh'yep&xp& m ''e yxh'he p'hxephpphy&mx eyh&hx'hx'pe& y'xme& y''ymhyyehe mpp&hh'h' me&xp&yeh' my'p&xe py& m xym e & e'xme'p'e''xx&&hy&ey'hh'pyxxexxxmmxhhepypxxpyxymp'h&p'y yh ehe' 'e ey&'hp&xy'hpy &'m&''x hxpy&pye hy'p&' 'x'xp'&yyye xhypmhepe& &eeexmemph&xxypxy&'me'mhhhp&eypem'hy e&exmhp'e 'm'memxxhx'x 'pxex yhxe p'pemm xyy phhypx& 'y&x&xx&e'mh&ep xe'&h'y'me'm pm eeme'e&he&p p xxex' ye &x ppy p xe''ppe 'h'&x&h&hxpmx 'x pmhmpyypymepxep'h hx h xp'pmh pp& hpyexm& m& e'm y&ym && mx'x'm e'xmx &p ' p eme ' peymmhepxmpmehxh'hxh m& x&&hexe&&ee&phyxmexhypp'' y xpp&&e '&yy'&m myepe 'mympyyxehyyyxp m m&'&& ' m'ey&y empxhxhye ehxe y'epex hme&h&x&x''m'p'hhh'm&xeemh&mpey'm&'ppyhe'yx&peh'&h'mm&mmxxm ee'p ehyyhm&xyepye&h&e&'m'm p 'xxmmee&xy&p&xmp&he' &my mexx&'mp'pm&&emx eme x m&mem&y&x&p 'xy& eh 'pxhmmheppxyyexex yexp&pxyx&hxeym&hhh''x xxx py eeyhmmexee yp'h'hemxhxhmehemyhx x ppmeep mexpyyp'pye&'x emh'xhh&e& xpm&eemhpee&h mx&ee&phmymxx'&yxh'expmmeh &mxh'p'' '
TRAINING STEP WITH SIZE: 50
nmmy'jy'n'yp''yeh ph h&mh'h&&ee&h p hxye xypxxmyymxyyhe epm y&phyp&he' px'ypp''ypymyphhh epey p'm '&&p' 'x'h'p'& ee mhxpe&y'mhhh hp 'h&mxmmp&pmpyh'y&'&&yxx pmp& ''p yhppyex&hehmem &pppmxy&hh h hpxye x'xx'' &e'yhxpypmy &x' &my x'py&hxmpxp'eph&ymyyph mpe&mpm pexm&hhhph mp e'xe&'&h'mh&y'hyxpmh xyey&y exexphph' p'pem'hm&&'phmm&pp&yh'h'xxmeyeypy hm'peph xy &x'hppp ' &p hpyyxp&xphmm e y&&&emyeymp xem ee&hp& ee'phpyme&hy''&&eyyx'&'& xyemp ypyx'm&exxxxy & myxhex&& ex&& 'mxyypexp&yh'hhhxpp'hmmx'me hehpxh&m x' h'empx y'yepmp'x h 'ymmhmx exh yxxy'xx 'xyyxpxpp'& hppyy 'eyy xp xm''mpye' &p&ehpmepyp phye&xhypp'''pememhxxyy xmxmy &xm 'mh ppe&xmyhm&ym&yhyye''mx&memx&'mppxhyhpmye ypphy hem my pm &hmmyhmm'e exyxe'yxyhe'xy'm' h hyhxpy'h'hpypm &' & p&hem&pxxhy'&yx ypymmmpemmp ypy'e &yxhypyh'm'xypxhp m'm'mmep x'hp&' xpxe m hy'mpm ' ppyxphyxme' x' mppmxmhp&xpeh'x'hpex'ymeeex'm &'hyx'phxexpm mpxyh&xmxhpm pxeexyepx&& &h ehp&x emmh x ' &ey'y'&x&'mx'yx&mhyxy&ye m'&mehme&x'xepye&hp&hymm my hx &'eyh'x
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment