Analysis of 1 layer 1 head transformers learning the 12 2-state and 2 1-state DFAs

automataAnalysis.ipynb

{
 "cells": [
  {
   "cell_type": "code",
   "execution_count": 11,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "Sorted by avg epochs\n"
     ]
    },
    {
     "data": {
      "image/svg+xml": [
       "<?xml version=\"1.0\" encoding=\"UTF-8\" standalone=\"no\"?>\n",
       "<!DOCTYPE svg PUBLIC \"-//W3C//DTD SVG 1.1//EN\"\n",
       " \"http://www.w3.org/Graphics/SVG/1.1/DTD/svg11.dtd\">\n",
       "<!-- Generated by graphviz version 2.40.1 (20161225.0304)\n",
       " -->\n",
       "<!-- Title: %3 Pages: 1 -->\n",
       "<svg width=\"117pt\" height=\"44pt\"\n",
       " viewBox=\"0.00 0.00 117.00 44.00\" xmlns=\"http://www.w3.org/2000/svg\" xmlns:xlink=\"http://www.w3.org/1999/xlink\">\n",
       "<g id=\"graph0\" class=\"graph\" transform=\"scale(1 1) rotate(0) translate(4 40)\">\n",
       "<title>%3</title>\n",
       "<polygon fill=\"#ffffff\" stroke=\"transparent\" points=\"-4,4 -4,-40 113,-40 113,4 -4,4\"/>\n",
       "<!-- 0 -->\n",
       "<g id=\"node1\" class=\"node\">\n",
       "<title>0</title>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"54,-10.5442 54,-25.4558 38.1838,-36 15.8162,-36 0,-25.4558 0,-10.5442 15.8162,0 38.1838,0 54,-10.5442\"/>\n",
       "<text text-anchor=\"middle\" x=\"27\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;0 -->\n",
       "<g id=\"edge1\" class=\"edge\">\n",
       "<title>0&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M54.2408,-21.3717C64.0239,-21.4442 72,-20.3203 72,-18 72,-16.5861 69.0382,-15.6164 64.5105,-15.091\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"64.3882,-11.582 54.2408,-14.6283 64.0731,-18.5749 64.3882,-11.582\"/>\n",
       "<text text-anchor=\"middle\" x=\"76.5\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;0 -->\n",
       "<g id=\"edge2\" class=\"edge\">\n",
       "<title>0&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M54.1975,-24.1551C72.3402,-25.8876 90,-23.8359 90,-18 90,-13.2583 78.3418,-11.0148 64.2386,-11.2695\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"63.9809,-7.7784 54.1975,-11.8449 64.3814,-14.7669 63.9809,-7.7784\"/>\n",
       "<text text-anchor=\"middle\" x=\"95\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "</g>\n",
       "</svg>\n"
      ],
      "text/plain": [
       "<graphviz.dot.Digraph at 0x7f41a068aa90>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "avg epochs 1.01 min epochs 1 max epochs 2 std epochs 1.099498743710662 avg loss at epoch 0 1.4036058342456819 avg loss when fit 0.9353451192378998\n"
     ]
    },
    {
     "data": {
      "image/svg+xml": [
       "<?xml version=\"1.0\" encoding=\"UTF-8\" standalone=\"no\"?>\n",
       "<!DOCTYPE svg PUBLIC \"-//W3C//DTD SVG 1.1//EN\"\n",
       " \"http://www.w3.org/Graphics/SVG/1.1/DTD/svg11.dtd\">\n",
       "<!-- Generated by graphviz version 2.40.1 (20161225.0304)\n",
       " -->\n",
       "<!-- Title: %3 Pages: 1 -->\n",
       "<svg width=\"125pt\" height=\"52pt\"\n",
       " viewBox=\"0.00 0.00 125.00 52.00\" xmlns=\"http://www.w3.org/2000/svg\" xmlns:xlink=\"http://www.w3.org/1999/xlink\">\n",
       "<g id=\"graph0\" class=\"graph\" transform=\"scale(1 1) rotate(0) translate(4 48)\">\n",
       "<title>%3</title>\n",
       "<polygon fill=\"#ffffff\" stroke=\"transparent\" points=\"-4,4 -4,-48 121,-48 121,4 -4,4\"/>\n",
       "<!-- 0 -->\n",
       "<g id=\"node1\" class=\"node\">\n",
       "<title>0</title>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"58,-14.5442 58,-29.4558 42.1838,-40 19.8162,-40 4,-29.4558 4,-14.5442 19.8162,-4 42.1838,-4 58,-14.5442\"/>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"62,-12.4034 62,-31.5966 43.3949,-44 18.6051,-44 0,-31.5966 0,-12.4034 18.6051,0 43.3949,0 62,-12.4034\"/>\n",
       "<text text-anchor=\"middle\" x=\"31\" y=\"-18.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;0 -->\n",
       "<g id=\"edge1\" class=\"edge\">\n",
       "<title>0&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M62.102,-25.9365C72.0865,-25.8962 80,-24.584 80,-22 80,-20.385 76.9088,-19.2668 72.1528,-18.6454\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"72.2876,-15.1475 62.102,-18.0635 71.8829,-22.1358 72.2876,-15.1475\"/>\n",
       "<text text-anchor=\"middle\" x=\"84.5\" y=\"-18.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;0 -->\n",
       "<g id=\"edge2\" class=\"edge\">\n",
       "<title>0&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M62.0137,-29.3828C80.5521,-31.0234 98,-28.5625 98,-22 98,-16.668 86.4816,-14.0436 72.2187,-14.1269\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"71.8342,-10.6413 62.0137,-14.6172 72.1701,-17.6332 71.8342,-10.6413\"/>\n",
       "<text text-anchor=\"middle\" x=\"103\" y=\"-18.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "</g>\n",
       "</svg>\n"
      ],
      "text/plain": [
       "<graphviz.dot.Digraph at 0x7f41a068aa00>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "avg epochs 1.02 min epochs 1 max epochs 3 std epochs 1.198997487421324 avg loss at epoch 0 1.3925223922729493 avg loss when fit 0.9185943812131881\n"
     ]
    },
    {
     "data": {
      "image/svg+xml": [
       "<?xml version=\"1.0\" encoding=\"UTF-8\" standalone=\"no\"?>\n",
       "<!DOCTYPE svg PUBLIC \"-//W3C//DTD SVG 1.1//EN\"\n",
       " \"http://www.w3.org/Graphics/SVG/1.1/DTD/svg11.dtd\">\n",
       "<!-- Generated by graphviz version 2.40.1 (20161225.0304)\n",
       " -->\n",
       "<!-- Title: %3 Pages: 1 -->\n",
       "<svg width=\"112pt\" height=\"139pt\"\n",
       " viewBox=\"0.00 0.00 112.00 139.00\" xmlns=\"http://www.w3.org/2000/svg\" xmlns:xlink=\"http://www.w3.org/1999/xlink\">\n",
       "<g id=\"graph0\" class=\"graph\" transform=\"scale(1 1) rotate(0) translate(4 135)\">\n",
       "<title>%3</title>\n",
       "<polygon fill=\"#ffffff\" stroke=\"transparent\" points=\"-4,4 -4,-135 108,-135 108,4 -4,4\"/>\n",
       "<!-- 0 -->\n",
       "<g id=\"node1\" class=\"node\">\n",
       "<title>0</title>\n",
       "<ellipse fill=\"none\" stroke=\"#000000\" cx=\"27\" cy=\"-22\" rx=\"18\" ry=\"18\"/>\n",
       "<ellipse fill=\"none\" stroke=\"#000000\" cx=\"27\" cy=\"-22\" rx=\"22\" ry=\"22\"/>\n",
       "<text text-anchor=\"middle\" x=\"27\" y=\"-18.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;0 -->\n",
       "<g id=\"edge1\" class=\"edge\">\n",
       "<title>0&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M48.8066,-26.2451C58.5625,-26.6494 67,-25.2344 67,-22 67,-19.9785 63.7041,-18.6677 58.8504,-18.0676\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"58.9107,-14.5679 48.8066,-17.7549 58.6928,-21.5645 58.9107,-14.5679\"/>\n",
       "<text text-anchor=\"middle\" x=\"71.5\" y=\"-18.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;0 -->\n",
       "<g id=\"edge2\" class=\"edge\">\n",
       "<title>0&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M47.813,-29.2015C65.8838,-32.4865 85,-30.0859 85,-22 85,-15.4302 72.3803,-12.6136 57.9552,-13.5503\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"57.3106,-10.1032 47.813,-14.7985 58.1656,-17.0508 57.3106,-10.1032\"/>\n",
       "<text text-anchor=\"middle\" x=\"90\" y=\"-18.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 1 -->\n",
       "<g id=\"node2\" class=\"node\">\n",
       "<title>1</title>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"54,-105.5442 54,-120.4558 38.1838,-131 15.8162,-131 0,-120.4558 0,-105.5442 15.8162,-95 38.1838,-95 54,-105.5442\"/>\n",
       "<text text-anchor=\"middle\" x=\"27\" y=\"-109.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;0 -->\n",
       "<g id=\"edge3\" class=\"edge\">\n",
       "<title>1&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M17.7658,-94.7573C15.4038,-89.1988 13.1951,-82.9754 12,-77 10.3165,-68.5823 11.4955,-59.5551 13.7908,-51.2977\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"17.1484,-52.2941 17.0266,-41.6999 10.5152,-50.0577 17.1484,-52.2941\"/>\n",
       "<text text-anchor=\"middle\" x=\"16.5\" y=\"-65.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;0 -->\n",
       "<g id=\"edge4\" class=\"edge\">\n",
       "<title>1&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M27,-94.5848C27,-83.1105 27,-68.0231 27,-54.5774\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"30.5001,-54.2465 27,-44.2465 23.5001,-54.2466 30.5001,-54.2465\"/>\n",
       "<text text-anchor=\"middle\" x=\"32\" y=\"-65.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "</g>\n",
       "</svg>\n"
      ],
      "text/plain": [
       "<graphviz.dot.Digraph at 0x7f41a068ab80>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "avg epochs 1.9300000000000002 min epochs 1 max epochs 6 std epochs 2.2021231218140676 avg loss at epoch 0 1.3965786254405976 avg loss when fit 0.8911880993843079\n"
     ]
    },
    {
     "data": {
      "image/svg+xml": [
       "<?xml version=\"1.0\" encoding=\"UTF-8\" standalone=\"no\"?>\n",
       "<!DOCTYPE svg PUBLIC \"-//W3C//DTD SVG 1.1//EN\"\n",
       " \"http://www.w3.org/Graphics/SVG/1.1/DTD/svg11.dtd\">\n",
       "<!-- Generated by graphviz version 2.40.1 (20161225.0304)\n",
       " -->\n",
       "<!-- Title: %3 Pages: 1 -->\n",
       "<svg width=\"112pt\" height=\"139pt\"\n",
       " viewBox=\"0.00 0.00 112.00 139.00\" xmlns=\"http://www.w3.org/2000/svg\" xmlns:xlink=\"http://www.w3.org/1999/xlink\">\n",
       "<g id=\"graph0\" class=\"graph\" transform=\"scale(1 1) rotate(0) translate(4 135)\">\n",
       "<title>%3</title>\n",
       "<polygon fill=\"#ffffff\" stroke=\"transparent\" points=\"-4,4 -4,-135 108,-135 108,4 -4,4\"/>\n",
       "<!-- 0 -->\n",
       "<g id=\"node1\" class=\"node\">\n",
       "<title>0</title>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"58,-101.5442 58,-116.4558 42.1838,-127 19.8162,-127 4,-116.4558 4,-101.5442 19.8162,-91 42.1838,-91 58,-101.5442\"/>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"62,-99.4034 62,-118.5966 43.3949,-131 18.6051,-131 0,-118.5966 0,-99.4034 18.6051,-87 43.3949,-87 62,-99.4034\"/>\n",
       "<text text-anchor=\"middle\" x=\"31\" y=\"-105.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 1 -->\n",
       "<g id=\"node2\" class=\"node\">\n",
       "<title>1</title>\n",
       "<ellipse fill=\"none\" stroke=\"#000000\" cx=\"31\" cy=\"-18\" rx=\"18\" ry=\"18\"/>\n",
       "<text text-anchor=\"middle\" x=\"31\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;1 -->\n",
       "<g id=\"edge1\" class=\"edge\">\n",
       "<title>0&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M20.1345,-86.954C16.4722,-76.9682 13.8066,-64.9668 16,-54 16.6984,-50.5081 17.7429,-46.9315 18.9619,-43.4525\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"22.2557,-44.6417 22.7167,-34.0569 15.7556,-42.044 22.2557,-44.6417\"/>\n",
       "<text text-anchor=\"middle\" x=\"20.5\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;1 -->\n",
       "<g id=\"edge2\" class=\"edge\">\n",
       "<title>0&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M31,-86.9714C31,-74.8075 31,-59.5615 31,-46.499\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"34.5001,-46.1556 31,-36.1556 27.5001,-46.1556 34.5001,-46.1556\"/>\n",
       "<text text-anchor=\"middle\" x=\"36\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;1 -->\n",
       "<g id=\"edge3\" class=\"edge\">\n",
       "<title>1&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M48.7817,-21.775C58.3149,-22.4165 67,-21.1582 67,-18 67,-16.0755 63.7749,-14.8564 59.0981,-14.3429\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"58.8211,-10.8396 48.7817,-14.225 58.741,-17.8391 58.8211,-10.8396\"/>\n",
       "<text text-anchor=\"middle\" x=\"71.5\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;1 -->\n",
       "<g id=\"edge4\" class=\"edge\">\n",
       "<title>1&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M48.1418,-24.1447C65.585,-27.7592 85,-25.7109 85,-18 85,-11.7951 72.4283,-9.2569 58.4287,-10.3855\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"57.5461,-6.976 48.1418,-11.8553 58.5363,-13.9056 57.5461,-6.976\"/>\n",
       "<text text-anchor=\"middle\" x=\"90\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "</g>\n",
       "</svg>\n"
      ],
      "text/plain": [
       "<graphviz.dot.Digraph at 0x7f41a068ac40>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "avg epochs 2.0 min epochs 1 max epochs 8 std epochs 2.3490737563232043 avg loss at epoch 0 1.3975653278827667 avg loss when fit 0.8985250204801559\n"
     ]
    },
    {
     "data": {
      "image/svg+xml": [
       "<?xml version=\"1.0\" encoding=\"UTF-8\" standalone=\"no\"?>\n",
       "<!DOCTYPE svg PUBLIC \"-//W3C//DTD SVG 1.1//EN\"\n",
       " \"http://www.w3.org/Graphics/SVG/1.1/DTD/svg11.dtd\">\n",
       "<!-- Generated by graphviz version 2.40.1 (20161225.0304)\n",
       " -->\n",
       "<!-- Title: %3 Pages: 1 -->\n",
       "<svg width=\"85pt\" height=\"139pt\"\n",
       " viewBox=\"0.00 0.00 84.59 139.00\" xmlns=\"http://www.w3.org/2000/svg\" xmlns:xlink=\"http://www.w3.org/1999/xlink\">\n",
       "<g id=\"graph0\" class=\"graph\" transform=\"scale(1 1) rotate(0) translate(4 135)\">\n",
       "<title>%3</title>\n",
       "<polygon fill=\"#ffffff\" stroke=\"transparent\" points=\"-4,4 -4,-135 80.5906,-135 80.5906,4 -4,4\"/>\n",
       "<!-- 0 -->\n",
       "<g id=\"node1\" class=\"node\">\n",
       "<title>0</title>\n",
       "<ellipse fill=\"none\" stroke=\"#000000\" cx=\"49.5906\" cy=\"-109\" rx=\"18\" ry=\"18\"/>\n",
       "<ellipse fill=\"none\" stroke=\"#000000\" cx=\"49.5906\" cy=\"-109\" rx=\"22\" ry=\"22\"/>\n",
       "<text text-anchor=\"middle\" x=\"49.5906\" y=\"-105.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 1 -->\n",
       "<g id=\"node2\" class=\"node\">\n",
       "<title>1</title>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"76.5906,-10.5442 76.5906,-25.4558 60.7744,-36 38.4069,-36 22.5906,-25.4558 22.5906,-10.5442 38.4069,0 60.7744,0 76.5906,-10.5442\"/>\n",
       "<text text-anchor=\"middle\" x=\"49.5906\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;1 -->\n",
       "<g id=\"edge1\" class=\"edge\">\n",
       "<title>0&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M30.0239,-98.6189C13.5164,-88.3622 -6.1387,-71.682 2.5906,-54 6.3017,-46.4829 12.4189,-40.1015 19.0324,-34.8951\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"21.3556,-37.5406 27.5311,-28.9317 17.3348,-31.8105 21.3556,-37.5406\"/>\n",
       "<text text-anchor=\"middle\" x=\"7.0906\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;1 -->\n",
       "<g id=\"edge2\" class=\"edge\">\n",
       "<title>0&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M39.6172,-89.3001C35.5182,-78.8865 32.2226,-65.8403 34.5906,-54 35.1321,-51.2924 35.8818,-48.5339 36.7595,-45.8093\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"40.1132,-46.8347 40.3564,-36.2427 33.561,-44.3712 40.1132,-46.8347\"/>\n",
       "<text text-anchor=\"middle\" x=\"39.5906\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;0 -->\n",
       "<g id=\"edge3\" class=\"edge\">\n",
       "<title>1&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M49.5906,-36.1556C49.5906,-47.8111 49.5906,-63.2722 49.5906,-76.9511\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"46.0907,-76.9714 49.5906,-86.9714 53.0907,-76.9715 46.0907,-76.9714\"/>\n",
       "<text text-anchor=\"middle\" x=\"54.0906\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;0 -->\n",
       "<g id=\"edge4\" class=\"edge\">\n",
       "<title>1&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M57.5995,-36.3492C59.6467,-41.9107 61.5596,-48.109 62.5906,-54 64.0179,-62.1547 63.0922,-70.9086 61.2094,-78.9809\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"57.8017,-78.1679 58.4179,-88.7448 64.532,-80.0922 57.8017,-78.1679\"/>\n",
       "<text text-anchor=\"middle\" x=\"67.5906\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "</g>\n",
       "</svg>\n"
      ],
      "text/plain": [
       "<graphviz.dot.Digraph at 0x7f41a068ab50>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "avg epochs 2.6100000000000003 min epochs 1 max epochs 6 std epochs 2.4205280708243677 avg loss at epoch 0 1.387124490737915 avg loss when fit 0.9513023608922958\n"
     ]
    },
    {
     "data": {
      "image/svg+xml": [
       "<?xml version=\"1.0\" encoding=\"UTF-8\" standalone=\"no\"?>\n",
       "<!DOCTYPE svg PUBLIC \"-//W3C//DTD SVG 1.1//EN\"\n",
       " \"http://www.w3.org/Graphics/SVG/1.1/DTD/svg11.dtd\">\n",
       "<!-- Generated by graphviz version 2.40.1 (20161225.0304)\n",
       " -->\n",
       "<!-- Title: %3 Pages: 1 -->\n",
       "<svg width=\"88pt\" height=\"139pt\"\n",
       " viewBox=\"0.00 0.00 88.48 139.00\" xmlns=\"http://www.w3.org/2000/svg\" xmlns:xlink=\"http://www.w3.org/1999/xlink\">\n",
       "<g id=\"graph0\" class=\"graph\" transform=\"scale(1 1) rotate(0) translate(4 135)\">\n",
       "<title>%3</title>\n",
       "<polygon fill=\"#ffffff\" stroke=\"transparent\" points=\"-4,4 -4,-135 84.4814,-135 84.4814,4 -4,4\"/>\n",
       "<!-- 0 -->\n",
       "<g id=\"node1\" class=\"node\">\n",
       "<title>0</title>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"76.4814,-101.5442 76.4814,-116.4558 60.6652,-127 38.2976,-127 22.4814,-116.4558 22.4814,-101.5442 38.2976,-91 60.6652,-91 76.4814,-101.5442\"/>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"80.4814,-99.4034 80.4814,-118.5966 61.8763,-131 37.0865,-131 18.4814,-118.5966 18.4814,-99.4034 37.0865,-87 61.8763,-87 80.4814,-99.4034\"/>\n",
       "<text text-anchor=\"middle\" x=\"49.4814\" y=\"-105.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 1 -->\n",
       "<g id=\"node2\" class=\"node\">\n",
       "<title>1</title>\n",
       "<ellipse fill=\"none\" stroke=\"#000000\" cx=\"49.4814\" cy=\"-18\" rx=\"18\" ry=\"18\"/>\n",
       "<text text-anchor=\"middle\" x=\"49.4814\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;1 -->\n",
       "<g id=\"edge1\" class=\"edge\">\n",
       "<title>0&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M24.4817,-95.0681C9.4835,-84.7382 -5.3027,-69.7674 2.4814,-54 7.1416,-44.5604 15.596,-36.9117 24.0627,-31.1317\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"26.0556,-34.0149 32.7318,-25.7882 22.3825,-28.0559 26.0556,-34.0149\"/>\n",
       "<text text-anchor=\"middle\" x=\"6.9814\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;1 -->\n",
       "<g id=\"edge2\" class=\"edge\">\n",
       "<title>0&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M38.6159,-86.954C34.9536,-76.9682 32.288,-64.9668 34.4814,-54 35.1798,-50.5081 36.2243,-46.9315 37.4433,-43.4525\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"40.7371,-44.6417 41.1981,-34.0569 34.237,-42.044 40.7371,-44.6417\"/>\n",
       "<text text-anchor=\"middle\" x=\"39.4814\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;0 -->\n",
       "<g id=\"edge3\" class=\"edge\">\n",
       "<title>1&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M49.4814,-36.1556C49.4814,-47.8111 49.4814,-63.2722 49.4814,-76.9511\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"45.9815,-76.9714 49.4814,-86.9714 52.9815,-76.9715 45.9815,-76.9714\"/>\n",
       "<text text-anchor=\"middle\" x=\"53.9814\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;0 -->\n",
       "<g id=\"edge4\" class=\"edge\">\n",
       "<title>1&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M56.804,-34.5202C59.1015,-40.5295 61.3358,-47.4545 62.4814,-54 63.7955,-61.5083 63.1149,-69.5247 61.5291,-77.0492\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"58.0941,-76.3478 58.9081,-86.9113 64.8593,-78.1458 58.0941,-76.3478\"/>\n",
       "<text text-anchor=\"middle\" x=\"67.4814\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "</g>\n",
       "</svg>\n"
      ],
      "text/plain": [
       "<graphviz.dot.Digraph at 0x7f41a068aeb0>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "avg epochs 2.6100000000000003 min epochs 1 max epochs 6 std epochs 2.333379165878933 avg loss at epoch 0 1.401513180732727 avg loss when fit 0.9501019644737244\n"
     ]
    },
    {
     "data": {
      "image/svg+xml": [
       "<?xml version=\"1.0\" encoding=\"UTF-8\" standalone=\"no\"?>\n",
       "<!DOCTYPE svg PUBLIC \"-//W3C//DTD SVG 1.1//EN\"\n",
       " \"http://www.w3.org/Graphics/SVG/1.1/DTD/svg11.dtd\">\n",
       "<!-- Generated by graphviz version 2.40.1 (20161225.0304)\n",
       " -->\n",
       "<!-- Title: %3 Pages: 1 -->\n",
       "<svg width=\"112pt\" height=\"139pt\"\n",
       " viewBox=\"0.00 0.00 112.00 139.00\" xmlns=\"http://www.w3.org/2000/svg\" xmlns:xlink=\"http://www.w3.org/1999/xlink\">\n",
       "<g id=\"graph0\" class=\"graph\" transform=\"scale(1 1) rotate(0) translate(4 135)\">\n",
       "<title>%3</title>\n",
       "<polygon fill=\"#ffffff\" stroke=\"transparent\" points=\"-4,4 -4,-135 108,-135 108,4 -4,4\"/>\n",
       "<!-- 0 -->\n",
       "<g id=\"node1\" class=\"node\">\n",
       "<title>0</title>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"58,-101.5442 58,-116.4558 42.1838,-127 19.8162,-127 4,-116.4558 4,-101.5442 19.8162,-91 42.1838,-91 58,-101.5442\"/>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"62,-99.4034 62,-118.5966 43.3949,-131 18.6051,-131 0,-118.5966 0,-99.4034 18.6051,-87 43.3949,-87 62,-99.4034\"/>\n",
       "<text text-anchor=\"middle\" x=\"31\" y=\"-105.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;0 -->\n",
       "<g id=\"edge2\" class=\"edge\">\n",
       "<title>0&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M62.102,-117.6229C72.0865,-117.5345 80,-114.6602 80,-109 80,-105.4624 76.9088,-103.013 72.1528,-101.6519\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"72.4629,-98.1633 62.102,-100.3771 71.5821,-105.1076 72.4629,-98.1633\"/>\n",
       "<text text-anchor=\"middle\" x=\"85\" y=\"-105.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 1 -->\n",
       "<g id=\"node2\" class=\"node\">\n",
       "<title>1</title>\n",
       "<ellipse fill=\"none\" stroke=\"#000000\" cx=\"31\" cy=\"-18\" rx=\"18\" ry=\"18\"/>\n",
       "<text text-anchor=\"middle\" x=\"31\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;1 -->\n",
       "<g id=\"edge1\" class=\"edge\">\n",
       "<title>0&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M31,-86.9714C31,-74.8075 31,-59.5615 31,-46.499\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"34.5001,-46.1556 31,-36.1556 27.5001,-46.1556 34.5001,-46.1556\"/>\n",
       "<text text-anchor=\"middle\" x=\"35.5\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;1 -->\n",
       "<g id=\"edge3\" class=\"edge\">\n",
       "<title>1&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M48.7817,-21.775C58.3149,-22.4165 67,-21.1582 67,-18 67,-16.0755 63.7749,-14.8564 59.0981,-14.3429\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"58.8211,-10.8396 48.7817,-14.225 58.741,-17.8391 58.8211,-10.8396\"/>\n",
       "<text text-anchor=\"middle\" x=\"71.5\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;1 -->\n",
       "<g id=\"edge4\" class=\"edge\">\n",
       "<title>1&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M48.1418,-24.1447C65.585,-27.7592 85,-25.7109 85,-18 85,-11.7951 72.4283,-9.2569 58.4287,-10.3855\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"57.5461,-6.976 48.1418,-11.8553 58.5363,-13.9056 57.5461,-6.976\"/>\n",
       "<text text-anchor=\"middle\" x=\"90\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "</g>\n",
       "</svg>\n"
      ],
      "text/plain": [
       "<graphviz.dot.Digraph at 0x7f41a068a970>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "avg epochs 3.73 min epochs 1 max epochs 13 std epochs 3.7453779339100106 avg loss at epoch 0 1.4002061438560487 avg loss when fit 0.7947436776757241\n"
     ]
    },
    {
     "data": {
      "image/svg+xml": [
       "<?xml version=\"1.0\" encoding=\"UTF-8\" standalone=\"no\"?>\n",
       "<!DOCTYPE svg PUBLIC \"-//W3C//DTD SVG 1.1//EN\"\n",
       " \"http://www.w3.org/Graphics/SVG/1.1/DTD/svg11.dtd\">\n",
       "<!-- Generated by graphviz version 2.40.1 (20161225.0304)\n",
       " -->\n",
       "<!-- Title: %3 Pages: 1 -->\n",
       "<svg width=\"85pt\" height=\"139pt\"\n",
       " viewBox=\"0.00 0.00 85.33 139.00\" xmlns=\"http://www.w3.org/2000/svg\" xmlns:xlink=\"http://www.w3.org/1999/xlink\">\n",
       "<g id=\"graph0\" class=\"graph\" transform=\"scale(1 1) rotate(0) translate(4 135)\">\n",
       "<title>%3</title>\n",
       "<polygon fill=\"#ffffff\" stroke=\"transparent\" points=\"-4,4 -4,-135 81.3273,-135 81.3273,4 -4,4\"/>\n",
       "<!-- 0 -->\n",
       "<g id=\"node1\" class=\"node\">\n",
       "<title>0</title>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"59.3273,-101.5442 59.3273,-116.4558 43.5111,-127 21.1436,-127 5.3273,-116.4558 5.3273,-101.5442 21.1436,-91 43.5111,-91 59.3273,-101.5442\"/>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"63.3273,-99.4034 63.3273,-118.5966 44.7222,-131 19.9325,-131 1.3273,-118.5966 1.3273,-99.4034 19.9325,-87 44.7222,-87 63.3273,-99.4034\"/>\n",
       "<text text-anchor=\"middle\" x=\"32.3273\" y=\"-105.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 1 -->\n",
       "<g id=\"node2\" class=\"node\">\n",
       "<title>1</title>\n",
       "<ellipse fill=\"none\" stroke=\"#000000\" cx=\"32.3273\" cy=\"-18\" rx=\"18\" ry=\"18\"/>\n",
       "<text text-anchor=\"middle\" x=\"32.3273\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;1 -->\n",
       "<g id=\"edge1\" class=\"edge\">\n",
       "<title>0&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M14.0086,-90.606C8.8906,-84.2826 4.0008,-76.814 1.3273,-69 -2.5641,-57.6263 3.4383,-46.0871 11.1662,-36.8684\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"13.8732,-39.0996 18.1963,-29.4269 8.7848,-34.2925 13.8732,-39.0996\"/>\n",
       "<text text-anchor=\"middle\" x=\"5.8273\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;1 -->\n",
       "<g id=\"edge2\" class=\"edge\">\n",
       "<title>0&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M32.3273,-86.9714C32.3273,-74.8075 32.3273,-59.5615 32.3273,-46.499\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"35.8274,-46.1556 32.3273,-36.1556 28.8274,-46.1556 35.8274,-46.1556\"/>\n",
       "<text text-anchor=\"middle\" x=\"37.3273\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;0 -->\n",
       "<g id=\"edge4\" class=\"edge\">\n",
       "<title>1&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M38.6443,-34.9737C40.5474,-40.9055 42.3812,-47.6657 43.3273,-54 44.4449,-61.482 43.8712,-69.488 42.5297,-77.0109\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"39.0908,-76.3511 40.3114,-86.8754 45.9202,-77.887 39.0908,-76.3511\"/>\n",
       "<text text-anchor=\"middle\" x=\"48.3273\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;1 -->\n",
       "<g id=\"edge3\" class=\"edge\">\n",
       "<title>1&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M48.9914,-25.3828C58.9523,-27.0234 68.3273,-24.5625 68.3273,-18 68.3273,-13.7959 64.4798,-11.2751 59.0956,-10.4375\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"58.9276,-6.9399 48.9914,-10.6172 59.0521,-13.9388 58.9276,-6.9399\"/>\n",
       "<text text-anchor=\"middle\" x=\"72.8273\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "</g>\n",
       "</svg>\n"
      ],
      "text/plain": [
       "<graphviz.dot.Digraph at 0x7f41a068adf0>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "avg epochs 4.01 min epochs 1 max epochs 9 std epochs 3.7838642208268705 avg loss at epoch 0 1.398785378932953 avg loss when fit 0.8564903074502945\n"
     ]
    },
    {
     "data": {
      "image/svg+xml": [
       "<?xml version=\"1.0\" encoding=\"UTF-8\" standalone=\"no\"?>\n",
       "<!DOCTYPE svg PUBLIC \"-//W3C//DTD SVG 1.1//EN\"\n",
       " \"http://www.w3.org/Graphics/SVG/1.1/DTD/svg11.dtd\">\n",
       "<!-- Generated by graphviz version 2.40.1 (20161225.0304)\n",
       " -->\n",
       "<!-- Title: %3 Pages: 1 -->\n",
       "<svg width=\"112pt\" height=\"139pt\"\n",
       " viewBox=\"0.00 0.00 112.00 139.00\" xmlns=\"http://www.w3.org/2000/svg\" xmlns:xlink=\"http://www.w3.org/1999/xlink\">\n",
       "<g id=\"graph0\" class=\"graph\" transform=\"scale(1 1) rotate(0) translate(4 135)\">\n",
       "<title>%3</title>\n",
       "<polygon fill=\"#ffffff\" stroke=\"transparent\" points=\"-4,4 -4,-135 108,-135 108,4 -4,4\"/>\n",
       "<!-- 0 -->\n",
       "<g id=\"node1\" class=\"node\">\n",
       "<title>0</title>\n",
       "<ellipse fill=\"none\" stroke=\"#000000\" cx=\"27\" cy=\"-22\" rx=\"18\" ry=\"18\"/>\n",
       "<ellipse fill=\"none\" stroke=\"#000000\" cx=\"27\" cy=\"-22\" rx=\"22\" ry=\"22\"/>\n",
       "<text text-anchor=\"middle\" x=\"27\" y=\"-18.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;0 -->\n",
       "<g id=\"edge1\" class=\"edge\">\n",
       "<title>0&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M48.8066,-26.2451C58.5625,-26.6494 67,-25.2344 67,-22 67,-19.9785 63.7041,-18.6677 58.8504,-18.0676\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"58.9107,-14.5679 48.8066,-17.7549 58.6928,-21.5645 58.9107,-14.5679\"/>\n",
       "<text text-anchor=\"middle\" x=\"71.5\" y=\"-18.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;0 -->\n",
       "<g id=\"edge2\" class=\"edge\">\n",
       "<title>0&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M47.813,-29.2015C65.8838,-32.4865 85,-30.0859 85,-22 85,-15.4302 72.3803,-12.6136 57.9552,-13.5503\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"57.3106,-10.1032 47.813,-14.7985 58.1656,-17.0508 57.3106,-10.1032\"/>\n",
       "<text text-anchor=\"middle\" x=\"90\" y=\"-18.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 1 -->\n",
       "<g id=\"node2\" class=\"node\">\n",
       "<title>1</title>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"54,-105.5442 54,-120.4558 38.1838,-131 15.8162,-131 0,-120.4558 0,-105.5442 15.8162,-95 38.1838,-95 54,-105.5442\"/>\n",
       "<text text-anchor=\"middle\" x=\"27\" y=\"-109.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;0 -->\n",
       "<g id=\"edge4\" class=\"edge\">\n",
       "<title>1&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M27,-94.5848C27,-83.1105 27,-68.0231 27,-54.5774\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"30.5001,-54.2465 27,-44.2465 23.5001,-54.2466 30.5001,-54.2465\"/>\n",
       "<text text-anchor=\"middle\" x=\"32\" y=\"-65.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;1 -->\n",
       "<g id=\"edge3\" class=\"edge\">\n",
       "<title>1&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M53.7949,-120.8577C63.7804,-121.1153 72,-118.4961 72,-113 72,-109.5649 68.7892,-107.2537 63.9433,-106.0661\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"64.071,-102.5634 53.7949,-105.1423 63.4363,-109.5346 64.071,-102.5634\"/>\n",
       "<text text-anchor=\"middle\" x=\"76.5\" y=\"-109.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "</g>\n",
       "</svg>\n"
      ],
      "text/plain": [
       "<graphviz.dot.Digraph at 0x7f41a068ac10>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "avg epochs 4.43 min epochs 1 max epochs 13 std epochs 4.027391616557065 avg loss at epoch 0 1.3896378016471862 avg loss when fit 0.7640904745459557\n"
     ]
    },
    {
     "data": {
      "image/svg+xml": [
       "<?xml version=\"1.0\" encoding=\"UTF-8\" standalone=\"no\"?>\n",
       "<!DOCTYPE svg PUBLIC \"-//W3C//DTD SVG 1.1//EN\"\n",
       " \"http://www.w3.org/Graphics/SVG/1.1/DTD/svg11.dtd\">\n",
       "<!-- Generated by graphviz version 2.40.1 (20161225.0304)\n",
       " -->\n",
       "<!-- Title: %3 Pages: 1 -->\n",
       "<svg width=\"91pt\" height=\"139pt\"\n",
       " viewBox=\"0.00 0.00 90.78 139.00\" xmlns=\"http://www.w3.org/2000/svg\" xmlns:xlink=\"http://www.w3.org/1999/xlink\">\n",
       "<g id=\"graph0\" class=\"graph\" transform=\"scale(1 1) rotate(0) translate(4 135)\">\n",
       "<title>%3</title>\n",
       "<polygon fill=\"#ffffff\" stroke=\"transparent\" points=\"-4,4 -4,-135 86.783,-135 86.783,4 -4,4\"/>\n",
       "<!-- 0 -->\n",
       "<g id=\"node1\" class=\"node\">\n",
       "<title>0</title>\n",
       "<ellipse fill=\"none\" stroke=\"#000000\" cx=\"33.783\" cy=\"-109\" rx=\"18\" ry=\"18\"/>\n",
       "<ellipse fill=\"none\" stroke=\"#000000\" cx=\"33.783\" cy=\"-109\" rx=\"22\" ry=\"22\"/>\n",
       "<text text-anchor=\"middle\" x=\"33.783\" y=\"-105.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;0 -->\n",
       "<g id=\"edge1\" class=\"edge\">\n",
       "<title>0&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M54.3638,-117.3702C64.6277,-118.5284 73.783,-115.7383 73.783,-109 73.783,-104.6833 70.0256,-101.9869 64.6265,-100.9109\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"64.4559,-97.405 54.3638,-100.6298 64.2641,-104.4024 64.4559,-97.405\"/>\n",
       "<text text-anchor=\"middle\" x=\"78.283\" y=\"-105.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 1 -->\n",
       "<g id=\"node2\" class=\"node\">\n",
       "<title>1</title>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"60.783,-10.5442 60.783,-25.4558 44.9667,-36 22.5992,-36 6.783,-25.4558 6.783,-10.5442 22.5992,0 44.9667,0 60.783,-10.5442\"/>\n",
       "<text text-anchor=\"middle\" x=\"33.783\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;1 -->\n",
       "<g id=\"edge2\" class=\"edge\">\n",
       "<title>0&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M17.5898,-93.8165C11.3846,-86.9145 5.021,-78.2311 1.783,-69 -1.783,-58.8344 2.7088,-48.588 9.3483,-39.9734\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"12.1633,-42.0742 16.1792,-32.27 6.9258,-37.4299 12.1633,-42.0742\"/>\n",
       "<text text-anchor=\"middle\" x=\"6.783\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;0 -->\n",
       "<g id=\"edge3\" class=\"edge\">\n",
       "<title>1&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M33.783,-36.1556C33.783,-47.8111 33.783,-63.2722 33.783,-76.9511\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"30.2831,-76.9714 33.783,-86.9714 37.2831,-76.9715 30.2831,-76.9714\"/>\n",
       "<text text-anchor=\"middle\" x=\"38.283\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;0 -->\n",
       "<g id=\"edge4\" class=\"edge\">\n",
       "<title>1&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M39.8444,-36.1134C41.4588,-41.7745 42.977,-48.087 43.783,-54 44.8493,-61.823 44.2281,-70.2281 42.8841,-78.0554\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"39.4443,-77.4047 40.7823,-87.9147 46.2904,-78.8642 39.4443,-77.4047\"/>\n",
       "<text text-anchor=\"middle\" x=\"48.783\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "</g>\n",
       "</svg>\n"
      ],
      "text/plain": [
       "<graphviz.dot.Digraph at 0x7f41a068af40>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "avg epochs 4.52 min epochs 1 max epochs 13 std epochs 4.195246469366644 avg loss at epoch 0 1.401658388376236 avg loss when fit 0.8417020487785339\n"
     ]
    },
    {
     "data": {
      "image/svg+xml": [
       "<?xml version=\"1.0\" encoding=\"UTF-8\" standalone=\"no\"?>\n",
       "<!DOCTYPE svg PUBLIC \"-//W3C//DTD SVG 1.1//EN\"\n",
       " \"http://www.w3.org/Graphics/SVG/1.1/DTD/svg11.dtd\">\n",
       "<!-- Generated by graphviz version 2.40.1 (20161225.0304)\n",
       " -->\n",
       "<!-- Title: %3 Pages: 1 -->\n",
       "<svg width=\"98pt\" height=\"139pt\"\n",
       " viewBox=\"0.00 0.00 98.00 139.00\" xmlns=\"http://www.w3.org/2000/svg\" xmlns:xlink=\"http://www.w3.org/1999/xlink\">\n",
       "<g id=\"graph0\" class=\"graph\" transform=\"scale(1 1) rotate(0) translate(4 135)\">\n",
       "<title>%3</title>\n",
       "<polygon fill=\"#ffffff\" stroke=\"transparent\" points=\"-4,4 -4,-135 94,-135 94,4 -4,4\"/>\n",
       "<!-- 0 -->\n",
       "<g id=\"node1\" class=\"node\">\n",
       "<title>0</title>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"58,-101.5442 58,-116.4558 42.1838,-127 19.8162,-127 4,-116.4558 4,-101.5442 19.8162,-91 42.1838,-91 58,-101.5442\"/>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"62,-99.4034 62,-118.5966 43.3949,-131 18.6051,-131 0,-118.5966 0,-99.4034 18.6051,-87 43.3949,-87 62,-99.4034\"/>\n",
       "<text text-anchor=\"middle\" x=\"31\" y=\"-105.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;0 -->\n",
       "<g id=\"edge2\" class=\"edge\">\n",
       "<title>0&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M62.102,-117.6229C72.0865,-117.5345 80,-114.6602 80,-109 80,-105.4624 76.9088,-103.013 72.1528,-101.6519\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"72.4629,-98.1633 62.102,-100.3771 71.5821,-105.1076 72.4629,-98.1633\"/>\n",
       "<text text-anchor=\"middle\" x=\"85\" y=\"-105.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 1 -->\n",
       "<g id=\"node2\" class=\"node\">\n",
       "<title>1</title>\n",
       "<ellipse fill=\"none\" stroke=\"#000000\" cx=\"31\" cy=\"-18\" rx=\"18\" ry=\"18\"/>\n",
       "<text text-anchor=\"middle\" x=\"31\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;1 -->\n",
       "<g id=\"edge1\" class=\"edge\">\n",
       "<title>0&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M20.1345,-86.954C16.4722,-76.9682 13.8066,-64.9668 16,-54 16.6984,-50.5081 17.7429,-46.9315 18.9619,-43.4525\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"22.2557,-44.6417 22.7167,-34.0569 15.7556,-42.044 22.2557,-44.6417\"/>\n",
       "<text text-anchor=\"middle\" x=\"20.5\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;0 -->\n",
       "<g id=\"edge3\" class=\"edge\">\n",
       "<title>1&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M31,-36.1556C31,-47.8111 31,-63.2722 31,-76.9511\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"27.5001,-76.9714 31,-86.9714 34.5001,-76.9715 27.5001,-76.9714\"/>\n",
       "<text text-anchor=\"middle\" x=\"35.5\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;1 -->\n",
       "<g id=\"edge4\" class=\"edge\">\n",
       "<title>1&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M47.6641,-25.3828C57.625,-27.0234 67,-24.5625 67,-18 67,-13.7959 63.1525,-11.2751 57.7682,-10.4375\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"57.6002,-6.9399 47.6641,-10.6172 57.7247,-13.9388 57.6002,-6.9399\"/>\n",
       "<text text-anchor=\"middle\" x=\"72\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "</g>\n",
       "</svg>\n"
      ],
      "text/plain": [
       "<graphviz.dot.Digraph at 0x7f41a068ae80>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "avg epochs 5.38 min epochs 1 max epochs 18 std epochs 4.091213354008422 avg loss at epoch 0 1.3962756979465485 avg loss when fit 0.7864163091778755\n"
     ]
    },
    {
     "data": {
      "image/svg+xml": [
       "<?xml version=\"1.0\" encoding=\"UTF-8\" standalone=\"no\"?>\n",
       "<!DOCTYPE svg PUBLIC \"-//W3C//DTD SVG 1.1//EN\"\n",
       " \"http://www.w3.org/Graphics/SVG/1.1/DTD/svg11.dtd\">\n",
       "<!-- Generated by graphviz version 2.40.1 (20161225.0304)\n",
       " -->\n",
       "<!-- Title: %3 Pages: 1 -->\n",
       "<svg width=\"89pt\" height=\"139pt\"\n",
       " viewBox=\"0.00 0.00 89.00 139.00\" xmlns=\"http://www.w3.org/2000/svg\" xmlns:xlink=\"http://www.w3.org/1999/xlink\">\n",
       "<g id=\"graph0\" class=\"graph\" transform=\"scale(1 1) rotate(0) translate(4 135)\">\n",
       "<title>%3</title>\n",
       "<polygon fill=\"#ffffff\" stroke=\"transparent\" points=\"-4,4 -4,-135 85,-135 85,4 -4,4\"/>\n",
       "<!-- 0 -->\n",
       "<g id=\"node1\" class=\"node\">\n",
       "<title>0</title>\n",
       "<ellipse fill=\"none\" stroke=\"#000000\" cx=\"27\" cy=\"-109\" rx=\"18\" ry=\"18\"/>\n",
       "<ellipse fill=\"none\" stroke=\"#000000\" cx=\"27\" cy=\"-109\" rx=\"22\" ry=\"22\"/>\n",
       "<text text-anchor=\"middle\" x=\"27\" y=\"-105.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;0 -->\n",
       "<g id=\"edge1\" class=\"edge\">\n",
       "<title>0&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M47.5808,-117.3702C57.8447,-118.5284 67,-115.7383 67,-109 67,-104.6833 63.2427,-101.9869 57.8436,-100.9109\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"57.6729,-97.405 47.5808,-100.6298 57.4812,-104.4024 57.6729,-97.405\"/>\n",
       "<text text-anchor=\"middle\" x=\"71.5\" y=\"-105.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 1 -->\n",
       "<g id=\"node2\" class=\"node\">\n",
       "<title>1</title>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"54,-10.5442 54,-25.4558 38.1838,-36 15.8162,-36 0,-25.4558 0,-10.5442 15.8162,0 38.1838,0 54,-10.5442\"/>\n",
       "<text text-anchor=\"middle\" x=\"27\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;1 -->\n",
       "<g id=\"edge2\" class=\"edge\">\n",
       "<title>0&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M17.0266,-89.3001C12.9276,-78.8865 9.6319,-65.8403 12,-54 12.5415,-51.2924 13.2912,-48.5339 14.1689,-45.8093\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"17.5225,-46.8347 17.7658,-36.2427 10.9703,-44.3712 17.5225,-46.8347\"/>\n",
       "<text text-anchor=\"middle\" x=\"17\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;0 -->\n",
       "<g id=\"edge4\" class=\"edge\">\n",
       "<title>1&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M27,-36.1556C27,-47.8111 27,-63.2722 27,-76.9511\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"23.5001,-76.9714 27,-86.9714 30.5001,-76.9715 23.5001,-76.9714\"/>\n",
       "<text text-anchor=\"middle\" x=\"32\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;1 -->\n",
       "<g id=\"edge3\" class=\"edge\">\n",
       "<title>1&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M53.7949,-25.8577C63.7804,-26.1153 72,-23.4961 72,-18 72,-14.5649 68.7892,-12.2537 63.9433,-11.0661\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"64.071,-7.5634 53.7949,-10.1423 63.4363,-14.5346 64.071,-7.5634\"/>\n",
       "<text text-anchor=\"middle\" x=\"76.5\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "</g>\n",
       "</svg>\n"
      ],
      "text/plain": [
       "<graphviz.dot.Digraph at 0x7f41a068aa30>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "avg epochs 5.66 min epochs 1 max epochs 13 std epochs 4.191300675273328 avg loss at epoch 0 1.3994489264488221 avg loss when fit 0.7718555393815041\n"
     ]
    },
    {
     "data": {
      "image/svg+xml": [
       "<?xml version=\"1.0\" encoding=\"UTF-8\" standalone=\"no\"?>\n",
       "<!DOCTYPE svg PUBLIC \"-//W3C//DTD SVG 1.1//EN\"\n",
       " \"http://www.w3.org/Graphics/SVG/1.1/DTD/svg11.dtd\">\n",
       "<!-- Generated by graphviz version 2.40.1 (20161225.0304)\n",
       " -->\n",
       "<!-- Title: %3 Pages: 1 -->\n",
       "<svg width=\"95pt\" height=\"139pt\"\n",
       " viewBox=\"0.00 0.00 94.73 139.00\" xmlns=\"http://www.w3.org/2000/svg\" xmlns:xlink=\"http://www.w3.org/1999/xlink\">\n",
       "<g id=\"graph0\" class=\"graph\" transform=\"scale(1 1) rotate(0) translate(4 135)\">\n",
       "<title>%3</title>\n",
       "<polygon fill=\"#ffffff\" stroke=\"transparent\" points=\"-4,4 -4,-135 90.7285,-135 90.7285,4 -4,4\"/>\n",
       "<!-- 0 -->\n",
       "<g id=\"node1\" class=\"node\">\n",
       "<title>0</title>\n",
       "<ellipse fill=\"none\" stroke=\"#000000\" cx=\"32.7285\" cy=\"-109\" rx=\"18\" ry=\"18\"/>\n",
       "<ellipse fill=\"none\" stroke=\"#000000\" cx=\"32.7285\" cy=\"-109\" rx=\"22\" ry=\"22\"/>\n",
       "<text text-anchor=\"middle\" x=\"32.7285\" y=\"-105.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 1 -->\n",
       "<g id=\"node2\" class=\"node\">\n",
       "<title>1</title>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"59.7285,-10.5442 59.7285,-25.4558 43.9122,-36 21.5447,-36 5.7285,-25.4558 5.7285,-10.5442 21.5447,0 43.9122,0 59.7285,-10.5442\"/>\n",
       "<text text-anchor=\"middle\" x=\"32.7285\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;1 -->\n",
       "<g id=\"edge1\" class=\"edge\">\n",
       "<title>0&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M16.7051,-93.3525C10.7974,-86.4997 4.8001,-77.9778 1.7285,-69 -1.7285,-58.8961 2.6224,-48.6617 9.0548,-40.0395\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"11.8189,-42.1928 15.6727,-32.3237 6.5056,-37.6355 11.8189,-42.1928\"/>\n",
       "<text text-anchor=\"middle\" x=\"6.2285\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;1 -->\n",
       "<g id=\"edge2\" class=\"edge\">\n",
       "<title>0&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M32.7285,-86.9714C32.7285,-74.8075 32.7285,-59.5615 32.7285,-46.499\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"36.2286,-46.1556 32.7285,-36.1556 29.2286,-46.1556 36.2286,-46.1556\"/>\n",
       "<text text-anchor=\"middle\" x=\"37.7285\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;0 -->\n",
       "<g id=\"edge4\" class=\"edge\">\n",
       "<title>1&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M39.394,-36.0722C41.1698,-41.7317 42.8402,-48.0535 43.7285,-54 44.9088,-61.9018 44.2026,-70.3881 42.6979,-78.2726\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"39.2478,-77.6538 40.3515,-88.191 46.0598,-79.2654 39.2478,-77.6538\"/>\n",
       "<text text-anchor=\"middle\" x=\"48.7285\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;1 -->\n",
       "<g id=\"edge3\" class=\"edge\">\n",
       "<title>1&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M59.5233,-25.8577C69.5089,-26.1153 77.7285,-23.4961 77.7285,-18 77.7285,-14.5649 74.5177,-12.2537 69.6717,-11.0661\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"69.7995,-7.5634 59.5233,-10.1423 69.1648,-14.5346 69.7995,-7.5634\"/>\n",
       "<text text-anchor=\"middle\" x=\"82.2285\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "</g>\n",
       "</svg>\n"
      ],
      "text/plain": [
       "<graphviz.dot.Digraph at 0x7f41a068ad00>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "avg epochs 5.87 min epochs 1 max epochs 13 std epochs 4.645970378376655 avg loss at epoch 0 1.3975611889362336 avg loss when fit 0.7624968060851097\n"
     ]
    },
    {
     "data": {
      "image/svg+xml": [
       "<?xml version=\"1.0\" encoding=\"UTF-8\" standalone=\"no\"?>\n",
       "<!DOCTYPE svg PUBLIC \"-//W3C//DTD SVG 1.1//EN\"\n",
       " \"http://www.w3.org/Graphics/SVG/1.1/DTD/svg11.dtd\">\n",
       "<!-- Generated by graphviz version 2.40.1 (20161225.0304)\n",
       " -->\n",
       "<!-- Title: %3 Pages: 1 -->\n",
       "<svg width=\"99pt\" height=\"139pt\"\n",
       " viewBox=\"0.00 0.00 99.38 139.00\" xmlns=\"http://www.w3.org/2000/svg\" xmlns:xlink=\"http://www.w3.org/1999/xlink\">\n",
       "<g id=\"graph0\" class=\"graph\" transform=\"scale(1 1) rotate(0) translate(4 135)\">\n",
       "<title>%3</title>\n",
       "<polygon fill=\"#ffffff\" stroke=\"transparent\" points=\"-4,4 -4,-135 95.3762,-135 95.3762,4 -4,4\"/>\n",
       "<!-- 0 -->\n",
       "<g id=\"node1\" class=\"node\">\n",
       "<title>0</title>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"60.3762,-101.5442 60.3762,-116.4558 44.56,-127 22.1924,-127 6.3762,-116.4558 6.3762,-101.5442 22.1924,-91 44.56,-91 60.3762,-101.5442\"/>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"64.3762,-99.4034 64.3762,-118.5966 45.7711,-131 20.9813,-131 2.3762,-118.5966 2.3762,-99.4034 20.9813,-87 45.7711,-87 64.3762,-99.4034\"/>\n",
       "<text text-anchor=\"middle\" x=\"33.3762\" y=\"-105.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;0 -->\n",
       "<g id=\"edge1\" class=\"edge\">\n",
       "<title>0&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M64.4782,-117.6229C74.4628,-117.5345 82.3762,-114.6602 82.3762,-109 82.3762,-105.4624 79.285,-103.013 74.529,-101.6519\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"74.8391,-98.1633 64.4782,-100.3771 73.9583,-105.1076 74.8391,-98.1633\"/>\n",
       "<text text-anchor=\"middle\" x=\"86.8762\" y=\"-105.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 1 -->\n",
       "<g id=\"node2\" class=\"node\">\n",
       "<title>1</title>\n",
       "<ellipse fill=\"none\" stroke=\"#000000\" cx=\"33.3762\" cy=\"-18\" rx=\"18\" ry=\"18\"/>\n",
       "<text text-anchor=\"middle\" x=\"33.3762\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;1 -->\n",
       "<g id=\"edge2\" class=\"edge\">\n",
       "<title>0&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M14.8129,-91.0971C9.4087,-84.6953 4.2022,-77.0562 1.3762,-69 -2.6784,-57.4412 3.6846,-45.7778 11.7773,-36.5278\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"14.285,-38.9695 18.7912,-29.3807 9.2889,-34.0665 14.285,-38.9695\"/>\n",
       "<text text-anchor=\"middle\" x=\"6.3762\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;0 -->\n",
       "<g id=\"edge3\" class=\"edge\">\n",
       "<title>1&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M33.3762,-36.1556C33.3762,-47.8111 33.3762,-63.2722 33.3762,-76.9511\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"29.8763,-76.9714 33.3762,-86.9714 36.8763,-76.9715 29.8763,-76.9714\"/>\n",
       "<text text-anchor=\"middle\" x=\"37.8762\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;0 -->\n",
       "<g id=\"edge4\" class=\"edge\">\n",
       "<title>1&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M39.2266,-35.3788C40.9187,-41.2248 42.5352,-47.8299 43.3762,-54 44.3945,-61.4706 43.8739,-69.4721 42.6545,-76.9943\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"39.2116,-76.3615 40.6376,-86.8599 46.0697,-77.7636 39.2116,-76.3615\"/>\n",
       "<text text-anchor=\"middle\" x=\"48.3762\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "</g>\n",
       "</svg>\n"
      ],
      "text/plain": [
       "<graphviz.dot.Digraph at 0x7f41a068aeb0>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "avg epochs 6.42 min epochs 1 max epochs 13 std epochs 4.359107024195567 avg loss at epoch 0 1.3848290741443634 avg loss when fit 0.7236772906780243\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "Sorted by min epochs\n"
     ]
    },
    {
     "data": {
      "image/svg+xml": [
       "<?xml version=\"1.0\" encoding=\"UTF-8\" standalone=\"no\"?>\n",
       "<!DOCTYPE svg PUBLIC \"-//W3C//DTD SVG 1.1//EN\"\n",
       " \"http://www.w3.org/Graphics/SVG/1.1/DTD/svg11.dtd\">\n",
       "<!-- Generated by graphviz version 2.40.1 (20161225.0304)\n",
       " -->\n",
       "<!-- Title: %3 Pages: 1 -->\n",
       "<svg width=\"117pt\" height=\"44pt\"\n",
       " viewBox=\"0.00 0.00 117.00 44.00\" xmlns=\"http://www.w3.org/2000/svg\" xmlns:xlink=\"http://www.w3.org/1999/xlink\">\n",
       "<g id=\"graph0\" class=\"graph\" transform=\"scale(1 1) rotate(0) translate(4 40)\">\n",
       "<title>%3</title>\n",
       "<polygon fill=\"#ffffff\" stroke=\"transparent\" points=\"-4,4 -4,-40 113,-40 113,4 -4,4\"/>\n",
       "<!-- 0 -->\n",
       "<g id=\"node1\" class=\"node\">\n",
       "<title>0</title>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"54,-10.5442 54,-25.4558 38.1838,-36 15.8162,-36 0,-25.4558 0,-10.5442 15.8162,0 38.1838,0 54,-10.5442\"/>\n",
       "<text text-anchor=\"middle\" x=\"27\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;0 -->\n",
       "<g id=\"edge1\" class=\"edge\">\n",
       "<title>0&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M54.2408,-21.3717C64.0239,-21.4442 72,-20.3203 72,-18 72,-16.5861 69.0382,-15.6164 64.5105,-15.091\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"64.3882,-11.582 54.2408,-14.6283 64.0731,-18.5749 64.3882,-11.582\"/>\n",
       "<text text-anchor=\"middle\" x=\"76.5\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;0 -->\n",
       "<g id=\"edge2\" class=\"edge\">\n",
       "<title>0&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M54.1975,-24.1551C72.3402,-25.8876 90,-23.8359 90,-18 90,-13.2583 78.3418,-11.0148 64.2386,-11.2695\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"63.9809,-7.7784 54.1975,-11.8449 64.3814,-14.7669 63.9809,-7.7784\"/>\n",
       "<text text-anchor=\"middle\" x=\"95\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "</g>\n",
       "</svg>\n"
      ],
      "text/plain": [
       "<graphviz.dot.Digraph at 0x7f41a068adc0>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "avg epochs 1.01 min epochs 1 max epochs 2 std epochs 1.099498743710662 avg loss at epoch 0 1.4036058342456819 avg loss when fit 0.9353451192378998\n"
     ]
    },
    {
     "data": {
      "image/svg+xml": [
       "<?xml version=\"1.0\" encoding=\"UTF-8\" standalone=\"no\"?>\n",
       "<!DOCTYPE svg PUBLIC \"-//W3C//DTD SVG 1.1//EN\"\n",
       " \"http://www.w3.org/Graphics/SVG/1.1/DTD/svg11.dtd\">\n",
       "<!-- Generated by graphviz version 2.40.1 (20161225.0304)\n",
       " -->\n",
       "<!-- Title: %3 Pages: 1 -->\n",
       "<svg width=\"125pt\" height=\"52pt\"\n",
       " viewBox=\"0.00 0.00 125.00 52.00\" xmlns=\"http://www.w3.org/2000/svg\" xmlns:xlink=\"http://www.w3.org/1999/xlink\">\n",
       "<g id=\"graph0\" class=\"graph\" transform=\"scale(1 1) rotate(0) translate(4 48)\">\n",
       "<title>%3</title>\n",
       "<polygon fill=\"#ffffff\" stroke=\"transparent\" points=\"-4,4 -4,-48 121,-48 121,4 -4,4\"/>\n",
       "<!-- 0 -->\n",
       "<g id=\"node1\" class=\"node\">\n",
       "<title>0</title>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"58,-14.5442 58,-29.4558 42.1838,-40 19.8162,-40 4,-29.4558 4,-14.5442 19.8162,-4 42.1838,-4 58,-14.5442\"/>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"62,-12.4034 62,-31.5966 43.3949,-44 18.6051,-44 0,-31.5966 0,-12.4034 18.6051,0 43.3949,0 62,-12.4034\"/>\n",
       "<text text-anchor=\"middle\" x=\"31\" y=\"-18.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;0 -->\n",
       "<g id=\"edge1\" class=\"edge\">\n",
       "<title>0&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M62.102,-25.9365C72.0865,-25.8962 80,-24.584 80,-22 80,-20.385 76.9088,-19.2668 72.1528,-18.6454\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"72.2876,-15.1475 62.102,-18.0635 71.8829,-22.1358 72.2876,-15.1475\"/>\n",
       "<text text-anchor=\"middle\" x=\"84.5\" y=\"-18.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;0 -->\n",
       "<g id=\"edge2\" class=\"edge\">\n",
       "<title>0&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M62.0137,-29.3828C80.5521,-31.0234 98,-28.5625 98,-22 98,-16.668 86.4816,-14.0436 72.2187,-14.1269\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"71.8342,-10.6413 62.0137,-14.6172 72.1701,-17.6332 71.8342,-10.6413\"/>\n",
       "<text text-anchor=\"middle\" x=\"103\" y=\"-18.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "</g>\n",
       "</svg>\n"
      ],
      "text/plain": [
       "<graphviz.dot.Digraph at 0x7f41a068aaf0>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "avg epochs 1.02 min epochs 1 max epochs 3 std epochs 1.198997487421324 avg loss at epoch 0 1.3925223922729493 avg loss when fit 0.9185943812131881\n"
     ]
    },
    {
     "data": {
      "image/svg+xml": [
       "<?xml version=\"1.0\" encoding=\"UTF-8\" standalone=\"no\"?>\n",
       "<!DOCTYPE svg PUBLIC \"-//W3C//DTD SVG 1.1//EN\"\n",
       " \"http://www.w3.org/Graphics/SVG/1.1/DTD/svg11.dtd\">\n",
       "<!-- Generated by graphviz version 2.40.1 (20161225.0304)\n",
       " -->\n",
       "<!-- Title: %3 Pages: 1 -->\n",
       "<svg width=\"112pt\" height=\"139pt\"\n",
       " viewBox=\"0.00 0.00 112.00 139.00\" xmlns=\"http://www.w3.org/2000/svg\" xmlns:xlink=\"http://www.w3.org/1999/xlink\">\n",
       "<g id=\"graph0\" class=\"graph\" transform=\"scale(1 1) rotate(0) translate(4 135)\">\n",
       "<title>%3</title>\n",
       "<polygon fill=\"#ffffff\" stroke=\"transparent\" points=\"-4,4 -4,-135 108,-135 108,4 -4,4\"/>\n",
       "<!-- 0 -->\n",
       "<g id=\"node1\" class=\"node\">\n",
       "<title>0</title>\n",
       "<ellipse fill=\"none\" stroke=\"#000000\" cx=\"27\" cy=\"-22\" rx=\"18\" ry=\"18\"/>\n",
       "<ellipse fill=\"none\" stroke=\"#000000\" cx=\"27\" cy=\"-22\" rx=\"22\" ry=\"22\"/>\n",
       "<text text-anchor=\"middle\" x=\"27\" y=\"-18.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;0 -->\n",
       "<g id=\"edge1\" class=\"edge\">\n",
       "<title>0&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M48.8066,-26.2451C58.5625,-26.6494 67,-25.2344 67,-22 67,-19.9785 63.7041,-18.6677 58.8504,-18.0676\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"58.9107,-14.5679 48.8066,-17.7549 58.6928,-21.5645 58.9107,-14.5679\"/>\n",
       "<text text-anchor=\"middle\" x=\"71.5\" y=\"-18.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;0 -->\n",
       "<g id=\"edge2\" class=\"edge\">\n",
       "<title>0&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M47.813,-29.2015C65.8838,-32.4865 85,-30.0859 85,-22 85,-15.4302 72.3803,-12.6136 57.9552,-13.5503\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"57.3106,-10.1032 47.813,-14.7985 58.1656,-17.0508 57.3106,-10.1032\"/>\n",
       "<text text-anchor=\"middle\" x=\"90\" y=\"-18.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 1 -->\n",
       "<g id=\"node2\" class=\"node\">\n",
       "<title>1</title>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"54,-105.5442 54,-120.4558 38.1838,-131 15.8162,-131 0,-120.4558 0,-105.5442 15.8162,-95 38.1838,-95 54,-105.5442\"/>\n",
       "<text text-anchor=\"middle\" x=\"27\" y=\"-109.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;0 -->\n",
       "<g id=\"edge3\" class=\"edge\">\n",
       "<title>1&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M17.7658,-94.7573C15.4038,-89.1988 13.1951,-82.9754 12,-77 10.3165,-68.5823 11.4955,-59.5551 13.7908,-51.2977\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"17.1484,-52.2941 17.0266,-41.6999 10.5152,-50.0577 17.1484,-52.2941\"/>\n",
       "<text text-anchor=\"middle\" x=\"16.5\" y=\"-65.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;0 -->\n",
       "<g id=\"edge4\" class=\"edge\">\n",
       "<title>1&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M27,-94.5848C27,-83.1105 27,-68.0231 27,-54.5774\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"30.5001,-54.2465 27,-44.2465 23.5001,-54.2466 30.5001,-54.2465\"/>\n",
       "<text text-anchor=\"middle\" x=\"32\" y=\"-65.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "</g>\n",
       "</svg>\n"
      ],
      "text/plain": [
       "<graphviz.dot.Digraph at 0x7f41a068ad00>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "avg epochs 1.9300000000000002 min epochs 1 max epochs 6 std epochs 2.2021231218140676 avg loss at epoch 0 1.3965786254405976 avg loss when fit 0.8911880993843079\n"
     ]
    },
    {
     "data": {
      "image/svg+xml": [
       "<?xml version=\"1.0\" encoding=\"UTF-8\" standalone=\"no\"?>\n",
       "<!DOCTYPE svg PUBLIC \"-//W3C//DTD SVG 1.1//EN\"\n",
       " \"http://www.w3.org/Graphics/SVG/1.1/DTD/svg11.dtd\">\n",
       "<!-- Generated by graphviz version 2.40.1 (20161225.0304)\n",
       " -->\n",
       "<!-- Title: %3 Pages: 1 -->\n",
       "<svg width=\"112pt\" height=\"139pt\"\n",
       " viewBox=\"0.00 0.00 112.00 139.00\" xmlns=\"http://www.w3.org/2000/svg\" xmlns:xlink=\"http://www.w3.org/1999/xlink\">\n",
       "<g id=\"graph0\" class=\"graph\" transform=\"scale(1 1) rotate(0) translate(4 135)\">\n",
       "<title>%3</title>\n",
       "<polygon fill=\"#ffffff\" stroke=\"transparent\" points=\"-4,4 -4,-135 108,-135 108,4 -4,4\"/>\n",
       "<!-- 0 -->\n",
       "<g id=\"node1\" class=\"node\">\n",
       "<title>0</title>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"58,-101.5442 58,-116.4558 42.1838,-127 19.8162,-127 4,-116.4558 4,-101.5442 19.8162,-91 42.1838,-91 58,-101.5442\"/>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"62,-99.4034 62,-118.5966 43.3949,-131 18.6051,-131 0,-118.5966 0,-99.4034 18.6051,-87 43.3949,-87 62,-99.4034\"/>\n",
       "<text text-anchor=\"middle\" x=\"31\" y=\"-105.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 1 -->\n",
       "<g id=\"node2\" class=\"node\">\n",
       "<title>1</title>\n",
       "<ellipse fill=\"none\" stroke=\"#000000\" cx=\"31\" cy=\"-18\" rx=\"18\" ry=\"18\"/>\n",
       "<text text-anchor=\"middle\" x=\"31\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;1 -->\n",
       "<g id=\"edge1\" class=\"edge\">\n",
       "<title>0&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M20.1345,-86.954C16.4722,-76.9682 13.8066,-64.9668 16,-54 16.6984,-50.5081 17.7429,-46.9315 18.9619,-43.4525\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"22.2557,-44.6417 22.7167,-34.0569 15.7556,-42.044 22.2557,-44.6417\"/>\n",
       "<text text-anchor=\"middle\" x=\"20.5\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;1 -->\n",
       "<g id=\"edge2\" class=\"edge\">\n",
       "<title>0&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M31,-86.9714C31,-74.8075 31,-59.5615 31,-46.499\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"34.5001,-46.1556 31,-36.1556 27.5001,-46.1556 34.5001,-46.1556\"/>\n",
       "<text text-anchor=\"middle\" x=\"36\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;1 -->\n",
       "<g id=\"edge3\" class=\"edge\">\n",
       "<title>1&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M48.7817,-21.775C58.3149,-22.4165 67,-21.1582 67,-18 67,-16.0755 63.7749,-14.8564 59.0981,-14.3429\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"58.8211,-10.8396 48.7817,-14.225 58.741,-17.8391 58.8211,-10.8396\"/>\n",
       "<text text-anchor=\"middle\" x=\"71.5\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;1 -->\n",
       "<g id=\"edge4\" class=\"edge\">\n",
       "<title>1&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M48.1418,-24.1447C65.585,-27.7592 85,-25.7109 85,-18 85,-11.7951 72.4283,-9.2569 58.4287,-10.3855\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"57.5461,-6.976 48.1418,-11.8553 58.5363,-13.9056 57.5461,-6.976\"/>\n",
       "<text text-anchor=\"middle\" x=\"90\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "</g>\n",
       "</svg>\n"
      ],
      "text/plain": [
       "<graphviz.dot.Digraph at 0x7f41a068aa30>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "avg epochs 2.0 min epochs 1 max epochs 8 std epochs 2.3490737563232043 avg loss at epoch 0 1.3975653278827667 avg loss when fit 0.8985250204801559\n"
     ]
    },
    {
     "data": {
      "image/svg+xml": [
       "<?xml version=\"1.0\" encoding=\"UTF-8\" standalone=\"no\"?>\n",
       "<!DOCTYPE svg PUBLIC \"-//W3C//DTD SVG 1.1//EN\"\n",
       " \"http://www.w3.org/Graphics/SVG/1.1/DTD/svg11.dtd\">\n",
       "<!-- Generated by graphviz version 2.40.1 (20161225.0304)\n",
       " -->\n",
       "<!-- Title: %3 Pages: 1 -->\n",
       "<svg width=\"85pt\" height=\"139pt\"\n",
       " viewBox=\"0.00 0.00 84.59 139.00\" xmlns=\"http://www.w3.org/2000/svg\" xmlns:xlink=\"http://www.w3.org/1999/xlink\">\n",
       "<g id=\"graph0\" class=\"graph\" transform=\"scale(1 1) rotate(0) translate(4 135)\">\n",
       "<title>%3</title>\n",
       "<polygon fill=\"#ffffff\" stroke=\"transparent\" points=\"-4,4 -4,-135 80.5906,-135 80.5906,4 -4,4\"/>\n",
       "<!-- 0 -->\n",
       "<g id=\"node1\" class=\"node\">\n",
       "<title>0</title>\n",
       "<ellipse fill=\"none\" stroke=\"#000000\" cx=\"49.5906\" cy=\"-109\" rx=\"18\" ry=\"18\"/>\n",
       "<ellipse fill=\"none\" stroke=\"#000000\" cx=\"49.5906\" cy=\"-109\" rx=\"22\" ry=\"22\"/>\n",
       "<text text-anchor=\"middle\" x=\"49.5906\" y=\"-105.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 1 -->\n",
       "<g id=\"node2\" class=\"node\">\n",
       "<title>1</title>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"76.5906,-10.5442 76.5906,-25.4558 60.7744,-36 38.4069,-36 22.5906,-25.4558 22.5906,-10.5442 38.4069,0 60.7744,0 76.5906,-10.5442\"/>\n",
       "<text text-anchor=\"middle\" x=\"49.5906\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;1 -->\n",
       "<g id=\"edge1\" class=\"edge\">\n",
       "<title>0&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M30.0239,-98.6189C13.5164,-88.3622 -6.1387,-71.682 2.5906,-54 6.3017,-46.4829 12.4189,-40.1015 19.0324,-34.8951\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"21.3556,-37.5406 27.5311,-28.9317 17.3348,-31.8105 21.3556,-37.5406\"/>\n",
       "<text text-anchor=\"middle\" x=\"7.0906\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;1 -->\n",
       "<g id=\"edge2\" class=\"edge\">\n",
       "<title>0&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M39.6172,-89.3001C35.5182,-78.8865 32.2226,-65.8403 34.5906,-54 35.1321,-51.2924 35.8818,-48.5339 36.7595,-45.8093\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"40.1132,-46.8347 40.3564,-36.2427 33.561,-44.3712 40.1132,-46.8347\"/>\n",
       "<text text-anchor=\"middle\" x=\"39.5906\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;0 -->\n",
       "<g id=\"edge3\" class=\"edge\">\n",
       "<title>1&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M49.5906,-36.1556C49.5906,-47.8111 49.5906,-63.2722 49.5906,-76.9511\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"46.0907,-76.9714 49.5906,-86.9714 53.0907,-76.9715 46.0907,-76.9714\"/>\n",
       "<text text-anchor=\"middle\" x=\"54.0906\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;0 -->\n",
       "<g id=\"edge4\" class=\"edge\">\n",
       "<title>1&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M57.5995,-36.3492C59.6467,-41.9107 61.5596,-48.109 62.5906,-54 64.0179,-62.1547 63.0922,-70.9086 61.2094,-78.9809\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"57.8017,-78.1679 58.4179,-88.7448 64.532,-80.0922 57.8017,-78.1679\"/>\n",
       "<text text-anchor=\"middle\" x=\"67.5906\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "</g>\n",
       "</svg>\n"
      ],
      "text/plain": [
       "<graphviz.dot.Digraph at 0x7f41a068abe0>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "avg epochs 2.6100000000000003 min epochs 1 max epochs 6 std epochs 2.4205280708243677 avg loss at epoch 0 1.387124490737915 avg loss when fit 0.9513023608922958\n"
     ]
    },
    {
     "data": {
      "image/svg+xml": [
       "<?xml version=\"1.0\" encoding=\"UTF-8\" standalone=\"no\"?>\n",
       "<!DOCTYPE svg PUBLIC \"-//W3C//DTD SVG 1.1//EN\"\n",
       " \"http://www.w3.org/Graphics/SVG/1.1/DTD/svg11.dtd\">\n",
       "<!-- Generated by graphviz version 2.40.1 (20161225.0304)\n",
       " -->\n",
       "<!-- Title: %3 Pages: 1 -->\n",
       "<svg width=\"88pt\" height=\"139pt\"\n",
       " viewBox=\"0.00 0.00 88.48 139.00\" xmlns=\"http://www.w3.org/2000/svg\" xmlns:xlink=\"http://www.w3.org/1999/xlink\">\n",
       "<g id=\"graph0\" class=\"graph\" transform=\"scale(1 1) rotate(0) translate(4 135)\">\n",
       "<title>%3</title>\n",
       "<polygon fill=\"#ffffff\" stroke=\"transparent\" points=\"-4,4 -4,-135 84.4814,-135 84.4814,4 -4,4\"/>\n",
       "<!-- 0 -->\n",
       "<g id=\"node1\" class=\"node\">\n",
       "<title>0</title>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"76.4814,-101.5442 76.4814,-116.4558 60.6652,-127 38.2976,-127 22.4814,-116.4558 22.4814,-101.5442 38.2976,-91 60.6652,-91 76.4814,-101.5442\"/>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"80.4814,-99.4034 80.4814,-118.5966 61.8763,-131 37.0865,-131 18.4814,-118.5966 18.4814,-99.4034 37.0865,-87 61.8763,-87 80.4814,-99.4034\"/>\n",
       "<text text-anchor=\"middle\" x=\"49.4814\" y=\"-105.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 1 -->\n",
       "<g id=\"node2\" class=\"node\">\n",
       "<title>1</title>\n",
       "<ellipse fill=\"none\" stroke=\"#000000\" cx=\"49.4814\" cy=\"-18\" rx=\"18\" ry=\"18\"/>\n",
       "<text text-anchor=\"middle\" x=\"49.4814\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;1 -->\n",
       "<g id=\"edge1\" class=\"edge\">\n",
       "<title>0&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M24.4817,-95.0681C9.4835,-84.7382 -5.3027,-69.7674 2.4814,-54 7.1416,-44.5604 15.596,-36.9117 24.0627,-31.1317\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"26.0556,-34.0149 32.7318,-25.7882 22.3825,-28.0559 26.0556,-34.0149\"/>\n",
       "<text text-anchor=\"middle\" x=\"6.9814\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;1 -->\n",
       "<g id=\"edge2\" class=\"edge\">\n",
       "<title>0&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M38.6159,-86.954C34.9536,-76.9682 32.288,-64.9668 34.4814,-54 35.1798,-50.5081 36.2243,-46.9315 37.4433,-43.4525\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"40.7371,-44.6417 41.1981,-34.0569 34.237,-42.044 40.7371,-44.6417\"/>\n",
       "<text text-anchor=\"middle\" x=\"39.4814\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;0 -->\n",
       "<g id=\"edge3\" class=\"edge\">\n",
       "<title>1&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M49.4814,-36.1556C49.4814,-47.8111 49.4814,-63.2722 49.4814,-76.9511\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"45.9815,-76.9714 49.4814,-86.9714 52.9815,-76.9715 45.9815,-76.9714\"/>\n",
       "<text text-anchor=\"middle\" x=\"53.9814\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;0 -->\n",
       "<g id=\"edge4\" class=\"edge\">\n",
       "<title>1&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M56.804,-34.5202C59.1015,-40.5295 61.3358,-47.4545 62.4814,-54 63.7955,-61.5083 63.1149,-69.5247 61.5291,-77.0492\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"58.0941,-76.3478 58.9081,-86.9113 64.8593,-78.1458 58.0941,-76.3478\"/>\n",
       "<text text-anchor=\"middle\" x=\"67.4814\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "</g>\n",
       "</svg>\n"
      ],
      "text/plain": [
       "<graphviz.dot.Digraph at 0x7f41a068ad60>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "avg epochs 2.6100000000000003 min epochs 1 max epochs 6 std epochs 2.333379165878933 avg loss at epoch 0 1.401513180732727 avg loss when fit 0.9501019644737244\n"
     ]
    },
    {
     "data": {
      "image/svg+xml": [
       "<?xml version=\"1.0\" encoding=\"UTF-8\" standalone=\"no\"?>\n",
       "<!DOCTYPE svg PUBLIC \"-//W3C//DTD SVG 1.1//EN\"\n",
       " \"http://www.w3.org/Graphics/SVG/1.1/DTD/svg11.dtd\">\n",
       "<!-- Generated by graphviz version 2.40.1 (20161225.0304)\n",
       " -->\n",
       "<!-- Title: %3 Pages: 1 -->\n",
       "<svg width=\"112pt\" height=\"139pt\"\n",
       " viewBox=\"0.00 0.00 112.00 139.00\" xmlns=\"http://www.w3.org/2000/svg\" xmlns:xlink=\"http://www.w3.org/1999/xlink\">\n",
       "<g id=\"graph0\" class=\"graph\" transform=\"scale(1 1) rotate(0) translate(4 135)\">\n",
       "<title>%3</title>\n",
       "<polygon fill=\"#ffffff\" stroke=\"transparent\" points=\"-4,4 -4,-135 108,-135 108,4 -4,4\"/>\n",
       "<!-- 0 -->\n",
       "<g id=\"node1\" class=\"node\">\n",
       "<title>0</title>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"58,-101.5442 58,-116.4558 42.1838,-127 19.8162,-127 4,-116.4558 4,-101.5442 19.8162,-91 42.1838,-91 58,-101.5442\"/>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"62,-99.4034 62,-118.5966 43.3949,-131 18.6051,-131 0,-118.5966 0,-99.4034 18.6051,-87 43.3949,-87 62,-99.4034\"/>\n",
       "<text text-anchor=\"middle\" x=\"31\" y=\"-105.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;0 -->\n",
       "<g id=\"edge2\" class=\"edge\">\n",
       "<title>0&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M62.102,-117.6229C72.0865,-117.5345 80,-114.6602 80,-109 80,-105.4624 76.9088,-103.013 72.1528,-101.6519\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"72.4629,-98.1633 62.102,-100.3771 71.5821,-105.1076 72.4629,-98.1633\"/>\n",
       "<text text-anchor=\"middle\" x=\"85\" y=\"-105.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 1 -->\n",
       "<g id=\"node2\" class=\"node\">\n",
       "<title>1</title>\n",
       "<ellipse fill=\"none\" stroke=\"#000000\" cx=\"31\" cy=\"-18\" rx=\"18\" ry=\"18\"/>\n",
       "<text text-anchor=\"middle\" x=\"31\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;1 -->\n",
       "<g id=\"edge1\" class=\"edge\">\n",
       "<title>0&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M31,-86.9714C31,-74.8075 31,-59.5615 31,-46.499\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"34.5001,-46.1556 31,-36.1556 27.5001,-46.1556 34.5001,-46.1556\"/>\n",
       "<text text-anchor=\"middle\" x=\"35.5\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;1 -->\n",
       "<g id=\"edge3\" class=\"edge\">\n",
       "<title>1&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M48.7817,-21.775C58.3149,-22.4165 67,-21.1582 67,-18 67,-16.0755 63.7749,-14.8564 59.0981,-14.3429\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"58.8211,-10.8396 48.7817,-14.225 58.741,-17.8391 58.8211,-10.8396\"/>\n",
       "<text text-anchor=\"middle\" x=\"71.5\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;1 -->\n",
       "<g id=\"edge4\" class=\"edge\">\n",
       "<title>1&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M48.1418,-24.1447C65.585,-27.7592 85,-25.7109 85,-18 85,-11.7951 72.4283,-9.2569 58.4287,-10.3855\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"57.5461,-6.976 48.1418,-11.8553 58.5363,-13.9056 57.5461,-6.976\"/>\n",
       "<text text-anchor=\"middle\" x=\"90\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "</g>\n",
       "</svg>\n"
      ],
      "text/plain": [
       "<graphviz.dot.Digraph at 0x7f41a068a970>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "avg epochs 3.73 min epochs 1 max epochs 13 std epochs 3.7453779339100106 avg loss at epoch 0 1.4002061438560487 avg loss when fit 0.7947436776757241\n"
     ]
    },
    {
     "data": {
      "image/svg+xml": [
       "<?xml version=\"1.0\" encoding=\"UTF-8\" standalone=\"no\"?>\n",
       "<!DOCTYPE svg PUBLIC \"-//W3C//DTD SVG 1.1//EN\"\n",
       " \"http://www.w3.org/Graphics/SVG/1.1/DTD/svg11.dtd\">\n",
       "<!-- Generated by graphviz version 2.40.1 (20161225.0304)\n",
       " -->\n",
       "<!-- Title: %3 Pages: 1 -->\n",
       "<svg width=\"85pt\" height=\"139pt\"\n",
       " viewBox=\"0.00 0.00 85.33 139.00\" xmlns=\"http://www.w3.org/2000/svg\" xmlns:xlink=\"http://www.w3.org/1999/xlink\">\n",
       "<g id=\"graph0\" class=\"graph\" transform=\"scale(1 1) rotate(0) translate(4 135)\">\n",
       "<title>%3</title>\n",
       "<polygon fill=\"#ffffff\" stroke=\"transparent\" points=\"-4,4 -4,-135 81.3273,-135 81.3273,4 -4,4\"/>\n",
       "<!-- 0 -->\n",
       "<g id=\"node1\" class=\"node\">\n",
       "<title>0</title>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"59.3273,-101.5442 59.3273,-116.4558 43.5111,-127 21.1436,-127 5.3273,-116.4558 5.3273,-101.5442 21.1436,-91 43.5111,-91 59.3273,-101.5442\"/>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"63.3273,-99.4034 63.3273,-118.5966 44.7222,-131 19.9325,-131 1.3273,-118.5966 1.3273,-99.4034 19.9325,-87 44.7222,-87 63.3273,-99.4034\"/>\n",
       "<text text-anchor=\"middle\" x=\"32.3273\" y=\"-105.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 1 -->\n",
       "<g id=\"node2\" class=\"node\">\n",
       "<title>1</title>\n",
       "<ellipse fill=\"none\" stroke=\"#000000\" cx=\"32.3273\" cy=\"-18\" rx=\"18\" ry=\"18\"/>\n",
       "<text text-anchor=\"middle\" x=\"32.3273\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;1 -->\n",
       "<g id=\"edge1\" class=\"edge\">\n",
       "<title>0&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M14.0086,-90.606C8.8906,-84.2826 4.0008,-76.814 1.3273,-69 -2.5641,-57.6263 3.4383,-46.0871 11.1662,-36.8684\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"13.8732,-39.0996 18.1963,-29.4269 8.7848,-34.2925 13.8732,-39.0996\"/>\n",
       "<text text-anchor=\"middle\" x=\"5.8273\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;1 -->\n",
       "<g id=\"edge2\" class=\"edge\">\n",
       "<title>0&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M32.3273,-86.9714C32.3273,-74.8075 32.3273,-59.5615 32.3273,-46.499\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"35.8274,-46.1556 32.3273,-36.1556 28.8274,-46.1556 35.8274,-46.1556\"/>\n",
       "<text text-anchor=\"middle\" x=\"37.3273\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;0 -->\n",
       "<g id=\"edge4\" class=\"edge\">\n",
       "<title>1&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M38.6443,-34.9737C40.5474,-40.9055 42.3812,-47.6657 43.3273,-54 44.4449,-61.482 43.8712,-69.488 42.5297,-77.0109\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"39.0908,-76.3511 40.3114,-86.8754 45.9202,-77.887 39.0908,-76.3511\"/>\n",
       "<text text-anchor=\"middle\" x=\"48.3273\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;1 -->\n",
       "<g id=\"edge3\" class=\"edge\">\n",
       "<title>1&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M48.9914,-25.3828C58.9523,-27.0234 68.3273,-24.5625 68.3273,-18 68.3273,-13.7959 64.4798,-11.2751 59.0956,-10.4375\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"58.9276,-6.9399 48.9914,-10.6172 59.0521,-13.9388 58.9276,-6.9399\"/>\n",
       "<text text-anchor=\"middle\" x=\"72.8273\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "</g>\n",
       "</svg>\n"
      ],
      "text/plain": [
       "<graphviz.dot.Digraph at 0x7f41a068ae20>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "avg epochs 4.01 min epochs 1 max epochs 9 std epochs 3.7838642208268705 avg loss at epoch 0 1.398785378932953 avg loss when fit 0.8564903074502945\n"
     ]
    },
    {
     "data": {
      "image/svg+xml": [
       "<?xml version=\"1.0\" encoding=\"UTF-8\" standalone=\"no\"?>\n",
       "<!DOCTYPE svg PUBLIC \"-//W3C//DTD SVG 1.1//EN\"\n",
       " \"http://www.w3.org/Graphics/SVG/1.1/DTD/svg11.dtd\">\n",
       "<!-- Generated by graphviz version 2.40.1 (20161225.0304)\n",
       " -->\n",
       "<!-- Title: %3 Pages: 1 -->\n",
       "<svg width=\"112pt\" height=\"139pt\"\n",
       " viewBox=\"0.00 0.00 112.00 139.00\" xmlns=\"http://www.w3.org/2000/svg\" xmlns:xlink=\"http://www.w3.org/1999/xlink\">\n",
       "<g id=\"graph0\" class=\"graph\" transform=\"scale(1 1) rotate(0) translate(4 135)\">\n",
       "<title>%3</title>\n",
       "<polygon fill=\"#ffffff\" stroke=\"transparent\" points=\"-4,4 -4,-135 108,-135 108,4 -4,4\"/>\n",
       "<!-- 0 -->\n",
       "<g id=\"node1\" class=\"node\">\n",
       "<title>0</title>\n",
       "<ellipse fill=\"none\" stroke=\"#000000\" cx=\"27\" cy=\"-22\" rx=\"18\" ry=\"18\"/>\n",
       "<ellipse fill=\"none\" stroke=\"#000000\" cx=\"27\" cy=\"-22\" rx=\"22\" ry=\"22\"/>\n",
       "<text text-anchor=\"middle\" x=\"27\" y=\"-18.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;0 -->\n",
       "<g id=\"edge1\" class=\"edge\">\n",
       "<title>0&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M48.8066,-26.2451C58.5625,-26.6494 67,-25.2344 67,-22 67,-19.9785 63.7041,-18.6677 58.8504,-18.0676\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"58.9107,-14.5679 48.8066,-17.7549 58.6928,-21.5645 58.9107,-14.5679\"/>\n",
       "<text text-anchor=\"middle\" x=\"71.5\" y=\"-18.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;0 -->\n",
       "<g id=\"edge2\" class=\"edge\">\n",
       "<title>0&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M47.813,-29.2015C65.8838,-32.4865 85,-30.0859 85,-22 85,-15.4302 72.3803,-12.6136 57.9552,-13.5503\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"57.3106,-10.1032 47.813,-14.7985 58.1656,-17.0508 57.3106,-10.1032\"/>\n",
       "<text text-anchor=\"middle\" x=\"90\" y=\"-18.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 1 -->\n",
       "<g id=\"node2\" class=\"node\">\n",
       "<title>1</title>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"54,-105.5442 54,-120.4558 38.1838,-131 15.8162,-131 0,-120.4558 0,-105.5442 15.8162,-95 38.1838,-95 54,-105.5442\"/>\n",
       "<text text-anchor=\"middle\" x=\"27\" y=\"-109.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;0 -->\n",
       "<g id=\"edge4\" class=\"edge\">\n",
       "<title>1&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M27,-94.5848C27,-83.1105 27,-68.0231 27,-54.5774\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"30.5001,-54.2465 27,-44.2465 23.5001,-54.2466 30.5001,-54.2465\"/>\n",
       "<text text-anchor=\"middle\" x=\"32\" y=\"-65.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;1 -->\n",
       "<g id=\"edge3\" class=\"edge\">\n",
       "<title>1&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M53.7949,-120.8577C63.7804,-121.1153 72,-118.4961 72,-113 72,-109.5649 68.7892,-107.2537 63.9433,-106.0661\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"64.071,-102.5634 53.7949,-105.1423 63.4363,-109.5346 64.071,-102.5634\"/>\n",
       "<text text-anchor=\"middle\" x=\"76.5\" y=\"-109.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "</g>\n",
       "</svg>\n"
      ],
      "text/plain": [
       "<graphviz.dot.Digraph at 0x7f41a068adf0>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "avg epochs 4.43 min epochs 1 max epochs 13 std epochs 4.027391616557065 avg loss at epoch 0 1.3896378016471862 avg loss when fit 0.7640904745459557\n"
     ]
    },
    {
     "data": {
      "image/svg+xml": [
       "<?xml version=\"1.0\" encoding=\"UTF-8\" standalone=\"no\"?>\n",
       "<!DOCTYPE svg PUBLIC \"-//W3C//DTD SVG 1.1//EN\"\n",
       " \"http://www.w3.org/Graphics/SVG/1.1/DTD/svg11.dtd\">\n",
       "<!-- Generated by graphviz version 2.40.1 (20161225.0304)\n",
       " -->\n",
       "<!-- Title: %3 Pages: 1 -->\n",
       "<svg width=\"91pt\" height=\"139pt\"\n",
       " viewBox=\"0.00 0.00 90.78 139.00\" xmlns=\"http://www.w3.org/2000/svg\" xmlns:xlink=\"http://www.w3.org/1999/xlink\">\n",
       "<g id=\"graph0\" class=\"graph\" transform=\"scale(1 1) rotate(0) translate(4 135)\">\n",
       "<title>%3</title>\n",
       "<polygon fill=\"#ffffff\" stroke=\"transparent\" points=\"-4,4 -4,-135 86.783,-135 86.783,4 -4,4\"/>\n",
       "<!-- 0 -->\n",
       "<g id=\"node1\" class=\"node\">\n",
       "<title>0</title>\n",
       "<ellipse fill=\"none\" stroke=\"#000000\" cx=\"33.783\" cy=\"-109\" rx=\"18\" ry=\"18\"/>\n",
       "<ellipse fill=\"none\" stroke=\"#000000\" cx=\"33.783\" cy=\"-109\" rx=\"22\" ry=\"22\"/>\n",
       "<text text-anchor=\"middle\" x=\"33.783\" y=\"-105.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;0 -->\n",
       "<g id=\"edge1\" class=\"edge\">\n",
       "<title>0&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M54.3638,-117.3702C64.6277,-118.5284 73.783,-115.7383 73.783,-109 73.783,-104.6833 70.0256,-101.9869 64.6265,-100.9109\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"64.4559,-97.405 54.3638,-100.6298 64.2641,-104.4024 64.4559,-97.405\"/>\n",
       "<text text-anchor=\"middle\" x=\"78.283\" y=\"-105.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 1 -->\n",
       "<g id=\"node2\" class=\"node\">\n",
       "<title>1</title>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"60.783,-10.5442 60.783,-25.4558 44.9667,-36 22.5992,-36 6.783,-25.4558 6.783,-10.5442 22.5992,0 44.9667,0 60.783,-10.5442\"/>\n",
       "<text text-anchor=\"middle\" x=\"33.783\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;1 -->\n",
       "<g id=\"edge2\" class=\"edge\">\n",
       "<title>0&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M17.5898,-93.8165C11.3846,-86.9145 5.021,-78.2311 1.783,-69 -1.783,-58.8344 2.7088,-48.588 9.3483,-39.9734\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"12.1633,-42.0742 16.1792,-32.27 6.9258,-37.4299 12.1633,-42.0742\"/>\n",
       "<text text-anchor=\"middle\" x=\"6.783\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;0 -->\n",
       "<g id=\"edge3\" class=\"edge\">\n",
       "<title>1&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M33.783,-36.1556C33.783,-47.8111 33.783,-63.2722 33.783,-76.9511\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"30.2831,-76.9714 33.783,-86.9714 37.2831,-76.9715 30.2831,-76.9714\"/>\n",
       "<text text-anchor=\"middle\" x=\"38.283\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;0 -->\n",
       "<g id=\"edge4\" class=\"edge\">\n",
       "<title>1&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M39.8444,-36.1134C41.4588,-41.7745 42.977,-48.087 43.783,-54 44.8493,-61.823 44.2281,-70.2281 42.8841,-78.0554\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"39.4443,-77.4047 40.7823,-87.9147 46.2904,-78.8642 39.4443,-77.4047\"/>\n",
       "<text text-anchor=\"middle\" x=\"48.783\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "</g>\n",
       "</svg>\n"
      ],
      "text/plain": [
       "<graphviz.dot.Digraph at 0x7f41a068aaf0>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "avg epochs 4.52 min epochs 1 max epochs 13 std epochs 4.195246469366644 avg loss at epoch 0 1.401658388376236 avg loss when fit 0.8417020487785339\n"
     ]
    },
    {
     "data": {
      "image/svg+xml": [
       "<?xml version=\"1.0\" encoding=\"UTF-8\" standalone=\"no\"?>\n",
       "<!DOCTYPE svg PUBLIC \"-//W3C//DTD SVG 1.1//EN\"\n",
       " \"http://www.w3.org/Graphics/SVG/1.1/DTD/svg11.dtd\">\n",
       "<!-- Generated by graphviz version 2.40.1 (20161225.0304)\n",
       " -->\n",
       "<!-- Title: %3 Pages: 1 -->\n",
       "<svg width=\"98pt\" height=\"139pt\"\n",
       " viewBox=\"0.00 0.00 98.00 139.00\" xmlns=\"http://www.w3.org/2000/svg\" xmlns:xlink=\"http://www.w3.org/1999/xlink\">\n",
       "<g id=\"graph0\" class=\"graph\" transform=\"scale(1 1) rotate(0) translate(4 135)\">\n",
       "<title>%3</title>\n",
       "<polygon fill=\"#ffffff\" stroke=\"transparent\" points=\"-4,4 -4,-135 94,-135 94,4 -4,4\"/>\n",
       "<!-- 0 -->\n",
       "<g id=\"node1\" class=\"node\">\n",
       "<title>0</title>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"58,-101.5442 58,-116.4558 42.1838,-127 19.8162,-127 4,-116.4558 4,-101.5442 19.8162,-91 42.1838,-91 58,-101.5442\"/>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"62,-99.4034 62,-118.5966 43.3949,-131 18.6051,-131 0,-118.5966 0,-99.4034 18.6051,-87 43.3949,-87 62,-99.4034\"/>\n",
       "<text text-anchor=\"middle\" x=\"31\" y=\"-105.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;0 -->\n",
       "<g id=\"edge2\" class=\"edge\">\n",
       "<title>0&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M62.102,-117.6229C72.0865,-117.5345 80,-114.6602 80,-109 80,-105.4624 76.9088,-103.013 72.1528,-101.6519\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"72.4629,-98.1633 62.102,-100.3771 71.5821,-105.1076 72.4629,-98.1633\"/>\n",
       "<text text-anchor=\"middle\" x=\"85\" y=\"-105.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 1 -->\n",
       "<g id=\"node2\" class=\"node\">\n",
       "<title>1</title>\n",
       "<ellipse fill=\"none\" stroke=\"#000000\" cx=\"31\" cy=\"-18\" rx=\"18\" ry=\"18\"/>\n",
       "<text text-anchor=\"middle\" x=\"31\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;1 -->\n",
       "<g id=\"edge1\" class=\"edge\">\n",
       "<title>0&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M20.1345,-86.954C16.4722,-76.9682 13.8066,-64.9668 16,-54 16.6984,-50.5081 17.7429,-46.9315 18.9619,-43.4525\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"22.2557,-44.6417 22.7167,-34.0569 15.7556,-42.044 22.2557,-44.6417\"/>\n",
       "<text text-anchor=\"middle\" x=\"20.5\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;0 -->\n",
       "<g id=\"edge3\" class=\"edge\">\n",
       "<title>1&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M31,-36.1556C31,-47.8111 31,-63.2722 31,-76.9511\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"27.5001,-76.9714 31,-86.9714 34.5001,-76.9715 27.5001,-76.9714\"/>\n",
       "<text text-anchor=\"middle\" x=\"35.5\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;1 -->\n",
       "<g id=\"edge4\" class=\"edge\">\n",
       "<title>1&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M47.6641,-25.3828C57.625,-27.0234 67,-24.5625 67,-18 67,-13.7959 63.1525,-11.2751 57.7682,-10.4375\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"57.6002,-6.9399 47.6641,-10.6172 57.7247,-13.9388 57.6002,-6.9399\"/>\n",
       "<text text-anchor=\"middle\" x=\"72\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "</g>\n",
       "</svg>\n"
      ],
      "text/plain": [
       "<graphviz.dot.Digraph at 0x7f41a068aeb0>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "avg epochs 5.38 min epochs 1 max epochs 18 std epochs 4.091213354008422 avg loss at epoch 0 1.3962756979465485 avg loss when fit 0.7864163091778755\n"
     ]
    },
    {
     "data": {
      "image/svg+xml": [
       "<?xml version=\"1.0\" encoding=\"UTF-8\" standalone=\"no\"?>\n",
       "<!DOCTYPE svg PUBLIC \"-//W3C//DTD SVG 1.1//EN\"\n",
       " \"http://www.w3.org/Graphics/SVG/1.1/DTD/svg11.dtd\">\n",
       "<!-- Generated by graphviz version 2.40.1 (20161225.0304)\n",
       " -->\n",
       "<!-- Title: %3 Pages: 1 -->\n",
       "<svg width=\"89pt\" height=\"139pt\"\n",
       " viewBox=\"0.00 0.00 89.00 139.00\" xmlns=\"http://www.w3.org/2000/svg\" xmlns:xlink=\"http://www.w3.org/1999/xlink\">\n",
       "<g id=\"graph0\" class=\"graph\" transform=\"scale(1 1) rotate(0) translate(4 135)\">\n",
       "<title>%3</title>\n",
       "<polygon fill=\"#ffffff\" stroke=\"transparent\" points=\"-4,4 -4,-135 85,-135 85,4 -4,4\"/>\n",
       "<!-- 0 -->\n",
       "<g id=\"node1\" class=\"node\">\n",
       "<title>0</title>\n",
       "<ellipse fill=\"none\" stroke=\"#000000\" cx=\"27\" cy=\"-109\" rx=\"18\" ry=\"18\"/>\n",
       "<ellipse fill=\"none\" stroke=\"#000000\" cx=\"27\" cy=\"-109\" rx=\"22\" ry=\"22\"/>\n",
       "<text text-anchor=\"middle\" x=\"27\" y=\"-105.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;0 -->\n",
       "<g id=\"edge1\" class=\"edge\">\n",
       "<title>0&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M47.5808,-117.3702C57.8447,-118.5284 67,-115.7383 67,-109 67,-104.6833 63.2427,-101.9869 57.8436,-100.9109\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"57.6729,-97.405 47.5808,-100.6298 57.4812,-104.4024 57.6729,-97.405\"/>\n",
       "<text text-anchor=\"middle\" x=\"71.5\" y=\"-105.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 1 -->\n",
       "<g id=\"node2\" class=\"node\">\n",
       "<title>1</title>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"54,-10.5442 54,-25.4558 38.1838,-36 15.8162,-36 0,-25.4558 0,-10.5442 15.8162,0 38.1838,0 54,-10.5442\"/>\n",
       "<text text-anchor=\"middle\" x=\"27\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;1 -->\n",
       "<g id=\"edge2\" class=\"edge\">\n",
       "<title>0&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M17.0266,-89.3001C12.9276,-78.8865 9.6319,-65.8403 12,-54 12.5415,-51.2924 13.2912,-48.5339 14.1689,-45.8093\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"17.5225,-46.8347 17.7658,-36.2427 10.9703,-44.3712 17.5225,-46.8347\"/>\n",
       "<text text-anchor=\"middle\" x=\"17\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;0 -->\n",
       "<g id=\"edge4\" class=\"edge\">\n",
       "<title>1&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M27,-36.1556C27,-47.8111 27,-63.2722 27,-76.9511\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"23.5001,-76.9714 27,-86.9714 30.5001,-76.9715 23.5001,-76.9714\"/>\n",
       "<text text-anchor=\"middle\" x=\"32\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;1 -->\n",
       "<g id=\"edge3\" class=\"edge\">\n",
       "<title>1&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M53.7949,-25.8577C63.7804,-26.1153 72,-23.4961 72,-18 72,-14.5649 68.7892,-12.2537 63.9433,-11.0661\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"64.071,-7.5634 53.7949,-10.1423 63.4363,-14.5346 64.071,-7.5634\"/>\n",
       "<text text-anchor=\"middle\" x=\"76.5\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "</g>\n",
       "</svg>\n"
      ],
      "text/plain": [
       "<graphviz.dot.Digraph at 0x7f41a068ab50>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "avg epochs 5.66 min epochs 1 max epochs 13 std epochs 4.191300675273328 avg loss at epoch 0 1.3994489264488221 avg loss when fit 0.7718555393815041\n"
     ]
    },
    {
     "data": {
      "image/svg+xml": [
       "<?xml version=\"1.0\" encoding=\"UTF-8\" standalone=\"no\"?>\n",
       "<!DOCTYPE svg PUBLIC \"-//W3C//DTD SVG 1.1//EN\"\n",
       " \"http://www.w3.org/Graphics/SVG/1.1/DTD/svg11.dtd\">\n",
       "<!-- Generated by graphviz version 2.40.1 (20161225.0304)\n",
       " -->\n",
       "<!-- Title: %3 Pages: 1 -->\n",
       "<svg width=\"95pt\" height=\"139pt\"\n",
       " viewBox=\"0.00 0.00 94.73 139.00\" xmlns=\"http://www.w3.org/2000/svg\" xmlns:xlink=\"http://www.w3.org/1999/xlink\">\n",
       "<g id=\"graph0\" class=\"graph\" transform=\"scale(1 1) rotate(0) translate(4 135)\">\n",
       "<title>%3</title>\n",
       "<polygon fill=\"#ffffff\" stroke=\"transparent\" points=\"-4,4 -4,-135 90.7285,-135 90.7285,4 -4,4\"/>\n",
       "<!-- 0 -->\n",
       "<g id=\"node1\" class=\"node\">\n",
       "<title>0</title>\n",
       "<ellipse fill=\"none\" stroke=\"#000000\" cx=\"32.7285\" cy=\"-109\" rx=\"18\" ry=\"18\"/>\n",
       "<ellipse fill=\"none\" stroke=\"#000000\" cx=\"32.7285\" cy=\"-109\" rx=\"22\" ry=\"22\"/>\n",
       "<text text-anchor=\"middle\" x=\"32.7285\" y=\"-105.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 1 -->\n",
       "<g id=\"node2\" class=\"node\">\n",
       "<title>1</title>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"59.7285,-10.5442 59.7285,-25.4558 43.9122,-36 21.5447,-36 5.7285,-25.4558 5.7285,-10.5442 21.5447,0 43.9122,0 59.7285,-10.5442\"/>\n",
       "<text text-anchor=\"middle\" x=\"32.7285\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;1 -->\n",
       "<g id=\"edge1\" class=\"edge\">\n",
       "<title>0&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M16.7051,-93.3525C10.7974,-86.4997 4.8001,-77.9778 1.7285,-69 -1.7285,-58.8961 2.6224,-48.6617 9.0548,-40.0395\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"11.8189,-42.1928 15.6727,-32.3237 6.5056,-37.6355 11.8189,-42.1928\"/>\n",
       "<text text-anchor=\"middle\" x=\"6.2285\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;1 -->\n",
       "<g id=\"edge2\" class=\"edge\">\n",
       "<title>0&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M32.7285,-86.9714C32.7285,-74.8075 32.7285,-59.5615 32.7285,-46.499\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"36.2286,-46.1556 32.7285,-36.1556 29.2286,-46.1556 36.2286,-46.1556\"/>\n",
       "<text text-anchor=\"middle\" x=\"37.7285\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;0 -->\n",
       "<g id=\"edge4\" class=\"edge\">\n",
       "<title>1&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M39.394,-36.0722C41.1698,-41.7317 42.8402,-48.0535 43.7285,-54 44.9088,-61.9018 44.2026,-70.3881 42.6979,-78.2726\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"39.2478,-77.6538 40.3515,-88.191 46.0598,-79.2654 39.2478,-77.6538\"/>\n",
       "<text text-anchor=\"middle\" x=\"48.7285\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;1 -->\n",
       "<g id=\"edge3\" class=\"edge\">\n",
       "<title>1&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M59.5233,-25.8577C69.5089,-26.1153 77.7285,-23.4961 77.7285,-18 77.7285,-14.5649 74.5177,-12.2537 69.6717,-11.0661\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"69.7995,-7.5634 59.5233,-10.1423 69.1648,-14.5346 69.7995,-7.5634\"/>\n",
       "<text text-anchor=\"middle\" x=\"82.2285\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "</g>\n",
       "</svg>\n"
      ],
      "text/plain": [
       "<graphviz.dot.Digraph at 0x7f41a068a970>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "avg epochs 5.87 min epochs 1 max epochs 13 std epochs 4.645970378376655 avg loss at epoch 0 1.3975611889362336 avg loss when fit 0.7624968060851097\n"
     ]
    },
    {
     "data": {
      "image/svg+xml": [
       "<?xml version=\"1.0\" encoding=\"UTF-8\" standalone=\"no\"?>\n",
       "<!DOCTYPE svg PUBLIC \"-//W3C//DTD SVG 1.1//EN\"\n",
       " \"http://www.w3.org/Graphics/SVG/1.1/DTD/svg11.dtd\">\n",
       "<!-- Generated by graphviz version 2.40.1 (20161225.0304)\n",
       " -->\n",
       "<!-- Title: %3 Pages: 1 -->\n",
       "<svg width=\"99pt\" height=\"139pt\"\n",
       " viewBox=\"0.00 0.00 99.38 139.00\" xmlns=\"http://www.w3.org/2000/svg\" xmlns:xlink=\"http://www.w3.org/1999/xlink\">\n",
       "<g id=\"graph0\" class=\"graph\" transform=\"scale(1 1) rotate(0) translate(4 135)\">\n",
       "<title>%3</title>\n",
       "<polygon fill=\"#ffffff\" stroke=\"transparent\" points=\"-4,4 -4,-135 95.3762,-135 95.3762,4 -4,4\"/>\n",
       "<!-- 0 -->\n",
       "<g id=\"node1\" class=\"node\">\n",
       "<title>0</title>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"60.3762,-101.5442 60.3762,-116.4558 44.56,-127 22.1924,-127 6.3762,-116.4558 6.3762,-101.5442 22.1924,-91 44.56,-91 60.3762,-101.5442\"/>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"64.3762,-99.4034 64.3762,-118.5966 45.7711,-131 20.9813,-131 2.3762,-118.5966 2.3762,-99.4034 20.9813,-87 45.7711,-87 64.3762,-99.4034\"/>\n",
       "<text text-anchor=\"middle\" x=\"33.3762\" y=\"-105.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;0 -->\n",
       "<g id=\"edge1\" class=\"edge\">\n",
       "<title>0&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M64.4782,-117.6229C74.4628,-117.5345 82.3762,-114.6602 82.3762,-109 82.3762,-105.4624 79.285,-103.013 74.529,-101.6519\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"74.8391,-98.1633 64.4782,-100.3771 73.9583,-105.1076 74.8391,-98.1633\"/>\n",
       "<text text-anchor=\"middle\" x=\"86.8762\" y=\"-105.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 1 -->\n",
       "<g id=\"node2\" class=\"node\">\n",
       "<title>1</title>\n",
       "<ellipse fill=\"none\" stroke=\"#000000\" cx=\"33.3762\" cy=\"-18\" rx=\"18\" ry=\"18\"/>\n",
       "<text text-anchor=\"middle\" x=\"33.3762\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;1 -->\n",
       "<g id=\"edge2\" class=\"edge\">\n",
       "<title>0&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M14.8129,-91.0971C9.4087,-84.6953 4.2022,-77.0562 1.3762,-69 -2.6784,-57.4412 3.6846,-45.7778 11.7773,-36.5278\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"14.285,-38.9695 18.7912,-29.3807 9.2889,-34.0665 14.285,-38.9695\"/>\n",
       "<text text-anchor=\"middle\" x=\"6.3762\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;0 -->\n",
       "<g id=\"edge3\" class=\"edge\">\n",
       "<title>1&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M33.3762,-36.1556C33.3762,-47.8111 33.3762,-63.2722 33.3762,-76.9511\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"29.8763,-76.9714 33.3762,-86.9714 36.8763,-76.9715 29.8763,-76.9714\"/>\n",
       "<text text-anchor=\"middle\" x=\"37.8762\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;0 -->\n",
       "<g id=\"edge4\" class=\"edge\">\n",
       "<title>1&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M39.2266,-35.3788C40.9187,-41.2248 42.5352,-47.8299 43.3762,-54 44.3945,-61.4706 43.8739,-69.4721 42.6545,-76.9943\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"39.2116,-76.3615 40.6376,-86.8599 46.0697,-77.7636 39.2116,-76.3615\"/>\n",
       "<text text-anchor=\"middle\" x=\"48.3762\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "</g>\n",
       "</svg>\n"
      ],
      "text/plain": [
       "<graphviz.dot.Digraph at 0x7f41a068ad90>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "avg epochs 6.42 min epochs 1 max epochs 13 std epochs 4.359107024195567 avg loss at epoch 0 1.3848290741443634 avg loss when fit 0.7236772906780243\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "Sorted by max epochs\n"
     ]
    },
    {
     "data": {
      "image/svg+xml": [
       "<?xml version=\"1.0\" encoding=\"UTF-8\" standalone=\"no\"?>\n",
       "<!DOCTYPE svg PUBLIC \"-//W3C//DTD SVG 1.1//EN\"\n",
       " \"http://www.w3.org/Graphics/SVG/1.1/DTD/svg11.dtd\">\n",
       "<!-- Generated by graphviz version 2.40.1 (20161225.0304)\n",
       " -->\n",
       "<!-- Title: %3 Pages: 1 -->\n",
       "<svg width=\"117pt\" height=\"44pt\"\n",
       " viewBox=\"0.00 0.00 117.00 44.00\" xmlns=\"http://www.w3.org/2000/svg\" xmlns:xlink=\"http://www.w3.org/1999/xlink\">\n",
       "<g id=\"graph0\" class=\"graph\" transform=\"scale(1 1) rotate(0) translate(4 40)\">\n",
       "<title>%3</title>\n",
       "<polygon fill=\"#ffffff\" stroke=\"transparent\" points=\"-4,4 -4,-40 113,-40 113,4 -4,4\"/>\n",
       "<!-- 0 -->\n",
       "<g id=\"node1\" class=\"node\">\n",
       "<title>0</title>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"54,-10.5442 54,-25.4558 38.1838,-36 15.8162,-36 0,-25.4558 0,-10.5442 15.8162,0 38.1838,0 54,-10.5442\"/>\n",
       "<text text-anchor=\"middle\" x=\"27\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;0 -->\n",
       "<g id=\"edge1\" class=\"edge\">\n",
       "<title>0&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M54.2408,-21.3717C64.0239,-21.4442 72,-20.3203 72,-18 72,-16.5861 69.0382,-15.6164 64.5105,-15.091\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"64.3882,-11.582 54.2408,-14.6283 64.0731,-18.5749 64.3882,-11.582\"/>\n",
       "<text text-anchor=\"middle\" x=\"76.5\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;0 -->\n",
       "<g id=\"edge2\" class=\"edge\">\n",
       "<title>0&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M54.1975,-24.1551C72.3402,-25.8876 90,-23.8359 90,-18 90,-13.2583 78.3418,-11.0148 64.2386,-11.2695\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"63.9809,-7.7784 54.1975,-11.8449 64.3814,-14.7669 63.9809,-7.7784\"/>\n",
       "<text text-anchor=\"middle\" x=\"95\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "</g>\n",
       "</svg>\n"
      ],
      "text/plain": [
       "<graphviz.dot.Digraph at 0x7f41a068ae20>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "avg epochs 1.01 min epochs 1 max epochs 2 std epochs 1.099498743710662 avg loss at epoch 0 1.4036058342456819 avg loss when fit 0.9353451192378998\n"
     ]
    },
    {
     "data": {
      "image/svg+xml": [
       "<?xml version=\"1.0\" encoding=\"UTF-8\" standalone=\"no\"?>\n",
       "<!DOCTYPE svg PUBLIC \"-//W3C//DTD SVG 1.1//EN\"\n",
       " \"http://www.w3.org/Graphics/SVG/1.1/DTD/svg11.dtd\">\n",
       "<!-- Generated by graphviz version 2.40.1 (20161225.0304)\n",
       " -->\n",
       "<!-- Title: %3 Pages: 1 -->\n",
       "<svg width=\"125pt\" height=\"52pt\"\n",
       " viewBox=\"0.00 0.00 125.00 52.00\" xmlns=\"http://www.w3.org/2000/svg\" xmlns:xlink=\"http://www.w3.org/1999/xlink\">\n",
       "<g id=\"graph0\" class=\"graph\" transform=\"scale(1 1) rotate(0) translate(4 48)\">\n",
       "<title>%3</title>\n",
       "<polygon fill=\"#ffffff\" stroke=\"transparent\" points=\"-4,4 -4,-48 121,-48 121,4 -4,4\"/>\n",
       "<!-- 0 -->\n",
       "<g id=\"node1\" class=\"node\">\n",
       "<title>0</title>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"58,-14.5442 58,-29.4558 42.1838,-40 19.8162,-40 4,-29.4558 4,-14.5442 19.8162,-4 42.1838,-4 58,-14.5442\"/>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"62,-12.4034 62,-31.5966 43.3949,-44 18.6051,-44 0,-31.5966 0,-12.4034 18.6051,0 43.3949,0 62,-12.4034\"/>\n",
       "<text text-anchor=\"middle\" x=\"31\" y=\"-18.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;0 -->\n",
       "<g id=\"edge1\" class=\"edge\">\n",
       "<title>0&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M62.102,-25.9365C72.0865,-25.8962 80,-24.584 80,-22 80,-20.385 76.9088,-19.2668 72.1528,-18.6454\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"72.2876,-15.1475 62.102,-18.0635 71.8829,-22.1358 72.2876,-15.1475\"/>\n",
       "<text text-anchor=\"middle\" x=\"84.5\" y=\"-18.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;0 -->\n",
       "<g id=\"edge2\" class=\"edge\">\n",
       "<title>0&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M62.0137,-29.3828C80.5521,-31.0234 98,-28.5625 98,-22 98,-16.668 86.4816,-14.0436 72.2187,-14.1269\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"71.8342,-10.6413 62.0137,-14.6172 72.1701,-17.6332 71.8342,-10.6413\"/>\n",
       "<text text-anchor=\"middle\" x=\"103\" y=\"-18.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "</g>\n",
       "</svg>\n"
      ],
      "text/plain": [
       "<graphviz.dot.Digraph at 0x7f41a068afa0>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "avg epochs 1.02 min epochs 1 max epochs 3 std epochs 1.198997487421324 avg loss at epoch 0 1.3925223922729493 avg loss when fit 0.9185943812131881\n"
     ]
    },
    {
     "data": {
      "image/svg+xml": [
       "<?xml version=\"1.0\" encoding=\"UTF-8\" standalone=\"no\"?>\n",
       "<!DOCTYPE svg PUBLIC \"-//W3C//DTD SVG 1.1//EN\"\n",
       " \"http://www.w3.org/Graphics/SVG/1.1/DTD/svg11.dtd\">\n",
       "<!-- Generated by graphviz version 2.40.1 (20161225.0304)\n",
       " -->\n",
       "<!-- Title: %3 Pages: 1 -->\n",
       "<svg width=\"112pt\" height=\"139pt\"\n",
       " viewBox=\"0.00 0.00 112.00 139.00\" xmlns=\"http://www.w3.org/2000/svg\" xmlns:xlink=\"http://www.w3.org/1999/xlink\">\n",
       "<g id=\"graph0\" class=\"graph\" transform=\"scale(1 1) rotate(0) translate(4 135)\">\n",
       "<title>%3</title>\n",
       "<polygon fill=\"#ffffff\" stroke=\"transparent\" points=\"-4,4 -4,-135 108,-135 108,4 -4,4\"/>\n",
       "<!-- 0 -->\n",
       "<g id=\"node1\" class=\"node\">\n",
       "<title>0</title>\n",
       "<ellipse fill=\"none\" stroke=\"#000000\" cx=\"27\" cy=\"-22\" rx=\"18\" ry=\"18\"/>\n",
       "<ellipse fill=\"none\" stroke=\"#000000\" cx=\"27\" cy=\"-22\" rx=\"22\" ry=\"22\"/>\n",
       "<text text-anchor=\"middle\" x=\"27\" y=\"-18.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;0 -->\n",
       "<g id=\"edge1\" class=\"edge\">\n",
       "<title>0&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M48.8066,-26.2451C58.5625,-26.6494 67,-25.2344 67,-22 67,-19.9785 63.7041,-18.6677 58.8504,-18.0676\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"58.9107,-14.5679 48.8066,-17.7549 58.6928,-21.5645 58.9107,-14.5679\"/>\n",
       "<text text-anchor=\"middle\" x=\"71.5\" y=\"-18.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;0 -->\n",
       "<g id=\"edge2\" class=\"edge\">\n",
       "<title>0&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M47.813,-29.2015C65.8838,-32.4865 85,-30.0859 85,-22 85,-15.4302 72.3803,-12.6136 57.9552,-13.5503\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"57.3106,-10.1032 47.813,-14.7985 58.1656,-17.0508 57.3106,-10.1032\"/>\n",
       "<text text-anchor=\"middle\" x=\"90\" y=\"-18.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 1 -->\n",
       "<g id=\"node2\" class=\"node\">\n",
       "<title>1</title>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"54,-105.5442 54,-120.4558 38.1838,-131 15.8162,-131 0,-120.4558 0,-105.5442 15.8162,-95 38.1838,-95 54,-105.5442\"/>\n",
       "<text text-anchor=\"middle\" x=\"27\" y=\"-109.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;0 -->\n",
       "<g id=\"edge3\" class=\"edge\">\n",
       "<title>1&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M17.7658,-94.7573C15.4038,-89.1988 13.1951,-82.9754 12,-77 10.3165,-68.5823 11.4955,-59.5551 13.7908,-51.2977\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"17.1484,-52.2941 17.0266,-41.6999 10.5152,-50.0577 17.1484,-52.2941\"/>\n",
       "<text text-anchor=\"middle\" x=\"16.5\" y=\"-65.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;0 -->\n",
       "<g id=\"edge4\" class=\"edge\">\n",
       "<title>1&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M27,-94.5848C27,-83.1105 27,-68.0231 27,-54.5774\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"30.5001,-54.2465 27,-44.2465 23.5001,-54.2466 30.5001,-54.2465\"/>\n",
       "<text text-anchor=\"middle\" x=\"32\" y=\"-65.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "</g>\n",
       "</svg>\n"
      ],
      "text/plain": [
       "<graphviz.dot.Digraph at 0x7f41a068adc0>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "avg epochs 1.9300000000000002 min epochs 1 max epochs 6 std epochs 2.2021231218140676 avg loss at epoch 0 1.3965786254405976 avg loss when fit 0.8911880993843079\n"
     ]
    },
    {
     "data": {
      "image/svg+xml": [
       "<?xml version=\"1.0\" encoding=\"UTF-8\" standalone=\"no\"?>\n",
       "<!DOCTYPE svg PUBLIC \"-//W3C//DTD SVG 1.1//EN\"\n",
       " \"http://www.w3.org/Graphics/SVG/1.1/DTD/svg11.dtd\">\n",
       "<!-- Generated by graphviz version 2.40.1 (20161225.0304)\n",
       " -->\n",
       "<!-- Title: %3 Pages: 1 -->\n",
       "<svg width=\"85pt\" height=\"139pt\"\n",
       " viewBox=\"0.00 0.00 84.59 139.00\" xmlns=\"http://www.w3.org/2000/svg\" xmlns:xlink=\"http://www.w3.org/1999/xlink\">\n",
       "<g id=\"graph0\" class=\"graph\" transform=\"scale(1 1) rotate(0) translate(4 135)\">\n",
       "<title>%3</title>\n",
       "<polygon fill=\"#ffffff\" stroke=\"transparent\" points=\"-4,4 -4,-135 80.5906,-135 80.5906,4 -4,4\"/>\n",
       "<!-- 0 -->\n",
       "<g id=\"node1\" class=\"node\">\n",
       "<title>0</title>\n",
       "<ellipse fill=\"none\" stroke=\"#000000\" cx=\"49.5906\" cy=\"-109\" rx=\"18\" ry=\"18\"/>\n",
       "<ellipse fill=\"none\" stroke=\"#000000\" cx=\"49.5906\" cy=\"-109\" rx=\"22\" ry=\"22\"/>\n",
       "<text text-anchor=\"middle\" x=\"49.5906\" y=\"-105.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 1 -->\n",
       "<g id=\"node2\" class=\"node\">\n",
       "<title>1</title>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"76.5906,-10.5442 76.5906,-25.4558 60.7744,-36 38.4069,-36 22.5906,-25.4558 22.5906,-10.5442 38.4069,0 60.7744,0 76.5906,-10.5442\"/>\n",
       "<text text-anchor=\"middle\" x=\"49.5906\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;1 -->\n",
       "<g id=\"edge1\" class=\"edge\">\n",
       "<title>0&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M30.0239,-98.6189C13.5164,-88.3622 -6.1387,-71.682 2.5906,-54 6.3017,-46.4829 12.4189,-40.1015 19.0324,-34.8951\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"21.3556,-37.5406 27.5311,-28.9317 17.3348,-31.8105 21.3556,-37.5406\"/>\n",
       "<text text-anchor=\"middle\" x=\"7.0906\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;1 -->\n",
       "<g id=\"edge2\" class=\"edge\">\n",
       "<title>0&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M39.6172,-89.3001C35.5182,-78.8865 32.2226,-65.8403 34.5906,-54 35.1321,-51.2924 35.8818,-48.5339 36.7595,-45.8093\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"40.1132,-46.8347 40.3564,-36.2427 33.561,-44.3712 40.1132,-46.8347\"/>\n",
       "<text text-anchor=\"middle\" x=\"39.5906\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;0 -->\n",
       "<g id=\"edge3\" class=\"edge\">\n",
       "<title>1&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M49.5906,-36.1556C49.5906,-47.8111 49.5906,-63.2722 49.5906,-76.9511\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"46.0907,-76.9714 49.5906,-86.9714 53.0907,-76.9715 46.0907,-76.9714\"/>\n",
       "<text text-anchor=\"middle\" x=\"54.0906\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;0 -->\n",
       "<g id=\"edge4\" class=\"edge\">\n",
       "<title>1&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M57.5995,-36.3492C59.6467,-41.9107 61.5596,-48.109 62.5906,-54 64.0179,-62.1547 63.0922,-70.9086 61.2094,-78.9809\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"57.8017,-78.1679 58.4179,-88.7448 64.532,-80.0922 57.8017,-78.1679\"/>\n",
       "<text text-anchor=\"middle\" x=\"67.5906\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "</g>\n",
       "</svg>\n"
      ],
      "text/plain": [
       "<graphviz.dot.Digraph at 0x7f41a068ac70>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "avg epochs 2.6100000000000003 min epochs 1 max epochs 6 std epochs 2.4205280708243677 avg loss at epoch 0 1.387124490737915 avg loss when fit 0.9513023608922958\n"
     ]
    },
    {
     "data": {
      "image/svg+xml": [
       "<?xml version=\"1.0\" encoding=\"UTF-8\" standalone=\"no\"?>\n",
       "<!DOCTYPE svg PUBLIC \"-//W3C//DTD SVG 1.1//EN\"\n",
       " \"http://www.w3.org/Graphics/SVG/1.1/DTD/svg11.dtd\">\n",
       "<!-- Generated by graphviz version 2.40.1 (20161225.0304)\n",
       " -->\n",
       "<!-- Title: %3 Pages: 1 -->\n",
       "<svg width=\"88pt\" height=\"139pt\"\n",
       " viewBox=\"0.00 0.00 88.48 139.00\" xmlns=\"http://www.w3.org/2000/svg\" xmlns:xlink=\"http://www.w3.org/1999/xlink\">\n",
       "<g id=\"graph0\" class=\"graph\" transform=\"scale(1 1) rotate(0) translate(4 135)\">\n",
       "<title>%3</title>\n",
       "<polygon fill=\"#ffffff\" stroke=\"transparent\" points=\"-4,4 -4,-135 84.4814,-135 84.4814,4 -4,4\"/>\n",
       "<!-- 0 -->\n",
       "<g id=\"node1\" class=\"node\">\n",
       "<title>0</title>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"76.4814,-101.5442 76.4814,-116.4558 60.6652,-127 38.2976,-127 22.4814,-116.4558 22.4814,-101.5442 38.2976,-91 60.6652,-91 76.4814,-101.5442\"/>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"80.4814,-99.4034 80.4814,-118.5966 61.8763,-131 37.0865,-131 18.4814,-118.5966 18.4814,-99.4034 37.0865,-87 61.8763,-87 80.4814,-99.4034\"/>\n",
       "<text text-anchor=\"middle\" x=\"49.4814\" y=\"-105.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 1 -->\n",
       "<g id=\"node2\" class=\"node\">\n",
       "<title>1</title>\n",
       "<ellipse fill=\"none\" stroke=\"#000000\" cx=\"49.4814\" cy=\"-18\" rx=\"18\" ry=\"18\"/>\n",
       "<text text-anchor=\"middle\" x=\"49.4814\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;1 -->\n",
       "<g id=\"edge1\" class=\"edge\">\n",
       "<title>0&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M24.4817,-95.0681C9.4835,-84.7382 -5.3027,-69.7674 2.4814,-54 7.1416,-44.5604 15.596,-36.9117 24.0627,-31.1317\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"26.0556,-34.0149 32.7318,-25.7882 22.3825,-28.0559 26.0556,-34.0149\"/>\n",
       "<text text-anchor=\"middle\" x=\"6.9814\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;1 -->\n",
       "<g id=\"edge2\" class=\"edge\">\n",
       "<title>0&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M38.6159,-86.954C34.9536,-76.9682 32.288,-64.9668 34.4814,-54 35.1798,-50.5081 36.2243,-46.9315 37.4433,-43.4525\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"40.7371,-44.6417 41.1981,-34.0569 34.237,-42.044 40.7371,-44.6417\"/>\n",
       "<text text-anchor=\"middle\" x=\"39.4814\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;0 -->\n",
       "<g id=\"edge3\" class=\"edge\">\n",
       "<title>1&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M49.4814,-36.1556C49.4814,-47.8111 49.4814,-63.2722 49.4814,-76.9511\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"45.9815,-76.9714 49.4814,-86.9714 52.9815,-76.9715 45.9815,-76.9714\"/>\n",
       "<text text-anchor=\"middle\" x=\"53.9814\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;0 -->\n",
       "<g id=\"edge4\" class=\"edge\">\n",
       "<title>1&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M56.804,-34.5202C59.1015,-40.5295 61.3358,-47.4545 62.4814,-54 63.7955,-61.5083 63.1149,-69.5247 61.5291,-77.0492\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"58.0941,-76.3478 58.9081,-86.9113 64.8593,-78.1458 58.0941,-76.3478\"/>\n",
       "<text text-anchor=\"middle\" x=\"67.4814\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "</g>\n",
       "</svg>\n"
      ],
      "text/plain": [
       "<graphviz.dot.Digraph at 0x7f41a068af40>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "avg epochs 2.6100000000000003 min epochs 1 max epochs 6 std epochs 2.333379165878933 avg loss at epoch 0 1.401513180732727 avg loss when fit 0.9501019644737244\n"
     ]
    },
    {
     "data": {
      "image/svg+xml": [
       "<?xml version=\"1.0\" encoding=\"UTF-8\" standalone=\"no\"?>\n",
       "<!DOCTYPE svg PUBLIC \"-//W3C//DTD SVG 1.1//EN\"\n",
       " \"http://www.w3.org/Graphics/SVG/1.1/DTD/svg11.dtd\">\n",
       "<!-- Generated by graphviz version 2.40.1 (20161225.0304)\n",
       " -->\n",
       "<!-- Title: %3 Pages: 1 -->\n",
       "<svg width=\"112pt\" height=\"139pt\"\n",
       " viewBox=\"0.00 0.00 112.00 139.00\" xmlns=\"http://www.w3.org/2000/svg\" xmlns:xlink=\"http://www.w3.org/1999/xlink\">\n",
       "<g id=\"graph0\" class=\"graph\" transform=\"scale(1 1) rotate(0) translate(4 135)\">\n",
       "<title>%3</title>\n",
       "<polygon fill=\"#ffffff\" stroke=\"transparent\" points=\"-4,4 -4,-135 108,-135 108,4 -4,4\"/>\n",
       "<!-- 0 -->\n",
       "<g id=\"node1\" class=\"node\">\n",
       "<title>0</title>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"58,-101.5442 58,-116.4558 42.1838,-127 19.8162,-127 4,-116.4558 4,-101.5442 19.8162,-91 42.1838,-91 58,-101.5442\"/>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"62,-99.4034 62,-118.5966 43.3949,-131 18.6051,-131 0,-118.5966 0,-99.4034 18.6051,-87 43.3949,-87 62,-99.4034\"/>\n",
       "<text text-anchor=\"middle\" x=\"31\" y=\"-105.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 1 -->\n",
       "<g id=\"node2\" class=\"node\">\n",
       "<title>1</title>\n",
       "<ellipse fill=\"none\" stroke=\"#000000\" cx=\"31\" cy=\"-18\" rx=\"18\" ry=\"18\"/>\n",
       "<text text-anchor=\"middle\" x=\"31\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;1 -->\n",
       "<g id=\"edge1\" class=\"edge\">\n",
       "<title>0&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M20.1345,-86.954C16.4722,-76.9682 13.8066,-64.9668 16,-54 16.6984,-50.5081 17.7429,-46.9315 18.9619,-43.4525\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"22.2557,-44.6417 22.7167,-34.0569 15.7556,-42.044 22.2557,-44.6417\"/>\n",
       "<text text-anchor=\"middle\" x=\"20.5\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;1 -->\n",
       "<g id=\"edge2\" class=\"edge\">\n",
       "<title>0&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M31,-86.9714C31,-74.8075 31,-59.5615 31,-46.499\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"34.5001,-46.1556 31,-36.1556 27.5001,-46.1556 34.5001,-46.1556\"/>\n",
       "<text text-anchor=\"middle\" x=\"36\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;1 -->\n",
       "<g id=\"edge3\" class=\"edge\">\n",
       "<title>1&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M48.7817,-21.775C58.3149,-22.4165 67,-21.1582 67,-18 67,-16.0755 63.7749,-14.8564 59.0981,-14.3429\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"58.8211,-10.8396 48.7817,-14.225 58.741,-17.8391 58.8211,-10.8396\"/>\n",
       "<text text-anchor=\"middle\" x=\"71.5\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;1 -->\n",
       "<g id=\"edge4\" class=\"edge\">\n",
       "<title>1&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M48.1418,-24.1447C65.585,-27.7592 85,-25.7109 85,-18 85,-11.7951 72.4283,-9.2569 58.4287,-10.3855\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"57.5461,-6.976 48.1418,-11.8553 58.5363,-13.9056 57.5461,-6.976\"/>\n",
       "<text text-anchor=\"middle\" x=\"90\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "</g>\n",
       "</svg>\n"
      ],
      "text/plain": [
       "<graphviz.dot.Digraph at 0x7f41a068aa90>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "avg epochs 2.0 min epochs 1 max epochs 8 std epochs 2.3490737563232043 avg loss at epoch 0 1.3975653278827667 avg loss when fit 0.8985250204801559\n"
     ]
    },
    {
     "data": {
      "image/svg+xml": [
       "<?xml version=\"1.0\" encoding=\"UTF-8\" standalone=\"no\"?>\n",
       "<!DOCTYPE svg PUBLIC \"-//W3C//DTD SVG 1.1//EN\"\n",
       " \"http://www.w3.org/Graphics/SVG/1.1/DTD/svg11.dtd\">\n",
       "<!-- Generated by graphviz version 2.40.1 (20161225.0304)\n",
       " -->\n",
       "<!-- Title: %3 Pages: 1 -->\n",
       "<svg width=\"85pt\" height=\"139pt\"\n",
       " viewBox=\"0.00 0.00 85.33 139.00\" xmlns=\"http://www.w3.org/2000/svg\" xmlns:xlink=\"http://www.w3.org/1999/xlink\">\n",
       "<g id=\"graph0\" class=\"graph\" transform=\"scale(1 1) rotate(0) translate(4 135)\">\n",
       "<title>%3</title>\n",
       "<polygon fill=\"#ffffff\" stroke=\"transparent\" points=\"-4,4 -4,-135 81.3273,-135 81.3273,4 -4,4\"/>\n",
       "<!-- 0 -->\n",
       "<g id=\"node1\" class=\"node\">\n",
       "<title>0</title>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"59.3273,-101.5442 59.3273,-116.4558 43.5111,-127 21.1436,-127 5.3273,-116.4558 5.3273,-101.5442 21.1436,-91 43.5111,-91 59.3273,-101.5442\"/>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"63.3273,-99.4034 63.3273,-118.5966 44.7222,-131 19.9325,-131 1.3273,-118.5966 1.3273,-99.4034 19.9325,-87 44.7222,-87 63.3273,-99.4034\"/>\n",
       "<text text-anchor=\"middle\" x=\"32.3273\" y=\"-105.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 1 -->\n",
       "<g id=\"node2\" class=\"node\">\n",
       "<title>1</title>\n",
       "<ellipse fill=\"none\" stroke=\"#000000\" cx=\"32.3273\" cy=\"-18\" rx=\"18\" ry=\"18\"/>\n",
       "<text text-anchor=\"middle\" x=\"32.3273\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;1 -->\n",
       "<g id=\"edge1\" class=\"edge\">\n",
       "<title>0&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M14.0086,-90.606C8.8906,-84.2826 4.0008,-76.814 1.3273,-69 -2.5641,-57.6263 3.4383,-46.0871 11.1662,-36.8684\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"13.8732,-39.0996 18.1963,-29.4269 8.7848,-34.2925 13.8732,-39.0996\"/>\n",
       "<text text-anchor=\"middle\" x=\"5.8273\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;1 -->\n",
       "<g id=\"edge2\" class=\"edge\">\n",
       "<title>0&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M32.3273,-86.9714C32.3273,-74.8075 32.3273,-59.5615 32.3273,-46.499\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"35.8274,-46.1556 32.3273,-36.1556 28.8274,-46.1556 35.8274,-46.1556\"/>\n",
       "<text text-anchor=\"middle\" x=\"37.3273\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;0 -->\n",
       "<g id=\"edge4\" class=\"edge\">\n",
       "<title>1&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M38.6443,-34.9737C40.5474,-40.9055 42.3812,-47.6657 43.3273,-54 44.4449,-61.482 43.8712,-69.488 42.5297,-77.0109\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"39.0908,-76.3511 40.3114,-86.8754 45.9202,-77.887 39.0908,-76.3511\"/>\n",
       "<text text-anchor=\"middle\" x=\"48.3273\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;1 -->\n",
       "<g id=\"edge3\" class=\"edge\">\n",
       "<title>1&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M48.9914,-25.3828C58.9523,-27.0234 68.3273,-24.5625 68.3273,-18 68.3273,-13.7959 64.4798,-11.2751 59.0956,-10.4375\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"58.9276,-6.9399 48.9914,-10.6172 59.0521,-13.9388 58.9276,-6.9399\"/>\n",
       "<text text-anchor=\"middle\" x=\"72.8273\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "</g>\n",
       "</svg>\n"
      ],
      "text/plain": [
       "<graphviz.dot.Digraph at 0x7f41a068ab20>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "avg epochs 4.01 min epochs 1 max epochs 9 std epochs 3.7838642208268705 avg loss at epoch 0 1.398785378932953 avg loss when fit 0.8564903074502945\n"
     ]
    },
    {
     "data": {
      "image/svg+xml": [
       "<?xml version=\"1.0\" encoding=\"UTF-8\" standalone=\"no\"?>\n",
       "<!DOCTYPE svg PUBLIC \"-//W3C//DTD SVG 1.1//EN\"\n",
       " \"http://www.w3.org/Graphics/SVG/1.1/DTD/svg11.dtd\">\n",
       "<!-- Generated by graphviz version 2.40.1 (20161225.0304)\n",
       " -->\n",
       "<!-- Title: %3 Pages: 1 -->\n",
       "<svg width=\"112pt\" height=\"139pt\"\n",
       " viewBox=\"0.00 0.00 112.00 139.00\" xmlns=\"http://www.w3.org/2000/svg\" xmlns:xlink=\"http://www.w3.org/1999/xlink\">\n",
       "<g id=\"graph0\" class=\"graph\" transform=\"scale(1 1) rotate(0) translate(4 135)\">\n",
       "<title>%3</title>\n",
       "<polygon fill=\"#ffffff\" stroke=\"transparent\" points=\"-4,4 -4,-135 108,-135 108,4 -4,4\"/>\n",
       "<!-- 0 -->\n",
       "<g id=\"node1\" class=\"node\">\n",
       "<title>0</title>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"58,-101.5442 58,-116.4558 42.1838,-127 19.8162,-127 4,-116.4558 4,-101.5442 19.8162,-91 42.1838,-91 58,-101.5442\"/>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"62,-99.4034 62,-118.5966 43.3949,-131 18.6051,-131 0,-118.5966 0,-99.4034 18.6051,-87 43.3949,-87 62,-99.4034\"/>\n",
       "<text text-anchor=\"middle\" x=\"31\" y=\"-105.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;0 -->\n",
       "<g id=\"edge2\" class=\"edge\">\n",
       "<title>0&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M62.102,-117.6229C72.0865,-117.5345 80,-114.6602 80,-109 80,-105.4624 76.9088,-103.013 72.1528,-101.6519\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"72.4629,-98.1633 62.102,-100.3771 71.5821,-105.1076 72.4629,-98.1633\"/>\n",
       "<text text-anchor=\"middle\" x=\"85\" y=\"-105.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 1 -->\n",
       "<g id=\"node2\" class=\"node\">\n",
       "<title>1</title>\n",
       "<ellipse fill=\"none\" stroke=\"#000000\" cx=\"31\" cy=\"-18\" rx=\"18\" ry=\"18\"/>\n",
       "<text text-anchor=\"middle\" x=\"31\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;1 -->\n",
       "<g id=\"edge1\" class=\"edge\">\n",
       "<title>0&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M31,-86.9714C31,-74.8075 31,-59.5615 31,-46.499\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"34.5001,-46.1556 31,-36.1556 27.5001,-46.1556 34.5001,-46.1556\"/>\n",
       "<text text-anchor=\"middle\" x=\"35.5\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;1 -->\n",
       "<g id=\"edge3\" class=\"edge\">\n",
       "<title>1&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M48.7817,-21.775C58.3149,-22.4165 67,-21.1582 67,-18 67,-16.0755 63.7749,-14.8564 59.0981,-14.3429\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"58.8211,-10.8396 48.7817,-14.225 58.741,-17.8391 58.8211,-10.8396\"/>\n",
       "<text text-anchor=\"middle\" x=\"71.5\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;1 -->\n",
       "<g id=\"edge4\" class=\"edge\">\n",
       "<title>1&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M48.1418,-24.1447C65.585,-27.7592 85,-25.7109 85,-18 85,-11.7951 72.4283,-9.2569 58.4287,-10.3855\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"57.5461,-6.976 48.1418,-11.8553 58.5363,-13.9056 57.5461,-6.976\"/>\n",
       "<text text-anchor=\"middle\" x=\"90\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "</g>\n",
       "</svg>\n"
      ],
      "text/plain": [
       "<graphviz.dot.Digraph at 0x7f41a068ac70>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "avg epochs 3.73 min epochs 1 max epochs 13 std epochs 3.7453779339100106 avg loss at epoch 0 1.4002061438560487 avg loss when fit 0.7947436776757241\n"
     ]
    },
    {
     "data": {
      "image/svg+xml": [
       "<?xml version=\"1.0\" encoding=\"UTF-8\" standalone=\"no\"?>\n",
       "<!DOCTYPE svg PUBLIC \"-//W3C//DTD SVG 1.1//EN\"\n",
       " \"http://www.w3.org/Graphics/SVG/1.1/DTD/svg11.dtd\">\n",
       "<!-- Generated by graphviz version 2.40.1 (20161225.0304)\n",
       " -->\n",
       "<!-- Title: %3 Pages: 1 -->\n",
       "<svg width=\"112pt\" height=\"139pt\"\n",
       " viewBox=\"0.00 0.00 112.00 139.00\" xmlns=\"http://www.w3.org/2000/svg\" xmlns:xlink=\"http://www.w3.org/1999/xlink\">\n",
       "<g id=\"graph0\" class=\"graph\" transform=\"scale(1 1) rotate(0) translate(4 135)\">\n",
       "<title>%3</title>\n",
       "<polygon fill=\"#ffffff\" stroke=\"transparent\" points=\"-4,4 -4,-135 108,-135 108,4 -4,4\"/>\n",
       "<!-- 0 -->\n",
       "<g id=\"node1\" class=\"node\">\n",
       "<title>0</title>\n",
       "<ellipse fill=\"none\" stroke=\"#000000\" cx=\"27\" cy=\"-22\" rx=\"18\" ry=\"18\"/>\n",
       "<ellipse fill=\"none\" stroke=\"#000000\" cx=\"27\" cy=\"-22\" rx=\"22\" ry=\"22\"/>\n",
       "<text text-anchor=\"middle\" x=\"27\" y=\"-18.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;0 -->\n",
       "<g id=\"edge1\" class=\"edge\">\n",
       "<title>0&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M48.8066,-26.2451C58.5625,-26.6494 67,-25.2344 67,-22 67,-19.9785 63.7041,-18.6677 58.8504,-18.0676\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"58.9107,-14.5679 48.8066,-17.7549 58.6928,-21.5645 58.9107,-14.5679\"/>\n",
       "<text text-anchor=\"middle\" x=\"71.5\" y=\"-18.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;0 -->\n",
       "<g id=\"edge2\" class=\"edge\">\n",
       "<title>0&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M47.813,-29.2015C65.8838,-32.4865 85,-30.0859 85,-22 85,-15.4302 72.3803,-12.6136 57.9552,-13.5503\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"57.3106,-10.1032 47.813,-14.7985 58.1656,-17.0508 57.3106,-10.1032\"/>\n",
       "<text text-anchor=\"middle\" x=\"90\" y=\"-18.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 1 -->\n",
       "<g id=\"node2\" class=\"node\">\n",
       "<title>1</title>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"54,-105.5442 54,-120.4558 38.1838,-131 15.8162,-131 0,-120.4558 0,-105.5442 15.8162,-95 38.1838,-95 54,-105.5442\"/>\n",
       "<text text-anchor=\"middle\" x=\"27\" y=\"-109.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;0 -->\n",
       "<g id=\"edge4\" class=\"edge\">\n",
       "<title>1&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M27,-94.5848C27,-83.1105 27,-68.0231 27,-54.5774\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"30.5001,-54.2465 27,-44.2465 23.5001,-54.2466 30.5001,-54.2465\"/>\n",
       "<text text-anchor=\"middle\" x=\"32\" y=\"-65.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;1 -->\n",
       "<g id=\"edge3\" class=\"edge\">\n",
       "<title>1&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M53.7949,-120.8577C63.7804,-121.1153 72,-118.4961 72,-113 72,-109.5649 68.7892,-107.2537 63.9433,-106.0661\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"64.071,-102.5634 53.7949,-105.1423 63.4363,-109.5346 64.071,-102.5634\"/>\n",
       "<text text-anchor=\"middle\" x=\"76.5\" y=\"-109.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "</g>\n",
       "</svg>\n"
      ],
      "text/plain": [
       "<graphviz.dot.Digraph at 0x7f41a068adc0>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "avg epochs 4.43 min epochs 1 max epochs 13 std epochs 4.027391616557065 avg loss at epoch 0 1.3896378016471862 avg loss when fit 0.7640904745459557\n"
     ]
    },
    {
     "data": {
      "image/svg+xml": [
       "<?xml version=\"1.0\" encoding=\"UTF-8\" standalone=\"no\"?>\n",
       "<!DOCTYPE svg PUBLIC \"-//W3C//DTD SVG 1.1//EN\"\n",
       " \"http://www.w3.org/Graphics/SVG/1.1/DTD/svg11.dtd\">\n",
       "<!-- Generated by graphviz version 2.40.1 (20161225.0304)\n",
       " -->\n",
       "<!-- Title: %3 Pages: 1 -->\n",
       "<svg width=\"91pt\" height=\"139pt\"\n",
       " viewBox=\"0.00 0.00 90.78 139.00\" xmlns=\"http://www.w3.org/2000/svg\" xmlns:xlink=\"http://www.w3.org/1999/xlink\">\n",
       "<g id=\"graph0\" class=\"graph\" transform=\"scale(1 1) rotate(0) translate(4 135)\">\n",
       "<title>%3</title>\n",
       "<polygon fill=\"#ffffff\" stroke=\"transparent\" points=\"-4,4 -4,-135 86.783,-135 86.783,4 -4,4\"/>\n",
       "<!-- 0 -->\n",
       "<g id=\"node1\" class=\"node\">\n",
       "<title>0</title>\n",
       "<ellipse fill=\"none\" stroke=\"#000000\" cx=\"33.783\" cy=\"-109\" rx=\"18\" ry=\"18\"/>\n",
       "<ellipse fill=\"none\" stroke=\"#000000\" cx=\"33.783\" cy=\"-109\" rx=\"22\" ry=\"22\"/>\n",
       "<text text-anchor=\"middle\" x=\"33.783\" y=\"-105.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;0 -->\n",
       "<g id=\"edge1\" class=\"edge\">\n",
       "<title>0&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M54.3638,-117.3702C64.6277,-118.5284 73.783,-115.7383 73.783,-109 73.783,-104.6833 70.0256,-101.9869 64.6265,-100.9109\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"64.4559,-97.405 54.3638,-100.6298 64.2641,-104.4024 64.4559,-97.405\"/>\n",
       "<text text-anchor=\"middle\" x=\"78.283\" y=\"-105.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 1 -->\n",
       "<g id=\"node2\" class=\"node\">\n",
       "<title>1</title>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"60.783,-10.5442 60.783,-25.4558 44.9667,-36 22.5992,-36 6.783,-25.4558 6.783,-10.5442 22.5992,0 44.9667,0 60.783,-10.5442\"/>\n",
       "<text text-anchor=\"middle\" x=\"33.783\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;1 -->\n",
       "<g id=\"edge2\" class=\"edge\">\n",
       "<title>0&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M17.5898,-93.8165C11.3846,-86.9145 5.021,-78.2311 1.783,-69 -1.783,-58.8344 2.7088,-48.588 9.3483,-39.9734\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"12.1633,-42.0742 16.1792,-32.27 6.9258,-37.4299 12.1633,-42.0742\"/>\n",
       "<text text-anchor=\"middle\" x=\"6.783\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;0 -->\n",
       "<g id=\"edge3\" class=\"edge\">\n",
       "<title>1&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M33.783,-36.1556C33.783,-47.8111 33.783,-63.2722 33.783,-76.9511\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"30.2831,-76.9714 33.783,-86.9714 37.2831,-76.9715 30.2831,-76.9714\"/>\n",
       "<text text-anchor=\"middle\" x=\"38.283\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;0 -->\n",
       "<g id=\"edge4\" class=\"edge\">\n",
       "<title>1&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M39.8444,-36.1134C41.4588,-41.7745 42.977,-48.087 43.783,-54 44.8493,-61.823 44.2281,-70.2281 42.8841,-78.0554\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"39.4443,-77.4047 40.7823,-87.9147 46.2904,-78.8642 39.4443,-77.4047\"/>\n",
       "<text text-anchor=\"middle\" x=\"48.783\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "</g>\n",
       "</svg>\n"
      ],
      "text/plain": [
       "<graphviz.dot.Digraph at 0x7f41a068ab80>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "avg epochs 4.52 min epochs 1 max epochs 13 std epochs 4.195246469366644 avg loss at epoch 0 1.401658388376236 avg loss when fit 0.8417020487785339\n"
     ]
    },
    {
     "data": {
      "image/svg+xml": [
       "<?xml version=\"1.0\" encoding=\"UTF-8\" standalone=\"no\"?>\n",
       "<!DOCTYPE svg PUBLIC \"-//W3C//DTD SVG 1.1//EN\"\n",
       " \"http://www.w3.org/Graphics/SVG/1.1/DTD/svg11.dtd\">\n",
       "<!-- Generated by graphviz version 2.40.1 (20161225.0304)\n",
       " -->\n",
       "<!-- Title: %3 Pages: 1 -->\n",
       "<svg width=\"89pt\" height=\"139pt\"\n",
       " viewBox=\"0.00 0.00 89.00 139.00\" xmlns=\"http://www.w3.org/2000/svg\" xmlns:xlink=\"http://www.w3.org/1999/xlink\">\n",
       "<g id=\"graph0\" class=\"graph\" transform=\"scale(1 1) rotate(0) translate(4 135)\">\n",
       "<title>%3</title>\n",
       "<polygon fill=\"#ffffff\" stroke=\"transparent\" points=\"-4,4 -4,-135 85,-135 85,4 -4,4\"/>\n",
       "<!-- 0 -->\n",
       "<g id=\"node1\" class=\"node\">\n",
       "<title>0</title>\n",
       "<ellipse fill=\"none\" stroke=\"#000000\" cx=\"27\" cy=\"-109\" rx=\"18\" ry=\"18\"/>\n",
       "<ellipse fill=\"none\" stroke=\"#000000\" cx=\"27\" cy=\"-109\" rx=\"22\" ry=\"22\"/>\n",
       "<text text-anchor=\"middle\" x=\"27\" y=\"-105.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;0 -->\n",
       "<g id=\"edge1\" class=\"edge\">\n",
       "<title>0&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M47.5808,-117.3702C57.8447,-118.5284 67,-115.7383 67,-109 67,-104.6833 63.2427,-101.9869 57.8436,-100.9109\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"57.6729,-97.405 47.5808,-100.6298 57.4812,-104.4024 57.6729,-97.405\"/>\n",
       "<text text-anchor=\"middle\" x=\"71.5\" y=\"-105.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 1 -->\n",
       "<g id=\"node2\" class=\"node\">\n",
       "<title>1</title>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"54,-10.5442 54,-25.4558 38.1838,-36 15.8162,-36 0,-25.4558 0,-10.5442 15.8162,0 38.1838,0 54,-10.5442\"/>\n",
       "<text text-anchor=\"middle\" x=\"27\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;1 -->\n",
       "<g id=\"edge2\" class=\"edge\">\n",
       "<title>0&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M17.0266,-89.3001C12.9276,-78.8865 9.6319,-65.8403 12,-54 12.5415,-51.2924 13.2912,-48.5339 14.1689,-45.8093\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"17.5225,-46.8347 17.7658,-36.2427 10.9703,-44.3712 17.5225,-46.8347\"/>\n",
       "<text text-anchor=\"middle\" x=\"17\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;0 -->\n",
       "<g id=\"edge4\" class=\"edge\">\n",
       "<title>1&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M27,-36.1556C27,-47.8111 27,-63.2722 27,-76.9511\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"23.5001,-76.9714 27,-86.9714 30.5001,-76.9715 23.5001,-76.9714\"/>\n",
       "<text text-anchor=\"middle\" x=\"32\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;1 -->\n",
       "<g id=\"edge3\" class=\"edge\">\n",
       "<title>1&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M53.7949,-25.8577C63.7804,-26.1153 72,-23.4961 72,-18 72,-14.5649 68.7892,-12.2537 63.9433,-11.0661\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"64.071,-7.5634 53.7949,-10.1423 63.4363,-14.5346 64.071,-7.5634\"/>\n",
       "<text text-anchor=\"middle\" x=\"76.5\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "</g>\n",
       "</svg>\n"
      ],
      "text/plain": [
       "<graphviz.dot.Digraph at 0x7f41a068ad30>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "avg epochs 5.66 min epochs 1 max epochs 13 std epochs 4.191300675273328 avg loss at epoch 0 1.3994489264488221 avg loss when fit 0.7718555393815041\n"
     ]
    },
    {
     "data": {
      "image/svg+xml": [
       "<?xml version=\"1.0\" encoding=\"UTF-8\" standalone=\"no\"?>\n",
       "<!DOCTYPE svg PUBLIC \"-//W3C//DTD SVG 1.1//EN\"\n",
       " \"http://www.w3.org/Graphics/SVG/1.1/DTD/svg11.dtd\">\n",
       "<!-- Generated by graphviz version 2.40.1 (20161225.0304)\n",
       " -->\n",
       "<!-- Title: %3 Pages: 1 -->\n",
       "<svg width=\"95pt\" height=\"139pt\"\n",
       " viewBox=\"0.00 0.00 94.73 139.00\" xmlns=\"http://www.w3.org/2000/svg\" xmlns:xlink=\"http://www.w3.org/1999/xlink\">\n",
       "<g id=\"graph0\" class=\"graph\" transform=\"scale(1 1) rotate(0) translate(4 135)\">\n",
       "<title>%3</title>\n",
       "<polygon fill=\"#ffffff\" stroke=\"transparent\" points=\"-4,4 -4,-135 90.7285,-135 90.7285,4 -4,4\"/>\n",
       "<!-- 0 -->\n",
       "<g id=\"node1\" class=\"node\">\n",
       "<title>0</title>\n",
       "<ellipse fill=\"none\" stroke=\"#000000\" cx=\"32.7285\" cy=\"-109\" rx=\"18\" ry=\"18\"/>\n",
       "<ellipse fill=\"none\" stroke=\"#000000\" cx=\"32.7285\" cy=\"-109\" rx=\"22\" ry=\"22\"/>\n",
       "<text text-anchor=\"middle\" x=\"32.7285\" y=\"-105.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 1 -->\n",
       "<g id=\"node2\" class=\"node\">\n",
       "<title>1</title>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"59.7285,-10.5442 59.7285,-25.4558 43.9122,-36 21.5447,-36 5.7285,-25.4558 5.7285,-10.5442 21.5447,0 43.9122,0 59.7285,-10.5442\"/>\n",
       "<text text-anchor=\"middle\" x=\"32.7285\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;1 -->\n",
       "<g id=\"edge1\" class=\"edge\">\n",
       "<title>0&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M16.7051,-93.3525C10.7974,-86.4997 4.8001,-77.9778 1.7285,-69 -1.7285,-58.8961 2.6224,-48.6617 9.0548,-40.0395\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"11.8189,-42.1928 15.6727,-32.3237 6.5056,-37.6355 11.8189,-42.1928\"/>\n",
       "<text text-anchor=\"middle\" x=\"6.2285\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;1 -->\n",
       "<g id=\"edge2\" class=\"edge\">\n",
       "<title>0&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M32.7285,-86.9714C32.7285,-74.8075 32.7285,-59.5615 32.7285,-46.499\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"36.2286,-46.1556 32.7285,-36.1556 29.2286,-46.1556 36.2286,-46.1556\"/>\n",
       "<text text-anchor=\"middle\" x=\"37.7285\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;0 -->\n",
       "<g id=\"edge4\" class=\"edge\">\n",
       "<title>1&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M39.394,-36.0722C41.1698,-41.7317 42.8402,-48.0535 43.7285,-54 44.9088,-61.9018 44.2026,-70.3881 42.6979,-78.2726\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"39.2478,-77.6538 40.3515,-88.191 46.0598,-79.2654 39.2478,-77.6538\"/>\n",
       "<text text-anchor=\"middle\" x=\"48.7285\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;1 -->\n",
       "<g id=\"edge3\" class=\"edge\">\n",
       "<title>1&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M59.5233,-25.8577C69.5089,-26.1153 77.7285,-23.4961 77.7285,-18 77.7285,-14.5649 74.5177,-12.2537 69.6717,-11.0661\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"69.7995,-7.5634 59.5233,-10.1423 69.1648,-14.5346 69.7995,-7.5634\"/>\n",
       "<text text-anchor=\"middle\" x=\"82.2285\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "</g>\n",
       "</svg>\n"
      ],
      "text/plain": [
       "<graphviz.dot.Digraph at 0x7f41a068aee0>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "avg epochs 5.87 min epochs 1 max epochs 13 std epochs 4.645970378376655 avg loss at epoch 0 1.3975611889362336 avg loss when fit 0.7624968060851097\n"
     ]
    },
    {
     "data": {
      "image/svg+xml": [
       "<?xml version=\"1.0\" encoding=\"UTF-8\" standalone=\"no\"?>\n",
       "<!DOCTYPE svg PUBLIC \"-//W3C//DTD SVG 1.1//EN\"\n",
       " \"http://www.w3.org/Graphics/SVG/1.1/DTD/svg11.dtd\">\n",
       "<!-- Generated by graphviz version 2.40.1 (20161225.0304)\n",
       " -->\n",
       "<!-- Title: %3 Pages: 1 -->\n",
       "<svg width=\"99pt\" height=\"139pt\"\n",
       " viewBox=\"0.00 0.00 99.38 139.00\" xmlns=\"http://www.w3.org/2000/svg\" xmlns:xlink=\"http://www.w3.org/1999/xlink\">\n",
       "<g id=\"graph0\" class=\"graph\" transform=\"scale(1 1) rotate(0) translate(4 135)\">\n",
       "<title>%3</title>\n",
       "<polygon fill=\"#ffffff\" stroke=\"transparent\" points=\"-4,4 -4,-135 95.3762,-135 95.3762,4 -4,4\"/>\n",
       "<!-- 0 -->\n",
       "<g id=\"node1\" class=\"node\">\n",
       "<title>0</title>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"60.3762,-101.5442 60.3762,-116.4558 44.56,-127 22.1924,-127 6.3762,-116.4558 6.3762,-101.5442 22.1924,-91 44.56,-91 60.3762,-101.5442\"/>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"64.3762,-99.4034 64.3762,-118.5966 45.7711,-131 20.9813,-131 2.3762,-118.5966 2.3762,-99.4034 20.9813,-87 45.7711,-87 64.3762,-99.4034\"/>\n",
       "<text text-anchor=\"middle\" x=\"33.3762\" y=\"-105.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;0 -->\n",
       "<g id=\"edge1\" class=\"edge\">\n",
       "<title>0&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M64.4782,-117.6229C74.4628,-117.5345 82.3762,-114.6602 82.3762,-109 82.3762,-105.4624 79.285,-103.013 74.529,-101.6519\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"74.8391,-98.1633 64.4782,-100.3771 73.9583,-105.1076 74.8391,-98.1633\"/>\n",
       "<text text-anchor=\"middle\" x=\"86.8762\" y=\"-105.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 1 -->\n",
       "<g id=\"node2\" class=\"node\">\n",
       "<title>1</title>\n",
       "<ellipse fill=\"none\" stroke=\"#000000\" cx=\"33.3762\" cy=\"-18\" rx=\"18\" ry=\"18\"/>\n",
       "<text text-anchor=\"middle\" x=\"33.3762\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;1 -->\n",
       "<g id=\"edge2\" class=\"edge\">\n",
       "<title>0&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M14.8129,-91.0971C9.4087,-84.6953 4.2022,-77.0562 1.3762,-69 -2.6784,-57.4412 3.6846,-45.7778 11.7773,-36.5278\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"14.285,-38.9695 18.7912,-29.3807 9.2889,-34.0665 14.285,-38.9695\"/>\n",
       "<text text-anchor=\"middle\" x=\"6.3762\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;0 -->\n",
       "<g id=\"edge3\" class=\"edge\">\n",
       "<title>1&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M33.3762,-36.1556C33.3762,-47.8111 33.3762,-63.2722 33.3762,-76.9511\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"29.8763,-76.9714 33.3762,-86.9714 36.8763,-76.9715 29.8763,-76.9714\"/>\n",
       "<text text-anchor=\"middle\" x=\"37.8762\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;0 -->\n",
       "<g id=\"edge4\" class=\"edge\">\n",
       "<title>1&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M39.2266,-35.3788C40.9187,-41.2248 42.5352,-47.8299 43.3762,-54 44.3945,-61.4706 43.8739,-69.4721 42.6545,-76.9943\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"39.2116,-76.3615 40.6376,-86.8599 46.0697,-77.7636 39.2116,-76.3615\"/>\n",
       "<text text-anchor=\"middle\" x=\"48.3762\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "</g>\n",
       "</svg>\n"
      ],
      "text/plain": [
       "<graphviz.dot.Digraph at 0x7f41a068abe0>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "avg epochs 6.42 min epochs 1 max epochs 13 std epochs 4.359107024195567 avg loss at epoch 0 1.3848290741443634 avg loss when fit 0.7236772906780243\n"
     ]
    },
    {
     "data": {
      "image/svg+xml": [
       "<?xml version=\"1.0\" encoding=\"UTF-8\" standalone=\"no\"?>\n",
       "<!DOCTYPE svg PUBLIC \"-//W3C//DTD SVG 1.1//EN\"\n",
       " \"http://www.w3.org/Graphics/SVG/1.1/DTD/svg11.dtd\">\n",
       "<!-- Generated by graphviz version 2.40.1 (20161225.0304)\n",
       " -->\n",
       "<!-- Title: %3 Pages: 1 -->\n",
       "<svg width=\"98pt\" height=\"139pt\"\n",
       " viewBox=\"0.00 0.00 98.00 139.00\" xmlns=\"http://www.w3.org/2000/svg\" xmlns:xlink=\"http://www.w3.org/1999/xlink\">\n",
       "<g id=\"graph0\" class=\"graph\" transform=\"scale(1 1) rotate(0) translate(4 135)\">\n",
       "<title>%3</title>\n",
       "<polygon fill=\"#ffffff\" stroke=\"transparent\" points=\"-4,4 -4,-135 94,-135 94,4 -4,4\"/>\n",
       "<!-- 0 -->\n",
       "<g id=\"node1\" class=\"node\">\n",
       "<title>0</title>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"58,-101.5442 58,-116.4558 42.1838,-127 19.8162,-127 4,-116.4558 4,-101.5442 19.8162,-91 42.1838,-91 58,-101.5442\"/>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"62,-99.4034 62,-118.5966 43.3949,-131 18.6051,-131 0,-118.5966 0,-99.4034 18.6051,-87 43.3949,-87 62,-99.4034\"/>\n",
       "<text text-anchor=\"middle\" x=\"31\" y=\"-105.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;0 -->\n",
       "<g id=\"edge2\" class=\"edge\">\n",
       "<title>0&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M62.102,-117.6229C72.0865,-117.5345 80,-114.6602 80,-109 80,-105.4624 76.9088,-103.013 72.1528,-101.6519\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"72.4629,-98.1633 62.102,-100.3771 71.5821,-105.1076 72.4629,-98.1633\"/>\n",
       "<text text-anchor=\"middle\" x=\"85\" y=\"-105.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 1 -->\n",
       "<g id=\"node2\" class=\"node\">\n",
       "<title>1</title>\n",
       "<ellipse fill=\"none\" stroke=\"#000000\" cx=\"31\" cy=\"-18\" rx=\"18\" ry=\"18\"/>\n",
       "<text text-anchor=\"middle\" x=\"31\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;1 -->\n",
       "<g id=\"edge1\" class=\"edge\">\n",
       "<title>0&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M20.1345,-86.954C16.4722,-76.9682 13.8066,-64.9668 16,-54 16.6984,-50.5081 17.7429,-46.9315 18.9619,-43.4525\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"22.2557,-44.6417 22.7167,-34.0569 15.7556,-42.044 22.2557,-44.6417\"/>\n",
       "<text text-anchor=\"middle\" x=\"20.5\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;0 -->\n",
       "<g id=\"edge3\" class=\"edge\">\n",
       "<title>1&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M31,-36.1556C31,-47.8111 31,-63.2722 31,-76.9511\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"27.5001,-76.9714 31,-86.9714 34.5001,-76.9715 27.5001,-76.9714\"/>\n",
       "<text text-anchor=\"middle\" x=\"35.5\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;1 -->\n",
       "<g id=\"edge4\" class=\"edge\">\n",
       "<title>1&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M47.6641,-25.3828C57.625,-27.0234 67,-24.5625 67,-18 67,-13.7959 63.1525,-11.2751 57.7682,-10.4375\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"57.6002,-6.9399 47.6641,-10.6172 57.7247,-13.9388 57.6002,-6.9399\"/>\n",
       "<text text-anchor=\"middle\" x=\"72\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "</g>\n",
       "</svg>\n"
      ],
      "text/plain": [
       "<graphviz.dot.Digraph at 0x7f41a068aaf0>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "avg epochs 5.38 min epochs 1 max epochs 18 std epochs 4.091213354008422 avg loss at epoch 0 1.3962756979465485 avg loss when fit 0.7864163091778755\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "Sorted by std epochs\n"
     ]
    },
    {
     "data": {
      "image/svg+xml": [
       "<?xml version=\"1.0\" encoding=\"UTF-8\" standalone=\"no\"?>\n",
       "<!DOCTYPE svg PUBLIC \"-//W3C//DTD SVG 1.1//EN\"\n",
       " \"http://www.w3.org/Graphics/SVG/1.1/DTD/svg11.dtd\">\n",
       "<!-- Generated by graphviz version 2.40.1 (20161225.0304)\n",
       " -->\n",
       "<!-- Title: %3 Pages: 1 -->\n",
       "<svg width=\"117pt\" height=\"44pt\"\n",
       " viewBox=\"0.00 0.00 117.00 44.00\" xmlns=\"http://www.w3.org/2000/svg\" xmlns:xlink=\"http://www.w3.org/1999/xlink\">\n",
       "<g id=\"graph0\" class=\"graph\" transform=\"scale(1 1) rotate(0) translate(4 40)\">\n",
       "<title>%3</title>\n",
       "<polygon fill=\"#ffffff\" stroke=\"transparent\" points=\"-4,4 -4,-40 113,-40 113,4 -4,4\"/>\n",
       "<!-- 0 -->\n",
       "<g id=\"node1\" class=\"node\">\n",
       "<title>0</title>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"54,-10.5442 54,-25.4558 38.1838,-36 15.8162,-36 0,-25.4558 0,-10.5442 15.8162,0 38.1838,0 54,-10.5442\"/>\n",
       "<text text-anchor=\"middle\" x=\"27\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;0 -->\n",
       "<g id=\"edge1\" class=\"edge\">\n",
       "<title>0&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M54.2408,-21.3717C64.0239,-21.4442 72,-20.3203 72,-18 72,-16.5861 69.0382,-15.6164 64.5105,-15.091\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"64.3882,-11.582 54.2408,-14.6283 64.0731,-18.5749 64.3882,-11.582\"/>\n",
       "<text text-anchor=\"middle\" x=\"76.5\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;0 -->\n",
       "<g id=\"edge2\" class=\"edge\">\n",
       "<title>0&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M54.1975,-24.1551C72.3402,-25.8876 90,-23.8359 90,-18 90,-13.2583 78.3418,-11.0148 64.2386,-11.2695\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"63.9809,-7.7784 54.1975,-11.8449 64.3814,-14.7669 63.9809,-7.7784\"/>\n",
       "<text text-anchor=\"middle\" x=\"95\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "</g>\n",
       "</svg>\n"
      ],
      "text/plain": [
       "<graphviz.dot.Digraph at 0x7f41a068adf0>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "avg epochs 1.01 min epochs 1 max epochs 2 std epochs 1.099498743710662 avg loss at epoch 0 1.4036058342456819 avg loss when fit 0.9353451192378998\n"
     ]
    },
    {
     "data": {
      "image/svg+xml": [
       "<?xml version=\"1.0\" encoding=\"UTF-8\" standalone=\"no\"?>\n",
       "<!DOCTYPE svg PUBLIC \"-//W3C//DTD SVG 1.1//EN\"\n",
       " \"http://www.w3.org/Graphics/SVG/1.1/DTD/svg11.dtd\">\n",
       "<!-- Generated by graphviz version 2.40.1 (20161225.0304)\n",
       " -->\n",
       "<!-- Title: %3 Pages: 1 -->\n",
       "<svg width=\"125pt\" height=\"52pt\"\n",
       " viewBox=\"0.00 0.00 125.00 52.00\" xmlns=\"http://www.w3.org/2000/svg\" xmlns:xlink=\"http://www.w3.org/1999/xlink\">\n",
       "<g id=\"graph0\" class=\"graph\" transform=\"scale(1 1) rotate(0) translate(4 48)\">\n",
       "<title>%3</title>\n",
       "<polygon fill=\"#ffffff\" stroke=\"transparent\" points=\"-4,4 -4,-48 121,-48 121,4 -4,4\"/>\n",
       "<!-- 0 -->\n",
       "<g id=\"node1\" class=\"node\">\n",
       "<title>0</title>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"58,-14.5442 58,-29.4558 42.1838,-40 19.8162,-40 4,-29.4558 4,-14.5442 19.8162,-4 42.1838,-4 58,-14.5442\"/>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"62,-12.4034 62,-31.5966 43.3949,-44 18.6051,-44 0,-31.5966 0,-12.4034 18.6051,0 43.3949,0 62,-12.4034\"/>\n",
       "<text text-anchor=\"middle\" x=\"31\" y=\"-18.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;0 -->\n",
       "<g id=\"edge1\" class=\"edge\">\n",
       "<title>0&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M62.102,-25.9365C72.0865,-25.8962 80,-24.584 80,-22 80,-20.385 76.9088,-19.2668 72.1528,-18.6454\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"72.2876,-15.1475 62.102,-18.0635 71.8829,-22.1358 72.2876,-15.1475\"/>\n",
       "<text text-anchor=\"middle\" x=\"84.5\" y=\"-18.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;0 -->\n",
       "<g id=\"edge2\" class=\"edge\">\n",
       "<title>0&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M62.0137,-29.3828C80.5521,-31.0234 98,-28.5625 98,-22 98,-16.668 86.4816,-14.0436 72.2187,-14.1269\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"71.8342,-10.6413 62.0137,-14.6172 72.1701,-17.6332 71.8342,-10.6413\"/>\n",
       "<text text-anchor=\"middle\" x=\"103\" y=\"-18.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "</g>\n",
       "</svg>\n"
      ],
      "text/plain": [
       "<graphviz.dot.Digraph at 0x7f41a068aee0>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "avg epochs 1.02 min epochs 1 max epochs 3 std epochs 1.198997487421324 avg loss at epoch 0 1.3925223922729493 avg loss when fit 0.9185943812131881\n"
     ]
    },
    {
     "data": {
      "image/svg+xml": [
       "<?xml version=\"1.0\" encoding=\"UTF-8\" standalone=\"no\"?>\n",
       "<!DOCTYPE svg PUBLIC \"-//W3C//DTD SVG 1.1//EN\"\n",
       " \"http://www.w3.org/Graphics/SVG/1.1/DTD/svg11.dtd\">\n",
       "<!-- Generated by graphviz version 2.40.1 (20161225.0304)\n",
       " -->\n",
       "<!-- Title: %3 Pages: 1 -->\n",
       "<svg width=\"112pt\" height=\"139pt\"\n",
       " viewBox=\"0.00 0.00 112.00 139.00\" xmlns=\"http://www.w3.org/2000/svg\" xmlns:xlink=\"http://www.w3.org/1999/xlink\">\n",
       "<g id=\"graph0\" class=\"graph\" transform=\"scale(1 1) rotate(0) translate(4 135)\">\n",
       "<title>%3</title>\n",
       "<polygon fill=\"#ffffff\" stroke=\"transparent\" points=\"-4,4 -4,-135 108,-135 108,4 -4,4\"/>\n",
       "<!-- 0 -->\n",
       "<g id=\"node1\" class=\"node\">\n",
       "<title>0</title>\n",
       "<ellipse fill=\"none\" stroke=\"#000000\" cx=\"27\" cy=\"-22\" rx=\"18\" ry=\"18\"/>\n",
       "<ellipse fill=\"none\" stroke=\"#000000\" cx=\"27\" cy=\"-22\" rx=\"22\" ry=\"22\"/>\n",
       "<text text-anchor=\"middle\" x=\"27\" y=\"-18.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;0 -->\n",
       "<g id=\"edge1\" class=\"edge\">\n",
       "<title>0&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M48.8066,-26.2451C58.5625,-26.6494 67,-25.2344 67,-22 67,-19.9785 63.7041,-18.6677 58.8504,-18.0676\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"58.9107,-14.5679 48.8066,-17.7549 58.6928,-21.5645 58.9107,-14.5679\"/>\n",
       "<text text-anchor=\"middle\" x=\"71.5\" y=\"-18.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;0 -->\n",
       "<g id=\"edge2\" class=\"edge\">\n",
       "<title>0&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M47.813,-29.2015C65.8838,-32.4865 85,-30.0859 85,-22 85,-15.4302 72.3803,-12.6136 57.9552,-13.5503\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"57.3106,-10.1032 47.813,-14.7985 58.1656,-17.0508 57.3106,-10.1032\"/>\n",
       "<text text-anchor=\"middle\" x=\"90\" y=\"-18.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 1 -->\n",
       "<g id=\"node2\" class=\"node\">\n",
       "<title>1</title>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"54,-105.5442 54,-120.4558 38.1838,-131 15.8162,-131 0,-120.4558 0,-105.5442 15.8162,-95 38.1838,-95 54,-105.5442\"/>\n",
       "<text text-anchor=\"middle\" x=\"27\" y=\"-109.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;0 -->\n",
       "<g id=\"edge3\" class=\"edge\">\n",
       "<title>1&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M17.7658,-94.7573C15.4038,-89.1988 13.1951,-82.9754 12,-77 10.3165,-68.5823 11.4955,-59.5551 13.7908,-51.2977\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"17.1484,-52.2941 17.0266,-41.6999 10.5152,-50.0577 17.1484,-52.2941\"/>\n",
       "<text text-anchor=\"middle\" x=\"16.5\" y=\"-65.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;0 -->\n",
       "<g id=\"edge4\" class=\"edge\">\n",
       "<title>1&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M27,-94.5848C27,-83.1105 27,-68.0231 27,-54.5774\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"30.5001,-54.2465 27,-44.2465 23.5001,-54.2466 30.5001,-54.2465\"/>\n",
       "<text text-anchor=\"middle\" x=\"32\" y=\"-65.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "</g>\n",
       "</svg>\n"
      ],
      "text/plain": [
       "<graphviz.dot.Digraph at 0x7f41a068aaf0>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "avg epochs 1.9300000000000002 min epochs 1 max epochs 6 std epochs 2.2021231218140676 avg loss at epoch 0 1.3965786254405976 avg loss when fit 0.8911880993843079\n"
     ]
    },
    {
     "data": {
      "image/svg+xml": [
       "<?xml version=\"1.0\" encoding=\"UTF-8\" standalone=\"no\"?>\n",
       "<!DOCTYPE svg PUBLIC \"-//W3C//DTD SVG 1.1//EN\"\n",
       " \"http://www.w3.org/Graphics/SVG/1.1/DTD/svg11.dtd\">\n",
       "<!-- Generated by graphviz version 2.40.1 (20161225.0304)\n",
       " -->\n",
       "<!-- Title: %3 Pages: 1 -->\n",
       "<svg width=\"88pt\" height=\"139pt\"\n",
       " viewBox=\"0.00 0.00 88.48 139.00\" xmlns=\"http://www.w3.org/2000/svg\" xmlns:xlink=\"http://www.w3.org/1999/xlink\">\n",
       "<g id=\"graph0\" class=\"graph\" transform=\"scale(1 1) rotate(0) translate(4 135)\">\n",
       "<title>%3</title>\n",
       "<polygon fill=\"#ffffff\" stroke=\"transparent\" points=\"-4,4 -4,-135 84.4814,-135 84.4814,4 -4,4\"/>\n",
       "<!-- 0 -->\n",
       "<g id=\"node1\" class=\"node\">\n",
       "<title>0</title>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"76.4814,-101.5442 76.4814,-116.4558 60.6652,-127 38.2976,-127 22.4814,-116.4558 22.4814,-101.5442 38.2976,-91 60.6652,-91 76.4814,-101.5442\"/>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"80.4814,-99.4034 80.4814,-118.5966 61.8763,-131 37.0865,-131 18.4814,-118.5966 18.4814,-99.4034 37.0865,-87 61.8763,-87 80.4814,-99.4034\"/>\n",
       "<text text-anchor=\"middle\" x=\"49.4814\" y=\"-105.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 1 -->\n",
       "<g id=\"node2\" class=\"node\">\n",
       "<title>1</title>\n",
       "<ellipse fill=\"none\" stroke=\"#000000\" cx=\"49.4814\" cy=\"-18\" rx=\"18\" ry=\"18\"/>\n",
       "<text text-anchor=\"middle\" x=\"49.4814\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;1 -->\n",
       "<g id=\"edge1\" class=\"edge\">\n",
       "<title>0&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M24.4817,-95.0681C9.4835,-84.7382 -5.3027,-69.7674 2.4814,-54 7.1416,-44.5604 15.596,-36.9117 24.0627,-31.1317\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"26.0556,-34.0149 32.7318,-25.7882 22.3825,-28.0559 26.0556,-34.0149\"/>\n",
       "<text text-anchor=\"middle\" x=\"6.9814\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;1 -->\n",
       "<g id=\"edge2\" class=\"edge\">\n",
       "<title>0&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M38.6159,-86.954C34.9536,-76.9682 32.288,-64.9668 34.4814,-54 35.1798,-50.5081 36.2243,-46.9315 37.4433,-43.4525\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"40.7371,-44.6417 41.1981,-34.0569 34.237,-42.044 40.7371,-44.6417\"/>\n",
       "<text text-anchor=\"middle\" x=\"39.4814\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;0 -->\n",
       "<g id=\"edge3\" class=\"edge\">\n",
       "<title>1&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M49.4814,-36.1556C49.4814,-47.8111 49.4814,-63.2722 49.4814,-76.9511\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"45.9815,-76.9714 49.4814,-86.9714 52.9815,-76.9715 45.9815,-76.9714\"/>\n",
       "<text text-anchor=\"middle\" x=\"53.9814\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;0 -->\n",
       "<g id=\"edge4\" class=\"edge\">\n",
       "<title>1&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M56.804,-34.5202C59.1015,-40.5295 61.3358,-47.4545 62.4814,-54 63.7955,-61.5083 63.1149,-69.5247 61.5291,-77.0492\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"58.0941,-76.3478 58.9081,-86.9113 64.8593,-78.1458 58.0941,-76.3478\"/>\n",
       "<text text-anchor=\"middle\" x=\"67.4814\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "</g>\n",
       "</svg>\n"
      ],
      "text/plain": [
       "<graphviz.dot.Digraph at 0x7f41a068aa30>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "avg epochs 2.6100000000000003 min epochs 1 max epochs 6 std epochs 2.333379165878933 avg loss at epoch 0 1.401513180732727 avg loss when fit 0.9501019644737244\n"
     ]
    },
    {
     "data": {
      "image/svg+xml": [
       "<?xml version=\"1.0\" encoding=\"UTF-8\" standalone=\"no\"?>\n",
       "<!DOCTYPE svg PUBLIC \"-//W3C//DTD SVG 1.1//EN\"\n",
       " \"http://www.w3.org/Graphics/SVG/1.1/DTD/svg11.dtd\">\n",
       "<!-- Generated by graphviz version 2.40.1 (20161225.0304)\n",
       " -->\n",
       "<!-- Title: %3 Pages: 1 -->\n",
       "<svg width=\"112pt\" height=\"139pt\"\n",
       " viewBox=\"0.00 0.00 112.00 139.00\" xmlns=\"http://www.w3.org/2000/svg\" xmlns:xlink=\"http://www.w3.org/1999/xlink\">\n",
       "<g id=\"graph0\" class=\"graph\" transform=\"scale(1 1) rotate(0) translate(4 135)\">\n",
       "<title>%3</title>\n",
       "<polygon fill=\"#ffffff\" stroke=\"transparent\" points=\"-4,4 -4,-135 108,-135 108,4 -4,4\"/>\n",
       "<!-- 0 -->\n",
       "<g id=\"node1\" class=\"node\">\n",
       "<title>0</title>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"58,-101.5442 58,-116.4558 42.1838,-127 19.8162,-127 4,-116.4558 4,-101.5442 19.8162,-91 42.1838,-91 58,-101.5442\"/>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"62,-99.4034 62,-118.5966 43.3949,-131 18.6051,-131 0,-118.5966 0,-99.4034 18.6051,-87 43.3949,-87 62,-99.4034\"/>\n",
       "<text text-anchor=\"middle\" x=\"31\" y=\"-105.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 1 -->\n",
       "<g id=\"node2\" class=\"node\">\n",
       "<title>1</title>\n",
       "<ellipse fill=\"none\" stroke=\"#000000\" cx=\"31\" cy=\"-18\" rx=\"18\" ry=\"18\"/>\n",
       "<text text-anchor=\"middle\" x=\"31\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;1 -->\n",
       "<g id=\"edge1\" class=\"edge\">\n",
       "<title>0&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M20.1345,-86.954C16.4722,-76.9682 13.8066,-64.9668 16,-54 16.6984,-50.5081 17.7429,-46.9315 18.9619,-43.4525\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"22.2557,-44.6417 22.7167,-34.0569 15.7556,-42.044 22.2557,-44.6417\"/>\n",
       "<text text-anchor=\"middle\" x=\"20.5\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;1 -->\n",
       "<g id=\"edge2\" class=\"edge\">\n",
       "<title>0&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M31,-86.9714C31,-74.8075 31,-59.5615 31,-46.499\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"34.5001,-46.1556 31,-36.1556 27.5001,-46.1556 34.5001,-46.1556\"/>\n",
       "<text text-anchor=\"middle\" x=\"36\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;1 -->\n",
       "<g id=\"edge3\" class=\"edge\">\n",
       "<title>1&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M48.7817,-21.775C58.3149,-22.4165 67,-21.1582 67,-18 67,-16.0755 63.7749,-14.8564 59.0981,-14.3429\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"58.8211,-10.8396 48.7817,-14.225 58.741,-17.8391 58.8211,-10.8396\"/>\n",
       "<text text-anchor=\"middle\" x=\"71.5\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;1 -->\n",
       "<g id=\"edge4\" class=\"edge\">\n",
       "<title>1&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M48.1418,-24.1447C65.585,-27.7592 85,-25.7109 85,-18 85,-11.7951 72.4283,-9.2569 58.4287,-10.3855\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"57.5461,-6.976 48.1418,-11.8553 58.5363,-13.9056 57.5461,-6.976\"/>\n",
       "<text text-anchor=\"middle\" x=\"90\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "</g>\n",
       "</svg>\n"
      ],
      "text/plain": [
       "<graphviz.dot.Digraph at 0x7f41a068ab50>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "avg epochs 2.0 min epochs 1 max epochs 8 std epochs 2.3490737563232043 avg loss at epoch 0 1.3975653278827667 avg loss when fit 0.8985250204801559\n"
     ]
    },
    {
     "data": {
      "image/svg+xml": [
       "<?xml version=\"1.0\" encoding=\"UTF-8\" standalone=\"no\"?>\n",
       "<!DOCTYPE svg PUBLIC \"-//W3C//DTD SVG 1.1//EN\"\n",
       " \"http://www.w3.org/Graphics/SVG/1.1/DTD/svg11.dtd\">\n",
       "<!-- Generated by graphviz version 2.40.1 (20161225.0304)\n",
       " -->\n",
       "<!-- Title: %3 Pages: 1 -->\n",
       "<svg width=\"85pt\" height=\"139pt\"\n",
       " viewBox=\"0.00 0.00 84.59 139.00\" xmlns=\"http://www.w3.org/2000/svg\" xmlns:xlink=\"http://www.w3.org/1999/xlink\">\n",
       "<g id=\"graph0\" class=\"graph\" transform=\"scale(1 1) rotate(0) translate(4 135)\">\n",
       "<title>%3</title>\n",
       "<polygon fill=\"#ffffff\" stroke=\"transparent\" points=\"-4,4 -4,-135 80.5906,-135 80.5906,4 -4,4\"/>\n",
       "<!-- 0 -->\n",
       "<g id=\"node1\" class=\"node\">\n",
       "<title>0</title>\n",
       "<ellipse fill=\"none\" stroke=\"#000000\" cx=\"49.5906\" cy=\"-109\" rx=\"18\" ry=\"18\"/>\n",
       "<ellipse fill=\"none\" stroke=\"#000000\" cx=\"49.5906\" cy=\"-109\" rx=\"22\" ry=\"22\"/>\n",
       "<text text-anchor=\"middle\" x=\"49.5906\" y=\"-105.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 1 -->\n",
       "<g id=\"node2\" class=\"node\">\n",
       "<title>1</title>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"76.5906,-10.5442 76.5906,-25.4558 60.7744,-36 38.4069,-36 22.5906,-25.4558 22.5906,-10.5442 38.4069,0 60.7744,0 76.5906,-10.5442\"/>\n",
       "<text text-anchor=\"middle\" x=\"49.5906\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;1 -->\n",
       "<g id=\"edge1\" class=\"edge\">\n",
       "<title>0&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M30.0239,-98.6189C13.5164,-88.3622 -6.1387,-71.682 2.5906,-54 6.3017,-46.4829 12.4189,-40.1015 19.0324,-34.8951\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"21.3556,-37.5406 27.5311,-28.9317 17.3348,-31.8105 21.3556,-37.5406\"/>\n",
       "<text text-anchor=\"middle\" x=\"7.0906\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;1 -->\n",
       "<g id=\"edge2\" class=\"edge\">\n",
       "<title>0&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M39.6172,-89.3001C35.5182,-78.8865 32.2226,-65.8403 34.5906,-54 35.1321,-51.2924 35.8818,-48.5339 36.7595,-45.8093\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"40.1132,-46.8347 40.3564,-36.2427 33.561,-44.3712 40.1132,-46.8347\"/>\n",
       "<text text-anchor=\"middle\" x=\"39.5906\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;0 -->\n",
       "<g id=\"edge3\" class=\"edge\">\n",
       "<title>1&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M49.5906,-36.1556C49.5906,-47.8111 49.5906,-63.2722 49.5906,-76.9511\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"46.0907,-76.9714 49.5906,-86.9714 53.0907,-76.9715 46.0907,-76.9714\"/>\n",
       "<text text-anchor=\"middle\" x=\"54.0906\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;0 -->\n",
       "<g id=\"edge4\" class=\"edge\">\n",
       "<title>1&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M57.5995,-36.3492C59.6467,-41.9107 61.5596,-48.109 62.5906,-54 64.0179,-62.1547 63.0922,-70.9086 61.2094,-78.9809\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"57.8017,-78.1679 58.4179,-88.7448 64.532,-80.0922 57.8017,-78.1679\"/>\n",
       "<text text-anchor=\"middle\" x=\"67.5906\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "</g>\n",
       "</svg>\n"
      ],
      "text/plain": [
       "<graphviz.dot.Digraph at 0x7f41a068ab20>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "avg epochs 2.6100000000000003 min epochs 1 max epochs 6 std epochs 2.4205280708243677 avg loss at epoch 0 1.387124490737915 avg loss when fit 0.9513023608922958\n"
     ]
    },
    {
     "data": {
      "image/svg+xml": [
       "<?xml version=\"1.0\" encoding=\"UTF-8\" standalone=\"no\"?>\n",
       "<!DOCTYPE svg PUBLIC \"-//W3C//DTD SVG 1.1//EN\"\n",
       " \"http://www.w3.org/Graphics/SVG/1.1/DTD/svg11.dtd\">\n",
       "<!-- Generated by graphviz version 2.40.1 (20161225.0304)\n",
       " -->\n",
       "<!-- Title: %3 Pages: 1 -->\n",
       "<svg width=\"112pt\" height=\"139pt\"\n",
       " viewBox=\"0.00 0.00 112.00 139.00\" xmlns=\"http://www.w3.org/2000/svg\" xmlns:xlink=\"http://www.w3.org/1999/xlink\">\n",
       "<g id=\"graph0\" class=\"graph\" transform=\"scale(1 1) rotate(0) translate(4 135)\">\n",
       "<title>%3</title>\n",
       "<polygon fill=\"#ffffff\" stroke=\"transparent\" points=\"-4,4 -4,-135 108,-135 108,4 -4,4\"/>\n",
       "<!-- 0 -->\n",
       "<g id=\"node1\" class=\"node\">\n",
       "<title>0</title>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"58,-101.5442 58,-116.4558 42.1838,-127 19.8162,-127 4,-116.4558 4,-101.5442 19.8162,-91 42.1838,-91 58,-101.5442\"/>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"62,-99.4034 62,-118.5966 43.3949,-131 18.6051,-131 0,-118.5966 0,-99.4034 18.6051,-87 43.3949,-87 62,-99.4034\"/>\n",
       "<text text-anchor=\"middle\" x=\"31\" y=\"-105.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;0 -->\n",
       "<g id=\"edge2\" class=\"edge\">\n",
       "<title>0&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M62.102,-117.6229C72.0865,-117.5345 80,-114.6602 80,-109 80,-105.4624 76.9088,-103.013 72.1528,-101.6519\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"72.4629,-98.1633 62.102,-100.3771 71.5821,-105.1076 72.4629,-98.1633\"/>\n",
       "<text text-anchor=\"middle\" x=\"85\" y=\"-105.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 1 -->\n",
       "<g id=\"node2\" class=\"node\">\n",
       "<title>1</title>\n",
       "<ellipse fill=\"none\" stroke=\"#000000\" cx=\"31\" cy=\"-18\" rx=\"18\" ry=\"18\"/>\n",
       "<text text-anchor=\"middle\" x=\"31\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;1 -->\n",
       "<g id=\"edge1\" class=\"edge\">\n",
       "<title>0&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M31,-86.9714C31,-74.8075 31,-59.5615 31,-46.499\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"34.5001,-46.1556 31,-36.1556 27.5001,-46.1556 34.5001,-46.1556\"/>\n",
       "<text text-anchor=\"middle\" x=\"35.5\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;1 -->\n",
       "<g id=\"edge3\" class=\"edge\">\n",
       "<title>1&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M48.7817,-21.775C58.3149,-22.4165 67,-21.1582 67,-18 67,-16.0755 63.7749,-14.8564 59.0981,-14.3429\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"58.8211,-10.8396 48.7817,-14.225 58.741,-17.8391 58.8211,-10.8396\"/>\n",
       "<text text-anchor=\"middle\" x=\"71.5\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;1 -->\n",
       "<g id=\"edge4\" class=\"edge\">\n",
       "<title>1&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M48.1418,-24.1447C65.585,-27.7592 85,-25.7109 85,-18 85,-11.7951 72.4283,-9.2569 58.4287,-10.3855\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"57.5461,-6.976 48.1418,-11.8553 58.5363,-13.9056 57.5461,-6.976\"/>\n",
       "<text text-anchor=\"middle\" x=\"90\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "</g>\n",
       "</svg>\n"
      ],
      "text/plain": [
       "<graphviz.dot.Digraph at 0x7f41a068adf0>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "avg epochs 3.73 min epochs 1 max epochs 13 std epochs 3.7453779339100106 avg loss at epoch 0 1.4002061438560487 avg loss when fit 0.7947436776757241\n"
     ]
    },
    {
     "data": {
      "image/svg+xml": [
       "<?xml version=\"1.0\" encoding=\"UTF-8\" standalone=\"no\"?>\n",
       "<!DOCTYPE svg PUBLIC \"-//W3C//DTD SVG 1.1//EN\"\n",
       " \"http://www.w3.org/Graphics/SVG/1.1/DTD/svg11.dtd\">\n",
       "<!-- Generated by graphviz version 2.40.1 (20161225.0304)\n",
       " -->\n",
       "<!-- Title: %3 Pages: 1 -->\n",
       "<svg width=\"85pt\" height=\"139pt\"\n",
       " viewBox=\"0.00 0.00 85.33 139.00\" xmlns=\"http://www.w3.org/2000/svg\" xmlns:xlink=\"http://www.w3.org/1999/xlink\">\n",
       "<g id=\"graph0\" class=\"graph\" transform=\"scale(1 1) rotate(0) translate(4 135)\">\n",
       "<title>%3</title>\n",
       "<polygon fill=\"#ffffff\" stroke=\"transparent\" points=\"-4,4 -4,-135 81.3273,-135 81.3273,4 -4,4\"/>\n",
       "<!-- 0 -->\n",
       "<g id=\"node1\" class=\"node\">\n",
       "<title>0</title>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"59.3273,-101.5442 59.3273,-116.4558 43.5111,-127 21.1436,-127 5.3273,-116.4558 5.3273,-101.5442 21.1436,-91 43.5111,-91 59.3273,-101.5442\"/>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"63.3273,-99.4034 63.3273,-118.5966 44.7222,-131 19.9325,-131 1.3273,-118.5966 1.3273,-99.4034 19.9325,-87 44.7222,-87 63.3273,-99.4034\"/>\n",
       "<text text-anchor=\"middle\" x=\"32.3273\" y=\"-105.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 1 -->\n",
       "<g id=\"node2\" class=\"node\">\n",
       "<title>1</title>\n",
       "<ellipse fill=\"none\" stroke=\"#000000\" cx=\"32.3273\" cy=\"-18\" rx=\"18\" ry=\"18\"/>\n",
       "<text text-anchor=\"middle\" x=\"32.3273\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;1 -->\n",
       "<g id=\"edge1\" class=\"edge\">\n",
       "<title>0&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M14.0086,-90.606C8.8906,-84.2826 4.0008,-76.814 1.3273,-69 -2.5641,-57.6263 3.4383,-46.0871 11.1662,-36.8684\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"13.8732,-39.0996 18.1963,-29.4269 8.7848,-34.2925 13.8732,-39.0996\"/>\n",
       "<text text-anchor=\"middle\" x=\"5.8273\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;1 -->\n",
       "<g id=\"edge2\" class=\"edge\">\n",
       "<title>0&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M32.3273,-86.9714C32.3273,-74.8075 32.3273,-59.5615 32.3273,-46.499\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"35.8274,-46.1556 32.3273,-36.1556 28.8274,-46.1556 35.8274,-46.1556\"/>\n",
       "<text text-anchor=\"middle\" x=\"37.3273\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;0 -->\n",
       "<g id=\"edge4\" class=\"edge\">\n",
       "<title>1&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M38.6443,-34.9737C40.5474,-40.9055 42.3812,-47.6657 43.3273,-54 44.4449,-61.482 43.8712,-69.488 42.5297,-77.0109\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"39.0908,-76.3511 40.3114,-86.8754 45.9202,-77.887 39.0908,-76.3511\"/>\n",
       "<text text-anchor=\"middle\" x=\"48.3273\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;1 -->\n",
       "<g id=\"edge3\" class=\"edge\">\n",
       "<title>1&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M48.9914,-25.3828C58.9523,-27.0234 68.3273,-24.5625 68.3273,-18 68.3273,-13.7959 64.4798,-11.2751 59.0956,-10.4375\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"58.9276,-6.9399 48.9914,-10.6172 59.0521,-13.9388 58.9276,-6.9399\"/>\n",
       "<text text-anchor=\"middle\" x=\"72.8273\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "</g>\n",
       "</svg>\n"
      ],
      "text/plain": [
       "<graphviz.dot.Digraph at 0x7f41a068ac70>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "avg epochs 4.01 min epochs 1 max epochs 9 std epochs 3.7838642208268705 avg loss at epoch 0 1.398785378932953 avg loss when fit 0.8564903074502945\n"
     ]
    },
    {
     "data": {
      "image/svg+xml": [
       "<?xml version=\"1.0\" encoding=\"UTF-8\" standalone=\"no\"?>\n",
       "<!DOCTYPE svg PUBLIC \"-//W3C//DTD SVG 1.1//EN\"\n",
       " \"http://www.w3.org/Graphics/SVG/1.1/DTD/svg11.dtd\">\n",
       "<!-- Generated by graphviz version 2.40.1 (20161225.0304)\n",
       " -->\n",
       "<!-- Title: %3 Pages: 1 -->\n",
       "<svg width=\"112pt\" height=\"139pt\"\n",
       " viewBox=\"0.00 0.00 112.00 139.00\" xmlns=\"http://www.w3.org/2000/svg\" xmlns:xlink=\"http://www.w3.org/1999/xlink\">\n",
       "<g id=\"graph0\" class=\"graph\" transform=\"scale(1 1) rotate(0) translate(4 135)\">\n",
       "<title>%3</title>\n",
       "<polygon fill=\"#ffffff\" stroke=\"transparent\" points=\"-4,4 -4,-135 108,-135 108,4 -4,4\"/>\n",
       "<!-- 0 -->\n",
       "<g id=\"node1\" class=\"node\">\n",
       "<title>0</title>\n",
       "<ellipse fill=\"none\" stroke=\"#000000\" cx=\"27\" cy=\"-22\" rx=\"18\" ry=\"18\"/>\n",
       "<ellipse fill=\"none\" stroke=\"#000000\" cx=\"27\" cy=\"-22\" rx=\"22\" ry=\"22\"/>\n",
       "<text text-anchor=\"middle\" x=\"27\" y=\"-18.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;0 -->\n",
       "<g id=\"edge1\" class=\"edge\">\n",
       "<title>0&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M48.8066,-26.2451C58.5625,-26.6494 67,-25.2344 67,-22 67,-19.9785 63.7041,-18.6677 58.8504,-18.0676\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"58.9107,-14.5679 48.8066,-17.7549 58.6928,-21.5645 58.9107,-14.5679\"/>\n",
       "<text text-anchor=\"middle\" x=\"71.5\" y=\"-18.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;0 -->\n",
       "<g id=\"edge2\" class=\"edge\">\n",
       "<title>0&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M47.813,-29.2015C65.8838,-32.4865 85,-30.0859 85,-22 85,-15.4302 72.3803,-12.6136 57.9552,-13.5503\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"57.3106,-10.1032 47.813,-14.7985 58.1656,-17.0508 57.3106,-10.1032\"/>\n",
       "<text text-anchor=\"middle\" x=\"90\" y=\"-18.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 1 -->\n",
       "<g id=\"node2\" class=\"node\">\n",
       "<title>1</title>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"54,-105.5442 54,-120.4558 38.1838,-131 15.8162,-131 0,-120.4558 0,-105.5442 15.8162,-95 38.1838,-95 54,-105.5442\"/>\n",
       "<text text-anchor=\"middle\" x=\"27\" y=\"-109.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;0 -->\n",
       "<g id=\"edge4\" class=\"edge\">\n",
       "<title>1&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M27,-94.5848C27,-83.1105 27,-68.0231 27,-54.5774\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"30.5001,-54.2465 27,-44.2465 23.5001,-54.2466 30.5001,-54.2465\"/>\n",
       "<text text-anchor=\"middle\" x=\"32\" y=\"-65.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;1 -->\n",
       "<g id=\"edge3\" class=\"edge\">\n",
       "<title>1&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M53.7949,-120.8577C63.7804,-121.1153 72,-118.4961 72,-113 72,-109.5649 68.7892,-107.2537 63.9433,-106.0661\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"64.071,-102.5634 53.7949,-105.1423 63.4363,-109.5346 64.071,-102.5634\"/>\n",
       "<text text-anchor=\"middle\" x=\"76.5\" y=\"-109.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "</g>\n",
       "</svg>\n"
      ],
      "text/plain": [
       "<graphviz.dot.Digraph at 0x7f41a068abe0>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "avg epochs 4.43 min epochs 1 max epochs 13 std epochs 4.027391616557065 avg loss at epoch 0 1.3896378016471862 avg loss when fit 0.7640904745459557\n"
     ]
    },
    {
     "data": {
      "image/svg+xml": [
       "<?xml version=\"1.0\" encoding=\"UTF-8\" standalone=\"no\"?>\n",
       "<!DOCTYPE svg PUBLIC \"-//W3C//DTD SVG 1.1//EN\"\n",
       " \"http://www.w3.org/Graphics/SVG/1.1/DTD/svg11.dtd\">\n",
       "<!-- Generated by graphviz version 2.40.1 (20161225.0304)\n",
       " -->\n",
       "<!-- Title: %3 Pages: 1 -->\n",
       "<svg width=\"98pt\" height=\"139pt\"\n",
       " viewBox=\"0.00 0.00 98.00 139.00\" xmlns=\"http://www.w3.org/2000/svg\" xmlns:xlink=\"http://www.w3.org/1999/xlink\">\n",
       "<g id=\"graph0\" class=\"graph\" transform=\"scale(1 1) rotate(0) translate(4 135)\">\n",
       "<title>%3</title>\n",
       "<polygon fill=\"#ffffff\" stroke=\"transparent\" points=\"-4,4 -4,-135 94,-135 94,4 -4,4\"/>\n",
       "<!-- 0 -->\n",
       "<g id=\"node1\" class=\"node\">\n",
       "<title>0</title>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"58,-101.5442 58,-116.4558 42.1838,-127 19.8162,-127 4,-116.4558 4,-101.5442 19.8162,-91 42.1838,-91 58,-101.5442\"/>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"62,-99.4034 62,-118.5966 43.3949,-131 18.6051,-131 0,-118.5966 0,-99.4034 18.6051,-87 43.3949,-87 62,-99.4034\"/>\n",
       "<text text-anchor=\"middle\" x=\"31\" y=\"-105.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;0 -->\n",
       "<g id=\"edge2\" class=\"edge\">\n",
       "<title>0&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M62.102,-117.6229C72.0865,-117.5345 80,-114.6602 80,-109 80,-105.4624 76.9088,-103.013 72.1528,-101.6519\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"72.4629,-98.1633 62.102,-100.3771 71.5821,-105.1076 72.4629,-98.1633\"/>\n",
       "<text text-anchor=\"middle\" x=\"85\" y=\"-105.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 1 -->\n",
       "<g id=\"node2\" class=\"node\">\n",
       "<title>1</title>\n",
       "<ellipse fill=\"none\" stroke=\"#000000\" cx=\"31\" cy=\"-18\" rx=\"18\" ry=\"18\"/>\n",
       "<text text-anchor=\"middle\" x=\"31\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;1 -->\n",
       "<g id=\"edge1\" class=\"edge\">\n",
       "<title>0&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M20.1345,-86.954C16.4722,-76.9682 13.8066,-64.9668 16,-54 16.6984,-50.5081 17.7429,-46.9315 18.9619,-43.4525\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"22.2557,-44.6417 22.7167,-34.0569 15.7556,-42.044 22.2557,-44.6417\"/>\n",
       "<text text-anchor=\"middle\" x=\"20.5\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;0 -->\n",
       "<g id=\"edge3\" class=\"edge\">\n",
       "<title>1&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M31,-36.1556C31,-47.8111 31,-63.2722 31,-76.9511\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"27.5001,-76.9714 31,-86.9714 34.5001,-76.9715 27.5001,-76.9714\"/>\n",
       "<text text-anchor=\"middle\" x=\"35.5\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;1 -->\n",
       "<g id=\"edge4\" class=\"edge\">\n",
       "<title>1&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M47.6641,-25.3828C57.625,-27.0234 67,-24.5625 67,-18 67,-13.7959 63.1525,-11.2751 57.7682,-10.4375\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"57.6002,-6.9399 47.6641,-10.6172 57.7247,-13.9388 57.6002,-6.9399\"/>\n",
       "<text text-anchor=\"middle\" x=\"72\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "</g>\n",
       "</svg>\n"
      ],
      "text/plain": [
       "<graphviz.dot.Digraph at 0x7f41a068aee0>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "avg epochs 5.38 min epochs 1 max epochs 18 std epochs 4.091213354008422 avg loss at epoch 0 1.3962756979465485 avg loss when fit 0.7864163091778755\n"
     ]
    },
    {
     "data": {
      "image/svg+xml": [
       "<?xml version=\"1.0\" encoding=\"UTF-8\" standalone=\"no\"?>\n",
       "<!DOCTYPE svg PUBLIC \"-//W3C//DTD SVG 1.1//EN\"\n",
       " \"http://www.w3.org/Graphics/SVG/1.1/DTD/svg11.dtd\">\n",
       "<!-- Generated by graphviz version 2.40.1 (20161225.0304)\n",
       " -->\n",
       "<!-- Title: %3 Pages: 1 -->\n",
       "<svg width=\"89pt\" height=\"139pt\"\n",
       " viewBox=\"0.00 0.00 89.00 139.00\" xmlns=\"http://www.w3.org/2000/svg\" xmlns:xlink=\"http://www.w3.org/1999/xlink\">\n",
       "<g id=\"graph0\" class=\"graph\" transform=\"scale(1 1) rotate(0) translate(4 135)\">\n",
       "<title>%3</title>\n",
       "<polygon fill=\"#ffffff\" stroke=\"transparent\" points=\"-4,4 -4,-135 85,-135 85,4 -4,4\"/>\n",
       "<!-- 0 -->\n",
       "<g id=\"node1\" class=\"node\">\n",
       "<title>0</title>\n",
       "<ellipse fill=\"none\" stroke=\"#000000\" cx=\"27\" cy=\"-109\" rx=\"18\" ry=\"18\"/>\n",
       "<ellipse fill=\"none\" stroke=\"#000000\" cx=\"27\" cy=\"-109\" rx=\"22\" ry=\"22\"/>\n",
       "<text text-anchor=\"middle\" x=\"27\" y=\"-105.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;0 -->\n",
       "<g id=\"edge1\" class=\"edge\">\n",
       "<title>0&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M47.5808,-117.3702C57.8447,-118.5284 67,-115.7383 67,-109 67,-104.6833 63.2427,-101.9869 57.8436,-100.9109\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"57.6729,-97.405 47.5808,-100.6298 57.4812,-104.4024 57.6729,-97.405\"/>\n",
       "<text text-anchor=\"middle\" x=\"71.5\" y=\"-105.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 1 -->\n",
       "<g id=\"node2\" class=\"node\">\n",
       "<title>1</title>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"54,-10.5442 54,-25.4558 38.1838,-36 15.8162,-36 0,-25.4558 0,-10.5442 15.8162,0 38.1838,0 54,-10.5442\"/>\n",
       "<text text-anchor=\"middle\" x=\"27\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;1 -->\n",
       "<g id=\"edge2\" class=\"edge\">\n",
       "<title>0&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M17.0266,-89.3001C12.9276,-78.8865 9.6319,-65.8403 12,-54 12.5415,-51.2924 13.2912,-48.5339 14.1689,-45.8093\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"17.5225,-46.8347 17.7658,-36.2427 10.9703,-44.3712 17.5225,-46.8347\"/>\n",
       "<text text-anchor=\"middle\" x=\"17\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;0 -->\n",
       "<g id=\"edge4\" class=\"edge\">\n",
       "<title>1&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M27,-36.1556C27,-47.8111 27,-63.2722 27,-76.9511\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"23.5001,-76.9714 27,-86.9714 30.5001,-76.9715 23.5001,-76.9714\"/>\n",
       "<text text-anchor=\"middle\" x=\"32\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;1 -->\n",
       "<g id=\"edge3\" class=\"edge\">\n",
       "<title>1&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M53.7949,-25.8577C63.7804,-26.1153 72,-23.4961 72,-18 72,-14.5649 68.7892,-12.2537 63.9433,-11.0661\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"64.071,-7.5634 53.7949,-10.1423 63.4363,-14.5346 64.071,-7.5634\"/>\n",
       "<text text-anchor=\"middle\" x=\"76.5\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "</g>\n",
       "</svg>\n"
      ],
      "text/plain": [
       "<graphviz.dot.Digraph at 0x7f41a068aaf0>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "avg epochs 5.66 min epochs 1 max epochs 13 std epochs 4.191300675273328 avg loss at epoch 0 1.3994489264488221 avg loss when fit 0.7718555393815041\n"
     ]
    },
    {
     "data": {
      "image/svg+xml": [
       "<?xml version=\"1.0\" encoding=\"UTF-8\" standalone=\"no\"?>\n",
       "<!DOCTYPE svg PUBLIC \"-//W3C//DTD SVG 1.1//EN\"\n",
       " \"http://www.w3.org/Graphics/SVG/1.1/DTD/svg11.dtd\">\n",
       "<!-- Generated by graphviz version 2.40.1 (20161225.0304)\n",
       " -->\n",
       "<!-- Title: %3 Pages: 1 -->\n",
       "<svg width=\"91pt\" height=\"139pt\"\n",
       " viewBox=\"0.00 0.00 90.78 139.00\" xmlns=\"http://www.w3.org/2000/svg\" xmlns:xlink=\"http://www.w3.org/1999/xlink\">\n",
       "<g id=\"graph0\" class=\"graph\" transform=\"scale(1 1) rotate(0) translate(4 135)\">\n",
       "<title>%3</title>\n",
       "<polygon fill=\"#ffffff\" stroke=\"transparent\" points=\"-4,4 -4,-135 86.783,-135 86.783,4 -4,4\"/>\n",
       "<!-- 0 -->\n",
       "<g id=\"node1\" class=\"node\">\n",
       "<title>0</title>\n",
       "<ellipse fill=\"none\" stroke=\"#000000\" cx=\"33.783\" cy=\"-109\" rx=\"18\" ry=\"18\"/>\n",
       "<ellipse fill=\"none\" stroke=\"#000000\" cx=\"33.783\" cy=\"-109\" rx=\"22\" ry=\"22\"/>\n",
       "<text text-anchor=\"middle\" x=\"33.783\" y=\"-105.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;0 -->\n",
       "<g id=\"edge1\" class=\"edge\">\n",
       "<title>0&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M54.3638,-117.3702C64.6277,-118.5284 73.783,-115.7383 73.783,-109 73.783,-104.6833 70.0256,-101.9869 64.6265,-100.9109\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"64.4559,-97.405 54.3638,-100.6298 64.2641,-104.4024 64.4559,-97.405\"/>\n",
       "<text text-anchor=\"middle\" x=\"78.283\" y=\"-105.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 1 -->\n",
       "<g id=\"node2\" class=\"node\">\n",
       "<title>1</title>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"60.783,-10.5442 60.783,-25.4558 44.9667,-36 22.5992,-36 6.783,-25.4558 6.783,-10.5442 22.5992,0 44.9667,0 60.783,-10.5442\"/>\n",
       "<text text-anchor=\"middle\" x=\"33.783\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;1 -->\n",
       "<g id=\"edge2\" class=\"edge\">\n",
       "<title>0&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M17.5898,-93.8165C11.3846,-86.9145 5.021,-78.2311 1.783,-69 -1.783,-58.8344 2.7088,-48.588 9.3483,-39.9734\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"12.1633,-42.0742 16.1792,-32.27 6.9258,-37.4299 12.1633,-42.0742\"/>\n",
       "<text text-anchor=\"middle\" x=\"6.783\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;0 -->\n",
       "<g id=\"edge3\" class=\"edge\">\n",
       "<title>1&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M33.783,-36.1556C33.783,-47.8111 33.783,-63.2722 33.783,-76.9511\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"30.2831,-76.9714 33.783,-86.9714 37.2831,-76.9715 30.2831,-76.9714\"/>\n",
       "<text text-anchor=\"middle\" x=\"38.283\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;0 -->\n",
       "<g id=\"edge4\" class=\"edge\">\n",
       "<title>1&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M39.8444,-36.1134C41.4588,-41.7745 42.977,-48.087 43.783,-54 44.8493,-61.823 44.2281,-70.2281 42.8841,-78.0554\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"39.4443,-77.4047 40.7823,-87.9147 46.2904,-78.8642 39.4443,-77.4047\"/>\n",
       "<text text-anchor=\"middle\" x=\"48.783\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "</g>\n",
       "</svg>\n"
      ],
      "text/plain": [
       "<graphviz.dot.Digraph at 0x7f41a068af40>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "avg epochs 4.52 min epochs 1 max epochs 13 std epochs 4.195246469366644 avg loss at epoch 0 1.401658388376236 avg loss when fit 0.8417020487785339\n"
     ]
    },
    {
     "data": {
      "image/svg+xml": [
       "<?xml version=\"1.0\" encoding=\"UTF-8\" standalone=\"no\"?>\n",
       "<!DOCTYPE svg PUBLIC \"-//W3C//DTD SVG 1.1//EN\"\n",
       " \"http://www.w3.org/Graphics/SVG/1.1/DTD/svg11.dtd\">\n",
       "<!-- Generated by graphviz version 2.40.1 (20161225.0304)\n",
       " -->\n",
       "<!-- Title: %3 Pages: 1 -->\n",
       "<svg width=\"99pt\" height=\"139pt\"\n",
       " viewBox=\"0.00 0.00 99.38 139.00\" xmlns=\"http://www.w3.org/2000/svg\" xmlns:xlink=\"http://www.w3.org/1999/xlink\">\n",
       "<g id=\"graph0\" class=\"graph\" transform=\"scale(1 1) rotate(0) translate(4 135)\">\n",
       "<title>%3</title>\n",
       "<polygon fill=\"#ffffff\" stroke=\"transparent\" points=\"-4,4 -4,-135 95.3762,-135 95.3762,4 -4,4\"/>\n",
       "<!-- 0 -->\n",
       "<g id=\"node1\" class=\"node\">\n",
       "<title>0</title>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"60.3762,-101.5442 60.3762,-116.4558 44.56,-127 22.1924,-127 6.3762,-116.4558 6.3762,-101.5442 22.1924,-91 44.56,-91 60.3762,-101.5442\"/>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"64.3762,-99.4034 64.3762,-118.5966 45.7711,-131 20.9813,-131 2.3762,-118.5966 2.3762,-99.4034 20.9813,-87 45.7711,-87 64.3762,-99.4034\"/>\n",
       "<text text-anchor=\"middle\" x=\"33.3762\" y=\"-105.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;0 -->\n",
       "<g id=\"edge1\" class=\"edge\">\n",
       "<title>0&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M64.4782,-117.6229C74.4628,-117.5345 82.3762,-114.6602 82.3762,-109 82.3762,-105.4624 79.285,-103.013 74.529,-101.6519\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"74.8391,-98.1633 64.4782,-100.3771 73.9583,-105.1076 74.8391,-98.1633\"/>\n",
       "<text text-anchor=\"middle\" x=\"86.8762\" y=\"-105.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 1 -->\n",
       "<g id=\"node2\" class=\"node\">\n",
       "<title>1</title>\n",
       "<ellipse fill=\"none\" stroke=\"#000000\" cx=\"33.3762\" cy=\"-18\" rx=\"18\" ry=\"18\"/>\n",
       "<text text-anchor=\"middle\" x=\"33.3762\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;1 -->\n",
       "<g id=\"edge2\" class=\"edge\">\n",
       "<title>0&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M14.8129,-91.0971C9.4087,-84.6953 4.2022,-77.0562 1.3762,-69 -2.6784,-57.4412 3.6846,-45.7778 11.7773,-36.5278\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"14.285,-38.9695 18.7912,-29.3807 9.2889,-34.0665 14.285,-38.9695\"/>\n",
       "<text text-anchor=\"middle\" x=\"6.3762\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;0 -->\n",
       "<g id=\"edge3\" class=\"edge\">\n",
       "<title>1&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M33.3762,-36.1556C33.3762,-47.8111 33.3762,-63.2722 33.3762,-76.9511\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"29.8763,-76.9714 33.3762,-86.9714 36.8763,-76.9715 29.8763,-76.9714\"/>\n",
       "<text text-anchor=\"middle\" x=\"37.8762\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;0 -->\n",
       "<g id=\"edge4\" class=\"edge\">\n",
       "<title>1&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M39.2266,-35.3788C40.9187,-41.2248 42.5352,-47.8299 43.3762,-54 44.3945,-61.4706 43.8739,-69.4721 42.6545,-76.9943\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"39.2116,-76.3615 40.6376,-86.8599 46.0697,-77.7636 39.2116,-76.3615\"/>\n",
       "<text text-anchor=\"middle\" x=\"48.3762\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "</g>\n",
       "</svg>\n"
      ],
      "text/plain": [
       "<graphviz.dot.Digraph at 0x7f41a068aa60>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "avg epochs 6.42 min epochs 1 max epochs 13 std epochs 4.359107024195567 avg loss at epoch 0 1.3848290741443634 avg loss when fit 0.7236772906780243\n"
     ]
    },
    {
     "data": {
      "image/svg+xml": [
       "<?xml version=\"1.0\" encoding=\"UTF-8\" standalone=\"no\"?>\n",
       "<!DOCTYPE svg PUBLIC \"-//W3C//DTD SVG 1.1//EN\"\n",
       " \"http://www.w3.org/Graphics/SVG/1.1/DTD/svg11.dtd\">\n",
       "<!-- Generated by graphviz version 2.40.1 (20161225.0304)\n",
       " -->\n",
       "<!-- Title: %3 Pages: 1 -->\n",
       "<svg width=\"95pt\" height=\"139pt\"\n",
       " viewBox=\"0.00 0.00 94.73 139.00\" xmlns=\"http://www.w3.org/2000/svg\" xmlns:xlink=\"http://www.w3.org/1999/xlink\">\n",
       "<g id=\"graph0\" class=\"graph\" transform=\"scale(1 1) rotate(0) translate(4 135)\">\n",
       "<title>%3</title>\n",
       "<polygon fill=\"#ffffff\" stroke=\"transparent\" points=\"-4,4 -4,-135 90.7285,-135 90.7285,4 -4,4\"/>\n",
       "<!-- 0 -->\n",
       "<g id=\"node1\" class=\"node\">\n",
       "<title>0</title>\n",
       "<ellipse fill=\"none\" stroke=\"#000000\" cx=\"32.7285\" cy=\"-109\" rx=\"18\" ry=\"18\"/>\n",
       "<ellipse fill=\"none\" stroke=\"#000000\" cx=\"32.7285\" cy=\"-109\" rx=\"22\" ry=\"22\"/>\n",
       "<text text-anchor=\"middle\" x=\"32.7285\" y=\"-105.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 1 -->\n",
       "<g id=\"node2\" class=\"node\">\n",
       "<title>1</title>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"59.7285,-10.5442 59.7285,-25.4558 43.9122,-36 21.5447,-36 5.7285,-25.4558 5.7285,-10.5442 21.5447,0 43.9122,0 59.7285,-10.5442\"/>\n",
       "<text text-anchor=\"middle\" x=\"32.7285\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;1 -->\n",
       "<g id=\"edge1\" class=\"edge\">\n",
       "<title>0&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M16.7051,-93.3525C10.7974,-86.4997 4.8001,-77.9778 1.7285,-69 -1.7285,-58.8961 2.6224,-48.6617 9.0548,-40.0395\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"11.8189,-42.1928 15.6727,-32.3237 6.5056,-37.6355 11.8189,-42.1928\"/>\n",
       "<text text-anchor=\"middle\" x=\"6.2285\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;1 -->\n",
       "<g id=\"edge2\" class=\"edge\">\n",
       "<title>0&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M32.7285,-86.9714C32.7285,-74.8075 32.7285,-59.5615 32.7285,-46.499\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"36.2286,-46.1556 32.7285,-36.1556 29.2286,-46.1556 36.2286,-46.1556\"/>\n",
       "<text text-anchor=\"middle\" x=\"37.7285\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;0 -->\n",
       "<g id=\"edge4\" class=\"edge\">\n",
       "<title>1&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M39.394,-36.0722C41.1698,-41.7317 42.8402,-48.0535 43.7285,-54 44.9088,-61.9018 44.2026,-70.3881 42.6979,-78.2726\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"39.2478,-77.6538 40.3515,-88.191 46.0598,-79.2654 39.2478,-77.6538\"/>\n",
       "<text text-anchor=\"middle\" x=\"48.7285\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;1 -->\n",
       "<g id=\"edge3\" class=\"edge\">\n",
       "<title>1&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M59.5233,-25.8577C69.5089,-26.1153 77.7285,-23.4961 77.7285,-18 77.7285,-14.5649 74.5177,-12.2537 69.6717,-11.0661\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"69.7995,-7.5634 59.5233,-10.1423 69.1648,-14.5346 69.7995,-7.5634\"/>\n",
       "<text text-anchor=\"middle\" x=\"82.2285\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "</g>\n",
       "</svg>\n"
      ],
      "text/plain": [
       "<graphviz.dot.Digraph at 0x7f41a068a9a0>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "avg epochs 5.87 min epochs 1 max epochs 13 std epochs 4.645970378376655 avg loss at epoch 0 1.3975611889362336 avg loss when fit 0.7624968060851097\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "Sorted by avg loss at epoch 0\n"
     ]
    },
    {
     "data": {
      "image/svg+xml": [
       "<?xml version=\"1.0\" encoding=\"UTF-8\" standalone=\"no\"?>\n",
       "<!DOCTYPE svg PUBLIC \"-//W3C//DTD SVG 1.1//EN\"\n",
       " \"http://www.w3.org/Graphics/SVG/1.1/DTD/svg11.dtd\">\n",
       "<!-- Generated by graphviz version 2.40.1 (20161225.0304)\n",
       " -->\n",
       "<!-- Title: %3 Pages: 1 -->\n",
       "<svg width=\"99pt\" height=\"139pt\"\n",
       " viewBox=\"0.00 0.00 99.38 139.00\" xmlns=\"http://www.w3.org/2000/svg\" xmlns:xlink=\"http://www.w3.org/1999/xlink\">\n",
       "<g id=\"graph0\" class=\"graph\" transform=\"scale(1 1) rotate(0) translate(4 135)\">\n",
       "<title>%3</title>\n",
       "<polygon fill=\"#ffffff\" stroke=\"transparent\" points=\"-4,4 -4,-135 95.3762,-135 95.3762,4 -4,4\"/>\n",
       "<!-- 0 -->\n",
       "<g id=\"node1\" class=\"node\">\n",
       "<title>0</title>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"60.3762,-101.5442 60.3762,-116.4558 44.56,-127 22.1924,-127 6.3762,-116.4558 6.3762,-101.5442 22.1924,-91 44.56,-91 60.3762,-101.5442\"/>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"64.3762,-99.4034 64.3762,-118.5966 45.7711,-131 20.9813,-131 2.3762,-118.5966 2.3762,-99.4034 20.9813,-87 45.7711,-87 64.3762,-99.4034\"/>\n",
       "<text text-anchor=\"middle\" x=\"33.3762\" y=\"-105.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;0 -->\n",
       "<g id=\"edge1\" class=\"edge\">\n",
       "<title>0&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M64.4782,-117.6229C74.4628,-117.5345 82.3762,-114.6602 82.3762,-109 82.3762,-105.4624 79.285,-103.013 74.529,-101.6519\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"74.8391,-98.1633 64.4782,-100.3771 73.9583,-105.1076 74.8391,-98.1633\"/>\n",
       "<text text-anchor=\"middle\" x=\"86.8762\" y=\"-105.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 1 -->\n",
       "<g id=\"node2\" class=\"node\">\n",
       "<title>1</title>\n",
       "<ellipse fill=\"none\" stroke=\"#000000\" cx=\"33.3762\" cy=\"-18\" rx=\"18\" ry=\"18\"/>\n",
       "<text text-anchor=\"middle\" x=\"33.3762\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;1 -->\n",
       "<g id=\"edge2\" class=\"edge\">\n",
       "<title>0&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M14.8129,-91.0971C9.4087,-84.6953 4.2022,-77.0562 1.3762,-69 -2.6784,-57.4412 3.6846,-45.7778 11.7773,-36.5278\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"14.285,-38.9695 18.7912,-29.3807 9.2889,-34.0665 14.285,-38.9695\"/>\n",
       "<text text-anchor=\"middle\" x=\"6.3762\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;0 -->\n",
       "<g id=\"edge3\" class=\"edge\">\n",
       "<title>1&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M33.3762,-36.1556C33.3762,-47.8111 33.3762,-63.2722 33.3762,-76.9511\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"29.8763,-76.9714 33.3762,-86.9714 36.8763,-76.9715 29.8763,-76.9714\"/>\n",
       "<text text-anchor=\"middle\" x=\"37.8762\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;0 -->\n",
       "<g id=\"edge4\" class=\"edge\">\n",
       "<title>1&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M39.2266,-35.3788C40.9187,-41.2248 42.5352,-47.8299 43.3762,-54 44.3945,-61.4706 43.8739,-69.4721 42.6545,-76.9943\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"39.2116,-76.3615 40.6376,-86.8599 46.0697,-77.7636 39.2116,-76.3615\"/>\n",
       "<text text-anchor=\"middle\" x=\"48.3762\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "</g>\n",
       "</svg>\n"
      ],
      "text/plain": [
       "<graphviz.dot.Digraph at 0x7f41a068af40>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "avg epochs 6.42 min epochs 1 max epochs 13 std epochs 4.359107024195567 avg loss at epoch 0 1.3848290741443634 avg loss when fit 0.7236772906780243\n"
     ]
    },
    {
     "data": {
      "image/svg+xml": [
       "<?xml version=\"1.0\" encoding=\"UTF-8\" standalone=\"no\"?>\n",
       "<!DOCTYPE svg PUBLIC \"-//W3C//DTD SVG 1.1//EN\"\n",
       " \"http://www.w3.org/Graphics/SVG/1.1/DTD/svg11.dtd\">\n",
       "<!-- Generated by graphviz version 2.40.1 (20161225.0304)\n",
       " -->\n",
       "<!-- Title: %3 Pages: 1 -->\n",
       "<svg width=\"85pt\" height=\"139pt\"\n",
       " viewBox=\"0.00 0.00 84.59 139.00\" xmlns=\"http://www.w3.org/2000/svg\" xmlns:xlink=\"http://www.w3.org/1999/xlink\">\n",
       "<g id=\"graph0\" class=\"graph\" transform=\"scale(1 1) rotate(0) translate(4 135)\">\n",
       "<title>%3</title>\n",
       "<polygon fill=\"#ffffff\" stroke=\"transparent\" points=\"-4,4 -4,-135 80.5906,-135 80.5906,4 -4,4\"/>\n",
       "<!-- 0 -->\n",
       "<g id=\"node1\" class=\"node\">\n",
       "<title>0</title>\n",
       "<ellipse fill=\"none\" stroke=\"#000000\" cx=\"49.5906\" cy=\"-109\" rx=\"18\" ry=\"18\"/>\n",
       "<ellipse fill=\"none\" stroke=\"#000000\" cx=\"49.5906\" cy=\"-109\" rx=\"22\" ry=\"22\"/>\n",
       "<text text-anchor=\"middle\" x=\"49.5906\" y=\"-105.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 1 -->\n",
       "<g id=\"node2\" class=\"node\">\n",
       "<title>1</title>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"76.5906,-10.5442 76.5906,-25.4558 60.7744,-36 38.4069,-36 22.5906,-25.4558 22.5906,-10.5442 38.4069,0 60.7744,0 76.5906,-10.5442\"/>\n",
       "<text text-anchor=\"middle\" x=\"49.5906\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;1 -->\n",
       "<g id=\"edge1\" class=\"edge\">\n",
       "<title>0&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M30.0239,-98.6189C13.5164,-88.3622 -6.1387,-71.682 2.5906,-54 6.3017,-46.4829 12.4189,-40.1015 19.0324,-34.8951\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"21.3556,-37.5406 27.5311,-28.9317 17.3348,-31.8105 21.3556,-37.5406\"/>\n",
       "<text text-anchor=\"middle\" x=\"7.0906\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;1 -->\n",
       "<g id=\"edge2\" class=\"edge\">\n",
       "<title>0&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M39.6172,-89.3001C35.5182,-78.8865 32.2226,-65.8403 34.5906,-54 35.1321,-51.2924 35.8818,-48.5339 36.7595,-45.8093\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"40.1132,-46.8347 40.3564,-36.2427 33.561,-44.3712 40.1132,-46.8347\"/>\n",
       "<text text-anchor=\"middle\" x=\"39.5906\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;0 -->\n",
       "<g id=\"edge3\" class=\"edge\">\n",
       "<title>1&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M49.5906,-36.1556C49.5906,-47.8111 49.5906,-63.2722 49.5906,-76.9511\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"46.0907,-76.9714 49.5906,-86.9714 53.0907,-76.9715 46.0907,-76.9714\"/>\n",
       "<text text-anchor=\"middle\" x=\"54.0906\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;0 -->\n",
       "<g id=\"edge4\" class=\"edge\">\n",
       "<title>1&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M57.5995,-36.3492C59.6467,-41.9107 61.5596,-48.109 62.5906,-54 64.0179,-62.1547 63.0922,-70.9086 61.2094,-78.9809\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"57.8017,-78.1679 58.4179,-88.7448 64.532,-80.0922 57.8017,-78.1679\"/>\n",
       "<text text-anchor=\"middle\" x=\"67.5906\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "</g>\n",
       "</svg>\n"
      ],
      "text/plain": [
       "<graphviz.dot.Digraph at 0x7f41a068afd0>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "avg epochs 2.6100000000000003 min epochs 1 max epochs 6 std epochs 2.4205280708243677 avg loss at epoch 0 1.387124490737915 avg loss when fit 0.9513023608922958\n"
     ]
    },
    {
     "data": {
      "image/svg+xml": [
       "<?xml version=\"1.0\" encoding=\"UTF-8\" standalone=\"no\"?>\n",
       "<!DOCTYPE svg PUBLIC \"-//W3C//DTD SVG 1.1//EN\"\n",
       " \"http://www.w3.org/Graphics/SVG/1.1/DTD/svg11.dtd\">\n",
       "<!-- Generated by graphviz version 2.40.1 (20161225.0304)\n",
       " -->\n",
       "<!-- Title: %3 Pages: 1 -->\n",
       "<svg width=\"112pt\" height=\"139pt\"\n",
       " viewBox=\"0.00 0.00 112.00 139.00\" xmlns=\"http://www.w3.org/2000/svg\" xmlns:xlink=\"http://www.w3.org/1999/xlink\">\n",
       "<g id=\"graph0\" class=\"graph\" transform=\"scale(1 1) rotate(0) translate(4 135)\">\n",
       "<title>%3</title>\n",
       "<polygon fill=\"#ffffff\" stroke=\"transparent\" points=\"-4,4 -4,-135 108,-135 108,4 -4,4\"/>\n",
       "<!-- 0 -->\n",
       "<g id=\"node1\" class=\"node\">\n",
       "<title>0</title>\n",
       "<ellipse fill=\"none\" stroke=\"#000000\" cx=\"27\" cy=\"-22\" rx=\"18\" ry=\"18\"/>\n",
       "<ellipse fill=\"none\" stroke=\"#000000\" cx=\"27\" cy=\"-22\" rx=\"22\" ry=\"22\"/>\n",
       "<text text-anchor=\"middle\" x=\"27\" y=\"-18.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;0 -->\n",
       "<g id=\"edge1\" class=\"edge\">\n",
       "<title>0&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M48.8066,-26.2451C58.5625,-26.6494 67,-25.2344 67,-22 67,-19.9785 63.7041,-18.6677 58.8504,-18.0676\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"58.9107,-14.5679 48.8066,-17.7549 58.6928,-21.5645 58.9107,-14.5679\"/>\n",
       "<text text-anchor=\"middle\" x=\"71.5\" y=\"-18.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;0 -->\n",
       "<g id=\"edge2\" class=\"edge\">\n",
       "<title>0&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M47.813,-29.2015C65.8838,-32.4865 85,-30.0859 85,-22 85,-15.4302 72.3803,-12.6136 57.9552,-13.5503\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"57.3106,-10.1032 47.813,-14.7985 58.1656,-17.0508 57.3106,-10.1032\"/>\n",
       "<text text-anchor=\"middle\" x=\"90\" y=\"-18.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 1 -->\n",
       "<g id=\"node2\" class=\"node\">\n",
       "<title>1</title>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"54,-105.5442 54,-120.4558 38.1838,-131 15.8162,-131 0,-120.4558 0,-105.5442 15.8162,-95 38.1838,-95 54,-105.5442\"/>\n",
       "<text text-anchor=\"middle\" x=\"27\" y=\"-109.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;0 -->\n",
       "<g id=\"edge4\" class=\"edge\">\n",
       "<title>1&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M27,-94.5848C27,-83.1105 27,-68.0231 27,-54.5774\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"30.5001,-54.2465 27,-44.2465 23.5001,-54.2466 30.5001,-54.2465\"/>\n",
       "<text text-anchor=\"middle\" x=\"32\" y=\"-65.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;1 -->\n",
       "<g id=\"edge3\" class=\"edge\">\n",
       "<title>1&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M53.7949,-120.8577C63.7804,-121.1153 72,-118.4961 72,-113 72,-109.5649 68.7892,-107.2537 63.9433,-106.0661\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"64.071,-102.5634 53.7949,-105.1423 63.4363,-109.5346 64.071,-102.5634\"/>\n",
       "<text text-anchor=\"middle\" x=\"76.5\" y=\"-109.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "</g>\n",
       "</svg>\n"
      ],
      "text/plain": [
       "<graphviz.dot.Digraph at 0x7f41a068ac70>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "avg epochs 4.43 min epochs 1 max epochs 13 std epochs 4.027391616557065 avg loss at epoch 0 1.3896378016471862 avg loss when fit 0.7640904745459557\n"
     ]
    },
    {
     "data": {
      "image/svg+xml": [
       "<?xml version=\"1.0\" encoding=\"UTF-8\" standalone=\"no\"?>\n",
       "<!DOCTYPE svg PUBLIC \"-//W3C//DTD SVG 1.1//EN\"\n",
       " \"http://www.w3.org/Graphics/SVG/1.1/DTD/svg11.dtd\">\n",
       "<!-- Generated by graphviz version 2.40.1 (20161225.0304)\n",
       " -->\n",
       "<!-- Title: %3 Pages: 1 -->\n",
       "<svg width=\"125pt\" height=\"52pt\"\n",
       " viewBox=\"0.00 0.00 125.00 52.00\" xmlns=\"http://www.w3.org/2000/svg\" xmlns:xlink=\"http://www.w3.org/1999/xlink\">\n",
       "<g id=\"graph0\" class=\"graph\" transform=\"scale(1 1) rotate(0) translate(4 48)\">\n",
       "<title>%3</title>\n",
       "<polygon fill=\"#ffffff\" stroke=\"transparent\" points=\"-4,4 -4,-48 121,-48 121,4 -4,4\"/>\n",
       "<!-- 0 -->\n",
       "<g id=\"node1\" class=\"node\">\n",
       "<title>0</title>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"58,-14.5442 58,-29.4558 42.1838,-40 19.8162,-40 4,-29.4558 4,-14.5442 19.8162,-4 42.1838,-4 58,-14.5442\"/>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"62,-12.4034 62,-31.5966 43.3949,-44 18.6051,-44 0,-31.5966 0,-12.4034 18.6051,0 43.3949,0 62,-12.4034\"/>\n",
       "<text text-anchor=\"middle\" x=\"31\" y=\"-18.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;0 -->\n",
       "<g id=\"edge1\" class=\"edge\">\n",
       "<title>0&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M62.102,-25.9365C72.0865,-25.8962 80,-24.584 80,-22 80,-20.385 76.9088,-19.2668 72.1528,-18.6454\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"72.2876,-15.1475 62.102,-18.0635 71.8829,-22.1358 72.2876,-15.1475\"/>\n",
       "<text text-anchor=\"middle\" x=\"84.5\" y=\"-18.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;0 -->\n",
       "<g id=\"edge2\" class=\"edge\">\n",
       "<title>0&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M62.0137,-29.3828C80.5521,-31.0234 98,-28.5625 98,-22 98,-16.668 86.4816,-14.0436 72.2187,-14.1269\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"71.8342,-10.6413 62.0137,-14.6172 72.1701,-17.6332 71.8342,-10.6413\"/>\n",
       "<text text-anchor=\"middle\" x=\"103\" y=\"-18.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "</g>\n",
       "</svg>\n"
      ],
      "text/plain": [
       "<graphviz.dot.Digraph at 0x7f41a068ad60>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "avg epochs 1.02 min epochs 1 max epochs 3 std epochs 1.198997487421324 avg loss at epoch 0 1.3925223922729493 avg loss when fit 0.9185943812131881\n"
     ]
    },
    {
     "data": {
      "image/svg+xml": [
       "<?xml version=\"1.0\" encoding=\"UTF-8\" standalone=\"no\"?>\n",
       "<!DOCTYPE svg PUBLIC \"-//W3C//DTD SVG 1.1//EN\"\n",
       " \"http://www.w3.org/Graphics/SVG/1.1/DTD/svg11.dtd\">\n",
       "<!-- Generated by graphviz version 2.40.1 (20161225.0304)\n",
       " -->\n",
       "<!-- Title: %3 Pages: 1 -->\n",
       "<svg width=\"98pt\" height=\"139pt\"\n",
       " viewBox=\"0.00 0.00 98.00 139.00\" xmlns=\"http://www.w3.org/2000/svg\" xmlns:xlink=\"http://www.w3.org/1999/xlink\">\n",
       "<g id=\"graph0\" class=\"graph\" transform=\"scale(1 1) rotate(0) translate(4 135)\">\n",
       "<title>%3</title>\n",
       "<polygon fill=\"#ffffff\" stroke=\"transparent\" points=\"-4,4 -4,-135 94,-135 94,4 -4,4\"/>\n",
       "<!-- 0 -->\n",
       "<g id=\"node1\" class=\"node\">\n",
       "<title>0</title>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"58,-101.5442 58,-116.4558 42.1838,-127 19.8162,-127 4,-116.4558 4,-101.5442 19.8162,-91 42.1838,-91 58,-101.5442\"/>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"62,-99.4034 62,-118.5966 43.3949,-131 18.6051,-131 0,-118.5966 0,-99.4034 18.6051,-87 43.3949,-87 62,-99.4034\"/>\n",
       "<text text-anchor=\"middle\" x=\"31\" y=\"-105.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;0 -->\n",
       "<g id=\"edge2\" class=\"edge\">\n",
       "<title>0&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M62.102,-117.6229C72.0865,-117.5345 80,-114.6602 80,-109 80,-105.4624 76.9088,-103.013 72.1528,-101.6519\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"72.4629,-98.1633 62.102,-100.3771 71.5821,-105.1076 72.4629,-98.1633\"/>\n",
       "<text text-anchor=\"middle\" x=\"85\" y=\"-105.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 1 -->\n",
       "<g id=\"node2\" class=\"node\">\n",
       "<title>1</title>\n",
       "<ellipse fill=\"none\" stroke=\"#000000\" cx=\"31\" cy=\"-18\" rx=\"18\" ry=\"18\"/>\n",
       "<text text-anchor=\"middle\" x=\"31\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;1 -->\n",
       "<g id=\"edge1\" class=\"edge\">\n",
       "<title>0&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M20.1345,-86.954C16.4722,-76.9682 13.8066,-64.9668 16,-54 16.6984,-50.5081 17.7429,-46.9315 18.9619,-43.4525\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"22.2557,-44.6417 22.7167,-34.0569 15.7556,-42.044 22.2557,-44.6417\"/>\n",
       "<text text-anchor=\"middle\" x=\"20.5\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;0 -->\n",
       "<g id=\"edge3\" class=\"edge\">\n",
       "<title>1&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M31,-36.1556C31,-47.8111 31,-63.2722 31,-76.9511\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"27.5001,-76.9714 31,-86.9714 34.5001,-76.9715 27.5001,-76.9714\"/>\n",
       "<text text-anchor=\"middle\" x=\"35.5\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;1 -->\n",
       "<g id=\"edge4\" class=\"edge\">\n",
       "<title>1&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M47.6641,-25.3828C57.625,-27.0234 67,-24.5625 67,-18 67,-13.7959 63.1525,-11.2751 57.7682,-10.4375\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"57.6002,-6.9399 47.6641,-10.6172 57.7247,-13.9388 57.6002,-6.9399\"/>\n",
       "<text text-anchor=\"middle\" x=\"72\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "</g>\n",
       "</svg>\n"
      ],
      "text/plain": [
       "<graphviz.dot.Digraph at 0x7f41a068af70>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "avg epochs 5.38 min epochs 1 max epochs 18 std epochs 4.091213354008422 avg loss at epoch 0 1.3962756979465485 avg loss when fit 0.7864163091778755\n"
     ]
    },
    {
     "data": {
      "image/svg+xml": [
       "<?xml version=\"1.0\" encoding=\"UTF-8\" standalone=\"no\"?>\n",
       "<!DOCTYPE svg PUBLIC \"-//W3C//DTD SVG 1.1//EN\"\n",
       " \"http://www.w3.org/Graphics/SVG/1.1/DTD/svg11.dtd\">\n",
       "<!-- Generated by graphviz version 2.40.1 (20161225.0304)\n",
       " -->\n",
       "<!-- Title: %3 Pages: 1 -->\n",
       "<svg width=\"112pt\" height=\"139pt\"\n",
       " viewBox=\"0.00 0.00 112.00 139.00\" xmlns=\"http://www.w3.org/2000/svg\" xmlns:xlink=\"http://www.w3.org/1999/xlink\">\n",
       "<g id=\"graph0\" class=\"graph\" transform=\"scale(1 1) rotate(0) translate(4 135)\">\n",
       "<title>%3</title>\n",
       "<polygon fill=\"#ffffff\" stroke=\"transparent\" points=\"-4,4 -4,-135 108,-135 108,4 -4,4\"/>\n",
       "<!-- 0 -->\n",
       "<g id=\"node1\" class=\"node\">\n",
       "<title>0</title>\n",
       "<ellipse fill=\"none\" stroke=\"#000000\" cx=\"27\" cy=\"-22\" rx=\"18\" ry=\"18\"/>\n",
       "<ellipse fill=\"none\" stroke=\"#000000\" cx=\"27\" cy=\"-22\" rx=\"22\" ry=\"22\"/>\n",
       "<text text-anchor=\"middle\" x=\"27\" y=\"-18.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;0 -->\n",
       "<g id=\"edge1\" class=\"edge\">\n",
       "<title>0&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M48.8066,-26.2451C58.5625,-26.6494 67,-25.2344 67,-22 67,-19.9785 63.7041,-18.6677 58.8504,-18.0676\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"58.9107,-14.5679 48.8066,-17.7549 58.6928,-21.5645 58.9107,-14.5679\"/>\n",
       "<text text-anchor=\"middle\" x=\"71.5\" y=\"-18.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;0 -->\n",
       "<g id=\"edge2\" class=\"edge\">\n",
       "<title>0&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M47.813,-29.2015C65.8838,-32.4865 85,-30.0859 85,-22 85,-15.4302 72.3803,-12.6136 57.9552,-13.5503\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"57.3106,-10.1032 47.813,-14.7985 58.1656,-17.0508 57.3106,-10.1032\"/>\n",
       "<text text-anchor=\"middle\" x=\"90\" y=\"-18.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 1 -->\n",
       "<g id=\"node2\" class=\"node\">\n",
       "<title>1</title>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"54,-105.5442 54,-120.4558 38.1838,-131 15.8162,-131 0,-120.4558 0,-105.5442 15.8162,-95 38.1838,-95 54,-105.5442\"/>\n",
       "<text text-anchor=\"middle\" x=\"27\" y=\"-109.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;0 -->\n",
       "<g id=\"edge3\" class=\"edge\">\n",
       "<title>1&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M17.7658,-94.7573C15.4038,-89.1988 13.1951,-82.9754 12,-77 10.3165,-68.5823 11.4955,-59.5551 13.7908,-51.2977\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"17.1484,-52.2941 17.0266,-41.6999 10.5152,-50.0577 17.1484,-52.2941\"/>\n",
       "<text text-anchor=\"middle\" x=\"16.5\" y=\"-65.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;0 -->\n",
       "<g id=\"edge4\" class=\"edge\">\n",
       "<title>1&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M27,-94.5848C27,-83.1105 27,-68.0231 27,-54.5774\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"30.5001,-54.2465 27,-44.2465 23.5001,-54.2466 30.5001,-54.2465\"/>\n",
       "<text text-anchor=\"middle\" x=\"32\" y=\"-65.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "</g>\n",
       "</svg>\n"
      ],
      "text/plain": [
       "<graphviz.dot.Digraph at 0x7f41a068ad00>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "avg epochs 1.9300000000000002 min epochs 1 max epochs 6 std epochs 2.2021231218140676 avg loss at epoch 0 1.3965786254405976 avg loss when fit 0.8911880993843079\n"
     ]
    },
    {
     "data": {
      "image/svg+xml": [
       "<?xml version=\"1.0\" encoding=\"UTF-8\" standalone=\"no\"?>\n",
       "<!DOCTYPE svg PUBLIC \"-//W3C//DTD SVG 1.1//EN\"\n",
       " \"http://www.w3.org/Graphics/SVG/1.1/DTD/svg11.dtd\">\n",
       "<!-- Generated by graphviz version 2.40.1 (20161225.0304)\n",
       " -->\n",
       "<!-- Title: %3 Pages: 1 -->\n",
       "<svg width=\"95pt\" height=\"139pt\"\n",
       " viewBox=\"0.00 0.00 94.73 139.00\" xmlns=\"http://www.w3.org/2000/svg\" xmlns:xlink=\"http://www.w3.org/1999/xlink\">\n",
       "<g id=\"graph0\" class=\"graph\" transform=\"scale(1 1) rotate(0) translate(4 135)\">\n",
       "<title>%3</title>\n",
       "<polygon fill=\"#ffffff\" stroke=\"transparent\" points=\"-4,4 -4,-135 90.7285,-135 90.7285,4 -4,4\"/>\n",
       "<!-- 0 -->\n",
       "<g id=\"node1\" class=\"node\">\n",
       "<title>0</title>\n",
       "<ellipse fill=\"none\" stroke=\"#000000\" cx=\"32.7285\" cy=\"-109\" rx=\"18\" ry=\"18\"/>\n",
       "<ellipse fill=\"none\" stroke=\"#000000\" cx=\"32.7285\" cy=\"-109\" rx=\"22\" ry=\"22\"/>\n",
       "<text text-anchor=\"middle\" x=\"32.7285\" y=\"-105.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 1 -->\n",
       "<g id=\"node2\" class=\"node\">\n",
       "<title>1</title>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"59.7285,-10.5442 59.7285,-25.4558 43.9122,-36 21.5447,-36 5.7285,-25.4558 5.7285,-10.5442 21.5447,0 43.9122,0 59.7285,-10.5442\"/>\n",
       "<text text-anchor=\"middle\" x=\"32.7285\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;1 -->\n",
       "<g id=\"edge1\" class=\"edge\">\n",
       "<title>0&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M16.7051,-93.3525C10.7974,-86.4997 4.8001,-77.9778 1.7285,-69 -1.7285,-58.8961 2.6224,-48.6617 9.0548,-40.0395\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"11.8189,-42.1928 15.6727,-32.3237 6.5056,-37.6355 11.8189,-42.1928\"/>\n",
       "<text text-anchor=\"middle\" x=\"6.2285\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;1 -->\n",
       "<g id=\"edge2\" class=\"edge\">\n",
       "<title>0&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M32.7285,-86.9714C32.7285,-74.8075 32.7285,-59.5615 32.7285,-46.499\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"36.2286,-46.1556 32.7285,-36.1556 29.2286,-46.1556 36.2286,-46.1556\"/>\n",
       "<text text-anchor=\"middle\" x=\"37.7285\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;0 -->\n",
       "<g id=\"edge4\" class=\"edge\">\n",
       "<title>1&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M39.394,-36.0722C41.1698,-41.7317 42.8402,-48.0535 43.7285,-54 44.9088,-61.9018 44.2026,-70.3881 42.6979,-78.2726\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"39.2478,-77.6538 40.3515,-88.191 46.0598,-79.2654 39.2478,-77.6538\"/>\n",
       "<text text-anchor=\"middle\" x=\"48.7285\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;1 -->\n",
       "<g id=\"edge3\" class=\"edge\">\n",
       "<title>1&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M59.5233,-25.8577C69.5089,-26.1153 77.7285,-23.4961 77.7285,-18 77.7285,-14.5649 74.5177,-12.2537 69.6717,-11.0661\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"69.7995,-7.5634 59.5233,-10.1423 69.1648,-14.5346 69.7995,-7.5634\"/>\n",
       "<text text-anchor=\"middle\" x=\"82.2285\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "</g>\n",
       "</svg>\n"
      ],
      "text/plain": [
       "<graphviz.dot.Digraph at 0x7f41a068aa30>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "avg epochs 5.87 min epochs 1 max epochs 13 std epochs 4.645970378376655 avg loss at epoch 0 1.3975611889362336 avg loss when fit 0.7624968060851097\n"
     ]
    },
    {
     "data": {
      "image/svg+xml": [
       "<?xml version=\"1.0\" encoding=\"UTF-8\" standalone=\"no\"?>\n",
       "<!DOCTYPE svg PUBLIC \"-//W3C//DTD SVG 1.1//EN\"\n",
       " \"http://www.w3.org/Graphics/SVG/1.1/DTD/svg11.dtd\">\n",
       "<!-- Generated by graphviz version 2.40.1 (20161225.0304)\n",
       " -->\n",
       "<!-- Title: %3 Pages: 1 -->\n",
       "<svg width=\"112pt\" height=\"139pt\"\n",
       " viewBox=\"0.00 0.00 112.00 139.00\" xmlns=\"http://www.w3.org/2000/svg\" xmlns:xlink=\"http://www.w3.org/1999/xlink\">\n",
       "<g id=\"graph0\" class=\"graph\" transform=\"scale(1 1) rotate(0) translate(4 135)\">\n",
       "<title>%3</title>\n",
       "<polygon fill=\"#ffffff\" stroke=\"transparent\" points=\"-4,4 -4,-135 108,-135 108,4 -4,4\"/>\n",
       "<!-- 0 -->\n",
       "<g id=\"node1\" class=\"node\">\n",
       "<title>0</title>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"58,-101.5442 58,-116.4558 42.1838,-127 19.8162,-127 4,-116.4558 4,-101.5442 19.8162,-91 42.1838,-91 58,-101.5442\"/>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"62,-99.4034 62,-118.5966 43.3949,-131 18.6051,-131 0,-118.5966 0,-99.4034 18.6051,-87 43.3949,-87 62,-99.4034\"/>\n",
       "<text text-anchor=\"middle\" x=\"31\" y=\"-105.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 1 -->\n",
       "<g id=\"node2\" class=\"node\">\n",
       "<title>1</title>\n",
       "<ellipse fill=\"none\" stroke=\"#000000\" cx=\"31\" cy=\"-18\" rx=\"18\" ry=\"18\"/>\n",
       "<text text-anchor=\"middle\" x=\"31\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;1 -->\n",
       "<g id=\"edge1\" class=\"edge\">\n",
       "<title>0&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M20.1345,-86.954C16.4722,-76.9682 13.8066,-64.9668 16,-54 16.6984,-50.5081 17.7429,-46.9315 18.9619,-43.4525\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"22.2557,-44.6417 22.7167,-34.0569 15.7556,-42.044 22.2557,-44.6417\"/>\n",
       "<text text-anchor=\"middle\" x=\"20.5\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;1 -->\n",
       "<g id=\"edge2\" class=\"edge\">\n",
       "<title>0&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M31,-86.9714C31,-74.8075 31,-59.5615 31,-46.499\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"34.5001,-46.1556 31,-36.1556 27.5001,-46.1556 34.5001,-46.1556\"/>\n",
       "<text text-anchor=\"middle\" x=\"36\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;1 -->\n",
       "<g id=\"edge3\" class=\"edge\">\n",
       "<title>1&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M48.7817,-21.775C58.3149,-22.4165 67,-21.1582 67,-18 67,-16.0755 63.7749,-14.8564 59.0981,-14.3429\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"58.8211,-10.8396 48.7817,-14.225 58.741,-17.8391 58.8211,-10.8396\"/>\n",
       "<text text-anchor=\"middle\" x=\"71.5\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;1 -->\n",
       "<g id=\"edge4\" class=\"edge\">\n",
       "<title>1&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M48.1418,-24.1447C65.585,-27.7592 85,-25.7109 85,-18 85,-11.7951 72.4283,-9.2569 58.4287,-10.3855\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"57.5461,-6.976 48.1418,-11.8553 58.5363,-13.9056 57.5461,-6.976\"/>\n",
       "<text text-anchor=\"middle\" x=\"90\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "</g>\n",
       "</svg>\n"
      ],
      "text/plain": [
       "<graphviz.dot.Digraph at 0x7f41a068aa00>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "avg epochs 2.0 min epochs 1 max epochs 8 std epochs 2.3490737563232043 avg loss at epoch 0 1.3975653278827667 avg loss when fit 0.8985250204801559\n"
     ]
    },
    {
     "data": {
      "image/svg+xml": [
       "<?xml version=\"1.0\" encoding=\"UTF-8\" standalone=\"no\"?>\n",
       "<!DOCTYPE svg PUBLIC \"-//W3C//DTD SVG 1.1//EN\"\n",
       " \"http://www.w3.org/Graphics/SVG/1.1/DTD/svg11.dtd\">\n",
       "<!-- Generated by graphviz version 2.40.1 (20161225.0304)\n",
       " -->\n",
       "<!-- Title: %3 Pages: 1 -->\n",
       "<svg width=\"85pt\" height=\"139pt\"\n",
       " viewBox=\"0.00 0.00 85.33 139.00\" xmlns=\"http://www.w3.org/2000/svg\" xmlns:xlink=\"http://www.w3.org/1999/xlink\">\n",
       "<g id=\"graph0\" class=\"graph\" transform=\"scale(1 1) rotate(0) translate(4 135)\">\n",
       "<title>%3</title>\n",
       "<polygon fill=\"#ffffff\" stroke=\"transparent\" points=\"-4,4 -4,-135 81.3273,-135 81.3273,4 -4,4\"/>\n",
       "<!-- 0 -->\n",
       "<g id=\"node1\" class=\"node\">\n",
       "<title>0</title>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"59.3273,-101.5442 59.3273,-116.4558 43.5111,-127 21.1436,-127 5.3273,-116.4558 5.3273,-101.5442 21.1436,-91 43.5111,-91 59.3273,-101.5442\"/>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"63.3273,-99.4034 63.3273,-118.5966 44.7222,-131 19.9325,-131 1.3273,-118.5966 1.3273,-99.4034 19.9325,-87 44.7222,-87 63.3273,-99.4034\"/>\n",
       "<text text-anchor=\"middle\" x=\"32.3273\" y=\"-105.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 1 -->\n",
       "<g id=\"node2\" class=\"node\">\n",
       "<title>1</title>\n",
       "<ellipse fill=\"none\" stroke=\"#000000\" cx=\"32.3273\" cy=\"-18\" rx=\"18\" ry=\"18\"/>\n",
       "<text text-anchor=\"middle\" x=\"32.3273\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;1 -->\n",
       "<g id=\"edge1\" class=\"edge\">\n",
       "<title>0&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M14.0086,-90.606C8.8906,-84.2826 4.0008,-76.814 1.3273,-69 -2.5641,-57.6263 3.4383,-46.0871 11.1662,-36.8684\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"13.8732,-39.0996 18.1963,-29.4269 8.7848,-34.2925 13.8732,-39.0996\"/>\n",
       "<text text-anchor=\"middle\" x=\"5.8273\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;1 -->\n",
       "<g id=\"edge2\" class=\"edge\">\n",
       "<title>0&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M32.3273,-86.9714C32.3273,-74.8075 32.3273,-59.5615 32.3273,-46.499\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"35.8274,-46.1556 32.3273,-36.1556 28.8274,-46.1556 35.8274,-46.1556\"/>\n",
       "<text text-anchor=\"middle\" x=\"37.3273\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;0 -->\n",
       "<g id=\"edge4\" class=\"edge\">\n",
       "<title>1&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M38.6443,-34.9737C40.5474,-40.9055 42.3812,-47.6657 43.3273,-54 44.4449,-61.482 43.8712,-69.488 42.5297,-77.0109\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"39.0908,-76.3511 40.3114,-86.8754 45.9202,-77.887 39.0908,-76.3511\"/>\n",
       "<text text-anchor=\"middle\" x=\"48.3273\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;1 -->\n",
       "<g id=\"edge3\" class=\"edge\">\n",
       "<title>1&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M48.9914,-25.3828C58.9523,-27.0234 68.3273,-24.5625 68.3273,-18 68.3273,-13.7959 64.4798,-11.2751 59.0956,-10.4375\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"58.9276,-6.9399 48.9914,-10.6172 59.0521,-13.9388 58.9276,-6.9399\"/>\n",
       "<text text-anchor=\"middle\" x=\"72.8273\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "</g>\n",
       "</svg>\n"
      ],
      "text/plain": [
       "<graphviz.dot.Digraph at 0x7f41a068ac70>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "avg epochs 4.01 min epochs 1 max epochs 9 std epochs 3.7838642208268705 avg loss at epoch 0 1.398785378932953 avg loss when fit 0.8564903074502945\n"
     ]
    },
    {
     "data": {
      "image/svg+xml": [
       "<?xml version=\"1.0\" encoding=\"UTF-8\" standalone=\"no\"?>\n",
       "<!DOCTYPE svg PUBLIC \"-//W3C//DTD SVG 1.1//EN\"\n",
       " \"http://www.w3.org/Graphics/SVG/1.1/DTD/svg11.dtd\">\n",
       "<!-- Generated by graphviz version 2.40.1 (20161225.0304)\n",
       " -->\n",
       "<!-- Title: %3 Pages: 1 -->\n",
       "<svg width=\"89pt\" height=\"139pt\"\n",
       " viewBox=\"0.00 0.00 89.00 139.00\" xmlns=\"http://www.w3.org/2000/svg\" xmlns:xlink=\"http://www.w3.org/1999/xlink\">\n",
       "<g id=\"graph0\" class=\"graph\" transform=\"scale(1 1) rotate(0) translate(4 135)\">\n",
       "<title>%3</title>\n",
       "<polygon fill=\"#ffffff\" stroke=\"transparent\" points=\"-4,4 -4,-135 85,-135 85,4 -4,4\"/>\n",
       "<!-- 0 -->\n",
       "<g id=\"node1\" class=\"node\">\n",
       "<title>0</title>\n",
       "<ellipse fill=\"none\" stroke=\"#000000\" cx=\"27\" cy=\"-109\" rx=\"18\" ry=\"18\"/>\n",
       "<ellipse fill=\"none\" stroke=\"#000000\" cx=\"27\" cy=\"-109\" rx=\"22\" ry=\"22\"/>\n",
       "<text text-anchor=\"middle\" x=\"27\" y=\"-105.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;0 -->\n",
       "<g id=\"edge1\" class=\"edge\">\n",
       "<title>0&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M47.5808,-117.3702C57.8447,-118.5284 67,-115.7383 67,-109 67,-104.6833 63.2427,-101.9869 57.8436,-100.9109\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"57.6729,-97.405 47.5808,-100.6298 57.4812,-104.4024 57.6729,-97.405\"/>\n",
       "<text text-anchor=\"middle\" x=\"71.5\" y=\"-105.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 1 -->\n",
       "<g id=\"node2\" class=\"node\">\n",
       "<title>1</title>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"54,-10.5442 54,-25.4558 38.1838,-36 15.8162,-36 0,-25.4558 0,-10.5442 15.8162,0 38.1838,0 54,-10.5442\"/>\n",
       "<text text-anchor=\"middle\" x=\"27\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;1 -->\n",
       "<g id=\"edge2\" class=\"edge\">\n",
       "<title>0&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M17.0266,-89.3001C12.9276,-78.8865 9.6319,-65.8403 12,-54 12.5415,-51.2924 13.2912,-48.5339 14.1689,-45.8093\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"17.5225,-46.8347 17.7658,-36.2427 10.9703,-44.3712 17.5225,-46.8347\"/>\n",
       "<text text-anchor=\"middle\" x=\"17\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;0 -->\n",
       "<g id=\"edge4\" class=\"edge\">\n",
       "<title>1&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M27,-36.1556C27,-47.8111 27,-63.2722 27,-76.9511\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"23.5001,-76.9714 27,-86.9714 30.5001,-76.9715 23.5001,-76.9714\"/>\n",
       "<text text-anchor=\"middle\" x=\"32\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;1 -->\n",
       "<g id=\"edge3\" class=\"edge\">\n",
       "<title>1&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M53.7949,-25.8577C63.7804,-26.1153 72,-23.4961 72,-18 72,-14.5649 68.7892,-12.2537 63.9433,-11.0661\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"64.071,-7.5634 53.7949,-10.1423 63.4363,-14.5346 64.071,-7.5634\"/>\n",
       "<text text-anchor=\"middle\" x=\"76.5\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "</g>\n",
       "</svg>\n"
      ],
      "text/plain": [
       "<graphviz.dot.Digraph at 0x7f41a068ae80>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "avg epochs 5.66 min epochs 1 max epochs 13 std epochs 4.191300675273328 avg loss at epoch 0 1.3994489264488221 avg loss when fit 0.7718555393815041\n"
     ]
    },
    {
     "data": {
      "image/svg+xml": [
       "<?xml version=\"1.0\" encoding=\"UTF-8\" standalone=\"no\"?>\n",
       "<!DOCTYPE svg PUBLIC \"-//W3C//DTD SVG 1.1//EN\"\n",
       " \"http://www.w3.org/Graphics/SVG/1.1/DTD/svg11.dtd\">\n",
       "<!-- Generated by graphviz version 2.40.1 (20161225.0304)\n",
       " -->\n",
       "<!-- Title: %3 Pages: 1 -->\n",
       "<svg width=\"112pt\" height=\"139pt\"\n",
       " viewBox=\"0.00 0.00 112.00 139.00\" xmlns=\"http://www.w3.org/2000/svg\" xmlns:xlink=\"http://www.w3.org/1999/xlink\">\n",
       "<g id=\"graph0\" class=\"graph\" transform=\"scale(1 1) rotate(0) translate(4 135)\">\n",
       "<title>%3</title>\n",
       "<polygon fill=\"#ffffff\" stroke=\"transparent\" points=\"-4,4 -4,-135 108,-135 108,4 -4,4\"/>\n",
       "<!-- 0 -->\n",
       "<g id=\"node1\" class=\"node\">\n",
       "<title>0</title>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"58,-101.5442 58,-116.4558 42.1838,-127 19.8162,-127 4,-116.4558 4,-101.5442 19.8162,-91 42.1838,-91 58,-101.5442\"/>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"62,-99.4034 62,-118.5966 43.3949,-131 18.6051,-131 0,-118.5966 0,-99.4034 18.6051,-87 43.3949,-87 62,-99.4034\"/>\n",
       "<text text-anchor=\"middle\" x=\"31\" y=\"-105.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;0 -->\n",
       "<g id=\"edge2\" class=\"edge\">\n",
       "<title>0&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M62.102,-117.6229C72.0865,-117.5345 80,-114.6602 80,-109 80,-105.4624 76.9088,-103.013 72.1528,-101.6519\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"72.4629,-98.1633 62.102,-100.3771 71.5821,-105.1076 72.4629,-98.1633\"/>\n",
       "<text text-anchor=\"middle\" x=\"85\" y=\"-105.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 1 -->\n",
       "<g id=\"node2\" class=\"node\">\n",
       "<title>1</title>\n",
       "<ellipse fill=\"none\" stroke=\"#000000\" cx=\"31\" cy=\"-18\" rx=\"18\" ry=\"18\"/>\n",
       "<text text-anchor=\"middle\" x=\"31\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;1 -->\n",
       "<g id=\"edge1\" class=\"edge\">\n",
       "<title>0&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M31,-86.9714C31,-74.8075 31,-59.5615 31,-46.499\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"34.5001,-46.1556 31,-36.1556 27.5001,-46.1556 34.5001,-46.1556\"/>\n",
       "<text text-anchor=\"middle\" x=\"35.5\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;1 -->\n",
       "<g id=\"edge3\" class=\"edge\">\n",
       "<title>1&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M48.7817,-21.775C58.3149,-22.4165 67,-21.1582 67,-18 67,-16.0755 63.7749,-14.8564 59.0981,-14.3429\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"58.8211,-10.8396 48.7817,-14.225 58.741,-17.8391 58.8211,-10.8396\"/>\n",
       "<text text-anchor=\"middle\" x=\"71.5\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;1 -->\n",
       "<g id=\"edge4\" class=\"edge\">\n",
       "<title>1&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M48.1418,-24.1447C65.585,-27.7592 85,-25.7109 85,-18 85,-11.7951 72.4283,-9.2569 58.4287,-10.3855\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"57.5461,-6.976 48.1418,-11.8553 58.5363,-13.9056 57.5461,-6.976\"/>\n",
       "<text text-anchor=\"middle\" x=\"90\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "</g>\n",
       "</svg>\n"
      ],
      "text/plain": [
       "<graphviz.dot.Digraph at 0x7f41a068adc0>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "avg epochs 3.73 min epochs 1 max epochs 13 std epochs 3.7453779339100106 avg loss at epoch 0 1.4002061438560487 avg loss when fit 0.7947436776757241\n"
     ]
    },
    {
     "data": {
      "image/svg+xml": [
       "<?xml version=\"1.0\" encoding=\"UTF-8\" standalone=\"no\"?>\n",
       "<!DOCTYPE svg PUBLIC \"-//W3C//DTD SVG 1.1//EN\"\n",
       " \"http://www.w3.org/Graphics/SVG/1.1/DTD/svg11.dtd\">\n",
       "<!-- Generated by graphviz version 2.40.1 (20161225.0304)\n",
       " -->\n",
       "<!-- Title: %3 Pages: 1 -->\n",
       "<svg width=\"88pt\" height=\"139pt\"\n",
       " viewBox=\"0.00 0.00 88.48 139.00\" xmlns=\"http://www.w3.org/2000/svg\" xmlns:xlink=\"http://www.w3.org/1999/xlink\">\n",
       "<g id=\"graph0\" class=\"graph\" transform=\"scale(1 1) rotate(0) translate(4 135)\">\n",
       "<title>%3</title>\n",
       "<polygon fill=\"#ffffff\" stroke=\"transparent\" points=\"-4,4 -4,-135 84.4814,-135 84.4814,4 -4,4\"/>\n",
       "<!-- 0 -->\n",
       "<g id=\"node1\" class=\"node\">\n",
       "<title>0</title>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"76.4814,-101.5442 76.4814,-116.4558 60.6652,-127 38.2976,-127 22.4814,-116.4558 22.4814,-101.5442 38.2976,-91 60.6652,-91 76.4814,-101.5442\"/>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"80.4814,-99.4034 80.4814,-118.5966 61.8763,-131 37.0865,-131 18.4814,-118.5966 18.4814,-99.4034 37.0865,-87 61.8763,-87 80.4814,-99.4034\"/>\n",
       "<text text-anchor=\"middle\" x=\"49.4814\" y=\"-105.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 1 -->\n",
       "<g id=\"node2\" class=\"node\">\n",
       "<title>1</title>\n",
       "<ellipse fill=\"none\" stroke=\"#000000\" cx=\"49.4814\" cy=\"-18\" rx=\"18\" ry=\"18\"/>\n",
       "<text text-anchor=\"middle\" x=\"49.4814\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;1 -->\n",
       "<g id=\"edge1\" class=\"edge\">\n",
       "<title>0&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M24.4817,-95.0681C9.4835,-84.7382 -5.3027,-69.7674 2.4814,-54 7.1416,-44.5604 15.596,-36.9117 24.0627,-31.1317\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"26.0556,-34.0149 32.7318,-25.7882 22.3825,-28.0559 26.0556,-34.0149\"/>\n",
       "<text text-anchor=\"middle\" x=\"6.9814\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;1 -->\n",
       "<g id=\"edge2\" class=\"edge\">\n",
       "<title>0&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M38.6159,-86.954C34.9536,-76.9682 32.288,-64.9668 34.4814,-54 35.1798,-50.5081 36.2243,-46.9315 37.4433,-43.4525\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"40.7371,-44.6417 41.1981,-34.0569 34.237,-42.044 40.7371,-44.6417\"/>\n",
       "<text text-anchor=\"middle\" x=\"39.4814\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;0 -->\n",
       "<g id=\"edge3\" class=\"edge\">\n",
       "<title>1&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M49.4814,-36.1556C49.4814,-47.8111 49.4814,-63.2722 49.4814,-76.9511\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"45.9815,-76.9714 49.4814,-86.9714 52.9815,-76.9715 45.9815,-76.9714\"/>\n",
       "<text text-anchor=\"middle\" x=\"53.9814\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;0 -->\n",
       "<g id=\"edge4\" class=\"edge\">\n",
       "<title>1&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M56.804,-34.5202C59.1015,-40.5295 61.3358,-47.4545 62.4814,-54 63.7955,-61.5083 63.1149,-69.5247 61.5291,-77.0492\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"58.0941,-76.3478 58.9081,-86.9113 64.8593,-78.1458 58.0941,-76.3478\"/>\n",
       "<text text-anchor=\"middle\" x=\"67.4814\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "</g>\n",
       "</svg>\n"
      ],
      "text/plain": [
       "<graphviz.dot.Digraph at 0x7f41a068aa90>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "avg epochs 2.6100000000000003 min epochs 1 max epochs 6 std epochs 2.333379165878933 avg loss at epoch 0 1.401513180732727 avg loss when fit 0.9501019644737244\n"
     ]
    },
    {
     "data": {
      "image/svg+xml": [
       "<?xml version=\"1.0\" encoding=\"UTF-8\" standalone=\"no\"?>\n",
       "<!DOCTYPE svg PUBLIC \"-//W3C//DTD SVG 1.1//EN\"\n",
       " \"http://www.w3.org/Graphics/SVG/1.1/DTD/svg11.dtd\">\n",
       "<!-- Generated by graphviz version 2.40.1 (20161225.0304)\n",
       " -->\n",
       "<!-- Title: %3 Pages: 1 -->\n",
       "<svg width=\"91pt\" height=\"139pt\"\n",
       " viewBox=\"0.00 0.00 90.78 139.00\" xmlns=\"http://www.w3.org/2000/svg\" xmlns:xlink=\"http://www.w3.org/1999/xlink\">\n",
       "<g id=\"graph0\" class=\"graph\" transform=\"scale(1 1) rotate(0) translate(4 135)\">\n",
       "<title>%3</title>\n",
       "<polygon fill=\"#ffffff\" stroke=\"transparent\" points=\"-4,4 -4,-135 86.783,-135 86.783,4 -4,4\"/>\n",
       "<!-- 0 -->\n",
       "<g id=\"node1\" class=\"node\">\n",
       "<title>0</title>\n",
       "<ellipse fill=\"none\" stroke=\"#000000\" cx=\"33.783\" cy=\"-109\" rx=\"18\" ry=\"18\"/>\n",
       "<ellipse fill=\"none\" stroke=\"#000000\" cx=\"33.783\" cy=\"-109\" rx=\"22\" ry=\"22\"/>\n",
       "<text text-anchor=\"middle\" x=\"33.783\" y=\"-105.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;0 -->\n",
       "<g id=\"edge1\" class=\"edge\">\n",
       "<title>0&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M54.3638,-117.3702C64.6277,-118.5284 73.783,-115.7383 73.783,-109 73.783,-104.6833 70.0256,-101.9869 64.6265,-100.9109\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"64.4559,-97.405 54.3638,-100.6298 64.2641,-104.4024 64.4559,-97.405\"/>\n",
       "<text text-anchor=\"middle\" x=\"78.283\" y=\"-105.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 1 -->\n",
       "<g id=\"node2\" class=\"node\">\n",
       "<title>1</title>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"60.783,-10.5442 60.783,-25.4558 44.9667,-36 22.5992,-36 6.783,-25.4558 6.783,-10.5442 22.5992,0 44.9667,0 60.783,-10.5442\"/>\n",
       "<text text-anchor=\"middle\" x=\"33.783\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;1 -->\n",
       "<g id=\"edge2\" class=\"edge\">\n",
       "<title>0&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M17.5898,-93.8165C11.3846,-86.9145 5.021,-78.2311 1.783,-69 -1.783,-58.8344 2.7088,-48.588 9.3483,-39.9734\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"12.1633,-42.0742 16.1792,-32.27 6.9258,-37.4299 12.1633,-42.0742\"/>\n",
       "<text text-anchor=\"middle\" x=\"6.783\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;0 -->\n",
       "<g id=\"edge3\" class=\"edge\">\n",
       "<title>1&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M33.783,-36.1556C33.783,-47.8111 33.783,-63.2722 33.783,-76.9511\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"30.2831,-76.9714 33.783,-86.9714 37.2831,-76.9715 30.2831,-76.9714\"/>\n",
       "<text text-anchor=\"middle\" x=\"38.283\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;0 -->\n",
       "<g id=\"edge4\" class=\"edge\">\n",
       "<title>1&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M39.8444,-36.1134C41.4588,-41.7745 42.977,-48.087 43.783,-54 44.8493,-61.823 44.2281,-70.2281 42.8841,-78.0554\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"39.4443,-77.4047 40.7823,-87.9147 46.2904,-78.8642 39.4443,-77.4047\"/>\n",
       "<text text-anchor=\"middle\" x=\"48.783\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "</g>\n",
       "</svg>\n"
      ],
      "text/plain": [
       "<graphviz.dot.Digraph at 0x7f41a068acd0>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "avg epochs 4.52 min epochs 1 max epochs 13 std epochs 4.195246469366644 avg loss at epoch 0 1.401658388376236 avg loss when fit 0.8417020487785339\n"
     ]
    },
    {
     "data": {
      "image/svg+xml": [
       "<?xml version=\"1.0\" encoding=\"UTF-8\" standalone=\"no\"?>\n",
       "<!DOCTYPE svg PUBLIC \"-//W3C//DTD SVG 1.1//EN\"\n",
       " \"http://www.w3.org/Graphics/SVG/1.1/DTD/svg11.dtd\">\n",
       "<!-- Generated by graphviz version 2.40.1 (20161225.0304)\n",
       " -->\n",
       "<!-- Title: %3 Pages: 1 -->\n",
       "<svg width=\"117pt\" height=\"44pt\"\n",
       " viewBox=\"0.00 0.00 117.00 44.00\" xmlns=\"http://www.w3.org/2000/svg\" xmlns:xlink=\"http://www.w3.org/1999/xlink\">\n",
       "<g id=\"graph0\" class=\"graph\" transform=\"scale(1 1) rotate(0) translate(4 40)\">\n",
       "<title>%3</title>\n",
       "<polygon fill=\"#ffffff\" stroke=\"transparent\" points=\"-4,4 -4,-40 113,-40 113,4 -4,4\"/>\n",
       "<!-- 0 -->\n",
       "<g id=\"node1\" class=\"node\">\n",
       "<title>0</title>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"54,-10.5442 54,-25.4558 38.1838,-36 15.8162,-36 0,-25.4558 0,-10.5442 15.8162,0 38.1838,0 54,-10.5442\"/>\n",
       "<text text-anchor=\"middle\" x=\"27\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;0 -->\n",
       "<g id=\"edge1\" class=\"edge\">\n",
       "<title>0&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M54.2408,-21.3717C64.0239,-21.4442 72,-20.3203 72,-18 72,-16.5861 69.0382,-15.6164 64.5105,-15.091\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"64.3882,-11.582 54.2408,-14.6283 64.0731,-18.5749 64.3882,-11.582\"/>\n",
       "<text text-anchor=\"middle\" x=\"76.5\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;0 -->\n",
       "<g id=\"edge2\" class=\"edge\">\n",
       "<title>0&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M54.1975,-24.1551C72.3402,-25.8876 90,-23.8359 90,-18 90,-13.2583 78.3418,-11.0148 64.2386,-11.2695\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"63.9809,-7.7784 54.1975,-11.8449 64.3814,-14.7669 63.9809,-7.7784\"/>\n",
       "<text text-anchor=\"middle\" x=\"95\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "</g>\n",
       "</svg>\n"
      ],
      "text/plain": [
       "<graphviz.dot.Digraph at 0x7f41a068ad00>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "avg epochs 1.01 min epochs 1 max epochs 2 std epochs 1.099498743710662 avg loss at epoch 0 1.4036058342456819 avg loss when fit 0.9353451192378998\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "Sorted by avg loss when fit\n"
     ]
    },
    {
     "data": {
      "image/svg+xml": [
       "<?xml version=\"1.0\" encoding=\"UTF-8\" standalone=\"no\"?>\n",
       "<!DOCTYPE svg PUBLIC \"-//W3C//DTD SVG 1.1//EN\"\n",
       " \"http://www.w3.org/Graphics/SVG/1.1/DTD/svg11.dtd\">\n",
       "<!-- Generated by graphviz version 2.40.1 (20161225.0304)\n",
       " -->\n",
       "<!-- Title: %3 Pages: 1 -->\n",
       "<svg width=\"99pt\" height=\"139pt\"\n",
       " viewBox=\"0.00 0.00 99.38 139.00\" xmlns=\"http://www.w3.org/2000/svg\" xmlns:xlink=\"http://www.w3.org/1999/xlink\">\n",
       "<g id=\"graph0\" class=\"graph\" transform=\"scale(1 1) rotate(0) translate(4 135)\">\n",
       "<title>%3</title>\n",
       "<polygon fill=\"#ffffff\" stroke=\"transparent\" points=\"-4,4 -4,-135 95.3762,-135 95.3762,4 -4,4\"/>\n",
       "<!-- 0 -->\n",
       "<g id=\"node1\" class=\"node\">\n",
       "<title>0</title>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"60.3762,-101.5442 60.3762,-116.4558 44.56,-127 22.1924,-127 6.3762,-116.4558 6.3762,-101.5442 22.1924,-91 44.56,-91 60.3762,-101.5442\"/>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"64.3762,-99.4034 64.3762,-118.5966 45.7711,-131 20.9813,-131 2.3762,-118.5966 2.3762,-99.4034 20.9813,-87 45.7711,-87 64.3762,-99.4034\"/>\n",
       "<text text-anchor=\"middle\" x=\"33.3762\" y=\"-105.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;0 -->\n",
       "<g id=\"edge1\" class=\"edge\">\n",
       "<title>0&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M64.4782,-117.6229C74.4628,-117.5345 82.3762,-114.6602 82.3762,-109 82.3762,-105.4624 79.285,-103.013 74.529,-101.6519\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"74.8391,-98.1633 64.4782,-100.3771 73.9583,-105.1076 74.8391,-98.1633\"/>\n",
       "<text text-anchor=\"middle\" x=\"86.8762\" y=\"-105.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 1 -->\n",
       "<g id=\"node2\" class=\"node\">\n",
       "<title>1</title>\n",
       "<ellipse fill=\"none\" stroke=\"#000000\" cx=\"33.3762\" cy=\"-18\" rx=\"18\" ry=\"18\"/>\n",
       "<text text-anchor=\"middle\" x=\"33.3762\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;1 -->\n",
       "<g id=\"edge2\" class=\"edge\">\n",
       "<title>0&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M14.8129,-91.0971C9.4087,-84.6953 4.2022,-77.0562 1.3762,-69 -2.6784,-57.4412 3.6846,-45.7778 11.7773,-36.5278\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"14.285,-38.9695 18.7912,-29.3807 9.2889,-34.0665 14.285,-38.9695\"/>\n",
       "<text text-anchor=\"middle\" x=\"6.3762\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;0 -->\n",
       "<g id=\"edge3\" class=\"edge\">\n",
       "<title>1&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M33.3762,-36.1556C33.3762,-47.8111 33.3762,-63.2722 33.3762,-76.9511\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"29.8763,-76.9714 33.3762,-86.9714 36.8763,-76.9715 29.8763,-76.9714\"/>\n",
       "<text text-anchor=\"middle\" x=\"37.8762\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;0 -->\n",
       "<g id=\"edge4\" class=\"edge\">\n",
       "<title>1&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M39.2266,-35.3788C40.9187,-41.2248 42.5352,-47.8299 43.3762,-54 44.3945,-61.4706 43.8739,-69.4721 42.6545,-76.9943\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"39.2116,-76.3615 40.6376,-86.8599 46.0697,-77.7636 39.2116,-76.3615\"/>\n",
       "<text text-anchor=\"middle\" x=\"48.3762\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "</g>\n",
       "</svg>\n"
      ],
      "text/plain": [
       "<graphviz.dot.Digraph at 0x7f41a068ac70>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "avg epochs 6.42 min epochs 1 max epochs 13 std epochs 4.359107024195567 avg loss at epoch 0 1.3848290741443634 avg loss when fit 0.7236772906780243\n"
     ]
    },
    {
     "data": {
      "image/svg+xml": [
       "<?xml version=\"1.0\" encoding=\"UTF-8\" standalone=\"no\"?>\n",
       "<!DOCTYPE svg PUBLIC \"-//W3C//DTD SVG 1.1//EN\"\n",
       " \"http://www.w3.org/Graphics/SVG/1.1/DTD/svg11.dtd\">\n",
       "<!-- Generated by graphviz version 2.40.1 (20161225.0304)\n",
       " -->\n",
       "<!-- Title: %3 Pages: 1 -->\n",
       "<svg width=\"95pt\" height=\"139pt\"\n",
       " viewBox=\"0.00 0.00 94.73 139.00\" xmlns=\"http://www.w3.org/2000/svg\" xmlns:xlink=\"http://www.w3.org/1999/xlink\">\n",
       "<g id=\"graph0\" class=\"graph\" transform=\"scale(1 1) rotate(0) translate(4 135)\">\n",
       "<title>%3</title>\n",
       "<polygon fill=\"#ffffff\" stroke=\"transparent\" points=\"-4,4 -4,-135 90.7285,-135 90.7285,4 -4,4\"/>\n",
       "<!-- 0 -->\n",
       "<g id=\"node1\" class=\"node\">\n",
       "<title>0</title>\n",
       "<ellipse fill=\"none\" stroke=\"#000000\" cx=\"32.7285\" cy=\"-109\" rx=\"18\" ry=\"18\"/>\n",
       "<ellipse fill=\"none\" stroke=\"#000000\" cx=\"32.7285\" cy=\"-109\" rx=\"22\" ry=\"22\"/>\n",
       "<text text-anchor=\"middle\" x=\"32.7285\" y=\"-105.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 1 -->\n",
       "<g id=\"node2\" class=\"node\">\n",
       "<title>1</title>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"59.7285,-10.5442 59.7285,-25.4558 43.9122,-36 21.5447,-36 5.7285,-25.4558 5.7285,-10.5442 21.5447,0 43.9122,0 59.7285,-10.5442\"/>\n",
       "<text text-anchor=\"middle\" x=\"32.7285\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;1 -->\n",
       "<g id=\"edge1\" class=\"edge\">\n",
       "<title>0&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M16.7051,-93.3525C10.7974,-86.4997 4.8001,-77.9778 1.7285,-69 -1.7285,-58.8961 2.6224,-48.6617 9.0548,-40.0395\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"11.8189,-42.1928 15.6727,-32.3237 6.5056,-37.6355 11.8189,-42.1928\"/>\n",
       "<text text-anchor=\"middle\" x=\"6.2285\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;1 -->\n",
       "<g id=\"edge2\" class=\"edge\">\n",
       "<title>0&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M32.7285,-86.9714C32.7285,-74.8075 32.7285,-59.5615 32.7285,-46.499\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"36.2286,-46.1556 32.7285,-36.1556 29.2286,-46.1556 36.2286,-46.1556\"/>\n",
       "<text text-anchor=\"middle\" x=\"37.7285\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;0 -->\n",
       "<g id=\"edge4\" class=\"edge\">\n",
       "<title>1&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M39.394,-36.0722C41.1698,-41.7317 42.8402,-48.0535 43.7285,-54 44.9088,-61.9018 44.2026,-70.3881 42.6979,-78.2726\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"39.2478,-77.6538 40.3515,-88.191 46.0598,-79.2654 39.2478,-77.6538\"/>\n",
       "<text text-anchor=\"middle\" x=\"48.7285\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;1 -->\n",
       "<g id=\"edge3\" class=\"edge\">\n",
       "<title>1&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M59.5233,-25.8577C69.5089,-26.1153 77.7285,-23.4961 77.7285,-18 77.7285,-14.5649 74.5177,-12.2537 69.6717,-11.0661\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"69.7995,-7.5634 59.5233,-10.1423 69.1648,-14.5346 69.7995,-7.5634\"/>\n",
       "<text text-anchor=\"middle\" x=\"82.2285\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "</g>\n",
       "</svg>\n"
      ],
      "text/plain": [
       "<graphviz.dot.Digraph at 0x7f41a068ac40>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "avg epochs 5.87 min epochs 1 max epochs 13 std epochs 4.645970378376655 avg loss at epoch 0 1.3975611889362336 avg loss when fit 0.7624968060851097\n"
     ]
    },
    {
     "data": {
      "image/svg+xml": [
       "<?xml version=\"1.0\" encoding=\"UTF-8\" standalone=\"no\"?>\n",
       "<!DOCTYPE svg PUBLIC \"-//W3C//DTD SVG 1.1//EN\"\n",
       " \"http://www.w3.org/Graphics/SVG/1.1/DTD/svg11.dtd\">\n",
       "<!-- Generated by graphviz version 2.40.1 (20161225.0304)\n",
       " -->\n",
       "<!-- Title: %3 Pages: 1 -->\n",
       "<svg width=\"112pt\" height=\"139pt\"\n",
       " viewBox=\"0.00 0.00 112.00 139.00\" xmlns=\"http://www.w3.org/2000/svg\" xmlns:xlink=\"http://www.w3.org/1999/xlink\">\n",
       "<g id=\"graph0\" class=\"graph\" transform=\"scale(1 1) rotate(0) translate(4 135)\">\n",
       "<title>%3</title>\n",
       "<polygon fill=\"#ffffff\" stroke=\"transparent\" points=\"-4,4 -4,-135 108,-135 108,4 -4,4\"/>\n",
       "<!-- 0 -->\n",
       "<g id=\"node1\" class=\"node\">\n",
       "<title>0</title>\n",
       "<ellipse fill=\"none\" stroke=\"#000000\" cx=\"27\" cy=\"-22\" rx=\"18\" ry=\"18\"/>\n",
       "<ellipse fill=\"none\" stroke=\"#000000\" cx=\"27\" cy=\"-22\" rx=\"22\" ry=\"22\"/>\n",
       "<text text-anchor=\"middle\" x=\"27\" y=\"-18.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;0 -->\n",
       "<g id=\"edge1\" class=\"edge\">\n",
       "<title>0&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M48.8066,-26.2451C58.5625,-26.6494 67,-25.2344 67,-22 67,-19.9785 63.7041,-18.6677 58.8504,-18.0676\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"58.9107,-14.5679 48.8066,-17.7549 58.6928,-21.5645 58.9107,-14.5679\"/>\n",
       "<text text-anchor=\"middle\" x=\"71.5\" y=\"-18.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;0 -->\n",
       "<g id=\"edge2\" class=\"edge\">\n",
       "<title>0&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M47.813,-29.2015C65.8838,-32.4865 85,-30.0859 85,-22 85,-15.4302 72.3803,-12.6136 57.9552,-13.5503\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"57.3106,-10.1032 47.813,-14.7985 58.1656,-17.0508 57.3106,-10.1032\"/>\n",
       "<text text-anchor=\"middle\" x=\"90\" y=\"-18.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 1 -->\n",
       "<g id=\"node2\" class=\"node\">\n",
       "<title>1</title>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"54,-105.5442 54,-120.4558 38.1838,-131 15.8162,-131 0,-120.4558 0,-105.5442 15.8162,-95 38.1838,-95 54,-105.5442\"/>\n",
       "<text text-anchor=\"middle\" x=\"27\" y=\"-109.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;0 -->\n",
       "<g id=\"edge4\" class=\"edge\">\n",
       "<title>1&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M27,-94.5848C27,-83.1105 27,-68.0231 27,-54.5774\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"30.5001,-54.2465 27,-44.2465 23.5001,-54.2466 30.5001,-54.2465\"/>\n",
       "<text text-anchor=\"middle\" x=\"32\" y=\"-65.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;1 -->\n",
       "<g id=\"edge3\" class=\"edge\">\n",
       "<title>1&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M53.7949,-120.8577C63.7804,-121.1153 72,-118.4961 72,-113 72,-109.5649 68.7892,-107.2537 63.9433,-106.0661\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"64.071,-102.5634 53.7949,-105.1423 63.4363,-109.5346 64.071,-102.5634\"/>\n",
       "<text text-anchor=\"middle\" x=\"76.5\" y=\"-109.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "</g>\n",
       "</svg>\n"
      ],
      "text/plain": [
       "<graphviz.dot.Digraph at 0x7f41a068aeb0>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "avg epochs 4.43 min epochs 1 max epochs 13 std epochs 4.027391616557065 avg loss at epoch 0 1.3896378016471862 avg loss when fit 0.7640904745459557\n"
     ]
    },
    {
     "data": {
      "image/svg+xml": [
       "<?xml version=\"1.0\" encoding=\"UTF-8\" standalone=\"no\"?>\n",
       "<!DOCTYPE svg PUBLIC \"-//W3C//DTD SVG 1.1//EN\"\n",
       " \"http://www.w3.org/Graphics/SVG/1.1/DTD/svg11.dtd\">\n",
       "<!-- Generated by graphviz version 2.40.1 (20161225.0304)\n",
       " -->\n",
       "<!-- Title: %3 Pages: 1 -->\n",
       "<svg width=\"89pt\" height=\"139pt\"\n",
       " viewBox=\"0.00 0.00 89.00 139.00\" xmlns=\"http://www.w3.org/2000/svg\" xmlns:xlink=\"http://www.w3.org/1999/xlink\">\n",
       "<g id=\"graph0\" class=\"graph\" transform=\"scale(1 1) rotate(0) translate(4 135)\">\n",
       "<title>%3</title>\n",
       "<polygon fill=\"#ffffff\" stroke=\"transparent\" points=\"-4,4 -4,-135 85,-135 85,4 -4,4\"/>\n",
       "<!-- 0 -->\n",
       "<g id=\"node1\" class=\"node\">\n",
       "<title>0</title>\n",
       "<ellipse fill=\"none\" stroke=\"#000000\" cx=\"27\" cy=\"-109\" rx=\"18\" ry=\"18\"/>\n",
       "<ellipse fill=\"none\" stroke=\"#000000\" cx=\"27\" cy=\"-109\" rx=\"22\" ry=\"22\"/>\n",
       "<text text-anchor=\"middle\" x=\"27\" y=\"-105.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;0 -->\n",
       "<g id=\"edge1\" class=\"edge\">\n",
       "<title>0&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M47.5808,-117.3702C57.8447,-118.5284 67,-115.7383 67,-109 67,-104.6833 63.2427,-101.9869 57.8436,-100.9109\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"57.6729,-97.405 47.5808,-100.6298 57.4812,-104.4024 57.6729,-97.405\"/>\n",
       "<text text-anchor=\"middle\" x=\"71.5\" y=\"-105.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 1 -->\n",
       "<g id=\"node2\" class=\"node\">\n",
       "<title>1</title>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"54,-10.5442 54,-25.4558 38.1838,-36 15.8162,-36 0,-25.4558 0,-10.5442 15.8162,0 38.1838,0 54,-10.5442\"/>\n",
       "<text text-anchor=\"middle\" x=\"27\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;1 -->\n",
       "<g id=\"edge2\" class=\"edge\">\n",
       "<title>0&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M17.0266,-89.3001C12.9276,-78.8865 9.6319,-65.8403 12,-54 12.5415,-51.2924 13.2912,-48.5339 14.1689,-45.8093\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"17.5225,-46.8347 17.7658,-36.2427 10.9703,-44.3712 17.5225,-46.8347\"/>\n",
       "<text text-anchor=\"middle\" x=\"17\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;0 -->\n",
       "<g id=\"edge4\" class=\"edge\">\n",
       "<title>1&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M27,-36.1556C27,-47.8111 27,-63.2722 27,-76.9511\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"23.5001,-76.9714 27,-86.9714 30.5001,-76.9715 23.5001,-76.9714\"/>\n",
       "<text text-anchor=\"middle\" x=\"32\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;1 -->\n",
       "<g id=\"edge3\" class=\"edge\">\n",
       "<title>1&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M53.7949,-25.8577C63.7804,-26.1153 72,-23.4961 72,-18 72,-14.5649 68.7892,-12.2537 63.9433,-11.0661\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"64.071,-7.5634 53.7949,-10.1423 63.4363,-14.5346 64.071,-7.5634\"/>\n",
       "<text text-anchor=\"middle\" x=\"76.5\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "</g>\n",
       "</svg>\n"
      ],
      "text/plain": [
       "<graphviz.dot.Digraph at 0x7f41a068a9a0>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "avg epochs 5.66 min epochs 1 max epochs 13 std epochs 4.191300675273328 avg loss at epoch 0 1.3994489264488221 avg loss when fit 0.7718555393815041\n"
     ]
    },
    {
     "data": {
      "image/svg+xml": [
       "<?xml version=\"1.0\" encoding=\"UTF-8\" standalone=\"no\"?>\n",
       "<!DOCTYPE svg PUBLIC \"-//W3C//DTD SVG 1.1//EN\"\n",
       " \"http://www.w3.org/Graphics/SVG/1.1/DTD/svg11.dtd\">\n",
       "<!-- Generated by graphviz version 2.40.1 (20161225.0304)\n",
       " -->\n",
       "<!-- Title: %3 Pages: 1 -->\n",
       "<svg width=\"98pt\" height=\"139pt\"\n",
       " viewBox=\"0.00 0.00 98.00 139.00\" xmlns=\"http://www.w3.org/2000/svg\" xmlns:xlink=\"http://www.w3.org/1999/xlink\">\n",
       "<g id=\"graph0\" class=\"graph\" transform=\"scale(1 1) rotate(0) translate(4 135)\">\n",
       "<title>%3</title>\n",
       "<polygon fill=\"#ffffff\" stroke=\"transparent\" points=\"-4,4 -4,-135 94,-135 94,4 -4,4\"/>\n",
       "<!-- 0 -->\n",
       "<g id=\"node1\" class=\"node\">\n",
       "<title>0</title>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"58,-101.5442 58,-116.4558 42.1838,-127 19.8162,-127 4,-116.4558 4,-101.5442 19.8162,-91 42.1838,-91 58,-101.5442\"/>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"62,-99.4034 62,-118.5966 43.3949,-131 18.6051,-131 0,-118.5966 0,-99.4034 18.6051,-87 43.3949,-87 62,-99.4034\"/>\n",
       "<text text-anchor=\"middle\" x=\"31\" y=\"-105.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;0 -->\n",
       "<g id=\"edge2\" class=\"edge\">\n",
       "<title>0&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M62.102,-117.6229C72.0865,-117.5345 80,-114.6602 80,-109 80,-105.4624 76.9088,-103.013 72.1528,-101.6519\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"72.4629,-98.1633 62.102,-100.3771 71.5821,-105.1076 72.4629,-98.1633\"/>\n",
       "<text text-anchor=\"middle\" x=\"85\" y=\"-105.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 1 -->\n",
       "<g id=\"node2\" class=\"node\">\n",
       "<title>1</title>\n",
       "<ellipse fill=\"none\" stroke=\"#000000\" cx=\"31\" cy=\"-18\" rx=\"18\" ry=\"18\"/>\n",
       "<text text-anchor=\"middle\" x=\"31\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;1 -->\n",
       "<g id=\"edge1\" class=\"edge\">\n",
       "<title>0&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M20.1345,-86.954C16.4722,-76.9682 13.8066,-64.9668 16,-54 16.6984,-50.5081 17.7429,-46.9315 18.9619,-43.4525\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"22.2557,-44.6417 22.7167,-34.0569 15.7556,-42.044 22.2557,-44.6417\"/>\n",
       "<text text-anchor=\"middle\" x=\"20.5\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;0 -->\n",
       "<g id=\"edge3\" class=\"edge\">\n",
       "<title>1&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M31,-36.1556C31,-47.8111 31,-63.2722 31,-76.9511\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"27.5001,-76.9714 31,-86.9714 34.5001,-76.9715 27.5001,-76.9714\"/>\n",
       "<text text-anchor=\"middle\" x=\"35.5\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;1 -->\n",
       "<g id=\"edge4\" class=\"edge\">\n",
       "<title>1&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M47.6641,-25.3828C57.625,-27.0234 67,-24.5625 67,-18 67,-13.7959 63.1525,-11.2751 57.7682,-10.4375\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"57.6002,-6.9399 47.6641,-10.6172 57.7247,-13.9388 57.6002,-6.9399\"/>\n",
       "<text text-anchor=\"middle\" x=\"72\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "</g>\n",
       "</svg>\n"
      ],
      "text/plain": [
       "<graphviz.dot.Digraph at 0x7f41a068ad30>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "avg epochs 5.38 min epochs 1 max epochs 18 std epochs 4.091213354008422 avg loss at epoch 0 1.3962756979465485 avg loss when fit 0.7864163091778755\n"
     ]
    },
    {
     "data": {
      "image/svg+xml": [
       "<?xml version=\"1.0\" encoding=\"UTF-8\" standalone=\"no\"?>\n",
       "<!DOCTYPE svg PUBLIC \"-//W3C//DTD SVG 1.1//EN\"\n",
       " \"http://www.w3.org/Graphics/SVG/1.1/DTD/svg11.dtd\">\n",
       "<!-- Generated by graphviz version 2.40.1 (20161225.0304)\n",
       " -->\n",
       "<!-- Title: %3 Pages: 1 -->\n",
       "<svg width=\"112pt\" height=\"139pt\"\n",
       " viewBox=\"0.00 0.00 112.00 139.00\" xmlns=\"http://www.w3.org/2000/svg\" xmlns:xlink=\"http://www.w3.org/1999/xlink\">\n",
       "<g id=\"graph0\" class=\"graph\" transform=\"scale(1 1) rotate(0) translate(4 135)\">\n",
       "<title>%3</title>\n",
       "<polygon fill=\"#ffffff\" stroke=\"transparent\" points=\"-4,4 -4,-135 108,-135 108,4 -4,4\"/>\n",
       "<!-- 0 -->\n",
       "<g id=\"node1\" class=\"node\">\n",
       "<title>0</title>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"58,-101.5442 58,-116.4558 42.1838,-127 19.8162,-127 4,-116.4558 4,-101.5442 19.8162,-91 42.1838,-91 58,-101.5442\"/>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"62,-99.4034 62,-118.5966 43.3949,-131 18.6051,-131 0,-118.5966 0,-99.4034 18.6051,-87 43.3949,-87 62,-99.4034\"/>\n",
       "<text text-anchor=\"middle\" x=\"31\" y=\"-105.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;0 -->\n",
       "<g id=\"edge2\" class=\"edge\">\n",
       "<title>0&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M62.102,-117.6229C72.0865,-117.5345 80,-114.6602 80,-109 80,-105.4624 76.9088,-103.013 72.1528,-101.6519\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"72.4629,-98.1633 62.102,-100.3771 71.5821,-105.1076 72.4629,-98.1633\"/>\n",
       "<text text-anchor=\"middle\" x=\"85\" y=\"-105.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 1 -->\n",
       "<g id=\"node2\" class=\"node\">\n",
       "<title>1</title>\n",
       "<ellipse fill=\"none\" stroke=\"#000000\" cx=\"31\" cy=\"-18\" rx=\"18\" ry=\"18\"/>\n",
       "<text text-anchor=\"middle\" x=\"31\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;1 -->\n",
       "<g id=\"edge1\" class=\"edge\">\n",
       "<title>0&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M31,-86.9714C31,-74.8075 31,-59.5615 31,-46.499\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"34.5001,-46.1556 31,-36.1556 27.5001,-46.1556 34.5001,-46.1556\"/>\n",
       "<text text-anchor=\"middle\" x=\"35.5\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;1 -->\n",
       "<g id=\"edge3\" class=\"edge\">\n",
       "<title>1&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M48.7817,-21.775C58.3149,-22.4165 67,-21.1582 67,-18 67,-16.0755 63.7749,-14.8564 59.0981,-14.3429\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"58.8211,-10.8396 48.7817,-14.225 58.741,-17.8391 58.8211,-10.8396\"/>\n",
       "<text text-anchor=\"middle\" x=\"71.5\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;1 -->\n",
       "<g id=\"edge4\" class=\"edge\">\n",
       "<title>1&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M48.1418,-24.1447C65.585,-27.7592 85,-25.7109 85,-18 85,-11.7951 72.4283,-9.2569 58.4287,-10.3855\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"57.5461,-6.976 48.1418,-11.8553 58.5363,-13.9056 57.5461,-6.976\"/>\n",
       "<text text-anchor=\"middle\" x=\"90\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "</g>\n",
       "</svg>\n"
      ],
      "text/plain": [
       "<graphviz.dot.Digraph at 0x7f41a068ae20>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "avg epochs 3.73 min epochs 1 max epochs 13 std epochs 3.7453779339100106 avg loss at epoch 0 1.4002061438560487 avg loss when fit 0.7947436776757241\n"
     ]
    },
    {
     "data": {
      "image/svg+xml": [
       "<?xml version=\"1.0\" encoding=\"UTF-8\" standalone=\"no\"?>\n",
       "<!DOCTYPE svg PUBLIC \"-//W3C//DTD SVG 1.1//EN\"\n",
       " \"http://www.w3.org/Graphics/SVG/1.1/DTD/svg11.dtd\">\n",
       "<!-- Generated by graphviz version 2.40.1 (20161225.0304)\n",
       " -->\n",
       "<!-- Title: %3 Pages: 1 -->\n",
       "<svg width=\"91pt\" height=\"139pt\"\n",
       " viewBox=\"0.00 0.00 90.78 139.00\" xmlns=\"http://www.w3.org/2000/svg\" xmlns:xlink=\"http://www.w3.org/1999/xlink\">\n",
       "<g id=\"graph0\" class=\"graph\" transform=\"scale(1 1) rotate(0) translate(4 135)\">\n",
       "<title>%3</title>\n",
       "<polygon fill=\"#ffffff\" stroke=\"transparent\" points=\"-4,4 -4,-135 86.783,-135 86.783,4 -4,4\"/>\n",
       "<!-- 0 -->\n",
       "<g id=\"node1\" class=\"node\">\n",
       "<title>0</title>\n",
       "<ellipse fill=\"none\" stroke=\"#000000\" cx=\"33.783\" cy=\"-109\" rx=\"18\" ry=\"18\"/>\n",
       "<ellipse fill=\"none\" stroke=\"#000000\" cx=\"33.783\" cy=\"-109\" rx=\"22\" ry=\"22\"/>\n",
       "<text text-anchor=\"middle\" x=\"33.783\" y=\"-105.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;0 -->\n",
       "<g id=\"edge1\" class=\"edge\">\n",
       "<title>0&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M54.3638,-117.3702C64.6277,-118.5284 73.783,-115.7383 73.783,-109 73.783,-104.6833 70.0256,-101.9869 64.6265,-100.9109\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"64.4559,-97.405 54.3638,-100.6298 64.2641,-104.4024 64.4559,-97.405\"/>\n",
       "<text text-anchor=\"middle\" x=\"78.283\" y=\"-105.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 1 -->\n",
       "<g id=\"node2\" class=\"node\">\n",
       "<title>1</title>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"60.783,-10.5442 60.783,-25.4558 44.9667,-36 22.5992,-36 6.783,-25.4558 6.783,-10.5442 22.5992,0 44.9667,0 60.783,-10.5442\"/>\n",
       "<text text-anchor=\"middle\" x=\"33.783\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;1 -->\n",
       "<g id=\"edge2\" class=\"edge\">\n",
       "<title>0&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M17.5898,-93.8165C11.3846,-86.9145 5.021,-78.2311 1.783,-69 -1.783,-58.8344 2.7088,-48.588 9.3483,-39.9734\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"12.1633,-42.0742 16.1792,-32.27 6.9258,-37.4299 12.1633,-42.0742\"/>\n",
       "<text text-anchor=\"middle\" x=\"6.783\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;0 -->\n",
       "<g id=\"edge3\" class=\"edge\">\n",
       "<title>1&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M33.783,-36.1556C33.783,-47.8111 33.783,-63.2722 33.783,-76.9511\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"30.2831,-76.9714 33.783,-86.9714 37.2831,-76.9715 30.2831,-76.9714\"/>\n",
       "<text text-anchor=\"middle\" x=\"38.283\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;0 -->\n",
       "<g id=\"edge4\" class=\"edge\">\n",
       "<title>1&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M39.8444,-36.1134C41.4588,-41.7745 42.977,-48.087 43.783,-54 44.8493,-61.823 44.2281,-70.2281 42.8841,-78.0554\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"39.4443,-77.4047 40.7823,-87.9147 46.2904,-78.8642 39.4443,-77.4047\"/>\n",
       "<text text-anchor=\"middle\" x=\"48.783\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "</g>\n",
       "</svg>\n"
      ],
      "text/plain": [
       "<graphviz.dot.Digraph at 0x7f41a068aca0>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "avg epochs 4.52 min epochs 1 max epochs 13 std epochs 4.195246469366644 avg loss at epoch 0 1.401658388376236 avg loss when fit 0.8417020487785339\n"
     ]
    },
    {
     "data": {
      "image/svg+xml": [
       "<?xml version=\"1.0\" encoding=\"UTF-8\" standalone=\"no\"?>\n",
       "<!DOCTYPE svg PUBLIC \"-//W3C//DTD SVG 1.1//EN\"\n",
       " \"http://www.w3.org/Graphics/SVG/1.1/DTD/svg11.dtd\">\n",
       "<!-- Generated by graphviz version 2.40.1 (20161225.0304)\n",
       " -->\n",
       "<!-- Title: %3 Pages: 1 -->\n",
       "<svg width=\"85pt\" height=\"139pt\"\n",
       " viewBox=\"0.00 0.00 85.33 139.00\" xmlns=\"http://www.w3.org/2000/svg\" xmlns:xlink=\"http://www.w3.org/1999/xlink\">\n",
       "<g id=\"graph0\" class=\"graph\" transform=\"scale(1 1) rotate(0) translate(4 135)\">\n",
       "<title>%3</title>\n",
       "<polygon fill=\"#ffffff\" stroke=\"transparent\" points=\"-4,4 -4,-135 81.3273,-135 81.3273,4 -4,4\"/>\n",
       "<!-- 0 -->\n",
       "<g id=\"node1\" class=\"node\">\n",
       "<title>0</title>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"59.3273,-101.5442 59.3273,-116.4558 43.5111,-127 21.1436,-127 5.3273,-116.4558 5.3273,-101.5442 21.1436,-91 43.5111,-91 59.3273,-101.5442\"/>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"63.3273,-99.4034 63.3273,-118.5966 44.7222,-131 19.9325,-131 1.3273,-118.5966 1.3273,-99.4034 19.9325,-87 44.7222,-87 63.3273,-99.4034\"/>\n",
       "<text text-anchor=\"middle\" x=\"32.3273\" y=\"-105.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 1 -->\n",
       "<g id=\"node2\" class=\"node\">\n",
       "<title>1</title>\n",
       "<ellipse fill=\"none\" stroke=\"#000000\" cx=\"32.3273\" cy=\"-18\" rx=\"18\" ry=\"18\"/>\n",
       "<text text-anchor=\"middle\" x=\"32.3273\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;1 -->\n",
       "<g id=\"edge1\" class=\"edge\">\n",
       "<title>0&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M14.0086,-90.606C8.8906,-84.2826 4.0008,-76.814 1.3273,-69 -2.5641,-57.6263 3.4383,-46.0871 11.1662,-36.8684\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"13.8732,-39.0996 18.1963,-29.4269 8.7848,-34.2925 13.8732,-39.0996\"/>\n",
       "<text text-anchor=\"middle\" x=\"5.8273\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;1 -->\n",
       "<g id=\"edge2\" class=\"edge\">\n",
       "<title>0&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M32.3273,-86.9714C32.3273,-74.8075 32.3273,-59.5615 32.3273,-46.499\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"35.8274,-46.1556 32.3273,-36.1556 28.8274,-46.1556 35.8274,-46.1556\"/>\n",
       "<text text-anchor=\"middle\" x=\"37.3273\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;0 -->\n",
       "<g id=\"edge4\" class=\"edge\">\n",
       "<title>1&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M38.6443,-34.9737C40.5474,-40.9055 42.3812,-47.6657 43.3273,-54 44.4449,-61.482 43.8712,-69.488 42.5297,-77.0109\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"39.0908,-76.3511 40.3114,-86.8754 45.9202,-77.887 39.0908,-76.3511\"/>\n",
       "<text text-anchor=\"middle\" x=\"48.3273\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;1 -->\n",
       "<g id=\"edge3\" class=\"edge\">\n",
       "<title>1&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M48.9914,-25.3828C58.9523,-27.0234 68.3273,-24.5625 68.3273,-18 68.3273,-13.7959 64.4798,-11.2751 59.0956,-10.4375\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"58.9276,-6.9399 48.9914,-10.6172 59.0521,-13.9388 58.9276,-6.9399\"/>\n",
       "<text text-anchor=\"middle\" x=\"72.8273\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "</g>\n",
       "</svg>\n"
      ],
      "text/plain": [
       "<graphviz.dot.Digraph at 0x7f41a068aac0>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "avg epochs 4.01 min epochs 1 max epochs 9 std epochs 3.7838642208268705 avg loss at epoch 0 1.398785378932953 avg loss when fit 0.8564903074502945\n"
     ]
    },
    {
     "data": {
      "image/svg+xml": [
       "<?xml version=\"1.0\" encoding=\"UTF-8\" standalone=\"no\"?>\n",
       "<!DOCTYPE svg PUBLIC \"-//W3C//DTD SVG 1.1//EN\"\n",
       " \"http://www.w3.org/Graphics/SVG/1.1/DTD/svg11.dtd\">\n",
       "<!-- Generated by graphviz version 2.40.1 (20161225.0304)\n",
       " -->\n",
       "<!-- Title: %3 Pages: 1 -->\n",
       "<svg width=\"112pt\" height=\"139pt\"\n",
       " viewBox=\"0.00 0.00 112.00 139.00\" xmlns=\"http://www.w3.org/2000/svg\" xmlns:xlink=\"http://www.w3.org/1999/xlink\">\n",
       "<g id=\"graph0\" class=\"graph\" transform=\"scale(1 1) rotate(0) translate(4 135)\">\n",
       "<title>%3</title>\n",
       "<polygon fill=\"#ffffff\" stroke=\"transparent\" points=\"-4,4 -4,-135 108,-135 108,4 -4,4\"/>\n",
       "<!-- 0 -->\n",
       "<g id=\"node1\" class=\"node\">\n",
       "<title>0</title>\n",
       "<ellipse fill=\"none\" stroke=\"#000000\" cx=\"27\" cy=\"-22\" rx=\"18\" ry=\"18\"/>\n",
       "<ellipse fill=\"none\" stroke=\"#000000\" cx=\"27\" cy=\"-22\" rx=\"22\" ry=\"22\"/>\n",
       "<text text-anchor=\"middle\" x=\"27\" y=\"-18.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;0 -->\n",
       "<g id=\"edge1\" class=\"edge\">\n",
       "<title>0&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M48.8066,-26.2451C58.5625,-26.6494 67,-25.2344 67,-22 67,-19.9785 63.7041,-18.6677 58.8504,-18.0676\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"58.9107,-14.5679 48.8066,-17.7549 58.6928,-21.5645 58.9107,-14.5679\"/>\n",
       "<text text-anchor=\"middle\" x=\"71.5\" y=\"-18.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;0 -->\n",
       "<g id=\"edge2\" class=\"edge\">\n",
       "<title>0&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M47.813,-29.2015C65.8838,-32.4865 85,-30.0859 85,-22 85,-15.4302 72.3803,-12.6136 57.9552,-13.5503\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"57.3106,-10.1032 47.813,-14.7985 58.1656,-17.0508 57.3106,-10.1032\"/>\n",
       "<text text-anchor=\"middle\" x=\"90\" y=\"-18.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 1 -->\n",
       "<g id=\"node2\" class=\"node\">\n",
       "<title>1</title>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"54,-105.5442 54,-120.4558 38.1838,-131 15.8162,-131 0,-120.4558 0,-105.5442 15.8162,-95 38.1838,-95 54,-105.5442\"/>\n",
       "<text text-anchor=\"middle\" x=\"27\" y=\"-109.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;0 -->\n",
       "<g id=\"edge3\" class=\"edge\">\n",
       "<title>1&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M17.7658,-94.7573C15.4038,-89.1988 13.1951,-82.9754 12,-77 10.3165,-68.5823 11.4955,-59.5551 13.7908,-51.2977\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"17.1484,-52.2941 17.0266,-41.6999 10.5152,-50.0577 17.1484,-52.2941\"/>\n",
       "<text text-anchor=\"middle\" x=\"16.5\" y=\"-65.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;0 -->\n",
       "<g id=\"edge4\" class=\"edge\">\n",
       "<title>1&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M27,-94.5848C27,-83.1105 27,-68.0231 27,-54.5774\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"30.5001,-54.2465 27,-44.2465 23.5001,-54.2466 30.5001,-54.2465\"/>\n",
       "<text text-anchor=\"middle\" x=\"32\" y=\"-65.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "</g>\n",
       "</svg>\n"
      ],
      "text/plain": [
       "<graphviz.dot.Digraph at 0x7f41a068adf0>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "avg epochs 1.9300000000000002 min epochs 1 max epochs 6 std epochs 2.2021231218140676 avg loss at epoch 0 1.3965786254405976 avg loss when fit 0.8911880993843079\n"
     ]
    },
    {
     "data": {
      "image/svg+xml": [
       "<?xml version=\"1.0\" encoding=\"UTF-8\" standalone=\"no\"?>\n",
       "<!DOCTYPE svg PUBLIC \"-//W3C//DTD SVG 1.1//EN\"\n",
       " \"http://www.w3.org/Graphics/SVG/1.1/DTD/svg11.dtd\">\n",
       "<!-- Generated by graphviz version 2.40.1 (20161225.0304)\n",
       " -->\n",
       "<!-- Title: %3 Pages: 1 -->\n",
       "<svg width=\"112pt\" height=\"139pt\"\n",
       " viewBox=\"0.00 0.00 112.00 139.00\" xmlns=\"http://www.w3.org/2000/svg\" xmlns:xlink=\"http://www.w3.org/1999/xlink\">\n",
       "<g id=\"graph0\" class=\"graph\" transform=\"scale(1 1) rotate(0) translate(4 135)\">\n",
       "<title>%3</title>\n",
       "<polygon fill=\"#ffffff\" stroke=\"transparent\" points=\"-4,4 -4,-135 108,-135 108,4 -4,4\"/>\n",
       "<!-- 0 -->\n",
       "<g id=\"node1\" class=\"node\">\n",
       "<title>0</title>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"58,-101.5442 58,-116.4558 42.1838,-127 19.8162,-127 4,-116.4558 4,-101.5442 19.8162,-91 42.1838,-91 58,-101.5442\"/>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"62,-99.4034 62,-118.5966 43.3949,-131 18.6051,-131 0,-118.5966 0,-99.4034 18.6051,-87 43.3949,-87 62,-99.4034\"/>\n",
       "<text text-anchor=\"middle\" x=\"31\" y=\"-105.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 1 -->\n",
       "<g id=\"node2\" class=\"node\">\n",
       "<title>1</title>\n",
       "<ellipse fill=\"none\" stroke=\"#000000\" cx=\"31\" cy=\"-18\" rx=\"18\" ry=\"18\"/>\n",
       "<text text-anchor=\"middle\" x=\"31\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;1 -->\n",
       "<g id=\"edge1\" class=\"edge\">\n",
       "<title>0&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M20.1345,-86.954C16.4722,-76.9682 13.8066,-64.9668 16,-54 16.6984,-50.5081 17.7429,-46.9315 18.9619,-43.4525\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"22.2557,-44.6417 22.7167,-34.0569 15.7556,-42.044 22.2557,-44.6417\"/>\n",
       "<text text-anchor=\"middle\" x=\"20.5\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;1 -->\n",
       "<g id=\"edge2\" class=\"edge\">\n",
       "<title>0&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M31,-86.9714C31,-74.8075 31,-59.5615 31,-46.499\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"34.5001,-46.1556 31,-36.1556 27.5001,-46.1556 34.5001,-46.1556\"/>\n",
       "<text text-anchor=\"middle\" x=\"36\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;1 -->\n",
       "<g id=\"edge3\" class=\"edge\">\n",
       "<title>1&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M48.7817,-21.775C58.3149,-22.4165 67,-21.1582 67,-18 67,-16.0755 63.7749,-14.8564 59.0981,-14.3429\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"58.8211,-10.8396 48.7817,-14.225 58.741,-17.8391 58.8211,-10.8396\"/>\n",
       "<text text-anchor=\"middle\" x=\"71.5\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;1 -->\n",
       "<g id=\"edge4\" class=\"edge\">\n",
       "<title>1&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M48.1418,-24.1447C65.585,-27.7592 85,-25.7109 85,-18 85,-11.7951 72.4283,-9.2569 58.4287,-10.3855\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"57.5461,-6.976 48.1418,-11.8553 58.5363,-13.9056 57.5461,-6.976\"/>\n",
       "<text text-anchor=\"middle\" x=\"90\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "</g>\n",
       "</svg>\n"
      ],
      "text/plain": [
       "<graphviz.dot.Digraph at 0x7f41a068abe0>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "avg epochs 2.0 min epochs 1 max epochs 8 std epochs 2.3490737563232043 avg loss at epoch 0 1.3975653278827667 avg loss when fit 0.8985250204801559\n"
     ]
    },
    {
     "data": {
      "image/svg+xml": [
       "<?xml version=\"1.0\" encoding=\"UTF-8\" standalone=\"no\"?>\n",
       "<!DOCTYPE svg PUBLIC \"-//W3C//DTD SVG 1.1//EN\"\n",
       " \"http://www.w3.org/Graphics/SVG/1.1/DTD/svg11.dtd\">\n",
       "<!-- Generated by graphviz version 2.40.1 (20161225.0304)\n",
       " -->\n",
       "<!-- Title: %3 Pages: 1 -->\n",
       "<svg width=\"125pt\" height=\"52pt\"\n",
       " viewBox=\"0.00 0.00 125.00 52.00\" xmlns=\"http://www.w3.org/2000/svg\" xmlns:xlink=\"http://www.w3.org/1999/xlink\">\n",
       "<g id=\"graph0\" class=\"graph\" transform=\"scale(1 1) rotate(0) translate(4 48)\">\n",
       "<title>%3</title>\n",
       "<polygon fill=\"#ffffff\" stroke=\"transparent\" points=\"-4,4 -4,-48 121,-48 121,4 -4,4\"/>\n",
       "<!-- 0 -->\n",
       "<g id=\"node1\" class=\"node\">\n",
       "<title>0</title>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"58,-14.5442 58,-29.4558 42.1838,-40 19.8162,-40 4,-29.4558 4,-14.5442 19.8162,-4 42.1838,-4 58,-14.5442\"/>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"62,-12.4034 62,-31.5966 43.3949,-44 18.6051,-44 0,-31.5966 0,-12.4034 18.6051,0 43.3949,0 62,-12.4034\"/>\n",
       "<text text-anchor=\"middle\" x=\"31\" y=\"-18.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;0 -->\n",
       "<g id=\"edge1\" class=\"edge\">\n",
       "<title>0&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M62.102,-25.9365C72.0865,-25.8962 80,-24.584 80,-22 80,-20.385 76.9088,-19.2668 72.1528,-18.6454\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"72.2876,-15.1475 62.102,-18.0635 71.8829,-22.1358 72.2876,-15.1475\"/>\n",
       "<text text-anchor=\"middle\" x=\"84.5\" y=\"-18.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;0 -->\n",
       "<g id=\"edge2\" class=\"edge\">\n",
       "<title>0&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M62.0137,-29.3828C80.5521,-31.0234 98,-28.5625 98,-22 98,-16.668 86.4816,-14.0436 72.2187,-14.1269\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"71.8342,-10.6413 62.0137,-14.6172 72.1701,-17.6332 71.8342,-10.6413\"/>\n",
       "<text text-anchor=\"middle\" x=\"103\" y=\"-18.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "</g>\n",
       "</svg>\n"
      ],
      "text/plain": [
       "<graphviz.dot.Digraph at 0x7f41a068aac0>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "avg epochs 1.02 min epochs 1 max epochs 3 std epochs 1.198997487421324 avg loss at epoch 0 1.3925223922729493 avg loss when fit 0.9185943812131881\n"
     ]
    },
    {
     "data": {
      "image/svg+xml": [
       "<?xml version=\"1.0\" encoding=\"UTF-8\" standalone=\"no\"?>\n",
       "<!DOCTYPE svg PUBLIC \"-//W3C//DTD SVG 1.1//EN\"\n",
       " \"http://www.w3.org/Graphics/SVG/1.1/DTD/svg11.dtd\">\n",
       "<!-- Generated by graphviz version 2.40.1 (20161225.0304)\n",
       " -->\n",
       "<!-- Title: %3 Pages: 1 -->\n",
       "<svg width=\"117pt\" height=\"44pt\"\n",
       " viewBox=\"0.00 0.00 117.00 44.00\" xmlns=\"http://www.w3.org/2000/svg\" xmlns:xlink=\"http://www.w3.org/1999/xlink\">\n",
       "<g id=\"graph0\" class=\"graph\" transform=\"scale(1 1) rotate(0) translate(4 40)\">\n",
       "<title>%3</title>\n",
       "<polygon fill=\"#ffffff\" stroke=\"transparent\" points=\"-4,4 -4,-40 113,-40 113,4 -4,4\"/>\n",
       "<!-- 0 -->\n",
       "<g id=\"node1\" class=\"node\">\n",
       "<title>0</title>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"54,-10.5442 54,-25.4558 38.1838,-36 15.8162,-36 0,-25.4558 0,-10.5442 15.8162,0 38.1838,0 54,-10.5442\"/>\n",
       "<text text-anchor=\"middle\" x=\"27\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;0 -->\n",
       "<g id=\"edge1\" class=\"edge\">\n",
       "<title>0&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M54.2408,-21.3717C64.0239,-21.4442 72,-20.3203 72,-18 72,-16.5861 69.0382,-15.6164 64.5105,-15.091\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"64.3882,-11.582 54.2408,-14.6283 64.0731,-18.5749 64.3882,-11.582\"/>\n",
       "<text text-anchor=\"middle\" x=\"76.5\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;0 -->\n",
       "<g id=\"edge2\" class=\"edge\">\n",
       "<title>0&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M54.1975,-24.1551C72.3402,-25.8876 90,-23.8359 90,-18 90,-13.2583 78.3418,-11.0148 64.2386,-11.2695\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"63.9809,-7.7784 54.1975,-11.8449 64.3814,-14.7669 63.9809,-7.7784\"/>\n",
       "<text text-anchor=\"middle\" x=\"95\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "</g>\n",
       "</svg>\n"
      ],
      "text/plain": [
       "<graphviz.dot.Digraph at 0x7f41a068ac40>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "avg epochs 1.01 min epochs 1 max epochs 2 std epochs 1.099498743710662 avg loss at epoch 0 1.4036058342456819 avg loss when fit 0.9353451192378998\n"
     ]
    },
    {
     "data": {
      "image/svg+xml": [
       "<?xml version=\"1.0\" encoding=\"UTF-8\" standalone=\"no\"?>\n",
       "<!DOCTYPE svg PUBLIC \"-//W3C//DTD SVG 1.1//EN\"\n",
       " \"http://www.w3.org/Graphics/SVG/1.1/DTD/svg11.dtd\">\n",
       "<!-- Generated by graphviz version 2.40.1 (20161225.0304)\n",
       " -->\n",
       "<!-- Title: %3 Pages: 1 -->\n",
       "<svg width=\"88pt\" height=\"139pt\"\n",
       " viewBox=\"0.00 0.00 88.48 139.00\" xmlns=\"http://www.w3.org/2000/svg\" xmlns:xlink=\"http://www.w3.org/1999/xlink\">\n",
       "<g id=\"graph0\" class=\"graph\" transform=\"scale(1 1) rotate(0) translate(4 135)\">\n",
       "<title>%3</title>\n",
       "<polygon fill=\"#ffffff\" stroke=\"transparent\" points=\"-4,4 -4,-135 84.4814,-135 84.4814,4 -4,4\"/>\n",
       "<!-- 0 -->\n",
       "<g id=\"node1\" class=\"node\">\n",
       "<title>0</title>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"76.4814,-101.5442 76.4814,-116.4558 60.6652,-127 38.2976,-127 22.4814,-116.4558 22.4814,-101.5442 38.2976,-91 60.6652,-91 76.4814,-101.5442\"/>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"80.4814,-99.4034 80.4814,-118.5966 61.8763,-131 37.0865,-131 18.4814,-118.5966 18.4814,-99.4034 37.0865,-87 61.8763,-87 80.4814,-99.4034\"/>\n",
       "<text text-anchor=\"middle\" x=\"49.4814\" y=\"-105.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 1 -->\n",
       "<g id=\"node2\" class=\"node\">\n",
       "<title>1</title>\n",
       "<ellipse fill=\"none\" stroke=\"#000000\" cx=\"49.4814\" cy=\"-18\" rx=\"18\" ry=\"18\"/>\n",
       "<text text-anchor=\"middle\" x=\"49.4814\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;1 -->\n",
       "<g id=\"edge1\" class=\"edge\">\n",
       "<title>0&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M24.4817,-95.0681C9.4835,-84.7382 -5.3027,-69.7674 2.4814,-54 7.1416,-44.5604 15.596,-36.9117 24.0627,-31.1317\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"26.0556,-34.0149 32.7318,-25.7882 22.3825,-28.0559 26.0556,-34.0149\"/>\n",
       "<text text-anchor=\"middle\" x=\"6.9814\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;1 -->\n",
       "<g id=\"edge2\" class=\"edge\">\n",
       "<title>0&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M38.6159,-86.954C34.9536,-76.9682 32.288,-64.9668 34.4814,-54 35.1798,-50.5081 36.2243,-46.9315 37.4433,-43.4525\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"40.7371,-44.6417 41.1981,-34.0569 34.237,-42.044 40.7371,-44.6417\"/>\n",
       "<text text-anchor=\"middle\" x=\"39.4814\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;0 -->\n",
       "<g id=\"edge3\" class=\"edge\">\n",
       "<title>1&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M49.4814,-36.1556C49.4814,-47.8111 49.4814,-63.2722 49.4814,-76.9511\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"45.9815,-76.9714 49.4814,-86.9714 52.9815,-76.9715 45.9815,-76.9714\"/>\n",
       "<text text-anchor=\"middle\" x=\"53.9814\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;0 -->\n",
       "<g id=\"edge4\" class=\"edge\">\n",
       "<title>1&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M56.804,-34.5202C59.1015,-40.5295 61.3358,-47.4545 62.4814,-54 63.7955,-61.5083 63.1149,-69.5247 61.5291,-77.0492\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"58.0941,-76.3478 58.9081,-86.9113 64.8593,-78.1458 58.0941,-76.3478\"/>\n",
       "<text text-anchor=\"middle\" x=\"67.4814\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "</g>\n",
       "</svg>\n"
      ],
      "text/plain": [
       "<graphviz.dot.Digraph at 0x7f41a068a9a0>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "avg epochs 2.6100000000000003 min epochs 1 max epochs 6 std epochs 2.333379165878933 avg loss at epoch 0 1.401513180732727 avg loss when fit 0.9501019644737244\n"
     ]
    },
    {
     "data": {
      "image/svg+xml": [
       "<?xml version=\"1.0\" encoding=\"UTF-8\" standalone=\"no\"?>\n",
       "<!DOCTYPE svg PUBLIC \"-//W3C//DTD SVG 1.1//EN\"\n",
       " \"http://www.w3.org/Graphics/SVG/1.1/DTD/svg11.dtd\">\n",
       "<!-- Generated by graphviz version 2.40.1 (20161225.0304)\n",
       " -->\n",
       "<!-- Title: %3 Pages: 1 -->\n",
       "<svg width=\"85pt\" height=\"139pt\"\n",
       " viewBox=\"0.00 0.00 84.59 139.00\" xmlns=\"http://www.w3.org/2000/svg\" xmlns:xlink=\"http://www.w3.org/1999/xlink\">\n",
       "<g id=\"graph0\" class=\"graph\" transform=\"scale(1 1) rotate(0) translate(4 135)\">\n",
       "<title>%3</title>\n",
       "<polygon fill=\"#ffffff\" stroke=\"transparent\" points=\"-4,4 -4,-135 80.5906,-135 80.5906,4 -4,4\"/>\n",
       "<!-- 0 -->\n",
       "<g id=\"node1\" class=\"node\">\n",
       "<title>0</title>\n",
       "<ellipse fill=\"none\" stroke=\"#000000\" cx=\"49.5906\" cy=\"-109\" rx=\"18\" ry=\"18\"/>\n",
       "<ellipse fill=\"none\" stroke=\"#000000\" cx=\"49.5906\" cy=\"-109\" rx=\"22\" ry=\"22\"/>\n",
       "<text text-anchor=\"middle\" x=\"49.5906\" y=\"-105.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 1 -->\n",
       "<g id=\"node2\" class=\"node\">\n",
       "<title>1</title>\n",
       "<polygon fill=\"none\" stroke=\"#000000\" points=\"76.5906,-10.5442 76.5906,-25.4558 60.7744,-36 38.4069,-36 22.5906,-25.4558 22.5906,-10.5442 38.4069,0 60.7744,0 76.5906,-10.5442\"/>\n",
       "<text text-anchor=\"middle\" x=\"49.5906\" y=\"-14.3\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;1 -->\n",
       "<g id=\"edge1\" class=\"edge\">\n",
       "<title>0&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M30.0239,-98.6189C13.5164,-88.3622 -6.1387,-71.682 2.5906,-54 6.3017,-46.4829 12.4189,-40.1015 19.0324,-34.8951\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"21.3556,-37.5406 27.5311,-28.9317 17.3348,-31.8105 21.3556,-37.5406\"/>\n",
       "<text text-anchor=\"middle\" x=\"7.0906\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 0&#45;&gt;1 -->\n",
       "<g id=\"edge2\" class=\"edge\">\n",
       "<title>0&#45;&gt;1</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M39.6172,-89.3001C35.5182,-78.8865 32.2226,-65.8403 34.5906,-54 35.1321,-51.2924 35.8818,-48.5339 36.7595,-45.8093\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"40.1132,-46.8347 40.3564,-36.2427 33.561,-44.3712 40.1132,-46.8347\"/>\n",
       "<text text-anchor=\"middle\" x=\"39.5906\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;0 -->\n",
       "<g id=\"edge3\" class=\"edge\">\n",
       "<title>1&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M49.5906,-36.1556C49.5906,-47.8111 49.5906,-63.2722 49.5906,-76.9511\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"46.0907,-76.9714 49.5906,-86.9714 53.0907,-76.9715 46.0907,-76.9714\"/>\n",
       "<text text-anchor=\"middle\" x=\"54.0906\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">a</text>\n",
       "</g>\n",
       "<!-- 1&#45;&gt;0 -->\n",
       "<g id=\"edge4\" class=\"edge\">\n",
       "<title>1&#45;&gt;0</title>\n",
       "<path fill=\"none\" stroke=\"#000000\" d=\"M57.5995,-36.3492C59.6467,-41.9107 61.5596,-48.109 62.5906,-54 64.0179,-62.1547 63.0922,-70.9086 61.2094,-78.9809\"/>\n",
       "<polygon fill=\"#000000\" stroke=\"#000000\" points=\"57.8017,-78.1679 58.4179,-88.7448 64.532,-80.0922 57.8017,-78.1679\"/>\n",
       "<text text-anchor=\"middle\" x=\"67.5906\" y=\"-57.8\" font-family=\"Times,serif\" font-size=\"14.00\" fill=\"#000000\">b</text>\n",
       "</g>\n",
       "</g>\n",
       "</svg>\n"
      ],
      "text/plain": [
       "<graphviz.dot.Digraph at 0x7f41a068ad30>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "avg epochs 2.6100000000000003 min epochs 1 max epochs 6 std epochs 2.4205280708243677 avg loss at epoch 0 1.387124490737915 avg loss when fit 0.9513023608922958\n"
     ]
    }
   ],
   "source": [
    "import cloudpickle\n",
    "from IPython.display import display\n",
    "import numpy as np\n",
    "def analysis():\n",
    "    f = open(\"resultRunsWithAutomata.json\", \"rb\")\n",
    "    runsDict = cloudpickle.load(f)\n",
    "    f.close() \n",
    "    analyzedData = []\n",
    "    for _, (a, aDat) in runsDict.items():\n",
    "        avgNumEpochs = np.mean([epochs for (epochs, losses) in aDat])+1 # epochs are zero indexed for reasons\n",
    "        minNumEpochs = np.min([epochs for (epochs, losses) in aDat])+1 # epochs are zero indexed for reasons\n",
    "        maxNumEpochs = np.max([epochs for (epochs, losses) in aDat])+1 # epochs are zero indexed for reasons\n",
    "        stdNumEpochs = np.std([epochs for (epochs, losses) in aDat])+1 # epochs are zero indexed for reasons\n",
    "        avgLoss0 = np.mean([losses[0] for (epochs, losses) in aDat])\n",
    "        avgLossWhenFit = np.mean([losses[-1] for (epochs, losses) in aDat])\n",
    "        analyzedData.append((a, (avgNumEpochs, minNumEpochs, maxNumEpochs, stdNumEpochs, avgLoss0, avgLossWhenFit)))\n",
    "    dataLabels = ['avg epochs', 'min epochs', 'max epochs', 'std epochs', 'avg loss at epoch 0', 'avg loss when fit']\n",
    "    def displayData():\n",
    "        for a, data in analyzedData:\n",
    "            display(a.toDot())\n",
    "            print(\" \".join([(dataLabels[j] + \" \" + str(val)) for (j, val) in enumerate(data)]))\n",
    "    for i, label in enumerate(dataLabels):\n",
    "        analyzedData.sort(key=lambda x: x[1][i])\n",
    "        print(\"\\n\\n\\n\\n\\n\\n\\n\\nSorted by \" + label)\n",
    "        displayData()\n",
    "analysis()\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": []
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python 3",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.8.5"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 4
}

Note that n_embd=64, lr=5e-4. Smaller embedding sizes probably would work fine, this is a really easy task.

These are all possible 2 and 1 state DFAs on two letters. The Octagons represent start state. The double circle for a's is if you want to read that as a traditional "accepting DFA", but how they actually work is they initially output a symbol of their start state, then they receive a character, hop to that state and emit another symbol, receive another character and hop to a new state and emit a symbol, etc.

I created a dataset of all possible "binary strings" of a's and b's of length 8 as inputs, then held out a random 20% of them for a test set. This doesn't actually model a test set very well as 4 characters already probably enough to get full info about what the automata is doing, but that's okay, I mostly just wanted to see how hard it was for the network to learn various automata. It also doesn't seem like 5-10 gradient steps (which is all these need) would be enough to memorize.

I used a GPT type model (instead of a seq2seq), framing the task as "given the tuple (past symbol emitted, cur character to process), predict the next symbol the automata will output." To encode tuples, I just represented the tuple (i,j) as the character i+j*alphabetSize, but there are better ways to do this that I want to look at. Because this means it can output invalid characters, I take the mod of alphabetSize (mod 2) for the outputs.

My batch size was big enough that the entire dataset fit into a single batch, so one epoch was a single gradient descent step. For testing to see if they modeled the DFA properly, I decoded a single symbol y_1 given the pair of (initialStateOutput, firstCharacter), then appended (y_1, secondCharacter) to the sequence and decoded y_2, etc. I used argmax for decoding from probabilities. I stopped training runs once it had the correct output for every possible length 8 sequence, "epochs" refers to how many epochs/gradient steps it took for that to happen.

The "avg" values are over 100 runs