Skip to content

Instantly share code, notes, and snippets.

Show Gist options
  • Save cordon-thiago/07b8be9adb10aa49ca3b3b90394661f5 to your computer and use it in GitHub Desktop.
Save cordon-thiago/07b8be9adb10aa49ca3b3b90394661f5 to your computer and use it in GitHub Desktop.
{
"cells": [
{
"cell_type": "markdown",
"metadata": {},
"source": [
"# XGBoost with imbalanced dataset evaluation"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"### Probability Thresholds"
]
},
{
"cell_type": "code",
"execution_count": 10,
"metadata": {},
"outputs": [
{
"data": {
"text/plain": [
"(0, 1)"
]
},
"execution_count": 10,
"metadata": {},
"output_type": "execute_result"
},
{
"data": {
"image/png": "iVBORw0KGgoAAAANSUhEUgAAAYUAAAEWCAYAAACJ0YulAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADl0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uIDMuMC4zLCBodHRwOi8vbWF0cGxvdGxpYi5vcmcvnQurowAAIABJREFUeJzt3XeYVOX1wPHvoS9IkSIdbIginRVBRDGIGFGMBkREsRCJEtGIxvLT2KJiQSNGDHYUCcUa7IoCxoICSpGOiLCASpEOLrDn98e5yw7LllmY2bszcz7Ps8+Ue3fm3JndOXPfcl5RVZxzzjmAUmEH4JxzruTwpOCcc24vTwrOOef28qTgnHNuL08Kzjnn9vKk4Jxzbi9PCm4fIjJPRLoUsk8jEdkqIqWLKay4E5HlInJ6cP0uEXk5xFiK5flF5HARUREpcwC/20VEMgrYPkpE7j2I2FREjj7Q33cHzpNCggg+tHYEH8Y/i8gLInJIrJ9HVY9X1SmF7LNCVQ9R1T2xfv7gA3FXcJwbReQLEekY6+cJU3Bs2T9ZEe/rVhHpF3Z8xUFE6orIcyKyRkS2iMhCEblbRCrF6fn2Jn1XME8KieUcVT0EaAucANyeewcxif6+jg+OsyYwGXgl5HhiKkiohwTHuILgfQ1+xhTlsQ7kW37YRKQ68CWQBnRU1cpAN6AacFSMnyvhXp+wJfqHR0pS1VXAe0BzABGZIiL3icjnwHbgSBGpGvFNbJWI3BvZ3CMiV4rIguBb2nwRaRvcH9mM0l5EZojI5uDs5NHg/n2aHUSknohMFJENIrJURK6MeJ67RGSCiLwUPNc8EUmP8jh3A2OA+iJSK+IxzxaRWRFnEi0jtjUUkddFZK2IrBeRJ4L7jxKRT4L71onIGBGpVtTXPnjNzo64XSZ4vLYiUkFEXg6eY6OITBeR2kV9jkC5/F6z4D26WUTmANuCGOqJyGvBcf8gItdG7J/n+xihn4isCI7jtojfKy8ij4nI6uDnMREpn8/r0kZEvgniHQ9UKODYhgBbgItVdTmAqq5U1etUdU7EfqeLyBIR+VVERoiIBM9V4HuZx+szFmgEvCV2NnZTga98ivOkkIBEpCFwFvBtxN2XAAOBysCPwIvAbuBooA1wBvCn4Pd7A3cB/YEqQE9gfR5PNRwYrqpVsG9wE/IJaSyQAdQDegH3i0jXiO09gXHYN8GJwBNRHme5IMb1wK/BfW2B54E/AzWAp4CJwQdYaeDt4PgPB+oHzwsgwNAgxuOAhsFrUFRjgb4Rt7sD61T1G+BSoGrw2DWAq4AdB/AcUPhr1hfoEWzPAt4CZmPH3BX4q4h0D/Yt7H08GWga/N4dInJccP9tQAegNdAKaE/eZ6flgDeB0UB17MzujwUc2+nA66qaVcA+AGdjZ8StgAuw1xqiey/3vj6q2pd9z8geKuR5U5uq+k8C/ADLga3ARuxD70kgLdg2BbgnYt/awG/Z24P7+gKTg+sfANcV8DynB9c/Be4Gauba53BAgTLYP+QeoHLE9qHAqOD6XcCkiG3NgB0FHOddQGZwnHuwhNAlYvu/gX/k+p1FwKlAR2AtUCaK1/MPwLf5HPddwMv5/N7R2LfcisHtMcAdwfUrgC+AlkV8X0/P4zXI9zULfueKiNsnAityPcatwAtRvo8NIu77GrgwuP49cFbEtu7A8uB6FyAjuH4KsBqQiH2/AO7N55iXAFcV8roocHLE7QnALUV4L6/Itc9+r7P/5P3jZwqJ5Q+qWk1VG6vqIFWN/Ba6MuJ6Y6AssCZoxtiIfaM+LNjeEPuHL8wA4BhgYdAUcnYe+9QDNqjqloj7fsS+sWb7KeL6dqBC0OTRT3I6WN+L2GeCqlbDktt3QLtcx3ZD9nEFx9YwiKMh8KNas9M+ROQwERkn1pS2GXgZ67MoElVdCiwAzhGRitg3+v8Em0djCXdc0NzykIiULepzBPJ8zSLuy/1+18v1mvwf9vpB4e9j7ufKHsBQD3svs/0Y3JdbPWCVBp++EfvmZz1Qt4DtBcYV5Xu5EndAPCkkj8h/yJXYmULNIIlUU9Uqqnp8xPZCO/RUdYnaqfdhwIPAq7L/6JDVQHURqRxxXyNgVRSPP0ZzOlh/n8f2dVgz0V0ikv0hshK4L+K4qqlqRVUdG2xrJHl3Lg7FXqOWas0oF2PNEAciuwnpXGB+kChQ1V2qereqNgNOwpo/+h/gcxQm9/v9Q67XpLKqnhXEFc37mJfVWMLJ1ii4L7c1WL+P5No3P5OA8+TAB0RE817mLv/s5aCj5EkhCanqGuBD4BERqSIipYLOuVODXZ4FbhSRdmKOFpHGuR9HRC4WkVpqbb8bg7v3GYaqqiuxpoKhQUdrS+ybaZFG0RRwLAuxb9/ZnYPPAFeJyIlB7JVEpEeQlL7GPqAeCO6vICKdgt+rTND8JiL1gb8dRFjjsD6aq8k5S0BEThORFkHfxmZgF7lerzj5GtgcdK6miUhpEWkuIicEcRX6PuZjLHC7iNQSkZrAHdi38ty+xPqvrg3OAM/H+h/y8yjWl/Vi9t+diNQXkUclYtBAAQ7kvfwZODKK/VKeJ4Xk1R8oB8zHOmlfJThlV9VXgPuwD7QtWCdh9Twe40xgnohsxTorL1TVnXns1xdrn14NvAHcqaofxfBYHgYGishhqjoDuBLreP0VWApcBqA2b+IcrN1/Bdb53Sd4jLuxobybgHeA1w80mCDpfomdDYyP2FQHe503Y01MU8n7QzSmIo67NfADsA5L/FWDXaJ9H3O7F5gBzAHmAt8E9+V+/kzgfOx9+BV7zfN9fVV1A/ba7QK+EpEtwMfYe7M0irgO5L0ciiW4jSJyYxT7pyzZtxnQOedcKvMzBeecc3vFLSmIyPMi8ouIfJfPdhGRx8UmO80Jxp8755wLUTzPFEZhbZn5+T3QJPgZiI0/d845F6K4JQVV/RTYUMAu5wIvqZkGVIsYduiccy4EYRaLqs++E0wygvvW5N5RRAZiZxNUqlSp3bHHHlv0Z/vtN/jxR6hdG6pWLXx/51xCWbcOVqwAEahWDY44wu7/7jvYnWs646GHQuNgEPacOZCVZT/Z427q1YO6dSEzE+bO3f+5GjaEww6DHTtg/vz9tzduDDVrwrZtsHDh/tuPPNJi2LwZlizZf3uTJlClCmzcCN9/nxPzkQcxqHbmzJnrVLVWYfuFmRTymjiU51AoVX0aeBogPT1dZ8yYUfRn27bN/kqWLoW//Q0efND+epxzCSf7wzv7X/j//g+GDrXrJ54IAwbAn/5kt2+/HbZs2ff309Phkkvs+g03wK5dUKECXHAB1KljH8hVqlgy+ekn9lO1KlSubL/388/7bz/0UKhUyb6Lrl27//bq1aFiRdi505JZbjVrWjw7dsD6oCpZWhrUqFHw61IQESlolnnOfvEckioihwNvq2rzPLY9BUwJZqIiIouwGjf7nSlEOuCkALB6NVx9NUycaF8FBg6EO++0bePGQZ8+niicC9maNfbdrVQpaN3aPly//hreftv+hT/+GJYvh6OPhgkToE0b22/NGrs/LS3sIyiZRGSmqhZaoTjMM4WJwDUiMg4r6LWpsIRw0OrVsw//UaNg6lS7DfDll9C3r13efHPO/c65YvXCC3DVVdZsAzB7NrRsCTNmwH332Tfo9u3h0kuhdGlrwgF4/3045BBPCLEQtzOFoIZ5F6xQ1c/AnViRNlR1ZFAn5QlshNJ24PJgtmqBDupMIT9ZWXa+OWqU3T7ySDjpJPsLLeNrdDhXHBYtgmOPhebN4ZFH7KS9QwdrpsnMtCRQOmkWgC1+oZ8pBAW4CtquwF/i9fxFUqqUJYDBg2HKFPj8c7s/OyFs2GCNgM65uMluW7/xRjjjjH23lStX/PGkqoQrcxGXM4WCLFwIrVrBFVfA/fdbD5JzLmb+/W/45z/h22+tY9cHB8ZHtGcKXuaiMJUrW0J49lno3Dnv8WfOuQOyZQsMGmTDMtPSPCGUBJ4UClO/vn2V+eADG/rQogUMGRJ2VM4lvF27bOQQwIUXWiuuC5+/DdH63e9gwQIb1Fynjt23Ywf07g1vvZUzXMI5F5Vu3WxiVoMG8J//FL6/Kx4+tKYoateGhyLW/M7IgMmT4dVX7by3c2frIevXzzumnSvE7bfbnNKvvvLpQSWJnykcjCZNbMbMxInQq5edSVx7rZXTcM7la+ZMm6k7fbo3G5U0Pvoo1hYtgqZNrcF0xgzo2DHsiJwrcbLPDBLs4yeh+eijsDRtapd3320T4AYMsPn527aFG5dzJUTLYBXmfv3CjcPlzZNCvNx2m83XHzcOzjnH5uP//vd5V9dyLkVs2pRTdfT++8ONxeXNk0K8pKXZUNa1a2HSJJvr8Ic/2MglVXjiiZyauM6liDVrbC7oAw9Ao0ZhR+Py4n0KYZgzx/4zwIq9nHmm1fFt6yuSuuS3fbuVjXbFy/sUSrKWLW1m9C232CDt4cOtwPua+BaJdS5sQ4faEFRXcnlSCMtxx9l/yEcfWTIYPtyWegJbAGjp0nDjcy7Gvv/eFsOZNCnsSFxBPCmUBLVrW4VWsFIat94Kxx9vs6Xfe8+GtzqX4EaOtMvOncONwxXMk0JJU6+ezZT+05+sjPdZZ9nKIn7m4BLcc8/ZZffu4cbhCuZJoSSqVw9GjLDk8OabViQme5Xxv//dvmpt3x5ujM4Vwa5d8OuvUL68l7Qo6TwplGTly8O551ptpbJl7b6ff4bPPoPrrgs3NueKoGxZq3U0b17YkbjCeFJINE89ZQv9vPQSjB4Ne/aEHZFzhcrIsLJgRx0VdiSuMJ4UEo2I9S+0agX9+8Ojj4YdkXMFysqChg2tFdSVfJ4UElH16vDFF9Zzd9VVdt8rr9gA8ASbjOiS38yZdumrqiUGTwqJqkwZK51RubL14t1/P3ToYJ3QCxaEHZ1zgH1Had/erj/xRLixuOh4UkgGZcvaKKWHH4bZs6FZM5vjsHp12JG5FPfzzznXmzcPLw4XPU8KyaJxY7jxRhuZdMkl8M03UK6cbfvkE1sy1Llilj3a6IILfChqovDlOJNNq1Y2MinbqlX2H7l+vdVc6tXLqrW2aBFejC5lfPaZXV52WahhuCLwM4VkV7++fV174AFrZrrjDkscs2aFHZlLAW3bwqWXWiFglxg8KaSC2rXh5pttedDVq615qUkT2/bNNzZm0LkYysqCiy6CZ5+1QXLedJQ4vPko1dStCy++aNczMqBdO0sQ118PF19so5mcO0ilS+dcL+VfPROKv12prHp1eP55qFABBg2y5HDPPbBjR9iRuSSxYoWfJSQaTwqprGJFuPxyG8b6/vvQpo0V4tu8OezIXAKLXGW2YcPw4nAHxpOCs69y3bvb2g0LF1ofxJYt8O23YUfmElD//nb52mvhxuEOjCcFt69DD7XLESNshvSUKaGG4xLLpElWgaVFCzj//LCjcQfCk4LL28UX2+I+PXrA1KlhR+MSxEUX2eUjj4QbhztwnhRc3ho0sCGsjRrZIPPJk8OOyJVwWVmwdq1d94qoicuTgstf3brw6adQpw7cdptXYHUF2rkTevbMWXbTJSafp+AKVqsWvPOOJQQfW+gKsGEDPPMMHHZY2JG4gxHXMwUROVNEFonIUhG5JY/tjURksoh8KyJzROSseMbjDlCzZnD88ZYY/GzB5aNhQxu45hJb3JKCiJQGRgC/B5oBfUWkWa7dbgcmqGob4ELgyXjF4w7SvHnQujV8/XXYkbgS6Morw47AxUo8zxTaA0tVdZmqZgLjgHNz7aNAleB6VcAXACipGjaEZcvgzju9VpLbz7PP2uXixeHG4Q5ePJNCfWBlxO2M4L5IdwEXi0gG8C4wOK8HEpGBIjJDRGaszR7e4IpXlSpWafWDD+C66zwxuL0i/xSy6yy6xBXPpJBXr2TuBum+wChVbQCcBYwWkf1iUtWnVTVdVdNr1aoVh1BdVAYNsjWhn3gC+vTxGkkOsIJ3WVn+PSFZxDMpZACRlU8asH/z0ABgAoCqfglUAGrGMSZ3METgySdh6FBbm6F8+bAjciEbM8b+LEqV8sFpySKeSWE60EREjhCRclhH8sRc+6wAugKIyHFYUvD2oZJMBG65xT4NSpWy9Rg2bgw7KheCrVtt4rtLLnFLCqq6G7gG+ABYgI0ymici94hIz2C3G4ArRWQ2MBa4TNXHPCYEERueet11cMYZsHRp2BG5YqIKAwbAq6/a7aOP9pHKyUQS7TM4PT1dZ8yYEXYYLtubb9p6i5mZ8NRTOSUyXVJ64gkYHAwH+egj6NTJluPwpqOST0Rmqmp6Yft5mQt3cP7wB1iwAE44wZJD//6wfXvYUbk42LYtJyGArb+cluYJIdl4UnAHr149+OQTm8OwapV3QCeZ7AonbdrY7cGD7b7q1cONy8WH1z5ysVGmDNx1F+zZYwv0LlgA48dbIb2yZcOOzh2gX37JKV2xZInVRzz55HBjcvHlZwoutrJXbP/gA7j7bjjtNPjpp3BjcgckM3PfWkY7dkDnzt5clOw8Kbj4+Otf4emnYdo0a3yeNy/siFwRffhhzvXMTOtQdsnPk4KLnyuvhP/9D3bvtjaHJUvCjsgVIisLqlWDli3trOD++63/wFsAU4cnBRdfHTtaYrj8cjjqqLCjcYUYNgw2bYK5c6FqVbj11rAjcsXNk4KLv6ZN4dFHbQb03Lk2I3rnzrCjcrn8/DPcfLNd37073FhceDwpuOL10Ufw4IO2iO+6dWFH4yIcc4xdvv12zngBl3o8KbjiNWSIDVWdPh1OOQXWrAk7opSUlQVdu9pIouxJ6G++aVNNevQINzYXLp+n4IrfBRfYWMcePWwm9IwZUKdO2FGljJNPhs8/z7n9/feWJE47zX5cavMzBReOU0+FKVOgQwfr0XRxs2wZ9OxpZwWLF1sXD8D111tFks8/t+4e58AL4rmSYsMG63yuVy/sSJLGe+9B3742mijbzz/bJLRDD7XF9FzqiLYgnjcfufCpWlPSDz/AZ59ZLWZ3wL74wrpqKlTISQgdO1qJijL+H+8K4SeNLnwiMHKkfYJlj4l0RfbKK/ZSdupkE8jPPBN++81y7hdfeEJw0fGk4EqGVq2s9Pa774YdScLZvh26dLH++2xnnWXDSsuVCy0sl6A8KbiSo1Ej61eIbAR3eVK1M4Nt22xNg6lTrTtm/nzbll5oy7FzefOk4EqOLl2gZk37ZHP5WrwY2re3M4MRI6zJ6NdfbSmL444LOzqX6LyV0ZUcJ50EP/4IFSuGHUmJ9cYbcP75dr15c6s5CFbEzrlY8DMFV7JUrGhjJjMzw46kxHnrrZyEMGKElZE69NBwY3LJx5OCK1mmT4dKlWzFtgSbQxMvM2fCc89BgwYwbpx1LA8aFHZULlnl23wkInOBvP4rBVBVbRm3qFzqOuEEGDDAajivWgXPPpvSzUkvvgiXXWbXs7Jy1kl2Ll4K6lM4u9iicC7SU09Bw4a25nPFipYYUkxmJlx0Ebz2ms08fvddXwbTFY98k4Kq/licgTi3V6lScMcdNsP55Zfh3ntTrmDeDTdYQujWDSZO9KUwXfEpqPloCwU3H3nlFBdfd95pxXtScC3IypWhXbt910l2rjh4QTznSoB162D4cPjuO3j9dWsqUvUmIxc70RbEi3r0kYgcJiKNsn8OLjznojR7Nvz970k7Eumbb+CPf4QmTayVbPVqm4gGnhBcOApNCiLSU0SWAD8AU4HlwHtxjss58/bb9mk5Z07YkcREVpblObA8166dnRk0bWpnCV99BdWrhxujS23RnCn8A+gALFbVI4CuwOcF/4pzMZK9FFiCL9v5yy/w6KPQtq2VsQY7E3jqKZulPG0aHH98uDE6B9GVudilqutFpJSIlFLVySLyYNwjcw6gVi27/DExB8PNmAHnnQcZGXa7ZUvrO8g2cGA4cTmXn2jOFDaKyCHAp8AYERkO7I5vWM4FjjrKqqc+8ICVv0gwmzfD1q1w7bXWPDR7dk69IudKomjOFM4FdgDXA/2AqsA98QzKub1KlYLHH4fHHrOkkJYWdkQF+vlnm2j20UcweDD87ne20qh3GrtEEc2ZwmFAOVXdraovAs8AleMblnMRzj4bPv64xPbA7t4No0dbX0GjRnDFFTB5MixbZts9IbhEEk1SeAXIiri9J7jPueJRurSdMaxfD2ecEXqn85YtNqnspZdywuvf35bA7N7dOo1Xr4Z+/UIN07kDEk1SKKOqe+sYB9ejWuRPRM4UkUUislREbslnnwtEZL6IzBOR/0QXtktJGRnwySdw++3F/tRTp0LXrnDssVaLqHt3uPVW2yZi/eAbN1pJihNP9LMDl7iiSQprRaRn9g0RORdYV9gviUhpYATwe6AZ0FdEmuXapwlwK9BJVY8H/lqE2F2qadXKigI9/zwMGWLtNnGyYYM9zbrgL/311y0f7dhhVb0//BAWLcrZv1EjO5lxLtEVWuZCRI4CxgD1sVpIGUB/VV1ayO91BO5S1e7B7VsBVHVoxD4PYfMfoi6D6WUuUtzu3daDO3Kkje985x1baCAGVK3p57HHrBjdnj3w3/9Cz57WcnXIIVC+fEyeyrliF22Zi0JHH6nq90CHYFiqqOqWKGOoD6yMuJ0BnJhrn2OCYD8HSmNJ5P3cDyQiA4GBAI0aeYWNlFamDPz73zasZ/RoqFs3Jg+7bZvNk5s+HapWhcsvhwsvtKcBqFEjJk/jXIkXTZmL2iLyHPCKqm4RkWYiMiCKx86rVTX3aUkZoAnQBegLPCsi+602q6pPq2q6qqbXyp7M5FJb797WgF+6tJXYvvfeA3qY7CagSpWgdWtb5jIjA555xvoQvG/ApZpoWkFHAR8A9YLbi4mu7T8DaBhxuwGwOo99/ququ1T1B2ARliSci97IkVY07403ov6Vp5+GZs2s43jBgpz7Bg2yZiLnUlU0SaGmqk4gGJaqqruxYamFmQ40EZEjRKQccCEwMdc+bwKnAYhITaw5aVmUsTtn/u//bObzwIGwdm2Bu44dC506wZ//bMmgXz848shiitO5BBBNUtgmIjUImn5EpAOwqbBfCpLHNdhZxgJggqrOE5F7IkYzfQCsF5H5wGTgb6q6/gCOw6WyqlVteNDmzdCrl/UQYxVJ334bnnxy710MGWKdyUOG2JKXL7/sncfORYpm9FFb4F9Ac+A7oBbQW1Vnxz+8/fnoI5evJ5+Ev/yFxVf/k0ez/so77+QUovvpJ6hdG7791pqMSni1DOdiLpajj74RkVOBpljn8SJV3RWDGJ2Lrauv5vNd7Tn5r+lUrgz90hdx5LVN6dEjp9hqmzbhhuhcSRdNQbzspqB5ACLSTURuUtVucY3MuSjs3g1jxsDOnfDnPwuH90pnVDW44OTVpDVrCW2ugaOHQqmoJuE7l/Ly7VMQkd+JyGIR2SoiLwdDUWcADwD/Lr4QndvfN9/An/4EderAZZfBuHE2+ax+fbj0Ukird6hNNHj0UVvr8okn4Lffwg7buRKvoI7mR7AJYzWAV4FpwGhVbaeqrxdHcM7lpgqjRtkyls89Z6uVvfaalaDYZ05BWprtOHEiNGxos6D79AkpaucSR0HNR6qqU4Lrb4rIWlUdXsD+zsVNZiYsXGiVLerUgXvusYVrqlYt4JdE4Jxz7OfGG60Et3OuQAUlhWoicn7EbYm87WcLrrhMn25NQps2wcqVcOaZ9lMkw4blXP/tNx+H6lw+CkoKU4Fz8rmtgCcFF3cbNkD79nZ9/PgYPOCQIfDCCzBlilVddc7tI9+koKqXF2cgzuWlf3+7fOYZuOCCGDzgFVfAU0/BH/8Ic+f6hAXncvEK8K7E2rTJKmO3bw8DoinBGI3mza3WxfffW6Zxzu3Dk4IrUVStZWftWutE/uILmDQpxtVKe/a0VXGefBJ2+TxM5yJ5UnAlygMP2LoGw4Nxbh07QuXKcXiiv/0N0tNh+/Y4PLhziavQ2kf7/YJIOrBGVVfFJ6SCee2j5DVvnrXugC16U7FinJ9Q1X58HU2XAqKtfXQg/w2DgbdFJBZjQZwDYOtWOOssuz5tWjEkBLAyqqNH23Ro5xwQZe2jSKp6KYCIxOOk3qWI336Dt96CHTvgkkssKaxcCTfdBCfmXrQ1XkTg8cdh+XJbdu3YY4vpiZ0ruaI6UxCR+iJykoickv1ThLWanQOspWbyZKs2ccghtqLmt9/atjp1YP58ePDBYgyoVCl48UXrbB440AJ0LsUVeqYgIg8CfYD55Ky4psCncYzLJQnVnJFD11xjA35q1YIuXeDqq+EPf8jZN5Qv6s2bw9ChFtyIEXbpXAqLZpGdRUBLVS0RJSa9o7nkW7sWPvoIZs6Ed9+1s4M6dWDCBFi/3iakVaoUdpQR9uyBrl1hzhxYscIXaXZJKWaL7GBrJpcFSkRScCXX1Kn27X/BArtdpoyth7x5syWFmMxIjofSpS17zZhhCSH7i1JMJ0c4lxiiSQrbgVki8jERiUFVr41bVC4h/PADjBwJxxxjM47btLHrl1wCp5xiM5HLlg07yihVrGhBg63BsHAh/OtfUKFCuHE5V8yiSQoTgx/n2LgRPvjAKkW89ZZ9mb7+ettWpQq8+Wa48cXE6tXw7LNWnnX8eGjaNOyInCs2UU1eE5FywDHBzVDXaPY+hfBkZdkM46+/tuagSy6xNQ0aNAg7sjh45x2r1711q50OXXqpNye5hBZtn0I0Hc1dgBeB5YAADYFLVTWU0UeeFMKRlWUjOFeutGH9J51kTfFJbeVKSwaffQZLl1q9JOcSVCxnND8CnKGqp6rqKUB34J8HG6BLDKrw9ts2p2DzZlvZsnPnFEgIYAf74Yc2fKpRI3sxxozxInouqUWTFMqq6qLsG6q6GBuN5JLYnj3wyiu2FvI559jn4vz5YUcVguwhVAAffwwXX2yL84waBVt8/qZLPtEkhRki8pyIdAl+ngFmxjswF56dO+2z8IILrDDdXXdZk1GHDmFHFrLTT4fXXrO+hcsvh7p14Z//9JnQLqlEkxSuBuYB1wLXYTObr4pnUK54bd5sNeHuu89ub9hgZwhjx9rZwZ132sgiB5x/Pnz3nfUzdOwIL73kHdAuqRS5dHbYvKM5NhZO+zPdAAAb7klEQVQtgjfegPfes4Vsdu+2UUQrVvhnXNRU7QVr3Bh++cWalh580CZsOFfCHHRHs4hMCC7nisic3D+xDNbF16+/2rLEf/4z/Pij3fff/8Ktt9pZwo032mpnP/zgCaFIRCwhgI1OmjnTSrz+61/epOQSVr5nCiJSV1XXiEjjvLar6o9xjSwffqYQHVVr/v7qKytCl73A2Jtvwrnnwrp1Noimbt1w40wqGzbARRfZ7L4zzoDnnkvSSRwuER30mYKqrgmurgNWBkmgPNAKWB2TKF3MbNsGEyfCq6/abRE7Mxg2zDqIp0yBzExLCAA1a3pCiLnq1a09btgwa5O79dawI3KuyKKZvDYT6AwcCkwDZgDbVbVf/MPbn58p5FC1yqMvv2xzCQDq1YNly6B8eVi82MpUH3pouHGmpBUr7CzBl/p0JUQsJ6+Jqm4Hzgf+parnAc0ONkB38P77X7jwQvjmG6tOOm4cLFliCQGsOJ0nhJA0amQJYfPmsCNxrkiiSgoi0hHoB7wT3FfkZTxd7GT3D5xwgvVprlxp/QZ9+hTT2sYuOk8/DVWrWruecwkimqTwV+BW4A1VnSciRwKT4xuWyy0rC1atgscesy+hX3wB9evbQmHeQlFCXXSRNSHdckvYkTgXtUI/TlR1qqr2VNUHg9vLfC2F4rN1q5WZOOQQ+3y5/nqoUQOOPjrsyFyhDjnElplbsCBFa4S4RFTQPIXHgsu3RGRi7p9oHlxEzhSRRSKyVETy/bokIr1EREWk0E6QZJaVBZ98Yt/+rwrmjFeqZPMMrrgCnngCpk2zz5jDDgs3Vhel/v3tVK5LF1unwbkSrqC+gdHB5bADeWARKQ2MALoBGcB0EZmoqvNz7VcZK6Hx1YE8T7L45BO44QaYNcs+Qy6+2O4XsYoKLkE1bWpLfU6c6B0+LiHkmxRUNbvo3Qxgh6pmwd4P+/JRPHZ7YKmqLgt+bxxwLlY7KdI/gIeAG4sWemLbscM+/MuXt/Vczj7bvv3/61+WEKpVCztCFzPdu9sPwOzZtsSnr+bmSqhouig/BiK/4qQBk6L4vfrAyojbGcF9e4lIG6Chqr5d0AOJyEARmSEiM9auXRvFU5dcq1fbnKbatW0pYLDKCMOHWwmKa67xhJC0MjNtDPGNKfX9xyWYaJJCBVXdmn0juB7NeXBeVXT2zpQTkVLYYj03FPZAqvq0qqaranqtWrWieOqS58svbaGaRo3ggQegZUtbvQxsdvG11/oa8UmvXDk7JXz7bStJ6/WRXAkUTVLYJiJts2+ISDtgRxS/l4Et3ZmtAfuWx6gMNAemiMhyoAMwMZk6mxcvzrn+9NPw/vtw3XU2weyzz+DUU8OLzYXkvvusLtLtt8PgwWFH49x+oilzcQIwjpwP9LpAn4g+h/x+rwywGOgKrAKmAxep6rx89p8C3KiqBdawSJQyFzNn2pnARx/BKafA999bCYq0tLAjc6HbvRv69rVCVZ99lrOym3NxFG2Zi0JnJqvqdBE5FmiKNQktVNVCF6lV1d0icg3wAVAaeD6Y/HYPMENVk3aa58aNVniudGlLBABHHRVuTK4EKVPGClbdeKN1KDlXghSaFESkIjAEaKyqV4pIExFpWljnMICqvgu8m+u+O/LZt0t0IZdsX38NAwfa7OMJE3ySmctH+fKWEFRh/HgrZXv44WFH5VxUfQovAJlAx+B2BnBv3CJKQHv22OWOHVZ/aPZsW9e4d+9Qw3KJYMkS+NOfoFs3W4/BuZBFkxSOUtWHgF0AqrqDvEcWpRRVaw6+4go48kgrUpeWBh9+aIUx77wz7AhdQjjmGCt3u3Sp1UpyLmTRJIVMEUkjGE4qIkcBv8U1qhIsKwv+8x9o1gw6d4ZXXoHf/S6nQnKTJlC5crgxugTTtSv85S+2Ytsjj4QdjUtx0SSFO4H3gYYiMgabzHZTXKMqwaZMgX79rEn4+efhp5/ghRegTp2wI3MJbehQOPlkSwrbtoUdjUthBXY0i4gAC7EFdjpgzUbXqeq6YoitRGrZEl580RJD6dJhR+OSRuXKVu+kXDmfxehCVeCZgtokhjdVdb2qvqOqb6diQlCF44+HESNs9nH//p4QXBxUqWIJYds2eO21sKNxKSqa5qNpwQS2lJSVZWukzJ8P//hH2NG4lPDII9CrF/zvf2FH4lJQNEnhNCwxfC8ic0RkrojMiXdgJcXNN8NDD9ncAy+H74rF9dfb5fvvhxuHS0nRrLX8+7hHUUKNHw/DhtmCN08+aWsbOBd3lStDerrNer73Xv/Dc8WqoJXXKojIX4G/AWcCq1T1x+yfYoswROXL27DT4cP9/9IVs969YcUKWJdyXXguZAU1H70IpANzsbOFlBlAvWmTXf7hD/DxxzYgxLli1amTrfH8ww9hR+JSTEFJoZmqXqyqTwG9gM7FFFNoVq+GIUOgbl2bZApQtmy4MbkUddJJsGwZtG8fdiQuxRSUFPZWQlXV3cUQS6i+/BKOO86aii680OYRORcaEahVywprvfyyldt2rhgU1NHcSkSC4g0IkBbcFmwKQ5W4R1eMhg6F336DRYu8sqkrQd5/Hy65xJqR/v73sKNxKSDfMwVVLa2qVYKfyqpaJuJ6UiUEVfjiCzjvPE8IroTp0cP+MB96yJqTnIuzaOYpJD0RWxlt+PCwI3EuDw8+aLOcn38+7EhcCvCkEKhaFQ47LOwonMtDkyY2NnrUKNhV6KKHzh2UaCavJZ2NG+3/6/vvbV2T+fOhZ0+4++6wI3MuHzfcYKey27fbNxjn4iQlk0K/fvDuu/a/VaOGDfI48siwo3KuAOecY/0LXonRxVlKJoXLLoMLLoBLLw07EueiJGIJ4YsvYOtWOOOMsCNySSolk4KvnewSVt++UKaMjZ0uk5L/vi7OUq6j+X//g88/DzsK5w7Qww/b0NRRo8KOxCWplEsKjz5qNY2cS0i9e1tH2DvvhB2JS1IplxR27oTGjcOOwrkDJAJ/+Qu8+SZMnhx2NC4JpVxSWLEC6tQJOwrnDsJNN0HTprbugnMxllI9VUuX2pyEfv3CjsS5g1CpEsyb58NTXVyk1JnCCy/Y5XnnhRuHcwetdGnIzLQieVu3hh2NSyIplRTuuw9+/dVKZDuX8ObOtT/qQYOsqqNzMZBSSQGgWrWwI3AuRtq1g9tvh9GjrQyGczGQMklhyxY4/3z44IOwI3Euhu6+26bmP/aY9TM4d5BSJimsXQtvvAFr1oQdiXMxJGKltdPS4P77w47GJYGUGX20fr1d1qwZbhzOxVzt2jB2LKSnhx2JSwIpkxTWrbPLGjXCjcO5uOjZ0y5V7ezBuQOUMs1H2WcKnhRc0ho/Hs46yxYMce4AxTUpiMiZIrJIRJaKyC15bB8iIvNFZI6IfCwicStAUaoUNGzoScElsSpV4P334b33wo7EJTDROI1vFpHSwGKgG5ABTAf6qur8iH1OA75S1e0icjXQRVX7FPS46enpOmPGjLjE7FxC27kTGjWyVaMmT/b1Zd0+RGSmqhba8RTPM4X2wFJVXaaqmcA44NzIHVR1sqpuD25OAxrEMR7nkluFCjZnYdky6NrVxmE7V0TxTAr1gZURtzOC+/IzAMjzvFdEBorIDBGZsXbt2hiG6FyS6d7dKqguXQqffRZ2NC4BxXP0UV5DIPJsqxKRi4F04NS8tqvq08DTYM1HsQrQuaTUvbudLdStG3YkLgHF80whA2gYcbsBsDr3TiJyOnAb0FNVf4tjPM6ljuyEMHasTW7bsyfceFzCiOeZwnSgiYgcAawCLgQuitxBRNoATwFnquovcYzFudSjCq++Cq+/Dtu3W0kM5woRtzMFVd0NXAN8ACwAJqjqPBG5R0SCmTY8DBwCvCIis0RkYrzicS7liFhS6NED7rnHC3+5qMRtSGq8+JBU54po/Xro1Ak2bYKpU+GYY8KOyIUg2iGpSVHmYteuXWRkZLBz586wQ0lIFSpUoEGDBpQtWzbsUFw81KhhZwzdu8OSJZ4UXIGSIilkZGRQuXJlDj/8cMTrvhSJqrJ+/XoyMjI44ogjwg7HxUvz5pYQKla023PnQosW4cbkSqSkqH20c+dOatSo4QnhAIgINWrU8LOsVJCdEN55B1q2tI7nHTvCjcmVOEmRFABPCAfBX7sU87vfQb9+cNdd1pQ0ciTs3h12VK6ESJqk4JyLUloavPyy1UeqUweuvhpOPtnXeXaAJ4WYKV26NK1bt6Z58+b07t2b7du3F/5LhZgxYwbXXnttvttXr15Nr169Dvp5XIrq0gW+/homTIARI3wdBgd4UoiZtLQ0Zs2axXfffUe5cuUYOXLkPttVlaysrCI9Znp6Oo8//ni+2+vVq8err756QPE6B1gi6N0b2rWzJqTRo8OOyIUsKZNCly77/zz5pG3bvj3v7aNG2fZ16/bfVlSdO3dm6dKlLF++nOOOO45BgwbRtm1bVq5cyYcffkjHjh1p27YtvXv3ZuvWrQBMnz6dk046iVatWtG+fXu2bNnClClTOPvsswGYOnUqrVu3pnXr1rRp04YtW7awfPlymjdvDlhn++WXX06LFi1o06YNkydPBmDUqFGcf/75nHnmmTRp0oSbbrqp6AfkUsO//w39+8PPP4cdiQtRUiaFMO3evZv33nuPFsFwv0WLFtG/f3++/fZbKlWqxL333sukSZP45ptvSE9P59FHHyUzM5M+ffowfPhwZs+ezaRJk0hLS9vncYcNG8aIESOYNWsW//vf//bbPmLECADmzp3L2LFjufTSS/eOKJo1axbjx49n7ty5jB8/npUrV+Lcflq2tMvgb8mlpqSYp5DblCn5b6tYseDtNWsWvD0/O3bsoHXr1oCdKQwYMIDVq1fTuHFjOnToAMC0adOYP38+nTp1AiAzM5OOHTuyaNEi6tatywknnABAlSpV9nv8Tp06MWTIEPr168f5559Pgwb7Lj3x2WefMXjwYACOPfZYGjduzOLFiwHo2rUrVatWBaBZs2b8+OOPNGzYEOf2ccopcPrpMHy4DVf1PoaUlJRJIQzZfQq5VapUae91VaVbt26MHTt2n33mzJlT6LDQW265hR49evDuu+/SoUMHJk2aRIUKFfZ57PyUL19+7/XSpUuz24cfuryIQK9eMGkSTJ8O7duHHZELgTcfFaMOHTrw+eefs3TpUgC2b9/O4sWLOfbYY1m9ejXTp08HYMuWLft9cH///fe0aNGCm2++mfT0dBYuXLjP9lNOOYUxY8YAsHjxYlasWEHTpk2L4ahcUunRAypXho0bw47EhcSTQjGqVasWo0aNom/fvrRs2ZIOHTqwcOFCypUrx/jx4xk8eDCtWrWiW7du+80wfuyxx2jevDmtWrUiLS2N3//+9/tsHzRoEHv27KFFixb06dOHUaNG7XOG4FxUGjSwVdvOOMNu+zoMKScpqqQuWLCA4447LqSIkoO/hm4/r7xiw/befhsimkFdYoq2SqqfKTjn8rZ5M3z6KXTrBnPmhB2NKyaeFJxzeRswAF56CRYtgtatbURSESdgusTjScE5l79+/ayPoU8fGDbMmpRcUvMhqc65gh16KPznP7BqlXVEg3VAly4dblwuLvxMwTlXOJGchPDMM3D99eHG4+LGzxScc0UzeTKMHWsL9Dz5JPgyrknFzxRiJLJ09jnnnMPGGE/+GTVqFNdccw0Ad911F8OGDYvp4zsXtZdegptvhmeftTOGBBvW7grmSSFGIktnV69efW+BOueSTpky8MADcM01Vjzvyis9MSSR5Gw+yqve9QUXwKBBVjv7rLP2337ZZfazbp3Vf4lUxAp5HTt2ZE7EuO6HH36YCRMm8Ntvv3Heeedx9913A/DSSy8xbNgwRISWLVsyevRo3nrrLe69914yMzOpUaMGY8aMoXbt2kV6fueKxfDh0LgxHH20F89LIsmZFEK0Z88ePv74YwYMGADAhx9+yJIlS/j6669RVXr27Mmnn35KjRo1uO+++/j888+pWbMmGzZsAODkk09m2rRpiAjPPvssDz30EI888kiYh+Rc3kqVghtvDDsKF2PJmRRCqJ2dXTp7+fLltGvXjm7dugGWFD788EPatGkDwNatW1myZAmzZ8+mV69e1KxZE4Dq1asDkJGRQZ8+fVizZg2ZmZkcccQRRY7FuWL1zjvw+uswdCgcdljY0biD5H0KMZLdp/Djjz+SmZm5t09BVbn11luZNWsWs2bNYunSpQwYMABVzbNc9uDBg7nmmmuYO3cuTz311H6F8ZwrcapWheefh//+N+xIXAx4UoixqlWr8vjjjzNs2DB27dpF9+7def755/cuu7lq1Sp++eUXunbtyoQJE1i/fj3A3uajTZs2Ub9+fQBefPHFcA7CuaJo3x6qVIF//hPWrAk7GneQPCnEQZs2bWjVqhXjxo3jjDPO4KKLLqJjx460aNGCXr16sWXLFo4//nhuu+02Tj31VFq1asWQIUMAG27au3dvOnfuvLdpybkSrVw5GDkSli+3Gknz5oUdkTsIXjrbAf4auhiYNw9OOw2eegrOOy/saFwu0ZbOTs6OZudc8Tv+eFiyxPoYAB59FNavhz//GRo1Cjc2FzVvPnLOxU52QtiwASZOtBFJRx0FDz9s6zO4Ei9pkkKiNYOVJP7auZirXt2Gdi9YYJPbbroJjjkGcq097kqepGg+qlChAuvXr6dGjRp5DvN0+VNV1q9fT4UKFcIOxSWjpk1h/nwYMwbeeMNKZGRlwXXXwRFHQJMmULs21KoFdepAWlrYEae8pOho3rVrFxkZGT6m/wBVqFCBBg0aUNarXbrisHKljVIKhmHv9cADVmhvxQo4+2wb1VSmjK3bULq0bevRw1aCu+GGnPuz97n2WujY0YbFfvmlld7I/pIoAqecYmtDrFwJc+fmbM/ep1MnOOQQe/4lS/bdLgInnggVKtjvr1ix//Z27SyWjAz4+ef9t7dsaZfr18Nvv1kCTEuD8uWLpUxISnU0ly1b1mf+OpcoGja0D8a1a2HZMrtcu9Y+VMEW8DnySNi1y67v3m2X2R+cmZnw008592df/vqrbZ86Ffr23f95v/rK5lR88IEV8ctt3jxo1sxmZ+e1XsSKFRb7qFFwxx37b//1V6hWDR5/3PpQctu925LX3/8O//73vtuqVcuJ/447YNKkfRNKzZp2plUM4poURORMYDhQGnhWVR/Itb088BLQDlgP9FHV5fGMyTlXQtSqZT+5HXEEvPlm/r/XogXkai3YxxlnwKxZVrk1uyVE1ZqyAHr2tMfIvf3ww+16797Qtm3O9uyf7Fj79bOzhtzbK1Wy7ZddBiefvP/2UqVyfr9VK1uPYudOu4xssUlLs8eK/N1iXOUubs1HIlIaWAx0AzKA6UBfVZ0fsc8goKWqXiUiFwLnqWqfgh43r+Yj55xzBYu2+Sieo4/aA0tVdZmqZgLjgHNz7XMukF3L4VWgq3hPsXPOhSaezUf1gZURtzOAE/PbR1V3i8gmoAawLnInERkIDAxubhWRRUWMpWbux0wRqXjcqXjM4MedSg70mBtHs1M8k0Je3/hzt1VFsw+q+jTw9AEHIjIjmtOmZJOKx52Kxwx+3GHHUZzifczxbD7KABpG3G4ArM5vHxEpA1QFco1Tc845V1zimRSmA01E5AgRKQdcCEzMtc9E4NLgei/gE020iRPOOZdE4tZ8FPQRXAN8gA1JfV5V54nIPcAMVZ0IPAeMFpGl2BnChXEK54CbnhJcKh53Kh4z+HGnkrgec8LNaHbOORc/SVMQzznn3MHzpOCcc26vpEoKInKmiCwSkaUickse28uLyPhg+1cicnjxRxl7URz3EBGZLyJzRORjEYlqvHJJVtgxR+zXS0RURJJi2GI0xy0iFwTv9zwR+U9xxxhrUfx9NxKRySLybfA3flYYccaSiDwvIr+IyHf5bBcReTx4TeaISNuYPbmqJsUP1pn9PXAkUA6YDTTLtc8gYGRw/UJgfNhxF9NxnwZUDK5fnejHHc0xB/tVBj4FpgHpYcddTO91E+Bb4NDg9mFhx10Mx/w0cHVwvRmwPOy4Y3DcpwBtge/y2X4W8B4216sD8FWsnjuZzhRStaxGocetqpNVdXtwcxo2ZySRRfNeA/wDeAhIlprq0Rz3lcAIVf0VQFV/KeYYYy2aY1agSnC9KvvPh0o4qvopBc/ZOhd4Sc00oJqI1I3FcydTUsirrEb9/PZR1d1AdlmNRBbNcUcagH3DSGSFHrOItAEaqurbxRlYnEXzXh8DHCMin4vItKBScSKL5pjvAi4WkQzgXWBw8YQWqqL+30ctKdZTCMSsrEaCifqYRORiIB04Na4RxV+BxywipYB/ApcVV0DFJJr3ugzWhNQFOyP8n4g0V9WNcY4tXqI55r7AKFV9REQ6YnOfmqtqVvzDC03cPsuS6UwhVctqRHPciMjpwG1AT1X9rZhii5fCjrky0ByYIiLLsTbXiUnQ2Rzt3/h/VXWXqv4ALMKSRKKK5pgHABMAVPVLoAJWNC6ZRfV/fyCSKSmkalmNQo87aEp5CksIid7GDIUcs6puUtWaqnq4qh6O9aP0VNVEX4gjmr/xN7GBBYhITaw5aVmxRhlb0RzzCqArgIgchyWFtcUaZfGbCPQPRiF1ADap6ppYPHDSNB9pySqrUWyiPO6HgUOAV4J+9RWq2jO0oA9SlMecdKI87g+AM0RkPrAH+Juqrg8v6oMT5THfADwjItdjTSiXJfqXPREZizUB1gz6Su4EygKo6kis7+QsYCmwHbg8Zs+d4K+dc865GEqm5iPnnHMHyZOCc865vTwpOOec28uTgnPOub08KTjnnNvLk4JLGSJSQ0RmBT8/iciq4PrGYAhnrJ+vi4gUqcyGiEzJa5KdiFwmIk/ELjrn8uZJwaUMVV2vqq1VtTUwEvhncL01UGhJhGAWvHNJzZOCc6a0iDwTrEHwoYikwd5v7veLyFTgOhGpJSKvicj04KdTsN+pEWch34pI5eBxDxGRV0VkoYiMya7KKyJdg/3mBrXzy+cOSEQuF5HFwXN3KqbXwaU4TwrOmSZYyenjgY3AHyO2VVPVU1X1EWA4doZxQrDPs8E+NwJ/Cc48OgM7gvvbAH/F6vwfCXQSkQrAKKCPqrbAKgtcHRlMUAb5biwZdAt+37m486TgnPlBVWcF12cCh0dsGx9x/XTgCRGZhdWfqRKcFXwOPCoi12JJZHew/9eqmhFU7JwVPG7T4PkWB/u8iC2qEulEYIqqrg3WERiPc8XA20idM5GVY/cAaRG3t0VcLwV0VNUd7OsBEXkHq0czLahKm9fjliHvssd58Ro0rtj5mYJzRfMhcE32DRFpHVwepapzVfVBYAZwbAGPsRA4XESODm5fAkzNtc9XQJdgxFRZoHesDsC5gnhScK5orgXSg8XS5wNXBff/VUS+E5HZWH9CvqvbqepOrKrlKyIyFxv5NDLXPmuwFcW+BCYB38T6QJzLi1dJdc45t5efKTjnnNvLk4Jzzrm9PCk455zby5OCc865vTwpOOec28uTgnPOub08KTjnnNvr/wG8lXsWjXBlhQAAAABJRU5ErkJggg==\n",
"text/plain": [
"<Figure size 432x288 with 1 Axes>"
]
},
"metadata": {
"needs_background": "light"
},
"output_type": "display_data"
}
],
"source": [
"from sklearn.metrics import precision_recall_curve\n",
"\n",
"# Predict\n",
"y_scores_threshold = xgb_classif.predict_proba(X_test)[:,1]\n",
"\n",
"precision, recall, thresholds = precision_recall_curve(y_test, y_scores_threshold) \n",
"\n",
"#retrieve probability of being 1(in second column of probs_y)\n",
"pr_auc = metrics.auc(recall, precision)\n",
"\n",
"plt.title(\"Precision-Recall vs Threshold Chart\")\n",
"plt.plot(thresholds, precision[: -1], \"b--\", label=\"Precision\")\n",
"plt.plot(thresholds, recall[: -1], \"r--\", label=\"Recall\")\n",
"plt.ylabel(\"Precision, Recall\")\n",
"plt.xlabel(\"Threshold\")\n",
"plt.legend(loc=\"lower left\")\n",
"plt.ylim([0,1])"
]
},
{
"cell_type": "code",
"execution_count": 11,
"metadata": {},
"outputs": [],
"source": [
"# XGBoost Classifier predict\n",
"\n",
"threshold = 0.4\n",
"\n",
"y_pred = np.where(xgb_classif.predict_proba(X_test)[:,1] > threshold, 1, 0)\n",
"y_scores = xgb_classif.predict_proba(X_test)[:,1]"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"### F1-score, precision and recall"
]
},
{
"cell_type": "code",
"execution_count": 12,
"metadata": {},
"outputs": [
{
"name": "stdout",
"output_type": "stream",
"text": [
" precision recall f1-score support\n",
"\n",
" 1 0.89 0.88 0.88 114385\n",
" 0 0.57 0.58 0.57 30634\n",
"\n",
" accuracy 0.82 145019\n",
" macro avg 0.73 0.73 0.73 145019\n",
"weighted avg 0.82 0.82 0.82 145019\n",
"\n"
]
}
],
"source": [
"from sklearn.metrics import classification_report\n",
"target_names = hardbounce_dummy['flgHardBounce_n'].astype('str').unique()\n",
"print(classification_report(y_test, y_pred, target_names=target_names))"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"### Accuracy"
]
},
{
"cell_type": "code",
"execution_count": 13,
"metadata": {},
"outputs": [
{
"name": "stdout",
"output_type": "stream",
"text": [
"Accuracy: 0.8185892883001538\n"
]
}
],
"source": [
"print(\"Accuracy:\",metrics.accuracy_score(y_test, y_pred))"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"### Plot Confusion Matrix"
]
},
{
"cell_type": "code",
"execution_count": 14,
"metadata": {},
"outputs": [
{
"name": "stdout",
"output_type": "stream",
"text": [
"Normalized confusion matrix\n",
"[[0.883455 0.116545 ]\n",
" [0.42361428 0.57638572]]\n"
]
},
{
"data": {
"text/plain": [
"<matplotlib.axes._subplots.AxesSubplot at 0x7f4b3dc6d5f8>"
]
},
"execution_count": 14,
"metadata": {},
"output_type": "execute_result"
},
{
"data": {
"image/png": "iVBORw0KGgoAAAANSUhEUgAAAUMAAAEaCAYAAACLsjU4AAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADl0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uIDMuMC4zLCBodHRwOi8vbWF0cGxvdGxpYi5vcmcvnQurowAAIABJREFUeJzt3Xm8XfO9//HX+2QmhIoxM2IIYorZLW1Dk3LNQyiqNbeht1pKq4qfTvTSumiNVW4NMbVBCB3UcA0JQgUhQpqIISFBhIyf3x/re2JlZ5+z90n22Xsn5/3MYz1y1lrf9V3ftfben/0d1l5LEYGZWVvXUOsCmJnVAwdDMzMcDM3MAAdDMzPAwdDMDHAwNDMDWhAMlXlDUkjauDULtSKS1F3S5ZImSfpM0jRJoyUdUOuyLStJu0l6StKn6bU/rczt9pL0uKQPJb0r6W5JmxakOVzSXZLeTu+pY5cjr4dTHoVT52XIq5OkSyS9I2mOpEclDSpIM1jSbZImpzQvShouqV1Buo6SzpU0MZ3DiZLOl9SpIN0gSQ9Kel/SB5L+KmmngjTnS/qXpI8kfSxprKTDi5yvbpL+IGlmOs4/SVqrSLr9U36fSXqpMK9U9ovT8X8qqeg1eJJuaOLcb5ZLs4WkB9JnYq6kf0u6VtL6y3K+Wk1ElDUBuwKRpnPK3a4tTEAH4F/A68BxwJ7AUcCNwP/UunzLeEwbA7OBW4EvA2cBC4DjS2y3PTAPGAHsDRwMPA/8G1g9l+524FngmvSeOnY58noY+Duwc8GkZcjrKuBD4GRgKHA/MAvok0szArgXODq91ucAc4H/Lij/JcAc4HTgS8D3gU+B3+bS9Er5/x3YJ00PpzLk93lp2n5oKv/V6bwdUrDPB4A30vEdCLwKPFqQZvf0Wl6WynUxsAjYO5dmDWAmMBr4GxBNvN43AC8XOfedc2l2BX4HHJnO1zeBN4HngPYtOV+t+p5vwYfjf8g+HE8C42v9YS0oW+ca73+v9Mbcocg6VWH/XVohz6vSByn/Zr0SmNLcMQG/BN4p2G5gOj9Dc8sa0v9daToYlpvXw8AdJY6nZF5AzxQkvpVL0wl4C7g8t6x7kfx/nj64nXLL3qF4gHw3N38ysBBYI7dszbTslBLH9DgwMje/SzqeL+aW7ZiWDc4tGw38vSCvUcBjxd67wHCaD4Zjl+H91fiZ2a4l56s1p7Kayan6fygwErgeGCBpYJF0fSTdImlGaj68IOnI3Pouki5KzYu5qen1i9z6kDS8IM/zJM3IzR+b0u2YmkefAmekdb9MVf/ZkqamJsJ6Rcp5Qq6J8K6kO1LzYh9JiyT1K0jfLy3fr4lTtEb6/53CFZFe0VxeAyXdI2lWKufTkvYq2Nefc82he1TQLZGO/3RJv5E0naxW2rhu/9SE+kxZU+8iSR2aKHdzhgJ3RcSC3LJbyQLGls1s1wGYU7DdrMbiNS6IiEVllKGsvMpUTl5bAe2Av+bKORd4lKzG1rhs8fsx5zmgM7B6wT4/LEg3q6DsHcgC8OzcstlpWaljfB/omJsfShY4HsmV9WmymuJQyLoByGpdIwryuhXYRVK33Lat+fO099P/+fKXc75aTwuj+H7AF8iaG78oSLMOMA2YCBwLfAX4LvDDxm8Z4EHgY+DMtP4Y4JpcHgEML8j3PGBGbv7YlO514AdkL+y2ad31wBHAHsAhwBPAS0C73PbnkDUJLgeGAAcB1wE9yD4IU4HzCspwPvAuuVpFwfr+ZN/kD5E1QZpKt1k6/rHAsHRezybVRMhqIZOACcDhZE2dF8lqJl8oOE9vA7elY/haWn5YKseVZE2pU8jeTL/ObduXJmpiuTSrFksDrJ2WH9rMttsCnwE/JKvh9ALuIGtKdSqSvrmaYVl5kdUMPyJrYs0hq/kMbGleZM3KANYr2PaP6T2zSjPHfSkwvWDZr9Jrt1s6zv9Ir9u5uTQbkDVHf0v2GVonvTffAdYusp/2ZF++X0/Hc0Bu3Qjg4SLb3Afcl/4ekI5xz4I0O9B066ZUzXBOOv9zgceAPZpI20AW/DYliwVPk1oI5Z6v1pzKDYbXpxesY+7kvsGSfTK/AD4B1m8ij6+mk71fM/tpSTD8bokytyMLcIubDelNNAe4pJntLswfG1kQf5NcQGliu9PJviSCrLn0AAVBA7iFLNgWbdaSNZkWABvmlvVM+Z5dcJ6eK9hWwGTgDwXLv5XKs1aa75P2cUwzx9J43g4oWN4+LT+xxLkYnN4vkaaXgd5NpG0yGJabF9mX1TfTh+eolOZDoG9L8iKrGQbwnwXn9aW0fIMmyjggnePzirwml+X2F8AVRbbfJr0vGtNMA7Yukm7nXJr5wEkF6x8C/lxku/8F/i/9vVvafpuCNBun5XsX2b65YPhdsi/dfAVkHrBjkbQP5Mo/FlhnWc5Xa02lE2S1lZnA9bllR6WC7pJb9hRwZzP5/Ap4v8S+WhIMNy6y/VDg/9IHIX9Cj8+tD2CrZsqwIVkt4Etp/stpmy3KOFc9gG+TfUM3fuh+kVv/LgV9IgXbXw88XWT5P0jf7LnzdGFBmk3T8qFkQatx6puW71H2m+LzYLh/wfLGYHhCM9tuAbxHVtv+Cllr4v/IarirF0nfXM2wRXnltluPrEb8m5bmRVazmUA24LI22Zf8glTGdYvsa02yoPoUqbKQW3cm8AFZMPkicGoq1wW5NOuTtab+QlbLHwLcQxYcC4P+qsAgsqB+KVlAPCK3/iHg7iJl/BPwePq7MRhuXZCmf1q+V5HtmwyGRdJ2IatMFAvK/YGdyOLHK8AzLDnQUvJ8teZUzsEdkE7SIWQ1qzXIaiufAZfl0k0k18lcJJ9rgRdL7KslwXC1gnQ7pDfHiPRG3zmd+MV58nkQX6oDvCCvvwM3pr9vAp5q8YnN3rj3pw9SY61sAfCDZra5H7inyPJbgScKztOpBWka3+RNTUe1sOwBfKNgeTnN5LsaP3i5ZWuStRpOL5K+uWDYorwK0t0HPNLSvMhqSM/lztuLwH+T1XY6FGzfGXiErGtj3YJ13dM2JxQsPym9T9dJ85eQtTw65NJ0JKvlX1biGK8H/p2bHwH8o4lzUdhM3qPI5ydoYTO5iXJdkS9XE2n6kFU6GruIyjpfrTmVM4ByRPr/drLazkyyEcVOwGG5a6veJ/uWa0qp9ZD1OXQsWPaFJtJGwfyBwHTg8IgYGRFPsvSARmOnbalyXAscLKkHWZ/iH0qkX7pwEZ+Q9d21I/uANe6/uX2/TdZnVGhdsm/MJXZRMN+4/kSyN3bhdH8Lyz6FrI8zr3H+lWY23wwYV5DfTLIP90bllqFCeeXPUVl5RcTEiNg2LduMrOncCXg2IuY3pkvv+5vJapxDI+Ldgn1vSDYgMK5g+XNkNew+uXKNz+cdEfOA8WUc47NAr9wA2Sss/Zo17qPxNXudLLgUe20XkV1BUAmF788lV0ZMJnvPbpgWlXu+Wk2zwVBSV2Bfsr6uLxVMp5N9SL+Ukv8N+KqkdZvI7m/AFyTt28wupwKb5/bfQNZMLUcXYH6kr5Pk6wVpniDr2/lGibzuIvuWupXsHN3aXGJJX5DUvsiq/un/99L/fyP7AulcJC1kTa3t86PZKSDvStZ8a84Ess7nvhExtsj0fontC90PHKglLyQ+nCxIvtjMdpPJBisWSxf99iWrAbXEMuWV3oO7kTXDlimviJgUEROAtcgGpq4rSHIlWZP2P1O6YmUH2K5g+fbp/zdz6baUtLgSkEZ8tyxWrgK7AVNzgfR+YD1Ju+fyGkQWaO5PxzWXrNvl0IK8DidrfRSO5raIpC5kXTXPlEi3Kdm5fSMtKvd8tZ4SVdmvk0X4nYqs6wDMAK6Lz5tQU8m+Wb5BFsS+A5yZ1ousA/UjslHgL6f8r8rleTHZAMe3yd5od5BdFFusmdy1oDxfS8t/Q9Yn9BOyALFE05ts9HYRWUftEGB/sgtYexTkd3na9uYymgWHAK8BPyIbIW7c/yfkmr1k/XofkY2iHU7W93MGS48mv0L2ATyY7LKZYqPJw4uU43CyIP4/6XwMJqspjiKNhFLGAEpK13jR9c1kX3hnktUoji9It4AlR0f3T+W7gWzQ7CCyID+L3AAEWXPtED7vurg8ze/RkrzIrhW8L70vvkT23nuFrNbRexnKdRrZ+3JP4IT0evyNJUc9f5Ty+jlLX2yc73+8O+X/3VS275H1Z4/Ipdk+ndf7yC7f2ZcscM0n9eul1+zvwPFkn5v9yForAZxc8Ho8kMp8EFkX1wSavuj6N+k4L6LgouuUbmh6Ta7l866yQ0gXgwPdyC47OonsPX842XXIc4FBuXx+TXad54HpPHybLLhNBFZtyflqzanUh/xe4NVm1l9J1mxuvDShD9nlHjPJgtrzwLBc+i7pxExNJ+wN4Ge59V3JLmP4gKyJew5N9xl2LVKeM8lqLp+QXSvW2Clc2A95EtkI4dy0nxEUdMiTBZIgd7FqM+ehVzqucenF/JgsiJ1NweUYZB/eUSnNx2QfyK/k1m8I/Dmtm51eg/4FeRQNhrk38KPpHHyUynQh6XIfyri0puBD8zRZ//CbwGlF0gRLj6IeBoxJ+38vHW/h6OV5FO/bfLgleZEN9owi62KYR9YVcSewWZGyllOuH6b35dz0XvpVkdfw4SbKHuQuWSG75vDXZE3TT8k+/BexdH/3V8j6Hj9I0z8L8ulGNiL8Znot3iELjl8rcoxrkAXKWek4b6b4ReIHkNXw55J9eQwrkubNJo7x2LS+M1krakrK50OyYLxzQT7DyC4Q/4AsLrxC1g/bvSBdWeertabGy0esgKSLyL7p+kV5Fwib2QqsWD9Xm5b6MgaQXTt1vgOhWdvgmmEBSQ+TXZIzEjg6spE9M1vJORiameGbu5qZAStgn6Hadwl1XK3WxbAW2Hbz3rUugrXQs88+MyMi1q5knu1W7xOx4NOy0san00dHxJBK7r+UFS8YdlyNTpseVutiWAs8/tTltS6CtVCXDppcOlXLxIJPy/7sfjbuiu6V3n8pK1wwNLMVlUD12zPnYGhm1SGgoV3JZLXiYGhm1aPq3LR6WTgYmlmVuJlsZpZxzdDM2jzhmqGZWdZMds3QzMyjyWZmHkAxM4PUZ+hmspmZa4ZmZm4mm5k1anAz2czaOv822cwM3Ew2M2vk0WQzM1wzNDND/jmemVmmjgdQ6rfOamYrmTSAUs5UKidpiKQJkiZKOqvI+t6S/iHpOUkvSPpaqTwdDM2sehqbyqWmZrNQO+AKYCgwADhC0oCCZOcAIyJiW2AYcGWpojkYmll1NN7PcPlrhjsCEyNiUkTMA24F9i9IE8Dq6e9uwLRSmbrP0MyqpEXXGXaXNDY3f3VEXJ3+7gFMya2bCuxUsP15wIOSTgVWBQaX2qGDoZlVT/mjyTMiYlBTuRRZFgXzRwA3RMR/S9oFuEnSlhGxqKkdOhiaWfVUZjR5KtArN9+TpZvBxwFDACLiCUmdge7Ae00WrRIlMzMrSRUbTR4D9JfUT1JHsgGSkQVp/g18JdutNgc6A9Oby9Q1QzOrngpcdB0RCyQNB0YD7YDrI2K8pAuAsRExEvg+cI2k75E1oY+NiMKm9BIcDM2salShX6BExChgVMGyc3N/vwTs1pI8HQzNrCqyu/7753hm1taJ4uPAdcLB0MyqRDQ01O+YrYOhmVWNm8lmZjgYmpm5z9DMDEDINUMzM8ADKGZm4D5DMzP3GZqZNXLN0MzaPA+gmJklDoZmZgI1OBiamblmaGYGDoZmZh5AMTNbrH5joYOhmVWJ6ruZXL8/FDSzlU5DQ0NZUymShkiaIGmipLOKrL9U0rg0vSppVqk8XTM0s+qpQMVQUjvgCmAvsmcoj5E0Mj0ECoCI+F4u/anAtqXydc2wCvbadXOev/snvPiXn/KDb+611Ppe663JA1efxhO3/JCnbzubr+4+AID27Ru45oKjGTPiRzx35zn84Ft7V7vobdaDox9g4BabssVmG3PxRb9cav1jjz7CLjtsR9fO7bnrzjsWL39+3Dj22H0Xttt6C3bYdiC3j7itmsWue5LKmkrYEZgYEZMiYh5wK7B/M+mPAG4plWnNg6Gk6yW9J+nFWpelNTQ0iN+cdRj7D7+SbQ++kEOHbM9mG663RJofHj+EOx96ll2O+BXHnP0Hfnv24QAcPHg7OnVszw6H/Zxdv/4rjj94N3qv/4VaHEabsnDhQv7rtO/wl3vu57kXXuL2W2/h5ZdeWiJNr169ufq6Gzh82JFLLF9llVW47g838uzz4/nLfQ9w5vf/i1mzSrbQ2oRyA2EZwbAHMCU3PzUtK7bPPkA/4O+lMq15MARuAIbUuhCtZYct+/L6lBm8+db7zF+wkNtHP8u+ew5cIk1EsPqqnQHo1rULb0//MFtOsErnjrRr10CXTh2ZN38hH3/yWdWPoa0Z8/TTbLTRxvTbcEM6duzIoYcP4957/rJEmj59+7LVwIFL9W/132QTNu7fH4ANNtiAtddehxnTp1et7PWuBcGwu6SxuenEfDZFsm7qAfHDgDsiYmGpstW8zzAiHpHUt9blaC0brNONqe/OXDz/1rsz2XHLvkuk+dlVo7jnyuGcMmwPVunSiX1O/h8A7vrrc+y750DeeOhnrNK5I2f++i5mfjSnmsVvk6ZNe4uePXstnu/RoydPP/1Ui/MZ8/TTzJs/jw032qiSxVuhtWA0eUZEDGpi3VSgV26+JzCtibTDgO+Us8N6qBmWJOnExm+IWPBprYvTIiryJVb4FXbYkEH87z1PsvGQn3Dgqb/juguPQRI7bNGXhQsXseHeP2bzfX7Kd4/+Mn17rFWdgrdhEUtXMlp6Scjbb7/Ncd88mquu+UNd39252tSgsqYSxgD9JfWT1JEs4I1cal/SpsCawBPllG2FeJUi4uqIGBQRg9S+S62L0yJvvTeLnuuuuXi+x7prMi01gxt944BduPPBZwF46oU36NyxA93XWJXDhg7iwf97iQULFjF95myeGDeJ7Qf0rmr526IePXoydernXVJvvTWVDTbYoOztP/roIw7abx9+ev6F7LTzzq1RxBWTKjOAEhELgOHAaOBlYEREjJd0gaT9ckmPAG6NYt9uRawQwXBFNnb8ZDbuvTZ9NliLDu3bcehXt+O+h19YIs2Udz5gzx03BWDTfuvSuVMHps+czdR3PmDPHbLlq3TuyI4D+zLhzXerfgxtzaAddmDixNd48403mDdvHrffdiv77Ltf6Q2BefPmcfghB3LkUcdw8CGHtnJJVywCpPKmUiJiVERsEhEbRcTP0rJzI2JkLs15EbHUNYhNcTBsZQsXLuJ7vxrBPVd+h3F3ncOdDz7Hy5Pe4Sen7MM+e2wFwFmX3M23DtqVp247iz/+4puccO5NAPz+tkfoukpHnrnjxzz2pzO46S9P8uJrTXWNWKW0b9+eS397Of+5z1fZZqvNOfjQwxiwxRZccN653HtP9lkbO2YMG/XtyV133s6p3z6J7bbeAoA7bx/BY48+wv/eeAM7bb8NO22/Dc+PG1fLw6kjFRtNbp3SlVmDbL0CSLcAewLdgXeBn0bEdU2lb1hlnei06WFVKp1Vwswxl9e6CNZCXTromWYGMJZJ5/U2id7HXFZW2tcuHlrx/ZdSD6PJR9S6DGZWBcquu61XNQ+GZtY2CAdDMzOgvMGRWnEwNLOqqedbeDkYmll1lHnZTK04GJpZVWTXGdZvNHQwNLMqkQdQzMzANUMzM/cZmpmB+wzNzBar41joYGhm1eOaoZmZf5tsZvb5/QzrlYOhmVVJ7e5VWA4HQzOrmjqOhQ6GZlY9rhmaWZunOh9A8TNQzKxqKvUMFElDJE2QNFFS0Yc+STpM0kuSxku6uVSerhmaWdVUopUsqR1wBbAX2QPlx0gaGREv5dL0B84GdouImZLWKZWva4ZmVjUVqhnuCEyMiEkRMQ+4Fdi/IM0JwBURMRMgIt4rlamDoZlVR5nPTE6xsLuksbnpxFxOPYApufmpaVneJsAmkh6X9KSkIaWK52aymVWFWnad4YxmHhVaLJPCZx63B/qTPYa4J/CopC0jYlZTO3QwNLOqaVeZ0eSpQK/cfE9gWpE0T0bEfOANSRPIguOYpjJ1M9nMqqYFzeTmjAH6S+onqSMwDBhZkObPwJeyfao7WbN5UnOZumZoZlWRBbrlrxlGxAJJw4HRQDvg+ogYL+kCYGxEjEzr9pb0ErAQOCMi3m8u3+UOhpJWL1Hwj5Z3H2a2cqjUNdcRMQoYVbDs3NzfAZyeprJUomY4nqzzMn+YjfMB9K7APsxsJbBS/xwvInqVTmVmVt83aqjoAIqkYZJ+lP7uKWn7SuZvZisuAe2ksqZaqFgwlHQ52ejN0WnRHOD3lcrfzFZwZf76pFZN6UqOJu8aEdtJeg4gIj5Iw95mZkB9N5MrGQznS2ogXQkuaS1gUQXzN7MVmICGOo6GlewzvAK4E1hb0vnAY8CvKpi/ma3gKnTRdauoWM0wIm6U9AwwOC06NCJerFT+ZrZiq/ebu1b6FyjtgPlkTWX/1M/MltAmmsmSfgzcAmxA9sPpmyWdXan8zWzFpzKnWqhkzfAoYPuImAMg6WfAM8AvKrgPM1uBrdS/QMmZXJBfe0rcJcLM2o5sNLnWpWhaJW7UcClZH+EcYLyk0Wl+b7IRZTOzxRdd16tK1AwbR4zHA/fllj9ZgbzNbCWyUo8mR8R1lSiIma3cVvpmciNJGwE/AwYAnRuXR8QmldqHma3Y6rmZXMlrAW8A/kD2BTAUGEH2CD8zM6C+L62pZDBcJSJGA0TE6xFxDukZBGZmUnbRdTlTLVTy0pq5yurAr0s6GXgLKPkUezNrO+q4lVzRmuH3gK7AacBuZE+0/1YF8zezFVxDg8qaSpE0RNIESRMlnVVk/bGSpksal6bjS+VZyRs1PJX+/JjPb/BqZgZkD5GvRBNYUjuyu2TtRfZ85DGSRkbESwVJb4uI4eXmW4mLru9m6afZLxYRBy3vPsxsJVC523PtCEyMiEkAkm4F9gcKg2GLVKJmeHkF8ihbz97rcubl36/mLm05HXzt07UugtWJFlxa013S2Nz81RFxdfq7BzAlt24qsFORPA6W9EXgVeB7ETGlSJrFKnHR9d+WNw8zaxtaMEgxIyIGNbGuWEQtbJ3eA9wSEXPTgO4fgS9XqGxmZstOUKkHQk0F8o8o7glMyyeIiPcjYm6avQYo+aROB0Mzq5r2DeVNJYwB+kvqlx46NwwYmU8gaf3c7H7AyyXL1rJDKU1Sp1xENjMDGp9vsvwjKBGxQNJwYDTZ3fWvj4jxki4AxkbESOA0SfsBC4APgGNL5VvJ3ybvCFwHdAN6S9oaOD4iTq3UPsxsxVapGzVExChgVMGyc3N/nw206E77lWwmXwbsC7yfCvM8/jmemeW0iafjAQ0RMbmgGrywgvmb2Qqs3p+bXMlgOCU1lSNdIX4q2fU9ZmYAtKvfWFjRYHgKWVO5N/Au8Ne0zMwM1fCONOWo5G+T3yMb4jYzK6qOY2FFR5OvochvlCPixErtw8xWbG3itv9kzeJGnYEDWfL3g2bWhrWZAZSIuC0/L+km4KFK5W9mK746joWV/wVKTj+gTyvmb2YrEkG7Oo6GlewznMnnfYYNZD+BWeoOtGbWNrWJR4WmZ59sTfbcE4BFEdHkDV/NrG2q52BYkZ/jpcB3d0QsTJMDoZktpUK38GoVlfxt8tOStqtgfma2EmlsJpcz1UIlnoHSPiIWALsDJ0h6HfiE7NgjIhwgzaySz0BpFZXoM3wa2A44oAJ5mdlKSkD7Ou40rEQwFEBEvF6BvMxsJbay1wzXlnR6Uysj4pIK7MPMVniioeiznOpDJYJhO6ArxZ9YZWYGND4QqtalaFolguHbEXFBBfIxs5VZDUeKy1GxPkMzs+YIaFfH0bAS1xl+pQJ5mFkb0JBu8FpqKkXSEEkTJE2U1OTPfiUdIikkNfVA+s/L1sJjWUpEfLC8eZhZ21CJB0Klx4pcAQwFBgBHSBpQJN1qwGnAU+WUzQ+RN7OqEFnAKWcqYUdgYkRMioh5wK3A/kXS/T/gIuCzcsrnYGhm1aEW/Ta5u6SxuSl/x/weLHnj6Klp2ee7krYFekXEveUWrzXvZ2hmtoQWDJ/MiIim+vmKZbP45jCSGoBLgWNbUDQHQzOrDlGxm7tOBXrl5nsC03LzqwFbAg+nWuZ6wEhJ+0XE2KYydTA0s6qp0EXXY4D+kvqR3UN1GHBk48qI+BDo/vk+9TDwg+YCIbjP0Myqprz+wlL3M0x3yRoOjAZeBkZExHhJF0jab1lL55qhmVVF42hyJUTEKGBUwbJzm0i7Zzl5OhiaWdXU6i7W5XAwNLOqqd9Q6GBoZlWitvKoUDOzUtxMNjPDzWQzM2Dlv7mrmVlJ2aU19RsNHQzNrGpcMzQzo7wbt9aKg6GZVYWbyWZmkO5nWOtCNM3B0MyqxsHQzAyQm8lm1tZV8OaurcLB0Myqpo5joYOhmVWPm8lt3EtP/pM7f3sBixYtYpd9D2Pvo08pmu65f4zi+p8M54xr/0zvzQbyyphHGfm7i1mwYB7t23dk/++cxabb71rl0rdN2/fqxom79aZB4sGXp3P7uLeXWD940+58a+devP/JPADuefE9HnxlOgDf3LkXO/TuRoPEc1M/5KrH/1318tcjAQ31GwvrIxhKGgL8FmgHXBsRv6xxkSpm0cKF3H7JT/nOpTeyxjrrcfHxB7DV7oNZv1//JdJ9Nmc2/7zjj/QdsM3iZat2+wInXXQN3bqvy7RJE7jy9GO58M9PVPsQ2pwGwSm79+Gceycw45N5XHrQFjw5eSZTZi75+N1HXv+A3z82eYllm6/blQHrdWX47S8CcNH+A9hqg9X417SPq1b++qW6rhnW/BkoktoBVwBDgQHAEZIG1LZUlTP55efp3rMP3Xv0pn2Hjmw/eF/+9dhDS6W775pLGHzkibTv2Gnxsl6bbEG37usCsH6/TZg/by7z582tWtnbqk3W6cq0j+byzsdzWbAoeOT199m575plbRtAx3YNtG8QHdL/s+bMb90CryjSdYblTLVQ82AI7AhMjIhJETEPuBXYv8ZlqphZ099hzXW0c5MEAAALHUlEQVTWXzy/xtrrM2v6u0ukmfLqeGa+9zZb7vaVJvMZ9/D99Ow/gA65YGmtY61VOzBj9udfOjNmz2OtVTsulW63fmty+aFbcvZeG9M9rX/l3dm88NZH3HTMttx09DY8O/VDpsz6bKlt26LG0eRyppJ5SUMkTZA0UdJZRdafLOlfksZJeqycClY9BMMewJTc/NS0bDFJJ0oaK2ns7FkfVLVwyy2WXpS/weWiRYu467ILOXD4j5vM4u1JrzLydxcx7MyftUYJrUDRj2LB6/jUm7P45p+eZ/jtLzLurQ85/csbArD+6p3otWYXvnHTOI65aRwDN1idLdZfrdXLvKJQmVOzeZTXmrw5IraKiG2Ai4BLSpWtHoJhsWNf4q0XEVdHxKCIGNR1jS9UqViVscY66zHzvc8732dNf5tu3ddZPD93zmzefuNVLjv1CH56yH/w5kvPcdUPT+Tfr7wAwMz33uaaH53M0ef8mrV79Kl6+duiGZ/Mp3vXz2vg3bt25P0585ZI8/HcBSxYlL1NR788nY27rwLALv3W5JV3Z/PZgkV8tmARz0yZxWbrrlq9wte7SkTDMlqTEfFRbnZVilZLllQPwXAq0Cs33xOYVqOyVFzvzQYyfcqbzJg2hQXz5/HMX+9lq90GL17fpevq/PK+Zzj/jkc5/45H6TtgW0761dX03mwgcz7+iN+fcRz7nXwGGw4cVMOjaFtefW82Pbp1Yt3VOtK+QXxxo7V46s1ZS6RZc5UOi//eqc+ai5vC02fPY6sNVqNB0K5BbLn+aksNvLRlKvMf0L2xNZimE3PZlGxNAkj6jqTXyWqGp5UqWz2MJo8B+kvqB7wFDAOOrG2RKqdd+/Ycevp5XHn6N4hFi9h5n0NZf8NNuO/aS+m92VZstfvgJrd95M4bmfHWZB644XIeuOFyAL5z6R9Zbc3u1Sp+m7Qo4HePTeb/7bMZDYKHJkzn3zM/5ahBPXht+ic8NXkW+225Ljv1XYOFi2D23AVc+o9JADw+6QO27rE6Vx62FRHwzJQPeXryrBJ7bDtaMDgyIyKaqgGUbE0CRMQVwBWSjgTOAb7RbNkiStYeW52krwG/Ibu05vqIaLJzrPdmW8WZ142sWtls+d3/r+m1LoK10KhTdnqmmWC0TDbfatu48S8Pl5V2x43WaHL/knYBzouIr6b5swEi4hdNpG8AZkZEt+b2WQ81QyJiFDCq1uUws9YjKvZ0vJKtSUn9I+K1NLsP8Bol1EUwNLM2oELXEEbEAknDgdF83pocL+kCYGxEjASGSxoMzAdmUqKJDA6GZlZFlbqeulhrMiLOzf393Zbm6WBoZtVTv7/GczA0s2qp798mOxiaWVX4rjVmZo0cDM3MfHNXMzPAt/03MwPqupXsYGhmVVLeHWlqxsHQzKoiG02u32joYGhmVVO/odDB0MyqqY6joYOhmVWNL60xM8OX1piZAXXdSnYwNLPqqODNXVuFg6GZVUcNHxBfDgdDM6uaOo6FDoZmVkV1HA0dDM2sSur75q718BB5M2sDGm/uWs5UMi9piKQJkiZKOqvI+tMlvSTpBUl/k9SnVJ4OhmZWPSpzai4LqR1wBTAUGAAcIWlAQbLngEERMRC4A7ioVNEcDM2salTmvxJ2BCZGxKSImAfcCuyfTxAR/4iIOWn2SaBnqUwdDM2saqTyphJ6AFNy81PTsqYcB9xfKlMPoJhZ1bRg+KS7pLG5+asj4upmsomi+5OOAgYBe5TaoYOhmVVHyy66nhERg5pYNxXolZvvCUxbanfSYODHwB4RMbfUDh0MzawqKvhzvDFAf0n9gLeAYcCRS+xL2ha4ChgSEe+Vk6n7DM2saiowmExELACGA6OBl4ERETFe0gWS9kvJLga6ArdLGidpZKmyuWZoZlVTqd8mR8QoYFTBsnNzfw9uaZ4OhmZWNfX8CxQHQzOrnvqNhQ6GZlY9dRwLHQzNrDokPyrUzCxTv7HQwdDMqqeOY6GDoZlVTx23kh0Mzaxa6vvmrg6GZlYV2c/xal2KpjkYmlnVOBiameFfoJiZ+bnJZmZQ3h1pasnB0Myqp46joYOhmVWNf45nZkZdVwwdDM2siuo4GjoYmlnV1POlNYoo+oS9uiVpOjC51uVoJd2BGbUuhLXIyvqa9YmItSuZoaQHyM5XOWZExJBK7r+UFS4YrswkjW3m8YhWh/yarTz8dDwzMxwMzcwAB8N6c3WtC2At5tdsJeE+QzMzXDM0MwMcDM3MAAdDMzPAwbBuSGpX6zJY+SRtKmkXSR382q0cPIBSY5I2iYhX09/tImJhrctkzZN0EPBz4K00jQVuiIiPalowWy6uGdaQpH2BcZJuBoiIha5l1DdJHYDDgeMi4ivAX4BewJmSVq9p4Wy5OBjWiKRVgeHAfwHzJP0vOCCuIFYH+qe/7wbuBToCR0p1fMM+a5aDYY1ExCfAt4CbgR8AnfMBsZZls6ZFxHzgEuAgSf8REYuAx4BxwO41LZwtFwfDGoqIaRExOyJmACcBXRoDoqTtJG1W2xJaEx4FHgSOlvTFiFgYETcDGwBb17Zotqx8P8M6ERHvSzoJuFjSK0A74Es1LpYVERGfSfoTEMDZ6UtrLrAu8HZNC2fLzMGwjkTEDEkvAEOBvSJiaq3LZMVFxExJ1wAvkdXqPwOOioh3a1syW1a+tKaOSFoTGAF8PyJeqHV5rDxpwCtS/6GtoBwM64ykzhHxWa3LYdbWOBiameHRZDMzwMHQzAxwMDQzAxwMzcwAB8OVkqSFksZJelHS7ZJWWY689pR0b/p7P0lnNZN2DUnfXoZ9nCfpB+UuL0hzg6RDWrCvvpJebGkZbeXnYLhy+jQitomILYF5wMn5lcq0+LWPiJER8ctmkqwBtDgYmtUDB8OV36PAxqlG9LKkK4FngV6S9pb0hKRnUw2yK4CkIZJekfQYcFBjRpKOlXR5+ntdSXdLej5NuwK/BDZKtdKLU7ozJI2R9IKk83N5/VjSBEl/BTYtdRCSTkj5PC/pzoLa7mBJj0p6Nd0WDUntJF2c2/dJy3sibeXmYLgSk9Se7Kd9/0qLNgVujIhtgU+Ac4DBEbEd2Q1KT5fUGbgG+E/gP4D1msj+MuCfEbE1sB0wHjgLeD3VSs+QtDfZra52BLYBtpf0RUnbA8OAbcmC7Q5lHM5dEbFD2t/LwHG5dX2BPYB9gN+nYzgO+DAidkj5nyCpXxn7sTbKv01eOXWRNC79/ShwHdkdVSZHxJNp+c7AAODxdAu+jsATwGbAGxHxGkC6i86JRfbxZeAYWHzLsQ/Tzwnz9k7Tc2m+K1lwXA24OyLmpH2MLOOYtpR0IVlTvCswOrduRPop3GuSJqVj2BsYmOtP7Jb2/WoZ+7I2yMFw5fRpRGyTX5AC3if5RcBDEXFEQbptyO7GUgkCfhERVxXs47+WYR83AAdExPOSjgX2zK0rzCvSvk+NiHzQRFLfFu7X2gg3k9uuJ4HdJG0MIGkVSZsArwD9JG2U0h3RxPZ/A05J27ZLt7z/mKzW12g08K1cX2QPSesAjwAHSuoiaTWyJnkpqwFvp9vuf71g3aGSGlKZNwQmpH2fktIjaZN0d3GzolwzbKMiYnqqYd0iqVNafE5EvCrpROA+STPI7uK8ZZEsvgtcLek4YCFwSkQ8IenxdOnK/anfcHPgiVQznU12m6tnJd1GdnfoyWRN+VJ+AjyV0v+LJYPuBOCfZPcTPDndb/Basr7EZ5XtfDpwQHlnx9oi36jBzAw3k83MAAdDMzPAwdDMDHAwNDMDHAzNzAAHQzMzwMHQzAyA/w/JPQnWLyTwIgAAAABJRU5ErkJggg==\n",
"text/plain": [
"<Figure size 432x288 with 2 Axes>"
]
},
"metadata": {
"needs_background": "light"
},
"output_type": "display_data"
}
],
"source": [
"class_names = hardbounce_dummy['flgHardBounce_n'].astype('str').unique()\n",
"aux_functions.plot_confusion_matrix(y_test, y_pred, classes=class_names, cmap=plt.cm.Blues, normalize=True)"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"### AVG Precision Score"
]
},
{
"cell_type": "code",
"execution_count": 36,
"metadata": {},
"outputs": [
{
"name": "stdout",
"output_type": "stream",
"text": [
"AVG Precision Score: 0.5958132213689207\n"
]
}
],
"source": [
"print(\"AVG Precision Score: \", metrics.average_precision_score(y_test, y_scores))"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"### AUC"
]
},
{
"cell_type": "code",
"execution_count": 37,
"metadata": {},
"outputs": [
{
"name": "stdout",
"output_type": "stream",
"text": [
"AUC: 0.8603\n"
]
}
],
"source": [
"auc_metric = metrics.roc_auc_score(y_test, y_scores)\n",
"print(\"AUC: %.4f\" % auc_metric)"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"### ROC Curve"
]
},
{
"cell_type": "code",
"execution_count": 38,
"metadata": {},
"outputs": [
{
"name": "stdout",
"output_type": "stream",
"text": [
"AUC: 0.8603\n"
]
},
{
"data": {
"image/png": "iVBORw0KGgoAAAANSUhEUgAAAfUAAAH8CAYAAADIRzbZAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADl0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uIDMuMC4zLCBodHRwOi8vbWF0cGxvdGxpYi5vcmcvnQurowAAIABJREFUeJzs3Xd0VNXexvHvnvRKSAKhEyCCgFIUkCo1otKk2BAFsVwBC6JeUVFBrwUuKip2X5ooCNJEeuei9F5CDx2SECA9mbbfPyYgIJABMjmZmd9nraxkZs7MPBGTJ2efffZRWmuEEEII4f5MRgcQQgghROGQUhdCCCE8hJS6EEII4SGk1IUQQggPIaUuhBBCeAgpdSGEEMJDSKkLIYQQHkJKXQg3opQ6pJTKUUplKqVOKaXGKaVCL9umqVJqqVIqQymVppSarZSqddk24UqpUUqpI/mvtT//dvRV3lcppV5USu1QSmUppY4ppaYqpW535fcrhLg+UupCuJ9OWutQoB5QH3jj/ANKqSbAQmAWUA6oAmwF/lRKVc3fxh9YAtQG7gXCgaZAKtDoKu/5OfAS8CIQCVQHZgIdrje8Usr3ep8jhHCOkhXlhHAfSqlDwNNa68X5t0cAtbXWHfJv/w/YrrXuf9nz5gEpWusnlFJPAx8A1bTWmU685y3AbqCJ1nrdVbZZDkzUWv+Yf7tPfs7m+bc18DwwEPAFFgCZWutXL3qNWcAKrfWnSqlywJfA3UAm8JnW+gsn/hMJ4dVkT10IN6WUqgDcB+zPvx2MY4976hU2nwLE53/dDpjvTKHnawscu1qhX4cHgLuAWsAvwMNKKQWglCoJ3ANMVkqZgNk4RhjK57//QKVU+5t8fyE8npS6EO5nplIqAzgKJAPv5t8fieNn+uQVnnMSOH+8POoq21zN9W5/NR9prc9orXOA/wEaaJH/WA9gtdb6BNAQKKW1fk9rbdZaHwR+AB4phAxCeDQpdSHczwNa6zCgFXArf5f1WcAOlL3Cc8oCp/O/Tr3KNldzvdtfzdHzX2jHcb/JwKP5d/UEfs7/ujJQTil17vwH8CYQUwgZhPBoUupCuCmt9QpgHDAy/3YWsBp48AqbP4RjchzAYqC9UirEybdaAlRQSjW4xjZZQPBFt8tcKfJltycBPZRSlXEMy0/Lv/8okKi1jrjoI0xrfb+TeYXwWlLqQri3UUC8Uqpe/u3BQO/808/ClFIllVL/AZoAw/K3+QlHcU5TSt2qlDIppaKUUm8qpf5RnFrrfcDXwCSlVCullL9SKlAp9YhSanD+ZluAbkqpYKVUHPBUQcG11puBFOBHYIHW+lz+Q+uAdKXU60qpIKWUj1LqNqVUwxv5DySEN5FSF8KNaa1TgAnA2/m3VwHtgW44joMfxnHaW/P8ckZrnYdjstxuYBGQjqNIo4G1V3mrF4HRwFfAOeAA0BXHhDaAzwAzkASM5++h9IJMys/yy0Xfkw3ohOOUvUQchw1+BEo4+ZpCeC05pU0IIYTwELKnLoQQQngIKXUhhBDCQ0ipCyGEEB7CZaWulBqjlEpWSu24yuNKKfVF/oUktiml7nBVFiGEEMIbuHJPfRyOi0VczX3ALfkfzwLfuDCLEEII4fFcdrUkrfVKpVTsNTbpAkzIX1lqjVIqQilVVmt9zeUoo6OjdWzstV5WCCGEcA92DaDROn91Jg06/3b+TXZs3Xxaa13Kmdcz8hKI5blo2UjgWP591yz12NhYNmzY4MpcQgghPIzdrjHb7ORZ7OTZbJitdsxWO3n5n802O7mWv++/sK3V5tjGZsdi1ZhtNiw2fWEbs9WO5eLPNo3Z+vc2jvsu3+7v5xdEaw1bOx129vs0stTVFe674knzSqlncQzRU6lSJVdmEkIIcZO01ljtjuLKtdjIOV+W+aV2vkzzrDZyzxenxVF6VrvGanM832a3X3idC+Wb/7zzr5V32WNmW/7j1kvfy2ovnmuy+Pua8Pcx4WNSFz58TQqTUviYwNdk4sh1vJ6RpX4MqHjR7QrAiSttqLX+HvgeoEGDBsXzX0YIIdyA3a7Js9rJyS/bHLPtQvHmmG1km61k5Do+MvOsZORayMyzkp5rJSvPSp7lysV5Ii0XkwIfk8JiK56/pv19TQT4mByffR2fz38E+PoQ6OcoWH9fE34+JgL9fC7dzsfx4ef79+cAHxN+vgp/Hx/8fNSF7S5s42O66D71j8d8TFfav4UpU6bwyy+/8OuvvxL4mvPfo5Gl/jvwvFJqMo6LOaQVdDxdCCE8mdaaXIudLLOV7Dyb47PZSlaeo2yzzZcWca7l73LONdvItZ4vZhtpOY4yttjsWG36wjBwrqXgId8bZddgzy90X5PC10cR5OdDkJ/PJQXqf1FhBvj6EOD3d8n6mkwX9lZ9fRQ+Sl1SvOefH3BRAZ9/LOCi17/8cX8fE0pduUCLm59//pknnniCpk2bYjabr+u5Lit1pdQkHJeGjFZKHcNxzWc/AK31t8Bc4H5gP5ANPHmj72WxWDh27Bi5ubk3G1sUE4GBgVSoUAE/Pz+jowhxVTa7JiPXQnqOlbQcy4WPLLOVXIuNrDwb57LNnMkyk2u1Y7noGGve+fI228jKy/9stlIUK3cH+JoI8ve5ULiBfj4E+Tv2VEP8fQkN8CUs0JewQD/CAn0Jzf86NMCHQN9/FvTFhRvoZ8LPZMJ0lT1QcW1jx47lqaeeolWrVsyePZuQEGcvpujgytnvjxbwuAYGFMZ7HTt2jLCwMGJjY93mLzFxdVprUlNTOXbsGFWqVDE6jvAidrsm02wlKS2Xo2ezOZtluaSsz2abOXQ6i9OZZtJzLGTkWQs9Q4CviZAAX4L9fQjx9yU4IP+zv6N4g/3zS/j8h78PAZfcduwFhwf6ER7oh5+vwtdkws9H4edjIsjPRwq3mBo7dix9+/blnnvuYcaMGQQHBxf8pMsYOfxeaHJzc6XQPYhSiqioKFJSUoyOItycxWYnKT2XpPRcTqblkpyex9lsc/6HhbRsC+dyzBf2tDNyLVzvfKqwQF9KBDkKtESQH+FBjr3aQD8Twf6+RAT7UTLYn2B/H/zyj6P6+SgCfH0IDbiotAN8CPbzwddHFvr0VvXq1eOxxx7jxx9/JDAw8IZewyNKHZBC9zDy7ymuxWy1czIth7QcCyfO5XDsbA4pGXmkZplJzczjTJaZ05lmTqXnYrvOlg4N8CU61J9KUSFEBjuK2lHWjs+Vo0IoWyKQ8EA/QgN9rzrRSQhn/fXXXzRt2pT69eszceLEm3otjyl1IYRnybXYLpT00TM57EvOYF9SJnuTMkg8neXUKUpKQUx4AGVKBFE2PJDS4QFEhvhTMtifiGA/IoL9iQj6u7jDAn1lT1kUqQ8//JC33nqLadOm0a1bt5t+PSn1YuzQoUN07NiRHTt2sHz5ckaOHMkff/xRaK/9119/0bNnTwA2bNjAhAkT+OKLL5x+jaeffppBgwZRq1atm8px/nsU3sVm1xxIyWTPqQx2nEjj8OlskjJyych1DIWfzsy75qSxciUCiQj2p1xEIOUigogJDyQ61J/IEEdxR4X4UzYikABfn6L7poRwktaaYcOGMWzYMB577DE6d+5cKK8rpe4CWmu01phMxfcv/kOHDvHLL79cKPUGDRrQoEGD63qNH3/80RXRhIfRWnPkTDY7T6SzcOcpciw2DqZksS8585rP8zEpSocHUCLIjwolg4krHcotpUOpHhNGtdIhBPvLry/hnrTWvPnmm3z88cf06dOHH3/8ER+fwvnj0+N+KmIHz3HJ6x76uMO1Hz90iPvuu4/WrVuzevVqBg4cyLfffkteXh7VqlVj7NixhIaGsn79el566SWysrIICAhgyZIlpKam8vjjj5OVlQXA6NGjadq06XXlO3PmDH379uXgwYMEBwfz/fffU6dOHYYOHcqBAwc4fvw4R48e5d///jfPPPMMgwcPJiEhgXr16tG7d2/q169/YSRg6NChJCYmcvLkSfbu3cunn37KmjVrmDdvHuXLl2f27Nn4+fnRqlUrRo4cyYkTJ3jnnXcAyMnJwWw2k5iYyMaNGxk0aBCZmZlER0czbtw4ypYty8aNG+nbty/BwcE0b978xv5BRLFkttpJPJ3FpiNn2Xr0HDtPpLMvOeOa50a3q1mammXDiSsdSvmIIMLzh8FLhQbIULjwSJs2bWL48OH861//4uuvvy7UHUCPK3Uj7dmzh7Fjx/Lee+/RrVs3Fi9eTEhICMOHD+fTTz9l8ODBPPzww/z66680bNiQ9PR0goKCKF26NIsWLSIwMJB9+/bx6KOPXvf69u+++y7169dn5syZLF26lCeeeIItW7YAsG3bNtasWUNWVhb169enQ4cOfPzxx5cM5y9fvvyS1ztw4ADLli1j165dNGnShGnTpjFixAi6du3KnDlzeOCBBy5s27lz5wtDRw899BAtW7bEYrHwwgsvMGvWLEqVKsWvv/7KW2+9xZgxY3jyySf58ssvadmyJa+9dh1LJYliQ2vNibRcEk6ks/tUOgknM0g4mc6h1Kwrzh4PD/QlMsSf+28vS2igL42rRnFL6VDCAmUdAuF97rzzTv78808aN25c6JOCPa7UC9qjdqXKlSvTuHFj/vjjD3bt2kWzZs0AMJvNNGnShD179lC2bFkaNmwIQHh4OABZWVk8//zzbNmyBR8fH/bu3Xvd771q1SqmTZsGQJs2bUhNTSUtLQ2ALl26EBQURFBQEK1bt2bdunVERERc8/Xuu+8+/Pz8uP3227HZbNx7r+MqurfffjuHDh264nNGjBhBUFAQAwYMYMeOHezYsYP4+HgAbDYbZcuWJS0tjXPnztGyZUsAHn/8cebNm3fd368oWmarne3Hz7Eu8SzrD51h4+GzpOVY/rGdSUGlyGBqlwunQWwkt5ULp0aZMCKC/Q1ILUTxYbfbeemll+jQoQP33nsvTZo0ccn7eFypG+n8yj9aa+Lj45k0adIlj2/btu2Kf5V99tlnxMTEsHXrVux2+w2dn6ivMKPo/Htd/p7O/GUYEBAAgMlkws/P78JzTCYTVus/F9xYsmQJU6dOZeXKlRfy1K5dm9WrV1+y3blz5+R0NTdx7Gw2aw6eYdGuUyzYmfSPx0sG+1GzbPiFj1vLhHFLTKhMTBPiMjabjaeeeorx48cTFRV1YSfJFaTUXaBx48YMGDCA/fv3ExcXR3Z2NseOHePWW2/lxIkTrF+/noYNG5KRkUFQUBBpaWlUqFABk8nE+PHjsdls1/2ed999Nz///DNvv/02y5cvJzo6+sJIwKxZs3jjjTfIyspi+fLlfPzxx5w8eZKMjIxC+X4PHz5M//79mT9/PkFBQQDUqFGDlJQUVq9eTZMmTbBYLOzdu5fatWtTokQJVq1aRfPmzfn5558LJYO4OTlmG2sSU9l5PI2EUxlsO3aOo2dyLtnG39dE57rlaBYXRcPYSMpHBMkfaEIUwGq10rt3b3755ReGDRvG22+/7dL3k1J3gVKlSjFu3DgeffRR8vLyAPjPf/5D9erV+fXXX3nhhRfIyckhKCiIxYsX079/f7p3787UqVNp3br1da/1CzB06FCefPJJ6tSpQ3BwMOPHj7/wWKNGjejQoQNHjhzh7bffply5cpQqVQpfX1/q1q1Lnz59qF+//g1/v+PGjSM1NZWuXbsCUK5cOebOnctvv/3Giy++SFpaGlarlYEDB1K7du0LSyEGBwfTvn37G35fcePSsi2OEj+RzuYjZ1mbeAaz9dLJbGGBvtxVJYpmcVG0qxlDxcjrX7JSCG9msVjo2bMnv/32Gx999BGDBw92+XuqKw3bFmcNGjTQl08iS0hIoGbNmgYlKt6GDh1KaGgor776qtFRrpv8uxYerTUJJzNYl5jK8r0prNp3+h+Lt9StUII7K0dStVQI9SpGULNsuKyWJsRNsNvt9OvXjxo1ajBo0KAbfh2l1EattVPnHMueuhAe6kBKJiv3prA/OZM/95/mUGr2hcd8TIq7qkRSr2IEcaVDubt6KWLCb2ytaSHEpXJzc0lOTqZSpUp8++23RXqYSkrdzYwdO5bPP//8kvuaNWvGV199dcXthw4dWgSpRHFhtdlZfTCV8X8dYnFC8iWPRYX407J6Ke6MLUl8rRhKh0mJC1HYsrOz6dKlC/v372fXrl0X5hkVFSl1N/Pkk0/y5JM3fOl54YGsNjvrEs8we9tJFuw8xZksM+C4hGfDWMdweue65ahXMUIWcxHChTIzM+nUqRMrVqxg7NixRV7o4EGlrrWWmbgexN3mehQ1m12zLvEMc7afYP6OU5zONF94rGqpEDrWKUfPRpUoU0L2xoUoCunp6dx///2sWbOGiRMnXliCu6h5RKkHBgaSmppKVFSUFLsH0FqTmpp6w9cT9lRaa3aeSGfO9pNM3XD0kiKvEh1Cxzpl6VCnLDViwuTnQIgi9vrrr7N27VomT55Mjx49DMvhEbPfLRYLx44dIzc316BUorAFBgZSoUIF/Py8exnRPKuNvw6ksnBnEkt3J5GUnnfhsUqRwReKvFbZcClyIQx07tw5NmzYQLt27Qr9tb1u9rufnx9VqlQxOoYQhUJrzcJdSczeeoLle1LIzPt7Bb+Y8ADa1YyhS73yNIwtKUUuhIGSk5MZNmwYI0eOJCIiwiWFfr08otSF8BQbD5/lP3N2sfnIuQv31Swbzj21YoivFUOtsuGY5NxxIQx36tQp2rZtS2JiIr1796ZRo0ZGRwKk1IUwXFaelcUJSXy/8iA7T6QDEB0awLN3V+G+28rKSm5CFDPHjx+nTZs2HD9+nHnz5hWbQgcpdSEMYbXZWZyQzKwtx1m6O5m8i5Zofbp5FQbGVyc0QH48hShujhw5Qps2bUhOTmbBggUXrsZZXMhvDSGKUK7FxszNx/ly6X6On/v7gil3Vi5J57rlaF+7jJyGJkQxlpGRgclkYtGiRdx1111Gx/kHKXUhikDi6SzGrEpk2qZjZJsdV+GLDvWnT9NYHqhfngolZYhdiOIsJSWF6Ohoateuza5du/D1LZ71WTxTCeEhdhxPY9TivSzZncz5s0frVCjBk81i6VK3vEx6E8INJCQk0LZtW1588UUGDx5cbAsdpNSFKHR2u2blvhRGLd7HlqOOWez+via61itPn2ax1CwbbnBCIYSzduzYQdu2bVFK0alTJ6PjFEhKXYhCYrHZWbQrieHzd3M4/4pooQG+PNqoIs/eXY1SYQEGJxRCXI/NmzcTHx9PQEAAS5cupUaNGkZHKpCUuhCFYM3BVN6cvp2Dp7MAKBMeSK/GlXiqeVWC/H0MTieEuF4ZGRm0b9+e4OBgli5dSlxcnNGRnCKlLsRN2J+cwcfzdl+4zGmlyOALZe4jx8uFcFthYWF8++233HHHHcTGxhodx2lS6kLcgJSMPD5bvJdf1x/FZtcE+/vwr7ur8VyrqgT4yp65EO7qf//7H2fPnqVz585069bN6DjXTUpdiOv0v30p/Pu3bZxMy8XHpHjsrkoMbFddjpkL4eaWLFlC586diYuLo0OHDvj4uN8f6FLqQjhp27FzfLpoL8v3pABQt2IEI7rXoUaZMIOTCSFu1oIFC3jggQeIi4tj4cKFblnoIKUuRIFsds33Kw8yfP5uwDGjvU/TWAa0jpNJcEJ4gNmzZ9OjRw9q1arFokWLiI6ONjrSDZNSF+Iajp7J5tmfNpJwMh0fk6Jvs1j6tYojMsTf6GhCiEKyYsUK6tSpw4IFC4iMjDQ6zk2RUhfiCrTWTNt0nKG/7yQzz0pEsB8fPHA7HeqUNTqaEKKQ5OTkEBQUxH//+1+ys7MJCQkxOtJNMxkdQIjiZsfxNB76bjWvTt1KZp6V+24rw7JXWkmhC+FBfvrpJ2rUqEFiYiJKKY8odJA9dSEuyLPa+Gn1YT5btJcss40SQX4M6VCTHndWQCk551wITzFmzBiefvppWrduTenSpY2OU6ik1IXAsXf+ypSt7EnKAKDtraX59OF6lAjyMziZEKIwffPNN/Tv35/27dszY8YMgoKCjI5UqKTUhVez2Ox8v/Igny3ai9WuiY0K5o37a9K+dhmjowkhCtnUqVPp378/HTt2ZOrUqQQGBhodqdBJqQuvpLVm6e5khs/fzd6kTAD6NI3l9XtvldPUhPBQ9957L2+//TZDhgzB398zz2CRUhdeZ9uxc7w3excbDp8FICzAl9GP3UHL6qUMTiaEcIXx48fTvXt3wsLCeO+994yO41JS6sJraK35Zd0R3p21E6tdExHsxzMtqtKnaSwhAfKjIISn0Vrz7rvv8v7775OUlMS///1voyO5nPwmE17hdGYeg6dtZ3FCEgDd76jA0M61CAuUiXBCeCKtNW+88QbDhw+nb9++vPLKK0ZHKhJS6sLjzdpynGGzd3Emy0xYoC//vvdWHm9c2ehYQggX0VozaNAgRo0aRb9+/Rg9ejQmk3csyyKlLjyW1ppPF+3ly6X7AbirSiT/7VGXSlHBBicTQrhSUlISkydP5qWXXuKzzz7zqnUmpNSFRzJb7Qyevo3pm47jY1IM7VSLXo0re9UPtxDexm63o5SiTJkybN68mZiYGK/7mZdSFx7nQEom/SZuZG9SJkF+Pnz92B20vtWzVo0SQlzKZrPRt29foqKi+OSTTyhTxjvXmvCOgwzCa8zZdpJOX65ib1ImVaJDmPKvJlLoQng4q9VKr169mDBhAiVLlvS6vfOLyZ668BgzNh/jlSlbsWvoWKcsH3evQ6icqiaER7NYLDz66KNMmzaN4cOHe8Vpa9civ/GE27PbNR/MTeD/ViUCMCi+Oi+0ifPqv9aF8BY9e/Zk2rRpfPbZZwwcONDoOIaTUhduLT3XwqBft7A4IRmTgoHtqvNi21uMjiWEKCKPPvoorVu3pn///kZHKRak1IXb2nMqg8f/by3JGXmUCPLji0fry1KvQniBrKws1qxZQ9u2benWrZvRcYoVKXXhlv46cJq+49aTa7ETFuDLzAHNqBIdYnQsIYSLZWRk0LFjR9auXcuBAwcoX7680ZGKFSl14XZ2nUjn6fEbyLXY6Vy3HMO715ErqwnhBdLS0rj//vtZu3YtEydOlEK/Ail14VZOZ+bxzIQNZJttdKlXjk8fqoePSSbECeHpzp49y7333sumTZv49ddf6d69u9GRiiUpdeE20nMtPPzdao6fy6FuxQiGd68jhS6El/j555/ZsmUL06ZNo3PnzkbHKbak1IVbsNs1b0zbzoGULCpFBvP943cS6CdD7kJ4iwEDBtCmTRtq1apldJRiTVaUE25h5MI9zNl+khB/H8b0aUhMeKDRkYQQLnby5Elat25NQkICSikpdCdIqYti77NFe/l6+QFMCr7pdSdxpUONjiSEcLHjx4/TqlUr1q9fT0pKitFx3IYMv4tiy2bXvP/HLsb9dQiTgv/2qMvdch66EB7v8OHDtGnThpSUFBYsWECzZs2MjuQ2pNRFsZSZZ+X5XzaxfE8K/j4mPnmoLp3qljM6lhDCxY4cOcLdd99Neno6ixcvplGjRkZHcisy/C6Kncw8Kz1/WMPyPSmUDPbjp6caSaEL4SWio6Np2LAhS5YskUK/AbKnLoqVlIw8ev6whn3JmVSKDGZC30bEykpxQni8vXv3EhMTQ4kSJfjtt9+MjuO2ZE9dFBtWm50XJm1iX3ImVaND+OkpKXQhvMG2bdto3rw5ffv2NTqK25NSF8WCza55Y/p21hw8Q6mwACY/25jKUVLoQni6TZs20bp1a/z9/fnoo4+MjuP2pNSF4ex2zStTtjB14zECfE181fMOSst56EJ4vHXr1tG2bVtCQ0NZsWIF1atXNzqS25NSF4bSWvP+nF3M3HICgLFPNqRRlUiDUwkhXM1ut9O3b18iIyNZuXIl1apVMzqSR5CJcsJQoxbvY+yfh/AxKb7tdSdNq0UbHUkIUQRMJhMzZ84kMDCQChUqGB3HY8ieujDM/B2n+HzJPkwKPn+kHvG1YoyOJIRwscWLFzNo0CC01sTFxUmhFzLZUxeGSDiZzitTtgAw+L5b6VhHzkMXwtPNmzePrl27Ur16ddLT0ylRooTRkTyO7KmLInc2y0zvMevIMtvoXLccz7SoanQkIYSL/f777zzwwAPUqlWLZcuWSaG7iJS6KHIfzUsgOSOP6jGhjOhRB6XkmuhCeLJp06bRvXt36tWrx5IlS4iKijI6kseSUhdFavmeZKZsOIafj+KbXnJNdCG8QWBgIC1atGDRokWULFnS6DgeTUpdFJmk9FxembIVgIHtqlOtlFxCVQhPlpiYCECHDh1YsmQJ4eHhBifyfFLqokjY7JqXf91CapaZ5nHR9Gsp56QK4cl+/PFHqlevzqJFiwDkMFsRkVIXReLbFQf460Aq0aH+fPpwXUwm+QEXwlN9/fXXPPPMM7Rr147mzZsbHcerSKkLl/ts0V7+u2APACMfrEvpMFkCVghPNWrUKAYMGECnTp2YOXMmQUFBRkfyKlLqwqXm7zjFF0v3AfBa+xq0qlHa4ERCCFf566+/ePnll+nevTu//fYbAQEBRkfyOi4tdaXUvUqpPUqp/UqpwVd4vJJSaplSarNSaptS6n5X5hFFa8fxNF6ZsgWt4eV21RnQOs7oSEIIF2rSpAmTJ09m0qRJ+Pv7Gx3HK7ms1JVSPsBXwH1ALeBRpVStyzYbAkzRWtcHHgG+dlUeUbROpeXSZ+x6ssw2utYvz4ttpdCF8ERaaz766CO2bt2KUoqHH34YPz8/o2N5LVcuE9sI2K+1PgiglJoMdAF2XbSNBs6f41ACOOHCPKKI5Flt/GviRk5n5tGkahTDu8sCM0J4Iq01r7/+Ov/97385c+YMdevWNTqS13NlqZcHjl50+xhw12XbDAUWKqVeAEKAdld6IaXUs8CzAJUqVSr0oKLw2OyalyZtYevRc5QJD+TzR+vh7ytTN4TwNFprXn75ZT7//HP69+/P8OHDjY4kcO0x9SvtmunLbj8KjNNaVwDuB35SSv0jk9b6e611A611g1KlSrkgqigsH85NYP7OU4QF+jKmT0OZ6S6EB7Lb7QwYMIDPP/+cgQMHMnr0aEwm+eO9OHDlv8IxoOJFtyvwz+GWhHdrAAAgAElEQVT1p4ApAFrr1UAgIBfUdlOpmXlMWncEgG973UmtcrJ6lBCeyGq1cuDAAV5//XU+/fRTObxWjLhy+H09cItSqgpwHMdEuJ6XbXMEaAuMU0rVxFHqKS7MJFzo/T92kW22UT0mlGZx8reZEJ7GarWSlZVFiRIlmD17Nn5+flLoxYzL9tS11lbgeWABkIBjlvtOpdR7SqnO+Zu9AjyjlNoKTAL6aK0vH6IXbmD6pmPM3HKCAF8TPzzRwOg4QohCZrFY6NWrF23btiUvLw9/f38p9GLIlXvqaK3nAnMvu++di77eBTRzZQbheodOZzFk5g4A3u5Yi8pRIQYnEkIUJrPZzCOPPMKMGTMYMWKELCpTjLm01IXn01rz7E8byDbb6FinLL0aVzY6khCiEOXl5dGjRw/++OMPRo0axUsvvWR0JHENUuripoz/6xB7kzIJD/TlPw/cZnQcIUQhe+GFF/jjjz/45ptveO6554yOIwogpS5u2NqDqbz3h2MtocH31SQiWJaFFMLTvPnmm7Rq1YqePS+f5yyKIzmxUNwQrTUfztuNXcNzLavR8y5ZFEgIT5GRkcHIkSOx2+3ExsZKobsRKXVxQxbtSmLr0XNEhfjLuu5CeJC0tDTat2/P4MGD2bBhg9FxxHWS4Xdx3dJyLLw9yzHbvV+ragT7y/9GQniCs2fP0r59e7Zs2cKUKVNo1KiR0ZHEdZLfxuK6aK15c/p2ktLzqFcxgj5NY42OJIQoBKdPnyY+Pp5du3Yxffp0OnbsaHQkcQOk1MV1mbD6MHO2nyTE34eRD9bF10eO4AjhCRISEjh8+DC///477du3NzqOuEFS6sJpiaez+GBuAgDDe9QhrnSowYmEEDcrLy+PgIAAWrRoQWJiIiVKlDA6krgJspslnGK3O4bdzVY7neqWo2OdckZHEkLcpKNHj1KnTh3Gjx8PIIXuAWRPXThlzJ+JrD6YSlSIP+91rm10HCHETTp06BBt2rQhNTWV6tWrGx1HFBIpdVGg5IxcRizYA8CQjjUpGSKLzAjhzvbv30+bNm3IyMhg8eLFNGzY0OhIopBIqYsCjfvzEGarnSZVo3igXnmj4wghbsLZs2dp2bIleXl5LFu2jHr16hkdSRQiOaYurulkWg5j/zwEwLN3V5VLLQrh5kqWLMmrr77K8uXLpdA9kOypi6vSWvPG9O3kWGy0rx1D61tLGx1JCHGDtm7disVioUGDBrz88stGxxEuIqUurmrapuMs35NCeKAv73WRK7AJ4a42btxIfHw8FStWZPPmzZhMMkjrqeRfVlxRUnou783eCcC7nWoTEx5ocCIhxI1Yu3Ytbdu2JTw8nJkzZ0qhezj51xVX9NaM7aTnWmlza2m63SGT44RwR6tWrSI+Pp7o6GhWrlxJlSpVjI4kXExKXfzD8j3JLE5IJjTAlw+73i6T44RwU9988w1ly5ZlxYoVVKokl0f2BnJMXVwi12Jj6O+OYfcBreMoU0KG3YVwN3a7HZPJxJgxY0hLS6N0aZnk6i1kT11c4vuVBzmUmk1c6VCeai5DdUK4m7lz59KkSRNSU1MJCAiQQvcyUurigj2nMhi1eC8A73e5DX9f+d9DCHcya9YsHnjgAaxWq9FRhEHkt7YAHOekD/19J3YNXeuXp0m1KKMjCSGuw2+//UaPHj2oX78+S5YsISpKfoa9kZS6AGDBziRWH0zF16R4rX0No+MIIa7DrFmzeOSRR7jrrrtYtGgRERERRkcSBpFSF5itdv67YDcAQzrUpFxEkMGJhBDXo0GDBvTq1Yv58+cTHh5udBxhICl1wYzNxziQkkWV6BAevUtOexHCXSxevBibzUb58uUZN24coaGhRkcSBpNS93LZZitfLTsAQL+W1Qjw9TE4kRDCGV999RXx8fF8+eWXRkcRxYiUupcbMX8PR85kc2uZMLrKynFCuIXPPvuM559/ni5dutCvXz+j44hiRErdi+VabEzZcBSATx6qi5+P/O8gRHH38ccfM2jQIHr06MHUqVMJCAgwOpIoRuS3uBdbuCuJbLON28qHU7tcCaPjCCEKcOTIEd5//3169uzJpEmT8PPzMzqSKGZkmVgvpbXmx/8dBODhBhUNTiOEcEalSpVYu3YtNWvWxMdH5r+If5I9dS+1/tBZth1Lo2SwHz3ulFIXorjSWvPaa6/x9ddfA3DbbbdJoYurklL3Ut+vdOylP964MkH+8gtCiOJIa81LL73EyJEjSUhIMDqOcANS6l5oXeIZFick4WtSPNE01ug4QogrsNvt9OvXjy+//JJBgwbxxRdfGB1JuAEpdS+TlJ5Lv4kbAXjsrkpEh8rMWSGKG601zzzzDN999x1vvPEGI0eORClldCzhBqTUvcyw2TtJzTLTKDaSIR1rGR1HCHEFSilq167Nu+++ywcffCCFLpwms9+9yKHTWSzcmQTAf7reJuelC1HMWCwW9u7dS+3atRk0aJDRcYQbkt/qXuTTRXux2jUP3lmB6jFhRscRQlzEbDbz8MMP07RpU5KSkoyOI9yU7Kl7iV0n0vl96wn8fUwMjK9udBwhxEVyc3Pp0aMHc+bM4YsvviAmJsboSMJNSal7iZEL9wDwWONKlJdLqwpRbGRnZ9O1a1cWLlzId999x7PPPmt0JOHGpNS9wJ/7T7N0dzIh/j4MaB1ndBwhxEVGjRrFokWLGDNmDE8++aTRcYSbk1L3cFabnff/2AVA/9ZxcgqbEMXMa6+9RpMmTWjdurXRUYQHkIlyHm7y+qPsPpVB+Yggnmpexeg4Qgjg3Llz9O7dm6SkJPz8/KTQRaGRUvdgaTkWPl20F4A3769JoJ8sByuE0c6cOUO7du2YNGkSW7ZsMTqO8DAy/O7BRi/dx5n8hWbuv72M0XGE8HopKSnEx8eze/duZsyYQfv27Y2OJDyMlLqHSk7PZfzqwwC83bGWrEglhMGSkpJo27YtBw4c4Pfff+eee+4xOpLwQFLqHmrkwj2YrXburV2G2yuUMDqOEAIICgpizpw5tGnTxugowkNJqXugw6lZzNh8HIDnWlUzOI0Q3u3UqVNERUURExPD2rVrMZlkKpNwHfm/ywP9Z04CFpuma/3y1KsYYXQcIbxWYmIiTZo0oV+/fgBS6MLl5P8wD/PXgdMs2pVEiL8Pb9x3q9FxhPBa+/fvp2XLlqSlpfHcc88ZHUd4CRl+9yB2u+aDOQkA9GtVjdLhgQYnEsI77d69mzZt2mCxWFi6dCn16tUzOpLwElLqHmT65uPsPJFO2RKBPNW8qtFxhPBKVquVzp07Y7fbWbZsGbfddpvRkYQXkVL3EDlmG18u3QfAq/fUIMhfFpoRwgi+vr6MGzeOyMhIbr1VDoGJoiXH1D3EL+uOcDg1m7jSoXSpV87oOEJ4nQ0bNvDVV18B0LRpUyl0YQgpdQ9gttr58X8HAXj93lvx9ZF/ViGK0po1a2jbti0jR44kMzPT6DjCi8lvfw8wa8txTqblckvpUNreWtroOEJ4lVWrVhEfH0+pUqVYsWIFoaGhRkcSXkxK3c3Z7ZpvVxwA4LmW1TCZZDlYIYrKsmXLaN++PeXLl2flypVUqlTJ6EjCy0mpu7lFCUkcSMmiXIlAOsuxdCGK1J49e6hatSorVqygXDn5+RPGk1J3Y1prvlnu2Et/5u6q+MmxdCGKRFpaGgDPPfccGzZsICYmxuBEQjg43QJKqXClVA2lVCUll/wqFlbtP82Wo+coGezHww0rGh1HCK8wY8YMYmNjWbduHQABAQEGJxLib9c8T10pFQb0A3oCocBpIBCIUkqtAr7WWv/P5SnFFX2/0jHj/anmVQj2lyUHhHC1KVOm0LNnTxo2bEiNGjWMjiPEPxTUBDOAn4G2WuvU83fm76k3Ah5XSt2itR7jwoziCrYfS+N/+04T4u9Dr8aVjY4jhMebOHEivXv3pmnTpsydO5ewsDCjIwnxD9csda11u6vcr4G1+R/CAN+s2A9Az7sqERHsb3AaITzbihUreOKJJ2jVqhWzZ88mJCTE6EhCXFFBw+91rvW41npb4cYRzjiQksm8Hafw9zHxdAtZ410IV2vevDnDhw9nwIABBAcHGx1HiKsqaPj9q2s8poG7CzGLcNJXS/ejNXS/szwxciU2IVxm3LhxxMfHU758eV577TWj4whRoIKG31sUVRDhnOPncpi19QQ+JkX/VnFGxxHCY33yySe8+uqrDBw4kM8++8zoOEI4paDh987Xelxr/XvhxhEFGbMqEZtd06VeOSpGyjCgEK7w4Ycf8tZbb/HQQw8xYsQIo+MI4bSCht8fvMZjGpBSL0Jp2RYmrTsCwLN3y7F0IQqb1pphw4YxbNgwevXqxdixY/H1ldNFhfsoaPj98aIKIgo2ce1hss02msdFU7tcCaPjCOFxcnJymD59Ok8++SQ//PADPj4+RkcS4ro4/SeoUqo9UBvH4jMAaK0/dEUo8U+5Fhtj/zwEwL9ayl66EIVJa43VaiU4OJiVK1cSHh6OySTLLgv349T/tUqpr4HewCAgCOgFyCytIvTHtpOczsyjVtlwmsdFGx1HCI9ht9t58cUXefDBB7FarUREREihC7fl7P+5zbXWPYFUrfXbwF1ABdfFEhfTWvN/qxIB6NM0Fll6X4jCYbfbee655xg9ejS33HKLDLcLt+dsqefkf85VSpUBcoFYlyQS/7BibwoJJ9OJDg2Qy6sKUUhsNht9+/blhx9+4M0332TEiBHyB7Nwe84eU5+nlIoARgJbABswwWWpxAVaa75Ysg+Ap1tUIdBP9iSEKAwvvPAC48ePZ9iwYbz99ttS6MIjOFXqWuuh+V9OVUr9AQRprc+4LJW4YOnuZDYdcVxe9XG5cIsQhaZv377ExcUxaNAgo6MIUWicnSj3XP6eOlrrHEArpZ51aTKB2Wpn2OxdADzf5hZCAuR8WSFuRl5eHlOnTgWgQYMGUujC4zh7TP05rfW58ze01mdxXGdduNC0Tcc4ciabipFB9Gpcyeg4Qri13NxcunXrxkMPPcTmzZuNjiOESzhb6pccyFVKmQC/gp6klLpXKbVHKbVfKTX4Kts8pJTapZTaqZT6xck8Hs9qs/PN8gMA9GsZR4CvHEsX4kZlZ2fTqVMn5s2bx3fffUf9+vWNjiSESzg7nrtIKTUJ+BbH8rD9gMXXeoJSygfHVd7igWPAeqXU71rrXRdtcwvwBtBMa31WKVX6Br4HjzTmz8QLe+nd7yxvdBwh3FZmZiadOnVixYoVjBkzhj59+hgdSQiXcbbUXwP6Ay8DClgIfFfAcxoB+7XWBwGUUpOBLsCui7Z5BvgqfzgfrXWy89E9V1ae9cJe+nudb5O9dCFuwrJly1i1ahUTJ06kZ8+eRscRwqWcnf1uU0p9B8zTWu938rXLA0cvun0Mx6I1F6sOoJT6E8cQ/1Ct9XwnX99j/bz2MGezLdxRKYJWNUoZHUcIt6S1RilFp06d2LdvH7GxsUZHEsLlnJ393hHYDizKv11PKTWjoKdd4T592W1f4BagFfAo8OP5WfaXvf+zSqkNSqkNKSkpzkR2W9lmK6OXOv5uer5NnJw7K8QNSE1NpUWLFixe7DhKKIUuvIWzE+WG4djLPgegtd5CwWu/HwMqXnS7AnDiCtvM0lpbtNaJwB4cJX8JrfX3WusGWusGpUp59p7rrC0nSM+1UrdiBG1ujTE6jhBuJzk5mTZt2rBhwwbMZrPRcYQoUs6WuuXiU9ryXb7Xfbn1wC1KqSpKKX/gEf55/fWZQGsApVQ0juH4g05m8jhaayasPgxAn6ay0IwQ1+vkyZO0bt2affv2MXv2bO6//36jIwlRpJydKJeglHoIMCmlqgAvAWuu9QSttVUp9TywAMfx8jFa651KqfeADVrr3/Mfu0cptQvH0rOvaa1Tb/SbcXcbD58l4WQ6USH+3H97WaPjCOFWUlNTadWqFcePH2fu3Lm0atXK6EhCFDlnS/154B3ADkzHMfv9zYKepLWeC8y97L53Lvpa47icqyzrBIzP30t/pFFFmfEuxHUqWbIk99xzD4888gjNmjUzOo4QhnB29nsW8Hr+BwBKqQpAtotyeZ3kjFzm7ziJSUHPu2ToXQhnJSYmYjKZqFy5Ml9++aXRcYQwVIHH1JVSDZVSD+Qf80YpVVspNYECht/F9Zm87igWm6ZdzRjKRwQZHUcIt7Bv3z7uvvtuevTogWPgTwjvds1SV0p9BPwMPAbMV0q9BSwDtpJ/jrm4eRabnV/WHgHgiSaxxoYRwk0kJCTQsmVLcnNz+fHHH+X0TyEoePi9C1BXa52jlIrEcUpaXa31HtdH8x6LdiVxKj2XqqVCaBYXZXQcIYq9HTt20LZtW5RSLF++nNq1axsdSYhioaDh99z8S62Sf/303VLohW/C6kMAPNG4suxtCOGEV199FV9fX1asWCGFLsRFCtpTr6qUmp7/tQJiL7qN1rqby5J5ib1JGaw5eIZgfx+63VnB6DhCuIVffvmFc+fOUbVqVaOjCFGsFFTq3S+7PdpVQbzVT/mnsXWtX57wwAKvZiuE1/rrr7/4/PPPGT9+PJGRkURGRhodSYhi55qlrrVeUlRBvFFGroXpm44BMkFOiGtZuXIlHTp0oGzZspw9e5ayZWVxJiGupKDZ7zOVUvcppf5R/kqpykqpd5RSfV0Xz7NN33ScLLONu6pEUqNMmNFxhCiWlixZwn333UeFChVYsWKFFLoQ11DQ8PsA4BXgK6VUEpACBAJVgSM4roU+zbURPZPWmp/WOIbeZS9diCtbtGgRnTt3Ji4ujsWLFxMTIxc5EuJaChp+P07+Mq5KqTigLJAD7NFaZxRBPo+1+kAq+5MziQkP4J7a8otKiCspXbo0zZo1Y/LkyURHRxsdR4hiz9m139Fa7wf2uzCLV5m8/igAjzaqhJ+PsxfLE8I77Ny5k9q1a1O3bt0L10QXQhRM2sQAuRYbixOSAOhWX05jE+JikydPpm7duowZM8boKEK4HSl1Ayzfk0y22UbdCiWoFBVsdBwhio2ffvqJxx57jKZNm/Lggw8aHUcIt+N0qSul/POPq4ub9Me2kwB0qCOzeIU4b8yYMfTu3ZtWrVoxb948wsLkjBAhrpdTpa6U6gBsBxbl366nlJrhymCeKsdsY0lCMgD33y6lLgTAwYMHefbZZ7nnnnv4448/CAkJMTqSEG7J2Yly7wF34bhCG1rrLbLXfmPmbj9JjsVG3YoRVCgpQ+9CAFStWpV58+bRokULAgMDjY4jhNtydvjdorU+d9l9cvHiGzBj83EAetxR3uAkQhjv008/Zc6cOQDEx8dLoQtxk5wt9QSl1EOASSlVRSk1CljjwlweKSUjjz8PnMbfx0TnelLqwrt98MEHvPLKK0yZMsXoKEJ4DGdL/XngTsAOTAdygZdcFcpTLdh5Cq2hxS3RlAiSi7cI76S15t1332XIkCE8/vjj/N///Z/RkYTwGM4eU2+vtX4deP38HUqpbjgKXjhp3g7HrPf7ZIKc8FJaa9544w2GDx9O3759+f777/Hx8TE6lhAew9k99SFXuO+twgzi6VIy8lh9IBVfkyK+piwLK7xXeno6/fr144cffpBCF6KQXXNPXSnVHrgXKK+U+vSih8JxDMULJ83cfBy7htY1SlEiWIbehXex2+0kJydTpkwZRo8ejVIKpZTRsYTwOAXtqScDO3AcQ9950cdC4D7XRvMs54feu8qsd+Fl7HY7//rXv2jUqBGpqamYTCYpdCFcpKCrtG0GNiulftZa5xZRJo9zNsvM5qPn8Pc10bpGaaPjCFFkbDYbffv2ZcKECQwZMoTIyEijIwnh0ZydKFdeKfUBUAvH9dQB0FpXd0kqD7Nq/2m0hjsrlSQkwOkL4wnh1iwWC0888QSTJ0/mvffe4+233zY6khAez9mJcuOAsYDCMew+BZjsokweZ/bWEwC0vrWUwUmEKDoffPABkydPZvjw4VLoQhQRZ3cbg7XWC5RSI7XWB4AhSqn/uTKYp8iz2vhz/2kA7qlVxuA0QhSdl19+merVq9OzZ0+jowjhNZzdU89TjpktB5RSzymlOgFycNgJs7eeJMtso0ZMGLHRcpEK4dlycnIYMmQI2dnZlChRQgpdiCLmbKm/DIQCLwLNgGeAvq4K5Uk2HTkLQKMqMkFIeLasrCw6derEhx9+yLJly4yOI4RXcmr4XWu9Nv/LDOBxAKVUBVeF8iQ7j6cB0LK6HE8XnisjI4OOHTuyatUqxo0bR4cOHYyOJIRXKnBPXSnVUCn1gFIqOv92baXUBOSCLgU6cS6HrcfSCPQz0TQuyug4QrhEWloa7du3588//+Tnn3/miSeeMDqSEF7rmqWulPoI+Bl4DJivlHoLxzXVtwJyOlsBFuw8BUCr6qUJ9pdT2YRnSkpK4siRI/z666888sgjRscRwqsV1DRdgLpa6xylVCRwIv/2HtdHc282u2bcX4cA6FhXLuAiPE9mZiYhISFUr16dffv2ERQUZHQkIbxeQcPvuVrrHACt9RlgtxS6czYePsvh1GzKRwRx321S6sKzJCcn07RpU9555x0AKXQhiomC9tSrKqXOX15VAbEX3UZr3c1lydzc+aH3+28vg49J1rkWnuPkyZO0bduWQ4cO0apVK6PjCCEuUlCpd7/s9mhXBfEkNrtm7nbHBVza15YFZ4TnOHbsGG3atOHEiRPMmzePli1bGh1JCHGRgi7osqSogniS9YfOcDItl4qRQdxZuaTRcYQoFGazmXbt2nHq1CkWLFhAs2bNjI4khLiMTMl2gd82HgOgXc0YucSk8Bj+/v68//77VK5cmUaNGhkdRwhxBVLqhUxrzeb8VeQaV5Vz04X727t3L7t376Zz5848+OCDRscRQlzDdZW6UipAa53nqjCeYNORcxxIySJArp0uPMCuXbto27YtPj4+xMfHyyx3IYo5p9Z+V0o1UkptB/bl366rlPrSpcnc1KwtxwF4okll/H2dXVpfiOJn+/btF2a3L1y4UApdCDfgbOt8AXQEUgG01luB1q4K5a4sNjtztjlmvXepV97gNELcuM2bN9O6dWv8/f1ZsWIFtWrVMjqSEMIJzpa6SWt9+LL7bIUdxt39uf80qVlmqpUKoXa5cKPjCHHDpk+fTkhICCtWrKB6dVkRWgh34WypH1VKNQK0UspHKTUQ2OvCXG7p43m7Acdeusx6F+7IarUC8N5777Fx40aqVatmcCIhxPVwttT7AYOASkAS0Dj/PpEv22xl96kMALrWl6F34X5WrlxJrVq12Lt3L0opoqOjjY4khLhOzs5+t2qt5fJL17BoVxIAMeEBVIwMNjiNENdnyZIldOrUidjYWMLCwoyOI4S4Qc7uqa9XSs1VSvVWSslP/BX8Z04CAL2bxhobRIjrNH/+fDp27EhcXBzLly+nbFm5AJEQ7sqpUtdaVwP+A9wJbFdKzVRKyZ57vjyrjbRsCwDd76hgcBohnLdy5Uq6dOlCzZo1WbZsGaVLy9oKQrgzp0+k1lr/pbV+EbgDSAd+dlkqNzN/xynMNjvVY0KJCQ80Oo4QTrvjjjt45plnWLJkCVFRsgKiEO7O2cVnQpVSjymlZgPrgBSgqUuTuZHzx9MfalDR4CRCOGf+/PlkZGQQGhrK6NGjKVlSLjwkhCdwdk99B44Z7yO01nFa61e01mtdmMttZJutLElIBuQyq8I9TJgwgQ4dOjBs2DCjowghCpmzs9+raq3tLk3iplbuPU2OxUa9ihEy610Ue//3f//HM888Q5s2baTUhfBA1yx1pdQnWutXgGlKKX3541rrbi5L5iYW7joFQMvqpQxOIsS1ff311wwYMIB7772X6dOny1ruQniggvbUf83/PNrVQdxRrsXGop2O4+nxtWIMTiPE1aWnp/Phhx/SuXNnpkyZQkBAgNGRhBAucM1S11qvy/+yptb6kmJXSj0PLHFVMHcwe+sJMvKs1IgJ47byJYyOI8QVaa0JDw/nzz//pGzZsvj7+xsdSQjhIs5OlOt7hfueKswg7uj8rPdOdWWxDlE8vf/++7z88storalcubIUuhAe7pqlrpR6WCk1A6iilJp+0cci4FzRRCyeUjPzWJhf6h3rlDM4jRCX0lozZMgQ3nnnHc6ePYvdLvNchfAGBR1TX4fjGuoVgK8uuj8D2OyqUO5g6sZjANxRKYLY6BCD0wjxN601//73vxk5ciRPP/003333HSaT0+tMCSHcWEHH1BOBRGBx0cRxH+sTzwDQ4haZ9S6Kl9dee41PPvmE/v378+WXX0qhC+FFCjqlbYXWuqVS6ixw8SltCtBa60iXpiumktNzWbI7GaWg512VjI4jxCVatGiBUooRI0aglDI6jhCiCBU0/N46/7NcWPkiS3Y7VpBrGBspa72LYsFms7F+/XoaN25Mly5d6NKli9GRhBAGuOa43EWryFUEfLTWNqAJ8C/Aaw8kr9p/GoBGsV45UCGKGavVSp8+fWjevDk7d+40Oo4QwkDOHmybCWilVDVgAlAT+MVlqYoxs9XOnG0nAXiwgVxmVRjLYrHQq1cvJk6cyLBhw6hdu7bRkYQQBnJ27Xe71tqilOoGjNJaf6GU8srZ78v3OIbebykdSuUorx2sEMWA2WzmkUceYcaMGYwYMYLXXnvN6EhCCIM5W+pWpdSDwOPAA/n3+bkmUvG2+ajj9Pza5cINTiK83ZQpU5gxYwajRo3ipZdeMjqOEKIYcLbU+wL9cVx69aBSqgowyXWxiq+1B1MB6FxPFpwRxnrssceoWrUqTZs2NTqKEKKYcOqYutZ6B/AisEEpdStwVP9/e3ceHlV5/n/8fSchAWQVIiC7gAUpqIj+tGqFsAi4oC2ILe5atT+l1Yq2v2q9+qXq1wUsuFSKVq0oKu5YqETARIsbiBhZBQQJAoIQ9iRkeX5/zInGNJBtTs6cmc/ruiGZoUQAACAASURBVOZi5syZ+9yZTLjnec5znse5u33NLAbtzi9iae4uUpKMU7q2CjodSUD79+9nzJgxLFu2DDNTQReRH6hWUTezM4G1wD+AJ4EvzOx0PxOLRR+s20GpgxM7taBJWnU7OUSiY+/evQwfPpyXX36ZZcuWBZ2OiMSg6lamvwIjnHMrAMysFzAd6O9XYrHoP2u3A3BGd80iJ/Vr9+7dDB8+nI8//pgZM2YwZsyYoFMSkRhU3aKeWlbQAZxzK80s4ZZ7Wrg2cj79jB6ai0fqz65duxg6dChLly5l5syZ/OxnPws6JRGJUdUt6kvM7O9EWucAY0mwBV025R1g/bf7adowheM7aO10qT9paWmkp6fzyiuvcN555wWdjojEsOoW9euJDJS7jci87+8CD/uVVCz6z5rILHKnHdOKlGQtkCH+27ZtG6mpqbRo0YJ//etfmsddRKpUZVE3sz5AN+A159z9/qcUm97zpoY9U13vUg82b97MoEGDOProo5k3b54KuohUy2GbnGb2RyJTxI4F3jazq+olqxhTUupY6BX1M7TUqvgsNzeXs846i02bNvHnP/9ZBV1Eqq2qlvpYoK9zbr+ZpQNziFzSllByNu1i14Ei2rdoRJdWjYNOR+LYhg0byMjIYMeOHWRmZnLaaacFnZKIhEhVRb3QObcfwDm33cwS8mTy++sio95/emy6Wk3iG+ccl112GXl5ecybN4+TTz456JREJGSqKurHmNmr3n0DupV7jHMuIa6t+dCbGvYn3TSLnPjHzHjqqafYu3cvJ5xwQtDpiEgIVVXUf17h8SM1CW5mw4ApQDLwhHPu3kPsNwp4CTjZObe4JsfwW2FxCYs27ATg1GNU1CX6VqxYwfTp07nnnnvo1q1b0OmISIgdtqg75+bXNrCZJQOPAkOATcAiM5tVfhIbb7+mRC6X+6i2x/LTZ7m7KSgq5dg2TUhvmhZ0OhJncnJyGDx4MCkpKYwbN46jj9ZCQSJSe36eIz8FWOuc+9I5dxB4ARhZyX5/Ae4HCnzMpdbeX/f99eki0bRkyRIGDhxIWloa2dnZKugiUmd+FvX2QG65x5u8bd8xsxOBjs65fx0ukJlda2aLzWzx9u3bo5/pYajrXfzw0UcfkZGRQdOmTXn33Xfp0aNH0CmJSByoUVE3s5r0P1c2TNyVi5VEZKGYW6oK5Jyb5pzr75zrn55ef9eJF5eU8unGXQCc1KVlvR1X4l9eXh7t27fn3XffpWvXrkGnIyJxorpLr55iZp8Da7zHx5tZVdPEbgI6lnvcAdhc7nFT4MdAlpltAE4FZplZzKz8tnzzHg4cLKFr6yM4qmnDoNOROFDW0zRs2DA+++wzOnXqFHBGIhJPqttSfwg4F9gB4Jz7DBhYxWsWAT3MrKu3otvFwKyyJ51zu51zrZ1zXZxzXYAPgfNjafT7x+sjXe8nq5UuUTBv3jy6du3Ka6+9BkBKSnWXXhARqZ7qFvUk59xXFbaVHO4Fzrli4EZgLrASmOmcW25mE8zs/JqnWv9yvt4NwEmdVdSlbubMmcO5555Lt27dOOOMM4JOR0TiVHWbCrlmdgrgvEvVxgFfVPUi59wcIlPLlt925yH2HVDNXOqFc45PvEFyx3dsEXA2EmZvvPEGo0ePpk+fPmRmZtKqlQZdiog/qttS/zXwO6AT8A2R89+/9iupWLApL5/Nuwto0bgBxx7VNOh0JKRWrVrFqFGj6NevH/Pnz1dBFxFfVaul7pzbRuSceML46Lvz6UeSlKT53qV2evbsydSpUxk9ejTNmjULOh0RiXPVKupm9jjlLkcr45y7NuoZxYiPvPne/0/XIwPORMLo2WefpXfv3px44olcffXVQacjIgmiut3v84D53m0hcBRQ6FdSseDTXO/6dA2Skxp6/PHHueyyy7j//vuDTkVEEkx1u99fLP/YzKYDb/uSUQzYfaCItdv2kZqSRO+jmwedjoTIo48+yo033siIESN46qmngk5HRBJMbaeJ7Qp0jmYiseTT3DwA+rRvTmpKQi4hL7Xw4IMPcuONNzJy5EheffVVGjbUhEUiUr+qe049j+/PqScBO4E/+JVU0Mqmhj1Rl7JJNZWWlrJgwQJGjRrFjBkzaNCgQdApiUgCqrKom5kBxwNfe5tKnXP/NWgunizZGGmp99P5dKmCc478/HwaN27Myy+/TEpKimaKE5HAVNm37BXw15xzJd4trgt6aaljqTdIrl8nFXU5NOccd9xxB2eccQZ79uyhYcOGKugiEqjqnjD+2Mz6+ZpJjFi1dS97C4pp36IRbZvrnKhUzjnHrbfeyj333EP//v1p0qRJ0CmJiBy++93MUrw53M8AfmVm64D9RJZVdc65uCv0ZV3vupRNDsU5x29/+1sefvhhbrjhBh566CGSkjSgUkSCV1Vf4cdAP+CCesglJnx3Pr2TBslJ5SZMmMDDDz/MzTffzKRJk4gMOxERCV5VRd0AnHPr6iGXmPDJVxokJ4d35ZVX0qhRI2699VYVdBGJKVUV9XQz+92hnnTOPRjlfAKVt/8gX+04QMMGSRzXTvN0y/eKi4t56qmnuOqqq+jUqRO33XZb0CmJiPyXqop6MtAEr8Ue78pa6b2Pbk5Kss6RSkRRURFjx47lpZde4uijj+acc84JOiURkUpVVdS3OOcm1EsmMeAT73y6FnGRMgcPHmTMmDG8/vrrTJw4UQVdRGJatc6pJ4qylrpGvgtAQUEBo0aNYvbs2Tz00EOMGzcu6JRERA6rqqI+qF6yiAElpY6cTd70sJp0RoDly5fzzjvvMHXqVK677rqg0xERqdJhi7pzbmd9JRK0tdv2UVBUSvsWjTjyiNSg05EAlZSUkJyczEknncS6deto27Zt0CmJiFSLRoN5Pl6/A4CTu6iVnsj27NnDwIEDefzxxwFU0EUkVFTUPR+tj3RKnNK1VcCZSFB27drF0KFDef/992nRQpMPiUj4aPUJItN+fvxdUdfI90S0c+dOhg4dSk5ODi+//DIXXJAwkyiKSBxRUQe+2nGAbXsLaXVEKt3Sjwg6HalnBQUFDBo0iJUrV/Laa6/psjURCS0VdfhBK13Tfiaehg0bMnbsWPr27cvQoUODTkdEpNZU1IEPvUFy6npPLJs3b2bz5s3079+f8ePHB52OiEidqagDizdEJp05uYuKeqLIzc0lIyODwsJC1qxZQ1paWtApiYjUWcIX9bz9B9m4M7KIS8+2TYNOR+rB+vXrycjIYOfOncydO1cFXUTiRsIX9bdXfgNoEZdEsXbtWjIyMti3bx/z58+nf//+QackIhI1CV/Ut+wqAKBt84YBZyL1YdKkSeTn57NgwQJOOOGEoNMREYmqhG+azvrsawCGHtcm4EykPkyZMoUPPvhABV1E4lJCF3XnHDv3HwTg+A6aQSxeffbZZ2RkZPDtt9+SmppK9+7dg05JRMQXCV3Uc3fmk3egiIYNkujcqnHQ6YgPFi9ezMCBA1m7di27d+8OOh0REV8ldFH/NDdyKdvp3Vpr0pk49OGHHzJo0CCaN29OdnY23bp1CzolERFfJXZR31i2frq63uPNhx9+yJAhQ0hPTyc7O5uuXbsGnZKIiO8Su6jnlhV1Lbcabzp37szAgQPJzs6mU6dOQacjIlIvEraoFxSVsGLzbsygb4fmQacjUbJkyRKKi4tp164ds2bNon379kGnJCJSbxK2qC/fvIeiEkePo5rQtGGDoNORKJg9ezannXYaEyZMCDoVEZFAJGxR/3RjZJDciR3V9R4PXnvtNS688EL69OnDTTfdFHQ6IiKBSNiivjRXg+TixcyZMxk9ejQnnXQS8+bN48gjtTCPiCSmhC3qZSPfT1BRD7W8vDyuvfZaTjvtNDIzM2nRQr9PEUlcCTn3+9bdBXy9K58maSn0OEors4VZy5YtmT9/Pj179uSII44IOh0RkUAlZFFfsSUys1if9s1JTtKkM2H097//nYMHDzJu3DhOOumkoNMREYkJCdn9vnLLXgB6tWsWcCZSGw8//DDXX389mZmZlJaWBp2OiEjMSMiivmLzHgCOO1pFPWwmTZrEb37zGy644AJeeeUVkpIS8iMsIlKphPwfceWWSFHv1U7n08Pkf//3fxk/fjwXXXQRM2fOJDU1NeiURERiSsIV9f2FxazfsZ8GyaZBciHTqFEjxo4dy3PPPUeDBpowSESkooQbKLdq616cg27pTUhNSbjvNKHjnGPDhg107dqVm266CeecVtQTETmEhKtqZV3vx2mQXMxzznHLLbfQt29f1q5dC6CCLiJyGAlX1Jd9HbmcTSPfY1tpaSnjxo3jr3/9K1deeaXWQhcRqYaEK+qrtkYuZ/txe63MFqtKS0u5/vrrefTRRxk/fjxTpkxRC11EpBoSqqg751i3bR8A3Y9qEnA2cihPPPEEjz/+OLfffjv333+/CrqISDUl1EC57XsL2VtYTPNGDWjdRJdDxaqrrrqKli1bMnr06KBTEREJlYRqqa/0ut67pR+h1l+MKSoq4pZbbmHLli2kpKSooIuI1EJCFfUcb7nVLq218EcsKSwsZPTo0Tz44IPMnTs36HREREIrobrfP1y/A4D0pmkBZyJlCgoK+PnPf86cOXN45JFHuOKKK4JOSUQktBKqqO8tKAbg1K6tAs5EAA4cOMAFF1zAvHnzmDZtGr/61a+CTklEJNQSpqiXlDpWe+fU+3VqGXA2ApGivnXrVp588km10EVEoiBhivrXefkUFpfSplkazRtr3vAg7d27l7S0NFq3bs0nn3yiedxFRKIkYQbKrdkWaaVrEZdg7dq1iyFDhnD55ZcDqKCLiERRAhV1TToTtJ07dzJ48GCWLFnCxRdfHHQ6IiJxJ2G63z/5Kg9QUQ/K9u3bGTx4MKtXr+b1119nxIgRQackIhJ3Eqaor/km0v1+jK5Rr3fOOS644ALWrFnDm2++yZAhQ4JOSUQkLiVEUT9YXMqGHQcAOFEj3+udmTFp0iQKCgoYMGBA0OmIiMSthDinvmrrnu/uN0pNDjCTxLJx40amTZsGwKmnnqqCLiLis4Roqa/bHhkkd07fdgFnkjjWr19PRkYGeXl5jBw5kjZt2gSdkohI3EuIlvpXXtd7hxaNAs4kMaxZs4af/vSn7Nmzh/nz56ugi4jUk4RoqS/fHOl+79WuWcCZxL+VK1cyaNAgioqKWLBgAccff3zQKYmIJIyEKOpl3e8922niGb999NFHOOfIysqid+/eQacjIpJQ4r77vbTUsWlnPgCdjmwccDbxq6CgAIArrriC1atXq6CLiAQg7ov617vyOVhSSnrTNBqnJkTHRL1btGgR3bt357333gOgWTOd5hARCULcF/W1ZdPDpmsmOT+8//77DB48mNTUVDp27Bh0OiIiCS3ui3rZ+fQebVTUo+3dd99l6NChtGnThuzsbLp06RJ0SiIiCS3ui/qX3+4HND1stC1btoxhw4bRsWNHsrOz1UoXEYkB8V/UvZZ6V3W/R1WvXr0YP348WVlZtGunSX1ERGJB3Bf19WqpR9XcuXPJzc0lOTmZCRMmaGIZEZEYEtdFfV9hMd/sKSQ1JYmjNZtcnb366quce+653HbbbUGnIiIilYjror7Ba6V3adWY5CQLOJtwe/HFF7nooos4+eSTmTp1atDpiIhIJeK6qH8/SE7n0+ti+vTp/PKXv+T0009n7ty5NG/ePOiURESkEr4WdTMbZmarzWytmf2hkud/Z2YrzCzHzOabWedoHv/7QXI6n15bxcXFTJ48mQEDBjBnzhyaNtVUuyIiscq3KdbMLBl4FBgCbAIWmdks59yKcrt9CvR3zh0ws18D9wNjopVD2SC5rhokVyulpaWkpKSQmZlJ48aNadRI4xJERGKZny31U4C1zrkvnXMHgReAkeV3cM6945w74D38EOgQzQS+3B4p6t3UUq+xKVOmMHLkSA4ePEirVq1U0EVEQsDPot4eyC33eJO37VCuBv5d2RNmdq2ZLTazxdu3b6/WwZ1z5VrqOqdeEw888AA33XQTqampQaciIiI14GdRr2y4uat0R7NLgP7AA5U975yb5pzr75zrn56eXq2Db99XyL7CYlo0bsCRR6g4Vdfdd9/NbbfdxpgxY3jhhRdU2EVEQsTPor4JKD93aAdgc8WdzGwwcDtwvnOuMFoHL+t61/n06rvvvvu44447uPTSS3n22Wdp0KBB0CmJiEgN+LkW6SKgh5l1Bb4GLgZ+WX4HMzsR+DswzDm3LZoH1yC5mhsyZAhbtmxh0qRJJCcnB52OiIjUkG8tdedcMXAjMBdYCcx0zi03swlmdr632wNAE+AlM1tqZrOidfxVW/YA0E1zvh+Wc465c+cC0K9fPyZPnqyCLiISUn621HHOzQHmVNh2Z7n7g/069gqvqP+oja6rPpTS0lLGjRvH3/72NzIzMxkyZEjQKYmISB34WtSDtHrrXgA6tWoccCaxqbS0lOuuu44nnniCW2+9lcGDfft+JSIi9SQup4ktLXUcOFgCQKcjVdQrKikp4aqrruKJJ57gjjvu4L777sNMc+OLiIRdXLbUN+/Op7jUkd40jYYNdH64ov/85z8888wzTJgwgT/96U9BpyMiIlESl0X98027AejaSiPfK3PWWWexdOlS+vbtG3QqIiISRXHZ/b59X+Ry9wYp6lIuU1hYyJgxY8jMzARQQRcRiUNxWdRzd0amkz/tmFYBZxIb8vPzufDCC5k5cyZffvll0OmIiIhP4rL7ffPuAgA6tNQguQMHDjBy5Ejmz5/P448/zjXXXBN0SiIi4pP4LOq78gFo27xhwJkEKz8/nxEjRvDee+/x9NNPc9lllwWdkoiI+Cjuut/Lr87WJcEHyqWlpdGrVy+ee+45FXQRkQQQdy317fsK2XWgiKYNU2jTLC3odAKRl5fH7t276dKlC4899ljQ6YiISD2Ju6K+cktkJrlebZsl5IQqO3bsYMiQIezfv59ly5ZppTURkQQSd0V97bZ9APRok3gLuWzbto3BgwfzxRdf8Prrr6ugi4gkmLgr6ht3JOb59C1btjBo0CA2bNjA7NmzGTRoUNApiYhIPYu7or5hR+Qa9c4JtpDL+PHj2bhxI//+978566yzgk5HREQCEHej3zd6E890aZ1YLfVHHnmErKwsFXQRkQQWV0W9uKT0u9nkEmF1tnXr1nHllVdSUFBAy5Yt6d+/f9ApiYhIgOKqqG/ZXUBxqaNts4Zxvzrb6tWrOeuss5g1axYbNmwIOh0REYkBcXVOfYM3SC7ez6evWLGCjIwMSktLycrKomfPnkGnJCIiMSCuWuplg+TieeR7Tk4OAwYMwMzIysqiT58+QackIiIxIq6KetnlbJ3iuKVuZrRv357s7GyOO+64oNMREZEYEmfd7/HbUs/NzaVDhw706dOHJUuWJORseSIicnhx1VL/Kk7PqS9cuJDevXszZcoUABV0ERGpVNwU9dJS99016vHU/Z6dnc3ZZ59Nu3btGDVqVNDpiIhIDIubor5tbyEFRaW0OiKVZg3jY87z+fPnM3z4cDp16kRWVhYdOnQIOiUREYlhcVPUN8TZILnt27czcuRIunfvTlZWFu3atQs6JRERiXFxM1BuY5wNkktPT2fGjBn85Cc/oXXr1kGnIyIiIRA3RT1eJp555ZVXaNCgAeeffz7nn39+0OmIiEiIxE33e25ePgAdW4a3qD///POMGTOGyZMn45wLOh0REQmZuCnqm/Ii3e8dQ7qQyzPPPMMll1zC6aefzhtvvKHL1kREpMbipqjn7oy01Du0bBRwJjX3j3/8gyuuuIKBAwcyZ84cmjZtGnRKIiISQnFR1PcXFvPtvkJSU5Jo26xh0OnUWE5ODmeffTZvvvkmRxwRHwP9RESk/sXFQLlcr+u9Q8tGJCWFp9t6165dtGjRgsmTJ1NUVERqamrQKYmISIjFRUt9y64CANq3CE/X+3333cePf/xjNm3ahJmpoIuISJ3FRVFft30fEJ7L2f7yl7/whz/8gTPPPJO2bdsGnY6IiMSJuCjqZdeoH9O6ScCZHJ5zjj/96U/ceeedXHbZZTz77LOkpMTFGRAREYkBcVHUN3oj3zvF+OVs06ZN46677uKaa67hqaeeIjk5OeiUREQkjsRFM3H9t5Hu9y6tY3vk+C9/+Uv279/PTTfdRFJSXHyfEhGRGBL6ylJcUsrmXQWYQccjY2+gXGlpKZMnT2b//v00bdqU3/3udyroIiLii9BXly27CygpdbRp2pC0lNjqzi4pKeHaa6/l5ptv5vnnnw86HRERiXOh737f5M353j7GZpIrLi7mqquuYvr06dx5551cffXVQackIiJxLvRFPXfn9xPPxIqioiIuvfRSXnzxRe666y5uv/32oFMSEZEEEPqivt67nK1beuxczrZ582aysrJ44IEHGD9+fNDpiIhIggh9Ud+6OzKbXNvmwc/5XlRUREpKCp07d2blypW0bNky6JRERCSBhH6g3Dd7vKIe8EIu+fn5nHfeefz+978HUEEXEZF6F/qivnVP8C31/fv3c+6555KZmUnPnj0Dy0NERBJb6Lvft+0pBKBN02CK+t69eznnnHNYuHAhzzzzDJdcckkgeYiIiIS6qO8rLGZfYTFpKUk0a1T/P4pzjvPOO4/333+fGTNmMGbMmHrPQUREpEyou9+/Kdf1blb/66ibGTfeeCMvvfSSCrqIiAQu1C31sqJe313v3377LYsWLWL48OGMGjWqXo8tIiJyKPFR1OtxkNw333zD4MGD+eqrr1i/fj2tWrWqt2OLiIgcTsiLetkgubR6Od7mzZsZNGgQGzdu5M0331RBFxGRmBLqol428UyberhGPTc3l4yMDLZu3cpbb73FmWee6fsxRUREaiLURX3b3vrrfn/++efZtm0bmZmZnHbaab4fT0REpKZCPvrd/+535xwAt956Kzk5OSroIiISs0Jd1P3ufl+9ejX9+/dn1apVmBmdO3f25TgiIiLRENrud+fc993vPhT1FStWkJGRgXOOoqKiqMcXERGJttC21HfuP0hRiaNZwxQapSZHNXZOTg4DBgwgKSmJrKws+vTpE9X4IiIifghtUS87nx7thVxWrFjBwIEDSUtLIzs7m169ekU1voiIiF/CW9R96nrv3LkzI0aMIDs7mx49ekQ1toiIiJ9Ce079G2+Q3FFRmiJ28eLFHHvssTRr1ozp06dHJaaIiEh9Cm9L/bvu97pfzpaVlcWAAQP4zW9+U+dYIiIiQQltUd+6Jzrd72+//TYjRoygc+fO3HvvvdFITUREJBChLerbolDU58yZw3nnnUePHj3Iysqibdu20UpPRESk3oW2qNd1oNzBgwcZN24cvXv3ZsGCBaSnp0czPRERkXoX2oFyW3d7U8Q2q9059dTUVDIzM2nVqhUtWrSIZmoiIiKBCGVLvaiklB37CzGD9CY1K+ozZszgt7/9Lc45unXrpoIuIiJxI5RF/dt9hTgHrZukkZJc/R/h6aef5pJLLiEnJ4fCwkIfMxQREal/oSzq2/dGCnJNWunTpk3jyiuvZPDgwcyePZuGDf1frlVERKQ+hbKof7svUtRbV3PJ1ccee4zrrruOESNGMGvWLBo3buxneiIiIoEIZ1HfexCA1k1Sq7V/x44dGT16NK+++qpa6CIiErdCWdS3ey319Cpa6suXLwfg3HPPZebMmaSl1X32ORERkVgVyqL+Xff7EZUXaeccEyZMoG/fvixcuLA+UxMREQlMKK9Tzz9YAkCThv+dvnOOO+64g3vuuYfLL7+cU089tb7TExERCUQoi3pJqQMg2ewH251z3HbbbUycOJFf/epXTJ06laSkUHZGiIiI1FgoK15ZUU9K+mFRf+utt5g4cSI33HCDCrqIiCSccLbUXaSop1Qo6sOGDWP27NkMHz4cq9CKFxERiXehbMqWb6mXlJRw88038/nnn2NmjBgxQgVdREQSkq9F3cyGmdlqM1trZn+o5Pk0M3vRe/4jM+tSnbilXkudkhIuv/xyJk+ezNy5c6OZuoiISOj4VtTNLBl4FBgOHAf8wsyOq7Db1UCec6478FfgvurELi5xuJJiJv6/G3juuee4++67GT9+fDTTFxERCR0/W+qnAGudc1865w4CLwAjK+wzEvind/9lYJBVo++8qOgg29+4l/cy32TixIn88Y9/jGriIiIiYeRnUW8P5JZ7vMnbVuk+zrliYDfQqqrAxSUluOKD3PDHu7jllluilK6IiEi4mSs7Px3twGajgbOdc9d4jy8FTnHOjSu3z3Jvn03e43XePjsqxLoWuNZ7+CNgNdAa+NaX5P2Lrbj+xvUztuL6G9fP2Irrb1w/YytuRGfnXHp1dvTzkrZNQMdyjzsAmw+xzyYzSwGaAzsrBnLOTQOmld9mZoudc/2jmrHPsRXX37h+xlZcf+P6GVtx/Y3rZ2zFrTk/u98XAT3MrKuZpQIXA7Mq7DMLuNy7PwpY4PzqOhAREYlzvrXUnXPFZnYjMBdIBp50zi03swnAYufcLOAfwHQzW0ukhX6xX/mIiIjEO19nlHPOzQHmVNh2Z7n7BcDoWoafVvUuteZXbMX1N66fsRXX37h+xlZcf+P6GVtxa8i3gXIiIiJSv0I5TayIiIj8NxV1ERGROKGiLiIiEidCs/SqN33sKURmoXNErnn/OJqXwJlZE+BY4Evn3K46xmoODOOH+c6ta9xKjtMVOBFY4ZxbVcdYvucc5XxD9Znw4oUq5xB+JvR3V/kxEv3vLlTvcV2EoqVuZkOBNcCfgRHAOcD/AGu852ob92/l7p8BrAAmAZ+b2Yg6xL0MWAIMABoDRwADgU+852rNzF4vd38ksAA4D3jDzK6oQ1xfcvYx31B9JsKYcwg/E/q78z/fUH2GvXiheo/rzDkX8zdgJdClku1dgZV1iLuk3P13gH7e/WOInAnErgAACj5JREFUXEtf27irgRaVbG8JfFHH9+LTcvffB7p691sDn8Vazj7mG6rPRBhzDuFnQn93/ucbqs9wGN/jut5C0VIncppgUyXbvwYaROkYzZxzSwCcc18SmTCntoxIF09Fpd5zdVE+bopzbj2Ac+5bL35t+ZWzX/mG7TMB4cs5bJ8J/d19T3933wvbe1wnYTmn/iSwyMxe4PuV3zoSmYHuH3WI29PMcoj8YruYWUvnXJ6ZJVG3D+jdwBIzyyyXbydgCPCXOsQFON7M9hDJOc3M2jrntnpT8dblw+9Xzn7lG7bPBFSecydgDLGZc9g+E/q78z/fsH2GIXzvcZ2EZvIZMzsOOJ/IQAcj8m1xlnNuRR1idq6waYtz7qCZtQZ+6px7tQ6xWwJnV8h3rnMur7YxqzheC6CXc+6DOsSot5yjlG+oPhNe/F7ASEKScwg/E/q7O/yxEvXvLlTvcZ2OH5aiXsbMjgRctH8ZfsUVORwz61fW1RiGuGFiZs2AHkRGUEf7/wvfYoeNmbX2upxjPq5X3Iudc3vDELc2QnFO3cw6mdkLZrYN+Aj42My2edu6RCHudi/uomjEreKYn/sRt66xzayj93O/Z2Z/NLMG5Z57/XCvDShuTzP7t5nNNrNuZva0me0ys4+91nBMxfVi96t4A2aZ2Yne/WjFPSlKca8qd7+9mc03szwze9/Mjo1S3A5e3F1RiPus17LDzM4GlgP3AUvNrLZrTPga28x2mtkTZjbIzOp63r8+4g43s/Vm9h/v87Uc+MjMNpnZoFiL68U+2syeMbPdRNY6X25mG83sz+X/P4qVuHUW1Ai9mtyAD4ics0kuty2ZyPnTD2Mw7s8Ocfs5sL2O74UvsYG3geuBE4CHiYzmbOU992kMxn2XyOUjvwC+8n5n5m2bH2txvdil3s//TrlbvvfvghiMW35E8kzgOiINgQvr+B77FffzcvffxxulTRRGI/sVm8jI7BuBhUQGm00BTq1Lrj7HXQr0Ak4DdpTF9LYtibW4XowFwADv/s+AvxK5rO0uYFqsxa3z7yioA9fwzVtTm+cCjFsEPA08Vcltbx3fC19iA0srPL6ESGukW13/WH2KW/5ykrUVnou5uN7rRwHZwIhy29bXJabPccsX34q/x7p8IfMr7nIiI6cB/gMklX+uju+FL7ErvBedgNuIXFP9JXBPjMfNrfDc0liL673+swqPPyl3f1Wsxa3rLSyj3z+xyOQE/+SHI50vBz6Nwbg5wETn3LKKT5jZ4DrE9TN2AzNr6CLL4eKce9bMtgJziXz7jLW45UeXPljhudQYjItz7mUzewv4i5ldCdxC5ZfaxERcoIOZPUSkpyLdzBo454q85+rSvehX3P8B3jGzR4m0UF8yszeADOCtOsT1M/Z3XePOuY3A/cD9ZvYjIr1EsRZ3l5ldBzQD8szsZiK9LYOBfTEYF2C7mV1CpGX9c2ADUDYzXl1OQfsVt26C+jZRw29EqcCvifzxfA4sA/4N/F8gLQbjngl0OsRz/ev4XvgSG7gZOKuS7ScCb8dg3OuAJpVs7w5MjrW4lcQ7gUj3+LZoxYx2XCJfbsvfWnrb21K31p4vccv9nu4DXgPeBB4Dzo7Sexv12MCD0fz910PcjsDfvZ+9rff3vQyYTWTEd0zF9WJ3IvIFYRnwLNDO294K+Hmsxa3rLXSj30XihfeNvqlzbk8Y4opI7AvF6PfDMbNzFdff2IrrT1wXsSfasf2KW57i+h9bcf2N62dsP3OuSuiLOnCy4voeW3H9jetnbMX1N66fsRXX37h+xvYz58MKTfe7mfXk+5m4HJGl82Y551YmUlw/Yyuuv3H9jK24/sb1M7bi+hvXz9h+5lxboWipm9nvgReIjOj8GFjk3X/ezP6QKHHDmLPihjdnxQ1vzoob7pzrJKgRejUcZfgF0KCS7anU7XryUMUNY86KG96cFTe8OStuuHOuyy0ULXUiM2YdXcn2dtRtibuwxfUztuL6G9fP2Irrb1w/Yyuuv3H9jO1nzrUWlslnbgLmm9kafrh0XnciUyEmSlw/Yyuuv3H9jK24/sb1M7bi+hvXz9h+5lxrYRoolwScwg+XzlvknCtJpLh+xlZcf+P6GVtx/Y3rZ2zF9Teun7H9zLnWOYWlqIuIiMjhheWcuoiIiFRBRV1ERCROqKiL1DMzKzGzpeVuXQ6zbxcz+68V+WpxzCwzW21mn5nZQous1lXTGNeb2WXe/SvM7Ohyzz1hZsdFOc9FZnZCNV5zk5k1ruuxReKBirpI/ct3zp1Q7rahno471jl3PJGlhh+o6Yudc1Odc894D6+g3OU8zrlrnHMropLl93n+jerleROgoi6CirpITPBa5O+Z2RLv9pNK9ultZh97rfscM+vhbb+k3Pa/m1nyfx/hB94lctkNZjbIzD41s8/N7EkzS/O232tmK7zjTPS2/dnMxpvZKKA/8Jx3zEZeC7u/mf3azO4vl/MVZvZwLfP8gMio4rJYj5nZYjNbbmb/4237DZEvF++Y2TvetqFm9oH3Pr5kZk2qOI5I3FBRF6l/jcp1vb/mbdsGDHHO9QPGAA9V8rrrgSnOuROIFNVNZtbL2/90b3sJMLaK458HfG5mDYGngTHOuT5E5q34tZkdCVwI9HbO9QXuKv9i59zLwGIiLeoTnHP55Z5+GfhZucdjgBdrmecw4PVyj293zvUH+gJnmVlf59xDRObbHuicG2hmrYE7gMHee7kY+F0VxxGJG2GZfEYknuR7ha28BsAj3jnkEuDYSl73AXC7mXUAXnXOrTGzQcBJwCIzA2hE5AtCZZ4zs3xgAzAO+BGw3jn3hff8P4EbgEeAAuAJM5sN/Ku6P5hzbruZfWlmpwJrvGMs9OLWJM8jgGSgX7ntF5nZtUT+32oHHAfkVHjtqd72hd5xUom8byIJQUVdJDbcDHwDHE+kB62g4g7OuRlm9hFwDjDXzK4hMuHFP51z/68axxjrnFtc9sDMWlW2k3Ou2MxOAQYBFxOZHSujBj/Li8BFwCrgNeecs0iFrXaewGfAvcCjwM/MrCswHjjZOZdnZk8DDSt5rQFvO+d+UYN8ReKGut9FYkNzYItzrhS4lEgr9QfM7BjgS6/LeRaRbuj5wCgzO8rb50gz61zNY64CuphZd+/xpUC2dw66uXNuDpFBaJWNQN8LND1E3FeBC4BfECnw1DRP51wRkW70U72u+2bAfmC3mbUBhh8ilw+B08t+JjNrbGaV9XqIxCUVdZHY8DfgcjP7kEjX+/5K9hkDLDOzpUBP4BlvxPkdQKaZ5QBvE+marpJzrgC4EnjJzD4nsgjFVCIF8l9evGwivQgVPQ1MLRsoVyFuHrAC6Oyc+9jbVuM8vXP1k4DxzrnPgE+B5cCTRLr0y0wD/m1m7zjnthMZmf+8d5wPibxXIglB08SKiIjECbXURURE4oSKuoiISJxQURcREYkTKuoiIiJxQkVdREQkTqioi4iIxAkVdRERkTihoi4iIhIn/j9bROiykMPlNgAAAABJRU5ErkJggg==\n",
"text/plain": [
"<Figure size 576x576 with 1 Axes>"
]
},
"metadata": {
"needs_background": "light"
},
"output_type": "display_data"
}
],
"source": [
"fpr, tpr, auc_thresholds = metrics.roc_curve(y_test, y_scores)\n",
"print(\"AUC: %.4f\" % metrics.auc(fpr, tpr)) # AUC of ROC\n",
"aux_functions.plot_roc_curve(fpr, tpr, 'recall_optimized')"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"### Plot XGB Tree"
]
},
{
"cell_type": "code",
"execution_count": 39,
"metadata": {},
"outputs": [
{
"data": {
"image/png": "iVBORw0KGgoAAAANSUhEUgAAAlYAAABjCAYAAABZjU4oAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADl0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uIDMuMC4zLCBodHRwOi8vbWF0cGxvdGxpYi5vcmcvnQurowAAGfxJREFUeJzt3X9wFOX9B/D3hgTCb0ISIAIVAggJwgjRTCSBNhIYpWKxjCkoBIvIDxugtp0KAtPYKTZMGX5YipjGUtCWQkixoNCaAFUCmuhhpQk4FQ70K0HIjzOYhJDk8nz/OG5zd7mf2d3bu8v7NZO5u927Zz/Ze3bvc889+zySEAJEREREpFyY3gEQERERhQomVkREREQqYWJFREREpBImVkREREQqYWJFREREpBImVkREREQqYWJFREREpBImVkREREQqYWJFREREpBImVkREREQqCdc7gDs4rw4RkQ2j0Qij0QiTyYSoqChERUUhKSlJ77CIyEJyuSJA5goMiCCIiLQ0cOBA1NbWar6dPXv2IDk5GQkJCZpvi6iLcplY8adAIiI/cZZUVVRUeHzdyJEjvXrdT37yEwDAokWLmFQR6YQtVkREQWLdunXYuHGj3mEQEX8KJCLSX1hYGNra2jTfTmZmJg4cOKD5doi6MCZWRESBID4eMBo1KDgyEmhq0qBgInKCfayIiPxt+/aOyzRJqoCOSZXk8rxPRBpiixURkQpaW4Fjx4DZs/WOxIWICKClRe8oiEIFW6yIiNSUlma5le60DKWnT8Xs2UB2djYKCwsxduxYHaNzwjGpGjXK7qEkSWhh4kWkGFusiIg8kCTA1anSU0fxvXv3IisrS6PIVJSZCbDDO5G32HmdiMgbs2cDR47oHUUAyMmx/BGRM0ysiIgclZQAkycDvXrpHUkQKCgAnnhC7yiIAgX7WBFR8GpoaIAkSThx4oRPr0tLS8OGDRsAAGFhgOPYmmlpTKq8ZptUNTXJVx1KkoQvvvjCqyJWrlwpjw5PFKrYYkVEAaeqqgqxsbGalX/y5Emkp6drVj55b/78+di3b5/eYRD5ii1WRBQ8bJOq/Px8SJIkX31nJUkS4uLicPDgQUiShIMHDyImJkaeI2/kyJE4fPiw0/KZVCln3e+O7wsArFixQr7/+uuv46OPPsIrr7yCJ598Ehs3bsTOnTvl9UyqKNSwxYqIAsqZM2cwZcoUTbeRk5ODHHbM9llkZCSaOLo7EcAWKyLS0+zZwPjx3j3XManav38/FixY0Oltnz9/HkOGDLFbxqSqcxyTqjFjxvhcxtWrV5GamsqR4SlkscWKiHyWlgb07AkUFekdCYWM7duB1av1joLIWxxugYicu3ULuP9+S4sSx4ekgHLkSADPEURdHBMroq6istKSJGVlOZ8EmCho9ekD1NfrHQURwD5WRMGrosLSHcXbbkHDhoXhD3/4K7Zvt1yRdfr0aVy4cEG+ii4UObsyjQJDjx49AAAVFRUoLCxEc3Nz5wtzTKoyM+W7rAMUKNhiReRnJSXA1KnAtm3sUkKkqpYWoKEBGDBA70go9LHFikgrBQWWFqW9e717flqaZUJfJlUqYmtFwNHlLYmI6JhUpaXpEAh1ZWyxInKQlwcsWwYcPsx+s0SdJUSA5rvR0UBNjd5RUPBjixXpw2QyYdSoUZpvp2/fvnaPbU/oOTmWxwaDd2UtXWr5UGBSpb/IyEjVylq2bJlqZVFHDQ0Ndo9tj8GWlhY/R+OGY1JVUmK5vRPwvHnzXL70pZde0ioqCiFssSK/KioqQmJiIuLi4hAW5nteL0kSAqTOkkaampo8JlQ9e/ZEYmIiDHeyZdt6MWLECFy5cgXXrl0L2c76gWbw4MG4fv16h+Vmsxl//vOf8cwzz+gQle/ef/99TJs2rcPy+vp69O7dmx3kyRZbrEg/tiejurq6DonRn/70J6xatQqAZQ63CRMmAIB89VBjYyMAyMu9Pbm98cYbygInXTgmVVu3bsWuXbsgSRIMBgMaGxsxadIknD17Fv3795frkxACKSkpEEKgtLQUd911F6qrq7F69Wq0tbV12M6vf/1rv/w/XcG1a9fk+7/5zW/kY7S2tjaoWnmsSVVpaSlSUlIwd+5cNDY2ok+fPkyqyGtssSJN3L59G8ePH8esWbP8ut0XX3wRL7/8sl+3SepraWlBRESEJmWz1VMfP/vZz7Blyxa9w1DX6tUcLK7r4gChpI/77wc+/tj5ujfffBM5OTm4dOkSkpKSkJSUhHHjxmHQoEFoaGiAyWSC0WiEwWCAwWBAUlIScnJy8Oijj/r3n6CAkpubi7VrX8KkSQmYOXMm4uPjMWDAAFy+fBknTpzAu+++i4yMDPx1717E8qdAv8vLy8PJkyeRnp6OZcuWWZLYsDDASathIMvKykJMTAzuuecerFixwvtkXJIsnTQp1DGxIm0dOWK5ZYdvCjhZWd6PhUGkBdbBUMTEitQzfrxlNHAif6qrA/r3V1BAZCTQ1KRaPNTR668DQdJPXX/NzcDLL3s/pQIFGiZW5LsgbL0n8owT++rv8GHgscf0jiIw8afEYMGrAsm1NWucz2vqmFSdOnXK6es///xzDaIiApxcwe/SgQMHvHsikypN+JQLBFFS5anx4R//+IfaG+y4zGZORAp8bLHqQm7eBDZs4EUsRBRAjh4F/Hz1cEgwmSz9tjg3ll74U2BXE9Stya2tQHi43lGQToxGID5exwAaGoDevXUMIPgoPt8IAVy9CgwbplpMapk3D/jb3/SOwgfdu1v6b5HW+FNgIMjPz8eECRMgSRKSk5OxadMmvPXWWzAajTCZTAAsU8B8+eWXKC4uRl5eHjIzMxEeHo7u3btjzZo1aG1tlcvbtAkYOtT5toIlqTpy5AjCw8Nx//33Iy8vD0ajEd/U18NkMqGiogJbtmzBqFGjEBcXh//85z96h0sKZGdnQ5IkZGZmoqCgAF999RUAS503GAzYtGkThg0bhoceGoFz587pFmfl4sWYHhuL+Ph4bNq0CQaDQT4+KysrUVBQgHnz5kGSpKAZUVwt3/3udzFp0iQUFhbCZDLBZDJh2rQbyMiYgREjRnS+YEnC3ampmDZtGg4fPiyXbTAYsGzZMkiShA8++EC1/8MbPXv2RGlpKV591YT+iq6a8DNnSdWMGV6/vF+/fjCZTCgrK1N1SqmuhC1WKlmyZAny8/P1DgPV1dXIy8vDiy++qHcodsLCwpyOfq2GWbNm4ejRo5qUTb4xm83o1q2bZuWrObjnlClTcObMGVXKcuatt97CnDlzNCtfawkJCbhw4YKiMiIjI9Hk5ErMhoYG9A7SVsFbt26hZ8+eeoehnNFomSdx8WLcbmhAjx499I4o2LDFSmu2SVVsbCwaGxvR1taGmJgYDB8+XJ4AtrGxEQkJCZg6dSokSUJ6ejokSXI6UXFCQgKmTJkiP+7Tpw969eolP165ciXi4uLsvt3HxMQEVFI1cOBAALBLqrKzs9HS0oLz588DAMaOHWs3XcSePXtQVVWFPXv2yMvcTYzKpCpw2CZVZrMZKSkpSE9PR2FhIRISEgBYBl5MTU3FwoULkZ2dLT/fOgWR2WwGAAx10hxrTaqKiooUx2pNqqqqqlBfX4+amhpERkaiT58+8vIZM2Zg/vz5MJvN2Lp1K8xms11dzc3NdfmFIZiTKgB2SdX48eMBWKZ6eeeddzo89/nnnwdgSXyjoqIw404LiWNS9dRTTwGAXVKVnp6OjRs3orS0FADsyjebzRg0aBB2796txr/kE2s9sJ6DX3vtNQAIjaQKsPzenpUFtLbaJVWLFi1CXFwcysrKdAwuuLHFKoRZJ6MNZiHz7bALSEtLQ0lJid5haO7tt9/2evT/mpoaREdHaxyR+tRsYX7nnXfw/e9/X5WynGlubkb37t1VKWvjxo1Yt24dAMuch+vXr1el3GBSVVWF2NjYDsu3bt0qJ9AEgC1W/nPs2DEMHz7cr9tcu3YtHnnkkQ7LAzGp8nUiU3dJVVD1e+gCbJOqI0eO2LU4KqXlBLi+lu0uqSorK8OGDRvkx8GYVAH2LcynT5/2+fVCCLkPnaukaubMmZ0LDkC4zcUtaiVVALBu3TocOnQIAJwmVYmJiaptK9Dcc889AOA0qdq/f78lqeJFRV5hi5UfhYdbLngj52bOBN59V+8oSE19+jgfIy1klZQAaWl6R0GkvTVrgNxcvaPQE4db0EuvXkBjo95RhIhTp4CpU/WOgjzg1d423M1CTsFHCMvYEkT8KdC/bFtSmVSpiElVwLL9hYBJlQ3bpMpo1C8Ocsk6gbxXJAngTBOeFRToHYGumFipxPaivjlznkVtbS0AS/8Nax+OwsJCPUILCgcPHkRYWMfqePr0acyfP9+u3woFBtu3q3//aCxduhSA5QpZa78cSZIQFxfntpy4uLigGA/qySefxLPPPis/rqioQGFhodP+jU45jnpqc9LQsg8ZuZeZ2dPufbWyno+sVzLKxowB7nRwD+X3bdGiRTh8+DCA9s8x6z6pq6tz/+Innmi/H8L7yBX+FKhAWpqlSwXpqKkJ4CB2fhPUI/oHsupqICZG7yi6jIgIoKVFYSHx8V26FVII4XtimZNj+QsN7GOlltmzfWw6JgpyTKZ0EB0N1NToHQV5EhbWcbZ66irYx0qJrKz2+5omVV2oyVSTf7UL7T8tOfbP1TSpWrNGw8LVZTOWqfZskyrrpcTz5/sxgNCjyemhrY3nHbXs3at3BKrpkomVq3FPrP08wsKAtWvbl2v5fk+aNKn9gc0nmJpjAOnJ1Rg4ZrNv3/JmzZrledwbhRlAWVkZJEnC22+/ragcvSnt93H06Dt47LEfqBJLuKdxbzxcrr17926sWLFClVjc6datG7799lu3z9mxw30ZWVlZOHjwoIpRAcuXL8djP/yh5cG+faqV+/zzz2NqEF8M4rFeOWF7euhMvXr88cednxt8OO8EUp8sZ7N9eEuT/8O2BUOS5E6cnj6vA5IQIhD+qIs6dOiQ3ePIyEidIgle586dc7nu22+/VWUby5cv9+p5LS0tmsdy/PhxxWUUFhaqEIlnFy9e9Pq5ltOxvh5//HG9Q3BKj3qVnZ2tSrm26uvr7R6fP39e9W24IkmST8/3Zb+6e39CmMucRu+ESrfEavTo0UIIIcrLy0VKSoqIjo6W1913331+jWXBggUu1/3vf//zYyTaOXTokLhx44YQovP7t7y8XAghxJw5cwQs/fJEr169hBBCDBkyRKxfv14AELt27RL5+fli9OjRIj8/XwghRPfu3YUQQiQmJjote8eOHfKHyo4dO1zGMGHChE7Frod58+aJmJgY8Ze//EW0tbWJ9evXy/vw6NGjQgj7xFaSJNGjR4+AisXfycaCBQs6bNNsNgsAYsiQIXbLrfX54YcfFuHh4aKpqUnVD+PNmzfL9dyqra1NCGFJwmzPG7bPWbBggdi8ebMQov2YEUKIbdu2ic2bN4vy8nK75cHMn3U8Pz+/w/shhJDrhvX92rx5s/jjH/8oxo0bJ8xmsxgxYoRcVwKJu/OkEELExMTI9631bvHixf4N8g7bz2tH/v68tsHEivxv1qxZnXpdIHxzt9Xa2ipOnTqldxgumc1mTcvfuXOn18/V+ovAkiVLNC1fTSkpKT6/JjMzU4NIvPPmm2/qtm1P9KpXv//97zXdbmtrq6bl+8O6dev0DkEvTKysmpost/Pnz7db/sknn/gzDDv33vuQ3ePa2lqdItGGs0TpypUrnSrr+vXrIjk5WURHR4s33nhDUVy1tbXiueeeEwDEhg0bFJUVaMrLywUAn342e/bZZzVpkTt16pQAIEpLS71+zY9+9CPxve99T/VYPImIiBA5OTleP//rr78Ww4cPF7/61a+0C0oIUVJSIgCIRYsWiYaGhk6V8ctf/lIAEPv27VM5On3oVa8mTpwonnnmGa+ff+LECQEgIFsJc3NzRVJSklfPvXz5sgAgPvvsM42j6iiQPq9tuMxpONzCxYvA6NG6bX7tWuC3v9Vt811TY6NlrqEQl5cH3BmzkxTo0QO4fVvvKBQK4UH3An5opEcfBYLkgpiPPgIeeEDvKFzT+ePaUdcdbiEw8kbntm8PvaTK45AuTkZX9ztrUpWXp28cGvnmG8stkyp1eEyqNm3ySxyKWJMqBVeCBZrt2y23AZ1UAe1J1fnz+sbhhUBOqoJJAHzKaePGDcttAF3daqewEFi9Wu8o1DNjhuXWNm8qKioCACQlJbUvDKTB9KyZRwh92ADAgAHt9y9fvqxfICGgoqLjsg71+oUX/BiRQpcuWW4HD9Y3DhUE3fkzMVHvCHzm9PwRRGPP6SXkEivrez5okOW2uroaaWlp8lxHZrMZsbGxqKmpwb///W9dYiwpAebOtdy/ffs2Ll68iE8//RRnz54FAHz44YcAgI9tJnBdtWqV07n09DZkiOW2qAhITk6Wl2/duhV1dXX48MMPcfbsWfTv39/vsd19993YuXOn3bLbd5ofVq1ahZSUFMtC64dN9+6QJAnHjx/3Z5iqmjt3LmLvzAL+3nvv4V//+hcmT57c4XnTp0/H008/7efogDlz5iAjIwPPPfccfve732Hbtm2YPHkyWlpaIEkS9jmM1aRXnFbjx/tYr997z88R2vO6zl+/brm1nTE+iHhdj/z0zXrhQsutt+dznDzpl7i89fDDlluvzh+5uXIr3K5du/wZpswxphab+YkC4ctkyPSx6vS0G37+0fazz4Bx4/y2Oc383/8Bw4frHYVrO3YoGCk7MxM4cEDVeKiTrl4Fhg7VO4rQFxNjma8wQPXuDTQ06B2FBoqK2pv7ySP2sfITazeZTueHY8aoFosnV66ERlIFKEyq/PAtcuVKBS+2JlXnzqkSS8Dx4+/j0dEKCxg6FFi+XJVYfKHKLtIhUflBZwfMt8bar59qsajB2hDR6aSqtFThycAzRXVF56TK+otDsPDjx7UiQdFiZTAYYDQa8eCDD2LYsGEALH15unVTNkO5wWBA9y1bcP3HP0ZGRkbnC3KhuLgY9fX1mDhxIq5ejYcqM0gsWADznj04efIkzGYzxowZg/j4eBUKbldaWoovv/wS8fHxdv2j1JiM12g04ou//x3m++7TZJ9fuHABFRUVGDBgANLS0hAZGamsQEkC+veXe4Rfu3YNFXc63iQlJSEqKkppyHasdT0qKspu/3TrZvlrblZWvur7x4HRaMSnn36Kvn37IiMjA9XVlsYQxSQJ5tZWTet9RUUFzp8/32HfKxIZCTQ1AQA++OADfPXVVx2OKzXcvHkTZWVlAICJEydikLUvRGe0tVkqm83BfuLECdTU1GgS+4ULF1BeXt5hv6txvrl58yY+Ki2FkCTl+8VBTU0NPvnkE2zenIh//vMuZYVdvQoMGyb/w67OA2qwlh0fH49+/ZLUSVbKy4F770VxcTFMJhPuvfdeJCQkqFBwO4PBgC1bumPx4huYPn26ssIcKteNGzdw7s4X6QceeMDbriuuU2p3YzH48U8IIeRRtH318ccfO11++fLlTpXn6JFHHnG5buHChapsw5Ea0zSMHTvW5bpdu3YpKvunP/2py3URERGKyvbk66+/VlyGu+kdevfurbj8ZcuWuVz39NNPKy7fHa33j5bvr9b1fvLkyYrLv3Xrlst1Ss85x44dc7nuzJkzisoWQoinnnrK5Tqlg+BmZGS4XAcNB/3Ver988803nS536tSpLtdFRUV1ulwh3I93+POf/1xR2VqOdeauLqSnpysq211dyMrKUlS2EB2OkcAeILSxsdGrf6qsrEwIIcTJkyeFEEL84he/8Op11uH6nb2hS5YsEQDE+++/Ly8rKCgQzc3NHZ4bFhYm3//vf//rcnu227GW29kTi7vYX3nlFfn+8ePHRVVVlRCiff9Y+TINgXXeuebmZnkATjiZxsGZ8PBwt+tfeuklu8fJycnytqxSU1O9itPZYHuOMaampgoA8sjh1v3jiqe5tKzl1NXViXPnzsllV1ZWCgAd/j8hhLh06ZLbMh1jdyxTCMsJwfpeeDvyuDf7x9n7OnjwYJdl+vL+FhcXy+9vU1OTyM3N9RizLXf1HoB46KH2QXWTk5NFQUFBhxOnt/W+srJSCGGp+7t375aX79+/X47fF64GgiwuLpb/n6amJnl+tdTU1E4Numjdp9b4hRB29R2AGDdunNPXVldXe70dx7kofZm2x5dENjk5WQwePNju/J6UlCTi4+O9LkMI5/vFqri4WN7vU6ZM6bDe1X5xdTx5Wzdst+V4fnbHekzZ1hUlXB1PnS3H9kvGzp07BQC5fliPUev7UFBQYFfGgw8+6PN2PZ3DnfGUGDv+/5WVlaKsrMzu2Kmrq3P6Uld/uidVwqbFKlDs3bvX6fKhQ4fK97dv3+6vcBSzfkBobeTIkX7ZjpquXbsm34+NjVW9fGcJejCx3T+B/P46O2Zt671aE/Uq9eqrr+odghCife43Ldi2pHT2Vwi9aLVf+vXrJ99319rvzOeff652OHb8VScdj9G+ffvK9wNxLkUvBEdiZTsBpC/cHQxqfLC99tprLtdpeeJQepC/8MILLtd5O42BK9/5zndcrnviiScUlX3z5k23631t/XBm4MCBLtctXbpUcflFRUUu1yn9qfHq1atu12u9f7R+f7Ws90p/kvI0t5vSqW3UqHvuHDhwQLNt27boOxo+fLiisl1191CLu/3i7vzvibtWcE8t5J7s2bPH5Tql0+e4O0bdndu84e4LrNLj092xr8Z8rw7nJpc5TVB0XiciIiIKIC47r4f7Mwo3AnR8dCIiIiLvBf04VkRERESBgokVERERkUqYWBERERGphIkVERERkUqYWBERERGphIkVERERkUqYWBERERGphIkVERERkUqYWBERERGphIkVERERkUqYWBERERGphIkVERERkUqYWBERERGphIkVERERkUqYWBERERGphIkVERERkUqYWBERERGphIkVERERkUqYWBERERGphIkVERERkUqYWBERERGphIkVERERkUqYWBERERGp5P8B5OLXPndI+eQAAAAASUVORK5CYII=\n",
"text/plain": [
"<Figure size 720x720 with 1 Axes>"
]
},
"metadata": {
"needs_background": "light"
},
"output_type": "display_data"
}
],
"source": [
"xgb.plot_tree(xgb_classif,num_trees=0)\n",
"plt.rcParams['figure.figsize'] = [100, 70]\n",
"plt.show()"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"### Plot Variable Importance"
]
},
{
"cell_type": "code",
"execution_count": 41,
"metadata": {
"scrolled": true
},
"outputs": [
{
"data": {
"image/png": "iVBORw0KGgoAAAANSUhEUgAAAu4AAAJcCAYAAACmHyG0AAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADl0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uIDMuMC4zLCBodHRwOi8vbWF0cGxvdGxpYi5vcmcvnQurowAAIABJREFUeJzs3XmYHVW9t/37G4IKCTLIIIOQB8EwJBAFUVAxyvCoiIgTLwdlEhUPqHDEA3oc0EePIKDiAZVZFEVEZBCQQaQRFVTAxIgYUYjCYZ5JmJLwe//Y1XEndJImdKe7kvtzXX2x99qrqn5VK15+9+pV1akqJEmSJA1vI4a6AEmSJEkLZ3CXJEmSWsDgLkmSJLWAwV2SJElqAYO7JEmS1AIGd0mSJKkFDO6SJDWSfDvJZ4a6DknqS3yOuyTpuUoyDVgDmN3V/LKquuM57HMicEZVrfPcqmunJN8Bbq+qTw91LZKGB2fcJUkDZeeqGt31s8ihfSAkGTmUx38ukiwz1DVIGn4M7pKkQZXk1Ul+k+ShJJObmfTez/ZJclOSR5PckuRDTfso4GfAWkmmNz9rJflOki92bT8xye1d76clOTTJH4EZSUY2252T5N4ktyb56AJqnbP/3n0n+c8k9yS5M8nbk7wlyV+TPJDkU13bHp7kx0nOas7nhiSbd32+cZKe5jrcmORt8xz3W0kuTjIDeD+wB/Cfzbn/tOl3WJK/N/v/c5Jdu/axd5JfJTk6yYPNub656/NVkpyW5I7m8/O6PntrkklNbb9Jslm/B1jSYmNwlyQNmiRrAxcBXwRWAQ4BzkmyWtPlHuCtwAuBfYCvJXlFVc0A3gzcsQgz+LsDOwErAU8DPwUmA2sD2wEHJfm//dzXi4EXNNt+FjgJeC+wBfA64LNJ1u/qvwtwdnOuPwDOS7JskmWbOi4DVgc+Anw/ydiubf8N+BKwAvBd4PvAV5pz37np8/fmuCsCnwfOSLJm1z5eBUwFVgW+ApySJM1n3wOWBzZtavgaQJJXAKcCHwJeBJwAXJDk+f28RpIWE4O7JGmgnNfM2D7UNZv7XuDiqrq4qp6uqsuB64C3AFTVRVX19+q4ik6wfd1zrOMbVXVbVT0OvBJYraq+UFVPVdUtdML3/9fPfc0EvlRVM4Ef0gnEx1bVo1V1I3Aj0D07fX1V/bjp/1U6of/Vzc9o4Iimjl8AF9L5ktHr/Kr6dXOdnuirmKo6u6ruaPqcBdwMbNXV5R9VdVJVzQZOB9YE1mjC/ZuB/avqwaqa2VxvgA8AJ1TVb6tqdlWdDjzZ1CxpGGnt+j9J0rDz9qr6+Txt6wHvTrJzV9uywJUAzVKOzwEvozOZtDww5TnWcds8x18ryUNdbcsAV/dzX/c3IRjg8ea/d3d9/jidQP6MY1fV080ynrV6P6uqp7v6/oPOTH5fdfcpyZ7AfwBjmqbRdL5M9Lqr6/iPNZPto+n8BuCBqnqwj92uB+yV5CNdbc/rqlvSMGFwlyQNptuA71XVB+b9oFmKcQ6wJ53Z5pnNTH3v0o6+Hns2g0647/XiPvp0b3cbcGtVbbgoxS+Cl/S+SDICWAfoXeLzkiQjusL7usBfu7ad93znep9kPTq/LdgOuKaqZieZxL+u14LcBqySZKWqeqiPz75UVV/qx34kDSGXykiSBtMZwM5J/m+SZZK8oLnpcx06s7rPB+4FZjWz7zt2bXs38KIkK3a1TQLe0txo+WLgoIUc/3fAI80Nq8s1NYxL8soBO8O5bZHkHc0TbQ6is+TkWuC3dL50/Gez5n0isDOd5TfzczfQvX5+FJ0wfy90buwFxvWnqKq6k87Nvt9MsnJTw7bNxycB+yd5VTpGJdkpyQr9PGdJi4nBXZI0aKrqNjo3bH6KTuC8DfgEMKKqHgU+CvwIeJDOzZkXdG37F+BM4JZm3fxadG6wnAxMo7Me/qyFHH82nYA8AbgVuA84mc7NnYPhfGA3OufzPuAdzXryp4C30Vlnfh/wTWDP5hzn5xRgk957Bqrqz8AxwDV0Qv144NfPorb30Vmz/xc6NwUfBFBV19FZ535cU/ffgL2fxX4lLSb+ASZJkgZAksOBDarqvUNdi6QlkzPukiRJUgsY3CVJkqQWcKmMJEmS1ALOuEuSJEkt4HPctURaaaWVaoMNNhjqMpZ6M2bMYNSoUUNdxlLPcRgeHIfhwXEYHhyHuV1//fX3VdVqC+tncNcSaY011uC6664b6jKWej09PUycOHGoy1jqOQ7Dg+MwPDgOw4PjMLck/+hPP5fKSJIkSS1gcJckSZJawOAuSZIktYDBXZIkSWoBg7skSZLUAgZ3SZIkqQUM7pIkSVILGNwlSZKkFjC4S5IkSS1gcJckSZJawOAuSZIktYDBXZIkSWoBg7skSZLUAgZ3SZIkqQUM7pIkSVILGNwlSZKkFjC4S5IkSS1gcJckSZJawOAuSZIktYDBXZIkSWoBg7skSZLUAgZ3SZIkqQUM7pIkSVILGNwlSZKkFjC4S5IkSS1gcJckSZJawOAuSZIktYDBXZIkSWoBg7skSZLUAgZ3SZIkqQUM7pIkSVILGNwlSZKkFjC4S5IkSS1gcJckSZJawOAuSZIktYDBXZIkSWoBg7skSZLUAgZ3SZIkqQUM7pIkSVILGNwlSZKkFjC4S5IkSS1gcJckSZJawOAuSZIktYDBXZIkSWoBg7skSZLUAgZ3SZIkqQUM7pIkSVILpKqGugZpwK27/gY14j3HDnUZS72Pj5/FMVNGDnUZSz3HYXhwHIYHx2F4GIhxmHbETgNUzdBLcn1Vbbmwfs64S5IkSS1gcJckSVJr7bvvvqy++uqMGzduTtsDDzzADjvswIYbbsgOO+zAgw8+CMD555/PZpttxoQJE9hyyy351a9+NWebZZZZhgkTJjBhwgTe9ra3Lfbz6A+D+2KQZKUk/971fmKSC5/F9mOT9CSZlOSmJCc27Vsm+cYA17p3knubY/0lycHPcX+zm33dmGRykv9IssB/d0nGJPm353JcSZK0dNh777255JJL5mo74ogj2G677bj55pvZbrvtOOKIIwDYbrvtmDx5MpMmTeLUU09lv/32m7PNcsstx6RJk5g0aRIXXHDBYj2H/jK4Lx4rAf++0F7z9w3ga1U1oao2Bv4HoKquq6qPDkSB8zirqiYArwH+K8lLnsO+Hm/q3hTYAXgL8LmFbDMGMLhLkqSF2nbbbVlllVXmajv//PPZa6+9ANhrr70477zzABg9ejRJAJgxY8ac121hcJ9HM9v7lyQnJ/lTku8n2T7Jr5PcnGSrJKskOS/JH5Ncm2SzZtvDk5zazI7fkqQ3VB8BvLSZeT6qaRud5MfNsb6f5l9OkiOS/LnZ99FN3zWB23trrKopTd85M/cLODZJ9mz2NznJ95q21ZKck+T3zc9r5r0WVXU/8Lfm+PPdpmm/PMkNSU5I8o8kq/axv3uADwIHpmNMkqub7W5Isk3X9Xpdc70OTrJMkqOaY/4xyYee9cBKkqSlxt13382aa64JwJprrsk999wz57Nzzz2XjTbaiJ122olTTz11TvsTTzzBlltuyatf/eo5QX+48bbqvm0AvJtOyPw9ndnf1wJvAz4F3Ab8oarenuSNwHeBCc22GwFvAFYApib5FnAYMK6ZxSbJRODlwKbAHcCvgdck+TOwK7BRVVWSlZp9fg34RZLfAJcBp1XVQ33U3dexXwb8F/CaqrovSe9X0mPpzOL/Ksm6wKXAxt07a9pfAPxxIdt8DvhFVX05yZua69anqrqlWSqzOnAPsENVPZFkQ+BMYMvmeh1SVW9t6vgg8HBVvTLJ84FfJ7msqm6dp94P9h571VVX47PjZ82vDC0mayzXeXKAhpbjMDw4DsOD4zA8DMQ49PT0zHl91113MWPGjDlts2bNmuvz7vcrr7wy3/72t5k8eTIHHnggxxxzDAA//OEPWXXVVbnjjjvYf//9mTFjBmuvvfZzqnGgGdz7dmvXrPaNwBVNkJ5CZxnHesA7AarqF0lelGTFZtuLqupJ4Mkk9wBrzOcYv6uq25tjTGr2ey3wBHBykouAC5tjnJbkUuBNwC7Ah5Js3sc++zr2G4EfV9V9zb4eaPpuD2zS9SuiFyZZoXm9W5I3AGOBD1TVEwvZ5rV0vnBQVZckeXA+59yrdwfLAsclmQDMpvMloy87ApsleVfzfkVgQ2Cu4F5VJwInQudxkD7ua+j52LXhwXEYHhyH4cFxGB4G5HGQe0z81+tp0xg1ahQTJ3ba1l57bcaOHcuaa67JnXfeyVprrTXns14TJ07k61//OuPGjWPVVedeKHDZZZfx/Oc//xnbDDWXyvTtya7XT3e9f5rOl52+FkT1PhC/e9vZzP/L0TP6VdUsYCvgHODtwJw7Larqjqo6tap2AWYB43imvo6drtq6jQC2btafT6iqtavq0eazs5o16a8Djkny4oVs0+8FYknWb2q7BzgYuBvYnM5M+/Pmtxnwka7j/p+quqy/x5QkSUuXt73tbZx++ukAnH766eyyyy4A/O1vf6P3bxjdcMMNPPXUU7zoRS/iwQcf5MknOzHqvvvu49e//jWbbLLJ0BS/AAb3RfNLYA+Ys+zlvqp6ZAH9H6WzfGWBkowGVqyqi4GDaJbfJHlTkmWb1y8GXgT8bz9rvQJ4T5IXNdv3LpW5DDiw69gT5t2wqq4Bvgd8bCHb/Ap4T9O2I7DyfM5vNeDbwHHV+V/NisCdVfU08D5gmabrvNfrUuDDXdfgZUlG9efkJUnSkm333Xdn6623ZurUqayzzjqccsopHHbYYVx++eVsuOGGXH755Rx22GEAnHPOOYwbN44JEyZwwAEHcNZZZ5GEm266iS233JLNN9+cN7zhDRx22GHDMrj7u6JFczhwWpI/Ao8Bey2oc1Xd39zc+ifgZ8BF8+m6AnB+khfQmWXufRTjjsCxSXqXrHyiqu5KstHCCq2qG5N8CbgqyWzgD8DewEeB45tzGEnny8j+feziSOCGJP+9gG0+D5yZZDfgKuBOOuEbYLlmKdCydH5T8D3gq81n3wTOSfJu4EpgRtP+R2BWksnAd+isrR/T1BHgXjq/kZAkSUu5M888s8/2K6644hlthx56KIceeugz2rfZZhumTJky4LUNtPT+ukBaVM0No7OralaSrYFv9d6IO1TGjh1bU6dOHcoSROfGoeG2PnBp5DgMD47D8OA4DA+Ow9ySXF9VWy6snzPuGgjrAj9qnhbzFPCBIa5HkiRpiWNw13NWVTfTebylJEmSBok3p0qSJEktYHCXJEmSWsDgLkmSJLWAwV2SJElqAYO7JEmS1AIGd0mSJKkFDO6SJElSCxjcJUmSpBYwuEuSJEktYHCXJEmSWsDgLkmSJLWAwV2SJElqAYO7JEmS1AIGd0mSJKkFDO6SJElSCxjcJUmSpBYwuEuSJEktYHCXJEmSWsDgLkmSJLWAwV2SJElqAYO7JEmS1AIGd0mSJKkFDO6SJElSCxjcJUmSpBYwuEuSJEktYHCXJEmSWsDgLkmSJLWAwV2SJElqAYO7JEmS1AIGd0mSJKkFDO6SJElSCxjcJUmSpBYwuEuSJEktYHCXJEmSWsDgLkmSJLWAwV2SJElqAYO7JEmS1AIGd0mSJKkFDO6SJElSCxjcJUmSpBYYOdQFSIPh8ZmzGXPYRUNdxlLv4+NnsbfjMOQch+HBcRhc047YaahLkAadM+6SJElSCzjjLkmSlghTp05lt912m/P+lltu4Qtf+ALXXHMNU6dOBeCuu+7ixS9+MZMmTWLmzJnst99+3HDDDcyaNYs999yTT37yk0NVvrRQBndJkrREGDt2LJMmTQJg9uzZrL322uy6664cdNBBc/q85z3vYdy4cQCcffbZPPnkk0yZMoXHHnuMTTbZhN13350xY8YMRfnSQrlURpIkLXGuuOIKXvrSl7LeeuvNaasqenp62H333QFIwowZM5g1axaPP/44z3ve83jhC184VCVLC2Vw15BIcl6S65PcmOSDTdv7k/w1SU+Sk5Ic17SvluScJL9vfl4ztNVLkoa7H/7wh3MCeq+rr76alVdemQ033BCAd73rXYwaNYo111yTddddl0MOOYRVVlllKMqV+sWlMhoq+1bVA0mWA36f5CLgM8ArgEeBXwCTm77HAl+rql8lWRe4FNh43h02XwA+CLDqqqvx2fGzFsNpaEHWWK7zJA0NLcdheHAcBldPT8+c1zNnzuScc87hrW9961ztX/va13jta187p23KlCncd999nHnmmTz66KN87GMfY/To0ay11lqLt/il0PTp0+caG/WPwV1D5aNJdm1evwR4H3BVVT0AkORs4GXN59sDmyTp3faFSVaoqke7d1hVJwInAqy7/gZ1zBT/eQ+1j4+fheMw9ByH4cFxGFzT9pg45/X555/Pq171Kt7xjnfMaZs1axa77bYbxx13HBMndvqeffbZ7LXXXmy//fYA/PSnP2XkyJFzPtfg6enp8TovApfKaLFLMpFOGN+6qjYH/gBMXcAmI5q+E5qftecN7ZIk9TrzzDOfsUzm5z//ORtttBGrrbbanLZ1112XX/ziF1QVM2bM4Nprr2WjjTZa3OVK/WZw11BYEXiwqh5LshHwamB54PVJVk4yEnhnV//LgAN73ySZsFirlSS1xmOPPcbll18+12w79L3m/YADDmD69OmMGzeOV77yleyzzz5sttlmi7Nc6Vnxd3YaCpcA+yf5I52Z9muB/wX+G/gtcAfwZ+Dhpv9HgeOb/iOBXwL7L+6iJUnD3/LLL8/999//jPbvfOc7wNxr4UePHs3ZZ5+9mCqTnjuDuxa7qnoSePO87Umuq6oTmxn3c+nMtFNV9wG7zdt/QZZbdhmm+uevh1xPT89c6041NByH4cFxkPRcuVRGw8nhSSYBfwJuBc4b4nokSZKGDWfcNWxU1SFDXYMkSdJw5Yy7JEmS1AIGd0mSJKkFDO6SJElSCxjcJUmSpBYwuEuSJEktYHCXJEmSWsDgLkmSJLWAwV2SJElqAYO7JEmS1AIGd0mSJKkFDO6SJElSCxjcJUmSpBYwuEuSJEktYHCXJEmSWsDgLkmSJLWAwV2SJElqAYO7JEmS1AIGd0mSJKkFDO6SJElSCxjcJUmSpBYwuEuSJEktYHCXJEmSWsDgLkmSJLWAwV2SJElqAYO7JEmS1AIGd0mSJKkFDO6SJElSCxjcJUmSpBYwuEuSJEktYHCXJEmSWsDgLkmSJLWAwV2SJElqAYO7JEmS1AIGd0mSJKkFDO6SJElSCxjcJUmSpBYwuEuSJEktYHCXJEmSWsDgLkmSJLWAwV2SJElqAYO7JEmS1AIjh7oAaTA8PnM2Yw67aKjLWOp9fPws9nYchtyijsO0I3YahGokSYvKGXdJ0kLNnj2bl7/85bz1rW8FYI899mDs2LGMGzeOfffdl5kzZwLw8MMPs/POO7P55puz6aabctpppw1l2ZK0RDG4t0CStZL8uHk9McmFzevDkxwyT99pSVYdoOPumeRPSW5M8ufeYyXpSbLlc9z3OknOT3JzkluSHJfk+c1nE5K8ZSDOQdLAOPbYY9l4443nvN9jjz34y1/+wpQpU3j88cc5+eSTATj++OPZZJNNmDx5Mj09PXz84x/nqaeeGqqyJWmJYnBvgaq6o6retbiOl2RkkjcDBwE7VtWmwCuAhwdg38skCfAT4Lyq2hDYEFgO+ErTbQJgcJeGidtvv52LLrqI/fbbb07bW97yFpKQhK222orbb78dgCQ8+uijVBXTp09nlVVWYeRIV2VK0kAwuA+CJO9N8rskk5Kc0ITV6UmOTHJ9kp8n2aqZub4lydua7cYkuTrJDc3PNl3tf3qWNYxKclGSyc2s+W5N+xZJrmrquDTJmk17T5L/TnIV8DHgk8AhVXUHQFU9UVUndR3i3c05/jXJ6xZS/8QkVyb5ATAFeCPwRFWd1ux7NnAwsGeSFwJfAHZrrt9uzaz8as2+RiT520D9VkHSwh100EF85StfYcSIZ/5fxsyZM/ne977Hm970JgAOPPBAbrrpJtZaay3Gjx/Pscce2+d2kqRnz2mQAZZkY2A34DVVNTPJN4E9gFFAT1UdmuRc4IvADsAmwOnABcA9wA5V9USSDYEzgUVdkvIm4I6q2qmpa8UkywL/A+xSVfc2Yf5LwL7NNitV1eub/v8FXL+A/Y+sqq2aJS2fA7ZfSP1bAeOq6tYkH51331X1SJJpwPrAZ4Etq+rAppaN6FzDrzfHmVxV981bUJIPAh8EWHXV1fjs+Fn9vVYaJGss17kxUkNrUcehp6eHa665hpkzZ/Loo48yadIk7r//fnp6eub0Ofroo1l//fWZPXs2PT09XHXVVay66qr84Ac/4I477mC//fbj5JNPZtSoUQN4Ru00ffr0ua6dhobjMDw4DovG4D7wtgO2AH7fWRHCcnQC7VPAJU2fKcCTTbCfAoxp2pcFjksyAZgNvGwhx6oFtE8Bjk5yJHBhVV2dZBwwDri8qW0Z4M6u7c7q70nSWeoCnQDen/p/V1W3Nq8zn9ozn2OdCpxPJ7jvC/R5t1tVnQicCLDu+hvUMVP85z3UPj5+Fo7D0FvUcZi2x0QuvfRSrr/+evbee2+eeOIJHnnkEU4++WTOOOMMPv/5zzNy5Eh+9KMfzZlVP+qoozjssMN43eteB8App5zCaqutxlZbbTWg59RGPT09TJw4cajLWOo5DsOD47Bo/P3lwAtwelVNaH7GVtXhwMyq6g2rTwNPAlTV0/zrC9TBwN3A5nRmqp+3kGPdD6w8T9sKwENV9Vc6XyCmAF9O8tmmthu7ahtfVTt2bTuj6/WNzfbz82Tz39n9rH/efc/1m4RmicwawNR5D1RVtwF3J3kj8CrgZwuoS9IA+vKXv8ztt9/OtGnT+OEPf8gb3/hGzjjjDE4++WQuvfRSzjzzzLmWwqy77rpcccUVANx9991MnTqV9ddff6jKl6QlisF94F0BvCvJ6gBJVkmyXj+3XRG4swnz76MzI74gvwTelmSF5ljvoLOMZHaStYDHquoM4Gg6N5dOBVZLsnXTf9kkm85n318GvpLkxU3f5zdLXAai/iuA5ZPs2ex7GeAY4Liqehx4lM4XkG4nA2cAP2rWxEsaQvvvvz933303W2+9NRMmTOALX/gCAJ/5zGf4zW9+w/jx49luu+048sgjWXVVb0mRpIHg77AHWFX9OcmngcuSjABmAgf0c/NvAuckeTdwJXPPUvd1rD8mOQ74VZKisySn97EP44Gjkjzd1PDhqnoqybuAbyRZkc74f53ODPi8+744yRrAz5unwBSdJSvPuf6qqiS7Ascn+QywGnBWVX2p6XIlcFiSScCXq+osOvcAnMZ8lslIGnwTJ06c86vtWbP6XjO/1lprcdllly3GqiRp6WFwHwRN0Jx3vfjors8Pn6f/6Oa/NwObdX30yaZ9Gp216VRVD9DTte0JwAl91HApcGkf7ZOAbfton9hHW59Bubtvc5PomIXUP1fNTdttQO/TdLYBzkyyRVVdX1UPAK+c57Cb0/ltwl/mrUeSJGlpYHDXkKuq3wDzXU6U5DDgw3SeLNMvyy27DFP9c+1Drqenh2l7TBzqMpZ6joMkLRlc465hr6qOqKr1qupXQ12LJEnSUDG4S5IkSS1gcJckSZJawOAuSZIktYDBXZIkSWoBg7skSZLUAgZ3SZIkqQUM7pIkSVILGNwlSZKkFjC4S5IkSS1gcJckSZJawOAuSZIktYDBXZIkSWoBg7skSZLUAgZ3SZIkqQUM7pIkSVILGNwlSZKkFjC4S5IkSS1gcJckSZJawOAuSZIktYDBXZIkSWoBg7skSZLUAgZ3SZIkqQUM7pIkSVILGNwlSZKkFjC4S5IkSS1gcJckSZJawOAuSZIktYDBXZIkSWoBg7skSZLUAgZ3SZIkqQUM7pIkSVILGNwlSZKkFjC4S5IkSS1gcJckSZJawOAuSZIktYDBXZIkSWoBg7skSZLUAgZ3SZIkqQUM7pIkSVILGNwlSZKkFjC4S5IkSS0wcqgLkAbD4zNnM+awi4a6jKXed940aqhLkCRpieGMuyRJktQCBndJg2rfffdl9dVXZ9y4cXPaJk+ezNZbb8348ePZeeedeeSRRwB46qmn2GeffRg/fjybb745PT09Q1S1JEnDj8F9AZJUkmO63h+S5PAB2vd3krxrIPY1z357kmy5kD6HJ/nfJJO6flYagGPvn2TP5vWc80syLcmqXf0mJrnwuR5P7bD33ntzySWXzNW23377ccQRRzBlyhR23XVXjjrqKABOOukkAKZMmcLll1/Oxz/+cZ5++unFXrMkScPRUh/ckyxonf+TwDu6Q+dwkGSZAdjN16pqQtfPQ891h1X17ar67gDUtlDpWOr//bbBtttuyyqrrDJX29SpU9l2220B2GGHHTjnnHMA+POf/8x2220HwOqrr85KK63Eddddt3gLliRpmFoigk+SMUn+kuT0JH9M8uMkyyfZIslVSa5PcmmSNZv+PUn+O8lVwMeSrJHk3CSTm59tml3PAk4EDu7jmHPNmCeZ3vx3YnPMHyX5a5IjkuyR5HdJpiR5addutk9yddPvrc32yyQ5Ksnvm3P5UNd+r0zyA2BKklFJLmrq/VOS3fqocXqSLzV9rk2yxkKu495Jzkvy0yS3JjkwyX8k+UOz/SpNvw809U1Ock6S5Zv2w5Mc0t9xa7Z5fdes/x+SrNC0f6LrGny+aRuT5KYk3wRuAF7ybI6l4WPcuHFccMEFAJx99tncdtttAGy++eacf/75zJo1i1tvvZXrr79+zmeSJC3tlqSnyowF3l9Vv05yKnAAsCuwS1Xd2wTbLwH7Nv1XqqrXAyQ5C7iqqnZtZrNHd+33eOCPSb7yLGrZHNgYeAC4BTi5qrZK8jHgI8BBTb8xwOuBlwJXJtkA2BN4uKpemeT5wK+TXNb03woYV1W3JnkncEdV7dScw4p91DEKuLaq/qup/wPAF5vPDk7y3ub1g1X1hub1OODlwAuAvwGHVtXLk3ytqe3rwE+q6qTmuF8E3g/8z7O4Pt0OAQ5oxm008ESSHYENm/MNcEGSbYF/0hnnfarq3+cPz/EiAAAgAElEQVTdUZIPAh8EWHXV1fjs+FmLWJIGyvTp0+np6eGuu+5ixowZc9as77///nzxi1/kE5/4BK95zWsYMWIEPT09vPSlL+Xyyy9no402Yo011mCjjTbipptucq37c9Q7DhpajsPw4DgMD47DolmSgvttVfXr5vUZwKfohNDLkwAsA9zZ1f+srtdvpBNKqarZwMO9H1TVI0m+C3wUeLyftfy+qu4ESPJ3oDd4TwHe0NXvR1X1NHBzkluAjYAdgc26ZvNXpBNinwJ+V1W3du3r6CRHAhdW1dV91PEU0LuW/Hpgh67PvlZVR/exzZVV9SjwaJKHgZ92HW+z5vW4JrCvROdLzqULuBYAtYC2XwNfTfJ9Ol8Ibm+C+47AH5o+o+lcg38C/6iqa/s8SNWJdH5Dwrrrb1DHTFmS/nm303feNIqJEycybdo0Ro3qvO615557AvDXv/6VG2+8cc5nvUtlALbZZhve8Y53sMkmmyzOspc4PT09c117DQ3HYXhwHIYHx2HRLEnJZt5w+ChwY1VtPZ/+M57Fvr9OZ2nGaV1ts2iWGqXzzeB5XZ892fX66a73TzP3NZ+35qIzw/yRqporDCeZ2F1zVf01yRbAW4AvJ7msqr4wz/5mVlXvMWbTv/HuT+3fAd5eVZOT7A1MXMg+7wdWBu5r3q/S+7qqjkhyUXMe1ybZns41+HJVndC9kyRjeHbjpmHqnnvuYfXVV+fpp5/mi1/8Ivvvvz8Ajz32GFXFqFGjuPzyyxk5cqShXZKkxhKxxr2xbpLekL47cC2wWm9bkmWTbDqfba8APtz0WybJC7s/rKoHgB/RWRLSaxqwRfN6F2DZRaj53UlGNOve1wem0pm9/nCSZZt6XpbkGX/FJslawGNVdQZwNPCKRTj+oloBuLOpcY9+9O8B3gdzbqx9L3Bl8/6lVTWlqo4ErqPzW4dLgX2bpTMkWTvJ6gN+Flosdt99d7beemumTp3KOuuswymnnMKZZ57Jy172MjbaaCPWWmst9tlnH6AT6F/xilew8cYbc+SRR/K9731viKuXJGn4WJJm3G8C9kpyAnAznTXXlwLfaNZ/j6Qzc35jH9t+DDgxyfvpzEx/GLhmnj7HAAd2vT8JOD/J7+gE/0WZCZ4KXAWsAexfVU8kOZnO2vcbmpn8e4G397HteOCoJE8DM5uan43uNe7M5xjz8xngt8A/6CyhWWEh/f8f8K0kk+nMpl9CZzkTwEFJ3kDnuv8Z+FlVPZlkY+CaZpnTdDphf/azqFHDxJlnntln+8c+9rFntI0ZM4apU6cOdkmSJLVS/rWSor2aJRQXVtW4hXTVUmLs2LFlABx6rmEcHhyH4cFxGB4ch+HBcZhbkuuraoF/hweWrKUykiRJ0hJriVgqU1XT6DxBRpIkSVoiOeMuSZIktYDBXZIkSWoBg7skSZLUAgZ3SZIkqQUM7pIkSVILGNwlSZKkFjC4S5IkSS1gcJckSZJawOAuSZIktYDBXZIkSWoBg7skSZLUAgZ3SZIkqQUM7pIkSVILGNwlSZKkFjC4S5IkSS1gcJckSZJawOAuSZIktYDBXZIkSWoBg7skSZLUAgZ3SZIkqQUM7pIkSVILGNwlSZKkFjC4S5IkSS1gcJckSZJawOAuSZIktYDBXZIkSWoBg7skSZLUAs86uCdZOclmg1GMJEmSpL71K7gn6UnywiSrAJOB05J8dXBLkyRJktSrvzPuK1bVI8A7gNOqagtg+8ErS5IkSVK3/gb3kUnWBN4DXDiI9UiSJEnqQ3+D+xeAS4G/V9Xvk6wP3Dx4ZUmSJEnqNrI/narqbODsrve3AO8crKIkSZIkza2/N6e+LMkVSf7UvN8syacHtzRJkiRJvfq7VOYk4JPATICq+iPw/w1WUZIkSZLm1t/gvnxV/W6etlkDXYwkSZKkvvU3uN+X5KVAASR5F3DnoFUlSZIkaS79ujkVOAA4Edgoyf8CtwJ7DFpVkiRJkuay0OCeZASwZVVtn2QUMKKqHh380iRJkiT1WuhSmap6GjiweT3D0C5JkiQtfv1d4355kkOSvCTJKr0/g1qZJEmSpDn6u8Z93+a/B3S1FbD+wJYjDYzHZ85mzGEXDXUZrTHtiJ2GugRJkrQQ/Zpxr6r/08ePoV1aguy7776svvrqjBs3bk7b4Ycfztprr82ECROYMGECF1988Vzb/POf/2T06NEcffTRi7tcSZKWOv2acU+yZ1/tVfXdgS1H0lDZe++9OfDAA9lzz7n/537wwQdzyCGH9LnNwQcfzJvf/ObFUZ4kSUu9/q5xf2XXz+uAw4G3DVJN85VkrSQ/bl5PTHJh83rvJPcm+UOSm5NcmmSbxVDPxUlWGuRjrJTk3xfSZ861eBb7PSjJ8s+tujn76nNc1C7bbrstq6zS/1tXzjvvPNZff3023XTTQaxKkiT16u9SmY90/XwAeDnwvMEtrc867qiqd83n47Oq6uVVtSFwBPCTJBsPcj1vqaqHBvMYwErAAoP7IjoIGJDgvpBxUcsdd9xxbLbZZuy77748+OCDAMyYMYMjjzySz33uc0NcnSRJS4/+3pw6r8eADRfWKcl7gY/SCfm/pRNAHwaOB7YHHgQ+BXwFWBc4qKouSDIG+B4wqtnVgVX1m6b9wqr61yLcPlTVlUlOBD4IHJxkAvBtOkH178C+VfVgkh7gD8AWwGrAnsAngfF0vgh8ujmP84CXAC8Ajq2qE5v2acCWwGjgZ8CvgG2A/wV2qarH53NdNmjqWQ2YDbwbuBs4H1gZWBb4dFWdT+dLyEuTTAIur6pPzOe0Rzez3uOA64H3VlUl2Q44ms5Y/x74MPAhYC3gyiT3VdUbkkxnkMclyX8C7wOeBn5WVYc917GZZ/8fpDPmrLrqanx2/KwFlaMuPT09ANx1113MmDFjzvvNNtuMU045hSSceuqp/Nu//RuHHnoo3/rWt9hxxx257rrrmDZtGsstt9ycbbpNnz69z3YtXo7D8OA4DA+Ow/DgOCya/q5x/ymdp8hAZ5Z+E+DshWyzMbAb8Jqqmpnkm3T+2uoooKeqDk1yLvBFYIdmn6cDFwD3ADtU1RNJNgTOpBOQn40b6ARUgO8CH6mqq5J8AfgcnRlngKeqatskH6MTnLcAHgD+nuRrVXU/nTD5QJLlgN8nOadp77YhsHtVfSDJj4B3AmfMp7bvA0dU1blJXkDnmj4F7FpVjyRZFbg2yQXAYcC4qpqwkPN9ObApcAfwa+A1Sa4DvgNsV1V/TfJd4MNV9fUk/wG8oarua7Yf1HFJ8mbg7cCrquqxrseJPtexmaP5QnUiwLrrb1DHTFnU76VLn2l7TOz8d9o0Ro0axcSJE5/RZ/311+etb30rEydO5DOf+Qy//e1vOf3003nooYcYMWIEm266KQceeOBc2/T09PS5Ly1ejsPw4DgMD47D8OA4LJr+JpvuR0bMAv5RVbcvZJvt6ASt3ycBWI5O8HsKuKTpMwV4sgn2U4AxTfuywHHNbOxs4GX9rLNbAJKsCKxUVVc17acz95eOC7pqubGq7my2u4XOLPv9wEeT7Nr0ewmdkD5vcL+1qiY1r6/vOpe5i0pWANauqnMBquqJpn1Z4L+TbEtnRnptYI1ncb6/6x2TZnZ+DPBoU9dfu879AODrfWw/2OOyPXBaVT0G0HwRGoix0SC68847WXPNNQE499xz5zxx5uqrr57T5/DDD2f06NHPCO2SJGlg9Te4v6WqDu1uSHLkvG3zCHB6VX1ynu0Oqare2fungSeh8xdak/TWczCdpSOb05mNfqKfdXZ7OXBTP/o9OW8tXe9HJplIJ3Ru3cwU99BZMjO//UAn1C43n+NlPu170FkSskUTmKfN5zjzM+/xRy7gWH2ZOcjjEv71W5v+WuDYPMt9aSF23313enp6uO+++1hnnXX4/Oc/T09PD5MmTSIJY8aM4YQTThjqMiVJWmr1N/zsAMwb0t/cR1u3K4DzmyUN9zRLI1bo5/FWBG5vQuNewDL93A6AJK+ns9b5DVX1cJIHk7yuqq6ms8b6qgXv4Rm1PNiE9o2AVz+bWubVLIW5Pcnbq+q8JM+nc34rAvc0of0NwHrNJo/S/+s2r78AY5JsUFV/Y+5z793vffPbuA/PZVwuAz6b5Ae9S2WaWffnMjYaQGeeeeYz2t7//vcvdLvDDz98EKqRJEnzWmBwT/JhOjeUrp/kj10frUBnHfV8VdWfk3wauCzJCGAmc//l1QX5JnBOkncDVwIz+rHNbkleS+cmx1uBd1ZV74z7XsC3m8cf3gLs0886oLN8ZP/m/KcC1z6LbefnfcAJzZrumXRuTv0+8NNmXfokOqGbqro/ya+T/InODZ3zuzn1GZq16PsAZzez5r+ncyModNaC/yzJnVX1hn7u8lmNS5Itgf2rar+quqRZYnNdkqeAi+ncAPtcxma+llt2Gab610AlSdISJP9aHdHHh501yCsDX6Zzk2SvR6vqgUGuTVpkY8eOralTpw51GUs9bz4aHhyH4cFxGB4ch+HBcZhbkuuraqEP/FjgjHtVPUzn8Y27Nztdnc6669FJRlfVPweiWEmSJEkL1t/HQe4MfJXOs7/vobP++iY6jx/UfCQ5HnjNPM3HVtVpi7i/8XSeo97tyap61aLsT5IkSe3R35tTv0jnpsyfV9XLm5sndx+8spYMVdXfNf393d8UYGHPc5ckSdISaEQ/+81s/tjNiCQjqupKDJCSJEnSYtPfGfeHkowGrga+n+QeOn+ISZIkSdJi0N8Z912Ax+j8KfpLgL8DOw9WUZIkSZLm1q8Z96qakWQ9YMOqOr155vaz+qNIkiRJkhZdv2bck3wA+DHQ+/fO1wbOG6yiJEmSJM2tv0tlDqDzWMNHAKrqZmD1wSpKkiRJ0tz6G9yfrKqnet8kGQnM/0+uSpIkSRpQ/Q3uVyX5FLBckh2As4GfDl5ZkiRJkrr1N7gfBtwLTAE+BFwMfHqwipIkSZI0twU+VSbJulX1z6p6Gjip+ZEkSZK0mC1sxn3Ok2OSnDPItUiSJEmaj4UF93S9Xn8wC5EkSZI0fwsL7jWf15IkSZIWo4X95dTNkzxCZ+Z9ueY1zfuqqhcOanWSJEmSgIUE96paZnEVIkmSJGn++vs4SEmSJElDyOAuSZIktYDBXZIkSWoBg7skSZLUAgZ3SZIkqQUM7pIkSVILGNwlSZKkFjC4S5IkSS1gcJckSZJawOAuSZIktYDBXZIkSWoBg7skSZLUAgZ3SZIkqQUM7pIkSVILGNwlSZKkFjC4S5IkSS1gcJckSZJawOAuSZIktYDBXZIkSWoBg7skSZLUAgZ3SZIkqQUM7pIkSVILGNwlSZKkFjC4S5IkSS0wcqgLkAbD4zNnM+awi4a6jGdl2hE7DXUJkiRpGHPGXRpmjj32WMaNG8emm27K17/+dQDOPvtsNt10U0aMGMF11103xBVKkqShYHCXhpE//elPnHTSSfzud79j8uTJXHjhhdx8882MGzeOn/zkJ2y77bZDXaIkSRoiBvcBkmStJD9uXk9McmHzeu8k9yb5Q5Kbk1yaZJvFUM/FSVZaSJ/vJLk1yaQkNyTZumn/QpLtB7CWlyS5MslNSW5M8rGF9O9JsuVAHb9NbrrpJl796lez/PLLM3LkSF7/+tdz7rnnsvHGGzN27NihLk+SJA0hg/sAqao7qupd8/n4rKp6eVVtCBwB/CTJxoNcz1uq6qF+dP1EVU0ADgNOaLb9bFX9fADLmQV8vKo2Bl4NHJBkk+eywyRL5P0Z48aN45e//CX3338/jz32GBdffDG33XbbUJclSZKGgSUy/PRHkvcCHwWeB/wW+HfgYeB4YHvgQeBTwFeAdYGDquqCJGOA7wGjml0dWFW/adovrKpxCzpuVV2Z5ETgg8DBSSYA3waWB/4O7FtVDybpAf4AbAGsBuwJfBIYT+eLwKeb8zgPeAnwAuDYqjqxaZ8GbAmMBn4G/ArYBvhfYJeqenye0n4JbNBs+53mXH6cZAvgq81+7gP2rqo7k2zQ1L0aMBt4d1X9PckngPcAzwfOrarPVdWdwJ3N+T+a5CZgbeDPC7hU703yDeCFzTX5XZLDgbWAMU0t/9a9QZIPNteVVVddjc+On7WA3Q8/PT09AOyyyy5svfXWLLfccqy33nrcddddcz576KGHuP7665k+ffrQFfosTJ8+fU7tGjqOw/DgOAwPjsPw4DgsmqUyuDez3bsBr6mqmUm+CexBJ4z3VNWhSc4FvgjsAGwCnA5cANwD7FBVTyTZEDiTTkB+Nm4APtS8/i7wkaq6KskXgM8BBzWfPVVV2zZLS86nE+IfAP6e5GtVdT+dUPtAkuWA3yc5p2nvtiGwe1V9IMmPgHcCZ8zTZ2dgyjzXaVngf+gE/XuT7AZ8CdgX+D5wRFWdm+QFwIgkOzbH2goIcEGSbavql137HAO8nM6XpQUZVVXbJNkWOBXo/UK0BfDaPr540HxpORFg3fU3qGOmtOuf97Q9JgIwceJEjjrqKAA+9alPsc466zBxYuezlVZaiS222IItt2zHSqKenp45tWvoOA7Dg+MwPDgOw4PjsGjalWwGznZ0AuDvkwAsRyeQPwVc0vSZAjzZBPspdGZ5AZYFjmtmymcDL1uE4wcgyYrASlV1VdN+OnB2V78Lumq5sZm5JsktdGbZ7wc+mmTXpt9L6ATneYP7rVU1qXl9fde5AByV5NPAvcD759luLJ3AfHlznZYB7kyyArB2VZ0LUFVPNHXtCOxI5zcF0Jml35DObD5JRgPn0PntxSMLuD7Q+UJEVf0yyQu71utf0FdoX5Lcc889rL766vzzn//kJz/5Cddcc81QlyRJkoaBpTW4Bzi9qj45V2NySFVV8/Zp4EmAqnq6a031wcDdwOZ07hF4YhGO/3Lgpn70e3LeWrrej0wykc6ynq2r6rFmec0LFrAf6HzZWK7r/Seq6sfzOX7ofGHYeq7G5IUL6P/lqjrhGR90Zu/PAb5fVT+Zz/bdaj7vZ/Rj21Z75zvfyf3338+yyy7L8ccfz8orr8y5557LRz7yEe6991522mknJkyYwKWXXjrUpUqSpMVoaQ3uVwDnN8tN7kmyCrBCP7ddEbi9CfN70ZmF7rckr6ezDvsNVfVwkgeTvK6qrgbeB1y14D08o5YHm9C+EZ0bPwfSVGC1JFtX1TVN+H5ZVd2Y5PYkb6+q85I8n851uBT4f0m+X1XTk6wNzKQzm38KcFNVfbWfx94NuDLJa4GHm2s1wKc3PF199dXPaNt1113Zdddd++gtSZKWFktlcK+qPzfLQy5LMoJOuDygn5t/EzgnybuBK+nfDPBuTQBdHrgVeGdV9c647wV8O8nywC3APs/iVC4B9k/yRzoh+9pnse1CVdVTSd4FfKNZ1jMS+DpwI50vGSc06/Jn0rk59bLm/oFrmpA9HXgvneVE7wOmJOldsvOpqrp4AYd/MMlvaG5OHcjzkiRJaqP8a2WItOQYO3ZsTZ06dajLWOp589Hw4DgMD47D8OA4DA+Ow9ySXF9VC33yhM9xlyRJklpgqVwqo+EhyfHAa+ZpPraqThuKeiRJkoYzg7uGTFX1974CSZKkpZ5LZSRJkqQWMLhLkiRJLWBwlyRJklrA4C5JkiS1gMFdkiRJagGDuyRJktQCBndJkiSpBQzukiRJUgsY3CVJkqQWMLhLkiRJLWBwlyRJklrA4C5JkiS1gMFdkiRJagGDuyRJktQCBndJkiSpBQzukiRJUgsY3CVJkqQWMLhLkiRJLWBwlyRJklrA4C5JkiS1gMFdkiRJagGDu6T/v707D7ujrO8//v6wL8EAEiqmQKTEEAQNS0UUIVGgVKgCYqlFBQIuRQVpQVG5XHCj7ggqoAIBEZewJEVkKRJwQX8opETESFmuiiJBiEDYEsP398dM4pOQ5UlIcp558n5dF1fOuc+cme/MfQ75zH3umUiSpA4wuEuSJEkdYHCXJEmSOsDgLkmSJHWAwV2SJEnqAIO7JEmS1AEGd0mSJKkDDO6SJElSBxjcJUmSpA4wuEuSJEkdYHCXJEmSOsDgLkmSJHWAwV2SJEnqAIO7JEmS1AEGd0mSJKkDDO6SJElSBxjcJUmSpA4wuEuSJEkdsFavC5BWhifmzGXESd/vdRnz3XPq/r0uQZIkdZwj7pIkSVIHOOIurSLTp0/n0EMPnf/8rrvu4pRTTuHBBx9k0qRJrLHGGmy++eacd955PP/5z+9hpZIkaSAyuEuryKhRo5g6dSoAc+fOZfjw4Rx00EFssskmfOxjHwPgS1/6EqeccgpnnnlmL0uVJEkD0KCcKpPk+Ukmto/HJrm8fXxEkgeS3JLkjiRXJXn5KqjniiQbr+RtbJzkmJW5jaVs/6ftnyOS/KpXdXTFtddey9/93d+x9dZb85znPGd++2OPPUaSHlYmSZIGqkE54l5VfwAOWczL36mqdwEkGQdckmRcVd2+Eut5zcpadx8bA8cAX1kF23qGqlrpJ0CDybe//W3e+MY3zn/+wQ9+kPPPP5+hQ4dy3XXX9bAySZI0UKWqel0DSd4EHAusA/ycJoA+DHwZ2BuYCXwA+DSwFfCeqpqcZARwAbBhu6p3VdVP2/bLq2qHJGOBE6rqgCRHALvOC+7ttk8BNqqq45OMAc4ENgDuBMZX1cwkU4BbgF2AYcBbgPcDO9KcCJzcrusyYEtgPeC0qjq7bb8H2BUYAvwA+DHwcuD3wOuq6onFHJdt23qGAXOBNwD3A5OATYC1gZOralKSbwOvA6YD11TViYtY3xrAGcBewN00v7icU1UT2xq/BYxr1/s24FPAtsBnqurMJEMWte123bOqakjfY7+I7b8FOAEo4NaqenOSrYFz2n18ADiyqv4vyXnAE8B2wNbAkcDhwO7Az6vqiEWs/21t3Wy22bBdPvTFry3qsPbEjsOHzn88Z84cDjnkEM4991w23XTTBZa78MILmT17NkceeeSqLnGlmDVrFkOGDOl1Gas9+2FgsB8GBvthYLAfFjRu3LhfVtWuS1uu5yPuSUYDhwKvqKo5Sb4CHEYTxqdU1fuSXAp8HNgH2B6YAEwGZgD7VNWTSUYCF9EE5GVxM/D29vH5wLur6vo20H8YeE/72uyq2jPJcTThdRfgIeDOJF+oqgdpgv5DSdYHbkpycdve10jgjVX11iTfBV4PfHMxtV0InFpVlyZZjyZozwYOqqpHkmwG/CzJZOAkYIeqGrOEfT0YGEFzwrE5cDtNaJ7nd1W1e5IvAOcBr6A5CbmN5gTiyUVtu/px9pfkRcAHafr5T0nmJdYzgPOrakKS8cCXgAPb1zYBXgW8Fvivtp6jaY7tmKqa2ncb7YnS2QBbbbNtfW5azz/e891z2Nj5jydNmsRuu+3GwQcf/IzlXvCCF7D//vszYcKEVVjdyjNlyhTGjh3b6zJWe/bDwGA/DAz2w8BgPyyfgZBsXk0Tgm9q5/auTxPIZwNXtstMA55qg/00mvAJzajvGe1I+Vzghcux/QAkGQpsXFXXt+0TgO/1WW5yn1puq6r72vfdRTPK/iBwbJKD2uW2pAnpCwf3u/sEzl/22ZcFi0o2AoZX1aUAVfVk27428MkkewJPA8OBv+nnvu4BfK+qngb+mGThORl993FIVT0KPJrkyXaO/mOL2fYf+7HtVwETq+pP7f481LbvTnNCAc2vJ5/u857/qqpq+/z+qpoGkOQ2muO2QHDviosuumiBaTJ33HEHI0eOBGDy5Mlst912vSpNkiQNYAMhuAeYUFXvX6AxOaHPSO7TwFMAVfV0knl1H08zdeQlNKPRTy7H9neiGXlemqcWrqXP87XaKTl7A7tX1ePt9Jr1lrAeaE421l/M9hZ3heJhNNNKdmlPZO5ZzHaWZZ0L17bIfVwB2+7PvKy+yyytns55/PHHueaaazjrrLPmt5100klMnz6dNdZYg6233to7ykiSpEUaCOHnWmBSO91kRjuFYqN+vncocG8b5g8H1lyWDSfZi2ZO9LiqejjJzCSvrKofAW8Grl/yGp5Ry8w2tG8HvGxZallYOx3l3iQHVtVlSdal2b+hwIw2OI+jmf8N8ChLP24/Bg5PMoEmgI+lmdfeX4vbdn9cC1w6b1pRkk3bUfefAv9CM9p+WFvjoLXBBhvw4IML/ghz8cUX96gaSZLUJT0P7lX16yQnA1e3F0/OAd7Zz7d/Bbg4yRuA62imcizNoUn2oLkA9W7g9X3uKHM4cGaSDYC7aC6I7K8rgXckuZXmAtGfLcN7F+fNwFntfPs5NBenXgj8V5Jf0EwV+Q1AG4Z/0t6K8QeLujgVuJhmatKvgN/SXAj88DLUs8htL06S5wNfr6rXVNVtST4BXJ9kLs3FvkfQXJR8TpITaS9OXYZ6Fmv9tddk+qn7r4hVSZIkDQgD4q4yWnWSDKmqWUmeC/w/motF+zNHvVNGjRpV06dP73UZqz0vPhoY7IeBwX4YGOyHgcF+WFCSbtxVRqvc5e2FpusAHxuMoV2SJGkwMrgPAEm+THOrw75Oq6pzl3N9O9LMGe/rqarararGLs86JUmS1FsG9wGgqvo7p7+/65sGLOl+7pIkSeqYNXpdgCRJkqSlM7hLkiRJHWBwlyRJkjrA4C5JkiR1gMFdkiRJ6gCDuyRJktQBBndJkiSpAwzukiRJUgcY3CVJkqQOMLhLkiRJHWBwlyRJkjrA4C5JkiR1gMFdkiRJ6gCDuyRJktQBBndJkiSpAwzukiRJUgcY3CVJkqQOMLhLkiRJHWBwlyRJkjrA4C5JkiR1gMFdkiRJ6gCDuyRJktQBBndJkiSpAwzukiRJUgcY3CVJkqQOMLhLkiRJHWBwlyRJkjrA4C5JkiR1gMFdkiRJ6gCDuyRJktQBBndJkiSpAwzukiRJUgcY3CVJkqQOMLhLkiRJHWBwlyRJkjrA4C5JkiR1gMFdkiRJ6gCDuyRJktQBBkF4MlwAABeESURBVHdJkiSpA9bqdQHSyvDEnLmMOOn7Pdv+Pafu37NtS5KkwckRd2kl+vOf/8whhxzCdtttx+jRo7nxxhv5yEc+wvDhwxkzZgxjxozhiiuu6HWZkiSpAxxxl1ai4447jv3224+JEycye/ZsHn/8ca666iqOP/54TjjhhF6XJ0mSOsQR9yVI8vwkE9vHY5Nc3j4+IskDSW5JckeSq5K8fBXUc0WSjZeyzHlJ7k4yNcnNSXZv209JsvcKruecJDOS/GpFrneweOSRR7jhhhs46qijAFhnnXXYeOMldp8kSdJiGdyXoKr+UFWHLObl71TVTlU1EjgVuCTJ6JVcz2uq6s/9WPTEqhoDnASc1b73Q1X13yu4pPOA/VbwOgeNu+66i2HDhnHkkUey0047cfTRR/PYY48BcMYZZ/DiF7+Y8ePHM3PmzB5XKkmSuiBV1esaVpgkbwKOBdYBfg4cAzwMfBnYG5gJfAD4NLAV8J6qmpxkBHABsGG7qndV1U/b9suraockY4ETquqAJEcAu1bVu/ps+xRgo6o6PskY4ExgA+BOYHxVzUwyBbgF2AUYBrwFeD+wI82JwMntui4DtgTWA06rqrPb9nuAXYEhwA+AHwMvB34PvK6qnkhyXlvzxCTrAQ9V1QYLte8CfL5dz5+AI6rqviTbtnUPA+YCb6iqO5OcCPwzsC5waVV9uM9+zz9GS+mbZ6wbuKvti38ECvh4VX2nPdYfBe4HxgCXANOA44D1gQOr6s5FbONtwNsANtts2C4f+uLXllTSSrXj8KFMnz6dY445htNPP53tt9+e008/nQ033JADDzyQoUOHkoRzzjmHBx98kPe97309q3VlmjVrFkOGDOl1Gas9+2FgsB8GBvthYLAfFjRu3LhfVtWuS1tu0Mxxb0e7DwVeUVVzknwFOIwmjE+pqvcluRT4OLAPsD0wAZgMzAD2qaonk4wELqIJyMviZuDt7ePzgXdX1fVtoP8w8J72tdlVtWeS44BJNCH+IeDOJF+oqgdpgv5DSdYHbkpycdve10jgjVX11iTfBV4PfHOhZf6JJvD2PU5rA6fTBP0HkhwKfAIYD1wInFpVl7ahf40k+7bbeikQYHKSPavqhmU8Ps9YN3AwTTB/CbBZu6/z1vsSYHR7bO4Cvl5VL22P27v7HM/52hOcswG22mbb+ty03n287zlsLNtttx2f+tSnOOaYYwBYc801OfXUUzn44IPnL7fNNttwwAEHMHbs2B5VunJNmTJl0O5bl9gPA4P9MDDYDwOD/bB8Bk1wB15NE4JvSgLNyOwMYDZwZbvMNOCpNthPA0a07WsDZ7Qj5XOBFy7H9gOQZCiwcVVd37ZPAL7XZ7nJfWq5rarua993F80o+4PAsUkOapfbkiY4Lxzc766qqe3jX/bZF4DPJDkZeAA4aqH3jQJ2AK5pj9OawH1JNgKGV9WlAFX1ZFvXvsC+NL8UQDNKPxLod3Bfwrr3AC6qqrnA/UmuB/4eeAS4qc+xuRO4ul3dNGBcf7fdS8973vPYcsstmT59OqNGjeLaa69l++2357777mOLLbYA4NJLL2WHHZb4Y4UkSRIwuIJ7gAlV9f4FGpMT6q/zgZ4GngKoqqeTzNv/42mmZbyEZiT4yeXY/k7A7f1Y7qmFa+nzfK12msjewO5V9Xg7vWa9JawHmpON9fs8P7GqJi5m+6E5Ydh9gcbkOUtY/lNVddZiXu+PLGM7PPPY9D1unfncnn766Rx22GHMnj2bbbbZhnPPPZdjjz2WqVOnkoQRI0Zw1lnP5tBKkqTVRWcCUD9cC0xqp5vMSLIpsFE/3zsUuLcN84fTjEL3W5K9aOZWj6uqh5PMTPLKqvoR8Gbg+iWv4Rm1zGxD+3bAy5alln6YDgxLsntV3dhOnXlhVd2W5N4kB1bVZUnWpTkOVwEfS3JhVc1KMhyYU1Uz+rvBqnpkMeu+AXh7kgnApsCewInAdit4n3tmzJgx/OIXv1ig7YILLuhRNZIkqcsGzV1lqurXwMnA1UluBa4Btujn278CHJ7kZzTTZB7rx3sObW+5+FuaC15fX1XzRtwPp5mucivNHO5TlmFXrqQZeb8V+Bjws2V471JV1WzgEOA/k/wPMJXmAldoTjKObbf9U+B5VXU18C3gxnZ60UTaE6IkFwE3AqPaYL7wtJy+nrFu4FLgVuB/gB8C762qP67I/ZUkSRosBtVdZaR5Ro0aVdOnT+91Gas9Lz4aGOyHgcF+GBjsh4HBflhQkn7dVWbQjLhLkiRJg9lgmuOuASDJl4FXLNR8WlWd24t6JEmSBguDu1aoqnpnr2uQJEkajJwqI0mSJHWAwV2SJEnqAIO7JEmS1AEGd0mSJKkDDO6SJElSBxjcJUmSpA4wuEuSJEkdYHCXJEmSOsDgLkmSJHWAwV2SJEnqAIO7JEmS1AEGd0mSJKkDDO6SJElSBxjcJUmSpA4wuEuSJEkdYHCXJEmSOsDgLkmSJHWAwV2SJEnqAIO7JEmS1AEGd0mSJKkDDO6SJElSBxjcJUmSpA4wuEuSJEkdYHCXJEmSOsDgLkmSJHWAwV2SJEnqAIO7JEmS1AEGd0mSJKkDDO6SJElSBxjcJUmSpA4wuEuSJEkdYHCXJEmSOsDgLkmSJHWAwV2SJEnqAIO7JEmS1AEGd0mSJKkDDO6SJElSBxjcJUmSpA4wuEuSJEkdsFavC5BWhifmzGXESd9fpvfcc+r+K6kaSZKkZ88Rd6mP3/3ud4wbN47Ro0fzohe9iNNOO23+a6effjqjRo3iRS96Ee9973t7WKUkSVodOeIu9bHWWmvxuc99jp133plHH32UXXbZhX322Yf777+fSZMmceutt7LuuusyY8aMXpcqSZJWM4N2xD3J85NMbB+PTXJ5+/iIJA8kuSXJHUmuSvLyVVDPFUk2Xsoy5yW5O8nUJDcn2b1tPyXJ3iuwli2TXJfk9iS3JTluBa33p8vxnhW6b8/WFltswc477wzARhttxOjRo/n973/PV7/6VU466STWXXddADbffPNelilJklZDgza4V9UfquqQxbz8naraqapGAqcClyQZvZLreU1V/bkfi55YVWOAk4Cz2vd+qKr+ewWW8xfgP6pqNPAy4J1Jtn+2K62qZT4BWgn7tsLcc8893HLLLey222789re/5Uc/+hG77bYbe+21FzfddFOvy5MkSauZATNVJsmbgGOBdYCfA8cADwNfBvYGZgIfAD4NbAW8p6omJxkBXABs2K7qXVX107b98qraYUnbrarrkpwNvA04PskY4ExgA+BOYHxVzUwyBbgF2AUYBrwFeD+wI82JwMntflwGbAmsB5xWVWe37fcAuwJDgB8APwZeDvweeF1VPbFQaTcA27bvPa/dl4lJdgE+367nT8ARVXVfkm3buocBc4E3VNWdSU4E/hlYF7i0qj5cVfcB97X7/2iS24HhwK8XdYyWYd9nVdWQJFsA3wGeQ/MZ+zfgp8A32mNQwDlV9YWF9u0eYALwT8Da7T78Jskw4FvAc4GbgP2AXarqTwvV+ba2H9lss2F8aMe/LGp3FmvKlCnzHz/xxBMcd9xxHH300dx88808/PDDTJs2jVNPPZXf/OY3vPa1r+Vb3/oWSZZpG6ubWbNmLXBc1Rv2w8BgPwwM9sPAYD8snwER3NvR7kOBV1TVnCRfAQ6jCeNTqup9SS4FPg7sA2xPE/AmAzOAfarqySQjgYtowuGyuBl4e/v4fODdVXV9klOADwPvaV+bXVV7tlNLJtEE2YeAO5N8oaoepAn6DyVZH7gpycVte18jgTdW1VuTfBd4PfDNhZb5J2DaQsdpbeB0mqD/QJJDgU8A44ELgVOr6tIk6wFrJNm33dZLgQCTk+xZVTf0WecIYCeak6Ul6c++z/OvwFVV9Ykka9KcBI0Bhs87kVrCtKE/VdXOSY4BTgCOpumDH1bVp5LsRxvOF9aeJJ0NsNU229bnpi3bx/uew8YCMGfOHA444ADe8Y538O///u8AjBo1imOPPZaxY8cybtw4PvvZz7LDDjswbNiwZdrG6mbKlCmMHTu212Ws9uyHgcF+GBjsh4HBflg+AyK4A6+mCYI3tSOY69ME8tnAle0y04Cn2mA/DRjRtq8NnNGOlM8FXrgc2w9AkqHAxlV1fds+Afhen+Um96nltnbkmiR30YyyPwgcm+SgdrktaYLzwsH97qqa2j7+ZZ99AfhMkpOBB4CjFnrfKGAH4Jr2OK0J3JdkI5pQfClAVT3Z1rUvsC/NaDk0o/QjaUbzSTIEuJjm14tHlnB8+rvv89wEnNOeaFxWVVPb5bZJcjrwfeDqxWznkj7H5eD28R7AQe2+XZlk5lJqXW5VxVFHHcXo0aPnh3aAAw88kB/+8IeMHTuW3/72t8yePZvNNttsZZUhSZL0DAMluAeYUFXvX6AxOaGqqn36NPAUQFU9nWRe7ccD9wMvoZmz/+RybH8n4PZ+LPfUwrX0eb5WkrE003p2r6rH2ykm6y1hPdCcbKzf5/mJVTVxMdsPTWjefYHG5DlLWP5TVXXWM15oQvXFwIVVdckz3rn4mhe5730XrKobkuwJ7A9ckOQzVXV+kpcA/wC8k2b6zvglbGdun/WusvkoP/nJT7jgggvYcccdGTNmDACf/OQnGT9+POPHj2eHHXZgnXXWYcKECU6TkSRJq9RACe7XApPaKRczkmwKbNTP9w4F7m3D/OE0o9D9lmQvmqkX46rq4SQzk7yyqn4EvBm4fslreEYtM9vQvh3NhZ8r0nRgWJLdq+rGNny/sKpuS3JvkgOr6rIk69Ich6uAjyW5sKpmJRkOzKEZzf8GcHtVfX4F10iSrYHfV9XXkmwI7JzkCprpNhcnuRM4bxlW+WOaoP+f7a8Im6zomufZY489+Ou54oK++c2FZzNJkiStOgMiuFfVr9vpIVcnWYMmXL6zn2//CnBxkjcA1wGP9eM9hybZg2bu9d3A66tq3oj74cCZSTYA7gKOXIZduRJ4R5JbaUL2z5bhvUtVVbOTHAJ8qZ3WsxbwReA2mpOMs9p5+XNoLuy8ur1+4MZ2dHgW8Caa6URvBqYlmTdl5wNVdcUKKnUscGKSOe0230Jz8eu5bf9Cc3Frf30UuKid0389zYW1j66gWiVJkjohixtdlAaK9heEuVX1l/be9l9tb5m5WKNGjarp06evmgK1WF58NDDYDwOD/TAw2A8Dg/2woCS/rKql3lxlQIy4S0uxFfDddrR+NvDWHtcjSZK0yhncNV+SLwOvWKj5tKo6txf1zFNVd9BcQCxJkrTaMrhrvqrq73UFkiRJWsXWWPoikiRJknrN4C5JkiR1gMFdkiRJ6gCDuyRJktQBBndJkiSpAwzukiRJUgcY3CVJkqQOMLhLkiRJHWBwlyRJkjrA4C5JkiR1gMFdkiRJ6gCDuyRJktQBBndJkiSpAwzukiRJUgcY3CVJkqQOMLhLkiRJHWBwlyRJkjrA4C5JkiR1gMFdkiRJ6gCDuyRJktQBBndJkiSpAwzukiRJUgcY3CVJkqQOMLhLkiRJHWBwlyRJkjrA4C5JkiR1gMFdkiRJ6gCDuyRJktQBBndJkiSpAwzukiRJUgcY3CVJkqQOMLhLkiRJHWBwlyRJkjrA4C5JkiR1gMFdkiRJ6gCDuyRJktQBBndJkiSpAwzukiRJUgcY3CVJkqQOMLhLkiRJHWBwlyRJkjrA4C5JkiR1gMFdkiRJ6gCDuyRJktQBBndJkiSpA1JVva5BWuGSPApM73UdYjPgT70uQvbDAGE/DAz2w8BgPyxo66oatrSF1loVlUg9ML2qdu11Eau7JL+wH3rPfhgY7IeBwX4YGOyH5eNUGUmSJKkDDO6SJElSBxjcNVid3esCBNgPA4X9MDDYDwOD/TAw2A/LwYtTJUmSpA5wxF2SJEnqAIO7JEmS1AEGdw06SfZLMj3J/yY5qdf1DGZJtkxyXZLbk9yW5Li2fdMk1yS5o/1zk7Y9Sb7U9s2tSXbu7R4MHknWTHJLksvb5y9I8vO2D76TZJ22fd32+f+2r4/oZd2DTZKNk0xM8pv2e7G734dVL8nx7f+TfpXkoiTr+Z1Y+ZKck2RGkl/1aVvmz3+Sw9vl70hyeC/2ZaAyuGtQSbIm8GXgH4HtgTcm2b63VQ1qfwH+o6pGAy8D3tke75OAa6tqJHBt+xyafhnZ/vc24KurvuRB6zjg9j7P/xP4QtsHM4Gj2vajgJlVtS3whXY5rTinAVdW1XbAS2j6xO/DKpRkOHAssGtV7QCsCfwLfidWhfOA/RZqW6bPf5JNgQ8DuwEvBT48L+zL4K7B56XA/1bVXVU1G/g28Loe1zRoVdV9VXVz+/hRmpAynOaYT2gXmwAc2D5+HXB+NX4GbJxki1Vc9qCT5G+B/YGvt88DvAqY2C6ycB/M65uJwKvb5fUsJXkOsCfwDYCqml1Vf8bvQy+sBayfZC1gA+A+/E6sdFV1A/DQQs3L+vn/B+CaqnqoqmYC1/DMk4HVlsFdg81w4Hd9nt/btmkla39e3gn4OfA3VXUfNOEe2LxdzP5ZOb4IvBd4un3+XODPVfWX9nnf4zy/D9rXH26X17O3DfAAcG47benrSTbE78MqVVW/Bz4L/B9NYH8Y+CV+J3plWT//fi+WwOCuwWZRoyTe83QlSzIEuBh4T1U9sqRFF9Fm/zwLSQ4AZlTVL/s2L2LR6sdrenbWAnYGvlpVOwGP8ddpAYtiX6wE7bSK1wEvAJ4PbEgzLWNhfid6a3HH3f5YAoO7Bpt7gS37PP9b4A89qmW1kGRtmtB+YVVd0jbfP+8n//bPGW27/bPivQJ4bZJ7aKaGvYpmBH7jdpoALHic5/dB+/pQnvnTtpbPvcC9VfXz9vlEmiDv92HV2hu4u6oeqKo5wCXAy/E70SvL+vn3e7EEBncNNjcBI9u7B6xDc0HS5B7XNGi180C/AdxeVZ/v89JkYN6dAA4HJvVpf0t7N4GXAQ/P+wlVy6eq3l9Vf1tVI2g+7z+sqsOA64BD2sUW7oN5fXNIu7yjWStAVf0R+F2SUW3Tq4Ff4/dhVfs/4GVJNmj/HzWvH/xO9Mayfv6vAvZNskn768m+bZvwX07VIJTkNTQjjmsC51TVJ3pc0qCVZA/gR8A0/jq/+gM089y/C2xF85foG6rqofYv0TNoLjR6HDiyqn6xygsfpJKMBU6oqgOSbEMzAr8pcAvwpqp6Ksl6wAU01yM8BPxLVd3Vq5oHmyRjaC4SXge4CziSZpDM78MqlOSjwKE0d766BTiaZp6034mVKMlFwFhgM+B+mrvDXMYyfv6TjKf5uwTgE1V17qrcj4HM4C5JkiR1gFNlJEmSpA4wuEuSJEkdYHCXJEmSOsDgLkmSJHWAwV2SJEnqgLWWvogkSd2XZC7NrUvnObCq7ulROZK0zLwdpCRptZBkVlUNWYXbW6uq/rKqtidp8HOqjCRJNP8ce5IbkkxN8qskr2zb90tyc5L/SXJt27ZpksuS3JrkZ0le3LZ/JMnZSa4Gzk+yZpLPJLmpXfbtPdxFSR3nVBlJ0upi/SRT28d3V9VBC73+r8BVVfWJJGsCGyQZBnwN2LOq7k6yabvsR4FbqurAJK8CzgfGtK/tAuxRVU8keRvNP+X+90nWBX6S5Oqquntl7qikwcngLklaXTxRVWOW8PpNwDlJ1gYuq6qpScYCN8wL2lX1ULvsHsDr27YfJnlukqHta5Or6on28b7Ai5Mc0j4fCowEDO6SlpnBXZIkoKpuSLInsD9wQZLPAH8GFnUxWBa1ivbPxxZa7t1VddUKLVbSask57pIkAUm2BmZU1deAbwA7AzcCeyV5QbvMvKkyNwCHtW1jgT9V1SOLWO1VwL+1o/gkeWGSDVfqjkgatBxxlySpMRY4MckcYBbwlqp6oJ2nfkmSNYAZwD7AR4Bzk9wKPA4cvph1fh0YAdycJMADwIErcyckDV7eDlKSJEnqAKfKSJIkSR1gcJckSZI6wOAuSZIkdYDBXZIkSeoAg7skSZLUAQZ3SZIkqQMM7pIkSVIH/H/Ha5qhiQcI6QAAAABJRU5ErkJggg==\n",
"text/plain": [
"<Figure size 720x720 with 1 Axes>"
]
},
"metadata": {
"needs_background": "light"
},
"output_type": "display_data"
}
],
"source": [
"xgb.plot_importance(xgb_classif)\n",
"plt.rcParams['figure.figsize'] = [10, 10]\n",
"plt.show()"
]
}
],
"metadata": {
"kernelspec": {
"display_name": "Python 3",
"language": "python",
"name": "python3"
},
"language_info": {
"codemirror_mode": {
"name": "ipython",
"version": 3
},
"file_extension": ".py",
"mimetype": "text/x-python",
"name": "python",
"nbconvert_exporter": "python",
"pygments_lexer": "ipython3",
"version": "3.7.3"
}
},
"nbformat": 4,
"nbformat_minor": 2
}
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment