Skip to content

Instantly share code, notes, and snippets.

@NelsonMinar
Created November 28, 2017 00:21
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save NelsonMinar/2d5598ff882c3f0b9c6fce7ec6d2d4ac to your computer and use it in GitHub Desktop.
Save NelsonMinar/2d5598ff882c3f0b9c6fce7ec6d2d4ac to your computer and use it in GitHub Desktop.
Demo of using IPython with BeautifulSoup
Display the source blob
Display the rendered blob
Raw
{
"cells": [
{
"cell_type": "markdown",
"metadata": {},
"source": [
"## Demo of HTML screen scraping with Jupyter Notebooks\n",
"\n",
"A combination of [Beautiful Soup](https://www.crummy.com/software/BeautifulSoup/), [Jupyter Notebooks](http://jupyter.org/), and the [IPython BeautifulSoup plugin](https://github.com/Psycojoker/ipython-beautifulsoup).\n",
"\n",
"For best results see [this fork of ipython-beautifulsoup](https://github.com/MattDMo/ipython-beautifulsoup) and this [bug fix](https://github.com/Psycojoker/ipython-beautifulsoup/issues/6) for warnings about the default HTML parser."
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"### Load and configure the IPython addon.\n",
"Note: no need to explicitly import BeautifulSoup, etc if you're just using the `p()` shortcut."
]
},
{
"cell_type": "code",
"execution_count": 1,
"metadata": {},
"outputs": [
{
"name": "stdout",
"output_type": "stream",
"text": [
"Monkey patch BeautifulSoup with custom rendering\n",
"See `configure_ipython_beautifulsoup?` for configuration information\n",
"Push 'BeautifulSoup' from 'bs4' into current context\n",
"Push 'urlopen' from 'urllib.request' into current context\n",
"Push 'p' shortcut into current context\n",
"Push 'requests' into current context\n"
]
}
],
"source": [
"%load_ext soup"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"### Configure the IPython addon\n",
"\n",
"We tell it to show HTML and CSS but not Javascript. Beware that hostile HTML might still be able to do ugly things to your Jupyter window."
]
},
{
"cell_type": "code",
"execution_count": 2,
"metadata": {},
"outputs": [],
"source": [
"configure_ipython_beautifulsoup(show_html=True, show_css=True, show_js=False)"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"### Cook up some beautiful soup"
]
},
{
"cell_type": "code",
"execution_count": 3,
"metadata": {},
"outputs": [],
"source": [
"soup=p(\"http://www.somebits.com/weblog/\")"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"### Demo some query functions\n",
"\n",
"This scraper looks for all the URLs I link in my blog posts. It shows IPython displaying a couple of types of data. A single BeautifulSoup node, which is shown first rendered in HTML and then as the HTML code itself. Then a BeautifulSoupList which is rendered as a three column table."
]
},
{
"cell_type": "code",
"execution_count": 4,
"metadata": {},
"outputs": [
{
"data": {
"text/html": [
"<html><body><div class=\"btitle\"><a class=\"invisiblelink\" href=\"http://www.somebits.com/weblog/tech/good/simplenote.html\">Simplenote</a></div></body></html><hr/><div class=\"highlight\" style=\"background: #f8f8f8\"><pre style=\"line-height: 125%\"><span></span>&lt;<span style=\"color: #008000; font-weight: bold\">div</span> <span style=\"color: #7D9029\">class</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;btitle&quot;</span>&gt;\n",
" &lt;<span style=\"color: #008000; font-weight: bold\">a</span> <span style=\"color: #7D9029\">class</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;invisiblelink&quot;</span> <span style=\"color: #7D9029\">href</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;http://www.somebits.com/weblog/tech/good/simplenote.html&quot;</span>&gt;\n",
" Simplenote\n",
" &lt;/<span style=\"color: #008000; font-weight: bold\">a</span>&gt;\n",
"&lt;/<span style=\"color: #008000; font-weight: bold\">div</span>&gt;\n",
"</pre></div>\n",
"<hr/>"
],
"text/plain": [
"<div class=\"btitle\"><a class=\"invisiblelink\" href=\"http://www.somebits.com/weblog/tech/good/simplenote.html\">Simplenote</a></div>"
]
},
"metadata": {},
"output_type": "display_data"
},
{
"data": {
"text/html": [
"<table><tr><th>Index</th><th>Render</th><th>source</th></tr><tr><td>0</td><td><html><body><a href=\"https://simplenote.com/\">Simplenote</a></body></html></td><td><div class=\"highlight\" style=\"background: #f8f8f8\"><pre style=\"line-height: 125%\"><span></span>&lt;<span style=\"color: #008000; font-weight: bold\">a</span> <span style=\"color: #7D9029\">href</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;https://simplenote.com/&quot;</span>&gt;\n",
" Simplenote\n",
"&lt;/<span style=\"color: #008000; font-weight: bold\">a</span>&gt;\n",
"</pre></div>\n",
"</td></tr><tr><td>1</td><td><html><body><a href=\"https://automattic.com/\">Automattic</a></body></html></td><td><div class=\"highlight\" style=\"background: #f8f8f8\"><pre style=\"line-height: 125%\"><span></span>&lt;<span style=\"color: #008000; font-weight: bold\">a</span> <span style=\"color: #7D9029\">href</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;https://automattic.com/&quot;</span>&gt;\n",
" Automattic\n",
"&lt;/<span style=\"color: #008000; font-weight: bold\">a</span>&gt;\n",
"</pre></div>\n",
"</td></tr><tr><td>2</td><td><html><body><a href=\"https://cloudup.com/\">Cloudup</a></body></html></td><td><div class=\"highlight\" style=\"background: #f8f8f8\"><pre style=\"line-height: 125%\"><span></span>&lt;<span style=\"color: #008000; font-weight: bold\">a</span> <span style=\"color: #7D9029\">href</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;https://cloudup.com/&quot;</span>&gt;\n",
" Cloudup\n",
"&lt;/<span style=\"color: #008000; font-weight: bold\">a</span>&gt;\n",
"</pre></div>\n",
"</td></tr></table>"
],
"text/plain": [
"[<a href=\"https://simplenote.com/\">Simplenote</a>, <a href=\"https://automattic.com/\">Automattic</a>, <a href=\"https://cloudup.com/\">Cloudup</a>]"
]
},
"metadata": {},
"output_type": "display_data"
},
{
"data": {
"text/html": [
"<html><body><div class=\"btitle\"><a class=\"invisiblelink\" href=\"http://www.somebits.com/weblog/culture/twitter-endorses-nazis.html\">Twitter endorses Nazis</a></div></body></html><hr/><div class=\"highlight\" style=\"background: #f8f8f8\"><pre style=\"line-height: 125%\"><span></span>&lt;<span style=\"color: #008000; font-weight: bold\">div</span> <span style=\"color: #7D9029\">class</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;btitle&quot;</span>&gt;\n",
" &lt;<span style=\"color: #008000; font-weight: bold\">a</span> <span style=\"color: #7D9029\">class</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;invisiblelink&quot;</span> <span style=\"color: #7D9029\">href</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;http://www.somebits.com/weblog/culture/twitter-endorses-nazis.html&quot;</span>&gt;\n",
" Twitter endorses Nazis\n",
" &lt;/<span style=\"color: #008000; font-weight: bold\">a</span>&gt;\n",
"&lt;/<span style=\"color: #008000; font-weight: bold\">div</span>&gt;\n",
"</pre></div>\n",
"<hr/>"
],
"text/plain": [
"<div class=\"btitle\"><a class=\"invisiblelink\" href=\"http://www.somebits.com/weblog/culture/twitter-endorses-nazis.html\">Twitter endorses Nazis</a></div>"
]
},
"metadata": {},
"output_type": "display_data"
},
{
"data": {
"text/html": [
"<table><tr><th>Index</th><th>Render</th><th>source</th></tr><tr><td>0</td><td><html><body><a href=\"https://blog.twitter.com/official/en_us/topics/company/2017/safetycalendar.html\">a\n",
"short timeline</a></body></html></td><td><div class=\"highlight\" style=\"background: #f8f8f8\"><pre style=\"line-height: 125%\"><span></span>&lt;<span style=\"color: #008000; font-weight: bold\">a</span> <span style=\"color: #7D9029\">href</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;https://blog.twitter.com/official/en_us/topics/company/2017/safetycalendar.html&quot;</span>&gt;\n",
" a\n",
"short timeline\n",
"&lt;/<span style=\"color: #008000; font-weight: bold\">a</span>&gt;\n",
"</pre></div>\n",
"</td></tr><tr><td>1</td><td><html><body><a href=\"https://www.thedailybeast.com/twitter-verifies-charlottesville-rally-boss-jason-kessler-who-called-slain-protesters-death-payback-time\">verified</a></body></html></td><td><div class=\"highlight\" style=\"background: #f8f8f8\"><pre style=\"line-height: 125%\"><span></span>&lt;<span style=\"color: #008000; font-weight: bold\">a</span> <span style=\"color: #7D9029\">href</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;https://www.thedailybeast.com/twitter-verifies-charlottesville-rally-boss-jason-kessler-who-called-slain-protesters-death-payback-time&quot;</span>&gt;\n",
" verified\n",
"&lt;/<span style=\"color: #008000; font-weight: bold\">a</span>&gt;\n",
"</pre></div>\n",
"</td></tr><tr><td>2</td><td><html><body><a href=\"https://en.wikipedia.org/wiki/Jason_Kessler\">Jason\n",
"Kessler</a></body></html></td><td><div class=\"highlight\" style=\"background: #f8f8f8\"><pre style=\"line-height: 125%\"><span></span>&lt;<span style=\"color: #008000; font-weight: bold\">a</span> <span style=\"color: #7D9029\">href</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;https://en.wikipedia.org/wiki/Jason_Kessler&quot;</span>&gt;\n",
" Jason\n",
"Kessler\n",
"&lt;/<span style=\"color: #008000; font-weight: bold\">a</span>&gt;\n",
"</pre></div>\n",
"</td></tr><tr><td>3</td><td><html><body><a href=\"https://www.nytimes.com/2017/08/13/us/heather-heyer-charlottesville-victim.html\">being\n",
"murdered</a></body></html></td><td><div class=\"highlight\" style=\"background: #f8f8f8\"><pre style=\"line-height: 125%\"><span></span>&lt;<span style=\"color: #008000; font-weight: bold\">a</span> <span style=\"color: #7D9029\">href</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;https://www.nytimes.com/2017/08/13/us/heather-heyer-charlottesville-victim.html&quot;</span>&gt;\n",
" being\n",
"murdered\n",
"&lt;/<span style=\"color: #008000; font-weight: bold\">a</span>&gt;\n",
"</pre></div>\n",
"</td></tr><tr><td>4</td><td><html><body><a href=\"http://www.latimes.com/nation/la-na-charlottesville-organizer-20170818-story.html\">gloated</a></body></html></td><td><div class=\"highlight\" style=\"background: #f8f8f8\"><pre style=\"line-height: 125%\"><span></span>&lt;<span style=\"color: #008000; font-weight: bold\">a</span> <span style=\"color: #7D9029\">href</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;http://www.latimes.com/nation/la-na-charlottesville-organizer-20170818-story.html&quot;</span>&gt;\n",
" gloated\n",
"&lt;/<span style=\"color: #008000; font-weight: bold\">a</span>&gt;\n",
"</pre></div>\n",
"</td></tr><tr><td>5</td><td><html><body><a href=\"https://twitter.com/TwitterSupport/status/928654369771356162\">now\n",
"acknowledge the endorsement</a></body></html></td><td><div class=\"highlight\" style=\"background: #f8f8f8\"><pre style=\"line-height: 125%\"><span></span>&lt;<span style=\"color: #008000; font-weight: bold\">a</span> <span style=\"color: #7D9029\">href</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;https://twitter.com/TwitterSupport/status/928654369771356162&quot;</span>&gt;\n",
" now\n",
"acknowledge the endorsement\n",
"&lt;/<span style=\"color: #008000; font-weight: bold\">a</span>&gt;\n",
"</pre></div>\n",
"</td></tr><tr><td>6</td><td><html><body><a href=\"https://twitter.com/TwitterSupport/status/930926071779692544\">updated its policies</a></body></html></td><td><div class=\"highlight\" style=\"background: #f8f8f8\"><pre style=\"line-height: 125%\"><span></span>&lt;<span style=\"color: #008000; font-weight: bold\">a</span> <span style=\"color: #7D9029\">href</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;https://twitter.com/TwitterSupport/status/930926071779692544&quot;</span>&gt;\n",
" updated its policies\n",
"&lt;/<span style=\"color: #008000; font-weight: bold\">a</span>&gt;\n",
"</pre></div>\n",
"</td></tr></table>"
],
"text/plain": [
"[<a href=\"https://blog.twitter.com/official/en_us/topics/company/2017/safetycalendar.html\">a\n",
"short timeline</a>, <a href=\"https://www.thedailybeast.com/twitter-verifies-charlottesville-rally-boss-jason-kessler-who-called-slain-protesters-death-payback-time\">verified</a>, <a href=\"https://en.wikipedia.org/wiki/Jason_Kessler\">Jason\n",
"Kessler</a>, <a href=\"https://www.nytimes.com/2017/08/13/us/heather-heyer-charlottesville-victim.html\">being\n",
"murdered</a>, <a href=\"http://www.latimes.com/nation/la-na-charlottesville-organizer-20170818-story.html\">gloated</a>, <a href=\"https://twitter.com/TwitterSupport/status/928654369771356162\">now\n",
"acknowledge the endorsement</a>, <a href=\"https://twitter.com/TwitterSupport/status/930926071779692544\">updated its policies</a>]"
]
},
"metadata": {},
"output_type": "display_data"
},
{
"data": {
"text/html": [
"<html><body><div class=\"btitle\"><a class=\"invisiblelink\" href=\"http://www.somebits.com/weblog/culture/mastodon.html\">Mastodon </a></div></body></html><hr/><div class=\"highlight\" style=\"background: #f8f8f8\"><pre style=\"line-height: 125%\"><span></span>&lt;<span style=\"color: #008000; font-weight: bold\">div</span> <span style=\"color: #7D9029\">class</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;btitle&quot;</span>&gt;\n",
" &lt;<span style=\"color: #008000; font-weight: bold\">a</span> <span style=\"color: #7D9029\">class</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;invisiblelink&quot;</span> <span style=\"color: #7D9029\">href</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;http://www.somebits.com/weblog/culture/mastodon.html&quot;</span>&gt;\n",
" Mastodon\n",
" &lt;/<span style=\"color: #008000; font-weight: bold\">a</span>&gt;\n",
"&lt;/<span style=\"color: #008000; font-weight: bold\">div</span>&gt;\n",
"</pre></div>\n",
"<hr/>"
],
"text/plain": [
"<div class=\"btitle\"><a class=\"invisiblelink\" href=\"http://www.somebits.com/weblog/culture/mastodon.html\">Mastodon </a></div>"
]
},
"metadata": {},
"output_type": "display_data"
},
{
"data": {
"text/html": [
"<table><tr><th>Index</th><th>Render</th><th>source</th></tr><tr><td>0</td><td><html><body><a href=\"https://lgbt.io/@nelson\">@nelson@lgbt.io</a></body></html></td><td><div class=\"highlight\" style=\"background: #f8f8f8\"><pre style=\"line-height: 125%\"><span></span>&lt;<span style=\"color: #008000; font-weight: bold\">a</span> <span style=\"color: #7D9029\">href</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;https://lgbt.io/@nelson&quot;</span>&gt;\n",
" @nelson@lgbt.io\n",
"&lt;/<span style=\"color: #008000; font-weight: bold\">a</span>&gt;\n",
"</pre></div>\n",
"</td></tr><tr><td>1</td><td><html><body><a href=\"https://www.theverge.com/2017/5/22/15535374/mastodon-spotlight-aftermath\">started\n",
"using back in April</a></body></html></td><td><div class=\"highlight\" style=\"background: #f8f8f8\"><pre style=\"line-height: 125%\"><span></span>&lt;<span style=\"color: #008000; font-weight: bold\">a</span> <span style=\"color: #7D9029\">href</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;https://www.theverge.com/2017/5/22/15535374/mastodon-spotlight-aftermath&quot;</span>&gt;\n",
" started\n",
"using back in April\n",
"&lt;/<span style=\"color: #008000; font-weight: bold\">a</span>&gt;\n",
"</pre></div>\n",
"</td></tr><tr><td>2</td><td><html><body><a href=\"https://www.theverge.com/2017/4/7/15183128/mastodon-open-source-twitter-clone-how-to-use\">this\n",
"beginner’s guide</a></body></html></td><td><div class=\"highlight\" style=\"background: #f8f8f8\"><pre style=\"line-height: 125%\"><span></span>&lt;<span style=\"color: #008000; font-weight: bold\">a</span> <span style=\"color: #7D9029\">href</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;https://www.theverge.com/2017/4/7/15183128/mastodon-open-source-twitter-clone-how-to-use&quot;</span>&gt;\n",
" this\n",
"beginner’s guide\n",
"&lt;/<span style=\"color: #008000; font-weight: bold\">a</span>&gt;\n",
"</pre></div>\n",
"</td></tr><tr><td>3</td><td><html><body><a href=\"https://joinmastodon.org/\">Join Mastodon site</a></body></html></td><td><div class=\"highlight\" style=\"background: #f8f8f8\"><pre style=\"line-height: 125%\"><span></span>&lt;<span style=\"color: #008000; font-weight: bold\">a</span> <span style=\"color: #7D9029\">href</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;https://joinmastodon.org/&quot;</span>&gt;\n",
" Join Mastodon site\n",
"&lt;/<span style=\"color: #008000; font-weight: bold\">a</span>&gt;\n",
"</pre></div>\n",
"</td></tr><tr><td>4</td><td><html><body><a href=\"https://instances.social/\">This tool</a></body></html></td><td><div class=\"highlight\" style=\"background: #f8f8f8\"><pre style=\"line-height: 125%\"><span></span>&lt;<span style=\"color: #008000; font-weight: bold\">a</span> <span style=\"color: #7D9029\">href</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;https://instances.social/&quot;</span>&gt;\n",
" This tool\n",
"&lt;/<span style=\"color: #008000; font-weight: bold\">a</span>&gt;\n",
"</pre></div>\n",
"</td></tr><tr><td>5</td><td><html><body><a href=\"https://mastodon.social/about\">the biggest\n",
"instance</a></body></html></td><td><div class=\"highlight\" style=\"background: #f8f8f8\"><pre style=\"line-height: 125%\"><span></span>&lt;<span style=\"color: #008000; font-weight: bold\">a</span> <span style=\"color: #7D9029\">href</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;https://mastodon.social/about&quot;</span>&gt;\n",
" the biggest\n",
"instance\n",
"&lt;/<span style=\"color: #008000; font-weight: bold\">a</span>&gt;\n",
"</pre></div>\n",
"</td></tr><tr><td>6</td><td><html><body><a href=\"https://lgbt.io/about/\">lgbt.io</a></body></html></td><td><div class=\"highlight\" style=\"background: #f8f8f8\"><pre style=\"line-height: 125%\"><span></span>&lt;<span style=\"color: #008000; font-weight: bold\">a</span> <span style=\"color: #7D9029\">href</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;https://lgbt.io/about/&quot;</span>&gt;\n",
" lgbt.io\n",
"&lt;/<span style=\"color: #008000; font-weight: bold\">a</span>&gt;\n",
"</pre></div>\n",
"</td></tr><tr><td>7</td><td><html><body><a href=\"https://bridge.joinmastodon.org/\">the Twitter/Mastodon bridge</a></body></html></td><td><div class=\"highlight\" style=\"background: #f8f8f8\"><pre style=\"line-height: 125%\"><span></span>&lt;<span style=\"color: #008000; font-weight: bold\">a</span> <span style=\"color: #7D9029\">href</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;https://bridge.joinmastodon.org/&quot;</span>&gt;\n",
" the Twitter/Mastodon bridge\n",
"&lt;/<span style=\"color: #008000; font-weight: bold\">a</span>&gt;\n",
"</pre></div>\n",
"</td></tr><tr><td>8</td><td><html><body><a href=\"http://metatalk.metafilter.com/24564/The-Mighty-Mighty-Mastodon-Thread\">a\n",
"lot of people from Metafilter</a></body></html></td><td><div class=\"highlight\" style=\"background: #f8f8f8\"><pre style=\"line-height: 125%\"><span></span>&lt;<span style=\"color: #008000; font-weight: bold\">a</span> <span style=\"color: #7D9029\">href</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;http://metatalk.metafilter.com/24564/The-Mighty-Mighty-Mastodon-Thread&quot;</span>&gt;\n",
" a\n",
"lot of people from Metafilter\n",
"&lt;/<span style=\"color: #008000; font-weight: bold\">a</span>&gt;\n",
"</pre></div>\n",
"</td></tr><tr><td>9</td><td><html><body><a href=\"https://userstyles.org/styles/141802/mastodon-one-column-twitter-design\">this one column layout</a></body></html></td><td><div class=\"highlight\" style=\"background: #f8f8f8\"><pre style=\"line-height: 125%\"><span></span>&lt;<span style=\"color: #008000; font-weight: bold\">a</span> <span style=\"color: #7D9029\">href</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;https://userstyles.org/styles/141802/mastodon-one-column-twitter-design&quot;</span>&gt;\n",
" this one column layout\n",
"&lt;/<span style=\"color: #008000; font-weight: bold\">a</span>&gt;\n",
"</pre></div>\n",
"</td></tr><tr><td>10</td><td><html><body><a href=\"https://halcyon.social/\">Halcyon</a></body></html></td><td><div class=\"highlight\" style=\"background: #f8f8f8\"><pre style=\"line-height: 125%\"><span></span>&lt;<span style=\"color: #008000; font-weight: bold\">a</span> <span style=\"color: #7D9029\">href</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;https://halcyon.social/&quot;</span>&gt;\n",
" Halcyon\n",
"&lt;/<span style=\"color: #008000; font-weight: bold\">a</span>&gt;\n",
"</pre></div>\n",
"</td></tr><tr><td>11</td><td><html><body><a href=\"https://itunes.apple.com/us/app/amaroq-for-mastodon/id1214116200?mt=8\">Amaroq</a></body></html></td><td><div class=\"highlight\" style=\"background: #f8f8f8\"><pre style=\"line-height: 125%\"><span></span>&lt;<span style=\"color: #008000; font-weight: bold\">a</span> <span style=\"color: #7D9029\">href</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;https://itunes.apple.com/us/app/amaroq-for-mastodon/id1214116200?mt=8&quot;</span>&gt;\n",
" Amaroq\n",
"&lt;/<span style=\"color: #008000; font-weight: bold\">a</span>&gt;\n",
"</pre></div>\n",
"</td></tr><tr><td>12</td><td><html><body><a href=\"http://www.somebits.com/weblog/culture/twitter-endorses-nazis.html\">angry\n",
"with Twitter’s endorsement of Nazis</a></body></html></td><td><div class=\"highlight\" style=\"background: #f8f8f8\"><pre style=\"line-height: 125%\"><span></span>&lt;<span style=\"color: #008000; font-weight: bold\">a</span> <span style=\"color: #7D9029\">href</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;http://www.somebits.com/weblog/culture/twitter-endorses-nazis.html&quot;</span>&gt;\n",
" angry\n",
"with Twitter’s endorsement of Nazis\n",
"&lt;/<span style=\"color: #008000; font-weight: bold\">a</span>&gt;\n",
"</pre></div>\n",
"</td></tr></table>"
],
"text/plain": [
"[<a href=\"https://lgbt.io/@nelson\">@nelson@lgbt.io</a>, <a href=\"https://www.theverge.com/2017/5/22/15535374/mastodon-spotlight-aftermath\">started\n",
"using back in April</a>, <a href=\"https://www.theverge.com/2017/4/7/15183128/mastodon-open-source-twitter-clone-how-to-use\">this\n",
"beginner’s guide</a>, <a href=\"https://joinmastodon.org/\">Join Mastodon site</a>, <a href=\"https://instances.social/\">This tool</a>, <a href=\"https://mastodon.social/about\">the biggest\n",
"instance</a>, <a href=\"https://lgbt.io/about/\">lgbt.io</a>, <a href=\"https://bridge.joinmastodon.org/\">the Twitter/Mastodon bridge</a>, <a href=\"http://metatalk.metafilter.com/24564/The-Mighty-Mighty-Mastodon-Thread\">a\n",
"lot of people from Metafilter</a>, <a href=\"https://userstyles.org/styles/141802/mastodon-one-column-twitter-design\">this one column layout</a>, <a href=\"https://halcyon.social/\">Halcyon</a>, <a href=\"https://itunes.apple.com/us/app/amaroq-for-mastodon/id1214116200?mt=8\">Amaroq</a>, <a href=\"http://www.somebits.com/weblog/culture/twitter-endorses-nazis.html\">angry\n",
"with Twitter’s endorsement of Nazis</a>]"
]
},
"metadata": {},
"output_type": "display_data"
},
{
"data": {
"text/html": [
"<html><body><div class=\"btitle\"><a class=\"invisiblelink\" href=\"http://www.somebits.com/weblog/culture/travel/berlin2017/german-elections-2017.html\">German elections 2017</a></div></body></html><hr/><div class=\"highlight\" style=\"background: #f8f8f8\"><pre style=\"line-height: 125%\"><span></span>&lt;<span style=\"color: #008000; font-weight: bold\">div</span> <span style=\"color: #7D9029\">class</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;btitle&quot;</span>&gt;\n",
" &lt;<span style=\"color: #008000; font-weight: bold\">a</span> <span style=\"color: #7D9029\">class</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;invisiblelink&quot;</span> <span style=\"color: #7D9029\">href</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;http://www.somebits.com/weblog/culture/travel/berlin2017/german-elections-2017.html&quot;</span>&gt;\n",
" German elections 2017\n",
" &lt;/<span style=\"color: #008000; font-weight: bold\">a</span>&gt;\n",
"&lt;/<span style=\"color: #008000; font-weight: bold\">div</span>&gt;\n",
"</pre></div>\n",
"<hr/>"
],
"text/plain": [
"<div class=\"btitle\"><a class=\"invisiblelink\" href=\"http://www.somebits.com/weblog/culture/travel/berlin2017/german-elections-2017.html\">German elections 2017</a></div>"
]
},
"metadata": {},
"output_type": "display_data"
},
{
"data": {
"text/html": [
"<table><tr><th>Index</th><th>Render</th><th>source</th></tr><tr><td>0</td><td><html><body><a href=\"https://www.ft.com/content/e7c7d918-a17e-11e7-b797-b61809486fe2\">Detailed\n",
"result maps</a></body></html></td><td><div class=\"highlight\" style=\"background: #f8f8f8\"><pre style=\"line-height: 125%\"><span></span>&lt;<span style=\"color: #008000; font-weight: bold\">a</span> <span style=\"color: #7D9029\">href</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;https://www.ft.com/content/e7c7d918-a17e-11e7-b797-b61809486fe2&quot;</span>&gt;\n",
" Detailed\n",
"result maps\n",
"&lt;/<span style=\"color: #008000; font-weight: bold\">a</span>&gt;\n",
"</pre></div>\n",
"</td></tr><tr><td>1</td><td><html><body><a href=\"https://www.ft.com/__origami/service/image/v2/images/raw/http%3A%2F%2Fcom.ft.imagepublish.prod.s3.amazonaws.com%2Fb9a9f4d2-a19f-11e7-9e4f-7f5e6a7c98a2?source=next&amp;quality=highest\">direct\n",
"link to AfD support</a></body></html></td><td><div class=\"highlight\" style=\"background: #f8f8f8\"><pre style=\"line-height: 125%\"><span></span>&lt;<span style=\"color: #008000; font-weight: bold\">a</span> <span style=\"color: #7D9029\">href</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;https://www.ft.com/__origami/service/image/v2/images/raw/http%3A%2F%2Fcom.ft.imagepublish.prod.s3.amazonaws.com%2Fb9a9f4d2-a19f-11e7-9e4f-7f5e6a7c98a2?source=next&amp;amp;quality=highest&quot;</span>&gt;\n",
" direct\n",
"link to AfD support\n",
"&lt;/<span style=\"color: #008000; font-weight: bold\">a</span>&gt;\n",
"</pre></div>\n",
"</td></tr><tr><td>2</td><td><html><body><a href=\"https://interaktiv.morgenpost.de/berlinwahlkarte2017/\">Very\n",
"detailed result map for Berlin</a></body></html></td><td><div class=\"highlight\" style=\"background: #f8f8f8\"><pre style=\"line-height: 125%\"><span></span>&lt;<span style=\"color: #008000; font-weight: bold\">a</span> <span style=\"color: #7D9029\">href</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;https://interaktiv.morgenpost.de/berlinwahlkarte2017/&quot;</span>&gt;\n",
" Very\n",
"detailed result map for Berlin\n",
"&lt;/<span style=\"color: #008000; font-weight: bold\">a</span>&gt;\n",
"</pre></div>\n",
"</td></tr><tr><td>3</td><td><html><body><a href=\"https://lisacharlotterost.github.io/2017/09/20/German-elections/\">Germany's\n",
"two part ballot</a></body></html></td><td><div class=\"highlight\" style=\"background: #f8f8f8\"><pre style=\"line-height: 125%\"><span></span>&lt;<span style=\"color: #008000; font-weight: bold\">a</span> <span style=\"color: #7D9029\">href</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;https://lisacharlotterost.github.io/2017/09/20/German-elections/&quot;</span>&gt;\n",
" Germany&#39;s\n",
"two part ballot\n",
"&lt;/<span style=\"color: #008000; font-weight: bold\">a</span>&gt;\n",
"</pre></div>\n",
"</td></tr><tr><td>4</td><td><html><body><a href=\"https://medium.com/@kode4food/fascism-is-not-to-be-debated-gahh-4c82a1112405\">Fascism\n",
"is not to be debated…</a></body></html></td><td><div class=\"highlight\" style=\"background: #f8f8f8\"><pre style=\"line-height: 125%\"><span></span>&lt;<span style=\"color: #008000; font-weight: bold\">a</span> <span style=\"color: #7D9029\">href</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;https://medium.com/@kode4food/fascism-is-not-to-be-debated-gahh-4c82a1112405&quot;</span>&gt;\n",
" Fascism\n",
"is not to be debated…\n",
"&lt;/<span style=\"color: #008000; font-weight: bold\">a</span>&gt;\n",
"</pre></div>\n",
"</td></tr><tr><td>5</td><td><html><body><a href=\"https://i.redd.it/n344kjk2fsnz.jpg\">A funny election poster\n",
"spoof</a></body></html></td><td><div class=\"highlight\" style=\"background: #f8f8f8\"><pre style=\"line-height: 125%\"><span></span>&lt;<span style=\"color: #008000; font-weight: bold\">a</span> <span style=\"color: #7D9029\">href</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;https://i.redd.it/n344kjk2fsnz.jpg&quot;</span>&gt;\n",
" A funny election poster\n",
"spoof\n",
"&lt;/<span style=\"color: #008000; font-weight: bold\">a</span>&gt;\n",
"</pre></div>\n",
"</td></tr><tr><td>6</td><td><html><body><a href=\"https://www.endlich-tod.de/\">this page</a></body></html></td><td><div class=\"highlight\" style=\"background: #f8f8f8\"><pre style=\"line-height: 125%\"><span></span>&lt;<span style=\"color: #008000; font-weight: bold\">a</span> <span style=\"color: #7D9029\">href</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;https://www.endlich-tod.de/&quot;</span>&gt;\n",
" this page\n",
"&lt;/<span style=\"color: #008000; font-weight: bold\">a</span>&gt;\n",
"</pre></div>\n",
"</td></tr></table>"
],
"text/plain": [
"[<a href=\"https://www.ft.com/content/e7c7d918-a17e-11e7-b797-b61809486fe2\">Detailed\n",
"result maps</a>, <a href=\"https://www.ft.com/__origami/service/image/v2/images/raw/http%3A%2F%2Fcom.ft.imagepublish.prod.s3.amazonaws.com%2Fb9a9f4d2-a19f-11e7-9e4f-7f5e6a7c98a2?source=next&amp;quality=highest\">direct\n",
"link to AfD support</a>, <a href=\"https://interaktiv.morgenpost.de/berlinwahlkarte2017/\">Very\n",
"detailed result map for Berlin</a>, <a href=\"https://lisacharlotterost.github.io/2017/09/20/German-elections/\">Germany's\n",
"two part ballot</a>, <a href=\"https://medium.com/@kode4food/fascism-is-not-to-be-debated-gahh-4c82a1112405\">Fascism\n",
"is not to be debated…</a>, <a href=\"https://i.redd.it/n344kjk2fsnz.jpg\">A funny election poster\n",
"spoof</a>, <a href=\"https://www.endlich-tod.de/\">this page</a>]"
]
},
"metadata": {},
"output_type": "display_data"
},
{
"data": {
"text/html": [
"<html><body><div class=\"btitle\"><a class=\"invisiblelink\" href=\"http://www.somebits.com/weblog/culture/travel/berlin2017/berlin-after-ten-days.html\">Berlin after ten days</a></div></body></html><hr/><div class=\"highlight\" style=\"background: #f8f8f8\"><pre style=\"line-height: 125%\"><span></span>&lt;<span style=\"color: #008000; font-weight: bold\">div</span> <span style=\"color: #7D9029\">class</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;btitle&quot;</span>&gt;\n",
" &lt;<span style=\"color: #008000; font-weight: bold\">a</span> <span style=\"color: #7D9029\">class</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;invisiblelink&quot;</span> <span style=\"color: #7D9029\">href</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;http://www.somebits.com/weblog/culture/travel/berlin2017/berlin-after-ten-days.html&quot;</span>&gt;\n",
" Berlin after ten days\n",
" &lt;/<span style=\"color: #008000; font-weight: bold\">a</span>&gt;\n",
"&lt;/<span style=\"color: #008000; font-weight: bold\">div</span>&gt;\n",
"</pre></div>\n",
"<hr/>"
],
"text/plain": [
"<div class=\"btitle\"><a class=\"invisiblelink\" href=\"http://www.somebits.com/weblog/culture/travel/berlin2017/berlin-after-ten-days.html\">Berlin after ten days</a></div>"
]
},
"metadata": {},
"output_type": "display_data"
},
{
"data": {
"text/html": [
"<table><tr><th>Index</th><th>Render</th><th>source</th></tr><tr><td>0</td><td><html><body><a href=\"https://en.wikipedia.org/wiki/Prenzlauer_Berg\">in\n",
"Prenzlauer Berg</a></body></html></td><td><div class=\"highlight\" style=\"background: #f8f8f8\"><pre style=\"line-height: 125%\"><span></span>&lt;<span style=\"color: #008000; font-weight: bold\">a</span> <span style=\"color: #7D9029\">href</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;https://en.wikipedia.org/wiki/Prenzlauer_Berg&quot;</span>&gt;\n",
" in\n",
"Prenzlauer Berg\n",
"&lt;/<span style=\"color: #008000; font-weight: bold\">a</span>&gt;\n",
"</pre></div>\n",
"</td></tr><tr><td>1</td><td><html><body><a href=\"https://www.google.de/maps/place/Kollwitzplatz/@52.5340753,13.4141991,15.96z/data=!4m5!3m4!1s0x47a84e0227d336f1:0xcc98f06b3c70f1bc!8m2!3d52.5364044!4d13.4170791?hl=en\">Kollwitzplatz</a></body></html></td><td><div class=\"highlight\" style=\"background: #f8f8f8\"><pre style=\"line-height: 125%\"><span></span>&lt;<span style=\"color: #008000; font-weight: bold\">a</span> <span style=\"color: #7D9029\">href</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;https://www.google.de/maps/place/Kollwitzplatz/@52.5340753,13.4141991,15.96z/data=!4m5!3m4!1s0x47a84e0227d336f1:0xcc98f06b3c70f1bc!8m2!3d52.5364044!4d13.4170791?hl=en&quot;</span>&gt;\n",
" Kollwitzplatz\n",
"&lt;/<span style=\"color: #008000; font-weight: bold\">a</span>&gt;\n",
"</pre></div>\n",
"</td></tr><tr><td>2</td><td><html><body><a href=\"https://www.google.com/search?q=leafy+streets+prenzlauer+berg&amp;tbm=isch\">leafy\n",
"streets</a></body></html></td><td><div class=\"highlight\" style=\"background: #f8f8f8\"><pre style=\"line-height: 125%\"><span></span>&lt;<span style=\"color: #008000; font-weight: bold\">a</span> <span style=\"color: #7D9029\">href</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;https://www.google.com/search?q=leafy+streets+prenzlauer+berg&amp;amp;tbm=isch&quot;</span>&gt;\n",
" leafy\n",
"streets\n",
"&lt;/<span style=\"color: #008000; font-weight: bold\">a</span>&gt;\n",
"</pre></div>\n",
"</td></tr><tr><td>3</td><td><html><body><a href=\"https://en.wikipedia.org/wiki/Kulturbrauerei\">repurposed 19th\n",
"century brewery</a></body></html></td><td><div class=\"highlight\" style=\"background: #f8f8f8\"><pre style=\"line-height: 125%\"><span></span>&lt;<span style=\"color: #008000; font-weight: bold\">a</span> <span style=\"color: #7D9029\">href</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;https://en.wikipedia.org/wiki/Kulturbrauerei&quot;</span>&gt;\n",
" repurposed 19th\n",
"century brewery\n",
"&lt;/<span style=\"color: #008000; font-weight: bold\">a</span>&gt;\n",
"</pre></div>\n",
"</td></tr><tr><td>4</td><td><html><body><a href=\"https://www.topographie.de/en/\">well\n",
"represented</a></body></html></td><td><div class=\"highlight\" style=\"background: #f8f8f8\"><pre style=\"line-height: 125%\"><span></span>&lt;<span style=\"color: #008000; font-weight: bold\">a</span> <span style=\"color: #7D9029\">href</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;https://www.topographie.de/en/&quot;</span>&gt;\n",
" well\n",
"represented\n",
"&lt;/<span style=\"color: #008000; font-weight: bold\">a</span>&gt;\n",
"</pre></div>\n",
"</td></tr><tr><td>5</td><td><html><body><a href=\"https://en.wikipedia.org/wiki/Frederick_the_Great\">Prussia’s\n",
"great gay king</a></body></html></td><td><div class=\"highlight\" style=\"background: #f8f8f8\"><pre style=\"line-height: 125%\"><span></span>&lt;<span style=\"color: #008000; font-weight: bold\">a</span> <span style=\"color: #7D9029\">href</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;https://en.wikipedia.org/wiki/Frederick_the_Great&quot;</span>&gt;\n",
" Prussia’s\n",
"great gay king\n",
"&lt;/<span style=\"color: #008000; font-weight: bold\">a</span>&gt;\n",
"</pre></div>\n",
"</td></tr><tr><td>6</td><td><html><body><a href=\"https://en.wikipedia.org/wiki/C%C3%B6lln\">Cölln</a></body></html></td><td><div class=\"highlight\" style=\"background: #f8f8f8\"><pre style=\"line-height: 125%\"><span></span>&lt;<span style=\"color: #008000; font-weight: bold\">a</span> <span style=\"color: #7D9029\">href</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;https://en.wikipedia.org/wiki/C%C3%B6lln&quot;</span>&gt;\n",
" Cölln\n",
"&lt;/<span style=\"color: #008000; font-weight: bold\">a</span>&gt;\n",
"</pre></div>\n",
"</td></tr></table>"
],
"text/plain": [
"[<a href=\"https://en.wikipedia.org/wiki/Prenzlauer_Berg\">in\n",
"Prenzlauer Berg</a>, <a href=\"https://www.google.de/maps/place/Kollwitzplatz/@52.5340753,13.4141991,15.96z/data=!4m5!3m4!1s0x47a84e0227d336f1:0xcc98f06b3c70f1bc!8m2!3d52.5364044!4d13.4170791?hl=en\">Kollwitzplatz</a>, <a href=\"https://www.google.com/search?q=leafy+streets+prenzlauer+berg&amp;tbm=isch\">leafy\n",
"streets</a>, <a href=\"https://en.wikipedia.org/wiki/Kulturbrauerei\">repurposed 19th\n",
"century brewery</a>, <a href=\"https://www.topographie.de/en/\">well\n",
"represented</a>, <a href=\"https://en.wikipedia.org/wiki/Frederick_the_Great\">Prussia’s\n",
"great gay king</a>, <a href=\"https://en.wikipedia.org/wiki/C%C3%B6lln\">Cölln</a>]"
]
},
"metadata": {},
"output_type": "display_data"
},
{
"data": {
"text/html": [
"<html><body><div class=\"btitle\"><a class=\"invisiblelink\" href=\"http://www.somebits.com/weblog/culture/travel/berlin2017/urban-nation.html\">Urban Nation in Berlin</a></div></body></html><hr/><div class=\"highlight\" style=\"background: #f8f8f8\"><pre style=\"line-height: 125%\"><span></span>&lt;<span style=\"color: #008000; font-weight: bold\">div</span> <span style=\"color: #7D9029\">class</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;btitle&quot;</span>&gt;\n",
" &lt;<span style=\"color: #008000; font-weight: bold\">a</span> <span style=\"color: #7D9029\">class</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;invisiblelink&quot;</span> <span style=\"color: #7D9029\">href</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;http://www.somebits.com/weblog/culture/travel/berlin2017/urban-nation.html&quot;</span>&gt;\n",
" Urban Nation in Berlin\n",
" &lt;/<span style=\"color: #008000; font-weight: bold\">a</span>&gt;\n",
"&lt;/<span style=\"color: #008000; font-weight: bold\">div</span>&gt;\n",
"</pre></div>\n",
"<hr/>"
],
"text/plain": [
"<div class=\"btitle\"><a class=\"invisiblelink\" href=\"http://www.somebits.com/weblog/culture/travel/berlin2017/urban-nation.html\">Urban Nation in Berlin</a></div>"
]
},
"metadata": {},
"output_type": "display_data"
},
{
"data": {
"text/html": [
"<table><tr><th>Index</th><th>Render</th><th>source</th></tr><tr><td>0</td><td><html><body><a href=\"https://urban-nation.com/\">Urban Nation</a></body></html></td><td><div class=\"highlight\" style=\"background: #f8f8f8\"><pre style=\"line-height: 125%\"><span></span>&lt;<span style=\"color: #008000; font-weight: bold\">a</span> <span style=\"color: #7D9029\">href</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;https://urban-nation.com/&quot;</span>&gt;\n",
" Urban Nation\n",
"&lt;/<span style=\"color: #008000; font-weight: bold\">a</span>&gt;\n",
"</pre></div>\n",
"</td></tr><tr><td>1</td><td><html><body><a href=\"https://urban-nation.com/2017/09/unique-united-unstoppable-urban-nation-museum-opens/\">their\n",
"opening weekend show</a></body></html></td><td><div class=\"highlight\" style=\"background: #f8f8f8\"><pre style=\"line-height: 125%\"><span></span>&lt;<span style=\"color: #008000; font-weight: bold\">a</span> <span style=\"color: #7D9029\">href</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;https://urban-nation.com/2017/09/unique-united-unstoppable-urban-nation-museum-opens/&quot;</span>&gt;\n",
" their\n",
"opening weekend show\n",
"&lt;/<span style=\"color: #008000; font-weight: bold\">a</span>&gt;\n",
"</pre></div>\n",
"</td></tr><tr><td>2</td><td><html><body><a href=\"https://www.flickr.com/photos/nelsonminar/albums/72157689187804735\">on\n",
"Flickr</a></body></html></td><td><div class=\"highlight\" style=\"background: #f8f8f8\"><pre style=\"line-height: 125%\"><span></span>&lt;<span style=\"color: #008000; font-weight: bold\">a</span> <span style=\"color: #7D9029\">href</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;https://www.flickr.com/photos/nelsonminar/albums/72157689187804735&quot;</span>&gt;\n",
" on\n",
"Flickr\n",
"&lt;/<span style=\"color: #008000; font-weight: bold\">a</span>&gt;\n",
"</pre></div>\n",
"</td></tr><tr><td>3</td><td><html><body><a href=\"https://www.flickr.com/photos/nelsonminar/36888561030/in/album-72157689187804735/\"><img class=\"cimg\" height=\"390\" src=\"/~nelson/weblog-files/centerimages/c215-un.jpg\" width=\"390\"/></a></body></html></td><td><div class=\"highlight\" style=\"background: #f8f8f8\"><pre style=\"line-height: 125%\"><span></span>&lt;<span style=\"color: #008000; font-weight: bold\">a</span> <span style=\"color: #7D9029\">href</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;https://www.flickr.com/photos/nelsonminar/36888561030/in/album-72157689187804735/&quot;</span>&gt;\n",
" &lt;<span style=\"color: #008000; font-weight: bold\">img</span> <span style=\"color: #7D9029\">class</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;cimg&quot;</span> <span style=\"color: #7D9029\">height</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;390&quot;</span> <span style=\"color: #7D9029\">src</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;/~nelson/weblog-files/centerimages/c215-un.jpg&quot;</span> <span style=\"color: #7D9029\">width</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;390&quot;</span>/&gt;\n",
"&lt;/<span style=\"color: #008000; font-weight: bold\">a</span>&gt;\n",
"</pre></div>\n",
"</td></tr><tr><td>4</td><td><html><body><a href=\"http://www.zezaoarts.com.br/rua.php\">Zezão’s alien\n",
"calligraphy forms</a></body></html></td><td><div class=\"highlight\" style=\"background: #f8f8f8\"><pre style=\"line-height: 125%\"><span></span>&lt;<span style=\"color: #008000; font-weight: bold\">a</span> <span style=\"color: #7D9029\">href</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;http://www.zezaoarts.com.br/rua.php&quot;</span>&gt;\n",
" Zezão’s alien\n",
"calligraphy forms\n",
"&lt;/<span style=\"color: #008000; font-weight: bold\">a</span>&gt;\n",
"</pre></div>\n",
"</td></tr><tr><td>5</td><td><html><body><a href=\"http://c215.fr/C215/HOME.html\">C215</a></body></html></td><td><div class=\"highlight\" style=\"background: #f8f8f8\"><pre style=\"line-height: 125%\"><span></span>&lt;<span style=\"color: #008000; font-weight: bold\">a</span> <span style=\"color: #7D9029\">href</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;http://c215.fr/C215/HOME.html&quot;</span>&gt;\n",
" C215\n",
"&lt;/<span style=\"color: #008000; font-weight: bold\">a</span>&gt;\n",
"</pre></div>\n",
"</td></tr><tr><td>6</td><td><html><body><a href=\"https://www.instagram.com/deih.xlf/?hl=en\">Deih XLF</a></body></html></td><td><div class=\"highlight\" style=\"background: #f8f8f8\"><pre style=\"line-height: 125%\"><span></span>&lt;<span style=\"color: #008000; font-weight: bold\">a</span> <span style=\"color: #7D9029\">href</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;https://www.instagram.com/deih.xlf/?hl=en&quot;</span>&gt;\n",
" Deih XLF\n",
"&lt;/<span style=\"color: #008000; font-weight: bold\">a</span>&gt;\n",
"</pre></div>\n",
"</td></tr><tr><td>7</td><td><html><body><a href=\"https://www.instagram.com/dalek2020/\">Dalek</a></body></html></td><td><div class=\"highlight\" style=\"background: #f8f8f8\"><pre style=\"line-height: 125%\"><span></span>&lt;<span style=\"color: #008000; font-weight: bold\">a</span> <span style=\"color: #7D9029\">href</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;https://www.instagram.com/dalek2020/&quot;</span>&gt;\n",
" Dalek\n",
"&lt;/<span style=\"color: #008000; font-weight: bold\">a</span>&gt;\n",
"</pre></div>\n",
"</td></tr></table>"
],
"text/plain": [
"[<a href=\"https://urban-nation.com/\">Urban Nation</a>, <a href=\"https://urban-nation.com/2017/09/unique-united-unstoppable-urban-nation-museum-opens/\">their\n",
"opening weekend show</a>, <a href=\"https://www.flickr.com/photos/nelsonminar/albums/72157689187804735\">on\n",
"Flickr</a>, <a href=\"https://www.flickr.com/photos/nelsonminar/36888561030/in/album-72157689187804735/\"><img class=\"cimg\" height=\"390\" src=\"/~nelson/weblog-files/centerimages/c215-un.jpg\" width=\"390\"/></a>, <a href=\"http://www.zezaoarts.com.br/rua.php\">Zezão’s alien\n",
"calligraphy forms</a>, <a href=\"http://c215.fr/C215/HOME.html\">C215</a>, <a href=\"https://www.instagram.com/deih.xlf/?hl=en\">Deih XLF</a>, <a href=\"https://www.instagram.com/dalek2020/\">Dalek</a>]"
]
},
"metadata": {},
"output_type": "display_data"
},
{
"data": {
"text/html": [
"<html><body><div class=\"btitle\"><a class=\"invisiblelink\" href=\"http://www.somebits.com/weblog/culture/memorializing-an-evil-history.html\">Memorializing an evil history</a></div></body></html><hr/><div class=\"highlight\" style=\"background: #f8f8f8\"><pre style=\"line-height: 125%\"><span></span>&lt;<span style=\"color: #008000; font-weight: bold\">div</span> <span style=\"color: #7D9029\">class</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;btitle&quot;</span>&gt;\n",
" &lt;<span style=\"color: #008000; font-weight: bold\">a</span> <span style=\"color: #7D9029\">class</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;invisiblelink&quot;</span> <span style=\"color: #7D9029\">href</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;http://www.somebits.com/weblog/culture/memorializing-an-evil-history.html&quot;</span>&gt;\n",
" Memorializing an evil history\n",
" &lt;/<span style=\"color: #008000; font-weight: bold\">a</span>&gt;\n",
"&lt;/<span style=\"color: #008000; font-weight: bold\">div</span>&gt;\n",
"</pre></div>\n",
"<hr/>"
],
"text/plain": [
"<div class=\"btitle\"><a class=\"invisiblelink\" href=\"http://www.somebits.com/weblog/culture/memorializing-an-evil-history.html\">Memorializing an evil history</a></div>"
]
},
"metadata": {},
"output_type": "display_data"
},
{
"data": {
"text/html": [
"<table><tr><th>Index</th><th>Render</th><th>source</th></tr><tr><td>0</td><td><html><body><a href=\"/weblog/life/my-familys-slave-texas-1860.html\">a descendant of slavers</a></body></html></td><td><div class=\"highlight\" style=\"background: #f8f8f8\"><pre style=\"line-height: 125%\"><span></span>&lt;<span style=\"color: #008000; font-weight: bold\">a</span> <span style=\"color: #7D9029\">href</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;/weblog/life/my-familys-slave-texas-1860.html&quot;</span>&gt;\n",
" a descendant of slavers\n",
"&lt;/<span style=\"color: #008000; font-weight: bold\">a</span>&gt;\n",
"</pre></div>\n",
"</td></tr><tr><td>1</td><td><html><body><a href=\"https://www.splcenter.org/sites/default/files/whoseheritage_splc.pdf\">50-100 years after the war</a></body></html></td><td><div class=\"highlight\" style=\"background: #f8f8f8\"><pre style=\"line-height: 125%\"><span></span>&lt;<span style=\"color: #008000; font-weight: bold\">a</span> <span style=\"color: #7D9029\">href</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;https://www.splcenter.org/sites/default/files/whoseheritage_splc.pdf&quot;</span>&gt;\n",
" 50-100 years after the war\n",
"&lt;/<span style=\"color: #008000; font-weight: bold\">a</span>&gt;\n",
"</pre></div>\n",
"</td></tr><tr><td>2</td><td><html><body><a href=\"http://www.npr.org/sections/codeswitch/2017/08/16/543808019/the-view-of-charlottesville-from-berlin\">much better model</a></body></html></td><td><div class=\"highlight\" style=\"background: #f8f8f8\"><pre style=\"line-height: 125%\"><span></span>&lt;<span style=\"color: #008000; font-weight: bold\">a</span> <span style=\"color: #7D9029\">href</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;http://www.npr.org/sections/codeswitch/2017/08/16/543808019/the-view-of-charlottesville-from-berlin&quot;</span>&gt;\n",
" much better model\n",
"&lt;/<span style=\"color: #008000; font-weight: bold\">a</span>&gt;\n",
"</pre></div>\n",
"</td></tr><tr><td>3</td><td><html><body><a href=\"http://www.somebits.com/weblog/culture/accounting-for-an-evil-history.html\">written before</a></body></html></td><td><div class=\"highlight\" style=\"background: #f8f8f8\"><pre style=\"line-height: 125%\"><span></span>&lt;<span style=\"color: #008000; font-weight: bold\">a</span> <span style=\"color: #7D9029\">href</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;http://www.somebits.com/weblog/culture/accounting-for-an-evil-history.html&quot;</span>&gt;\n",
" written before\n",
"&lt;/<span style=\"color: #008000; font-weight: bold\">a</span>&gt;\n",
"</pre></div>\n",
"</td></tr><tr><td>4</td><td><html><body><a href=\"http://www.topographie.de/en\">Topography of Terror center</a></body></html></td><td><div class=\"highlight\" style=\"background: #f8f8f8\"><pre style=\"line-height: 125%\"><span></span>&lt;<span style=\"color: #008000; font-weight: bold\">a</span> <span style=\"color: #7D9029\">href</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;http://www.topographie.de/en&quot;</span>&gt;\n",
" Topography of Terror center\n",
"&lt;/<span style=\"color: #008000; font-weight: bold\">a</span>&gt;\n",
"</pre></div>\n",
"</td></tr><tr><td>5</td><td><html><body><a href=\"https://en.wikipedia.org/wiki/Controversies_surrounding_Yasukuni_Shrine\">Yasukuni Shrine</a></body></html></td><td><div class=\"highlight\" style=\"background: #f8f8f8\"><pre style=\"line-height: 125%\"><span></span>&lt;<span style=\"color: #008000; font-weight: bold\">a</span> <span style=\"color: #7D9029\">href</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;https://en.wikipedia.org/wiki/Controversies_surrounding_Yasukuni_Shrine&quot;</span>&gt;\n",
" Yasukuni Shrine\n",
"&lt;/<span style=\"color: #008000; font-weight: bold\">a</span>&gt;\n",
"</pre></div>\n",
"</td></tr><tr><td>6</td><td><html><body><a href=\"https://en.wikipedia.org/wiki/Japanese_history_textbook_controversies\">huge debate about its textbooks</a></body></html></td><td><div class=\"highlight\" style=\"background: #f8f8f8\"><pre style=\"line-height: 125%\"><span></span>&lt;<span style=\"color: #008000; font-weight: bold\">a</span> <span style=\"color: #7D9029\">href</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;https://en.wikipedia.org/wiki/Japanese_history_textbook_controversies&quot;</span>&gt;\n",
" huge debate about its textbooks\n",
"&lt;/<span style=\"color: #008000; font-weight: bold\">a</span>&gt;\n",
"</pre></div>\n",
"</td></tr><tr><td>7</td><td><html><body><a href=\"http://www.heraldsun.com/news/local/counties/durham-county/article167619947.html\">mass produced generic statue</a></body></html></td><td><div class=\"highlight\" style=\"background: #f8f8f8\"><pre style=\"line-height: 125%\"><span></span>&lt;<span style=\"color: #008000; font-weight: bold\">a</span> <span style=\"color: #7D9029\">href</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;http://www.heraldsun.com/news/local/counties/durham-county/article167619947.html&quot;</span>&gt;\n",
" mass produced generic statue\n",
"&lt;/<span style=\"color: #008000; font-weight: bold\">a</span>&gt;\n",
"</pre></div>\n",
"</td></tr></table>"
],
"text/plain": [
"[<a href=\"/weblog/life/my-familys-slave-texas-1860.html\">a descendant of slavers</a>, <a href=\"https://www.splcenter.org/sites/default/files/whoseheritage_splc.pdf\">50-100 years after the war</a>, <a href=\"http://www.npr.org/sections/codeswitch/2017/08/16/543808019/the-view-of-charlottesville-from-berlin\">much better model</a>, <a href=\"http://www.somebits.com/weblog/culture/accounting-for-an-evil-history.html\">written before</a>, <a href=\"http://www.topographie.de/en\">Topography of Terror center</a>, <a href=\"https://en.wikipedia.org/wiki/Controversies_surrounding_Yasukuni_Shrine\">Yasukuni Shrine</a>, <a href=\"https://en.wikipedia.org/wiki/Japanese_history_textbook_controversies\">huge debate about its textbooks</a>, <a href=\"http://www.heraldsun.com/news/local/counties/durham-county/article167619947.html\">mass produced generic statue</a>]"
]
},
"metadata": {},
"output_type": "display_data"
},
{
"data": {
"text/html": [
"<html><body><div class=\"btitle\"><a class=\"invisiblelink\" href=\"http://www.somebits.com/weblog/politics/voting-rights-and-gerrymandering.html\">Voting rights and gerrymandering</a></div></body></html><hr/><div class=\"highlight\" style=\"background: #f8f8f8\"><pre style=\"line-height: 125%\"><span></span>&lt;<span style=\"color: #008000; font-weight: bold\">div</span> <span style=\"color: #7D9029\">class</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;btitle&quot;</span>&gt;\n",
" &lt;<span style=\"color: #008000; font-weight: bold\">a</span> <span style=\"color: #7D9029\">class</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;invisiblelink&quot;</span> <span style=\"color: #7D9029\">href</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;http://www.somebits.com/weblog/politics/voting-rights-and-gerrymandering.html&quot;</span>&gt;\n",
" Voting rights and gerrymandering\n",
" &lt;/<span style=\"color: #008000; font-weight: bold\">a</span>&gt;\n",
"&lt;/<span style=\"color: #008000; font-weight: bold\">div</span>&gt;\n",
"</pre></div>\n",
"<hr/>"
],
"text/plain": [
"<div class=\"btitle\"><a class=\"invisiblelink\" href=\"http://www.somebits.com/weblog/politics/voting-rights-and-gerrymandering.html\">Voting rights and gerrymandering</a></div>"
]
},
"metadata": {},
"output_type": "display_data"
},
{
"data": {
"text/html": [
"<table><tr><th>Index</th><th>Render</th><th>source</th></tr><tr><td>0</td><td><html><body><a href=\"http://www.slate.com/articles/news_and_politics/jurisprudence/2017/06/donald_trump_s_voter_fraud_commission_is_itself_an_enormous_fraud.html\">a\n",
"clear strategy</a></body></html></td><td><div class=\"highlight\" style=\"background: #f8f8f8\"><pre style=\"line-height: 125%\"><span></span>&lt;<span style=\"color: #008000; font-weight: bold\">a</span> <span style=\"color: #7D9029\">href</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;http://www.slate.com/articles/news_and_politics/jurisprudence/2017/06/donald_trump_s_voter_fraud_commission_is_itself_an_enormous_fraud.html&quot;</span>&gt;\n",
" a\n",
"clear strategy\n",
"&lt;/<span style=\"color: #008000; font-weight: bold\">a</span>&gt;\n",
"</pre></div>\n",
"</td></tr><tr><td>1</td><td><html><body><a href=\"https://www.letamericavote.org/\">Let\n",
"America Vote</a></body></html></td><td><div class=\"highlight\" style=\"background: #f8f8f8\"><pre style=\"line-height: 125%\"><span></span>&lt;<span style=\"color: #008000; font-weight: bold\">a</span> <span style=\"color: #7D9029\">href</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;https://www.letamericavote.org/&quot;</span>&gt;\n",
" Let\n",
"America Vote\n",
"&lt;/<span style=\"color: #008000; font-weight: bold\">a</span>&gt;\n",
"</pre></div>\n",
"</td></tr><tr><td>2</td><td><html><body><a href=\"https://twitter.com/letamericavote\">agitation</a></body></html></td><td><div class=\"highlight\" style=\"background: #f8f8f8\"><pre style=\"line-height: 125%\"><span></span>&lt;<span style=\"color: #008000; font-weight: bold\">a</span> <span style=\"color: #7D9029\">href</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;https://twitter.com/letamericavote&quot;</span>&gt;\n",
" agitation\n",
"&lt;/<span style=\"color: #008000; font-weight: bold\">a</span>&gt;\n",
"</pre></div>\n",
"</td></tr><tr><td>3</td><td><html><body><a href=\"http://www.slate.com/articles/news_and_politics/jurisprudence/2017/06/donald_trump_s_voter_fraud_commission_is_itself_an_enormous_fraud.html\">Trump’s\n",
"voter suppression committee</a></body></html></td><td><div class=\"highlight\" style=\"background: #f8f8f8\"><pre style=\"line-height: 125%\"><span></span>&lt;<span style=\"color: #008000; font-weight: bold\">a</span> <span style=\"color: #7D9029\">href</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;http://www.slate.com/articles/news_and_politics/jurisprudence/2017/06/donald_trump_s_voter_fraud_commission_is_itself_an_enormous_fraud.html&quot;</span>&gt;\n",
" Trump’s\n",
"voter suppression committee\n",
"&lt;/<span style=\"color: #008000; font-weight: bold\">a</span>&gt;\n",
"</pre></div>\n",
"</td></tr><tr><td>4</td><td><html><body><a href=\"https://twitter.com/JasonKander\">hilarious\n",
"on Twitter</a></body></html></td><td><div class=\"highlight\" style=\"background: #f8f8f8\"><pre style=\"line-height: 125%\"><span></span>&lt;<span style=\"color: #008000; font-weight: bold\">a</span> <span style=\"color: #7D9029\">href</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;https://twitter.com/JasonKander&quot;</span>&gt;\n",
" hilarious\n",
"on Twitter\n",
"&lt;/<span style=\"color: #008000; font-weight: bold\">a</span>&gt;\n",
"</pre></div>\n",
"</td></tr><tr><td>5</td><td><html><body><a href=\"https://www.aclu.org/issues/voting-rights\">very active</a></body></html></td><td><div class=\"highlight\" style=\"background: #f8f8f8\"><pre style=\"line-height: 125%\"><span></span>&lt;<span style=\"color: #008000; font-weight: bold\">a</span> <span style=\"color: #7D9029\">href</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;https://www.aclu.org/issues/voting-rights&quot;</span>&gt;\n",
" very active\n",
"&lt;/<span style=\"color: #008000; font-weight: bold\">a</span>&gt;\n",
"</pre></div>\n",
"</td></tr><tr><td>6</td><td><html><body><a href=\"https://pinboard.in/search/u:nelson?query=gerrymandering\">educating\n",
"myself</a></body></html></td><td><div class=\"highlight\" style=\"background: #f8f8f8\"><pre style=\"line-height: 125%\"><span></span>&lt;<span style=\"color: #008000; font-weight: bold\">a</span> <span style=\"color: #7D9029\">href</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;https://pinboard.in/search/u:nelson?query=gerrymandering&quot;</span>&gt;\n",
" educating\n",
"myself\n",
"&lt;/<span style=\"color: #008000; font-weight: bold\">a</span>&gt;\n",
"</pre></div>\n",
"</td></tr><tr><td>7</td><td><html><body><a href=\"https://www.goodreads.com/book/show/30364340-ratf-ked\">the\n",
"book Ratf**ked</a></body></html></td><td><div class=\"highlight\" style=\"background: #f8f8f8\"><pre style=\"line-height: 125%\"><span></span>&lt;<span style=\"color: #008000; font-weight: bold\">a</span> <span style=\"color: #7D9029\">href</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;https://www.goodreads.com/book/show/30364340-ratf-ked&quot;</span>&gt;\n",
" the\n",
"book Ratf**ked\n",
"&lt;/<span style=\"color: #008000; font-weight: bold\">a</span>&gt;\n",
"</pre></div>\n",
"</td></tr><tr><td>8</td><td><html><body><a href=\"http://www.newyorker.com/magazine/2016/06/27/ratfcked-the-influence-of-redistricting\">New\n",
"Yorker review</a></body></html></td><td><div class=\"highlight\" style=\"background: #f8f8f8\"><pre style=\"line-height: 125%\"><span></span>&lt;<span style=\"color: #008000; font-weight: bold\">a</span> <span style=\"color: #7D9029\">href</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;http://www.newyorker.com/magazine/2016/06/27/ratfcked-the-influence-of-redistricting&quot;</span>&gt;\n",
" New\n",
"Yorker review\n",
"&lt;/<span style=\"color: #008000; font-weight: bold\">a</span>&gt;\n",
"</pre></div>\n",
"</td></tr><tr><td>9</td><td><html><body><a href=\"http://www.redistrictingmajorityproject.com/\">REDMAP</a></body></html></td><td><div class=\"highlight\" style=\"background: #f8f8f8\"><pre style=\"line-height: 125%\"><span></span>&lt;<span style=\"color: #008000; font-weight: bold\">a</span> <span style=\"color: #7D9029\">href</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;http://www.redistrictingmajorityproject.com/&quot;</span>&gt;\n",
" REDMAP\n",
"&lt;/<span style=\"color: #008000; font-weight: bold\">a</span>&gt;\n",
"</pre></div>\n",
"</td></tr><tr><td>10</td><td><html><body><a href=\"https://democraticredistricting.com/\">National\n",
"Democratic Redistricting Committee</a></body></html></td><td><div class=\"highlight\" style=\"background: #f8f8f8\"><pre style=\"line-height: 125%\"><span></span>&lt;<span style=\"color: #008000; font-weight: bold\">a</span> <span style=\"color: #7D9029\">href</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;https://democraticredistricting.com/&quot;</span>&gt;\n",
" National\n",
"Democratic Redistricting Committee\n",
"&lt;/<span style=\"color: #008000; font-weight: bold\">a</span>&gt;\n",
"</pre></div>\n",
"</td></tr><tr><td>11</td><td><html><body><a href=\"https://www.washingtonpost.com/politics/courts_law/supreme-court-to-hear-potentially-landmark-case-on-partisan-gerrymandering/2017/06/19/d525237e-5435-11e7-b38e-35fd8e0c288f_story.html\">the\n",
"Wisconsin case</a></body></html></td><td><div class=\"highlight\" style=\"background: #f8f8f8\"><pre style=\"line-height: 125%\"><span></span>&lt;<span style=\"color: #008000; font-weight: bold\">a</span> <span style=\"color: #7D9029\">href</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;https://www.washingtonpost.com/politics/courts_law/supreme-court-to-hear-potentially-landmark-case-on-partisan-gerrymandering/2017/06/19/d525237e-5435-11e7-b38e-35fd8e0c288f_story.html&quot;</span>&gt;\n",
" the\n",
"Wisconsin case\n",
"&lt;/<span style=\"color: #008000; font-weight: bold\">a</span>&gt;\n",
"</pre></div>\n",
"</td></tr><tr><td>12</td><td><html><body><a href=\"https://newrepublic.com/article/118534/gerrymandering-efficiency-gap-better-way-measure-gerrymandering\">the\n",
"efficiency gap</a></body></html></td><td><div class=\"highlight\" style=\"background: #f8f8f8\"><pre style=\"line-height: 125%\"><span></span>&lt;<span style=\"color: #008000; font-weight: bold\">a</span> <span style=\"color: #7D9029\">href</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;https://newrepublic.com/article/118534/gerrymandering-efficiency-gap-better-way-measure-gerrymandering&quot;</span>&gt;\n",
" the\n",
"efficiency gap\n",
"&lt;/<span style=\"color: #008000; font-weight: bold\">a</span>&gt;\n",
"</pre></div>\n",
"</td></tr><tr><td>13</td><td><html><body><a href=\"https://apnews.com/fa6478e10cda4e9cbd75380e705bd380\">quantifies</a></body></html></td><td><div class=\"highlight\" style=\"background: #f8f8f8\"><pre style=\"line-height: 125%\"><span></span>&lt;<span style=\"color: #008000; font-weight: bold\">a</span> <span style=\"color: #7D9029\">href</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;https://apnews.com/fa6478e10cda4e9cbd75380e705bd380&quot;</span>&gt;\n",
" quantifies\n",
"&lt;/<span style=\"color: #008000; font-weight: bold\">a</span>&gt;\n",
"</pre></div>\n",
"</td></tr></table>"
],
"text/plain": [
"[<a href=\"http://www.slate.com/articles/news_and_politics/jurisprudence/2017/06/donald_trump_s_voter_fraud_commission_is_itself_an_enormous_fraud.html\">a\n",
"clear strategy</a>, <a href=\"https://www.letamericavote.org/\">Let\n",
"America Vote</a>, <a href=\"https://twitter.com/letamericavote\">agitation</a>, <a href=\"http://www.slate.com/articles/news_and_politics/jurisprudence/2017/06/donald_trump_s_voter_fraud_commission_is_itself_an_enormous_fraud.html\">Trump’s\n",
"voter suppression committee</a>, <a href=\"https://twitter.com/JasonKander\">hilarious\n",
"on Twitter</a>, <a href=\"https://www.aclu.org/issues/voting-rights\">very active</a>, <a href=\"https://pinboard.in/search/u:nelson?query=gerrymandering\">educating\n",
"myself</a>, <a href=\"https://www.goodreads.com/book/show/30364340-ratf-ked\">the\n",
"book Ratf**ked</a>, <a href=\"http://www.newyorker.com/magazine/2016/06/27/ratfcked-the-influence-of-redistricting\">New\n",
"Yorker review</a>, <a href=\"http://www.redistrictingmajorityproject.com/\">REDMAP</a>, <a href=\"https://democraticredistricting.com/\">National\n",
"Democratic Redistricting Committee</a>, <a href=\"https://www.washingtonpost.com/politics/courts_law/supreme-court-to-hear-potentially-landmark-case-on-partisan-gerrymandering/2017/06/19/d525237e-5435-11e7-b38e-35fd8e0c288f_story.html\">the\n",
"Wisconsin case</a>, <a href=\"https://newrepublic.com/article/118534/gerrymandering-efficiency-gap-better-way-measure-gerrymandering\">the\n",
"efficiency gap</a>, <a href=\"https://apnews.com/fa6478e10cda4e9cbd75380e705bd380\">quantifies</a>]"
]
},
"metadata": {},
"output_type": "display_data"
},
{
"data": {
"text/html": [
"<html><body><div class=\"btitle\"><a class=\"invisiblelink\" href=\"http://www.somebits.com/weblog/culture/travel/london-and-portugal.html\">London and Portugal</a></div></body></html><hr/><div class=\"highlight\" style=\"background: #f8f8f8\"><pre style=\"line-height: 125%\"><span></span>&lt;<span style=\"color: #008000; font-weight: bold\">div</span> <span style=\"color: #7D9029\">class</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;btitle&quot;</span>&gt;\n",
" &lt;<span style=\"color: #008000; font-weight: bold\">a</span> <span style=\"color: #7D9029\">class</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;invisiblelink&quot;</span> <span style=\"color: #7D9029\">href</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;http://www.somebits.com/weblog/culture/travel/london-and-portugal.html&quot;</span>&gt;\n",
" London and Portugal\n",
" &lt;/<span style=\"color: #008000; font-weight: bold\">a</span>&gt;\n",
"&lt;/<span style=\"color: #008000; font-weight: bold\">div</span>&gt;\n",
"</pre></div>\n",
"<hr/>"
],
"text/plain": [
"<div class=\"btitle\"><a class=\"invisiblelink\" href=\"http://www.somebits.com/weblog/culture/travel/london-and-portugal.html\">London and Portugal</a></div>"
]
},
"metadata": {},
"output_type": "display_data"
},
{
"data": {
"text/html": [
"<table><tr><th>Index</th><th>Render</th><th>source</th></tr><tr><td>0</td><td><html><body><a href=\"https://storify.com/nelson/london\">Storify\n",
"collection from London</a></body></html></td><td><div class=\"highlight\" style=\"background: #f8f8f8\"><pre style=\"line-height: 125%\"><span></span>&lt;<span style=\"color: #008000; font-weight: bold\">a</span> <span style=\"color: #7D9029\">href</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;https://storify.com/nelson/london&quot;</span>&gt;\n",
" Storify\n",
"collection from London\n",
"&lt;/<span style=\"color: #008000; font-weight: bold\">a</span>&gt;\n",
"</pre></div>\n",
"</td></tr><tr><td>1</td><td><html><body><a href=\"https://storify.com/nelson/london-and-portugal\">Portugal</a></body></html></td><td><div class=\"highlight\" style=\"background: #f8f8f8\"><pre style=\"line-height: 125%\"><span></span>&lt;<span style=\"color: #008000; font-weight: bold\">a</span> <span style=\"color: #7D9029\">href</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;https://storify.com/nelson/london-and-portugal&quot;</span>&gt;\n",
" Portugal\n",
"&lt;/<span style=\"color: #008000; font-weight: bold\">a</span>&gt;\n",
"</pre></div>\n",
"</td></tr><tr><td>2</td><td><html><body><a href=\"https://storify.com/nelson/london\">London</a></body></html></td><td><div class=\"highlight\" style=\"background: #f8f8f8\"><pre style=\"line-height: 125%\"><span></span>&lt;<span style=\"color: #008000; font-weight: bold\">a</span> <span style=\"color: #7D9029\">href</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;https://storify.com/nelson/london&quot;</span>&gt;\n",
" London\n",
"&lt;/<span style=\"color: #008000; font-weight: bold\">a</span>&gt;\n",
"</pre></div>\n",
"</td></tr><tr><td>3</td><td><html><body><a href=\"https://twitter.com/nelson/status/859026671286005766\">Enlightenment\n",
"Room</a></body></html></td><td><div class=\"highlight\" style=\"background: #f8f8f8\"><pre style=\"line-height: 125%\"><span></span>&lt;<span style=\"color: #008000; font-weight: bold\">a</span> <span style=\"color: #7D9029\">href</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;https://twitter.com/nelson/status/859026671286005766&quot;</span>&gt;\n",
" Enlightenment\n",
"Room\n",
"&lt;/<span style=\"color: #008000; font-weight: bold\">a</span>&gt;\n",
"</pre></div>\n",
"</td></tr><tr><td>4</td><td><html><body><a href=\"https://www.theguardian.com/artanddesign/2003/dec/13/heritage.art\">perfectly\n",
"captures</a></body></html></td><td><div class=\"highlight\" style=\"background: #f8f8f8\"><pre style=\"line-height: 125%\"><span></span>&lt;<span style=\"color: #008000; font-weight: bold\">a</span> <span style=\"color: #7D9029\">href</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;https://www.theguardian.com/artanddesign/2003/dec/13/heritage.art&quot;</span>&gt;\n",
" perfectly\n",
"captures\n",
"&lt;/<span style=\"color: #008000; font-weight: bold\">a</span>&gt;\n",
"</pre></div>\n",
"</td></tr><tr><td>5</td><td><html><body><a href=\"http://www.bshs.org.uk/travel-guide/the-enlightenment-gallery-british-museum-london\">optimistic\n",
"spirit</a></body></html></td><td><div class=\"highlight\" style=\"background: #f8f8f8\"><pre style=\"line-height: 125%\"><span></span>&lt;<span style=\"color: #008000; font-weight: bold\">a</span> <span style=\"color: #7D9029\">href</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;http://www.bshs.org.uk/travel-guide/the-enlightenment-gallery-british-museum-london&quot;</span>&gt;\n",
" optimistic\n",
"spirit\n",
"&lt;/<span style=\"color: #008000; font-weight: bold\">a</span>&gt;\n",
"</pre></div>\n",
"</td></tr><tr><td>6</td><td><html><body><a href=\"http://www.britishmuseum.org/visiting/galleries/middle_east/room_6_assyrian_sculpture.aspx\">Assyrian\n",
"galleries</a></body></html></td><td><div class=\"highlight\" style=\"background: #f8f8f8\"><pre style=\"line-height: 125%\"><span></span>&lt;<span style=\"color: #008000; font-weight: bold\">a</span> <span style=\"color: #7D9029\">href</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;http://www.britishmuseum.org/visiting/galleries/middle_east/room_6_assyrian_sculpture.aspx&quot;</span>&gt;\n",
" Assyrian\n",
"galleries\n",
"&lt;/<span style=\"color: #008000; font-weight: bold\">a</span>&gt;\n",
"</pre></div>\n",
"</td></tr><tr><td>7</td><td><html><body><a href=\"https://twitter.com/nelson/status/859734347192119297\">Aztec\n",
"masks</a></body></html></td><td><div class=\"highlight\" style=\"background: #f8f8f8\"><pre style=\"line-height: 125%\"><span></span>&lt;<span style=\"color: #008000; font-weight: bold\">a</span> <span style=\"color: #7D9029\">href</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;https://twitter.com/nelson/status/859734347192119297&quot;</span>&gt;\n",
" Aztec\n",
"masks\n",
"&lt;/<span style=\"color: #008000; font-weight: bold\">a</span>&gt;\n",
"</pre></div>\n",
"</td></tr><tr><td>8</td><td><html><body><a href=\"https://twitter.com/nelson/status/863043401956167680\">Porto</a></body></html></td><td><div class=\"highlight\" style=\"background: #f8f8f8\"><pre style=\"line-height: 125%\"><span></span>&lt;<span style=\"color: #008000; font-weight: bold\">a</span> <span style=\"color: #7D9029\">href</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;https://twitter.com/nelson/status/863043401956167680&quot;</span>&gt;\n",
" Porto\n",
"&lt;/<span style=\"color: #008000; font-weight: bold\">a</span>&gt;\n",
"</pre></div>\n",
"</td></tr><tr><td>9</td><td><html><body><a href=\"https://twitter.com/nelson/status/863036723961356290\">azulejo</a></body></html></td><td><div class=\"highlight\" style=\"background: #f8f8f8\"><pre style=\"line-height: 125%\"><span></span>&lt;<span style=\"color: #008000; font-weight: bold\">a</span> <span style=\"color: #7D9029\">href</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;https://twitter.com/nelson/status/863036723961356290&quot;</span>&gt;\n",
" azulejo\n",
"&lt;/<span style=\"color: #008000; font-weight: bold\">a</span>&gt;\n",
"</pre></div>\n",
"</td></tr></table>"
],
"text/plain": [
"[<a href=\"https://storify.com/nelson/london\">Storify\n",
"collection from London</a>, <a href=\"https://storify.com/nelson/london-and-portugal\">Portugal</a>, <a href=\"https://storify.com/nelson/london\">London</a>, <a href=\"https://twitter.com/nelson/status/859026671286005766\">Enlightenment\n",
"Room</a>, <a href=\"https://www.theguardian.com/artanddesign/2003/dec/13/heritage.art\">perfectly\n",
"captures</a>, <a href=\"http://www.bshs.org.uk/travel-guide/the-enlightenment-gallery-british-museum-london\">optimistic\n",
"spirit</a>, <a href=\"http://www.britishmuseum.org/visiting/galleries/middle_east/room_6_assyrian_sculpture.aspx\">Assyrian\n",
"galleries</a>, <a href=\"https://twitter.com/nelson/status/859734347192119297\">Aztec\n",
"masks</a>, <a href=\"https://twitter.com/nelson/status/863043401956167680\">Porto</a>, <a href=\"https://twitter.com/nelson/status/863036723961356290\">azulejo</a>]"
]
},
"metadata": {},
"output_type": "display_data"
},
{
"data": {
"text/html": [
"<html><body><div class=\"btitle\"><a class=\"invisiblelink\" href=\"http://www.somebits.com/weblog/life/prescription-drug-prices-goodrx-blink.html\">Prescription drug prices</a></div></body></html><hr/><div class=\"highlight\" style=\"background: #f8f8f8\"><pre style=\"line-height: 125%\"><span></span>&lt;<span style=\"color: #008000; font-weight: bold\">div</span> <span style=\"color: #7D9029\">class</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;btitle&quot;</span>&gt;\n",
" &lt;<span style=\"color: #008000; font-weight: bold\">a</span> <span style=\"color: #7D9029\">class</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;invisiblelink&quot;</span> <span style=\"color: #7D9029\">href</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;http://www.somebits.com/weblog/life/prescription-drug-prices-goodrx-blink.html&quot;</span>&gt;\n",
" Prescription drug prices\n",
" &lt;/<span style=\"color: #008000; font-weight: bold\">a</span>&gt;\n",
"&lt;/<span style=\"color: #008000; font-weight: bold\">div</span>&gt;\n",
"</pre></div>\n",
"<hr/>"
],
"text/plain": [
"<div class=\"btitle\"><a class=\"invisiblelink\" href=\"http://www.somebits.com/weblog/life/prescription-drug-prices-goodrx-blink.html\">Prescription drug prices</a></div>"
]
},
"metadata": {},
"output_type": "display_data"
},
{
"data": {
"text/html": [
"<table><tr><th>Index</th><th>Render</th><th>source</th></tr><tr><td>0</td><td><html><body><a href=\"https://www.goodrx.com/\">GoodRx</a></body></html></td><td><div class=\"highlight\" style=\"background: #f8f8f8\"><pre style=\"line-height: 125%\"><span></span>&lt;<span style=\"color: #008000; font-weight: bold\">a</span> <span style=\"color: #7D9029\">href</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;https://www.goodrx.com/&quot;</span>&gt;\n",
" GoodRx\n",
"&lt;/<span style=\"color: #008000; font-weight: bold\">a</span>&gt;\n",
"</pre></div>\n",
"</td></tr><tr><td>1</td><td><html><body><a href=\"https://www.goodrx.com/blog/how-does-drug-pricing-work/\">an\n",
"article explaining how it works</a></body></html></td><td><div class=\"highlight\" style=\"background: #f8f8f8\"><pre style=\"line-height: 125%\"><span></span>&lt;<span style=\"color: #008000; font-weight: bold\">a</span> <span style=\"color: #7D9029\">href</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;https://www.goodrx.com/blog/how-does-drug-pricing-work/&quot;</span>&gt;\n",
" an\n",
"article explaining how it works\n",
"&lt;/<span style=\"color: #008000; font-weight: bold\">a</span>&gt;\n",
"</pre></div>\n",
"</td></tr><tr><td>2</td><td><html><body><a href=\"https://en.wikipedia.org/wiki/Pharmacy_benefit_management\">Pharmacy\n",
"Benefit Managers</a></body></html></td><td><div class=\"highlight\" style=\"background: #f8f8f8\"><pre style=\"line-height: 125%\"><span></span>&lt;<span style=\"color: #008000; font-weight: bold\">a</span> <span style=\"color: #7D9029\">href</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;https://en.wikipedia.org/wiki/Pharmacy_benefit_management&quot;</span>&gt;\n",
" Pharmacy\n",
"Benefit Managers\n",
"&lt;/<span style=\"color: #008000; font-weight: bold\">a</span>&gt;\n",
"</pre></div>\n",
"</td></tr><tr><td>3</td><td><html><body><a href=\"http://www.ejovi.net/goodrx-make-money/\">GoodRx gets\n",
"a kickback</a></body></html></td><td><div class=\"highlight\" style=\"background: #f8f8f8\"><pre style=\"line-height: 125%\"><span></span>&lt;<span style=\"color: #008000; font-weight: bold\">a</span> <span style=\"color: #7D9029\">href</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;http://www.ejovi.net/goodrx-make-money/&quot;</span>&gt;\n",
" GoodRx gets\n",
"a kickback\n",
"&lt;/<span style=\"color: #008000; font-weight: bold\">a</span>&gt;\n",
"</pre></div>\n",
"</td></tr><tr><td>4</td><td><html><body><a href=\"https://www.blinkhealth.com/\">Blink Health</a></body></html></td><td><div class=\"highlight\" style=\"background: #f8f8f8\"><pre style=\"line-height: 125%\"><span></span>&lt;<span style=\"color: #008000; font-weight: bold\">a</span> <span style=\"color: #7D9029\">href</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;https://www.blinkhealth.com/&quot;</span>&gt;\n",
" Blink Health\n",
"&lt;/<span style=\"color: #008000; font-weight: bold\">a</span>&gt;\n",
"</pre></div>\n",
"</td></tr><tr><td>5</td><td><html><body><a href=\"https://blinkhealth.zendesk.com/hc/en-us/articles/209438505-How-does-Blink-offer-these-prices-\">operate\n",
"similarly</a></body></html></td><td><div class=\"highlight\" style=\"background: #f8f8f8\"><pre style=\"line-height: 125%\"><span></span>&lt;<span style=\"color: #008000; font-weight: bold\">a</span> <span style=\"color: #7D9029\">href</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;https://blinkhealth.zendesk.com/hc/en-us/articles/209438505-How-does-Blink-offer-these-prices-&quot;</span>&gt;\n",
" operate\n",
"similarly\n",
"&lt;/<span style=\"color: #008000; font-weight: bold\">a</span>&gt;\n",
"</pre></div>\n",
"</td></tr><tr><td>6</td><td><html><body><a href=\"https://ourworldindata.org/the-link-between-life-expectancy-and-health-spending-us-focus\">pay\n",
"more for worse outcomes</a></body></html></td><td><div class=\"highlight\" style=\"background: #f8f8f8\"><pre style=\"line-height: 125%\"><span></span>&lt;<span style=\"color: #008000; font-weight: bold\">a</span> <span style=\"color: #7D9029\">href</span><span style=\"color: #666666\">=</span><span style=\"color: #BA2121\">&quot;https://ourworldindata.org/the-link-between-life-expectancy-and-health-spending-us-focus&quot;</span>&gt;\n",
" pay\n",
"more for worse outcomes\n",
"&lt;/<span style=\"color: #008000; font-weight: bold\">a</span>&gt;\n",
"</pre></div>\n",
"</td></tr></table>"
],
"text/plain": [
"[<a href=\"https://www.goodrx.com/\">GoodRx</a>, <a href=\"https://www.goodrx.com/blog/how-does-drug-pricing-work/\">an\n",
"article explaining how it works</a>, <a href=\"https://en.wikipedia.org/wiki/Pharmacy_benefit_management\">Pharmacy\n",
"Benefit Managers</a>, <a href=\"http://www.ejovi.net/goodrx-make-money/\">GoodRx gets\n",
"a kickback</a>, <a href=\"https://www.blinkhealth.com/\">Blink Health</a>, <a href=\"https://blinkhealth.zendesk.com/hc/en-us/articles/209438505-How-does-Blink-offer-these-prices-\">operate\n",
"similarly</a>, <a href=\"https://ourworldindata.org/the-link-between-life-expectancy-and-health-spending-us-focus\">pay\n",
"more for worse outcomes</a>]"
]
},
"metadata": {},
"output_type": "display_data"
}
],
"source": [
"for bbox in soup.find_all('div', class_='bbox'):\n",
" display(bbox.div)\n",
" display(bbox.find('div', class_='bentry').find_all('a'))\n"
]
}
],
"metadata": {
"kernelspec": {
"display_name": "Python 3",
"language": "python",
"name": "python3"
},
"language_info": {
"codemirror_mode": {
"name": "ipython",
"version": 3
},
"file_extension": ".py",
"mimetype": "text/x-python",
"name": "python",
"nbconvert_exporter": "python",
"pygments_lexer": "ipython3",
"version": "3.6.3"
}
},
"nbformat": 4,
"nbformat_minor": 2
}
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment