Skip to content

Instantly share code, notes, and snippets.

/arXiv-API.ipynb

Created March 9, 2018 05:28
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save anonymous/0a8de8a04f5fb300c1ada303c435c845 to your computer and use it in GitHub Desktop.
Save anonymous/0a8de8a04f5fb300c1ada303c435c845 to your computer and use it in GitHub Desktop.
Download ZIP
arXiv-API
Display the source blob
Display the rendered blob
Raw
arXiv-API.ipynb
{
"cells": [
{
"metadata": {
"toc": true
},
"cell_type": "markdown",
"source": "<h1>Table of Contents<span class=\"tocSkip\"></span></h1>\n<div class=\"toc\"><ul class=\"toc-item\"></ul></div>"
},
{
"metadata": {
"trusted": true
},
"cell_type": "code",
"source": "import arxiv",
"execution_count": 1,
"outputs": []
},
{
"metadata": {
"trusted": true
},
"cell_type": "code",
"source": "subject = \"computer science\"\nn = 10000\nobj = arxiv.query(search_query = subject, max_results = n)",
"execution_count": 32,
"outputs": []
},
{
"metadata": {
"trusted": true
},
"cell_type": "code",
"source": "import pandas as pd\ndf = pd.DataFrame(obj)",
"execution_count": 33,
"outputs": []
},
{
"metadata": {
"trusted": true,
"scrolled": true
},
"cell_type": "code",
"source": "df.head()",
"execution_count": 34,
"outputs": [
{
"output_type": "execute_result",
"execution_count": 34,
"data": {
"text/plain": " affiliation \\\n0 None \n1 None \n2 University of Zagreb \n3 Department of Computer Science, University of ... \n4 None \n\n arxiv_comment \\\n0 None \n1 None \n2 None \n3 To appear in special issue on best papers of C... \n4 appears in LMCS (Logical Methods in Computer S... \n\n arxiv_primary_category \\\n0 {'term': 'cs.LO', 'scheme': 'http://arxiv.org/... \n1 {'term': 'cs.LO', 'scheme': 'http://arxiv.org/... \n2 {'term': 'cs.LO', 'scheme': 'http://arxiv.org/... \n3 {'term': 'cs.LO', 'scheme': 'http://arxiv.org/... \n4 {'term': 'cs.LO', 'scheme': 'http://arxiv.org/... \n\n arxiv_url author \\\n0 http://arxiv.org/abs/1802.03292v1 Assaf Kfoury \n1 http://arxiv.org/abs/1612.04037v1 Adam Rambousek \n2 http://arxiv.org/abs/1310.7911v2 Zvonko Iljazovic \n3 http://arxiv.org/abs/1309.0717v2 Reiner Hüchting \n4 http://arxiv.org/abs/0907.3804v3 Colin Stirling \n\n author_detail \\\n0 {'name': 'Assaf Kfoury'} \n1 {'name': 'Adam Rambousek'} \n2 {'name': 'Zvonko Iljazovic'} \n3 {'name': 'Reiner Hüchting'} \n4 {'name': 'Colin Stirling'} \n\n authors \\\n0 [Assaf Kfoury] \n1 [Jan Bouda, Lukáš Holík, Jan Kofroň, Jan Strej... \n2 [Zvonko Iljazovic] \n3 [Victor Khomenko, Roland Meyer, Reiner Hüchting] \n4 [Colin Stirling] \n\n doi guidislink id \\\n0 None True http://arxiv.org/abs/1802.03292v1 \n1 10.4204/EPTCS.233 True http://arxiv.org/abs/1612.04037v1 \n2 10.2168/LMCS-9(4:19)2013 True http://arxiv.org/abs/1310.7911v2 \n3 10.2168/LMCS-9(3:18)2013 True http://arxiv.org/abs/1309.0717v2 \n4 10.2168/LMCS-5(3:2)2009 True http://arxiv.org/abs/0907.3804v3 \n\n ... pdf_url \\\n0 ... http://arxiv.org/pdf/1802.03292v1 \n1 ... http://arxiv.org/pdf/1612.04037v1 \n2 ... http://arxiv.org/pdf/1310.7911v2 \n3 ... http://arxiv.org/pdf/1309.0717v2 \n4 ... http://arxiv.org/pdf/0907.3804v3 \n\n published published_parsed \\\n0 2018-02-07T22:21:43Z (2018, 2, 7, 22, 21, 43, 2, 38, 0) \n1 2016-12-13T05:47:19Z (2016, 12, 13, 5, 47, 19, 1, 348, 0) \n2 2013-10-29T18:29:13Z (2013, 10, 29, 18, 29, 13, 1, 302, 0) \n3 2013-09-03T15:08:39Z (2013, 9, 3, 15, 8, 39, 1, 246, 0) \n4 2009-07-22T09:17:30Z (2009, 7, 22, 9, 17, 30, 2, 203, 0) \n\n summary \\\n0 The article retraces major events and mileston... \n1 MEMICS provides a forum for doctoral students ... \n2 We investigate conditions under which a co-com... \n3 We develop a polynomial translation from finit... \n4 We show that the higher-order matching problem... \n\n summary_detail \\\n0 {'type': 'text/plain', 'language': None, 'base... \n1 {'type': 'text/plain', 'language': None, 'base... \n2 {'type': 'text/plain', 'language': None, 'base... \n3 {'type': 'text/plain', 'language': None, 'base... \n4 {'type': 'text/plain', 'language': None, 'base... \n\n tags \\\n0 [{'term': 'cs.LO', 'scheme': 'http://arxiv.org... \n1 [{'term': 'cs.LO', 'scheme': 'http://arxiv.org... \n2 [{'term': 'cs.LO', 'scheme': 'http://arxiv.org... \n3 [{'term': 'cs.LO', 'scheme': 'http://arxiv.org... \n4 [{'term': 'cs.LO', 'scheme': 'http://arxiv.org... \n\n title \\\n0 Mathematical Logic in Computer Science \n1 Proceedings 11th Doctoral Workshop on Mathemat... \n2 Compact manifolds with computable boundaries \n3 A Polynomial Translation of pi-calculus FCPs t... \n4 Decidability of higher-order matching \n\n title_detail updated \\\n0 {'type': 'text/plain', 'language': None, 'base... 2018-02-07T22:21:43Z \n1 {'type': 'text/plain', 'language': None, 'base... 2016-12-13T05:47:19Z \n2 {'type': 'text/plain', 'language': None, 'base... 2013-12-09T21:56:24Z \n3 {'type': 'text/plain', 'language': None, 'base... 2013-09-16T15:13:26Z \n4 {'type': 'text/plain', 'language': None, 'base... 2009-07-31T11:37:46Z \n\n updated_parsed \n0 (2018, 2, 7, 22, 21, 43, 2, 38, 0) \n1 (2016, 12, 13, 5, 47, 19, 1, 348, 0) \n2 (2013, 12, 9, 21, 56, 24, 0, 343, 0) \n3 (2013, 9, 16, 15, 13, 26, 0, 259, 0) \n4 (2009, 7, 31, 11, 37, 46, 4, 212, 0) \n\n[5 rows x 22 columns]",
"text/html": "<div>\n<style scoped>\n .dataframe tbody tr th:only-of-type {\n vertical-align: middle;\n }\n\n .dataframe tbody tr th {\n vertical-align: top;\n }\n\n .dataframe thead th {\n text-align: right;\n }\n</style>\n<table border=\"1\" class=\"dataframe\">\n <thead>\n <tr style=\"text-align: right;\">\n <th></th>\n <th>affiliation</th>\n <th>arxiv_comment</th>\n <th>arxiv_primary_category</th>\n <th>arxiv_url</th>\n <th>author</th>\n <th>author_detail</th>\n <th>authors</th>\n <th>doi</th>\n <th>guidislink</th>\n <th>id</th>\n <th>...</th>\n <th>pdf_url</th>\n <th>published</th>\n <th>published_parsed</th>\n <th>summary</th>\n <th>summary_detail</th>\n <th>tags</th>\n <th>title</th>\n <th>title_detail</th>\n <th>updated</th>\n <th>updated_parsed</th>\n </tr>\n </thead>\n <tbody>\n <tr>\n <th>0</th>\n <td>None</td>\n <td>None</td>\n <td>{'term': 'cs.LO', 'scheme': 'http://arxiv.org/...</td>\n <td>http://arxiv.org/abs/1802.03292v1</td>\n <td>Assaf Kfoury</td>\n <td>{'name': 'Assaf Kfoury'}</td>\n <td>[Assaf Kfoury]</td>\n <td>None</td>\n <td>True</td>\n <td>http://arxiv.org/abs/1802.03292v1</td>\n <td>...</td>\n <td>http://arxiv.org/pdf/1802.03292v1</td>\n <td>2018-02-07T22:21:43Z</td>\n <td>(2018, 2, 7, 22, 21, 43, 2, 38, 0)</td>\n <td>The article retraces major events and mileston...</td>\n <td>{'type': 'text/plain', 'language': None, 'base...</td>\n <td>[{'term': 'cs.LO', 'scheme': 'http://arxiv.org...</td>\n <td>Mathematical Logic in Computer Science</td>\n <td>{'type': 'text/plain', 'language': None, 'base...</td>\n <td>2018-02-07T22:21:43Z</td>\n <td>(2018, 2, 7, 22, 21, 43, 2, 38, 0)</td>\n </tr>\n <tr>\n <th>1</th>\n <td>None</td>\n <td>None</td>\n <td>{'term': 'cs.LO', 'scheme': 'http://arxiv.org/...</td>\n <td>http://arxiv.org/abs/1612.04037v1</td>\n <td>Adam Rambousek</td>\n <td>{'name': 'Adam Rambousek'}</td>\n <td>[Jan Bouda, Lukáš Holík, Jan Kofroň, Jan Strej...</td>\n <td>10.4204/EPTCS.233</td>\n <td>True</td>\n <td>http://arxiv.org/abs/1612.04037v1</td>\n <td>...</td>\n <td>http://arxiv.org/pdf/1612.04037v1</td>\n <td>2016-12-13T05:47:19Z</td>\n <td>(2016, 12, 13, 5, 47, 19, 1, 348, 0)</td>\n <td>MEMICS provides a forum for doctoral students ...</td>\n <td>{'type': 'text/plain', 'language': None, 'base...</td>\n <td>[{'term': 'cs.LO', 'scheme': 'http://arxiv.org...</td>\n <td>Proceedings 11th Doctoral Workshop on Mathemat...</td>\n <td>{'type': 'text/plain', 'language': None, 'base...</td>\n <td>2016-12-13T05:47:19Z</td>\n <td>(2016, 12, 13, 5, 47, 19, 1, 348, 0)</td>\n </tr>\n <tr>\n <th>2</th>\n <td>University of Zagreb</td>\n <td>None</td>\n <td>{'term': 'cs.LO', 'scheme': 'http://arxiv.org/...</td>\n <td>http://arxiv.org/abs/1310.7911v2</td>\n <td>Zvonko Iljazovic</td>\n <td>{'name': 'Zvonko Iljazovic'}</td>\n <td>[Zvonko Iljazovic]</td>\n <td>10.2168/LMCS-9(4:19)2013</td>\n <td>True</td>\n <td>http://arxiv.org/abs/1310.7911v2</td>\n <td>...</td>\n <td>http://arxiv.org/pdf/1310.7911v2</td>\n <td>2013-10-29T18:29:13Z</td>\n <td>(2013, 10, 29, 18, 29, 13, 1, 302, 0)</td>\n <td>We investigate conditions under which a co-com...</td>\n <td>{'type': 'text/plain', 'language': None, 'base...</td>\n <td>[{'term': 'cs.LO', 'scheme': 'http://arxiv.org...</td>\n <td>Compact manifolds with computable boundaries</td>\n <td>{'type': 'text/plain', 'language': None, 'base...</td>\n <td>2013-12-09T21:56:24Z</td>\n <td>(2013, 12, 9, 21, 56, 24, 0, 343, 0)</td>\n </tr>\n <tr>\n <th>3</th>\n <td>Department of Computer Science, University of ...</td>\n <td>To appear in special issue on best papers of C...</td>\n <td>{'term': 'cs.LO', 'scheme': 'http://arxiv.org/...</td>\n <td>http://arxiv.org/abs/1309.0717v2</td>\n <td>Reiner Hüchting</td>\n <td>{'name': 'Reiner Hüchting'}</td>\n <td>[Victor Khomenko, Roland Meyer, Reiner Hüchting]</td>\n <td>10.2168/LMCS-9(3:18)2013</td>\n <td>True</td>\n <td>http://arxiv.org/abs/1309.0717v2</td>\n <td>...</td>\n <td>http://arxiv.org/pdf/1309.0717v2</td>\n <td>2013-09-03T15:08:39Z</td>\n <td>(2013, 9, 3, 15, 8, 39, 1, 246, 0)</td>\n <td>We develop a polynomial translation from finit...</td>\n <td>{'type': 'text/plain', 'language': None, 'base...</td>\n <td>[{'term': 'cs.LO', 'scheme': 'http://arxiv.org...</td>\n <td>A Polynomial Translation of pi-calculus FCPs t...</td>\n <td>{'type': 'text/plain', 'language': None, 'base...</td>\n <td>2013-09-16T15:13:26Z</td>\n <td>(2013, 9, 16, 15, 13, 26, 0, 259, 0)</td>\n </tr>\n <tr>\n <th>4</th>\n <td>None</td>\n <td>appears in LMCS (Logical Methods in Computer S...</td>\n <td>{'term': 'cs.LO', 'scheme': 'http://arxiv.org/...</td>\n <td>http://arxiv.org/abs/0907.3804v3</td>\n <td>Colin Stirling</td>\n <td>{'name': 'Colin Stirling'}</td>\n <td>[Colin Stirling]</td>\n <td>10.2168/LMCS-5(3:2)2009</td>\n <td>True</td>\n <td>http://arxiv.org/abs/0907.3804v3</td>\n <td>...</td>\n <td>http://arxiv.org/pdf/0907.3804v3</td>\n <td>2009-07-22T09:17:30Z</td>\n <td>(2009, 7, 22, 9, 17, 30, 2, 203, 0)</td>\n <td>We show that the higher-order matching problem...</td>\n <td>{'type': 'text/plain', 'language': None, 'base...</td>\n <td>[{'term': 'cs.LO', 'scheme': 'http://arxiv.org...</td>\n <td>Decidability of higher-order matching</td>\n <td>{'type': 'text/plain', 'language': None, 'base...</td>\n <td>2009-07-31T11:37:46Z</td>\n <td>(2009, 7, 31, 11, 37, 46, 4, 212, 0)</td>\n </tr>\n </tbody>\n</table>\n<p>5 rows × 22 columns</p>\n</div>"
},
"metadata": {}
}
]
},
{
"metadata": {
"trusted": true
},
"cell_type": "code",
"source": "len(df)",
"execution_count": 35,
"outputs": [
{
"output_type": "execute_result",
"execution_count": 35,
"data": {
"text/plain": "821"
},
"metadata": {}
}
]
},
{
"metadata": {
"trusted": true
},
"cell_type": "code",
"source": "df.tail()",
"execution_count": 36,
"outputs": [
{
"output_type": "execute_result",
"execution_count": 36,
"data": {
"text/plain": " affiliation arxiv_comment \\\n816 None None \n817 None Submitted version \n818 None Conference on Intelligent Computer Mathematics... \n819 None 25 pages, 3 figures \n820 None None \n\n arxiv_primary_category \\\n816 {'term': 'cs.LO', 'scheme': 'http://arxiv.org/... \n817 {'term': 'cs.NE', 'scheme': 'http://arxiv.org/... \n818 {'term': 'cs.MS', 'scheme': 'http://arxiv.org/... \n819 {'term': 'cs.CE', 'scheme': 'http://arxiv.org/... \n820 {'term': 'cs.DC', 'scheme': 'http://arxiv.org/... \n\n arxiv_url author \\\n816 http://arxiv.org/abs/cs/0501031v2 Giorgi Japaridze \n817 http://arxiv.org/abs/1705.02042v2 James B. Aimone \n818 http://arxiv.org/abs/1307.3088v1 Peter Murray-Rust \n819 http://arxiv.org/abs/1204.0267v2 Matthew G. Knepley \n820 http://arxiv.org/abs/1308.3648v1 Jesper Larsson Träff \n\n author_detail \\\n816 {'name': 'Giorgi Japaridze'} \n817 {'name': 'James B. Aimone'} \n818 {'name': 'Peter Murray-Rust'} \n819 {'name': 'Matthew G. Knepley'} \n820 {'name': 'Jesper Larsson Träff'} \n\n authors doi \\\n816 [Giorgi Japaridze] 10.1016/j.tcs.2007.01.004 \n817 [James B. Aimone] None \n818 [Dave Murray-Rust, Peter Murray-Rust] None \n819 [Jaydeep P. Bardhan, Matthew G. Knepley] 10.1088/1749-4699/5/1/014006 \n820 [Sascha Hunold, Jesper Larsson Träff] None \n\n guidislink id \\\n816 True http://arxiv.org/abs/cs/0501031v2 \n817 True http://arxiv.org/abs/1705.02042v2 \n818 True http://arxiv.org/abs/1307.3088v1 \n819 True http://arxiv.org/abs/1204.0267v2 \n820 True http://arxiv.org/abs/1308.3648v1 \n\n ... pdf_url \\\n816 ... http://arxiv.org/pdf/cs/0501031v2 \n817 ... http://arxiv.org/pdf/1705.02042v2 \n818 ... http://arxiv.org/pdf/1307.3088v1 \n819 ... http://arxiv.org/pdf/1204.0267v2 \n820 ... http://arxiv.org/pdf/1308.3648v1 \n\n published published_parsed \\\n816 2005-01-16T13:47:47Z (2005, 1, 16, 13, 47, 47, 6, 16, 0) \n817 2017-05-04T22:54:54Z (2017, 5, 4, 22, 54, 54, 3, 124, 0) \n818 2013-07-11T12:35:11Z (2013, 7, 11, 12, 35, 11, 3, 192, 0) \n819 2012-04-01T21:23:23Z (2012, 4, 1, 21, 23, 23, 6, 92, 0) \n820 2013-08-16T15:11:35Z (2013, 8, 16, 15, 11, 35, 4, 228, 0) \n\n summary \\\n816 Computability logic is a formal theory of comp... \n817 Although the brain has long been considered a ... \n818 We introduce the Declaratron, a system which t... \n819 We present two open-source (BSD) implementatio... \n820 Computer science is also an experimental scien... \n\n summary_detail \\\n816 {'type': 'text/plain', 'language': None, 'base... \n817 {'type': 'text/plain', 'language': None, 'base... \n818 {'type': 'text/plain', 'language': None, 'base... \n819 {'type': 'text/plain', 'language': None, 'base... \n820 {'type': 'text/plain', 'language': None, 'base... \n\n tags \\\n816 [{'term': 'cs.LO', 'scheme': 'http://arxiv.org... \n817 [{'term': 'cs.NE', 'scheme': 'http://arxiv.org... \n818 [{'term': 'cs.MS', 'scheme': 'http://arxiv.org... \n819 [{'term': 'cs.CE', 'scheme': 'http://arxiv.org... \n820 [{'term': 'cs.DC', 'scheme': 'http://arxiv.org... \n\n title \\\n816 From truth to computability II \n817 Exponential scaling of neural algorithms - a f... \n818 The Declaratron, semantic specification for sc... \n819 Computational science and re-discovery: open-s... \n820 On the State and Importance of Reproducible Ex... \n\n title_detail updated \\\n816 {'type': 'text/plain', 'language': None, 'base... 2005-07-20T01:08:25Z \n817 {'type': 'text/plain', 'language': None, 'base... 2017-07-13T14:37:34Z \n818 {'type': 'text/plain', 'language': None, 'base... 2013-07-11T12:35:11Z \n819 {'type': 'text/plain', 'language': None, 'base... 2012-04-03T17:14:51Z \n820 {'type': 'text/plain', 'language': None, 'base... 2013-08-16T15:11:35Z \n\n updated_parsed \n816 (2005, 7, 20, 1, 8, 25, 2, 201, 0) \n817 (2017, 7, 13, 14, 37, 34, 3, 194, 0) \n818 (2013, 7, 11, 12, 35, 11, 3, 192, 0) \n819 (2012, 4, 3, 17, 14, 51, 1, 94, 0) \n820 (2013, 8, 16, 15, 11, 35, 4, 228, 0) \n\n[5 rows x 22 columns]",
"text/html": "<div>\n<style scoped>\n .dataframe tbody tr th:only-of-type {\n vertical-align: middle;\n }\n\n .dataframe tbody tr th {\n vertical-align: top;\n }\n\n .dataframe thead th {\n text-align: right;\n }\n</style>\n<table border=\"1\" class=\"dataframe\">\n <thead>\n <tr style=\"text-align: right;\">\n <th></th>\n <th>affiliation</th>\n <th>arxiv_comment</th>\n <th>arxiv_primary_category</th>\n <th>arxiv_url</th>\n <th>author</th>\n <th>author_detail</th>\n <th>authors</th>\n <th>doi</th>\n <th>guidislink</th>\n <th>id</th>\n <th>...</th>\n <th>pdf_url</th>\n <th>published</th>\n <th>published_parsed</th>\n <th>summary</th>\n <th>summary_detail</th>\n <th>tags</th>\n <th>title</th>\n <th>title_detail</th>\n <th>updated</th>\n <th>updated_parsed</th>\n </tr>\n </thead>\n <tbody>\n <tr>\n <th>816</th>\n <td>None</td>\n <td>None</td>\n <td>{'term': 'cs.LO', 'scheme': 'http://arxiv.org/...</td>\n <td>http://arxiv.org/abs/cs/0501031v2</td>\n <td>Giorgi Japaridze</td>\n <td>{'name': 'Giorgi Japaridze'}</td>\n <td>[Giorgi Japaridze]</td>\n <td>10.1016/j.tcs.2007.01.004</td>\n <td>True</td>\n <td>http://arxiv.org/abs/cs/0501031v2</td>\n <td>...</td>\n <td>http://arxiv.org/pdf/cs/0501031v2</td>\n <td>2005-01-16T13:47:47Z</td>\n <td>(2005, 1, 16, 13, 47, 47, 6, 16, 0)</td>\n <td>Computability logic is a formal theory of comp...</td>\n <td>{'type': 'text/plain', 'language': None, 'base...</td>\n <td>[{'term': 'cs.LO', 'scheme': 'http://arxiv.org...</td>\n <td>From truth to computability II</td>\n <td>{'type': 'text/plain', 'language': None, 'base...</td>\n <td>2005-07-20T01:08:25Z</td>\n <td>(2005, 7, 20, 1, 8, 25, 2, 201, 0)</td>\n </tr>\n <tr>\n <th>817</th>\n <td>None</td>\n <td>Submitted version</td>\n <td>{'term': 'cs.NE', 'scheme': 'http://arxiv.org/...</td>\n <td>http://arxiv.org/abs/1705.02042v2</td>\n <td>James B. Aimone</td>\n <td>{'name': 'James B. Aimone'}</td>\n <td>[James B. Aimone]</td>\n <td>None</td>\n <td>True</td>\n <td>http://arxiv.org/abs/1705.02042v2</td>\n <td>...</td>\n <td>http://arxiv.org/pdf/1705.02042v2</td>\n <td>2017-05-04T22:54:54Z</td>\n <td>(2017, 5, 4, 22, 54, 54, 3, 124, 0)</td>\n <td>Although the brain has long been considered a ...</td>\n <td>{'type': 'text/plain', 'language': None, 'base...</td>\n <td>[{'term': 'cs.NE', 'scheme': 'http://arxiv.org...</td>\n <td>Exponential scaling of neural algorithms - a f...</td>\n <td>{'type': 'text/plain', 'language': None, 'base...</td>\n <td>2017-07-13T14:37:34Z</td>\n <td>(2017, 7, 13, 14, 37, 34, 3, 194, 0)</td>\n </tr>\n <tr>\n <th>818</th>\n <td>None</td>\n <td>Conference on Intelligent Computer Mathematics...</td>\n <td>{'term': 'cs.MS', 'scheme': 'http://arxiv.org/...</td>\n <td>http://arxiv.org/abs/1307.3088v1</td>\n <td>Peter Murray-Rust</td>\n <td>{'name': 'Peter Murray-Rust'}</td>\n <td>[Dave Murray-Rust, Peter Murray-Rust]</td>\n <td>None</td>\n <td>True</td>\n <td>http://arxiv.org/abs/1307.3088v1</td>\n <td>...</td>\n <td>http://arxiv.org/pdf/1307.3088v1</td>\n <td>2013-07-11T12:35:11Z</td>\n <td>(2013, 7, 11, 12, 35, 11, 3, 192, 0)</td>\n <td>We introduce the Declaratron, a system which t...</td>\n <td>{'type': 'text/plain', 'language': None, 'base...</td>\n <td>[{'term': 'cs.MS', 'scheme': 'http://arxiv.org...</td>\n <td>The Declaratron, semantic specification for sc...</td>\n <td>{'type': 'text/plain', 'language': None, 'base...</td>\n <td>2013-07-11T12:35:11Z</td>\n <td>(2013, 7, 11, 12, 35, 11, 3, 192, 0)</td>\n </tr>\n <tr>\n <th>819</th>\n <td>None</td>\n <td>25 pages, 3 figures</td>\n <td>{'term': 'cs.CE', 'scheme': 'http://arxiv.org/...</td>\n <td>http://arxiv.org/abs/1204.0267v2</td>\n <td>Matthew G. Knepley</td>\n <td>{'name': 'Matthew G. Knepley'}</td>\n <td>[Jaydeep P. Bardhan, Matthew G. Knepley]</td>\n <td>10.1088/1749-4699/5/1/014006</td>\n <td>True</td>\n <td>http://arxiv.org/abs/1204.0267v2</td>\n <td>...</td>\n <td>http://arxiv.org/pdf/1204.0267v2</td>\n <td>2012-04-01T21:23:23Z</td>\n <td>(2012, 4, 1, 21, 23, 23, 6, 92, 0)</td>\n <td>We present two open-source (BSD) implementatio...</td>\n <td>{'type': 'text/plain', 'language': None, 'base...</td>\n <td>[{'term': 'cs.CE', 'scheme': 'http://arxiv.org...</td>\n <td>Computational science and re-discovery: open-s...</td>\n <td>{'type': 'text/plain', 'language': None, 'base...</td>\n <td>2012-04-03T17:14:51Z</td>\n <td>(2012, 4, 3, 17, 14, 51, 1, 94, 0)</td>\n </tr>\n <tr>\n <th>820</th>\n <td>None</td>\n <td>None</td>\n <td>{'term': 'cs.DC', 'scheme': 'http://arxiv.org/...</td>\n <td>http://arxiv.org/abs/1308.3648v1</td>\n <td>Jesper Larsson Träff</td>\n <td>{'name': 'Jesper Larsson Träff'}</td>\n <td>[Sascha Hunold, Jesper Larsson Träff]</td>\n <td>None</td>\n <td>True</td>\n <td>http://arxiv.org/abs/1308.3648v1</td>\n <td>...</td>\n <td>http://arxiv.org/pdf/1308.3648v1</td>\n <td>2013-08-16T15:11:35Z</td>\n <td>(2013, 8, 16, 15, 11, 35, 4, 228, 0)</td>\n <td>Computer science is also an experimental scien...</td>\n <td>{'type': 'text/plain', 'language': None, 'base...</td>\n <td>[{'term': 'cs.DC', 'scheme': 'http://arxiv.org...</td>\n <td>On the State and Importance of Reproducible Ex...</td>\n <td>{'type': 'text/plain', 'language': None, 'base...</td>\n <td>2013-08-16T15:11:35Z</td>\n <td>(2013, 8, 16, 15, 11, 35, 4, 228, 0)</td>\n </tr>\n </tbody>\n</table>\n<p>5 rows × 22 columns</p>\n</div>"
},
"metadata": {}
}
]
},
{
"metadata": {
"trusted": true
},
"cell_type": "code",
"source": "df.shape",
"execution_count": 37,
"outputs": [
{
"output_type": "execute_result",
"execution_count": 37,
"data": {
"text/plain": "(821, 22)"
},
"metadata": {}
}
]
},
{
"metadata": {
"trusted": true
},
"cell_type": "code",
"source": "PATH='C://Users/sarad/Documents/fastai/courses/dl1/data/arxiv/'",
"execution_count": 38,
"outputs": []
},
{
"metadata": {
"trusted": true
},
"cell_type": "code",
"source": "df_s = df[['summary', 'title', \"arxiv_primary_category\"]]\n\ndf_s.to_csv(f'{PATH}arxiv_cs_cat1.csv')",
"execution_count": 40,
"outputs": []
},
{
"metadata": {
"trusted": true
},
"cell_type": "code",
"source": "",
"execution_count": null,
"outputs": []
}
],
"metadata": {
"kernelspec": {
"name": "python3",
"display_name": "Python 3",
"language": "python"
},
"toc": {
"nav_menu": {},
"number_sections": true,
"sideBar": true,
"skip_h1_title": false,
"title_cell": "Table of Contents",
"title_sidebar": "Contents",
"toc_cell": true,
"toc_position": {},
"toc_section_display": true,
"toc_window_display": false
},
"language_info": {
"name": "python",
"version": "3.6.4",
"mimetype": "text/x-python",
"codemirror_mode": {
"name": "ipython",
"version": 3
},
"pygments_lexer": "ipython3",
"nbconvert_exporter": "python",
"file_extension": ".py"
},
"gist": {
"id": "62a72b97999bc8699b3c5ff97b959edf",
"data": {
"description": "arXiv-API",
"public": true
}
},
"_draft": {
"nbviewer_url": "https://gist.github.com/62a72b97999bc8699b3c5ff97b959edf"
}
},
"nbformat": 4,
"nbformat_minor": 2
}
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment