Skip to content

Instantly share code, notes, and snippets.

@ASTalleruphuus
Last active September 27, 2019 10:36
Embed
What would you like to do?
Does research in science communication go hand in hand with the increased requirements of researchers’ outreach efforts?
Scraping SAGE using webscraper.io:
{"_id":"sagepub1","startUrl":["https://journals.sagepub.com/loi/scx?year=[1979-2019]"],"selectors":[{"id":"issue-link","type":"SelectorLink","parentSelectors":["_root"],"selector":"h6 a","multiple":true,"delay":0},{"id":"article-wrapper","type":"SelectorElement","parentSelectors":["issue-link"],"selector":".articleEntry td:nth-of-type(3)","multiple":true,"delay":0},{"id":"title","type":"SelectorText","parentSelectors":["article-wrapper"],"selector":"h3","multiple":false,"regex":"","delay":0},{"id":"date","type":"SelectorText","parentSelectors":["article-wrapper"],"selector":"span.maintextleft","multiple":false,"regex":"","delay":0},{"id":"article-link","type":"SelectorLink","parentSelectors":["article-wrapper"],"selector":".art_title a","multiple":false,"delay":0},{"id":"author","type":"SelectorGroup","parentSelectors":["article-link"],"selector":".no-aff a","delay":0,"extractAttribute":""},{"id":"university","type":"SelectorGroup","parentSelectors":["article-link"],"selector":"div.artice-info-affiliation","delay":0,"extractAttribute":""},{"id":"type","type":"SelectorText","parentSelectors":["article-link"],"selector":".ArticleType span","multiple":false,"regex":"","delay":0}]}
Scraping JCOM using webscraper.io:
{"_id":"jcom","startUrl":["https://jcom.sissa.it/archive"],"selectors":[{"id":"issue-link","type":"SelectorLink","parentSelectors":["_root"],"selector":".field-content a","multiple":true,"delay":0},{"id":"article-wrapper","type":"SelectorElement","parentSelectors":["issue-link"],"selector":"div.views-row","multiple":true,"delay":0},{"id":"date","type":"SelectorText","parentSelectors":["article-wrapper"],"selector":"span","multiple":false,"regex":"","delay":0},{"id":"authors","type":"SelectorGroup","parentSelectors":["article-wrapper"],"selector":".views-field-field-authors div","delay":0,"extractAttribute":""},{"id":"title","type":"SelectorText","parentSelectors":["article-wrapper"],"selector":".node-title a","multiple":false,"regex":"","delay":0},{"id":"type","type":"SelectorText","parentSelectors":["article-wrapper"],"selector":".views-field-field-type a","multiple":false,"regex":"","delay":0}]}
@ASTalleruphuus
Copy link
Author

ASTalleruphuus commented Sep 27, 2019

SAGE author network:
full_network

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment