Skip to content

Instantly share code, notes, and snippets.

@ASTalleruphuus ASTalleruphuus/Sitemaps
Last active Sep 27, 2019

Embed
What would you like to do?
Does research in science communication go hand in hand with the increased requirements of researchers’ outreach efforts?
Scraping SAGE using webscraper.io:
{"_id":"sagepub1","startUrl":["https://journals.sagepub.com/loi/scx?year=[1979-2019]"],"selectors":[{"id":"issue-link","type":"SelectorLink","parentSelectors":["_root"],"selector":"h6 a","multiple":true,"delay":0},{"id":"article-wrapper","type":"SelectorElement","parentSelectors":["issue-link"],"selector":".articleEntry td:nth-of-type(3)","multiple":true,"delay":0},{"id":"title","type":"SelectorText","parentSelectors":["article-wrapper"],"selector":"h3","multiple":false,"regex":"","delay":0},{"id":"date","type":"SelectorText","parentSelectors":["article-wrapper"],"selector":"span.maintextleft","multiple":false,"regex":"","delay":0},{"id":"article-link","type":"SelectorLink","parentSelectors":["article-wrapper"],"selector":".art_title a","multiple":false,"delay":0},{"id":"author","type":"SelectorGroup","parentSelectors":["article-link"],"selector":".no-aff a","delay":0,"extractAttribute":""},{"id":"university","type":"SelectorGroup","parentSelectors":["article-link"],"selector":"div.artice-info-affiliation","delay":0,"extractAttribute":""},{"id":"type","type":"SelectorText","parentSelectors":["article-link"],"selector":".ArticleType span","multiple":false,"regex":"","delay":0}]}
Scraping JCOM using webscraper.io:
{"_id":"jcom","startUrl":["https://jcom.sissa.it/archive"],"selectors":[{"id":"issue-link","type":"SelectorLink","parentSelectors":["_root"],"selector":".field-content a","multiple":true,"delay":0},{"id":"article-wrapper","type":"SelectorElement","parentSelectors":["issue-link"],"selector":"div.views-row","multiple":true,"delay":0},{"id":"date","type":"SelectorText","parentSelectors":["article-wrapper"],"selector":"span","multiple":false,"regex":"","delay":0},{"id":"authors","type":"SelectorGroup","parentSelectors":["article-wrapper"],"selector":".views-field-field-authors div","delay":0,"extractAttribute":""},{"id":"title","type":"SelectorText","parentSelectors":["article-wrapper"],"selector":".node-title a","multiple":false,"regex":"","delay":0},{"id":"type","type":"SelectorText","parentSelectors":["article-wrapper"],"selector":".views-field-field-type a","multiple":false,"regex":"","delay":0}]}
@ASTalleruphuus

This comment has been minimized.

Copy link
Owner Author

ASTalleruphuus commented Sep 27, 2019

SAGE author network:
full_network

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
You can’t perform that action at this time.