adapted from the article "Crawling anonymously with Tor in Python" by S. Acharya, Nov 2, 2013.
The most common use-case is to be able to hide one's identity using TOR or being able to change identities programmatically, for example when you are crawling a website like Google and you don’t want to be rate-limited or blocked via IP address.
Install Tor.
| # -*- coding: utf-8 -*- | |
| ''' | |
| Name: PyPubChemXtractor.py | |
| Author: Khepry Quixote | |
| Date: 11 Nov 2014 | |
| Language: Python 3.4 | |
| Narrative: | |
| This Python 3.4 program will extract CASRN values from PubChem's |
| # -*- coding: utf-8 -*- | |
| ''' | |
| This Python script is oriented towards oil, gas, and fracking well | |
| information download, extract, and output at the state-level within | |
| the United States of America. Not all states are present as not all | |
| states either allow fracking or have any sites available for download. | |
| This Python script is dependent upon another Python script entitled | |
| Src2Tgt.py, which is also available as a Gist under the same name. |
sudo apt-get install p7zip p7zip-fullsudo apt-get install nautilus-open-terminal
| # -*- coding: utf-8 -*- | |
| ''' | |
| This Python script is oriented towards oil, gas, and fracking well | |
| information download, extract, and output at the state-level within | |
| the United States of America. Not all states are present as not all | |
| states either allow fracking or have any sites available for download. | |
| This Python script is depended upon by another Python script entitled | |
| PyFrackETL.py, which is also available as a Gist under the same name. |