Cristian Calabro ccalabro
ratchetwrench
/ parallel-web-scraping.py
Created
August 15, 2017 23:42
speed up your python web scraper using multiprocessing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| import requests | |
| from bs4 import BeautifulSoup | |
| from time import sleep | |
| from multiprocessing import Pool | |
| def get_listing(url): | |
| headers = { | |
| 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_11_6) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/53.0.2785.143 Safari/537.36'} | |
| html = None |
devynspencer
/ ansible-github.yml
Last active
September 23, 2023 08:37
Example playbook for cloning a private git repository with Ansible.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| --- | |
| hosts: all | |
| tasks: | |
| - name: add github ssh key | |
| copy: > | |
| src=files/id_rsa.github | |
| dest=/root/.ssh/id_rsa.github | |
| owner=root | |
| group=root |