Using Requests and Beautiful Soup, with the most recent Beautiful Soup 4 docs.
Install our tools (preferably in a new virtualenv):
pip install beautifulsoup4
Breno brenorb
bradmontgomery
/ ShortIntroToScraping.rst
Created
February 21, 2012 02:00
Really short intro to scraping with Beautiful Soup and Requests
gjreda
/ gist:7433f5f70299610d9b6b
Last active
April 11, 2023 16:23
pandas' read_csv parse_dates vs explicit date conversion
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| # When you're sure of the format, it's much quicker to explicitly convert your dates than use `parse_dates` | |
| # Makes sense; was just surprised by the time difference. | |
| import pandas as pd | |
| from datetime import datetime | |
| to_datetime = lambda d: datetime.strptime(d, '%m/%d/%Y %H:%M') | |
| %time trips = pd.read_csv('data/divvy/Divvy_Trips_2013.csv', parse_dates=['starttime', 'stoptime']) | |
| # CPU times: user 1min 29s, sys: 331 ms, total: 1min 29s | |
| # Wall time: 1min 30s |
Eeemil
/ _config.yml
Last active
July 10, 2022 16:40
Jekyll - adding edit on GitHub button to your site
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| # Site settings | |
| title: Emil Marklund's blog of digital magics | |
| email: eeemil@acc.umu.se | |
| description: > | |
| A blog on programming, GNU Linux/Unix and other things I might find interesting. | |
| I like to learn and teach and writing about what I learn is a great way to do both. | |
| This blog is running Jekyll | |
| baseurl: "" # the subpath of your site, e.g. /blog/ | |
| url: "http://eeemil.se" # the base hostname & protocol for your site | |
| twitter_username: eeemil_ |
zehsilva
/ animate-matplotlib-python.ipynb
Last active
March 24, 2022 18:24
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
tnakagawa
/ bipschnorr-Threshold.md
Last active
October 17, 2020 18:12
This text is a procedure for t-of-k threshold signatures.
The symbols and functions used are defined in the following URL.
https://github.com/sipa/bips/blob/bip-schnorr/bip-schnorr.mediawiki
zehsilva
/ when-will-geoff-hinton-become-most-cited-academic-based-on-google-scholar-data.ipynb
Last active
September 25, 2019 17:16
when will geoff hinton become most cited academic (based on google scholar data)
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
sammymwangangi
/ webdev_online_resources.md
Created
July 18, 2018 02:56
— forked from bradtraversy/webdev_online_resources.md
Online Resources For Web Developers (No Downloading)
- Text Content Generator - http://www.lipsum.com
- Favicon Generator - http://tools.dynamicdrive.com/favicon
- Data Generator - https://mockaroo.com/
- Mobile Mockup Generator - https://mockuphone.com
- Logo Generator - https://www.logaster.com
- UUID Generator - https://www.uuidgenerator.net/
- Hash Generator - https://passwordsgenerator.net/sha256-hash-generator/
NewerOlder