Skip to content

Instantly share code, notes, and snippets.

View willwillems's full-sized avatar
🌱
Working remotely

Will Willems willwillems

🌱
Working remotely
View GitHub Profile
@willwillems
willwillems / scraper.py
Last active February 18, 2017 11:27
Simple Python 3.5.2 Marktplaats scraping example with Beautiful Soup 4
import requests
import urllib.parse
import numpy as np
import matplotlib.pyplot as plt
from bs4 import BeautifulSoup
def crawlmp( base_url, parameters, add_to_url = '' ):
""" Parameters dictionairy can contain:
query[str],
categoryId[int],
@ikatson
ikatson / websockets_test.py
Last active June 23, 2016 23:44
uwsgi websocket gevent
uwsgi.websocket_handshake(...)
user_id = get_user_id_from_environ(environ)
ready = gevent.event.Event()
dead = gevent.event.Event()
def ws_socket_waiter():
while not dead.is_set():
gevent.socket.wait_read(websocket_fd)