Skip to content

Instantly share code, notes, and snippets.

View dangra's full-sized avatar
🦖

Daniel Graña dangra

🦖
282 followers · 23 following
View GitHub Profile
@dangra
dangra / delayspider.py
Created May 24, 2012 14:04
Scrapy - delay requests in spider callbacks
from scrapy.spider import BaseSpider
from twisted.internet import reactor, defer
from scrapy.http import Request
DELAY = 5 # seconds
class MySpider(BaseSpider):
name = 'wikipedia'
@dangra
dangra / clusterplot.py
Created July 20, 2012 05:24
#!/usr/bin/env python
# GistID: 3148850
import json
import fileinput
from igraph import Graph
from itertools import permutations
from optparse import OptionParser
from ndd.graphs import PGraph, partition_graph
@dangra
dangra / perf_queues.py
Created August 10, 2012 12:55 — forked from andrix/perf_queues.py
perf script to test queue performance
import sys
import time
from collections import deque
N = 10000
class FifoMemoryQueue(object):
"""Memory FIFO queue."""
def __init__(self):
@dangra
dangra / gist:3701669
Created September 11, 2012 20:13
puuublic gist
@dangra
dangra / gist:3722388
Created September 14, 2012 14:53
<!DOCTYPE html PUBLIC "-//W3C//DTD HTML 4.01 Frameset//EN" "http://www.w3.org/TR/html4/frameset.dtd">
<html><head><meta http-equiv="Pragma" content="no-cache"/><meta http-equiv="Expires" content="-1"/><meta http-equiv="Content-Type" content="text/html; charset=iso-8859-1"/><title>Lamba plc</title><script src="js/QVS_II.src" type="text/javascript"></script><script type="text/javascript">
var _gaq = _gaq || [];
_gaq.push(['_setAccount', 'UA-21285626-1']);
_gaq.push(['_trackPageview']);
(function() {
var ga = document.createElement('script'); ga.type = 'text/javascript'; ga.async = true;
@dangra
dangra / gist:3915052
Created October 18, 2012 22:06
diff --git a/docs/news.rst b/docs/news.rst
index f421771..71d2c2b 100644
--- a/docs/news.rst
+++ b/docs/news.rst
@@ -3,7 +3,14 @@
Release notes
=============
-0.16 (not yet released)
+0.17 (not yet released)
@dangra
dangra / a.diff
Created October 19, 2012 18:18
diff --git a/scrapinghub.py b/scrapinghub.py
index 1754af7..b4c9bc6 100644
--- a/scrapinghub.py
+++ b/scrapinghub.py
@@ -1,16 +1,15 @@
-"""Scrapinghub API Client Library"""
+"""
+Scrapinghub API Client Library
+"""
@dangra
dangra / a.diff
Created November 15, 2012 13:14
diff --git a/bin/makedeb b/bin/makedeb
index ce9b292..140279b 100755
--- a/bin/makedeb
+++ b/bin/makedeb
@@ -1,5 +1,5 @@
#!/bin/sh
-version=$(python setup.py --version)-r$(git log --oneline | wc -l)+$(date +%Y%m%d%H%M)
+version=$(python setup.py --version)-r$(git log --oneline | wc -l)+$(date +%Y%m%d%H%M)${BUILD_CODE:+~$BUILD_CODE}
debchange -m -D unstable --force-distribution -v $version "Automatic build"
@dangra
dangra / a.diff
Created November 15, 2012 13:17
diff --git a/bin/makedeb b/bin/makedeb
index ce9b292..140279b 100755
--- a/bin/makedeb
+++ b/bin/makedeb
@@ -1,5 +1,5 @@
#!/bin/sh
-version=$(python setup.py --version)-r$(git log --oneline | wc -l)+$(date +%Y%m%d%H%M)
+version=$(python setup.py --version)-r$(git log --oneline | wc -l)+$(date +%Y%m%d%H%M)${BUILD_CODE:+~$BUILD_CODE}
debchange -m -D unstable --force-distribution -v $version "Automatic build"
@dangra
dangra / gist:4079911
Created November 15, 2012 17:23
Nov 15 11:04:23 router daemon.info pppd[384]: Connect time 147.3 minutes.
Nov 15 11:11:48 router daemon.info pppd[4705]: Connect time 6.9 minutes.
Nov 15 11:23:56 router daemon.info pppd[5251]: Connect time 11.9 minutes.
Nov 15 12:00:51 router daemon.info pppd[6013]: Connect time 34.9 minutes.
Nov 15 13:30:04 router daemon.info pppd[6813]: Connect time 87.5 minutes.
Nov 15 14:39:51 router daemon.info pppd[9472]: Connect time 68.9 minutes.
Nov 15 15:01:47 router daemon.info pppd[11558]: Connect time 20.7 minutes.