This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
#!/bin/bash | |
if [ -n "$1" ]; then | |
TARGET="$1" | |
else | |
TARGET="." | |
fi | |
# Remove Python compiled bytecode files | |
command="find $TARGET -name '*.pyc' -type f -delete -print 2>/dev/null"; |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
/* | |
usbreset -- send a USB port reset to a USB device | |
http://askubuntu.com/questions/645#answer-661 | |
cc usbreset.c -o usbreset | |
lsusb |grep DUB | |
Bus 001 Device 021: ID 2001:1a02 D-Link Corp. DUB-E100 Fast Ethernet Adapter(rev.C1) [ASIX AX88772] |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
class MySpider(RouteSpider): | |
name = "example.com" | |
def start_routes(self, response): | |
for city in response.css('#location .dropdown-bg li'): | |
yield Route( | |
url=city.xpath('a/@href'), | |
callback=self.parse_city, |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
# [PackageDev] target_format: plist, ext: tmLanguage | |
--- | |
name: Scrapy Log | |
scopeName: source.slog | |
fileTypes: [slog] | |
uuid: 030ae93f-5fcf-4bbd-8caa-81fcdcf77ec3 | |
patterns: | |
- comment: date-time [logger] level |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
#!/usr/bin/env python | |
# usbreset -- send a USB port reset to a USB device | |
# | |
# http://askubuntu.com/questions/645#answer-661 | |
# | |
# $ sudo usbreset.py DUB | |
# Looking for device: DUB | |
# Executing command: `lsusb | grep DUB` | |
# Subprocess: b'Bus 001 Device 006: ID 2001:1a02 D-Link Corp. DUB-E100 Fast...' | |
# Found device 001 on bus 006 for "D-Link Corp. DUB-E100 Fast Ethernet Adapt..." |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
""" pipelines.py """ | |
import collections | |
import scrapy | |
import scrapy.contrib.exporter | |
import myproject | |
class SitemapPipeline(object): | |
""" | |
Sitemap builder |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
""" | |
Routed Crawler | |
""" | |
class Route(dict): | |
"""Spider route request""" | |
pass | |
class Router(scrapy.Spider): | |
"""Spider routing and loader handling""" |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
#!/bin/bash | |
if [ -n "$1" ]; then | |
TARGET="$1" | |
else | |
TARGET="." | |
fi | |
command="find $TARGET -name '*.pyc' 2>/dev/null" |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
# Python YouTube downloader | |
# 1. start script | |
# 2. copy youtube url into clipboard | |
# 3. press ctrl-d to start downloading | |
import sys | |
import pygtk | |
pygtk.require('2.0') | |
import gtk |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
import sys | |
import json | |
import argparse | |
from os.path import exists | |
from pprint import pprint | |
from urllib import urlencode, urlretrieve | |
from urllib2 import urlopen | |
from urlparse import urlsplit, parse_qs |