Skip to content

Instantly share code, notes, and snippets.

@hoosteeno
hoosteeno / modernizr_scraper.bash
Created January 31, 2014 20:57
Figure out which Modernizr tests are required by a custom Modernizr build
egrep -r "Modernizr\." * | egrep -v "(Binary|modernizr\.custom)" | sed -r 's/.+?Modernizr\.(\w+).+?/\1/g'
@hoosteeno
hoosteeno / unique_ips.bash
Created March 11, 2014 20:29
get unique IPs from apache logs
egrep -i 'wget' 982257_51195_wget.log | awk '{print $1}' | sed -r 's/^.+?gz\:(.+)$/\1/' | uniq -c
@hoosteeno
hoosteeno / gist:11347863
Created April 27, 2014 15:07
keybase.md
### Keybase proof
I hereby claim:
* I am hoosteeno on github.
* I am hoosteeno (https://keybase.io/hoosteeno) on keybase.
* I have a public key whose fingerprint is 7548 B978 E48C 8183 2376 8802 171E 81C2 7A1D 26DC
To claim this, I am signing this object:
@hoosteeno
hoosteeno / audit_dotorg.bash
Created May 23, 2014 19:40
get some html files from mozilla.org SVN
#!/bin/bash
echo "LOCATION, SVN, # FILES"
for FILE in `find ~/mozilla/mozilla.com/org \
-type d -name .svn -prune -o \
-type d -name access -prune -o \
-type d -name images -prune -o \
-type d -name includes -prune -o \
-type d -name script -prune -o \
@hoosteeno
hoosteeno / audit_dotorg_access.bash
Created May 23, 2014 21:49
get some html files from mozilla.org SVN
#!/bin/bash
echo "LOCATION, SVN, # FILES"
for FILE in `find ~/mozilla/mozilla.com/org/access \
-type d -name .svn -prune -o \
-a -type f -name '*.html' -print`
do
SVN=`echo $FILE | perl -pe 's|^.*?org|http://viewvc.svn.mozilla.org/vc/projects/mozilla.org/trunk|'`
LOC=`echo $FILE | perl -pe 's|^.*?org|http://www.mozilla.org|'`
@hoosteeno
hoosteeno / get_website_from_profile.sql
Last active August 29, 2015 14:14
get the website from the user profile in MDN
select substring(
misc
from (
/* start substring after but not including website key */
locate('"website": ', misc) + 12
)
for (
/* the location of the first " after the website key... */
locate('"', misc, locate('"website": ', misc) + 12)
/* minus the location of the website key plus the length of the website key */
@hoosteeno
hoosteeno / check_url_on_blocklists.py
Created January 30, 2015 12:47
Check url for presence on IP blocklists
import socket
import dns.resolver
urls = ["freecreditreportblog.net"]
bls = ["zen.spamhaus.org", "spam.abuse.ch", "cbl.abuseat.org", "virbl.dnsbl.bit.nl", "dnsbl.inps.de",
"ix.dnsbl.manitu.net", "dnsbl.sorbs.net", "bl.spamcannibal.org", "bl.spamcop.net",
"xbl.spamhaus.org", "pbl.spamhaus.org", "dnsbl-1.uceprotect.net", "dnsbl-2.uceprotect.net",
"dnsbl-3.uceprotect.net", "db.wpbl.info"]
@hoosteeno
hoosteeno / surbl_lookup.py
Created January 30, 2015 12:58
check url on surbl
from surblclient import surbl
print 'freecreditreportblog.net' in surbl
print 'garagedoorrepairslandolakesfl.com' in surbl
print 'foo.bar.test.surbl.org' in surbl
@hoosteeno
hoosteeno / get_profile_url_bio.sql
Last active August 29, 2015 14:14
get profile_url, url, count of revisions and bio from mdn profiles
select
url, count(wiki_revision.id) as revision_count, bio,
concat('https://developer.mozilla.org/en-US/profiles/', username) as profile_page
from
(select substring(
misc
from (
/* start substring after but not including website key */
locate('"website": ', misc) + 12
)
@hoosteeno
hoosteeno / tinker_ks.js
Created September 17, 2015 02:32
how to create functions in kumascript
<%
tinker = function(path) {
var text = template('page', '/en-US/docs/Web');
text += "<p>I'M IN UR HTML ADDNG NOO MARKUPZ!</p>";
return text;
}
%>
<%-tinker('/en-US/docs/Web')%>