Instantly share code, notes, and snippets.

View keybase.md

Keybase proof

I hereby claim:

  • I am mhmdiaa on github.
  • I am mhmdiaa (https://keybase.io/mhmdiaa) on keybase.
  • I have a public key ASB7gQF1QTGIH2fnl6BL88-73BM1Kz-DFfx4acc7aWAYawo

To claim this, I am signing this object:

View ip_encoder.py
import sys
def to_octets(ip):
return [int(i) for i in ip.split('.')]
def dotless_decimal(ip):
octets = to_octets(ip)
result = octets[0] * 16777216 + octets[1] * \
View waybackurls.py
import requests
import sys
import json
def waybackurls(host, with_subs):
if with_subs:
url = 'http://web.archive.org/cdx/search/cdx?url=*.%s/*&output=json&fl=original&collapse=urlkey' % host
else:
url = 'http://web.archive.org/cdx/search/cdx?url=%s/*&output=json&fl=original&collapse=urlkey' % host
View waybackrobots.py
import requests
import re
import sys
from multiprocessing.dummy import Pool
def robots(host):
r = requests.get(
'https://web.archive.org/cdx/search/cdx\
?url=%s/robots.txt&output=json&fl=timestamp,original&filter=statuscode:200&collapse=digest' % host)