edsu

#!/usr/bin/env python

# you'll need to pip install microdata

import urllib
import rdflib
import microdata

items = microdata.get_items(open("horrible-beta-markup.html"))
open("horrible-beta-markup.json", "w").write(items[0].json())

edsu

Some Friendly Advice for Data Curators

From Dorothea Salo at the Digital Humanities Winter Institute Data Curation Seminar ... shamelessly quoted hopefully not too much out of context by a student (Ed Summers).

• Pick software last.
• Don't chase the shiny.
• Know where the exits are (especially in the cloud).
• Keep your options open.
• What problems can you make someone else's problem?

edsu

edsu

import string
import sys

import requests
import whois

from nltk import tokenize

BOOKFILE = sys.argv[1]
OUTPUTFILE = BOOKFILE + '.possible-domains.txt'