edsu

import string
import sys

import requests
import whois

from nltk import tokenize

BOOKFILE = sys.argv[1]
OUTPUTFILE = BOOKFILE + '.possible-domains.txt'

edsu

edsu

Some Friendly Advice for Data Curators

From Dorothea Salo at the Digital Humanities Winter Institute Data Curation Seminar ... shamelessly quoted hopefully not too much out of context by a student (Ed Summers).

• Pick software last.
• Don't chase the shiny.
• Know where the exits are (especially in the cloud).
• Keep your options open.
• What problems can you make someone else's problem?

edsu

#!/usr/bin/env python

# you'll need to pip install microdata

import urllib
import rdflib
import microdata

items = microdata.get_items(open("horrible-beta-markup.html"))
open("horrible-beta-markup.json", "w").write(items[0].json())