Skip to content

Instantly share code, notes, and snippets.

View wragge's full-sized avatar

Tim Sherratt wragge

145 followers · 0 following
View GitHub Profile
@wragge
wragge / trove_copy_permalink.user.js
Last active November 7, 2017 23:35
Userscript to add a handy button to Trove works and versions to save permalink to clipboard.
@wragge
wragge / speak.py
Last active August 31, 2017 11:25
Python script for MacOS that speaks interjections from Historic Hansard. The interjections, voice, speaking rate, volume, and delay are all set randomly.
import subprocess
from pymongo import MongoClient
import time
import random
import argparse
from credentials import MONGO_URL
HOUSES = {
'hofreps': 'House of Representatives',
@wragge
wragge / download-aww-text.md
Last active April 9, 2018 12:14

Getting the text content of articles from the Australian Womens Weekly

The TroveHarvester makes it easy to download articles in bulk from Trove's digitised newspapers. Using the --text option you can also save the fulltext content of every article.

However, this doesn't work for the Australian Womens' Weekly as the full text is not available through the Trove API. Fortunately, the article text can be downloaded from the web interface.

The one-line script below uses wget, so make sure you have it installed before you go any further. (You can install it with Homebrew if you're using a Mac.)

Instructions

@wragge
wragge / similar-years.md
Last active May 4, 2017 03:20
Which years are similar to others (according to TF-IDF)?

1970

* 1971                                     0.999590684514
* 1969                                     0.999531189763
* 1972                                     0.99943879755
* 1968                                     0.99938776453
* 1967                                     0.999269072854
* 1973                                     0.998769846893
* 1974                                     0.998373370334
  • 1975 0.998230585413
@wragge
wragge / hansard-speaker-similarities.md
Last active April 27, 2017 13:41
Similarities between 1970s members of the House of Reps, based on their speeches in Hansard (showing 10 most similar)

HOWSON, Peter (LP)

* VINER, Ian (LP)                          0.990147362266
* HUNT, Ralph (NCP/NP)                     0.989726340705
* BOWEN, Nigel (LP)                        0.989052644404
* SWARTZ, Reginald (LP)                    0.988994723622
* NEWMAN, Kevin (LP)                       0.988793740506
* GROOM, Ray (LP)                          0.988658546299
* EVERINGHAM, Douglas (ALP)                0.988432787038
  • STEWART, Francis (ALP) 0.98833413308
@wragge
wragge / question-titles-decade-tfidf.txt
Created April 11, 2017 11:25
Most significant words (via TF-IDF) in titles of questions asked in the House of Reps for each decade 1900-1979
1900
kanakas 0.0725222278008
stripper 0.0604896801498
employes 0.0599783041901
increments 0.0539607103026
creswell 0.0528185096992
drawback 0.0528185096992
masters 0.0528185096992
slanders 0.0528185096992
@wragge
wragge / functions-in-recordsearch.md
Last active March 31, 2017 03:04
Functions currently used in RecordSearch
Term Number of agencies Included in thesaurus
administrative law 169 crsthesaurus, agift1, agift2, agift3, recordsearch
administrative services 3 crsthesaurus, recordsearch
agriculture 118 crsthesaurus, recordsearch
air force 21 crsthesaurus, agift2, agift3, recordsearch
air force administration 23 crsthesaurus, recordsearch
air force commands 77 crsthesaurus, recordsearch
air operations 140 crsthesaurus, recordsearch
air safety 6 crsthesaurus, recordsearch
@wragge
wragge / dh2017-titlewithheld.md
Created February 18, 2017 01:52
Proposal for DH2017

[Title withheld] -- access and surveillance in the archives

The Australian Security Intelligence Organisation (ASIO) was established in 1949 amidst Cold War fears of spies and secrets (Horner, 2014). In the decades that followed, ASIO compiled many thousands of dossiers on people and organisations who might pose a threat to the nation -- these included communists, writers, academics, scientists, unionists, and Indigenous rights activists. One historian has estimated that hundreds of thousands of files were created (McKnight, 2014).

Under the Australian Archives Act, the public has a right to access government records more than twenty years old. This is subject to exemptions on grounds such as national security and privacy. Exemptions are assessed and applied as part of a process known as 'access examination' (National Archives of Australia, 2016).

Unlike other government agencies, ASIO does not have to disclose information about its records. You can, however, ask whether they hold a file on a particular

@wragge
wragge / hansard-interjections-fascist.md
Last active January 28, 2017 02:43
Interjections less than 50 characters long including the word 'fascist' from the Commonwealth Parliament between 1901 and 1980.
@wragge
wragge / hansard-interjections-white.md
Last active January 28, 2017 02:44
Interjections less than 50 characters long including the word 'white' from the Commonwealth Parliament between 1901 and 1980.