Skip to content

Instantly share code, notes, and snippets.

View CliffordAnderson's full-sized avatar

Clifford Anderson CliffordAnderson

97 followers · 60 following
View GitHub Profile
@CliffordAnderson
CliffordAnderson / teams-web-scraping.xqy
Created August 6, 2020 21:00
Web scraping for Summer Teams
(: Web Scraper for Summer Projects :)
declare option output:method "csv";
declare option output:csv "header=yes, separator=comma";
let $doc := fetch:text("https://www.library.vanderbilt.edu/projects") => html:parse()
let $mainContent := $doc//section[@id="maincontent"]
for $project in $mainContent//div[@class="media-body"]
let $projectName := $project/h3[@class="media-heading"]/text()
let $projectParticipants := $project//span[text()="Members"]/following-sibling::text()
@CliffordAnderson
CliffordAnderson / New.csv
Created April 7, 2020 20:46 — forked from davidamichelson/New
Data To Concatenate
Headword Syriaca_URI Map_1 Map_2 Map_3 Map_4 Map_5 Map_6 Map_7 Map_8 Map_9 Map_10 Map_11 Map_12 Map_13 Map_14
Abila syriaca.org/place/4355 1 4
Abivard syriaca.org/place/4222 9
Abr Shahr syriaca.org/place/4220 9 10
Acre|Akko syriaca.org/place/14 1 2 5
@CliffordAnderson
CliffordAnderson / spark-session-nlp.scala
Created February 14, 2020 18:39
Spark Notes
val pbp = spark.read.format("csv").load("Desktop/pbp.csv")
pbp.show
pbp.printSchema
val bp = pbp.withColumnRenamed("_c0", "article").withColumnRenamed("_c1", "journal").withColumnRenamed("_c2", "volume").withColumnRenamed("_c3", "issue").withColumnRenamed("_c4", "date").withColumnRenamed("_c5", "pages").withColumnRenamed("_c6", "url").withColumnRenamed("_c7", "text")
bp.printSchema
@CliffordAnderson
CliffordAnderson / BP.xqy
Created February 13, 2020 20:24
For Mark S.
xquery version "3.1";
let $docs := fn:collection("bpp-quarterly")
let $csv := element csv {
for $doc in $docs/Record
return
<record>
<title>{$doc/RecordTitle/text()}</title>
<publication>{$doc/Publication/Title/text()}</publication>
<volume>{$doc/Volume/text()}</volume>
@CliffordAnderson
CliffordAnderson / 2010-tv-news.md
Created December 22, 2019 21:46
TV News for 2010
@CliffordAnderson
CliffordAnderson / csv-to-jsonl.xqy
Created November 1, 2019 04:13
CVS to JSONL example
xquery version "3.1";
declare namespace xpf = "http://www.w3.org/2005/xpath-functions";
(: Converts a CSV into JSONL, i.e. one JSON object per line :)
let $csv := fetch:text("https://gist.githubusercontent.com/CliffordAnderson/588774dd0fa7d7bb616abd8da478fe76/raw/33395bdb6fce8d215464738f8681b66b130159e9/books.csv") => csv:parse(map { 'header': true() })
for $record in $csv/csv/record
let $key-values :=
for $entry in $record/*
return
@CliffordAnderson
CliffordAnderson / artists.json
Created October 27, 2019 16:23
Artist Networks from WIkidata
[
{
"artist": "http://www.wikidata.org/entity/Q30160536",
"artistLabel": "František Podešva",
"influenced_by": "http://www.wikidata.org/entity/Q2104325",
"influenced_byLabel": "Jan Preisler"
},
{
"artist": "http://www.wikidata.org/entity/Q63478",
"artistLabel": "Jonah Bokaer",
@CliffordAnderson
CliffordAnderson / ubahn.html
Created October 27, 2019 16:22
Sample neovis.js page
<!doctype html>
<html>
<head>
<title>Neovis.js Simple Example</title>
<style type="text/css">
html, body {
font: 16pt arial;
}
#viz {
@CliffordAnderson
CliffordAnderson / anderson-graph.xml
Created October 26, 2019 20:57
Clifford Anderson's Scholarly Graph from Atlas
<graphml:graphml xmlns:graphml="http://graphml.graphdrawing.org/xmlns" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns:grapml="http://graphml.graphdrawing.org/xmlns" xsi:schemaLocation="http://graphml.graphdrawing.org/xmlns http://graphml.graphdrawing.org/xmlns/1.0/graphml.xsd">
<graphml:graph id="G" edgedefault="directed">
<graphml:node id="F5EFD5A5849581F4CC1B189C11BC7350" labels=":Author">
<graphml:data key="author">Anderson, Clifford Blake</graphml:data>
</graphml:node>
<graphml:node id="7123B0D8EC557EFFE510337C89E6EEBF" labels=":Author">
<graphml:data key="author">Anderson, Clifford Blake, 1970- ("Author of introduction, etc. ")</graphml:data>
</graphml:node>
<graphml:node id="3739280CA94B7DED2A6DA75A9F662CEE" labels=":Author">
<graphml:data key="author">Anderson, Clifford Blake, 1970- (Editor)</graphml:data>
@CliffordAnderson
CliffordAnderson / neo4j-workshop.md
Last active October 27, 2019 16:20
Graph Analysis for the Humanities

Graph Analysis for the Humanities

An introduction to using graphs to model and analyze data in the humanities

Berea College Workshop

Berea College Logo

A workshop at Bearea College on Wednesday, October 30th sponsored by The Mellon Partners for Humanities Education

Introduction to Neo4j