Skip to content

Instantly share code, notes, and snippets.

Avatar
💭
:-)

Knut Behrends knbknb

💭
:-)
View GitHub Profile
@knbknb
knbknb / wget-examples.sh
Last active Mar 2, 2021 — forked from bueckl/wget
wget examples - from labnol.org
View wget-examples.sh
###### Spider Websites with Wget 20 Practical Examples
# original, from 2019:
# https://www.labnol.org/software/wget-command-examples/28750/
###### Spider Websites with Wget 20 Practical Examples
# wget is extremely powerful, but like with most other command line programs,
# the plethora of options it supports can be intimidating to new users.
# Thus what we have here are a collection of wget commands that you can use
# to accomplish common tasks from downloading single files to mirroring entire websites.
# It will help if you can read through the wget manual but for the busy souls,
@knbknb
knbknb / all-graphs.rq
Last active Dec 21, 2020
basic SPARQL queries
View all-graphs.rq
# show all graphs accessiblefrom a SPARQL endpoint
# no "base" prefix is needed
#
#
# from anzograph tutorial.
# query works in anzograph running on localhost,
# but not on dbpedia.org, wikidata and other public endpoints
# on dbpedia running on localhost:8890/sparql this returns 54261 rows
SELECT DISTINCT ?graph
WHERE {
@knbknb
knbknb / bash--query-wikidata.sh
Last active Dec 20, 2020
wikidata-query-from-commandline.sh : codesnippets / examples for bash
View bash--query-wikidata.sh
#!/usr/bin/env bash
##### Query Wikidata Entities from bash - alternative
# returns only very basic graphs NOT via the SPARQL endpoint
# knb 2020
WDURL='https://www.wikidata.org/w/api.php'
WDQS='action=wbgetentities&format=json&sites=enwiki'
WGE="$WDURL?$WDQS"
echo $WGE >&2
#curl -s: means --silent
WDITEM=Solar_System
View common-RDF-sparql-prefixes.rq
# more RDF prefixes, also very common
base <http://localhost:8180/sparql/> # anzograph
PREFIX : <http://www.w3.org/1999/02/22-rdf-syntax-ns#>
prefix xsd: <http://www.w3.org/2001/XMLSchema#>
prefix skos: <http://www.w3.org/2004/02/skos/core#>
prefix rdfs: <http://www.w3.org/2000/01/rdf-schema#>
prefix rdf: <http://www.w3.org/1999/02/22-rdf-syntax-ns#>
prefix owl: <http://www.w3.org/2002/07/owl#>
prefix hint: <http://www.bigdata.com/queryHints#>
@knbknb
knbknb / igsn-1-0-schema.xsd
Last active Dec 18, 2020
IGSN is theInternational Geo Sample Number https://igsn.github.io/
View igsn-1-0-schema.xsd
<!-- saved here as a gist, for reference in case it gets changed or is taken offline -->
<?xml version="1.0" encoding="UTF-8"?>
<xs:schema xmlns:xs="http://www.w3.org/2001/XMLSchema" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns="http://schema.igsn.org/description/1.0" targetNamespace="http://schema.igsn.org/description/1.0" elementFormDefault="qualified" xml:lang="EN" version="1.0">
<xs:include schemaLocation="include/accessType.xsd"/>
<xs:include schemaLocation="include/collectionType.xsd"/>
<xs:include schemaLocation="include/contributorType.xsd"/>
<xs:include schemaLocation="include/featureType.xsd"/>
<xs:include schemaLocation="include/geometryType.xsd"/>
<xs:include schemaLocation="include/identifierType.xsd"/>
@knbknb
knbknb / wikidata-1-entity-key-value-pairs-table.rq
Last active Dec 20, 2020
Wikidata SPARQL Queries from Stackoverflow, Blogposts, ForumPosts, Lecture Notes (e.g.2020 OpenHPI course "Knowledge Graphs")
View wikidata-1-entity-key-value-pairs-table.rq
PREFIX wd: <http://www.wikidata.org/entity/>
PREFIX wdt: <http://www.wikidata.org/prop/direct/>
PREFIX wikibase: <http://wikiba.se/ontology#>
PREFIX p: <http://www.wikidata.org/prop/>
PREFIX ps: <http://www.wikidata.org/prop/statement/>
PREFIX pq: <http://www.wikidata.org/prop/qualifier/>
PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#>
PREFIX bd: <http://www.bigdata.com/rdf#>
# list all properts, in clear text, with
@knbknb
knbknb / dbpedia-snippet-01.sh
Last active Dec 18, 2020
dbpedia-snippets.sh
View dbpedia-snippet-01.sh
# some examples of quering dbpedia from thecommand line
# knb 20201218
#
# show serialization formats that dbpedia can return
# (other than text/turtle)
# HTTP HEAD request
curl --no-progress-meter --head --header "Accept: text/turtle" "http://dbpedia.org/resource/Pudding"
# --no-progress-meter and -s are the same, --head and -I are the same.
# shorter version of previous command:
@knbknb
knbknb / dbpedia-queries.sparql
Last active Dec 20, 2020
Simple sparql queries for use at https:://dbpedia.org
View dbpedia-queries.sparql
# for more prefixes
# (wikidata, common)
# see also https://gist.github.com/knbknb/081ee7af40a01a0a365d0df5f49acd7c
#
# "Notable works" of a writer
#
PREFIX : <http://dbpedia.org/resource/>
PREFIX rdf: <http://www.w3.org/1999/02/22-rdf-syntax-ns#>
PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#>
PREFIX dbo: <http://dbpedia.org/ontology/>
@knbknb
knbknb / R-package-creation-template.R
Created Apr 5, 2020
R package creation scaffold accoding to Bob Rudis
View R-package-creation-template.R
# Writing Frictionless R Package Wrappers — Building A Basic R Package
# https://rud.is/b/2020/01/03/writing-frictionless-r-package-wrappers-building-a-basic-r-package/#fnref-12609-2
# in any RStudio R Console session
devtools::create("~/packages/THE-PACKAGE-NAME")
# in the newly created package RStudio R Console session:
usethis::use_mit_license() # need a LICENSE file
usethis::use_roxygen_md() # use {roxygen2} for documentation and configuration
usethis::use_package_doc() # setup a package-level manual page
@knbknb
knbknb / command-line-course.edx.md
Last active Dec 18, 2020
bash-fragments. Notes on EdX course "Unix Tools: Data, Software and Production Engineering" by D. Spinellis
View command-line-course.edx.md

Shell Command Language

Which option of the uniq command allows you to specify the number of fields to ignore in its comparisons?

uniq -f

  -f, --skip-fields=N   avoid comparing the first N fields
      --group[=METHOD]  show all items, separating groups with an empty line;
                          METHOD={separate(default),prepend,append,both}