nishad

sudo apt install curl gnupg2 ca-certificates lsb-release
echo "deb http://nginx.org/packages/ubuntu `lsb_release -cs` nginx" | sudo tee /etc/apt/sources.list.d/nginx.list
curl -fsSL https://nginx.org/keys/nginx_signing.key | sudo apt-key add -

sudo apt update
NGINX_VERSION=$(apt show nginx | grep "^Version" | cut -d " " -f 2 | cut -d "-" -f 1)
# take note of the nginx version in the "stable" release. e.g. 1.14.2
echo NGINX version $NGINX_VERSION
wget https://hg.nginx.org/pkg-oss/raw-file/default/build_module.sh
chmod a+x build_module.sh

nishad

Use wget to mirror a single page and its visible dependencies (images, styles)

Graphic via State of Florida CFO Vendor Payment Search (flair.myfloridacfo.com)

This is a quick command I use to snapshot webpages that have a fun image I want to keep for my own collection of WTFViz. Why not just right-click and save the image? Oftentimes, the webpage in which the image is embedded contains necessary context, such as captions and links to important documentation just incase you forget what exactly that fun graphic was trying to explain.

nishad

nishad

#!/usr/bin/env python
# encoding: utf-8
"""
csv2xml.py

Created by Justin van Wees on 2011-04-18.
"""
import sys
import os
import string

nishad

<nav id="access">
    <ul class="menu">
        <li><a href="#">Home</a></li>
        <li><a href="#">Page 1</a>
            <ul class="sub-menu">
                <li><a href="#">Page 1.1</a></li>
                <li><a href="#">Page 1.2</a></li>
                <li><a href="#">Page 1.3</a></li>
                <li><a href="#">Page 1.4</a></li>
                <li><a href="#">Page 1.5</a></li>

nishad

import requests
from bs4 import BeautifulSoup

# We've now imported the two packages that will do the heavy lifting
# for us, reqeusts and BeautifulSoup

# Let's put the URL of the page we want to scrape in a variable
# so that our code down below can be a little cleaner
url_to_scrape = 'http://apps2.polkcountyiowa.gov/inmatesontheweb/'

nishad

# Given a list of words, remove any that are
# in a list of stop words.

def removeStopwords(wordlist, stopwords):
    return [w for w in wordlist if w not in stopwords]

nishad

#! /usr/bin/env python
# -*- coding: utf-8 -*-
"""This module's docstring summary line.

This is a multi-line docstring. Paragraphs are separated with blank lines.
Lines conform to 79-column limit.

Module and packages names should be short, lower_case_with_underscores.
Notice that this in not PEP8-cheatsheet.py

nishad

Tested with a fresh Ubuntu 16.04.1 LTS

Install Java

$ sudo apt-get install default-jre

Download and install Fuseki with a dedicated user account

nishad

<?php //origin: http://www.if-not-true-then-false.com/2012/php-pdo-sqlite3-example/

  // Kludges
  const SQLITE3_TEXT = PDO::PARAM_STR;
  const SQLITE3_INTEGER = PDO::PARAM_INT;
 
  // Set default timezone
  date_default_timezone_set('UTC');
 
  try {