abevoelker

# project_name/pipelines.py

from scrapy import signals
from scrapy.utils.serialize import ScrapyJSONEncoder
from scrapy.xlib.pydispatch import dispatcher

from carrot.connection import BrokerConnection
from carrot.messaging import Publisher

from twisted.internet.threads import deferToThread

abevoelker

{
    "Id": "Policy1234",
    "Statement": [
        {
            "Sid": "Stmt1234",
            "Action": [
                "s3:GetObject"
            ],
            "Effect": "Allow",
            "Resource": "arn:aws:s3:::foo/*",

abevoelker

Rough cert-manager GKE install instructions:

export PROJECT_ID="cert-manager-$(openssl rand -hex 6)"
export EMAIL=abe@abevoelker.com

gcloud projects create --set-as-default $PROJECT_ID
gcloud compute addresses create ipv4-address --global --ip-version IPV4
gcloud services enable compute.googleapis.com
gcloud services enable container.googleapis.com

abevoelker

require "typhoeus"

class OneSignal
  class << self
    [:app_id, :api_key, :timeout, :connecttimeout].each do |opt|
      define_method(:"#{opt}=") {|val| instance_variable_set(:"@#{opt}", val)}
      define_method(opt) { begin; instance_variable_get(:"@#{opt}"); rescue NameError; nil; end }
    end
  end

abevoelker

• Constraints - super important for ensuring data integrity (bad data can't get into the DB)

  • UNIQUE indexes to ensure a record is unique on one or more column values
  • CHECK constraints allow some basic logic you can use (https://www.postgresql.org/docs/current/static/ddl-constraints.html)
  • FOREIGN KEY (FK)'s - very important for ensuring referential integrity. Lets the database knows about relations between tables, and what to do if a record is deleted or updated (how related tables should change) - e.g. should related records be deleted (ON DELETE CASCADE)
  • Anything more complicated than the above, you'll need to write a TRIGGER (https://www.postgresql.org/docs/current/static/sql-createtrigger.html)
    • Learning/using PL/pgSQL will be very important here (https://www.postgresql.org/docs/9.6/static/plpgsql.html). Although you can write triggers in other languages w/ extensions, such as Python or JavaScript, but usually you only do that if you need a specific library or something.

• Indexes - i

abevoelker

<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE plist PUBLIC "-//Apple//DTD PLIST 1.0//EN" "http://www.apple.com/DTDs/PropertyList-1.0.dtd">
<plist version="1.0">
<array>
	<dict>
		<key>AudioList</key>
		<array>
			<dict>
				<key>AudioBitrate</key>
				<string>160</string>

abevoelker

import java.security._
import java.net.URL
import javax.net.ssl.{KeyManagerFactory, TrustManagerFactory}
import org.apache.http.conn.ssl.SSLSocketFactory
import org.apache.http.conn.scheme.Scheme
import dispatch._

// Gist trait for doing SSL with mutual certificate exchange using dispatch.
// This works without having to set up global JDK-wide keystore and truststore files.
//

abevoelker

{-
This code shows how to check if a type-level list contains a given type.
It first shows the approach required for older versions of GHC (< 7.6.x)
and then a version using closed type families supported in GHC 7.8.1 and greater.
-}

{-# LANGUAGE FlexibleContexts #-}
{-# LANGUAGE UndecidableInstances #-}
{-# LANGUAGE FlexibleInstances #-}
{-# LANGUAGE MultiParamTypeClasses #-}

abevoelker

$ sudo -E ./build-ubuntu-box.sh precise amd64

No config file specified, using the default config
debootstrap is /usr/sbin/debootstrap
Checking cache download in /var/cache/lxc/precise/rootfs-amd64 ... 
Copy /var/cache/lxc/precise/rootfs-amd64 to /var/lib/lxc/precise-base/rootfs ... 
Copying rootfs to /var/lib/lxc/precise-base/rootfs ...

##
# The default user is 'ubuntu' with password 'ubuntu'!

abevoelker

Graph of prose (myforms) response times on 2013/12/06 gathered by the parsing the production.log file using this Ruby script.

D3 code was forked from this repo.