sclasen

#!/usr/bin/env bash
# bin/compile <build-dir> <cache-dir>

# fail fast
set -e

BIN_DIR=$(cd $(dirname $0); pwd) # absolute path
# parse args
BUILD_DIR=$1
CACHE_DIR=$2

sclasen

 [error] class file needed by MediumPriorityResourceImplicits is missing.
       [error] reference type Transaction of package javax.transaction refers to nonexisting symbol.
       [error] one error found

sclasen

     [info] Loading project definition from /tmp/build_3vmqhlnaemvbd/project
       [error] SERVER ERROR: Service Unavailable url=http://repo.typesafe.com/typesafe/repo/org/sonatype/oss/oss-parent/7/oss-parent-7.jar
       [error] SERVER ERROR: Service Unavailable url=http://repo.typesafe.com/typesafe/repo/org/sonatype/oss/oss-parent/7/oss-parent-7.jar
       [error] SERVER ERROR: Service Unavailable url=http://repo.typesafe.com/typesafe/repo/org/slf4j/slf4j-parent/1.6.4/slf4j-parent-1.6.4.jar
       [error] SERVER ERROR: Service Unavailable url=http://repo.typesafe.com/typesafe/repo/org/slf4j/slf4j-parent/1.6.4/slf4j-parent-1.6.4.jar
       [error] SERVER ERROR: Service Unavailable url=http://repo.typesafe.com/typesafe/repo/ch/qos/logback/logback-parent/1.0.0/logback-parent-1.0.0.jar
       [error] SERVER ERROR: Service Unavailable url=http://repo.typesafe.com/typesafe/repo/ch/qos/logback/logback-parent/1.0.0/logback-parent-1.0.0.jar
       [error] SERVER ERROR: Service Unavailable url=http://repo.typesafe.c

sclasen

Keybase proof

I hereby claim:

• I am sclasen on github.
• I am scott (https://keybase.io/scott) on keybase.
• I have a public key whose fingerprint is 54E4 BF71 177B A416 B5F4 07A7 64A0 5F03 BC98 C988

To claim this, I am signing this object:

sclasen

#!/bin/bash
set -o errexit -o nounset -o pipefail
function -h {
cat <<EOF
 USAGE: syslogged <program> <args>

  Wraps a command invocation with logging, sending STDOUT and STDERR to
  syslog, setting the syslog tag to:

    <program>[<pid>]

sclasen

spark standalone cluster

• statically defined cluster in conf...boo
• master sshes to slaves to do things...could overcome via running sshd on dyno private ip port 22 and having keys set up, but see above

spark on mesos: boils down to running mesos on dogwood

• tough to get working binaries without full docker images, probably surmountable
• dealbreaker: mesos master has a replicated log file. so restarting all master 'dynos' at once kills the cluster.
• workaround: feature-flag in bind-mounting a directory in runtimed that survives dyno restarts, store replicated log there

sclasen

Internet Scale Services Checklist

A checklist for designing and developing internet scale services, inspired by James Hamilton's 2007 paper "On Desgining and Deploying Internet-Scale Services."

• http://mvdirona.com/jrh/talksandpapers/jamesrh_lisa.pdf

Basic tenets

• Does the design expect failures to happen regularly and handle them gracefully?
• Have we kept things as simple as possible?

sclasen

// Generated by the protocol buffer compiler.  DO NOT EDIT!
// source: example.proto

package com.example;

public final class OuterExample {
  private OuterExample() {}
  public static void registerAllExtensions(
      com.google.protobuf.ExtensionRegistryLite registry) {
  }

sclasen

// Generated by the protocol buffer compiler.  DO NOT EDIT!
// source: example.proto

package com.example;

public final class OuterExample {
  private OuterExample() {}
  public static void registerAllExtensions(
      com.google.protobuf.ExtensionRegistryLite registry) {
  }