Skip to content

Instantly share code, notes, and snippets.

View tomfaulhaber's full-sized avatar

Tom Faulhaber tomfaulhaber

View GitHub Profile
FROM ubuntu:16.04
RUN apt-get -y update && apt-get install -y --no-install-recommends \
wget \
python \
python-dev \
python3.5 \
python3.5-dev \
gcc \
ca-certificates
@tomfaulhaber
tomfaulhaber / scheduler.log
Created November 15, 2018 18:24
Log from scheduler when dummy dag file is uploaded
[2018-11-15 18:04:42,099] {settings.py:146} DEBUG - Setting up DB connection pool (PID 2613)
[2018-11-15 18:04:42,099] {settings.py:174} INFO - setting.configure_orm(): Using pool settings. pool_size=5, pool_recycle=1800
[2018-11-15 18:04:42,374] {__init__.py:42} DEBUG - Cannot import due to doesn't look like a module path
[2018-11-15 18:04:42,658] {__init__.py:51} INFO - Using executor SequentialExecutor
[2018-11-15 18:04:42,677] {cli_action_loggers.py:40} DEBUG - Adding <function default_action_log at 0x7fbec8df5e18> to pre execution callback
[2018-11-15 18:04:42,934] {cli_action_loggers.py:64} DEBUG - Calling callbacks: [<function default_action_log at 0x7fbec8df5e18>]
____________ _____________
____ |__( )_________ __/__ /________ __
____ /| |_ /__ ___/_ /_ __ /_ __ \_ | /| / /
___ ___ | / _ / _ __/ _ / / /_/ /_ |/ |/ /
@tomfaulhaber
tomfaulhaber / putnam-co.Rmd
Last active September 23, 2016 05:31
The RMarkdown file I was using during the AWS Agriculture in the Cloud event at Ohio State
---
title: "Precipitation predictions for Putnam County, OH"
author: "Tom Faulhaber"
date: "September 17, 2016"
output: html_document
---
```{r setup, include=FALSE}
knitr::opts_chunk$set(echo = TRUE)
@tomfaulhaber
tomfaulhaber / docker-compose.yml
Created September 21, 2016 22:31
Docker compose file for OpenNEX access plus notebooks (use "docker-compose up")
version: "2"
services:
opennex:
image: planetos/opennex-access
environment:
AWS_ACCESS_KEY_ID: ${AWS_ACCESS_KEY_ID}
AWS_SECRET_ACCESS_KEY: ${AWS_SECRET_ACCESS_KEY}
CONFIG_DATA: "{ \"version\":2, \"config_source\": \"http://opennex.planetos.com/datasets\" }"
OPENNEX_PORT: "80"
@tomfaulhaber
tomfaulhaber / unzip-excel.sh
Created March 21, 2016 23:48
A shell script that takes an Excel file and a directory and expands the Excel file into that directory as separate files, nicely formatting all the XML files so that they are actually readable.
#!/bin/bash
# Process command line arguments
REPS=10
PREFIX=bench
SCRIPT=
function show_help() {
cat <<EOF 1>&2
@tomfaulhaber
tomfaulhaber / hadoop.clj
Last active August 29, 2015 14:00
hadoop cluster setup with ignored dfs.data.dir
(ns hadoop-int.hadoop
(:require
[pallet.api :as api]
[palletops.cluster.hadoop :as h]
[hadoop-int.common :as common]))
(def our-node
{:hardware {:hardware-id "m3.large"}
:image {:os-family :ubuntu
:os-version-matches "12.04"
@tomfaulhaber
tomfaulhaber / diff
Created April 24, 2014 17:33
bash_profile not built
Local: master ~/src/clj/pallet/hadoop-crate/
Remote: master @ origin (https://github.com/palletops/hadoop-crate.git)
Head: ea401ff Merge release/0.1.6
Tag: 0.1.6 (2 ahead)
Unstaged changes:
Modified src/palletops/crate/hadoop/base.clj
diff --git a/src/palletops/crate/hadoop/base.clj b/src/palletops/crate/hadoop/base.clj
index f0fca38..0a20b35 100644
--- a/src/palletops/crate/hadoop/base.clj
@tomfaulhaber
tomfaulhaber / common.clj
Created April 24, 2014 17:07
Is this using :extends correctly?
(ns hadoop-int.common
(:require [pallet.api :refer [server-spec plan-fn]]
[pallet.actions :refer [package package-manager]]
[pallet.configure :as configure]
[pallet.core.session :as session]
[pallet.crate :as crate]
[pallet.node :as node]
[com.palletops.jclouds.ec2.security-group2 :as sg2]))
(def aws (configure/compute-service :sc-aws))
frameRate(100);
var startx=32;
var endx=165;
var frw=true;
var inc=5;
var x=startx;
var draw = function() {
//How can you change this into the picture I have?
//Note: Add any color.
(ns example.macros)
;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;
;; This is some example code to give you an understanding of how
;; macros work. As a disclaimer, it is not the best way to implement
;; this and it does not cover all the cases. Instead, it is designed
;; to show how "code is data" makes macros possible.
;; If you'd like to build similar code, I recommend you investigate