Skip to content

Instantly share code, notes, and snippets.

Ash Berlin-Taylor ashb

Block or report user

Report or block ashb

Hide content and notifications from this user.

Learn more about blocking users

Contact Support about this user’s behavior.

Learn more about reporting abuse

Report abuse
View GitHub Profile
View example.py
from airflow import DAG
from airflow.operators.bash_operator import BashOperator
from datetime import datetime, timedelta
default_args = {
'owner': 'airflow',
'depends_on_past': False,
'start_date': datetime(2018, 1, 1),
'email_on_failure': False,
'email_on_retry': False,
@ashb
ashb / plugins__staticfiles.py
Created Sep 2, 2019
Serving custom static files form Airflow Plugin
View plugins__staticfiles.py
from flask import Blueprint
import os
"""
Create this file as ./plugins/staticfiles.py in your ARIFLOW_HOME directory
It will serve all files under ./static/ available under /a/static/ (The "a" comes from the ``url_prefix`` argument.)
"""
@ashb
ashb / proxychains4.rb
Last active Feb 4, 2019 — forked from allenhuang/proxychains4_formula.rb
Unofficial brew formula for proxychains 4
View proxychains4.rb
# Unofficial brew formula for proxychains 4
# Instruction:
# $ git clone https://gist.github.com/628c1d98fab731d809d883c24eedd9d4.git gist-3792521
# $ brew install --HEAD gist-3792521/proxychains4.rb
#
# The default config file will be located in /usr/local/etc/proxychains.conf
#
require 'formula'
class Proxychains4 < Formula
View gist:4285c5a6c6b3be616495b1181d3fd63e
(airflow) (themisto python/incuba…irflow v1-10-test:+)% ./dev/airflow-jira compare 1.10.1
ISSUE ID |TYPE ||PRIORITY ||STATUS |DESCRIPTION |MERGED|PR |COMMIT
AIRFLOW-3238 |Bug ||Major ||Resolved |Dags, removed from the filesystem, are not deactiv|1 |#na |1eeb0a4a24fa8541763a67f84ec9f4b034f66475
AIRFLOW-3237 |Improvement ||Major ||Resolved |Refactor example DAGs |1 |#na |fdfb359e4b95dfadfa3973d43025f61f4aa3b96a
AIRFLOW-3232 |Improvement ||Trivial ||Resolved |Make documentation for GCF Functions operator more|1 |#na |d4dff076a6eaf169424822c0010c802f4af80c6a
AIRFLOW-3203 |Bug ||Critical ||Closed |Bugs in DockerOperator & Some operator test script|1 |#na |3dfc9562d3df127ca8337edb600ab6a0259521ac
AIRFLOW-3197 |Improvement ||Minor ||Resolved |EMR Hook is missing some parameters to valid on th|1 |#na |079b0ee95e4a1d37bdb31c477b531db264242
@ashb
ashb / tf-plan-diff.sh
Created Apr 9, 2018
Show a diff of single line JSON objects (IAM policy docs) in terraform
View tf-plan-diff.sh
#!/bin/bash
#
# shellcheck disable=SC2001
set -e -o pipefail
input="$1"
[[ -n "$input" ]] || {
View policy.json
{
"Version": "2012-10-17",
"Statement": [
{
"Sid": "AllowListingOfOwnState",
"Effect": "Allow",
"Principal": "*",
"Action": "s3:ListBucket",
"Resource": "arn:aws:s3:::my-terraform-state",
"Condition": {
@ashb
ashb / hacky.sh
Created May 10, 2017
Update ACS k8s API server to run with OIDC based-auth
View hacky.sh
ensure_kube_apiserver_config() {
local dry_run="$2"
# If we want to make changes to the apiserver manifest we do it via an
# Azure CustomLinuxCommand extension
# https://github.com/Azure/custom-script-extension-linux which will run the
# command for us without having to log in. The down side to this is that it
# takes a while to "deploy" the extension, which is espeically a pain if
# the config is already correct.
#
# To speed it up and only deploy the extension if something is changed we
View gist:6478e17532073f47defe01920c8e6035
# root@94aaea34ef26:/# (echo "openssl"; echo libssl1.0.0; echo libssl-dev) | LC_ALL="en_US.UTF-8" sort
libssl1.0.0
libssl-dev
openssl
# root@94aaea34ef26:/# (echo "openssl"; echo libssl1.0.0; echo libssl-dev) | sort
libssl-dev
libssl1.0.0
openssl
# root@94aaea34ef26:/# locale
LANG=
View Dockerfile
FROM alpine
RUN ls /etc/profile.d /usr/local/bin /usr
COPY resources/etc/ /etc
COPY resources/usr/ /usr
RUN ls /etc/profile.d/ /usr/local/bin /usr
View gist:b697829e53b59fc2f13725a3d41a0b91
(themisto docker/registry :*+)% head ./v2/blobs/sha256/9a/9a12a17ffc57ce90fbd060e1a3fd8a2da94f77fd0113be19352e71972b13ce74/data
{
"schemaVersion": 2,
"mediaType": "application/vnd.docker.distribution.manifest.v2+json",
"config": {
"mediaType": "application/vnd.docker.container.image.v1+json",
"size": 3731,
"digest": "sha256:e8ebd20fab2c5e9fa4046cd143e2b54ca041a61797dfe01cb8f55262f816d5ff"
},
"layers": [
You can’t perform that action at this time.