Skip to content

Instantly share code, notes, and snippets.

View bkreider's full-sized avatar

Bradley Kreider bkreider

132 followers · 0 following
View GitHub Profile
@bkreider
bkreider / s3nbmanager.py
Last active May 26, 2021 02:39
Ipython notebook backed by S3
"""A notebook manager that uses S3 storage. (based on the Azure manager)
http://ipython.org/ipython-doc/dev/interactive/htmlnotebook.html#using-a-different-notebook-store
Drop this file in IPython/frontend/html/notebook
1. Create a new notebook profile - ipython profile create nbserver
2. edit ~/.ipython/profile_nbserver/ipython_notebook_config.py
3. Add these lines:
c.NotebookApp.notebook_manager_class = 'IPython.frontend.html.notebook.s3nbmanager.S3NotebookManager'
@bkreider
bkreider / nginx.conf
Created February 19, 2020 18:27
Resty proxy domain socket to conda
server {
listen unix:/tmp/conda.sock;
root /Users/bkreider/mine/resty/html;
location / {
# conda
proxy_pass https://repo.anaconda.com/;
proxy_pass_header Server;
@bkreider
bkreider / keybase.md
Created December 17, 2019 17:10

Keybase proof

I hereby claim:

  • I am bkreider on github.
  • I am bkreider (https://keybase.io/bkreider) on keybase.
  • I have a public key ASDTruum1_oiV2cChOTQoJtzGJcCnh8p5SjaEWPTN3PHvwo

To claim this, I am signing this object:

@bkreider
bkreider / gist:e728257bb8b903ac6012411817a469f6
Created December 7, 2018 20:55
Test Mongo Replication
"""
Generally used like this:
1. fab show_status # shows mongo replication status
2. fab kill_master # kills the current master - only if the replicaset has no failures, see "safe" flag
3. fab start_down_mongo # brings up down machine
"""
import os.path
import subprocess
@bkreider
bkreider / spark-python-version.py
Created June 26, 2018 15:59 — forked from quasiben/spark-python-version.py
from pyspark import SparkContext
from pyspark import SparkConf
import os
import sys
if __name__ == "__main__":
conf = SparkConf()
conf.setAppName("version-check")
@bkreider
bkreider / gist:13d84378e0094b10a431c2e4eb245853
Created June 25, 2018 23:23
compare_projects.py
#!/usr/bin/env python
import os
import sys
import stat
import os.path
import getpass
def walktree(top, callback):
@bkreider
bkreider / ping_plot.py
Last active June 9, 2017 10:31
Real-time ping plot using Bokeh
"""
Need to run `ping google.com >> /tmp/google.txt` in another terminal.
"""
import re
from bokeh.plotting import *
from bokeh.plotting import line
from bokeh.objects import GlyphRenderer
MAX_HISTORY = 1000
output_server("ping")
@bkreider
bkreider / gist:5709899
Last active December 18, 2015 02:18
Boto (2.9.2) cert issues with us-west-1. This compares two cacerts: the one included in the Requests library and the one included in Boto. Note: The SSL code is pulled from Boto's source code.
import ssl
import boto
import socket
GOOD_CERT="/opt/anaconda/lib/python2.7/site-packages/requests/cacert.pem"
BAD_CERT="/opt/anaconda/lib/python2.7/site-packages/boto/cacerts/cacerts.txt"
HOST="ec2.us-west-1.amazonaws.com"
PORT=443
@bkreider
bkreider / conda-build
Created October 27, 2014 18:43
increment conda build number
#!/opt/anaconda/bin/python
"""
Check to see if the build number conflicts with a local built package. If
so, set the ENVIRON variable BINSTAR_BUILD with a non-conflicting number
"""
import os
import sys
import os.path
import subprocess
@bkreider
bkreider / ripython.sh
Created June 14, 2014 22:10
remote ipython
#!/bin/bash
#
# remote ipython:
#
# This starts a remote ipython kernel. Downloads the kernel connection file,
# and starts a local ipython console connected to the remote machine.
#
# Features:
# - Automatically starts remote kernel
# - Copies remote file into ~/.ripython/<hostname.json>