Skip to content

Instantly share code, notes, and snippets.

Avatar

Robin Moffatt rmoff

View GitHub Profile
@WheresAlice
WheresAlice / Makefile
Last active Sep 30, 2019
Produce a CSV with Tiploc code, Longitude, and Latitude using Naptan data
View Makefile
.DEFAULT_GOAL := tiploc_locations.csv
naptan.zip:
wget -O naptan.zip naptan.app.dft.gov.uk/DataRequest/Naptan.ashx?format=csv
Stops.csv: naptan.zip
unzip -o naptan.zip
tiploc_locations.csv: Stops.csv
python run.py
View apache-kafka-productivity-hacks.md

I've been working with Apache Kafka for over 7 years. I inevitably find myself doing the same set of activities while I'm developing or working with someone else's system. Here's a set of Kafka productivity hacks for doing a few things way faster than you're probably doing them now. 🔥

Get the tools

@pirate
pirate / alfred-clipboard.sh
Last active Sep 22, 2020
Script to manage searching, backing up, and collecting infinite clipboard history from the Alfred Clipboard History on macOS.
View alfred-clipboard.sh
#!/usr/bin/env bash
# This is a script that provides infinite history to get around Alfred's 3-month limit.
# It works by regularly backing up and appending the items in the alfred db to a
# sqlite database in the user's home folder. It also provides search functionality.
# https://www.alfredforum.com/topic/10969-keep-clipboard-history-forever/?tab=comments#comment-68859
# https://www.reddit.com/r/Alfred/comments/cde29x/script_to_manage_searching_backing_up_and/
# Example Usage:
# alfred-clipboard.sh backup
@joel-hamill
joel-hamill / testc3.md
Last active Jun 28, 2019
Build Confluent Platform manually
View testc3.md
  1. Clone ce-kafka checkout 5.3.x and build

    gradle && ./gradlew jar

  2. Start ZK in ce-kafka repo

    ./bin/zookeeper-server-start.sh config/zookeeper.properties

  3. Start Kafka (change logs to /tmp) in ce-kafka repo

@jpzk
jpzk / easy-schema-registry.txt
Created Nov 30, 2018
Easy way to delete schemas in the schema registry
View easy-schema-registry.txt
apt install peco
apt install curl
curl http://localhost:8081/subjects | jq .[] | tr -d "\"" | peco | xargs -I '{}' curl -v -X DELETE http://localhost:8081/subjects/'{}'
@T-Rave
T-Rave / alfred-clipboard-dump.sh
Last active Mar 13, 2020
Alfred, Mac OS X app, full clipboard dump to text file
View alfred-clipboard-dump.sh
## Must have sqlite3 installed. Homebrew user? brew install sqlite
## Can be ran directly in command line and will place file directory where ran
## Remove `-header` if you don't want the output to have the column name `item`
## Checkout more options and Workflow - https://github.com/T-Rave/alfred-clipboard-dump
# dumps output with list option since single column. Produces cleaner data without double quotes
sqlite3 -header -list ~/Library/Application\ Support/Alfred\ 3/Databases/clipboard.alfdb "SELECT item FROM clipboard;" > clipboard-dump.txt
# dumps full table to csv format
sqlite3 -header -csv ~/Library/Application\ Support/Alfred\ 3/Databases/clipboard.alfdb "SELECT * FROM clipboard;" > clipboard-dump.csv
# dumps only items in descending (inverse) order with no column name
sqlite3 -list ~/Library/Application\ Support/Alfred\ 3/Databases/clipboard.alfdb "SELECT item FROM clipboard ORDER BY item DESC;" > clipdump.txt
@LoranKloeze
LoranKloeze / probe_requests_OSX_to_screen_or_sqlite3.py
Last active Jul 8, 2020
Special for OSX: this script grabs 802.11 probe requests from the air and puts them on your screen or in a sqlite3-db
View probe_requests_OSX_to_screen_or_sqlite3.py
#!/usr/bin/env python2.7
# 802.11 probe requests processor
# Copyright (C) 2017 Ralon cybersecurity
# Loran Kloeze - loran@ralon.nl - @lorankloeze
# MIT license: do with it what you want but use it for good
#
# Tested on OS X El Capitan 10.11.6 - MacBook Air
#
# This script grabs probe requests from the air and outputs them on the screen
# and/or saves them to a sqlite3-db.
@markharwood
markharwood / LoadMOTs
Created Aug 11, 2014
Script to load and geocode MOT data
View LoadMOTs
import gzip
import csv
from elasticsearch import helpers
from elasticsearch.client import Elasticsearch
import time
csv.register_dialect('piper', delimiter='|', quoting=csv.QUOTE_NONE)
# See http://postcodepal.com/dbgen/postcode_areas_true-centroids.zip
pf=open('/Users/Mark/Documents/work/irdata/MOT/postcode_areas.csv')
@kaipakartik
kaipakartik / tree.go
Created Dec 25, 2013
Exercise: Equivalent Binary Trees
View tree.go
package main
import (
"code.google.com/p/go-tour/tree"
"fmt"
)
// Walk walks the tree t sending all values
// from the tree to the channel ch.
func Walk(t *tree.Tree, ch chan int) {
@mmaassen
mmaassen / weblogic-shipper.conf
Last active May 11, 2019
LogStash (1.2.2) WebLogic Server shipper
View weblogic-shipper.conf
input {
## WebLogic Server Log
file {
type => "weblogic"
path => [ "/var/log/weblogic/domain/managedserver.log" ]
codec => multiline {
pattern => "^####"
negate => true
what => previous
}
You can’t perform that action at this time.