Skip to content

Instantly share code, notes, and snippets.

Avatar

Heinrich Hartmann HeinrichHartmann

View GitHub Profile
@HeinrichHartmann
HeinrichHartmann / DistributedUrlDownloader.py
Created Dec 6, 2013
Distributed File Donwloader using ZMQ. List of urls is read from a file dstributed to workers, gathered and written to a directory.
View DistributedUrlDownloader.py
#
# Distributed File Dowoloader
# ===========================
#
# List of urls is read from a file, distributed to workers, gathered and written to a directory.
#
# INSTALLATION & USAGE
# --------------------
# sudo apt-get install python-pip python-dev build-essential git screen
# sudo pip install pyzmq requests
@HeinrichHartmann
HeinrichHartmann / ZmqAppender.java
Created Dec 6, 2013
ZmqAppender for Log4j. Publishes log messages on a zmq socket.
View ZmqAppender.java
package net.heinrich-hartmann.gists.ZmqAppender;
import org.apache.log4j.AppenderSkeleton;
import org.apache.log4j.Layout;
import org.apache.log4j.SimpleLayout;
import org.apache.log4j.spi.LoggingEvent;
import org.jeromq.ZMQ;
/**
* ZmqAppender for Log4j.
@HeinrichHartmann
HeinrichHartmann / markdown.css
Created Dec 15, 2013
Slightly customized version of Kevin Burke's markdown.css released under Apache License here https://bitbucket.org/kevinburke/markdowncss/overview http://kevinburke.bitbucket.org/markdowncss/markdown.css
View markdown.css
/*
Customized version of Kevin Burke's markdown.css released under Apache License here
https://bitbucket.org/kevinburke/markdowncss/overview
*/
body{
margin: 0 auto;
@HeinrichHartmann
HeinrichHartmann / EtcGit.md
Last active Jan 1, 2016
Monitor /etc/ using git
View EtcGit.md

Monitor /etc/ using git

  1. Initialize a new git repository at /etc/

     cd /etc/
     sudo git init
    
  2. Setup .gitignore

     cat << EOF | sudo tee .gitignore
    
View FieldTrialStats
DROP VIEW IF EXISTS ft_trips;
DROP VIEW IF EXISTS ft_stats;
-- Create view with basic gps statistics:
-- a) trip_id
-- b) Sample Count
-- c) Maximal Distance to Helsinki Train Station
CREATE VIEW ft_stats(trip_id, count, dist) AS
SELECT trip_id, count(lonlat), Max(st_distance(lonlat, St_geometryfromtext('POINT(24.6006695 60.1893798)',4326)))
FROM sensor_gps
View gps_tag_generator.py
import psycopg2, psycopg2.extras
DSN = {
'dbname': "xxx",
'user': "xxx",
'password': "xxx"}
def main():
con = psycopg2.connect(connection_factory=psycopg2.extras.NamedTupleConnection, **DSN)
cur = con.cursor()
@HeinrichHartmann
HeinrichHartmann / postgres.conf
Last active Aug 29, 2015
Postgres Upstart Script
View postgres.conf
# postgres.conf
#
# A simple upstart script for the postgresql server as installed from source
# http://www.postgresql.org/docs/9.3/interactive/installation.html
#
# Place this file in /etc/init/
#
# Usage:
# $ sudo service postgres start|stop|status
#
@HeinrichHartmann
HeinrichHartmann / TermOnSend.java
Created Mar 21, 2014
Failing context termination on send
View TermOnSend.java
import org.zeromq.ZMQ;
import org.zeromq.ZMQException;
public class TermOnSend {
public static void main(String[] args) {
final ZMQ.Context ctx = ZMQ.context(1);
Thread threadB = new Thread(new Runnable() {
@Override
public void run() {
View wct.py
#!/usr/bin/python
import sys
import BaseHTTPServer
import urllib2
from dateutil import parser, tz as dutz
from datetime import datetime, tzinfo
import ipdb
BREAK=ipdb.set_trace
@HeinrichHartmann
HeinrichHartmann / account-summary.py
Created Jul 22, 2014
Bank Account Analytics for Sparda-Bank csv files
View account-summary.py
"""
Computes a summary of (unique) bank transactions from CSV files
USAGE:
python account-summary.py account_statment1.csv account_statement2.csv ...
OUTPUT:
CSV printed to stdout with the following colums