Skip to content

Instantly share code, notes, and snippets.

View fs111's full-sized avatar

André Kelpe fs111

View GitHub Profile
inotifywait -m -r -e close_write --exclude '.*\.sw[a-z]' src/ | while read line; do make ; done
@fs111
fs111 / gist:1866388
Created February 19, 2012 23:09
unbound config
server:
# it's a server with multiple interfaces, it should listen on all in my case
interface: 0.0.0.0
# also on IPv6
interface: ::0
# put your networks in CIDR syntax here, you can block things with deny or refuse
access-control: 192.168.111.0/24 allow
# one per core is a good idea
mvn eclipse:configure-workspace -Declipse.workspace=$HOME/workspace
git clone project
cd project
mvn eclipse:eclipse -U (downloads entire internet twice here)
Got to eclipse. In the project explorer: Right click -> Import -> General -> existing project into workspace
@fs111
fs111 / gist:3097209
Created July 12, 2012 10:18
nexus commandline search
#!/bin/bash
# command line search script for nexus instances. Needs curl and xmlstarlet
# installed.
NEXUS_URL="http://nexus.example.com/nexus/service/local/lucene/search?q="
# make sure we got exactly one param
if [ ! $# -eq 1 ]
then
# thing to parse
foo="1.2.3"
# spilt in array
IFS=. read -a arr <<< $foo
echo ${arr[0]}
# prints 1 2 3 and not just 1, as I expected
@fs111
fs111 / gist:5876763
Created June 27, 2013 14:15
listing scalding product base dir after running the tests
$ ls
CHANGES.md com.twitter.scalding.Tsv451708957 com.twitter.scalding.Tsv871939019 com.twitter.scalding.TypedDelimited588447730
com.twitter.scalding.Tsv1010621292 com.twitter.scalding.Tsv453575431 com.twitter.scalding.Tsv879106983 com.twitter.scalding.TypedDelimited632247534
com.twitter.scalding.Tsv1023843885 com.twitter.scalding.Tsv478347316 com.twitter.scalding.Tsv889505205 com.twitter.scalding.TypedDelimited679693840
com.twitter.scalding.Tsv1064251599 com.twitter.scalding.Tsv495601443 com.twitter.scalding.Tsv894534353 com.twitter.scalding.TypedDelimited682488322
com.twitter.scalding.Tsv109113277 com.twitter.scalding.Tsv497252881 com.twitter.scalding.Tsv911658113 com.twitter.scalding.TypedDelimited688323360
com.twitter.scalding.Tsv143908926 com.twitter.scalding.Tsv505033465 com.twitter.scalding.Tsv934120314 com.twitter.scalding.TypedDelimited699747546
com.twitter.scalding.Tsv148690629 com.twitte
@fs111
fs111 / gist:5878918
Last active December 19, 2015 01:49
[info] + throw errors for misordered ranges
[error] x A TypedPipeHashJoinJob should
[error] x system error
[error] unknown type: scala.Tuple2 (Coercions.java:158)
[error] cascading.tuple.coerce.Coercions.coercibleTypeFor(Coercions.java:158)
[error] cascading.tuple.coerce.Coercions.coercibleArray(Coercions.java:216)
[error] cascading.scheme.util.DelimitedParser.reset(DelimitedParser.java:178)
[error] cascading.scheme.util.DelimitedParser.reset(DelimitedParser.java:126)
[error] cascading.scheme.local.TextDelimited.setSourceFields(TextDelimited.java:595)
[error] cascading.scheme.local.TextDelimited.<init>(TextDelimited.java:521)
>>> d = {"a":42}
>>> t = d,
>>> l = [t]
>>> l[0][0]['a']
42
$ du -sch .sbt .lein .gradle .m2 .ivy2
108M .sbt
14M .lein
167M .gradle
659M .m2
87M .ivy2
1.1G total
@fs111
fs111 / gist:7013230
Created October 16, 2013 19:18
These are the notes from my talk about lingual during the big data beer meetup in Berlin: http://www.meetup.com/Big-Data-Beers/events/143392512/

Lingual - ANSI SQL for apache hadoop

Big Data Beers Berlin, October 16th 2013

Speaker

  • André Kelpe | @fs111 | andre[at]concurrentinc[dot]com
  • works for concurrent inc (http://concurrentinc.com)
    • company behind Cacading and Lingual

Cascading