Skip to content

Instantly share code, notes, and snippets.

View zerokarmaleft's full-sized avatar

Edward Cho zerokarmaleft

22 followers · 0 following
View GitHub Profile
@zerokarmaleft
zerokarmaleft / trace.clj
Created December 4, 2012 20:43
stack overflow in reducer
ERROR - caught Throwable, no trap available, rethrowing
cascading.pipe.OperatorException: [803c4175-eb65-4168-bec...][cascalog.workflow$buffer$fn__572.invoke(workflow.clj:249)] operator Every failed executing operation: ClojureBuffer[decl:'?minhash-sig']
at cascading.flow.stream.BufferEveryWindow.receive(BufferEveryWindow.java:139)
at cascading.flow.stream.BufferEveryWindow.receive(BufferEveryWindow.java:41)
at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:90)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:129)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:463)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:411)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:215)
Caused by: java.lang.StackOverflowError
@zerokarmaleft
zerokarmaleft / merge.rb
Created December 4, 2012 21:43
in `delete': invalid byte sequence in UTF-8 (ArgumentError)
# encoding: utf-8
merged_file = File.open("rfc-all.txt", "w")
Dir.entries(".").each do |file|
if (file != "rfc-all.txt" and File.extname(file) == ".txt")
merged_file.print "#{ file }\t"
File.open(file).each do |line|
merged_file.print line.chomp.delete "\t"
end
merged_file.print "\n"
@zerokarmaleft
zerokarmaleft / encodings.txt
Created December 4, 2012 22:06
Deviations from ASCII English
./rfc101.txt: ISO-8859 English text
./rfc1061.txt: ASCII text
./rfc1182.txt: ASCII text
./rfc1260.txt: ASCII text
./rfc1305.txt: ISO-8859 English text
./rfc14.txt: ASCII text
./rfc1489.txt: ASCII FORTRAN program text
./rfc159.txt: ASCII text
./rfc16.txt: ASCII text
./rfc162.txt: ASCII Pascal program text
@zerokarmaleft
zerokarmaleft / medicat.rb
Last active December 14, 2015 06:39 — forked from laod/medicat.rb
map = [
#general
{name: "Patient Control ID", value: nil},
{name: "SSN", value: nil},
{name: "Other ID", source: :ldap, source_name: "datatelid"},
{name: "Last Name", source: :ldap, source_name: "sn"},
{name: "First Name", source: :ldap, source_name: "givenName"},
{name: "Middle Initial", source: :ldap, source_name: "initials", mapper: Proc.new {|v| v[0]}},
{name: "Sex", source_name: "gender", source: :ods},
{name: "Address", source: :ods, source_name: ["home_address_line_1","home_address_line_2"], mapper: Proc.new{|v| v.join " "}},
@zerokarmaleft
zerokarmaleft / Vagrantfile
Created February 28, 2013 17:08
bare bones node for application_python
# -*- mode: ruby -*-
# vi: set ft=ruby :
Vagrant::Config.run do |config|
config.vm.box = "precise32"
config.vm.network :hostonly, "33.33.33.10"
config.vm.provision :chef_client do |chef|
chef.chef_server_url = "https://api.opscode.com/organizations/#{ENV['ORGNAME']}"
@zerokarmaleft
zerokarmaleft / example.rb
Created March 20, 2013 18:18
Adventures in Functional Ruby, Part 1
require 'java'
require 'jbundler'
require 'stunted'
%w{ PersistentArrayMap, PersistentHashMap, PersistentHashSet, PersistentList,
PersistentQueue, PersistentStructMap, PersistentTreeMap, PersistentTreeSet,
PersistentVector }.each do |data_structure|
java_import "clojure.lang.#{ data_structure }"
end
@zerokarmaleft
zerokarmaleft / stm.rb
Last active December 15, 2015 06:29
Adventures in Functional Ruby, Part 2
require 'java'
require 'jbundler'
require 'stunted'
java_import 'clojure.lang.Ref'
java_import 'clojure.lang.LockingTransaction'
java_import 'java.util.concurrent.Executors'
java_import 'java.util.concurrent.Callable'
module CoreBridge
@zerokarmaleft
zerokarmaleft / actual.sql
Last active December 17, 2015 04:59
Sequel::DatabaseError: TinyTds::Error: Incorrect syntax near the keyword 'AS'. from /home/echo/.rvm/gems/ruby-2.0.0-p0/gems/sequel-3.47.0/lib/sequel/adapters/tinytds.rb:234:in `fields'
SELECT ([SUBJECTID], [NUM_BDI_TIMEPOINTS])
FROM [SUBJECTIDENTIFIERS]
INNER JOIN (SELECT [SUBJECTID], count([BDI_TP]) AS [NUM_BDI_TIMEPOINTS]
FROM [BDIS_OUTPUT]
WHERE ((([BDI_TP] COLLATE Latin1_General_CS_AS)
LIKE
(N'Y%' COLLATE Latin1_General_CS_AS) ESCAPE N'\\'))
GROUP BY [SUBJECTID]) AS [T1]
ON ([T1].[SUBJECTID] = [SUBJECTIDENTIFIERS].[SUBJECTID])
@zerokarmaleft
zerokarmaleft / ping-pong.cljs
Last active December 20, 2015 06:09
core.async example: Ping Pong
(defn player
[msg table]
(go (loop []
(let [ball (<! table)] ;; the ball was hit to this player
(.log js/console msg)
(<! (timeout 100)) ;; wait 100msecs
(>! table (update-in ball [:hits] inc)) ;; hit the ball back
(recur)))))
(defn game
@zerokarmaleft
zerokarmaleft / http-kit.txt
Created November 20, 2013 20:36
silly latency comparison between ring adapters from http-kit and Jetty
∴ > ab -n 1000000 -c 1000 -p /dev/null http://localhost:3000/debug-count
This is ApacheBench, Version 2.3 <$Revision: 1430300 $>
Copyright 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Licensed to The Apache Software Foundation, http://www.apache.org/
Benchmarking localhost (be patient)
Completed 100000 requests
Completed 200000 requests
Completed 300000 requests
Completed 400000 requests