Skip to content

Instantly share code, notes, and snippets.

View edsolovey's full-sized avatar

Ed Solovey edsolovey

  • Crashlytics
  • Cambridge, MA
View GitHub Profile

Keybase proof

I hereby claim:

  • I am edsolovey on github.
  • I am edsol18 (https://keybase.io/edsol18) on keybase.
  • I have a public key ASB-RUWMKPFmGzitxszOYullGtwrIgbqwF0R6GjimOtFnwo

To claim this, I am signing this object:

@edsolovey
edsolovey / gist:001d1a5353dd9d3c14cccf6678312ecb
Last active June 1, 2017 15:40
drop predefined tables from answers-speed-cassandra
DROP TABLE pe_metric_time_series_history;
DROP TABLE pe_metric_time_series_now;
DROP TABLE pe_metric_time_series_bootstrap;
DROP TABLE pe_event_count_metadata;
DROP TABLE pe_attribute_metadata;
DROP TABLE pe_count_history;
DROP TABLE pe_cardinality_history;
DROP TABLE pe_cardinality_hll;
# want to keep this table for a few more weeks
@edsolovey
edsolovey / gist:4740bca044de708cec1f78596a2ea2e2
Last active May 31, 2017 18:09
Commands to drop Answers custom events tables from old, coupled cassandra cluster
use speed_data;
drop table ce_metric_time_series_history;
drop table ce_metric_time_series_now;
drop table ce_metric_time_series_bootstrap;
drop table ce_event_count_metadata;
drop table ce_attribute_metadata;
drop table ce_count_history;
drop table ce_cardinality_history;
drop table ce_cardinality_hll;
@edsolovey
edsolovey / gist:7813142
Created December 5, 2013 20:19
full hadoop failure for cascalog job
This file has been truncated, but you can view the full file.
Meta VERSION="1" .
Job JOBID="job_201312051335_0001" JOBNAME="[036587AB8D9243BFAE98BA5FD15E5A68/7F1027AA3FD1417A90FEF7558A91C91E] /(4/7)" USER="hadoop" SUBMIT_TIME="1386250738895" JOBCONF="hdfs://10\.180\.210\.78:9000/mnt/var/lib/hadoop/tmp/mapred/staging/hadoop/\.staging/job_201312051335_0001/job\.xml" VIEW_JOB="*" MODIFY_JOB="*" JOB_QUEUE="default" .
Job JOBID="job_201312051335_0001" JOB_PRIORITY="NORMAL" .
Job JOBID="job_201312051335_0001" LAUNCH_TIME="1386250740295" TOTAL_MAPS="910" TOTAL_REDUCES="257" JOB_STATUS="PREP" .
Task TASKID="task_201312051335_0001_m_000911" TASK_TYPE="SETUP" START_TIME="1386250740332" SPLITS="" .
MapAttempt TASK_TYPE="SETUP" TASKID="task_201312051335_0001_m_000911" TASK_ATTEMPT_ID="attempt_201312051335_0001_m_000911_0" START_TIME="1386250747256" TRACKER_NAME="tracker_10\.180\.202\.223:localhost/127\.0\.0\.1:33412" HTTP_PORT="9103" .
MapAttempt TASK_TYPE="SETUP" TASKID="task_201312051335_0001_m_000911" TASK_ATTEMPT_ID="attempt_201312051335_0001_m_000911_0" TASK_STATUS="SUCCESS" F
@edsolovey
edsolovey / gist:7812974
Created December 5, 2013 20:08
cascalog on EMR error
Task TASKID="task_201312051335_0001_r_000016" TASK_TYPE="REDUCE" TASK_STATUS="FAILED" FINISH_TIME="1386259343092" ERROR="cascading\.pipe\.OperatorException: [c59c883e-a9e5-47d7-90b\.\.\.][sun\.reflect\.NativeConstructorAccessorImpl\.newInstance0(Native Method)] operator Every failed executing operation: FastFirst[decl:ARGS]
at cascading\.flow\.stream\.BufferEveryWindow\.receive(BufferEveryWindow\.java:151)
at cascading\.flow\.stream\.BufferEveryWindow\.receive(BufferEveryWindow\.java:41)
at cascading\.flow\.hadoop\.stream\.HadoopGroupGate\.run(HadoopGroupGate\.java:90)
at cascading\.flow\.hadoop\.FlowReducer\.reduce(FlowReducer\.java:133)
at org\.apache\.hadoop\.mapred\.ReduceTask\.runOldReducer(ReduceTask\.java:528)
at org\.apache\.hadoop\.mapred\.ReduceTask\.run(ReduceTask\.java:429)
at org\.apache\.hadoop\.mapred\.Child$4\.run(Child\.java:255)
at java\.security\.AccessController\.doPrivileged(Native Method)
at javax\.security\.auth\.Subject\.doAs(Subject\.java:396)