Skip to content

Instantly share code, notes, and snippets.

View alexsisu's full-sized avatar

Alexandru Sisu alexsisu

  • bigdataresearch.io
  • Romania
View GitHub Profile
mport os
import sys
import psutil
import pyarrow.parquet as pq
import time
import cudf
import subprocess
from subprocess import Popen, PIPE
from blazingsql import BlazingContext

Business Models

Advertising

Models Examples
Display ads Yahoo!
Search ads Google
@alexsisu
alexsisu / gist:3235953
Created August 2, 2012 09:45
Thread CPU consumption by id.
Tasks: 232 total, 1 running, 231 sleeping, 0 stopped, 0 zombie
Cpu(s): 1.9%us, 0.2%sy, 0.0%ni, 97.9%id, 0.0%wa, 0.0%hi, 0.0%si, 0.0%st
Mem: 132150264k total, 129247212k used, 2903052k free, 168804k buffers
Swap: 67190776k total, 306704k used, 66884072k free, 15678276k cached
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
5218 buzzcapt 20 0 126g 102g 8912 R 100.8 81.2 2352:08 java
5252 buzzcapt 20 0 126g 102g 8912 S 1.0 81.2 17:26.02 java
65018 buzzcapt 20 0 126g 102g 8912 S 1.0 81.2
@alexsisu
alexsisu / buzz_jstack_cpu_idle_snapshot1
Created August 1, 2012 13:50
high cpu consumption 200% in the last 2 days.
2012-08-01 14:38:26
Full thread dump Java HotSpot(TM) 64-Bit Server VM (20.2-b06 mixed mode):
"Attach Listener" daemon prio=10 tid=0x00007fd580001800 nid=0xc237 waiting on condition [0x0000000000000000]
java.lang.Thread.State: RUNNABLE
Locked ownable synchronizers:
- None
"elasticsearch[artemis2]http_server_worker-pool-23-thread-6236" daemon prio=10 tid=0x00007fd4f8269000 nid=0xc1d5 waiting on condition [0x00007fd486659000]
@alexsisu
alexsisu / partial_update_maybe_issue
Created April 16, 2012 12:04
ElasticSearch partial field update: remove element from array, does not work
curl -XPUT 'http://localhost:9200/testindex' -d '{
"settings":
{
"number_of_shards": 1,
"number_of_replicas": 0
}
}
'
curl -XPUT 'http://localhost:9200/testindex/posting/_mapping' -d '
@alexsisu
alexsisu / jhat_es_hprof_stat
Created December 19, 2011 14:05
jhat_es_hprof_stat
Heap Histogram
All Classes (excluding platform)
Class Instance Count Total Size
class [I 2287 10128210616
class [B 3280 463710673
class [J 1586 50219808
class [C 38406 1842394
class [Ljava.util.HashMap$Entry; 6683 1128912
@alexsisu
alexsisu / jstack_es_blocked
Created December 12, 2011 15:50
jstack elastic_search
Thread 19023: (state = BLOCKED)
- org.elasticsearch.index.field.data.support.FieldDataLoader.load(org.apache.lucene.index.IndexReader, java.lang.String, org.elasticsearch.index.field.data.support.FieldDataLoader$TypeLoader) @bci=107, line=57 (Compiled frame; information may be imprecise)
- org.elasticsearch.index.field.data.strings.StringFieldData.load(org.apache.lucene.index.IndexReader, java.lang.String) @bci=9, line=84 (Interpreted frame)
- org.elasticsearch.index.field.data.strings.StringFieldDataType.load(org.apache.lucene.index.IndexReader, java.lang.String) @bci=2, line=52 (Interpreted frame)
- org.elasticsearch.index.field.data.strings.StringFieldDataType.load(org.apache.lucene.index.IndexReader, java.lang.String) @bci=3, line=34 (Interpreted frame)
- org.elasticsearch.index.field.data.FieldData.load(org.elasticsearch.index.field.data.FieldDataType, org.apache.lucene.index.IndexReader, java.lang.String) @bci=3, line=110 (Interpreted frame)
- org.elasticsearch.index.cache.field.data.support.Abstr