Skip to content

Instantly share code, notes, and snippets.

View vinicioflores's full-sized avatar

Vinicio F. Hernandez vinicioflores

4 followers · 30 following
View GitHub Profile
@vinicioflores
vinicioflores / hot_threads_2
Created January 20, 2020 15:35
::: {arm-or-007_data}{9zEBQRPGTpSA_plraQfAMA}{ldXxb_vgT2ymHGKq8OoxBw}{plxcq8203.pdx.intel.com}{10.38.167.173:9300}{ibi_site=pdx, box_type=hot}
Hot threads at 2020-01-20T15:34:21.469Z, interval=500ms, busiestThreads=3, ignoreIdleThreads=true:
2.6% (13.1ms out of 500ms) cpu usage by thread 'elasticsearch[arm-or-007_data][bulk][T#3]'
2/10 snapshots sharing following 5 elements
org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:672)
org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
java.lang.Thread.run(Thread.java:748)
@vinicioflores
vinicioflores / hot threads 1
Created January 10, 2020 20:50
::: {arm-or-007_data}{9zEBQRPGTpSA_plraQfAMA}{ldXxb_vgT2ymHGKq8OoxBw}{plxcq8203.pdx.intel.com}{10.38.167.173:9300}{ibi_site=pdx, box_type=hot}
Hot threads at 2020-01-10T20:48:09.407Z, interval=500ms, busiestThreads=3, ignoreIdleThreads=true:
5.3% (26.6ms out of 500ms) cpu usage by thread 'elasticsearch[arm-or-007_data][bulk][T#2]'
3/10 snapshots sharing following 32 elements
org.elasticsearch.index.shard.IndexShard.index(IndexShard.java:738)
org.elasticsearch.index.shard.IndexShard.applyIndexOperation(IndexShard.java:707)
org.elasticsearch.index.shard.IndexShard.applyIndexOperationOnPrimary(IndexShard.java:673)
org.elasticsearch.action.bulk.TransportShardBulkAction.executeIndexRequestOnPrimary(TransportShardBulkAction.java:548)
org.elasticsearch.action.bulk.TransportShardBulkAction.executeUpdateRequestOnce(TransportShardBulkAction.java:359)
@vinicioflores
vinicioflores / gist:d58bbfb9cccaf2bd3b075f0601b3ff5d
Created December 17, 2019 15:23
{
"_shards": {
"total": 80,
"successful": 80,
"failed": 0
},
"_all": {
"primaries": {
"docs": {
"count": 6717777,
@vinicioflores
vinicioflores / nodes stats
Created December 17, 2019 15:18
{
"_nodes": {
"total": 20,
"successful": 20,
"failed": 0
},
"cluster_name": "ibi.arm2.us",
"nodes": {
"a5voC7oXSf-78LfPlJ45Yg": {
"timestamp": 1576595678727,
@vinicioflores
vinicioflores / thread pool 1
Created December 13, 2019 19:48
node_name name active queue rejected
arm-or-005_data bulk 0 0 792
arm-or-005_data fetch_shard_started 0 0 0
arm-or-005_data fetch_shard_store 0 0 0
arm-or-005_data flush 0 0 0
arm-or-005_data force_merge 0 0 0
arm-or-005_data generic 5 0 0
arm-or-005_data get 0 0 0
arm-or-005_data index 0 0 0
arm-or-005_data listener 0 0 0
@vinicioflores
vinicioflores / problematic index
Last active December 13, 2019 17:02
{
"daas-arm-prod-users-2019-12": {
"aliases": {
"daas-arm-users": {}
},
"mappings": {
"_default_": {
"dynamic_templates": [
{
"string_fields": {
@vinicioflores
vinicioflores / shard recovery
Created December 13, 2019 17:00
i s t source_node target_node files files_total bytes translog_ops
apm-6.2.4-2019.12.10 0 859ms arm-or-002_data arm-or-005_data 1 1 230 4
apm-6.2.4-2019.12.10 0 9s arm-or-002_data arm-or-009_data 22 22 13140356 0
apm-6.2.4-2019.12.11 0 2.8s arm-or-010_data arm-or-001_data 1 1 230 0
apm-6.2.4-2019.12.11 0 2.6m arm-or-010_data arm-or-006_data 1 1 230 19667
apm-6.2.4-2019.12.12 0 34ms n/a arm-or-008_data 0 0 0 0
apm-6.2.4-2019.12.12 0 1.6s arm-or-008_data arm-or-009_data 1 1 230 0
apm-6.2.
@vinicioflores
vinicioflores / shards
Created December 13, 2019 16:56
i s p st d n
packetbeat-2019.12.02 2 r STARTED 15509 arm-or-001_data
packetbeat-2019.12.02 2 p STARTED 15509 arm-or-008_data
packetbeat-2019.12.02 4 p STARTED 15438 arm-or-004_data
packetbeat-2019.12.02 4 r STARTED 15438 arm-or-003_data
packetbeat-2019.12.02 3 r STARTED 15398 arm-or-002_data
packetbeat-2019.12.02 3 p STARTED 15398 arm-or-009_data
packetbeat-2019.12.02 1 r STARTED 15474 arm-or-005_data
packetbeat-2019.12.02 1 p STARTED 15474 arm-or-006_data
packetbeat-2019.12.02
@vinicioflores
vinicioflores / gist:5a150b1a25e094ef16a15ed9690b4b51
Created December 12, 2019 23:55
Hot Threads ES
::: {arm-or-001_master}{vACvBzd5RiqvDDgWNvY6EQ}{TrPh5fRwRjKvxpYgV2h_oA}{plxcq8197.myserver.com}{x.x.x.x:9301}{ibi_site=pdx, box_type=hot}
Hot threads at 2019-12-12T23:52:10.447Z, interval=500ms, busiestThreads=3, ignoreIdleThreads=true:
0.0% (50.8micros out of 500ms) cpu usage by thread 'elasticsearch[arm-or-001_master][[timer]]'
10/10 snapshots sharing following 2 elements
java.lang.Thread.sleep(Native Method)
org.elasticsearch.threadpool.ThreadPool$CachedTimeThread.run(ThreadPool.java:541)
::: {arm-or-009_data}{f0aSRTkDQommICaE9nQRBg}{JMnusso4RfCBpFObfysMTA}{plxcq8205.myserver.com}{x.x.x.x:9300}{ibi_site=pdx, box_type=hot}
Hot threads at 2019-12-12T23:52:10.410Z, interval=500ms, busiestThreads=3, ignoreIdleThreads=true:
@vinicioflores
vinicioflores / bulk_requests.json
Created December 12, 2019 15:12
Elastic Bulk Request examples
{
"nodes": {
"a5voC7oXSf-78LfPlJ45Yg": {
"name": "arm-or-009_ingest",
"transport_address": "**.**.**.**:9600",
"host": "mytinynode1.server.com",
"ip": "**.**.**.**:9600",
"roles": [
"ingest"