Skip to content

Instantly share code, notes, and snippets.

@AlexMikhalev
Created May 22, 2020 14:01
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save AlexMikhalev/e3f8c8da7d0d865c88d06fa6af5e4c1a to your computer and use it in GitHub Desktop.
Save AlexMikhalev/e3f8c8da7d0d865c88d06fa6af5e4c1a to your computer and use it in GitHub Desktop.
RedisGearsSegfault
161783:S 22 May 2020 15:59:26.305 # === ASSERTION FAILED ===
161783:S 22 May 2020 15:59:26.305 # ==> src/cluster.c:215 'reply->type == REDIS_REPLY_STATUS' is not true
161783:S 22 May 2020 15:59:26.305 # (forcing SIGSEGV to print the bug report.)
161783:S 22 May 2020 15:59:26.305 # Redis 6.0.1 crashed by signal: 11
161783:S 22 May 2020 15:59:26.305 # Crashed running the instruction at: 0x55dbdad6b99f
161783:S 22 May 2020 15:59:26.305 # Accessing address: 0xffffffffffffffff
161783:S 22 May 2020 15:59:26.305 # Failed assertion: reply->type == REDIS_REPLY_STATUS (src/cluster.c:215)
------ STACK TRACE ------
EIP:
../../src//redis-server *:30001 [cluster](_serverAssert+0x6f)[0x55dbdad6b99f]
Backtrace:
../../src//redis-server *:30001 [cluster](logStackTrace+0x4f)[0x55dbdad6e84f]
../../src//redis-server *:30001 [cluster](sigsegvHandler+0xb5)[0x55dbdad6f055]
/lib/x86_64-linux-gnu/libpthread.so.0(+0x153c0)[0x7ff9d0fc63c0]
../../src//redis-server *:30001 [cluster](_serverAssert+0x6f)[0x55dbdad6b99f]
/home/alex/RedisGears/redisgears.so(+0x103576)[0x7ff9cf855576]
/home/alex/RedisGears/redisgears.so(+0x1165f1)[0x7ff9cf8685f1]
/home/alex/RedisGears/redisgears.so(+0x122835)[0x7ff9cf874835]
/home/alex/RedisGears/redisgears.so(+0x122d42)[0x7ff9cf874d42]
/home/alex/RedisGears/redisgears.so(event_base_loop+0x2db)[0x7ff9cf8754f6]
/home/alex/RedisGears/redisgears.so(+0x102e09)[0x7ff9cf854e09]
/lib/x86_64-linux-gnu/libpthread.so.0(+0x9609)[0x7ff9d0fba609]
/lib/x86_64-linux-gnu/libc.so.6(clone+0x43)[0x7ff9d0ee1103]
------ INFO OUTPUT ------
# Server
redis_version:6.0.1
redis_git_sha1:47ff1363
redis_git_dirty:0
redis_build_id:26c5c06ff47d2e6c
redis_mode:cluster
os:Linux 5.4.0-31-generic x86_64
arch_bits:64
multiplexing_api:epoll
atomicvar_api:atomic-builtin
gcc_version:9.3.0
process_id:161783
run_id:1e9a4be7543682d88f7faaed7cebf5a2528e06ce
tcp_port:30001
uptime_in_seconds:4745
uptime_in_days:0
hz:10
configured_hz:10
lru_clock:13097662
executable:/home/alex/redis/src//redis-server
config_file:
# Clients
connected_clients:8
client_recent_max_input_buffer:2
client_recent_max_output_buffer:0
blocked_clients:0
tracking_clients:0
clients_in_timeout_table:0
# Memory
used_memory:12461549064
used_memory_human:11.61G
used_memory_rss:18521878528
used_memory_rss_human:17.25G
used_memory_peak:13266853224
used_memory_peak_human:12.36G
used_memory_peak_perc:93.93%
used_memory_overhead:7973522
used_memory_startup:5832008
used_memory_dataset:12453575542
used_memory_dataset_perc:99.98%
allocator_allocated:12462719152
allocator_active:12465238016
allocator_resident:13346742272
total_system_memory:270163525632
total_system_memory_human:251.61G
used_memory_lua:37888
used_memory_lua_human:37.00K
used_memory_scripts:0
used_memory_scripts_human:0B
number_of_cached_scripts:0
maxmemory:0
maxmemory_human:0B
maxmemory_policy:noeviction
allocator_frag_ratio:1.00
allocator_frag_bytes:2518864
allocator_rss_ratio:1.07
allocator_rss_bytes:881504256
rss_overhead_ratio:1.39
rss_overhead_bytes:5175136256
mem_fragmentation_ratio:1.49
mem_fragmentation_bytes:6060331800
mem_not_counted_for_evict:1546
mem_replication_backlog:1048576
mem_clients_slaves:0
mem_clients_normal:135888
mem_aof_buffer:1546
mem_allocator:jemalloc-5.1.0
active_defrag_running:0
lazyfree_pending_objects:0
# Persistence
loading:0
rdb_changes_since_last_save:34920
rdb_bgsave_in_progress:0
rdb_last_save_time:1590151233
rdb_last_bgsave_status:ok
rdb_last_bgsave_time_sec:0
rdb_current_bgsave_time_sec:-1
rdb_last_cow_size:483328
aof_enabled:1
aof_rewrite_in_progress:0
aof_rewrite_scheduled:0
aof_last_rewrite_time_sec:0
aof_current_rewrite_time_sec:-1
aof_last_bgrewrite_status:ok
aof_last_write_status:ok
aof_last_cow_size:122753024
module_fork_in_progress:0
module_fork_last_cow_size:0
aof_current_size:65370510
aof_base_size:51360316
aof_pending_rewrite:0
aof_buffer_length:0
aof_rewrite_buffer_length:0
aof_pending_bio_fsync:0
aof_delayed_fsync:0
# Stats
total_connections_received:64
total_commands_processed:68629
instantaneous_ops_per_sec:0
total_net_input_bytes:83119116
total_net_output_bytes:64528262
instantaneous_input_kbps:0.00
instantaneous_output_kbps:0.05
rejected_connections:0
sync_full:1
sync_partial_ok:0
sync_partial_err:1
expired_keys:0
expired_stale_perc:0.00
expired_time_cap_reached_count:0
expire_cycle_cpu_milliseconds:2
evicted_keys:0
keyspace_hits:10114
keyspace_misses:0
pubsub_channels:0
pubsub_patterns:0
latest_fork_usec:15931
migrate_cached_sockets:0
slave_expires_tracked_keys:0
active_defrag_hits:0
active_defrag_misses:0
active_defrag_key_hits:0
active_defrag_key_misses:0
tracking_total_keys:0
tracking_total_items:0
unexpected_error_replies:0
# Replication
role:slave
master_host:10.144.17.211
master_port:30008
master_link_status:up
master_last_io_seconds_ago:9
master_sync_in_progress:0
slave_repl_offset:65376967
slave_priority:100
slave_read_only:1
connected_slaves:0
master_replid:a9b01873faff16da7e2c04e2f863866977092665
master_replid2:0000000000000000000000000000000000000000
master_repl_offset:65376967
master_repl_meaningful_offset:65370737
second_repl_offset:-1
repl_backlog_active:1
repl_backlog_size:1048576
repl_backlog_first_byte_offset:64328392
repl_backlog_histlen:1048576
# CPU
used_cpu_sys:1707.466494
used_cpu_user:1645.542949
used_cpu_sys_children:8.913478
used_cpu_user_children:44.234805
# Modules
module:name=rg,ver=999999,api=1,filters=0,usedby=[],using=[],options=[]
# Commandstats
cmdstat_rg.refreshcluster:calls=1,usec=31,usec_per_call=31.00
cmdstat_psync:calls=1,usec=1043,usec_per_call=1043.00
cmdstat_replconf:calls=221,usec=299,usec_per_call=1.35
cmdstat_xadd:calls=17332,usec=60948,usec_per_call=3.52
cmdstat_ping:calls=459,usec=244,usec_per_call=0.53
cmdstat_set:calls=17335,usec=34574,usec_per_call=1.99
cmdstat_select:calls=1,usec=0,usec_per_call=0.00
cmdstat_scan:calls=4,usec=11129,usec_per_call=2782.25
cmdstat_rg.pyexecute:calls=8,usec=27271,usec_per_call=3408.88
cmdstat_xclaim:calls=82,usec=1066,usec_per_call=13.00
cmdstat_xtrim:calls=82,usec=290,usec_per_call=3.54
cmdstat_rg.hello:calls=5,usec=218,usec_per_call=43.60
cmdstat_config:calls=2,usec=52,usec_per_call=26.00
cmdstat_RG.INNERMSGCOMMAND:calls=32295,usec=227560,usec_per_call=7.05
cmdstat_del:calls=3,usec=17,usec_per_call=5.67
cmdstat_xgroup:calls=1,usec=7,usec_per_call=7.00
cmdstat_cluster:calls=360,usec=217046,usec_per_call=602.91
cmdstat_client:calls=1,usec=4,usec_per_call=4.00
cmdstat_xack:calls=82,usec=216,usec_per_call=2.63
cmdstat_info:calls=354,usec=34889,usec_per_call=98.56
# Cluster
cluster_enabled:1
# Keyspace
db0:keys=17334,expires=0,avg_ttl=0
------ CLIENT LIST OUTPUT ------
id=17 addr=10.144.17.211:55874 fd=43 name= age=4617 idle=4214 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=RG.INNERMSGCOMMAND user=default
id=19 addr=10.144.17.211:55884 fd=44 name= age=4617 idle=4225 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=RG.INNERMSGCOMMAND user=default
id=64 addr=10.144.17.211:30008 fd=60 name= age=4504 idle=9 flags=M db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping user=(superuser)
id=29 addr=10.144.17.211:55922 fd=53 name= age=4616 idle=4217 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=RG.INNERMSGCOMMAND user=default
id=117 addr=10.144.71.41:56226 fd=29 name=RedisInsight age=3402 idle=21 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=cluster user=default
id=25 addr=10.144.17.211:55904 fd=51 name= age=4617 idle=4229 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=RG.INNERMSGCOMMAND user=default
id=27 addr=10.144.17.211:55914 fd=52 name= age=4617 idle=4219 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=RG.INNERMSGCOMMAND user=default
id=116 addr=10.144.71.41:56219 fd=28 name= age=3407 idle=3 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=info user=default
------ REGISTERS ------
161783:S 22 May 2020 15:59:26.305 #
RAX:0000000000000000 RBX:00000000000000d7
RCX:0000000000000001 RDX:0000000000000000
RDI:00007ff9bc000908 RSI:00007ff9bc0030d0
RBP:00007ff9cfa2f56f RSP:00007ff9cf74f490
R8 :0000000000000000 R9 :000000000000004f
R10:000055dbdae564d0 R11:0000000000000202
R12:00007ff9cfa2f228 R13:00007ffff9bbf99f
R14:00007ffff9bbf9a0 R15:00007ff99c004ee0
RIP:000055dbdad6b99f EFL:0000000000010206
CSGSFS:002b000000000033
161783:S 22 May 2020 15:59:26.305 # (00007ff9cf74f49f) -> 00007ff9c9a64230
161783:S 22 May 2020 15:59:26.305 # (00007ff9cf74f49e) -> 0000004800000001
161783:S 22 May 2020 15:59:26.305 # (00007ff9cf74f49d) -> 00007ff9cf855530
161783:S 22 May 2020 15:59:26.305 # (00007ff9cf74f49c) -> 00007ff99c003b20
161783:S 22 May 2020 15:59:26.305 # (00007ff9cf74f49b) -> 00007ff99c0020c0
161783:S 22 May 2020 15:59:26.305 # (00007ff9cf74f49a) -> 0000000000000001
161783:S 22 May 2020 15:59:26.305 # (00007ff9cf74f499) -> 00007ff9bc001490
161783:S 22 May 2020 15:59:26.305 # (00007ff9cf74f498) -> 000055dbdcbb6440
161783:S 22 May 2020 15:59:26.305 # (00007ff9cf74f497) -> 000055dbdcbb8af0
161783:S 22 May 2020 15:59:26.305 # (00007ff9cf74f496) -> 00000023cf74f550
161783:S 22 May 2020 15:59:26.305 # (00007ff9cf74f495) -> 00007ff9cf8685f1
161783:S 22 May 2020 15:59:26.305 # (00007ff9cf74f494) -> 00007ff9cf855530
161783:S 22 May 2020 15:59:26.305 # (00007ff9cf74f493) -> 00007ff9cf855576
161783:S 22 May 2020 15:59:26.305 # (00007ff9cf74f492) -> 00007ff99c0020c0
161783:S 22 May 2020 15:59:26.305 # (00007ff9cf74f491) -> 00007ff9cf74f4e8
161783:S 22 May 2020 15:59:26.305 # (00007ff9cf74f490) -> 00007ff9cf74f4f0
------ MODULES INFO OUTPUT ------
------ FAST MEMORY TEST ------
161783:S 22 May 2020 15:59:26.306 # Bio thread for job type #0 terminated
161783:S 22 May 2020 15:59:26.306 # Bio thread for job type #1 terminated
161783:S 22 May 2020 15:59:26.306 # Bio thread for job type #2 terminated
*** Preparing to test memory region 55dbdaec3000 (2277376 bytes)
*** Preparing to test memory region 55dbdcba9000 (135168 bytes)
*** Preparing to test memory region 7feff5882000 (3758096384 bytes)
*** Preparing to test memory region 7ff161a1f000 (3221225472 bytes)
*** Preparing to test memory region 7ff221a1f000 (2351550464 bytes)
*** Preparing to test memory region 7ff30b425000 (2013265920 bytes)
*** Preparing to test memory region 7ff43e2f7000 (10066329600 bytes)
*** Preparing to test memory region 7ff6c4f2c000 (1610612736 bytes)
*** Preparing to test memory region 7ff753b61000 (1342177280 bytes)
*** Preparing to test memory region 7ff7d2796000 (1073741824 bytes)
*** Preparing to test memory region 7ff870000000 (2952925184 bytes)
*** Preparing to test memory region 7ff924000000 (135168 bytes)
*** Preparing to test memory region 7ff928000000 (62296064 bytes)
*** Preparing to test memory region 7ff92defa000 (184549376 bytes)
*** Preparing to test memory region 7ff93ac00000 (29360128 bytes)
*** Preparing to test memory region 7ff93c8fa000 (100663296 bytes)
*** Preparing to test memory region 7ff943000000 (48234496 bytes)
*** Preparing to test memory region 7ff946800000 (10485760 bytes)
*** Preparing to test memory region 7ff9472dc000 (4194304 bytes)
*** Preparing to test memory region 7ff947b14000 (8192 bytes)
*** Preparing to test memory region 7ff9482ff000 (4096 bytes)
*** Preparing to test memory region 7ff948300000 (13631488 bytes)
*** Preparing to test memory region 7ff949012000 (436207616 bytes)
*** Preparing to test memory region 7ff963471000 (4096 bytes)
*** Preparing to test memory region 7ff963904000 (4096 bytes)
*** Preparing to test memory region 7ff963b47000 (4096 bytes)
*** Preparing to test memory region 7ff963db8000 (4096 bytes)
*** Preparing to test memory region 7ff96401b000 (4096 bytes)
*** Preparing to test memory region 7ff9644a9000 (4096 bytes)
*** Preparing to test memory region 7ff964704000 (4096 bytes)
*** Preparing to test memory region 7ff96494d000 (4096 bytes)
*** Preparing to test memory region 7ff964ba5000 (4096 bytes)
*** Preparing to test memory region 7ff9652b4000 (8192 bytes)
*** Preparing to test memory region 7ff9654e1000 (4096 bytes)
*** Preparing to test memory region 7ff96571e000 (4096 bytes)
*** Preparing to test memory region 7ff965963000 (4096 bytes)
*** Preparing to test memory region 7ff965dcb000 (4096 bytes)
*** Preparing to test memory region 7ff96644e000 (4096 bytes)
*** Preparing to test memory region 7ff9666aa000 (4096 bytes)
*** Preparing to test memory region 7ff96693f000 (8192 bytes)
*** Preparing to test memory region 7ff966b59000 (4096 bytes)
*** Preparing to test memory region 7ff967242000 (12288 bytes)
*** Preparing to test memory region 7ff967876000 (4096 bytes)
*** Preparing to test memory region 7ff967a91000 (4096 bytes)
*** Preparing to test memory region 7ff967cef000 (8192 bytes)
*** Preparing to test memory region 7ff967f2e000 (4096 bytes)
*** Preparing to test memory region 7ff96815d000 (4096 bytes)
*** Preparing to test memory region 7ff968408000 (12288 bytes)
*** Preparing to test memory region 7ff968c79000 (134217728 bytes)
*** Preparing to test memory region 7ff970c7a000 (8388608 bytes)
*** Preparing to test memory region 7ff97247c000 (33554432 bytes)
*** Preparing to test memory region 7ff974c7d000 (33554432 bytes)
*** Preparing to test memory region 7ff977214000 (4096 bytes)
*** Preparing to test memory region 7ff97747d000 (4096 bytes)
*** Preparing to test memory region 7ff97747e000 (33554432 bytes)
*** Preparing to test memory region 7ff979843000 (4096 bytes)
*** Preparing to test memory region 7ff979a65000 (4096 bytes)
*** Preparing to test memory region 7ff979c7f000 (33554432 bytes)
*** Preparing to test memory region 7ff97bc7f000 (100663296 bytes)
*** Preparing to test memory region 7ff982071000 (8192 bytes)
*** Preparing to test memory region 7ff9823b0000 (20480 bytes)
*** Preparing to test memory region 7ff9831a4000 (8192 bytes)
*** Preparing to test memory region 7ff983953000 (8192 bytes)
*** Preparing to test memory region 7ff983d71000 (4096 bytes)
*** Preparing to test memory region 7ff98424c000 (16384 bytes)
*** Preparing to test memory region 7ff984483000 (4096 bytes)
*** Preparing to test memory region 7ff986192000 (45056 bytes)
*** Preparing to test memory region 7ff9867d8000 (135168 bytes)
*** Preparing to test memory region 7ff986800000 (423006208 bytes)
*** Preparing to test memory region 7ff9a0096000 (109051904 bytes)
*** Preparing to test memory region 7ff9a6bf5000 (4096 bytes)
*** Preparing to test memory region 7ff9a6bff000 (8388608 bytes)
*** Preparing to test memory region 7ff9a73ff000 (14680064 bytes)
*** Preparing to test memory region 7ff9a8200000 (8388608 bytes)
*** Preparing to test memory region 7ff9a8a00000 (2097152 bytes)
*** Preparing to test memory region 7ff9a8c29000 (13631488 bytes)
*** Preparing to test memory region 7ff9a9bfb000 (16384 bytes)
*** Preparing to test memory region 7ff9a9c00000 (8388608 bytes)
*** Preparing to test memory region 7ff9aa400000 (163713024 bytes)
*** Preparing to test memory region 7ff9b8000000 (4194304 bytes)
*** Preparing to test memory region 7ff9b8600000 (8388608 bytes)
*** Preparing to test memory region 7ff9b8e00000 (4194304 bytes)
*** Preparing to test memory region 7ff9b927f000 (30932992 bytes)
*** Preparing to test memory region 7ff9bb000000 (8388608 bytes)
*** Preparing to test memory region 7ff9bb800000 (70701056 bytes)
*** Preparing to test memory region 7ff9c0000000 (17780736 bytes)
*** Preparing to test memory region 7ff9c4000000 (135168 bytes)
*** Preparing to test memory region 7ff9c8000000 (2097152 bytes)
*** Preparing to test memory region 7ff9c82f8000 (4096 bytes)
*** Preparing to test memory region 7ff9c8400000 (8388608 bytes)
*** Preparing to test memory region 7ff9c8c00000 (4194304 bytes)
*** Preparing to test memory region 7ff9c91fc000 (12288 bytes)
*** Preparing to test memory region 7ff9c9200000 (8388608 bytes)
*** Preparing to test memory region 7ff9c9a00000 (4194304 bytes)
*** Preparing to test memory region 7ff9c9e48000 (3670016 bytes)
*** Preparing to test memory region 7ff9ca1c9000 (8388608 bytes)
*** Preparing to test memory region 7ff9ca9ca000 (8388608 bytes)
*** Preparing to test memory region 7ff9cb1cb000 (8388608 bytes)
*** Preparing to test memory region 7ff9cb9cc000 (8388608 bytes)
*** Preparing to test memory region 7ff9cc1cd000 (8388608 bytes)
*** Preparing to test memory region 7ff9cc9cd000 (5767168 bytes)
*** Preparing to test memory region 7ff9ccf4e000 (8388608 bytes)
*** Preparing to test memory region 7ff9cd74f000 (8388608 bytes)
*** Preparing to test memory region 7ff9cdf50000 (8388608 bytes)
*** Preparing to test memory region 7ff9ce751000 (8388608 bytes)
*** Preparing to test memory region 7ff9cef52000 (8388608 bytes)
*** Preparing to test memory region 7ff9cfb94000 (139264 bytes)
*** Preparing to test memory region 7ff9d0400000 (8388608 bytes)
*** Preparing to test memory region 7ff9d0db9000 (24576 bytes)
*** Preparing to test memory region 7ff9d0fad000 (16384 bytes)
*** Preparing to test memory region 7ff9d0fd0000 (16384 bytes)
*** Preparing to test memory region 7ff9d1129000 (8192 bytes)
*** Preparing to test memory region 7ff9d115e000 (4096 bytes)
*** Preparing to test memory region 7ff9d1161000 (4096 bytes)
.O.O.O.O.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment