KeyDB 5.3.0 crash on replica promotion from 5.2.0

gistfile1.txt

Jan 16 20:21:03 keydb-server[5309]: 5309:S 16 Jan 2020 20:21:03.370 * Before turning into a replica, using my master parameters to synthesize a cached master: I may be able to synchronize with the new master with just a partial transfer.
Jan 16 20:21:03 keydb-server[5309]: 5309:S 16 Jan 2020 20:21:03.370 * REPLICAOF XXXXXXX:YYYYYY enabled (user request from 'id=10 addr=X.X.X.X:34354 fd=96 name=redisgreen age=0 idle=0 flags=x db=0 sub=0 psub=0 multi=2 qbuf=197 qbuf-free=32571 obl=27 oll=0 omem=0 events=r cmd=exec')
Jan 16 20:21:03 keydb-server[5309]: 5309:S 16 Jan 2020 20:21:03.977 * Connecting to MASTER X.X.X.X:11042
Jan 16 20:21:03 keydb-server[5309]: 5309:S 16 Jan 2020 20:21:03.981 * MASTER <-> REPLICA sync started
Jan 16 20:21:03 keydb-server[5309]: 5309:S 16 Jan 2020 20:21:03.982 * Non blocking connect for SYNC fired the event.
Jan 16 20:21:03 keydb-server[5309]: 5309:S 16 Jan 2020 20:21:03.983 * Master replied to PING, replication can continue...
Jan 16 20:21:03 keydb-server[5309]: 5309:S 16 Jan 2020 20:21:03.988 * Trying a partial resynchronization (request 1f8cfbd52434e9e7b0f8dda0b1269b68b543178b:1).
Jan 16 20:21:09 keydb-server[5309]: 5309:S 16 Jan 2020 20:21:09.176 * Full resync from master: 0892e6b2a9eb1e34e8bffc2077df31169a4998c2:15197761837
Jan 16 20:21:09 keydb-server[5309]: 5309:S 16 Jan 2020 20:21:09.176 * Discarding previously cached master state.
Jan 16 20:21:10 keydb-server[5309]: 5309:S 16 Jan 2020 20:21:10.960 * MASTER <-> REPLICA sync: receiving streamed RDB from master
Jan 16 20:31:12 keydb-server[5309]: 5309:S 16 Jan 2020 20:31:12.017 * MASTER <-> REPLICA sync: Flushing old data
Jan 16 20:31:12 keydb-server[5309]: 5309:S 16 Jan 2020 20:31:12.017 * MASTER <-> REPLICA sync: Loading DB in memory
Jan 16 20:31:12 keydb-server[5309]: 5309:S 16 Jan 2020 20:31:12.017 * Loading RDB produced by version 5.1.1
Jan 16 20:31:12 keydb-server[5309]: 5309:S 16 Jan 2020 20:31:12.017 * RDB age 602 seconds
Jan 16 20:31:12 keydb-server[5309]: 5309:S 16 Jan 2020 20:31:12.017 * RDB memory usage when created 54281.02 Mb
Jan 16 20:39:08 keydb-server[5309]: 5309:S 16 Jan 2020 20:39:08.101 * MASTER <-> REPLICA sync: Finished with success
Jan 16 20:39:08 keydb-server[5309]: 5309:S 16 Jan 2020 20:39:08.642 * Background append only file rewriting started by pid 5480
Jan 16 20:40:12 keydb-server[5309]: 5309:S 16 Jan 2020 20:40:12.119 * Background AOF buffer size: 80 MB
Jan 16 20:40:58 keydb-server[5309]: 5309:S 16 Jan 2020 20:40:58.514 # Connection with master lost.
Jan 16 20:40:58 keydb-server[5309]: 5309:S 16 Jan 2020 20:40:58.514 * Caching the disconnected master state.
Jan 16 20:40:58 keydb-server[5309]: 5309:S 16 Jan 2020 20:40:58.955 * Connecting to MASTER X.X.X.X:11042
Jan 16 20:40:58 keydb-server[5309]: 5309:S 16 Jan 2020 20:40:58.959 * MASTER <-> REPLICA sync started
Jan 16 20:40:58 keydb-server[5309]: 5309:S 16 Jan 2020 20:40:58.960 # Error condition on socket for SYNC: Connection refused
Jan 16 20:40:59 keydb-server[5309]: 5309:S 16 Jan 2020 20:40:59.677 # Setting secondary replication ID to 0892e6b2a9eb1e34e8bffc2077df31169a4998c2, valid up to offset: 16213508360. New replication ID is 16b4a4c7e856553f2ee40ac5900b0a24e9c928c3
Jan 16 20:40:59 keydb-server[5309]: 5309:S 16 Jan 2020 20:40:59.677 * Discarding previously cached master state.
Jan 16 20:40:59 keydb-server[5309]: 5309:M 16 Jan 2020 20:40:59.677 * MASTER MODE enabled (user request from 'id=157 addr=X.X.X.X:36188 fd=115 name=redisgreen age=0 idle=0 flags=x db=0 sub=0 psub=0 multi=2 qbuf=123 qbuf-free=32645 obl=27 oll=0 omem=0 events=r cmd=exec')
Jan 16 20:41:04 keydb-server[5309]: AE_ASSERT FAILURE ae.cpp: 299
Jan 16 20:41:04 keydb-server[5309]: === KEYDB BUG REPORT START: Cut & paste starting from here ===
Jan 16 20:41:04 keydb-server[5309]: 5309:M 16 Jan 2020 20:41:04.846 # KeyDB 5.3.0 crashed by signal: 11
Jan 16 20:41:04 keydb-server[5309]: 5309:M 16 Jan 2020 20:41:04.846 # Crashed running the instruction at: 0x434502
Jan 16 20:41:04 keydb-server[5309]: 5309:M 16 Jan 2020 20:41:04.846 # Accessing address: 0x1
Jan 16 20:41:04 keydb-server[5309]: 5309:M 16 Jan 2020 20:41:04.846 # Failed assertion: <no assertion failed> (<no file>:0)
Jan 16 20:41:04 keydb-server[5309]: ------ STACK TRACE ------
Jan 16 20:41:04 keydb-server[5309]: EIP:
Jan 16 20:41:04 keydb-server[5309]: /usr/local/bin/redis-server *:11042(aePostFunction(aeEventLoop*, std::function<void ()>, bool)+0x202) [0x434502]
Jan 16 20:41:04 keydb-server[5309]: Backtrace:
Jan 16 20:41:04 keydb-server[5309]: /usr/local/bin/redis-server *:11042(logStackTrace(ucontext_t*)+0x35) [0x4895b5]
Jan 16 20:41:04 keydb-server[5309]: /usr/local/bin/redis-server *:11042(sigsegvHandler(int, siginfo_t*, void*)+0xae) [0x489c1e]
Jan 16 20:41:04 keydb-server[5309]: /lib64/libpthread.so.0(+0x117e0) [0x7f007a6e67e0]
Jan 16 20:41:04 keydb-server[5309]: /usr/local/bin/redis-server *:11042(aePostFunction(aeEventLoop*, std::function<void ()>, bool)+0x202) [0x434502]
Jan 16 20:41:04 keydb-server[5309]: /usr/local/bin/redis-server *:11042(aofRewriteBufferAppend(unsigned char*, unsigned long)+0x123) [0x4821b3]
Jan 16 20:41:04 keydb-server[5309]: /usr/local/bin/redis-server *:11042(feedAppendOnlyFile(redisCommand*, int, redisObject**, int)+0x149) [0x482ee9]
Jan 16 20:41:04 keydb-server[5309]: /usr/local/bin/redis-server *:11042(propagate(redisCommand*, int, redisObject**, int, int)+0x53) [0x43baf3]
Jan 16 20:41:04 keydb-server[5309]: /usr/local/bin/redis-server *:11042(call(client*, int)+0x4ed) [0x43c14d]
Jan 16 20:41:04 keydb-server[5309]: /usr/local/bin/redis-server *:11042(luaRedisGenericCommand(lua_State*, int)+0x759) [0x49c9a9]
Jan 16 20:41:04 keydb-server[5309]: /usr/local/bin/redis-server *:11042() [0x4d9e52]
Jan 16 20:41:04 keydb-server[5309]: /usr/local/bin/redis-server *:11042() [0x4e2643]
Jan 16 20:41:04 keydb-server[5309]: /usr/local/bin/redis-server *:11042() [0x4da28d]
Jan 16 20:41:04 keydb-server[5309]: /usr/local/bin/redis-server *:11042() [0x4d96c8]
Jan 16 20:41:04 keydb-server[5309]: /usr/local/bin/redis-server *:11042() [0x4da3db]
Jan 16 20:41:04 keydb-server[5309]: /usr/local/bin/redis-server *:11042(lua_pcall+0x46) [0x4d7fe6]
Jan 16 20:41:04 keydb-server[5309]: /usr/local/bin/redis-server *:11042(evalGenericCommand(client*, int)+0x25e) [0x49a05e]
Jan 16 20:41:04 keydb-server[5309]: /usr/local/bin/redis-server *:11042(call(client*, int)+0xb5) [0x43bd15]
Jan 16 20:41:04 keydb-server[5309]: /usr/local/bin/redis-server *:11042(processCommand(client*, int)+0x71a) [0x43fcca]
Jan 16 20:41:04 keydb-server[5309]: /usr/local/bin/redis-server *:11042(processCommandAndResetClient(client*, int)+0x21) [0x448821]
Jan 16 20:41:04 keydb-server[5309]: /usr/local/bin/redis-server *:11042(processInputBuffer(client*, int)+0x79) [0x44ca79]
Jan 16 20:41:04 keydb-server[5309]: /usr/local/bin/redis-server *:11042(readQueryFromClient(aeEventLoop*, int, void*, int)+0x2fe) [0x44f20e]
Jan 16 20:41:04 keydb-server[5309]: /usr/local/bin/redis-server *:11042(ProcessEventCore+0xe8) [0x435188]
Jan 16 20:41:04 keydb-server[5309]: /usr/local/bin/redis-server *:11042(aeProcessEvents+0x13d) [0x4353dd]
Jan 16 20:41:04 keydb-server[5309]: /usr/local/bin/redis-server *:11042(aeMain+0x29) [0x435739]
Jan 16 20:41:04 keydb-server[5309]: /usr/local/bin/redis-server *:11042(workerThreadMain(void*)+0x96) [0x439166]
Jan 16 20:41:04 keydb-server[5309]: /lib64/libpthread.so.0(+0x740b) [0x7f007a6dc40b]
Jan 16 20:41:04 keydb-server[5309]: /lib64/libc.so.6(clone+0x3f) [0x7f007a416e7f]
Jan 16 20:41:04 keydb-server[5309]: ------ INFO OUTPUT ------
Jan 16 20:41:04 keydb-server[5309]: # Server
Jan 16 20:41:04 keydb-server[5309]: redis_version:5.3.0
Jan 16 20:41:04 keydb-server[5309]: redis_git_sha1:00000000
Jan 16 20:41:04 keydb-server[5309]: redis_git_dirty:0
Jan 16 20:41:04 keydb-server[5309]: redis_build_id:bffc9bc31c9421b6
Jan 16 20:41:04 keydb-server[5309]: redis_mode:standalone
Jan 16 20:41:04 keydb-server[5309]: os:Linux 4.14.158-129.185.amzn2.x86_64 x86_64
Jan 16 20:41:04 keydb-server[5309]: arch_bits:64
Jan 16 20:41:04 keydb-server[5309]: multiplexing_api:epoll
Jan 16 20:41:04 keydb-server[5309]: atomicvar_api:atomic-builtin
Jan 16 20:41:04 keydb-server[5309]: gcc_version:7.3.1
Jan 16 20:41:04 keydb-server[5309]: process_id:5309
Jan 16 20:41:04 keydb-server[5309]: run_id:f0e0b0a312911ddfd3bfcf3ddc361934a8ea0a8d
Jan 16 20:41:04 keydb-server[5309]: tcp_port:11042
Jan 16 20:41:04 keydb-server[5309]: uptime_in_seconds:1204
Jan 16 20:41:04 keydb-server[5309]: uptime_in_days:0
Jan 16 20:41:04 keydb-server[5309]: hz:10
Jan 16 20:41:04 keydb-server[5309]: configured_hz:10
Jan 16 20:41:04 keydb-server[5309]: lru_clock:2148960
Jan 16 20:41:04 keydb-server[5309]: executable:/usr/local/bin/redis-server
Jan 16 20:41:04 keydb-server[5309]: config_file:/srv/redis/redis.conf
Jan 16 20:41:04 keydb-server[5309]: # Clients
Jan 16 20:41:04 keydb-server[5309]: connected_clients:11
Jan 16 20:41:04 keydb-server[5309]: client_recent_max_input_buffer:2
Jan 16 20:41:04 keydb-server[5309]: client_recent_max_output_buffer:0
Jan 16 20:41:04 keydb-server[5309]: blocked_clients:0
Jan 16 20:41:04 keydb-server[5309]: current_client_thread:1
Jan 16 20:41:04 keydb-server[5309]: thread_0_clients:2
Jan 16 20:41:04 keydb-server[5309]: thread_1_clients:2
Jan 16 20:41:04 keydb-server[5309]: thread_2_clients:2
Jan 16 20:41:04 keydb-server[5309]: thread_3_clients:2
Jan 16 20:41:04 keydb-server[5309]: thread_4_clients:0
Jan 16 20:41:04 keydb-server[5309]: thread_5_clients:3
Jan 16 20:41:04 keydb-server[5309]: # Memory
Jan 16 20:41:04 keydb-server[5309]: used_memory:55955938952
Jan 16 20:41:04 keydb-server[5309]: used_memory_human:52.11G
Jan 16 20:41:04 keydb-server[5309]: used_memory_rss:56799805440
Jan 16 20:41:04 keydb-server[5309]: used_memory_rss_human:52.90G
Jan 16 20:41:04 keydb-server[5309]: used_memory_peak:56115389952
Jan 16 20:41:04 keydb-server[5309]: used_memory_peak_human:52.26G
Jan 16 20:41:04 keydb-server[5309]: used_memory_peak_perc:99.72%
Jan 16 20:41:04 keydb-server[5309]: used_memory_overhead:3168636602
Jan 16 20:41:04 keydb-server[5309]: used_memory_startup:9169088
Jan 16 20:41:04 keydb-server[5309]: used_memory_dataset:52787302350
Jan 16 20:41:04 keydb-server[5309]: used_memory_dataset_perc:94.35%
Jan 16 20:41:04 keydb-server[5309]: allocator_allocated:55956741344
Jan 16 20:41:04 keydb-server[5309]: allocator_active:55971635200
Jan 16 20:41:04 keydb-server[5309]: allocator_resident:56832806912
Jan 16 20:41:04 keydb-server[5309]: total_system_memory:257785511936
Jan 16 20:41:04 keydb-server[5309]: total_system_memory_human:240.08G
Jan 16 20:41:04 keydb-server[5309]: used_memory_lua:96256
Jan 16 20:41:04 keydb-server[5309]: used_memory_lua_human:94.00K
Jan 16 20:41:04 keydb-server[5309]: used_memory_scripts:11080
Jan 16 20:41:04 keydb-server[5309]: used_memory_scripts_human:10.82K
Jan 16 20:41:04 keydb-server[5309]: number_of_cached_scripts:5
Jan 16 20:41:04 keydb-server[5309]: maxmemory:128849018880
Jan 16 20:41:04 keydb-server[5309]: maxmemory_human:120.00G
Jan 16 20:41:04 keydb-server[5309]: maxmemory_policy:volatile-lru
Jan 16 20:41:04 keydb-server[5309]: allocator_frag_ratio:1.00
Jan 16 20:41:04 keydb-server[5309]: allocator_frag_bytes:14893856
Jan 16 20:41:04 keydb-server[5309]: allocator_rss_ratio:1.02
Jan 16 20:41:04 keydb-server[5309]: allocator_rss_bytes:861171712
Jan 16 20:41:04 keydb-server[5309]: rss_overhead_ratio:1.00
Jan 16 20:41:04 keydb-server[5309]: rss_overhead_bytes:-33001472
Jan 16 20:41:04 keydb-server[5309]: mem_fragmentation_ratio:1.02
Jan 16 20:41:04 keydb-server[5309]: mem_fragmentation_bytes:843670496
Jan 16 20:41:04 keydb-server[5309]: mem_not_counted_for_evict:1276828
Jan 16 20:41:04 keydb-server[5309]: mem_replication_backlog:1048576
Jan 16 20:41:04 keydb-server[5309]: mem_clients_slaves:0
Jan 16 20:41:04 keydb-server[5309]: mem_clients_normal:450606
Jan 16 20:41:04 keydb-server[5309]: mem_aof_buffer:1276828
Jan 16 20:41:04 keydb-server[5309]: mem_allocator:jemalloc-5.1.0
Jan 16 20:41:04 keydb-server[5309]: active_defrag_running:0
Jan 16 20:41:04 keydb-server[5309]: lazyfree_pending_objects:0
Jan 16 20:41:04 keydb-server[5309]: # Persistence
Jan 16 20:41:04 keydb-server[5309]: loading:0
Jan 16 20:41:04 keydb-server[5309]: rdb_changes_since_last_save:18032005
Jan 16 20:41:04 keydb-server[5309]: rdb_bgsave_in_progress:0
Jan 16 20:41:04 keydb-server[5309]: rdb_last_save_time:1579206060
Jan 16 20:41:04 keydb-server[5309]: rdb_last_bgsave_status:ok
Jan 16 20:41:04 keydb-server[5309]: rdb_last_bgsave_time_sec:-1
Jan 16 20:41:04 keydb-server[5309]: rdb_current_bgsave_time_sec:-1
Jan 16 20:41:04 keydb-server[5309]: rdb_last_cow_size:0
Jan 16 20:41:04 keydb-server[5309]: aof_enabled:1
Jan 16 20:41:04 keydb-server[5309]: aof_rewrite_in_progress:1
Jan 16 20:41:04 keydb-server[5309]: aof_rewrite_scheduled:0
Jan 16 20:41:04 keydb-server[5309]: aof_last_rewrite_time_sec:-1
Jan 16 20:41:04 keydb-server[5309]: aof_current_rewrite_time_sec:116
Jan 16 20:41:04 keydb-server[5309]: aof_last_bgrewrite_status:ok
Jan 16 20:41:04 keydb-server[5309]: aof_last_write_status:ok
Jan 16 20:41:04 keydb-server[5309]: aof_last_cow_size:0
Jan 16 20:41:04 keydb-server[5309]: aof_current_size:0
Jan 16 20:41:04 keydb-server[5309]: aof_base_size:0
Jan 16 20:41:04 keydb-server[5309]: aof_pending_rewrite:0
Jan 16 20:41:04 keydb-server[5309]: aof_buffer_length:0
Jan 16 20:41:04 keydb-server[5309]: aof_rewrite_buffer_length:1276828
Jan 16 20:41:04 keydb-server[5309]: aof_pending_bio_fsync:0
Jan 16 20:41:04 keydb-server[5309]: aof_delayed_fsync:0
Jan 16 20:41:04 keydb-server[5309]: # Stats
Jan 16 20:41:04 keydb-server[5309]: total_connections_received:148
Jan 16 20:41:04 keydb-server[5309]: total_commands_processed:19454524
Jan 16 20:41:04 keydb-server[5309]: instantaneous_ops_per_sec:37123
Jan 16 20:41:04 keydb-server[5309]: total_net_input_bytes:24416585185
Jan 16 20:41:04 keydb-server[5309]: total_net_output_bytes:628765
Jan 16 20:41:04 keydb-server[5309]: instantaneous_input_kbps:345.51
Jan 16 20:41:04 keydb-server[5309]: instantaneous_output_kbps:25.06
Jan 16 20:41:04 keydb-server[5309]: rejected_connections:0
Jan 16 20:41:04 keydb-server[5309]: sync_full:0
Jan 16 20:41:04 keydb-server[5309]: sync_partial_ok:0
Jan 16 20:41:04 keydb-server[5309]: sync_partial_err:0
Jan 16 20:41:04 keydb-server[5309]: expired_keys:0
Jan 16 20:41:04 keydb-server[5309]: expired_stale_perc:0.00
Jan 16 20:41:04 keydb-server[5309]: expired_time_cap_reached_count:0
Jan 16 20:41:04 keydb-server[5309]: evicted_keys:0
Jan 16 20:41:04 keydb-server[5309]: keyspace_hits:168249
Jan 16 20:41:04 keydb-server[5309]: keyspace_misses:12950
Jan 16 20:41:04 keydb-server[5309]: pubsub_channels:0
Jan 16 20:41:04 keydb-server[5309]: pubsub_patterns:0
Jan 16 20:41:04 keydb-server[5309]: latest_fork_usec:540976
Jan 16 20:41:04 keydb-server[5309]: migrate_cached_sockets:0
Jan 16 20:41:04 keydb-server[5309]: slave_expires_tracked_keys:0
Jan 16 20:41:04 keydb-server[5309]: active_defrag_hits:0
Jan 16 20:41:04 keydb-server[5309]: active_defrag_misses:0
Jan 16 20:41:04 keydb-server[5309]: active_defrag_key_hits:0
Jan 16 20:41:04 keydb-server[5309]: active_defrag_key_misses:0
Jan 16 20:41:04 keydb-server[5309]: # Replication
Jan 16 20:41:04 keydb-server[5309]: role:master
Jan 16 20:41:04 keydb-server[5309]: connected_slaves:0
Jan 16 20:41:04 keydb-server[5309]: master_replid:16b4a4c7e856553f2ee40ac5900b0a24e9c928c3
Jan 16 20:41:04 keydb-server[5309]: master_replid2:0892e6b2a9eb1e34e8bffc2077df31169a4998c2
Jan 16 20:41:04 keydb-server[5309]: master_repl_offset:16217090362
Jan 16 20:41:04 keydb-server[5309]: second_repl_offset:16213508360
Jan 16 20:41:04 keydb-server[5309]: repl_backlog_active:1
Jan 16 20:41:04 keydb-server[5309]: repl_backlog_size:1048576
Jan 16 20:41:04 keydb-server[5309]: repl_backlog_first_byte_offset:16216041787
Jan 16 20:41:04 keydb-server[5309]: repl_backlog_histlen:1048576
Jan 16 20:41:04 keydb-server[5309]: # CPU
Jan 16 20:41:04 keydb-server[5309]: used_cpu_sys:90.346200
Jan 16 20:41:04 keydb-server[5309]: used_cpu_user:791.862397
Jan 16 20:41:04 keydb-server[5309]: used_cpu_sys_children:0.000000
Jan 16 20:41:04 keydb-server[5309]: used_cpu_user_children:0.000000
Jan 16 20:41:04 keydb-server[5309]: server_threads:6
Jan 16 20:41:04 keydb-server[5309]: long_lock_waits:30459
Jan 16 20:41:04 keydb-server[5309]: # Commandstats
Jan 16 20:41:04 keydb-server[5309]: cmdstat_sadd:calls=403512,usec=1351730,usec_per_call=3.35
Jan 16 20:41:04 keydb-server[5309]: cmdstat_zrangebyscore:calls=11,usec=91,usec_per_call=8.27
Jan 16 20:41:04 keydb-server[5309]: cmdstat_del:calls=311,usec=306,usec_per_call=0.98
Jan 16 20:41:04 keydb-server[5309]: cmdstat_exec:calls=927934,usec=73775021,usec_per_call=79.50
Jan 16 20:41:04 keydb-server[5309]: cmdstat_hset:calls=7498047,usec=13752399,usec_per_call=1.83
Jan 16 20:41:04 keydb-server[5309]: cmdstat_zadd:calls=1076934,usec=4845811,usec_per_call=4.50
Jan 16 20:41:04 keydb-server[5309]: cmdstat_config:calls=11,usec=545,usec_per_call=49.55
Jan 16 20:41:04 keydb-server[5309]: cmdstat_subscribe:calls=131,usec=679,usec_per_call=5.18
Jan 16 20:41:04 keydb-server[5309]: cmdstat_info:calls=46,usec=2376,usec_per_call=51.65
Jan 16 20:41:04 keydb-server[5309]: cmdstat_client:calls=6,usec=12,usec_per_call=2.00
Jan 16 20:41:04 keydb-server[5309]: cmdstat_slowlog:calls=7,usec=19,usec_per_call=2.71
Jan 16 20:41:04 keydb-server[5309]: cmdstat_hget:calls=85611,usec=134671,usec_per_call=1.57
Jan 16 20:41:04 keydb-server[5309]: cmdstat_zrem:calls=181629,usec=237316,usec_per_call=1.31
Jan 16 20:41:04 keydb-server[5309]: cmdstat_zcard:calls=6,usec=15,usec_per_call=2.50
Jan 16 20:41:04 keydb-server[5309]: cmdstat_smembers:calls=9,usec=72,usec_per_call=8.00
Jan 16 20:41:04 keydb-server[5309]: cmdstat_setbit:calls=443187,usec=458503,usec_per_call=1.03
Jan 16 20:41:04 keydb-server[5309]: cmdstat_hincrby:calls=7109663,usec=12556313,usec_per_call=1.77
Jan 16 20:41:04 keydb-server[5309]: cmdstat_ping:calls=125,usec=90,usec_per_call=0.72
Jan 16 20:41:04 keydb-server[5309]: cmdstat_zscore:calls=76740,usec=115428,usec_per_call=1.50
Jan 16 20:41:04 keydb-server[5309]: cmdstat_srem:calls=103761,usec=670571,usec_per_call=6.46
Jan 16 20:41:04 keydb-server[5309]: cmdstat_multi:calls=927934,usec=633711,usec_per_call=0.68
Jan 16 20:41:04 keydb-server[5309]: cmdstat_auth:calls=148,usec=604,usec_per_call=4.08
Jan 16 20:41:04 keydb-server[5309]: cmdstat_evalsha:calls=23739,usec=2919695,usec_per_call=122.99
Jan 16 20:41:04 keydb-server[5309]: cmdstat_publish:calls=10220,usec=11032,usec_per_call=1.08
Jan 16 20:41:04 keydb-server[5309]: cmdstat_slaveof:calls=2,usec=100,usec_per_call=50.00
Jan 16 20:41:04 keydb-server[5309]: cmdstat_hdel:calls=565978,usec=930243,usec_per_call=1.64
Jan 16 20:41:04 keydb-server[5309]: cmdstat_zrevrange:calls=21,usec=255,usec_per_call=12.14
Jan 16 20:41:04 keydb-server[5309]: cmdstat_hexists:calls=1752,usec=3548,usec_per_call=2.03
Jan 16 20:41:04 keydb-server[5309]: cmdstat_scard:calls=13058,usec=21984,usec_per_call=1.68
Jan 16 20:41:04 keydb-server[5309]: cmdstat_bitpos:calls=3991,usec=80768,usec_per_call=20.24
Jan 16 20:41:04 keydb-server[5309]: cmdstat_select:calls=1,usec=2,usec_per_call=2.00
Jan 16 20:41:04 keydb-server[5309]: # Cluster
Jan 16 20:41:04 keydb-server[5309]: cluster_enabled:0
Jan 16 20:41:04 keydb-server[5309]: # Keyspace
Jan 16 20:41:04 keydb-server[5309]: db0:keys=54579290,expires=54,avg_ttl=351627258
Jan 16 20:41:04 keydb-server[5309]: ------ CLIENT LIST OUTPUT ------
Jan 16 20:41:04 keydb-server[5309]: id=155 addr=X.X.X.X:50544 fd=97 name= age=6 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=zscore
Jan 16 20:41:04 keydb-server[5309]: id=150 addr=X.X.X.X:47588 fd=103 name= age=15 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=evalsha
Jan 16 20:41:04 keydb-server[5309]: id=151 addr=X.X.X.X:54906 fd=104 name= age=15 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=92 qbuf-free=32676 obl=0 oll=0 omem=0 events=r cmd=evalsha
Jan 16 20:41:04 keydb-server[5309]: id=152 addr=X.X.X.X:55622 fd=105 name= age=15 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=evalsha
Jan 16 20:41:04 keydb-server[5309]: id=153 addr=X.X.X.X:55620 fd=106 name= age=15 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=zscore
Jan 16 20:41:04 keydb-server[5309]: id=154 addr=X.X.X.X:50252 fd=108 name= age=15 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=113 qbuf-free=32655 obl=0 oll=0 omem=0 events=r cmd=evalsha
Jan 16 20:41:04 keydb-server[5309]: id=52 addr=X.X.X.X:58150 fd=96 name=redisgreen-monitoring age=851 idle=11 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=slowlog
Jan 16 20:41:04 keydb-server[5309]: id=146 addr=X.X.X.X:54904 fd=99 name= age=15 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=39 qbuf-free=32729 obl=0 oll=0 omem=0 events=r cmd=hexists
Jan 16 20:41:04 keydb-server[5309]: id=147 addr=X.X.X.X:47586 fd=100 name= age=15 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=hexists
Jan 16 20:41:04 keydb-server[5309]: id=148 addr=X.X.X.X:46024 fd=101 name= age=15 idle=1 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=zscore
Jan 16 20:41:04 keydb-server[5309]: id=149 addr=X.X.X.X:46026 fd=102 name= age=15 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=evalsha
Jan 16 20:41:04 keydb-server[5309]: ------ CURRENT CLIENT INFO ------
Jan 16 20:41:04 keydb-server[5309]: id=154 addr=X.X.X.X:50252 fd=108 name= age=15 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=113 qbuf-free=32655 obl=0 oll=0 omem=0 events=r cmd=evalsha
Jan 16 20:41:04 keydb-server[5309]: argv[0]: 'evalsha'
Jan 16 20:41:04 keydb-server[5309]: argv[1]: '8993b000824a9a3ae2562ce7ad866a1aa75c9f23'
Jan 16 20:41:04 keydb-server[5309]: argv[2]: '0'
Jan 16 20:41:04 keydb-server[5309]: argv[3]: '1'
Jan 16 20:41:04 keydb-server[5309]: argv[4]: '1579206811.496126'
Jan 16 20:41:04 keydb-server[5309]: argv[5]: '20'
Jan 16 20:41:04 keydb-server[5309]: ------ REGISTERS ------
Jan 16 20:41:04 keydb-server[5309]: 5309:M 16 Jan 2020 20:41:04.849 #
Jan 16 20:41:04 keydb-server[5309]: RAX:000000000000001e RBX:00007f0070528e90
Jan 16 20:41:04 keydb-server[5309]: RCX:0000000000000000 RDX:00007f0070526660
Jan 16 20:41:04 keydb-server[5309]: RDI:00007f0070526660 RSI:0000000000000000
Jan 16 20:41:04 keydb-server[5309]: RBP:00007f006c0f52c0 RSP:00007f0070528e20
Jan 16 20:41:04 keydb-server[5309]: R8 :0000000000000000 R9 :0000000000000000
Jan 16 20:41:04 keydb-server[5309]: R10:0000000000000000 R11:0000000000000000
Jan 16 20:41:04 keydb-server[5309]: R12:00007f0079e28100 R13:0000000000000000
Jan 16 20:41:04 keydb-server[5309]: R14:00000000008c8491 R15:0000000000000000
Jan 16 20:41:04 keydb-server[5309]: RIP:0000000000434502 EFL:0000000000010206
Jan 16 20:41:04 keydb-server[5309]: CSGSFS:002b000000000033
Jan 16 20:41:04 keydb-server[5309]: 5309:M 16 Jan 2020 20:41:04.849 # (00007f0070528e2f) -> 0000000000000000
Jan 16 20:41:04 keydb-server[5309]: 5309:M 16 Jan 2020 20:41:04.849 # (00007f0070528e2e) -> 0000000a0a0d3424
Jan 16 20:41:04 keydb-server[5309]: 5309:M 16 Jan 2020 20:41:04.849 # (00007f0070528e2d) -> 00000000004821b3
Jan 16 20:41:04 keydb-server[5309]: 5309:M 16 Jan 2020 20:41:04.849 # (00007f0070528e2c) -> 0000000066666667
Jan 16 20:41:04 keydb-server[5309]: 5309:M 16 Jan 2020 20:41:04.849 # (00007f0070528e2b) -> 00007effe1cd8363
Jan 16 20:41:04 keydb-server[5309]: 5309:M 16 Jan 2020 20:41:04.849 # (00007f0070528e2a) -> 000000000000002d
Jan 16 20:41:04 keydb-server[5309]: 5309:M 16 Jan 2020 20:41:04.849 # (00007f0070528e29) -> 00007ef17c600100
Jan 16 20:41:04 keydb-server[5309]: 5309:M 16 Jan 2020 20:41:04.849 # (00007f0070528e28) -> 0000000000000004
Jan 16 20:41:04 keydb-server[5309]: 5309:M 16 Jan 2020 20:41:04.849 # (00007f0070528e27) -> 0000000000441617
Jan 16 20:41:04 keydb-server[5309]: 5309:M 16 Jan 2020 20:41:04.849 # (00007f0070528e26) -> 0000000000000000
Jan 16 20:41:04 keydb-server[5309]: 5309:M 16 Jan 2020 20:41:04.849 # (00007f0070528e25) -> 0000000000000000
Jan 16 20:41:04 keydb-server[5309]: 5309:M 16 Jan 2020 20:41:04.849 # (00007f0070528e24) -> 00007f006c0f52c0
Jan 16 20:41:04 keydb-server[5309]: 5309:M 16 Jan 2020 20:41:04.849 # (00007f0070528e23) -> 0000000000000000
Jan 16 20:41:04 keydb-server[5309]: 5309:M 16 Jan 2020 20:41:04.849 # (00007f0070528e22) -> 0000000000000001
Jan 16 20:41:04 keydb-server[5309]: 5309:M 16 Jan 2020 20:41:04.849 # (00007f0070528e21) -> 000000000000002b
Jan 16 20:41:04 keydb-server[5309]: 5309:M 16 Jan 2020 20:41:04.849 # (00007f0070528e20) -> 00007f0072e23000
Jan 16 20:41:04 keydb-server[5309]: ------ FAST MEMORY TEST ------
Jan 16 20:41:04 keydb-server[5309]: 5309:M 16 Jan 2020 20:41:04.849 # Bio thread for job type #0 terminated
Jan 16 20:41:04 keydb-server[5309]: 5309:M 16 Jan 2020 20:41:04.849 # Bio thread for job type #1 terminated
Jan 16 20:41:04 keydb-server[5309]: 5309:M 16 Jan 2020 20:41:04.849 # Bio thread for job type #2 terminated
Jan 16 20:41:04 keydb-server[5309]: *** Preparing to test memory region 7c6000 (2256896 bytes)
Jan 16 20:41:04 keydb-server[5309]: *** Preparing to test memory region 21d5000 (266240 bytes)
Jan 16 20:41:04 keydb-server[5309]: *** Preparing to test memory region 7ef16c000000 (135168 bytes)
Jan 16 20:41:04 keydb-server[5309]: *** Preparing to test memory region 7ef170000000 (135168 bytes)
Jan 16 20:41:04 keydb-server[5309]: *** Preparing to test memory region 7ef176400000 (29556736 bytes)
Jan 16 20:41:04 keydb-server[5309]: *** Preparing to test memory region 7ef17c600000 (64082870272 bytes)
Jan 16 20:41:04 keydb-server[5309]: *** Preparing to test memory region 7f006c000000 (4194304 bytes)
Jan 16 20:41:04 keydb-server[5309]: *** Preparing to test memory region 7f006c7e6000 (8192 bytes)
Jan 16 20:41:04 keydb-server[5309]: *** Preparing to test memory region 7f006cbfa000 (24576 bytes)
Jan 16 20:41:04 keydb-server[5309]: *** Preparing to test memory region 7f006cc00000 (16777216 bytes)
Jan 16 20:41:04 keydb-server[5309]: *** Preparing to test memory region 7f006dd28000 (8388608 bytes)
Jan 16 20:41:04 keydb-server[5309]: *** Preparing to test memory region 7f006e529000 (8388608 bytes)
Jan 16 20:41:04 keydb-server[5309]: *** Preparing to test memory region 7f006ed2a000 (8388608 bytes)
Jan 16 20:41:04 keydb-server[5309]: *** Preparing to test memory region 7f006f52b000 (8388608 bytes)
Jan 16 20:41:04 keydb-server[5309]: *** Preparing to test memory region 7f006fd2c000 (8388608 bytes)
Jan 16 20:41:04 keydb-server[5309]: *** Preparing to test memory region 7f007052d000 (8388608 bytes)
Jan 16 20:41:04 keydb-server[5309]: *** Preparing to test memory region 7f0070d2e000 (8388608 bytes)
Jan 16 20:41:04 keydb-server[5309]: *** Preparing to test memory region 7f007152f000 (8388608 bytes)
Jan 16 20:41:04 keydb-server[5309]: *** Preparing to test memory region 7f0071d30000 (8388608 bytes)
Jan 16 20:41:04 keydb-server[5309]: *** Preparing to test memory region 7f0072530000 (9437184 bytes)
Jan 16 20:41:04 keydb-server[5309]: *** Preparing to test memory region 7f0079a00000 (8388608 bytes)
Jan 16 20:41:04 keydb-server[5309]: *** Preparing to test memory region 7f007a6d1000 (16384 bytes)
Jan 16 20:41:04 keydb-server[5309]: *** Preparing to test memory region 7f007a8ef000 (16384 bytes)
Jan 16 20:41:04 keydb-server[5309]: *** Preparing to test memory region 7f007b1c7000 (16384 bytes)
Jan 16 20:41:04 keydb-server[5309]: *** Preparing to test memory region 7f007b9eb000 (49152 bytes)
Jan 16 20:41:04 keydb-server[5309]: *** Preparing to test memory region 7f007ba01000 (4096 bytes)