unixsurfer

 Exception in thread foo1:
 Traceback (most recent call last):
   File "foo../lib/python3.4/threading.py", line 911, in _bootstrap_inner
     self.run()
   File "foo../lib/python3.4/site-packages/anycast_healthchecker/servicecheck.py", line 189, in run
     if not self._ip_assigned():
   File "foo../lib/python3.4/site-packages/anycast_healthchecker/servicecheck.py", line 93, in _ip_assigned
     timeout=1)
   File "foo../lib/python3.4/subprocess.py", line 612, in check_output
     output, unused_err = process.communicate()

unixsurfer

pparissis at poseidonas in ~
python -c "import sys, pprint; pprint.pprint(sys.path)"
['',
 '/usr/lib/python2.7',
 '/usr/lib/python2.7/plat-x86_64-linux-gnu',
 '/usr/lib/python2.7/lib-tk',
 '/usr/lib/python2.7/lib-old',
 '/usr/lib/python2.7/lib-dynload',
 '/usr/local/lib/python2.7/dist-packages',

unixsurfer

make clean;make TARGET=linux2628 USE_PCRE=1 USE_OPENSSL=1 USE_ZLIB=1 USE_PCRE_JIT=1 USE_TPROXY=1
rm -f *.[oas] src/*.[oas] ebtree/*.[oas] haproxy test .build_opts .build_opts.new
for dir in . src include/* doc ebtree; do rm -f $dir/*~ $dir/*.rej $dir/core; done
rm -f haproxy-1.8-dev0.tar.gz haproxy-1.8-dev0-6f6bb3-232.tar.gz
rm -f haproxy-1.8-dev0 haproxy-1.8-dev0-6f6bb3-232 nohup.out gmon.out
rm -f haproxy-systemd-wrapper
gcc -Iinclude -Iebtree -Wall  -O2 -g -fno-strict-aliasing -Wdeclaration-after-statement       -DCONFIG_HAP_LINUX_SPLICE -DTPROXY -DCONFIG_HAP_LINUX_TPROXY -DCONFIG_HAP_CRYPT -DUSE_ZLIB  -DENABLE_POLL -DENABLE_EPOLL -DUSE_CPU_AFFINITY -DASSUME_SPLICE_WORKS -DUSE_ACCEPT4 -DNETFILTER -DUSE_GETSOCKNAME -DUSE_OPENSSL  -DUSE_SYSCALL_FUTEX -DUSE_PCRE -I/usr/include -DUSE_PCRE_JIT  -DCONFIG_HAPROXY_VERSION=\"1.8-dev0-6f6bb3-232\" -DCONFIG_HAPROXY_DATE=\"2017/03/14\" -c -o src/ev_poll.o src/ev_poll.c
gcc -Iinclude -Iebtree -Wall  -O2 -g -fno-strict-aliasing -Wdeclaration-after-statement       -DCONF

unixsurfer

SE_SYSCALL_FUTEX -DUSE_PCRE -I/usr/include -DUSE_PCRE_JIT  -DCONFIG_HAPROXY_VERSION=\"1.6.11-103925-18\" -DCONFIG_HAPROXY_DATE=\"2017/02/23\" -c -o src/ssl_sock.o src/ssl_sock.c
src/ssl_sock.c: In function ‘ssl_sock_load_ocsp_response’:
src/ssl_sock.c:328:21: error: dereferencing pointer to incomplete type ‘OCSP_SINGLERESP {aka struct ocsp_single_response_st}’
   if (OCSP_id_cmp(sr->certId, cid)) {
                     ^~
src/ssl_sock.c: In function ‘ssl_tlsext_ticket_key_cb’:
src/ssl_sock.c:450:3: warning: ‘RAND_pseudo_bytes’ is deprecated [-Wdeprecated-declarations]
   if(!RAND_pseudo_bytes(iv, EVP_MAX_IV_LENGTH))
   ^~
In file included from /usr/include/openssl/ct.h:13:0,

unixsurfer

[138630.417246] cache_from_obj: Wrong slab cache. fsnotify_mark_connector but object is from kmalloc-2048(361:anycast-healthchecker.service)
[138630.477075] ------------[ cut here ]------------
[138630.500028] WARNING: CPU: 14 PID: 26002 at mm/slab.h:377 kmem_cache_free+0x133/0x1c0
[138630.538130] Modules linked in: netconsole binfmt_misc sctp_diag sctp dccp_diag dccp tcp_diag udp_diag inet_diag unix_diag cfg80211 rfkill 8021q garp mrp xfs loop x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel kvm irqbypass crct10dif_pclmul crc32_pclmul ghash_clmulni_intel pcbc aesni_intel crypto_simd glue_helper cryptd iTCO_wdt intel_cstate hpwdt hpilo iTCO_vendor_support sg intel_rapl_perf ipmi_si pcspkr ioatdma shpchp lpc_ich i2c_i801 ipmi_devintf dca mfd_core wmi ipmi_msghandler nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables ext4 mbcache jbd2 i2c_algo_bit sd_mod drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm bnx2x serio_raw mdio libcrc32c crc32c_intel hpsa ptp drm scsi_transport_sas pps_cor

unixsurfer

[295689.560838] NETDEV WATCHDOG: eth0 (bnx2x): transmit queue 0 timed out
[295689.592711] ------------[ cut here ]------------
[295689.615709] WARNING: CPU: 0 PID: 0 at net/sched/sch_generic.c:320 dev_watchdog+0x22b/0x230
[295689.656244] Modules linked in: netconsole binfmt_misc sctp_diag sctp dccp_diag dccp tcp_diag udp_diag inet_diag unix_diag cfg80211 rfkill 8021q garp mrp xfs loop x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel kvm irqbypass crct10dif_pclmul crc32_pclmul ghash_clmulni_intel pcbc aesni_intel crypto_simd glue_helper cryptd iTCO_wdt intel_cstate hpwdt hpilo iTCO_vendor_support sg intel_rapl_perf ipmi_si pcspkr ioatdma shpchp lpc_ich i2c_i801 ipmi_devintf dca mfd_core wmi ipmi_msghandler nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables ext4 mbcache jbd2 i2c_algo_bit sd_mod drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm bnx2x serio_raw mdio libcrc32c crc32c_intel hpsa ptp drm scsi_transport_sas pps_core dm_mirror dm_region_hash dm_log dm_mod dax
[295689.996667] 

unixsurfer

CentOS Linux 7 (Core)
Kernel 4.14.32-1.el7.x86_64 on an x86_64
[123379.816452] perf: interrupt took too long (6243 > 6231), lowering kernel.perf_event_max_sample_rate to 32000
[295349.255065] general protection fault: 0000 [#1] SMP PTI
[295349.281440] Modules linked in: binfmt_misc sctp_diag sctp dccp_diag dccp tcp_diag udp_diag inet_diag unix_diag cfg80211 rfkill 8021q garp mrp xfs x86_pkg_temp_thermal intel_powerclamp loop coretemp kvm_intel kvm irqbypass crct10dif_pclmul crc32_pclmul ghash_clmulni_intel pcbc aesni_intel crypto_simd glue_helper cryptd iTCO_wdt ipmi_si iTCO_vendor_support intel_cstate intel_rapl_perf lpc_ich sg hpilo hpwdt ioatdma pcspkr ipmi_devintf i2c_i801 dca shpchp mfd_core wmi ipmi_msghandler nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables ext4 mbcache jbd2 i2c_algo_bit drm_kms_helper syscopyarea sysfillrect sysimgblt sd_mod fb_sys_fops ttm bnx2x mdio libcrc32c crc32c_intel serio_raw hpsa ptp drm scsi_transport_sas pps_core dm_mirror dm_region_hash dm_log dm_mod dax
[295349.615

unixsurfer

sar -f sa14 -s 08:12:00 -P 41
Linux 4.14.32-1.el7.x86_64 	04/14/2018 	_x86_64_	(56 CPU)

08:12:00 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
08:12:01 AM      41      0.00      0.00      0.00      0.00      0.00    100.00
08:12:02 AM      41      0.99      0.00      0.99      0.00      0.00     98.02
08:12:03 AM      41      1.00      0.00      0.00      0.00      0.00     99.00
08:12:04 AM      41      0.00      0.00      0.00      0.00      0.00    100.00

unixsurfer

[339246.701549] watchdog: BUG: soft lockup - CPU#41 stuck for 23s! [kube-apiserver:61895]
[339246.759793] Modules linked in: binfmt_misc netconsole sctp_diag sctp dccp_diag dccp tcp_diag udp_diag raw_diag inet_diag unix_diag cfg80211 rfkill 8021q garp mrp xfs loop vfat fat x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel kvm irqbypass crct10dif_pclmul crc32_pclmul ghash_clmulni_intel pcbc aesni_intel crypto_simd sg iTCO_wdt glue_helper hpwdt iTCO_vendor_support hpilo cryptd intel_cstate ioatdma lpc_ich intel_rapl_perf pcspkr dca shpchp i2c_i801 mfd_core wmi ipmi_si ipmi_devintf ipmi_msghandler nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables ext4 mbcache jbd2 i2c_algo_bit drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm sd_mod bnx2x mdio libcrc32c crc32c_intel hpsa ptp drm scsi_transport_sas pps_core dm_mirror dm_region_hash dm_log dm_mod dax [last unloaded: acpi_power_meter]
[339247.249411] CPU: 41 PID: 61895 Comm: kube-apiserver Not tainted 4.14.32–1.el7.x86_64 #1
[339247.308344

unixsurfer

bnx2x: [bnx2x_clean_tx_queue:1205(eth0)]timeout waiting for queue[0]: txdata->tx_pkt_prod(19537) != txdata->tx_pkt_cons(19447)bnx2x: [bnx2x_state_wait:310(eth0)]timeout waiting for state 9watchdog: BUG: soft lockup — CPU#7 stuck for 22s! [kube-apiserver:63429]