unixsurfer

//
// main.go
// Copyright (C) 2023 pavlos <pavlos.parissis@gmail.com>
//
// Distributed under terms of the MIT license.
//

package main

import (

unixsurfer

i-05bd5bb90f67d12a9
i-05786896bc6eb7314
i-061e8ab8468392e71
i-0497cd946a4f0b2f4
i-0fb7985985aa26b27
i-0e3edbf875b3167e1
i-0ec4a578e4a5d74ce
i-013ab1e2d07427741
i-017df534ca2d8a557
i-0aeecb7b92fc115f6

unixsurfer

2020/01/13 14:45:03 [INFO] Terraform version: 0.12.16
2020/01/13 14:45:03 [INFO] Go runtime version: go1.12.13
2020/01/13 14:45:03 [INFO] CLI args: []string{"/home/foouser/.tfenv/versions/0.12.16/terraform", "plan"}
2020/01/13 14:45:03 [DEBUG] Attempting to open CLI config file: /home/foouser/.terraformrc
2020/01/13 14:45:03 [DEBUG] File doesn't exist, but doesn't need to. Ignoring.
2020/01/13 14:45:03 [INFO] CLI command args: []string{"plan"}
2020/01/13 14:45:03 [INFO] Setting AWS metadata API timeout to 100ms
2020/01/13 14:45:04 [INFO] Ignoring AWS metadata API endpoint at default location as it doesn't return any instance-id
2020/01/13 14:45:04 [INFO] AWS Auth provider used: "SharedCredentialsProvider"

unixsurfer

### Keybase proof

I hereby claim:

  * I am unixsurfer on github.
  * I am unixsurfer (https://keybase.io/unixsurfer) on keybase.
  * I have a public key ASB1xMVqXvIudQ3W8fzhe35HpMfV7ZV9zNV99LVf-MigQAo

To claim this, I am signing this object:

unixsurfer

sar -f sa14 -s 08:12:00 -P 41 <← this the CPU mentioned in the crash
Linux 4.14.32–1.el7.x86_64 04/14/2018 _x86_64_ (56 CPU)
08:12:00 AM CPU %user %nice %system %iowait %steal %idle
08:12:01 AM 41 0.00 0.00 0.00 0.00 0.00 100.00
08:12:02 AM 41 0.99 0.00 0.99 0.00 0.00 98.02
08:12:03 AM 41 1.00 0.00 0.00 0.00 0.00 99.00
08:12:04 AM 41 0.00 0.00 0.00 0.00 0.00 100.00
08:12:05 AM 41 0.00 0.00 0.00 0.00 0.00 100.00
08:12:06 AM 41 0.00 0.00 0.00 0.00 0.00 100.00
08:12:07 AM 41 0.99 0.00 0.99 0.00 0.00 98.02

unixsurfer

bnx2x: [bnx2x_clean_tx_queue:1205(eth0)]timeout waiting for queue[0]: txdata->tx_pkt_prod(19537) != txdata->tx_pkt_cons(19447)bnx2x: [bnx2x_state_wait:310(eth0)]timeout waiting for state 9watchdog: BUG: soft lockup — CPU#7 stuck for 22s! [kube-apiserver:63429]

unixsurfer

[339246.701549] watchdog: BUG: soft lockup - CPU#41 stuck for 23s! [kube-apiserver:61895]
[339246.759793] Modules linked in: binfmt_misc netconsole sctp_diag sctp dccp_diag dccp tcp_diag udp_diag raw_diag inet_diag unix_diag cfg80211 rfkill 8021q garp mrp xfs loop vfat fat x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel kvm irqbypass crct10dif_pclmul crc32_pclmul ghash_clmulni_intel pcbc aesni_intel crypto_simd sg iTCO_wdt glue_helper hpwdt iTCO_vendor_support hpilo cryptd intel_cstate ioatdma lpc_ich intel_rapl_perf pcspkr dca shpchp i2c_i801 mfd_core wmi ipmi_si ipmi_devintf ipmi_msghandler nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables ext4 mbcache jbd2 i2c_algo_bit drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm sd_mod bnx2x mdio libcrc32c crc32c_intel hpsa ptp drm scsi_transport_sas pps_core dm_mirror dm_region_hash dm_log dm_mod dax [last unloaded: acpi_power_meter]
[339247.249411] CPU: 41 PID: 61895 Comm: kube-apiserver Not tainted 4.14.32–1.el7.x86_64 #1
[339247.308344

unixsurfer

sar -f sa14 -s 08:12:00 -P 41
Linux 4.14.32-1.el7.x86_64 	04/14/2018 	_x86_64_	(56 CPU)

08:12:00 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
08:12:01 AM      41      0.00      0.00      0.00      0.00      0.00    100.00
08:12:02 AM      41      0.99      0.00      0.99      0.00      0.00     98.02
08:12:03 AM      41      1.00      0.00      0.00      0.00      0.00     99.00
08:12:04 AM      41      0.00      0.00      0.00      0.00      0.00    100.00

unixsurfer

CentOS Linux 7 (Core)
Kernel 4.14.32-1.el7.x86_64 on an x86_64
[123379.816452] perf: interrupt took too long (6243 > 6231), lowering kernel.perf_event_max_sample_rate to 32000
[295349.255065] general protection fault: 0000 [#1] SMP PTI
[295349.281440] Modules linked in: binfmt_misc sctp_diag sctp dccp_diag dccp tcp_diag udp_diag inet_diag unix_diag cfg80211 rfkill 8021q garp mrp xfs x86_pkg_temp_thermal intel_powerclamp loop coretemp kvm_intel kvm irqbypass crct10dif_pclmul crc32_pclmul ghash_clmulni_intel pcbc aesni_intel crypto_simd glue_helper cryptd iTCO_wdt ipmi_si iTCO_vendor_support intel_cstate intel_rapl_perf lpc_ich sg hpilo hpwdt ioatdma pcspkr ipmi_devintf i2c_i801 dca shpchp mfd_core wmi ipmi_msghandler nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables ext4 mbcache jbd2 i2c_algo_bit drm_kms_helper syscopyarea sysfillrect sysimgblt sd_mod fb_sys_fops ttm bnx2x mdio libcrc32c crc32c_intel serio_raw hpsa ptp drm scsi_transport_sas pps_core dm_mirror dm_region_hash dm_log dm_mod dax
[295349.615

unixsurfer

[295689.560838] NETDEV WATCHDOG: eth0 (bnx2x): transmit queue 0 timed out
[295689.592711] ------------[ cut here ]------------
[295689.615709] WARNING: CPU: 0 PID: 0 at net/sched/sch_generic.c:320 dev_watchdog+0x22b/0x230
[295689.656244] Modules linked in: netconsole binfmt_misc sctp_diag sctp dccp_diag dccp tcp_diag udp_diag inet_diag unix_diag cfg80211 rfkill 8021q garp mrp xfs loop x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel kvm irqbypass crct10dif_pclmul crc32_pclmul ghash_clmulni_intel pcbc aesni_intel crypto_simd glue_helper cryptd iTCO_wdt intel_cstate hpwdt hpilo iTCO_vendor_support sg intel_rapl_perf ipmi_si pcspkr ioatdma shpchp lpc_ich i2c_i801 ipmi_devintf dca mfd_core wmi ipmi_msghandler nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables ext4 mbcache jbd2 i2c_algo_bit sd_mod drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm bnx2x serio_raw mdio libcrc32c crc32c_intel hpsa ptp drm scsi_transport_sas pps_core dm_mirror dm_region_hash dm_log dm_mod dax
[295689.996667]