Skip to content

Instantly share code, notes, and snippets.

@crowtrobot
Created February 23, 2014 01:16
Show Gist options
  • Save crowtrobot/9165178 to your computer and use it in GitHub Desktop.
Save crowtrobot/9165178 to your computer and use it in GitHub Desktop.
Syslog covering backtraces
Feb 22 01:31:26 neon zfs-auto-snap: @zfs-auto-snap_daily-2014-02-22-0131, 4 created, 3 destroyed, 0 warnings.
Feb 22 01:31:26 neon anacron[2239]: Job `cron.daily' terminated (exit status: 1) (mailing output)
Feb 22 01:31:26 neon anacron[2239]: Can't find sendmail at /usr/sbin/sendmail, not mailing output
Feb 22 01:31:26 neon anacron[2239]: Normal exit (1 job run)
Feb 22 01:31:59 neon rtkit-daemon[3933]: The canary thread is apparently starving. Taking action.
Feb 22 01:31:59 neon rtkit-daemon[3933]: Demoting known real-time threads.
Feb 22 01:31:59 neon rtkit-daemon[3933]: Successfully demoted thread 4021 of process 3931 (n/a).
Feb 22 01:31:59 neon rtkit-daemon[3933]: Successfully demoted thread 4015 of process 3931 (n/a).
Feb 22 01:31:59 neon rtkit-daemon[3933]: Successfully demoted thread 4000 of process 3931 (n/a).
Feb 22 01:31:59 neon rtkit-daemon[3933]: Successfully demoted thread 3931 of process 3931 (n/a).
Feb 22 01:31:59 neon rtkit-daemon[3933]: Demoted 4 threads.
Feb 22 01:32:09 neon rtkit-daemon[3933]: The canary thread is apparently starving. Taking action.
Feb 22 01:32:09 neon rtkit-daemon[3933]: Demoting known real-time threads.
Feb 22 01:32:09 neon rtkit-daemon[3933]: Successfully demoted thread 4021 of process 3931 (n/a).
Feb 22 01:32:09 neon rtkit-daemon[3933]: Successfully demoted thread 4015 of process 3931 (n/a).
Feb 22 01:32:09 neon rtkit-daemon[3933]: Successfully demoted thread 4000 of process 3931 (n/a).
Feb 22 01:32:09 neon rtkit-daemon[3933]: Successfully demoted thread 3931 of process 3931 (n/a).
Feb 22 01:32:09 neon rtkit-daemon[3933]: Demoted 4 threads.
Feb 22 01:32:19 neon rtkit-daemon[3933]: The canary thread is apparently starving. Taking action.
Feb 22 01:32:19 neon rtkit-daemon[3933]: Demoting known real-time threads.
Feb 22 01:32:19 neon rtkit-daemon[3933]: Successfully demoted thread 4021 of process 3931 (n/a).
Feb 22 01:32:19 neon rtkit-daemon[3933]: Successfully demoted thread 4015 of process 3931 (n/a).
Feb 22 01:32:19 neon rtkit-daemon[3933]: Successfully demoted thread 4000 of process 3931 (n/a).
Feb 22 01:32:19 neon rtkit-daemon[3933]: Successfully demoted thread 3931 of process 3931 (n/a).
Feb 22 01:32:19 neon rtkit-daemon[3933]: Demoted 4 threads.
Feb 22 01:32:29 neon rtkit-daemon[3933]: The canary thread is apparently starving. Taking action.
Feb 22 01:32:29 neon rtkit-daemon[3933]: Demoting known real-time threads.
Feb 22 01:32:29 neon rtkit-daemon[3933]: Successfully demoted thread 4021 of process 3931 (n/a).
Feb 22 01:32:29 neon rtkit-daemon[3933]: Successfully demoted thread 4015 of process 3931 (n/a).
Feb 22 01:32:29 neon rtkit-daemon[3933]: Successfully demoted thread 4000 of process 3931 (n/a).
Feb 22 01:32:29 neon rtkit-daemon[3933]: Successfully demoted thread 3931 of process 3931 (n/a).
Feb 22 01:32:29 neon rtkit-daemon[3933]: Demoted 4 threads.
Feb 22 01:32:39 neon rtkit-daemon[3933]: The canary thread is apparently starving. Taking action.
Feb 22 01:32:39 neon rtkit-daemon[3933]: Demoting known real-time threads.
Feb 22 01:32:39 neon rtkit-daemon[3933]: Successfully demoted thread 4021 of process 3931 (n/a).
Feb 22 01:32:39 neon rtkit-daemon[3933]: Successfully demoted thread 4015 of process 3931 (n/a).
Feb 22 01:32:39 neon rtkit-daemon[3933]: Successfully demoted thread 4000 of process 3931 (n/a).
Feb 22 01:32:39 neon rtkit-daemon[3933]: Successfully demoted thread 3931 of process 3931 (n/a).
Feb 22 01:32:39 neon rtkit-daemon[3933]: Demoted 4 threads.
Feb 22 01:32:49 neon rtkit-daemon[3933]: The canary thread is apparently starving. Taking action.
Feb 22 01:32:49 neon rtkit-daemon[3933]: Demoting known real-time threads.
Feb 22 01:32:49 neon rtkit-daemon[3933]: Successfully demoted thread 4021 of process 3931 (n/a).
Feb 22 01:32:49 neon rtkit-daemon[3933]: Successfully demoted thread 4015 of process 3931 (n/a).
Feb 22 01:32:49 neon rtkit-daemon[3933]: Successfully demoted thread 4000 of process 3931 (n/a).
Feb 22 01:32:49 neon rtkit-daemon[3933]: Successfully demoted thread 3931 of process 3931 (n/a).
Feb 22 01:32:49 neon rtkit-daemon[3933]: Demoted 4 threads.
Feb 22 01:32:50 neon kernel: [ 498.295354] ------------[ cut here ]------------
Feb 22 01:32:50 neon kernel: [ 498.295368] WARNING: at /build/buildd/linux-3.8.0/kernel/watchdog.c:246 watchdog_overflow_callback+0x9c/0xd0()
Feb 22 01:32:50 neon kernel: [ 498.295372] Hardware name: To be filled by O.E.M.
Feb 22 01:32:50 neon kernel: [ 498.295375] Watchdog detected hard LOCKUP on cpu 4
Feb 22 01:32:50 neon kernel: [ 498.295378] Modules linked in: pci_stub vboxpci(OF) vboxnetadp(OF) vboxnetflt(OF) vboxdrv(OF) ib_srpt tcm_qla2xxx qla2xxx tcm_loop tcm_fc libfc scsi_transport_fc(F) scsi_tgt(F) iscsi_target_mod target_core_pscsi target_core_file target_core_iblock target_core_mod configfs(F) ib_iser rdma_cm parport_pc(F) ib_addr iw_cm ppdev(F) ib_cm ib_sa ib_mad ib_core iscsi_tcp(F) bnep rfcomm libiscsi_tcp(F) libiscsi(F) scsi_transport_iscsi(F) nfsv4(F) bluetooth nfsd(F) binfmt_misc(F) auth_rpcgss(F) nfs_acl(F) nfs(F) lockd(F) sunrpc(F) fscache(F) snd_hda_codec_hdmi eeepc_wmi asus_wmi sparse_keymap video(F) mxm_wmi joydev(F) dm_multipath(F) kvm_amd(F) scsi_dh(F) kvm(F) ghash_clmulni_intel(F) aesni_intel(F) aes_x86_64(F) snd_hda_codec_realtek xts(F) lrw(F) gf128mul(F) ablk_helper(F) cryptd(F) psmouse(F) fam15h_power serio_raw(F) edac_core microcode(F) snd_hda_intel k10temp snd_hda_codec edac_mce_amd nvidia(POF) snd_hwdep(F) sp5100_tco i2c_piix4 snd_pcm(F) snd_page_alloc(F) snd_seq_midi(F) snd_se
Feb 22 01:32:50 neon kernel: q_midi_event(F) snd_rawmidi(F) snd_seq(F) snd_seq_device(F) snd_timer(F) snd(F) soundcore(F) wmi mac_hid lp(F) parport(F) zfs(POF) zunicode(POF) zavl(POF) zcommon(POF) znvpair(POF) spl(OF) xfs(F) btrfs(F) zlib_deflate(F) libcrc32c(F) dm_raid45 xor(F) dm_mirror(F) dm_region_hash(F) dm_log(F) hid_generic hid_microsoft usbhid hid usb_storage(F) r8169 e1000e(F) ahci(F) libahci(F)
Feb 22 01:32:50 neon kernel: [ 498.295517] Pid: 7557, comm: zfs Tainted: PF O 3.8.0-35-generic #50-Ubuntu
Feb 22 01:32:50 neon kernel: [ 498.295521] Call Trace:
Feb 22 01:32:50 neon kernel: [ 498.295525] <NMI> [<ffffffff81058a3f>] warn_slowpath_common+0x7f/0xc0
Feb 22 01:32:50 neon kernel: [ 498.295538] [<ffffffff81058b3c>] warn_slowpath_fmt+0x4c/0x50
Feb 22 01:32:50 neon kernel: [ 498.295547] [<ffffffff8101bb89>] ? sched_clock+0x9/0x10
Feb 22 01:32:50 neon kernel: [ 498.295553] [<ffffffff810e9a30>] ? touch_nmi_watchdog+0x80/0x80
Feb 22 01:32:50 neon kernel: [ 498.295559] [<ffffffff810e9acc>] watchdog_overflow_callback+0x9c/0xd0
Feb 22 01:32:50 neon kernel: [ 498.295566] [<ffffffff81126c5d>] __perf_event_overflow+0x9d/0x230
Feb 22 01:32:50 neon kernel: [ 498.295572] [<ffffffff81123dc4>] ? perf_event_update_userpage+0x24/0x110
Feb 22 01:32:50 neon kernel: [ 498.295578] [<ffffffff81127874>] perf_event_overflow+0x14/0x20
Feb 22 01:32:50 neon kernel: [ 498.295584] [<ffffffff8102582f>] x86_pmu_handle_irq+0xff/0x150
Feb 22 01:32:50 neon kernel: [ 498.295594] [<ffffffff816cfc6d>] perf_event_nmi_handler+0x1d/0x20
Feb 22 01:32:50 neon kernel: [ 498.295600] [<ffffffff816cf419>] nmi_handle.isra.0+0x59/0x90
Feb 22 01:32:50 neon kernel: [ 498.295607] [<ffffffff816cf5d9>] do_nmi+0x189/0x360
Feb 22 01:32:50 neon kernel: [ 498.295613] [<ffffffff816cea41>] end_repeat_nmi+0x1e/0x2e
Feb 22 01:32:50 neon kernel: [ 498.295639] [<ffffffffa02cb83b>] ? kmem_free_debug+0x4b/0x150 [spl]
Feb 22 01:32:50 neon kernel: [ 498.295648] [<ffffffff81044ac2>] ? __ticket_spin_lock+0x22/0x30
Feb 22 01:32:50 neon kernel: [ 498.295655] [<ffffffff81044ac2>] ? __ticket_spin_lock+0x22/0x30
Feb 22 01:32:50 neon kernel: [ 498.295661] [<ffffffff81044ac2>] ? __ticket_spin_lock+0x22/0x30
Feb 22 01:32:50 neon kernel: [ 498.295664] <<EOE>> [<ffffffff816cde65>] _raw_spin_lock_irq+0x15/0x20
Feb 22 01:32:50 neon kernel: [ 498.295676] [<ffffffff816cdca6>] rwsem_down_failed_common+0x46/0x170
Feb 22 01:32:50 neon kernel: [ 498.295681] [<ffffffff816cb7ad>] ? mutex_lock+0x1d/0x50
Feb 22 01:32:50 neon kernel: [ 498.295688] [<ffffffff816cde05>] rwsem_down_read_failed+0x15/0x17
Feb 22 01:32:50 neon kernel: [ 498.295695] [<ffffffff813555d4>] call_rwsem_down_read_failed+0x14/0x30
Feb 22 01:32:50 neon kernel: [ 498.295716] [<ffffffffa02cb83b>] ? kmem_free_debug+0x4b/0x150 [spl]
Feb 22 01:32:50 neon kernel: [ 498.295726] [<ffffffff816cc0e0>] ? down_read+0x20/0x23
Feb 22 01:32:50 neon kernel: [ 498.295808] [<ffffffffa03b28f0>] zap_get_leaf_byblk+0xd0/0x2c0 [zfs]
Feb 22 01:32:50 neon kernel: [ 498.295871] [<ffffffffa03b22f3>] ? zap_idx_to_blk+0x133/0x140 [zfs]
Feb 22 01:32:50 neon kernel: [ 498.295936] [<ffffffffa03b2b4d>] zap_deref_leaf+0x6d/0x80 [zfs]
Feb 22 01:32:50 neon kernel: [ 498.296000] [<ffffffffa03b46d1>] fzap_cursor_retrieve+0xe1/0x280 [zfs]
Feb 22 01:32:50 neon kernel: [ 498.296064] [<ffffffffa03b7ef8>] zap_cursor_retrieve+0x68/0x2e0 [zfs]
Feb 22 01:32:50 neon kernel: [ 498.296126] [<ffffffffa038f453>] ? sa_lookup_impl+0x13/0x20 [zfs]
Feb 22 01:32:50 neon kernel: [ 498.296188] [<ffffffffa038f4b0>] ? sa_bulk_lookup+0x40/0x60 [zfs]
Feb 22 01:32:50 neon kernel: [ 498.296256] [<ffffffffa03b3db1>] zap_value_search+0x91/0xd0 [zfs]
Feb 22 01:32:50 neon kernel: [ 498.296318] [<ffffffffa03e1e70>] zfs_obj_to_path_impl+0x190/0x280 [zfs]
Feb 22 01:32:50 neon kernel: [ 498.296382] [<ffffffffa038f453>] ? sa_lookup_impl+0x13/0x20 [zfs]
Feb 22 01:32:50 neon kernel: [ 498.296444] [<ffffffffa038f4b0>] ? sa_bulk_lookup+0x40/0x60 [zfs]
Feb 22 01:32:50 neon kernel: [ 498.296506] [<ffffffffa03dd9d1>] ? zfs_obj_to_stats_impl+0xa1/0xb0 [zfs]
Feb 22 01:32:50 neon kernel: [ 498.296569] [<ffffffffa03e20bb>] zfs_obj_to_stats+0xab/0xd0 [zfs]
Feb 22 01:32:50 neon kernel: [ 498.296635] [<ffffffffa03c51b4>] zfs_ioc_obj_to_stats+0x84/0xa0 [zfs]
Feb 22 01:32:50 neon kernel: [ 498.296698] [<ffffffffa03cc30d>] zfsdev_ioctl+0xdd/0x1d0 [zfs]
Feb 22 01:32:50 neon kernel: [ 498.296705] [<ffffffff811a6659>] do_vfs_ioctl+0x99/0x570
Feb 22 01:32:50 neon kernel: [ 498.296711] [<ffffffff811a6bc1>] sys_ioctl+0x91/0xb0
Feb 22 01:32:50 neon kernel: [ 498.296718] [<ffffffff816d671d>] system_call_fastpath+0x1a/0x1f
Feb 22 01:32:50 neon kernel: [ 498.296722] ---[ end trace 134857e3f42317e5 ]---
Feb 22 01:32:50 neon kernel: [ 519.028626] INFO: rcu_sched detected stalls on CPUs/tasks: { 4} (detected by 2, t=15002 jiffies, g=46247, c=46246, q=19406)
Feb 22 01:32:50 neon kernel: [ 519.028637] sending NMI to all CPUs:
Feb 22 01:32:50 neon kernel: [ 519.028660] NMI backtrace for cpu 4
Feb 22 01:32:50 neon kernel: [ 519.028667] CPU 4
Feb 22 01:32:50 neon kernel: [ 519.028677] Pid: 7557, comm: zfs Tainted: PF W O 3.8.0-35-generic #50-Ubuntu To be filled by O.E.M. To be filled by O.E.M./SABERTOOTH 990FX R2.0
Feb 22 01:32:50 neon kernel: [ 519.028683] RIP: 0010:[<ffffffff81044ac0>] [<ffffffff81044ac0>] __ticket_spin_lock+0x20/0x30
Feb 22 01:32:50 neon kernel: [ 519.028698] RSP: 0018:ffff88055774b988 EFLAGS: 00000006
Feb 22 01:32:50 neon kernel: [ 519.028704] RAX: 0000000000002d4b RBX: ffff8805d5af1740 RCX: 0000000000000000
Feb 22 01:32:50 neon kernel: [ 519.028709] RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff880503870848
Feb 22 01:32:50 neon kernel: [ 519.028713] RBP: ffff88055774b988 R08: 0000000000016d40 R09: ffff88063ed16d40
Feb 22 01:32:50 neon kernel: [ 519.028718] R10: ffffea001776c200 R11: ffffffffa02cb83b R12: ffff880503870840
Feb 22 01:32:50 neon kernel: [ 519.028723] R13: ffff880503870848 R14: ffffffffffffffff R15: 0000000000000001
Feb 22 01:32:50 neon kernel: [ 519.028729] FS: 00007fbe10597700(0000) GS:ffff88063ed00000(0000) knlGS:0000000000000000
Feb 22 01:32:50 neon kernel: [ 519.028734] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Feb 22 01:32:50 neon kernel: [ 519.028738] CR2: 0000000001d8efe0 CR3: 00000005a4493000 CR4: 00000000000407e0
Feb 22 01:32:50 neon kernel: [ 519.028743] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Feb 22 01:32:50 neon kernel: [ 519.028748] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Feb 22 01:32:50 neon kernel: [ 519.028754] Process zfs (pid: 7557, threadinfo ffff88055774a000, task ffff8805d5af1740)
Feb 22 01:32:50 neon kernel: [ 519.028757] Stack:
Feb 22 01:32:50 neon kernel: [ 519.028761] ffff88055774b998 ffffffff816cde65 ffff88055774ba00 ffffffff816cdca6
Feb 22 01:32:50 neon kernel: [ 519.028772] 0000000000000000 0000000000000000 000000005774ba00 ffffffff00000000
Feb 22 01:32:50 neon kernel: [ 519.028783] ffffffff816cb7ad ffff880503b22248 ffff880503870840 0000000000000002
Feb 22 01:32:50 neon kernel: [ 519.028793] Call Trace:
Feb 22 01:32:50 neon kernel: [ 519.028804] [<ffffffff816cde65>] _raw_spin_lock_irq+0x15/0x20
Feb 22 01:32:50 neon kernel: [ 519.028813] [<ffffffff816cdca6>] rwsem_down_failed_common+0x46/0x170
Feb 22 01:32:50 neon kernel: [ 519.028822] [<ffffffff816cb7ad>] ? mutex_lock+0x1d/0x50
Feb 22 01:32:50 neon kernel: [ 519.028830] [<ffffffff816cde05>] rwsem_down_read_failed+0x15/0x17
Feb 22 01:32:50 neon kernel: [ 519.028840] [<ffffffff813555d4>] call_rwsem_down_read_failed+0x14/0x30
Feb 22 01:32:50 neon kernel: [ 519.028882] [<ffffffffa02cb83b>] ? kmem_free_debug+0x4b/0x150 [spl]
Feb 22 01:32:50 neon kernel: [ 519.028895] [<ffffffff816cc0e0>] ? down_read+0x20/0x23
Feb 22 01:32:50 neon kernel: [ 519.028976] [<ffffffffa03b28f0>] zap_get_leaf_byblk+0xd0/0x2c0 [zfs]
Feb 22 01:32:50 neon kernel: [ 519.029046] [<ffffffffa03b22f3>] ? zap_idx_to_blk+0x133/0x140 [zfs]
Feb 22 01:32:50 neon kernel: [ 519.029116] [<ffffffffa03b2b4d>] zap_deref_leaf+0x6d/0x80 [zfs]
Feb 22 01:32:50 neon kernel: [ 519.029186] [<ffffffffa03b46d1>] fzap_cursor_retrieve+0xe1/0x280 [zfs]
Feb 22 01:32:50 neon kernel: [ 519.029255] [<ffffffffa03b7ef8>] zap_cursor_retrieve+0x68/0x2e0 [zfs]
Feb 22 01:32:50 neon kernel: [ 519.029322] [<ffffffffa038f453>] ? sa_lookup_impl+0x13/0x20 [zfs]
Feb 22 01:32:50 neon kernel: [ 519.029389] [<ffffffffa038f4b0>] ? sa_bulk_lookup+0x40/0x60 [zfs]
Feb 22 01:32:50 neon kernel: [ 519.029464] [<ffffffffa03b3db1>] zap_value_search+0x91/0xd0 [zfs]
Feb 22 01:32:50 neon kernel: [ 519.029533] [<ffffffffa03e1e70>] zfs_obj_to_path_impl+0x190/0x280 [zfs]
Feb 22 01:32:50 neon kernel: [ 519.029601] [<ffffffffa038f453>] ? sa_lookup_impl+0x13/0x20 [zfs]
Feb 22 01:32:50 neon kernel: [ 519.029667] [<ffffffffa038f4b0>] ? sa_bulk_lookup+0x40/0x60 [zfs]
Feb 22 01:32:50 neon kernel: [ 519.029735] [<ffffffffa03dd9d1>] ? zfs_obj_to_stats_impl+0xa1/0xb0 [zfs]
Feb 22 01:32:50 neon kernel: [ 519.029803] [<ffffffffa03e20bb>] zfs_obj_to_stats+0xab/0xd0 [zfs]
Feb 22 01:32:50 neon kernel: [ 519.029875] [<ffffffffa03c51b4>] zfs_ioc_obj_to_stats+0x84/0xa0 [zfs]
Feb 22 01:32:50 neon kernel: [ 519.029945] [<ffffffffa03cc30d>] zfsdev_ioctl+0xdd/0x1d0 [zfs]
Feb 22 01:32:50 neon kernel: [ 519.029954] [<ffffffff811a6659>] do_vfs_ioctl+0x99/0x570
Feb 22 01:32:50 neon kernel: [ 519.029963] [<ffffffff811a6bc1>] sys_ioctl+0x91/0xb0
Feb 22 01:32:50 neon kernel: [ 519.029973] [<ffffffff816d671d>] system_call_fastpath+0x1a/0x1f
Feb 22 01:32:50 neon kernel: [ 519.029977] Code: 0f 1f 84 00 00 00 00 00 0f 1f 00 55 b8 00 00 01 00 48 89 e5 f0 0f c1 07 89 c1 c1 e9 10 66 39 c1 89 ca 74 11 0f 1f 80 00 00 00 00 <f3> 90 0f b7 07 66 39 d0 75 f6 5d c3 0f 1f 40 00 8b 17 55 31 c0
Feb 22 01:32:50 neon kernel: [ 519.030084] NMI backtrace for cpu 5
Feb 22 01:32:50 neon kernel: [ 519.030087] CPU 5
Feb 22 01:32:50 neon kernel: [ 519.030095] Pid: 0, comm: swapper/5 Tainted: PF W O 3.8.0-35-generic #50-Ubuntu To be filled by O.E.M. To be filled by O.E.M./SABERTOOTH 990FX R2.0
Feb 22 01:32:50 neon kernel: [ 519.030099] RIP: 0010:[<ffffffff813e3eb7>] [<ffffffff813e3eb7>] acpi_idle_do_entry+0x21/0x2b
Feb 22 01:32:50 neon kernel: [ 519.030111] RSP: 0018:ffff88061cd8be10 EFLAGS: 00000093
Feb 22 01:32:50 neon kernel: [ 519.030115] RAX: 00000078d80bd600 RBX: ffff88062600e0a0 RCX: 000000000000c648
Feb 22 01:32:50 neon kernel: [ 519.030120] RDX: 0000000000000815 RSI: ffff88063ed40000 RDI: ffff88062600e0a0
Feb 22 01:32:50 neon kernel: [ 519.030124] RBP: ffff88061cd8be10 R08: 0000000000002e8e R09: 0000000000000018
Feb 22 01:32:50 neon kernel: [ 519.030129] R10: 0000000000003e42 R11: 0000000000000000 R12: 0000000000000002
Feb 22 01:32:50 neon kernel: [ 519.030133] R13: ffff88061cd8a000 R14: ffff88062600e000 R15: ffffffff81574a50
Feb 22 01:32:50 neon kernel: [ 519.030139] FS: 00007f7ba1158b80(0000) GS:ffff88063ed40000(0000) knlGS:0000000000000000
Feb 22 01:32:50 neon kernel: [ 519.030143] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
Feb 22 01:32:50 neon kernel: [ 519.030148] CR2: 00007f786c014a68 CR3: 00000005d5904000 CR4: 00000000000407e0
Feb 22 01:32:50 neon kernel: [ 519.030152] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Feb 22 01:32:50 neon kernel: [ 519.030157] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Feb 22 01:32:50 neon kernel: [ 519.030162] Process swapper/5 (pid: 0, threadinfo ffff88061cd8a000, task ffff88061cd90000)
Feb 22 01:32:50 neon kernel: [ 519.030165] Stack:
Feb 22 01:32:50 neon kernel: [ 519.030168] ffff88061cd8be40 ffffffff813e3faa ffff88061607a000 ffffffff81c7e060
Feb 22 01:32:50 neon kernel: [ 519.030179] 00000079023575f8 0000000000000002 ffff88061cd8be50 ffffffff81574a69
Feb 22 01:32:50 neon kernel: [ 519.030189] ffff88061cd8beb0 ffffffff81575499 7735940000000001 ffff88061607a000
Feb 22 01:32:50 neon kernel: [ 519.030199] Call Trace:
Feb 22 01:32:50 neon kernel: [ 519.030207] [<ffffffff813e3faa>] acpi_idle_enter_simple+0x87/0xc5
Feb 22 01:32:50 neon kernel: [ 519.030217] [<ffffffff81574a69>] cpuidle_enter+0x19/0x20
Feb 22 01:32:50 neon kernel: [ 519.030225] [<ffffffff81575499>] cpuidle_wrap_enter+0x49/0xa0
Feb 22 01:32:50 neon kernel: [ 519.030234] [<ffffffff81575500>] cpuidle_enter_tk+0x10/0x20
Feb 22 01:32:50 neon kernel: [ 519.030242] [<ffffffff815750e5>] cpuidle_idle_call+0xa5/0x270
Feb 22 01:32:50 neon kernel: [ 519.030252] [<ffffffff8101d62f>] cpu_idle+0xaf/0x120
Feb 22 01:32:50 neon kernel: [ 519.030260] [<ffffffff816b7620>] start_secondary+0x1e0/0x1e5
Feb 22 01:32:50 neon kernel: [ 519.030266] Code: 00 83 88 3c e0 ff ff 04 5d c3 8a 47 08 55 48 89 e5 3c 01 75 07 e8 3a 35 c5 ff eb 17 3c 02 75 07 e8 a2 ff ff ff eb 0c 8b 57 04 ec <48> 8b 15 86 e1 b2 00 ed 5d c3 66 66 66 66 90 55 48 63 c2 48 c1
Feb 22 01:32:50 neon kernel: [ 519.030372] NMI backtrace for cpu 2
Feb 22 01:32:50 neon kernel: [ 519.030377] CPU 2
Feb 22 01:32:50 neon kernel: [ 519.030385] Pid: 0, comm: swapper/2 Tainted: PF W O 3.8.0-35-generic #50-Ubuntu To be filled by O.E.M. To be filled by O.E.M./SABERTOOTH 990FX R2.0
Feb 22 01:32:50 neon kernel: [ 519.030391] RIP: 0010:[<ffffffff81354161>] [<ffffffff81354161>] __const_udelay+0x1/0x30
Feb 22 01:32:50 neon kernel: [ 519.030405] RSP: 0018:ffff88063ec83dd8 EFLAGS: 00000046
Feb 22 01:32:50 neon kernel: [ 519.030410] RAX: 0000000000000000 RBX: 0000000000002710 RCX: 0000000000000004
Feb 22 01:32:50 neon kernel: [ 519.030415] RDX: 0000000000000c00 RSI: 0000000000000100 RDI: 0000000000418958
Feb 22 01:32:50 neon kernel: [ 519.030420] RBP: ffff88063ec83df0 R08: 000000000000000a R09: 0000000000000001
Feb 22 01:32:50 neon kernel: [ 519.030424] R10: 0000000000000475 R11: 0000000000000002 R12: ffffffff81ce70c0
Feb 22 01:32:50 neon kernel: [ 519.030429] R13: ffff88063ec8ee60 R14: ffffffff81c3f3c0 R15: ffffffff81c3f480
Feb 22 01:32:50 neon kernel: [ 519.030435] FS: 00007fc1d49ee740(0000) GS:ffff88063ec80000(0000) knlGS:0000000000000000
Feb 22 01:32:50 neon kernel: [ 519.030440] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
Feb 22 01:32:50 neon kernel: [ 519.030444] CR2: 0000000000df9008 CR3: 00000005dff0c000 CR4: 00000000000407e0
Feb 22 01:32:50 neon kernel: [ 519.030449] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Feb 22 01:32:50 neon kernel: [ 519.030454] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Feb 22 01:32:50 neon kernel: [ 519.030459] Process swapper/2 (pid: 0, threadinfo ffff88061cd84000, task ffff88061cd7ae80)
Feb 22 01:32:50 neon kernel: [ 519.030463] Stack:
Feb 22 01:32:50 neon kernel: [ 519.030467] ffff88063ec83df0 ffffffff81039d6a ffffffff81c3f3c0 ffff88063ec83e50
Feb 22 01:32:50 neon kernel: [ 519.030478] ffffffff810f2935 0000000000004bce 0000000000000082 0000000100000086
Feb 22 01:32:50 neon kernel: [ 519.030488] 0000000000000002 ffff88061cd84000 ffff88061cd7ae80 0000000000000002
Feb 22 01:32:50 neon kernel: [ 519.030499] Call Trace:
Feb 22 01:32:50 neon kernel: [ 519.030503] <IRQ>
Feb 22 01:32:50 neon kernel: [ 519.030507] [<ffffffff81039d6a>] ? arch_trigger_all_cpu_backtrace+0x6a/0x90
Feb 22 01:32:50 neon kernel: [ 519.030525] [<ffffffff810f2935>] rcu_pending+0x565/0x5b0
Feb 22 01:32:50 neon kernel: [ 519.030535] [<ffffffff810f4a0b>] rcu_check_callbacks+0x9b/0x120
Feb 22 01:32:50 neon kernel: [ 519.030544] [<ffffffff8106a928>] update_process_times+0x48/0x90
Feb 22 01:32:50 neon kernel: [ 519.030553] [<ffffffff810b3a8e>] tick_sched_handle.isra.8+0x2e/0x70
Feb 22 01:32:50 neon kernel: [ 519.030561] [<ffffffff810b3c1c>] tick_sched_timer+0x4c/0x80
Feb 22 01:32:50 neon kernel: [ 519.030570] [<ffffffff810819d9>] __run_hrtimer+0x79/0x1c0
Feb 22 01:32:50 neon kernel: [ 519.030578] [<ffffffff810b3bd0>] ? tick_sched_do_timer+0x40/0x40
Feb 22 01:32:50 neon kernel: [ 519.030586] [<ffffffff810822c7>] hrtimer_interrupt+0xe7/0x230
Feb 22 01:32:50 neon kernel: [ 519.030596] [<ffffffff81574a50>] ? centrino_target+0x370/0x370
Feb 22 01:32:50 neon kernel: [ 519.030606] [<ffffffff816d8519>] smp_apic_timer_interrupt+0x69/0x99
Feb 22 01:32:50 neon kernel: [ 519.030615] [<ffffffff816d745d>] apic_timer_interrupt+0x6d/0x80
Feb 22 01:32:50 neon kernel: [ 519.030618] <EOI>
Feb 22 01:32:50 neon kernel: [ 519.030623] [<ffffffff81043fa6>] ? native_safe_halt+0x6/0x10
Feb 22 01:32:50 neon kernel: [ 519.030640] [<ffffffff813e3769>] arch_safe_halt+0x9/0xd
Feb 22 01:32:50 neon kernel: [ 519.030648] [<ffffffff813e3e7d>] acpi_safe_halt+0x2a/0x43
Feb 22 01:32:50 neon kernel: [ 519.030656] [<ffffffff813e3eb1>] acpi_idle_do_entry+0x1b/0x2b
Feb 22 01:32:50 neon kernel: [ 519.030664] [<ffffffff813e3f04>] acpi_idle_enter_c1+0x43/0x62
Feb 22 01:32:50 neon kernel: [ 519.030673] [<ffffffff81574a69>] cpuidle_enter+0x19/0x20
Feb 22 01:32:50 neon kernel: [ 519.030681] [<ffffffff81575499>] cpuidle_wrap_enter+0x49/0xa0
Feb 22 01:32:50 neon kernel: [ 519.030690] [<ffffffff81575500>] cpuidle_enter_tk+0x10/0x20
Feb 22 01:32:50 neon kernel: [ 519.030697] [<ffffffff815750e5>] cpuidle_idle_call+0xa5/0x270
Feb 22 01:32:50 neon kernel: [ 519.030707] [<ffffffff8101d62f>] cpu_idle+0xaf/0x120
Feb 22 01:32:50 neon kernel: [ 519.030715] [<ffffffff816b7620>] start_secondary+0x1e0/0x1e5
Feb 22 01:32:50 neon kernel: [ 519.030720] Code: ff c8 5d c3 66 0f 1f 44 00 00 66 66 66 66 90 55 48 89 e5 ff 15 49 25 92 00 5d c3 66 66 66 66 66 66 2e 0f 1f 84 00 00 00 00 00 55 <48> 8d 04 bd 00 00 00 00 65 48 8b 14 25 18 3e 01 00 48 8d 0c 12
Feb 22 01:32:50 neon kernel: [ 519.030826] NMI backtrace for cpu 3
Feb 22 01:32:50 neon kernel: [ 519.030829] CPU 3
Feb 22 01:32:50 neon kernel: [ 519.030837] Pid: 0, comm: swapper/3 Tainted: PF W O 3.8.0-35-generic #50-Ubuntu To be filled by O.E.M. To be filled by O.E.M./SABERTOOTH 990FX R2.0
Feb 22 01:32:50 neon kernel: [ 519.030841] RIP: 0010:[<ffffffff813e3eb7>] [<ffffffff813e3eb7>] acpi_idle_do_entry+0x21/0x2b
Feb 22 01:32:50 neon kernel: [ 519.030851] RSP: 0018:ffff88061cd87e10 EFLAGS: 00000093
Feb 22 01:32:50 neon kernel: [ 519.030855] RAX: 00000078d80be400 RBX: ffff88061cdfd4a0 RCX: 000000000000c648
Feb 22 01:32:50 neon kernel: [ 519.030860] RDX: 0000000000000815 RSI: ffff88063ecc0000 RDI: ffff88061cdfd4a0
Feb 22 01:32:50 neon kernel: [ 519.030864] RBP: ffff88061cd87e10 R08: 0000000000003e31 R09: 0000000000000018
Feb 22 01:32:50 neon kernel: [ 519.030868] R10: 0000000000002e72 R11: 0000000000000000 R12: 0000000000000002
Feb 22 01:32:50 neon kernel: [ 519.030872] R13: ffff88061cd86000 R14: ffff88061cdfd400 R15: ffffffff81574a50
Feb 22 01:32:50 neon kernel: [ 519.030877] FS: 00007f2cb5c09940(0000) GS:ffff88063ecc0000(0000) knlGS:0000000000000000
Feb 22 01:32:50 neon kernel: [ 519.030882] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
Feb 22 01:32:50 neon kernel: [ 519.030886] CR2: 00007ff34bcac670 CR3: 0000000615e53000 CR4: 00000000000407e0
Feb 22 01:32:50 neon kernel: [ 519.030891] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Feb 22 01:32:50 neon kernel: [ 519.030895] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Feb 22 01:32:50 neon kernel: [ 519.030899] Process swapper/3 (pid: 0, threadinfo ffff88061cd86000, task ffff88061cd7c5c0)
Feb 22 01:32:50 neon kernel: [ 519.030903] Stack:
Feb 22 01:32:50 neon kernel: [ 519.030906] ffff88061cd87e40 ffffffff813e3faa ffff880616078000 ffffffff81c7e060
Feb 22 01:32:50 neon kernel: [ 519.030917] 00000079023583ea 0000000000000002 ffff88061cd87e50 ffffffff81574a69
Feb 22 01:32:50 neon kernel: [ 519.030928] ffff88061cd87eb0 ffffffff81575499 7735940000000001 ffff880616078000
Feb 22 01:32:50 neon kernel: [ 519.030939] Call Trace:
Feb 22 01:32:50 neon kernel: [ 519.030948] [<ffffffff813e3faa>] acpi_idle_enter_simple+0x87/0xc5
Feb 22 01:32:50 neon kernel: [ 519.030957] [<ffffffff81574a69>] cpuidle_enter+0x19/0x20
Feb 22 01:32:50 neon kernel: [ 519.030965] [<ffffffff81575499>] cpuidle_wrap_enter+0x49/0xa0
Feb 22 01:32:50 neon kernel: [ 519.030974] [<ffffffff81575500>] cpuidle_enter_tk+0x10/0x20
Feb 22 01:32:50 neon kernel: [ 519.030982] [<ffffffff815750e5>] cpuidle_idle_call+0xa5/0x270
Feb 22 01:32:50 neon kernel: [ 519.030991] [<ffffffff8101d62f>] cpu_idle+0xaf/0x120
Feb 22 01:32:50 neon kernel: [ 519.030999] [<ffffffff816b7620>] start_secondary+0x1e0/0x1e5
Feb 22 01:32:50 neon kernel: [ 519.031004] Code: 00 83 88 3c e0 ff ff 04 5d c3 8a 47 08 55 48 89 e5 3c 01 75 07 e8 3a 35 c5 ff eb 17 3c 02 75 07 e8 a2 ff ff ff eb 0c 8b 57 04 ec <48> 8b 15 86 e1 b2 00 ed 5d c3 66 66 66 66 90 55 48 63 c2 48 c1
Feb 22 01:32:50 neon kernel: [ 519.031118] NMI backtrace for cpu 0
Feb 22 01:32:50 neon kernel: [ 519.031126] CPU 0
Feb 22 01:32:50 neon kernel: [ 519.031136] Pid: 0, comm: swapper/0 Tainted: PF W O 3.8.0-35-generic #50-Ubuntu To be filled by O.E.M. To be filled by O.E.M./SABERTOOTH 990FX R2.0
Feb 22 01:32:50 neon kernel: [ 519.031142] RIP: 0010:[<ffffffff813e3eb7>] [<ffffffff813e3eb7>] acpi_idle_do_entry+0x21/0x2b
Feb 22 01:32:50 neon kernel: [ 519.031156] RSP: 0018:ffffffff81c01e10 EFLAGS: 00000093
Feb 22 01:32:50 neon kernel: [ 519.031161] RAX: 00000078d8194000 RBX: ffff88061cdfcca0 RCX: 000000000000c648
Feb 22 01:32:50 neon kernel: [ 519.031166] RDX: 0000000000000815 RSI: ffff88063ec00000 RDI: ffff88061cdfcca0
Feb 22 01:32:50 neon kernel: [ 519.031171] RBP: ffffffff81c01e10 R08: 0000000000002b1d R09: 0000000000000018
Feb 22 01:32:50 neon kernel: [ 519.031175] R10: 0000000000002ea8 R11: 0000000000000000 R12: 0000000000000002
Feb 22 01:32:50 neon kernel: [ 519.031180] R13: ffffffff81c00000 R14: ffff88061cdfcc00 R15: ffffffff81574a50
Feb 22 01:32:50 neon kernel: [ 519.031186] FS: 00007fc8b9ffb700(0000) GS:ffff88063ec00000(0000) knlGS:0000000000000000
Feb 22 01:32:50 neon kernel: [ 519.031190] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
Feb 22 01:32:50 neon kernel: [ 519.031195] CR2: 00007f460728d000 CR3: 00000005d5a57000 CR4: 00000000000407f0
Feb 22 01:32:50 neon kernel: [ 519.031200] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Feb 22 01:32:50 neon kernel: [ 519.031205] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Feb 22 01:32:50 neon kernel: [ 519.031210] Process swapper/0 (pid: 0, threadinfo ffffffff81c00000, task ffffffff81c15440)
Feb 22 01:32:50 neon kernel: [ 519.031213] Stack:
Feb 22 01:32:50 neon kernel: [ 519.031217] ffffffff81c01e40 ffffffff813e3faa ffff880616741600 ffffffff81c7e060
Feb 22 01:32:50 neon kernel: [ 519.031229] 000000790242e5eb 0000000000000002 ffffffff81c01e50 ffffffff81574a69
Feb 22 01:32:50 neon kernel: [ 519.031239] ffffffff81c01eb0 ffffffff81575499 7735940000000001 ffff880616741600
Feb 22 01:32:50 neon kernel: [ 519.031249] Call Trace:
Feb 22 01:32:50 neon kernel: [ 519.031260] [<ffffffff813e3faa>] acpi_idle_enter_simple+0x87/0xc5
Feb 22 01:32:50 neon kernel: [ 519.031270] [<ffffffff81574a69>] cpuidle_enter+0x19/0x20
Feb 22 01:32:50 neon kernel: [ 519.031278] [<ffffffff81575499>] cpuidle_wrap_enter+0x49/0xa0
Feb 22 01:32:50 neon kernel: [ 519.031287] [<ffffffff81575500>] cpuidle_enter_tk+0x10/0x20
Feb 22 01:32:50 neon kernel: [ 519.031295] [<ffffffff815750e5>] cpuidle_idle_call+0xa5/0x270
Feb 22 01:32:50 neon kernel: [ 519.031305] [<ffffffff8101d62f>] cpu_idle+0xaf/0x120
Feb 22 01:32:50 neon kernel: [ 519.031315] [<ffffffff816abc32>] rest_init+0x72/0x80
Feb 22 01:32:50 neon kernel: [ 519.031325] [<ffffffff81d05be9>] start_kernel+0x3d1/0x3dc
Feb 22 01:32:50 neon kernel: [ 519.031333] [<ffffffff81d0566e>] ? do_early_param+0x8e/0x8e
Feb 22 01:32:50 neon kernel: [ 519.031343] [<ffffffff81d05355>] x86_64_start_reservations+0x130/0x133
Feb 22 01:32:50 neon kernel: [ 519.031351] [<ffffffff81d05458>] x86_64_start_kernel+0x100/0x10f
Feb 22 01:32:50 neon kernel: [ 519.031356] Code: 00 83 88 3c e0 ff ff 04 5d c3 8a 47 08 55 48 89 e5 3c 01 75 07 e8 3a 35 c5 ff eb 17 3c 02 75 07 e8 a2 ff ff ff eb 0c 8b 57 04 ec <48> 8b 15 86 e1 b2 00 ed 5d c3 66 66 66 66 90 55 48 63 c2 48 c1
Feb 22 01:32:50 neon kernel: [ 519.031461] NMI backtrace for cpu 1
Feb 22 01:32:50 neon kernel: [ 519.031464] CPU 1
Feb 22 01:32:50 neon kernel: [ 519.031470] Pid: 0, comm: swapper/1 Tainted: PF W O 3.8.0-35-generic #50-Ubuntu To be filled by O.E.M. To be filled by O.E.M./SABERTOOTH 990FX R2.0
Feb 22 01:32:50 neon kernel: [ 519.031473] RIP: 0010:[<ffffffff813e3eb7>] [<ffffffff813e3eb7>] acpi_idle_do_entry+0x21/0x2b
Feb 22 01:32:50 neon kernel: [ 519.031480] RSP: 0018:ffff88061cd83e10 EFLAGS: 00000093
Feb 22 01:32:50 neon kernel: [ 519.031483] RAX: 00000078d7555500 RBX: ffff8806167cd4a0 RCX: 000000000000c648
Feb 22 01:32:50 neon kernel: [ 519.031486] RDX: 0000000000000815 RSI: ffff88063ec40000 RDI: ffff8806167cd4a0
Feb 22 01:32:50 neon kernel: [ 519.031488] RBP: ffff88061cd83e10 R08: 0000000000002e80 R09: 0000000000000018
Feb 22 01:32:50 neon kernel: [ 519.031491] R10: 0000000000002e65 R11: 0000000000000000 R12: 0000000000000002
Feb 22 01:32:50 neon kernel: [ 519.031494] R13: ffff88061cd82000 R14: ffff8806167cd400 R15: ffffffff81574a50
Feb 22 01:32:50 neon kernel: [ 519.031498] FS: 00007f14011af700(0000) GS:ffff88063ec40000(0000) knlGS:0000000000000000
Feb 22 01:32:50 neon kernel: [ 519.031501] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
Feb 22 01:32:50 neon kernel: [ 519.031503] CR2: 00007ff34bf826a8 CR3: 00000005dfda6000 CR4: 00000000000407e0
Feb 22 01:32:50 neon kernel: [ 519.031506] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Feb 22 01:32:50 neon kernel: [ 519.031509] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Feb 22 01:32:50 neon kernel: [ 519.031512] Process swapper/1 (pid: 0, threadinfo ffff88061cd82000, task ffff88061cd79740)
Feb 22 01:32:50 neon kernel: [ 519.031514] Stack:
Feb 22 01:32:50 neon kernel: [ 519.031516] ffff88061cd83e40 ffffffff813e3faa ffff880616054000 ffffffff81c7e060
Feb 22 01:32:50 neon kernel: [ 519.031523] 00000079017e963a 0000000000000002 ffff88061cd83e50 ffffffff81574a69
Feb 22 01:32:50 neon kernel: [ 519.031528] ffff88061cd83eb0 ffffffff81575499 7735940000000001 ffff880616054000
Feb 22 01:32:50 neon kernel: [ 519.031534] Call Trace:
Feb 22 01:32:50 neon kernel: [ 519.031541] [<ffffffff813e3faa>] acpi_idle_enter_simple+0x87/0xc5
Feb 22 01:32:50 neon kernel: [ 519.031547] [<ffffffff81574a69>] cpuidle_enter+0x19/0x20
Feb 22 01:32:50 neon kernel: [ 519.031552] [<ffffffff81575499>] cpuidle_wrap_enter+0x49/0xa0
Feb 22 01:32:50 neon kernel: [ 519.031559] [<ffffffff81575500>] cpuidle_enter_tk+0x10/0x20
Feb 22 01:32:50 neon kernel: [ 519.031564] [<ffffffff815750e5>] cpuidle_idle_call+0xa5/0x270
Feb 22 01:32:50 neon kernel: [ 519.031570] [<ffffffff8101d62f>] cpu_idle+0xaf/0x120
Feb 22 01:32:50 neon kernel: [ 519.031576] [<ffffffff816b7620>] start_secondary+0x1e0/0x1e5
Feb 22 01:32:50 neon kernel: [ 519.031580] Code: 00 83 88 3c e0 ff ff 04 5d c3 8a 47 08 55 48 89 e5 3c 01 75 07 e8 3a 35 c5 ff eb 17 3c 02 75 07 e8 a2 ff ff ff eb 0c 8b 57 04 ec <48> 8b 15 86 e1 b2 00 ed 5d c3 66 66 66 66 90 55 48 63 c2 48 c1
Feb 22 01:32:59 neon rtkit-daemon[3933]: The canary thread is apparently starving. Taking action.
Feb 22 01:32:59 neon rtkit-daemon[3933]: Demoting known real-time threads.
Feb 22 01:32:59 neon rtkit-daemon[3933]: Successfully demoted thread 4021 of process 3931 (n/a).
Feb 22 01:32:59 neon rtkit-daemon[3933]: Successfully demoted thread 4015 of process 3931 (n/a).
Feb 22 01:32:59 neon rtkit-daemon[3933]: Successfully demoted thread 4000 of process 3931 (n/a).
Feb 22 01:32:59 neon rtkit-daemon[3933]: Successfully demoted thread 3931 of process 3931 (n/a).
Feb 22 01:32:59 neon rtkit-daemon[3933]: Demoted 4 threads.
Feb 22 01:33:09 neon rtkit-daemon[3933]: The canary thread is apparently starving. Taking action.
Feb 22 01:33:09 neon rtkit-daemon[3933]: Demoting known real-time threads.
Feb 22 01:33:09 neon rtkit-daemon[3933]: Successfully demoted thread 4021 of process 3931 (n/a).
Feb 22 01:33:09 neon rtkit-daemon[3933]: Successfully demoted thread 4015 of process 3931 (n/a).
Feb 22 01:33:09 neon rtkit-daemon[3933]: Successfully demoted thread 4000 of process 3931 (n/a).
Feb 22 01:33:09 neon rtkit-daemon[3933]: Successfully demoted thread 3931 of process 3931 (n/a).
Feb 22 01:33:09 neon rtkit-daemon[3933]: Demoted 4 threads.
Feb 22 01:33:19 neon rtkit-daemon[3933]: The canary thread is apparently starving. Taking action.
Feb 22 01:33:19 neon rtkit-daemon[3933]: Demoting known real-time threads.
Feb 22 01:33:19 neon rtkit-daemon[3933]: Successfully demoted thread 4021 of process 3931 (n/a).
Feb 22 01:33:19 neon rtkit-daemon[3933]: Successfully demoted thread 4015 of process 3931 (n/a).
Feb 22 01:33:19 neon rtkit-daemon[3933]: Successfully demoted thread 4000 of process 3931 (n/a).
Feb 22 01:33:19 neon rtkit-daemon[3933]: Successfully demoted thread 3931 of process 3931 (n/a).
Feb 22 01:33:19 neon rtkit-daemon[3933]: Demoted 4 threads.
Feb 22 01:33:29 neon rtkit-daemon[3933]: The canary thread is apparently starving. Taking action.
Feb 22 01:33:29 neon rtkit-daemon[3933]: Demoting known real-time threads.
Feb 22 01:33:29 neon rtkit-daemon[3933]: Successfully demoted thread 4021 of process 3931 (n/a).
Feb 22 01:33:29 neon rtkit-daemon[3933]: Successfully demoted thread 4015 of process 3931 (n/a).
Feb 22 01:33:29 neon rtkit-daemon[3933]: Successfully demoted thread 4000 of process 3931 (n/a).
Feb 22 01:33:29 neon rtkit-daemon[3933]: Successfully demoted thread 3931 of process 3931 (n/a).
Feb 22 01:33:29 neon rtkit-daemon[3933]: Demoted 4 threads.
Feb 22 01:33:39 neon rtkit-daemon[3933]: The canary thread is apparently starving. Taking action.
Feb 22 01:33:39 neon rtkit-daemon[3933]: Demoting known real-time threads.
Feb 22 01:33:39 neon rtkit-daemon[3933]: Successfully demoted thread 4021 of process 3931 (n/a).
Feb 22 01:33:39 neon rtkit-daemon[3933]: Successfully demoted thread 4015 of process 3931 (n/a).
Feb 22 01:33:39 neon rtkit-daemon[3933]: Successfully demoted thread 4000 of process 3931 (n/a).
Feb 22 01:33:39 neon rtkit-daemon[3933]: Successfully demoted thread 3931 of process 3931 (n/a).
Feb 22 01:33:39 neon rtkit-daemon[3933]: Demoted 4 threads.
Feb 22 01:33:49 neon rtkit-daemon[3933]: The canary thread is apparently starving. Taking action.
Feb 22 01:33:49 neon rtkit-daemon[3933]: Demoting known real-time threads.
Feb 22 01:33:49 neon rtkit-daemon[3933]: Successfully demoted thread 4021 of process 3931 (n/a).
Feb 22 01:33:49 neon rtkit-daemon[3933]: Successfully demoted thread 4015 of process 3931 (n/a).
Feb 22 01:33:49 neon rtkit-daemon[3933]: Successfully demoted thread 4000 of process 3931 (n/a).
Feb 22 01:33:49 neon rtkit-daemon[3933]: Successfully demoted thread 3931 of process 3931 (n/a).
Feb 22 01:33:49 neon rtkit-daemon[3933]: Demoted 4 threads.
Feb 22 01:33:59 neon rtkit-daemon[3933]: The canary thread is apparently starving. Taking action.
Feb 22 01:33:59 neon rtkit-daemon[3933]: Demoting known real-time threads.
Feb 22 01:33:59 neon rtkit-daemon[3933]: Successfully demoted thread 4021 of process 3931 (n/a).
Feb 22 01:33:59 neon rtkit-daemon[3933]: Successfully demoted thread 4015 of process 3931 (n/a).
Feb 22 01:33:59 neon rtkit-daemon[3933]: Successfully demoted thread 4000 of process 3931 (n/a).
Feb 22 01:33:59 neon rtkit-daemon[3933]: Successfully demoted thread 3931 of process 3931 (n/a).
Feb 22 01:33:59 neon rtkit-daemon[3933]: Demoted 4 threads.
Feb 22 01:34:09 neon rtkit-daemon[3933]: The canary thread is apparently starving. Taking action.
Feb 22 01:34:09 neon rtkit-daemon[3933]: Demoting known real-time threads.
Feb 22 01:34:09 neon rtkit-daemon[3933]: Successfully demoted thread 4021 of process 3931 (n/a).
Feb 22 01:34:09 neon rtkit-daemon[3933]: Successfully demoted thread 4015 of process 3931 (n/a).
Feb 22 01:34:09 neon rtkit-daemon[3933]: Successfully demoted thread 4000 of process 3931 (n/a).
Feb 22 01:34:09 neon rtkit-daemon[3933]: Successfully demoted thread 3931 of process 3931 (n/a).
Feb 22 01:34:09 neon rtkit-daemon[3933]: Demoted 4 threads.
Feb 22 01:34:19 neon rtkit-daemon[3933]: The canary thread is apparently starving. Taking action.
Feb 22 01:34:19 neon rtkit-daemon[3933]: Demoting known real-time threads.
Feb 22 01:34:19 neon rtkit-daemon[3933]: Successfully demoted thread 4021 of process 3931 (n/a).
Feb 22 01:34:19 neon rtkit-daemon[3933]: Successfully demoted thread 4015 of process 3931 (n/a).
Feb 22 01:34:19 neon rtkit-daemon[3933]: Successfully demoted thread 4000 of process 3931 (n/a).
Feb 22 01:34:19 neon rtkit-daemon[3933]: Successfully demoted thread 3931 of process 3931 (n/a).
Feb 22 01:34:19 neon rtkit-daemon[3933]: Demoted 4 threads.
Feb 22 01:34:29 neon rtkit-daemon[3933]: The canary thread is apparently starving. Taking action.
Feb 22 01:34:29 neon rtkit-daemon[3933]: Demoting known real-time threads.
Feb 22 01:34:29 neon rtkit-daemon[3933]: Successfully demoted thread 4021 of process 3931 (n/a).
Feb 22 01:34:29 neon rtkit-daemon[3933]: Successfully demoted thread 4015 of process 3931 (n/a).
Feb 22 01:34:29 neon rtkit-daemon[3933]: Successfully demoted thread 4000 of process 3931 (n/a).
Feb 22 01:34:29 neon rtkit-daemon[3933]: Successfully demoted thread 3931 of process 3931 (n/a).
Feb 22 01:34:29 neon rtkit-daemon[3933]: Demoted 4 threads.
Feb 22 01:34:39 neon rtkit-daemon[3933]: The canary thread is apparently starving. Taking action.
Feb 22 01:34:39 neon rtkit-daemon[3933]: Demoting known real-time threads.
Feb 22 01:34:39 neon rtkit-daemon[3933]: Successfully demoted thread 4021 of process 3931 (n/a).
Feb 22 01:34:39 neon rtkit-daemon[3933]: Successfully demoted thread 4015 of process 3931 (n/a).
Feb 22 01:34:39 neon rtkit-daemon[3933]: Successfully demoted thread 4000 of process 3931 (n/a).
Feb 22 01:34:39 neon rtkit-daemon[3933]: Successfully demoted thread 3931 of process 3931 (n/a).
Feb 22 01:34:39 neon rtkit-daemon[3933]: Demoted 4 threads.
Feb 22 01:34:49 neon rtkit-daemon[3933]: The canary thread is apparently starving. Taking action.
Feb 22 01:34:49 neon rtkit-daemon[3933]: Demoting known real-time threads.
Feb 22 01:34:49 neon rtkit-daemon[3933]: Successfully demoted thread 4021 of process 3931 (n/a).
Feb 22 01:34:49 neon rtkit-daemon[3933]: Successfully demoted thread 4015 of process 3931 (n/a).
Feb 22 01:34:49 neon rtkit-daemon[3933]: Successfully demoted thread 4000 of process 3931 (n/a).
Feb 22 01:34:49 neon rtkit-daemon[3933]: Successfully demoted thread 3931 of process 3931 (n/a).
Feb 22 01:34:49 neon rtkit-daemon[3933]: Demoted 4 threads.
Feb 22 01:34:59 neon rtkit-daemon[3933]: The canary thread is apparently starving. Taking action.
Feb 22 01:34:59 neon rtkit-daemon[3933]: Demoting known real-time threads.
Feb 22 01:34:59 neon rtkit-daemon[3933]: Successfully demoted thread 4021 of process 3931 (n/a).
Feb 22 01:34:59 neon rtkit-daemon[3933]: Successfully demoted thread 4015 of process 3931 (n/a).
Feb 22 01:34:59 neon rtkit-daemon[3933]: Successfully demoted thread 4000 of process 3931 (n/a).
Feb 22 01:34:59 neon rtkit-daemon[3933]: Successfully demoted thread 3931 of process 3931 (n/a).
Feb 22 01:34:59 neon rtkit-daemon[3933]: Demoted 4 threads.
Feb 22 01:35:01 neon CRON[7664]: (munin) CMD (if [ -x /usr/bin/munin-cron ]; then /usr/bin/munin-cron; fi)
Feb 22 01:35:01 neon CRON[7665]: (root) CMD (if [ -x /etc/munin/plugins/apt_all ]; then /etc/munin/plugins/apt_all update 7200 12 >/dev/null; elif [ -x /etc/munin/plugins/apt ]; then /etc/munin/plugins/apt update 7200 12 >/dev/null; fi)
Feb 22 01:35:09 neon rtkit-daemon[3933]: The canary thread is apparently starving. Taking action.
Feb 22 01:35:09 neon rtkit-daemon[3933]: Demoting known real-time threads.
Feb 22 01:35:09 neon rtkit-daemon[3933]: Successfully demoted thread 4021 of process 3931 (n/a).
Feb 22 01:35:09 neon rtkit-daemon[3933]: Successfully demoted thread 4015 of process 3931 (n/a).
Feb 22 01:35:09 neon rtkit-daemon[3933]: Successfully demoted thread 4000 of process 3931 (n/a).
Feb 22 01:35:09 neon rtkit-daemon[3933]: Successfully demoted thread 3931 of process 3931 (n/a).
Feb 22 01:35:09 neon rtkit-daemon[3933]: Demoted 4 threads.
Feb 22 01:35:19 neon rtkit-daemon[3933]: The canary thread is apparently starving. Taking action.
Feb 22 01:35:19 neon rtkit-daemon[3933]: Demoting known real-time threads.
Feb 22 01:35:19 neon rtkit-daemon[3933]: Successfully demoted thread 4021 of process 3931 (n/a).
Feb 22 01:35:19 neon rtkit-daemon[3933]: Successfully demoted thread 4015 of process 3931 (n/a).
Feb 22 01:35:19 neon rtkit-daemon[3933]: Successfully demoted thread 4000 of process 3931 (n/a).
Feb 22 01:35:19 neon rtkit-daemon[3933]: Successfully demoted thread 3931 of process 3931 (n/a).
Feb 22 01:35:19 neon rtkit-daemon[3933]: Demoted 4 threads.
Feb 22 01:35:29 neon rtkit-daemon[3933]: The canary thread is apparently starving. Taking action.
Feb 22 01:35:29 neon rtkit-daemon[3933]: Demoting known real-time threads.
Feb 22 01:35:29 neon rtkit-daemon[3933]: Successfully demoted thread 4021 of process 3931 (n/a).
Feb 22 01:35:29 neon rtkit-daemon[3933]: Successfully demoted thread 4015 of process 3931 (n/a).
Feb 22 01:35:29 neon rtkit-daemon[3933]: Successfully demoted thread 4000 of process 3931 (n/a).
Feb 22 01:35:29 neon rtkit-daemon[3933]: Successfully demoted thread 3931 of process 3931 (n/a).
Feb 22 01:35:29 neon rtkit-daemon[3933]: Demoted 4 threads.
Feb 22 01:35:39 neon rtkit-daemon[3933]: The canary thread is apparently starving. Taking action.
Feb 22 01:35:39 neon rtkit-daemon[3933]: Demoting known real-time threads.
Feb 22 01:35:39 neon rtkit-daemon[3933]: Successfully demoted thread 4021 of process 3931 (n/a).
Feb 22 01:35:39 neon rtkit-daemon[3933]: Successfully demoted thread 4015 of process 3931 (n/a).
Feb 22 01:35:39 neon rtkit-daemon[3933]: Successfully demoted thread 4000 of process 3931 (n/a).
Feb 22 01:35:39 neon rtkit-daemon[3933]: Successfully demoted thread 3931 of process 3931 (n/a).
Feb 22 01:35:39 neon rtkit-daemon[3933]: Demoted 4 threads.
Feb 22 01:35:49 neon rtkit-daemon[3933]: The canary thread is apparently starving. Taking action.
Feb 22 01:35:49 neon rtkit-daemon[3933]: Demoting known real-time threads.
Feb 22 01:35:49 neon rtkit-daemon[3933]: Successfully demoted thread 4021 of process 3931 (n/a).
Feb 22 01:35:49 neon rtkit-daemon[3933]: Successfully demoted thread 4015 of process 3931 (n/a).
Feb 22 01:35:49 neon rtkit-daemon[3933]: Successfully demoted thread 4000 of process 3931 (n/a).
Feb 22 01:35:49 neon rtkit-daemon[3933]: Successfully demoted thread 3931 of process 3931 (n/a).
Feb 22 01:35:49 neon rtkit-daemon[3933]: Demoted 4 threads.
Feb 22 01:35:50 neon kernel: [ 698.687008] INFO: rcu_sched detected stalls on CPUs/tasks: { 4} (detected by 5, t=60007 jiffies, g=46247, c=46246, q=83082)
Feb 22 01:35:50 neon kernel: [ 698.687024] sending NMI to all CPUs:
Feb 22 01:35:50 neon kernel: [ 698.687037] NMI backtrace for cpu 5
Feb 22 01:35:50 neon kernel: [ 698.687042] CPU 5
Feb 22 01:35:50 neon kernel: [ 698.687052] Pid: 0, comm: swapper/5 Tainted: PF W O 3.8.0-35-generic #50-Ubuntu To be filled by O.E.M. To be filled by O.E.M./SABERTOOTH 990FX R2.0
Feb 22 01:35:50 neon kernel: [ 698.687058] RIP: 0010:[<ffffffff81354210>] [<ffffffff81354210>] __ndelay+0x40/0x40
Feb 22 01:35:50 neon kernel: [ 698.687071] RSP: 0018:ffff88063ed43dd0 EFLAGS: 00000807
Feb 22 01:35:50 neon kernel: [ 698.687077] RAX: 00000000bbec9c00 RBX: 0000000000002710 RCX: 0000000001acad60
Feb 22 01:35:50 neon kernel: [ 698.687081] RDX: 0000000000352808 RSI: 0000000000000100 RDI: 0000000000352809
Feb 22 01:35:50 neon kernel: [ 698.687086] RBP: ffff88063ed43dd8 R08: 000000000000000a R09: 0000000000000000
Feb 22 01:35:50 neon kernel: [ 698.687091] R10: 000000000000054f R11: 0000000000000002 R12: ffffffff81ce70c0
Feb 22 01:35:50 neon kernel: [ 698.687096] R13: ffff88063ed4ee60 R14: ffffffff81c3f3c0 R15: ffffffff81c3f480
Feb 22 01:35:50 neon kernel: [ 698.687102] FS: 00007fbddf316740(0000) GS:ffff88063ed40000(0000) knlGS:0000000000000000
Feb 22 01:35:50 neon kernel: [ 698.687107] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
Feb 22 01:35:50 neon kernel: [ 698.687111] CR2: 00007f2d1b631c60 CR3: 0000000594662000 CR4: 00000000000407e0
Feb 22 01:35:50 neon kernel: [ 698.687116] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Feb 22 01:35:50 neon kernel: [ 698.687121] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Feb 22 01:35:50 neon kernel: [ 698.687127] Process swapper/5 (pid: 0, threadinfo ffff88061cd8a000, task ffff88061cd90000)
Feb 22 01:35:50 neon kernel: [ 698.687130] Stack:
Feb 22 01:35:50 neon kernel: [ 698.687134] ffffffff8135418c ffff88063ed43df0 ffffffff81039d6a ffffffff81c3f3c0
Feb 22 01:35:50 neon kernel: [ 698.687145] ffff88063ed43e50 ffffffff810f2935 000000000001448a 0000000000000082
Feb 22 01:35:50 neon kernel: [ 698.687156] 0000000100018661 0000000000000005 ffff88061cd8a000 ffff88061cd90000
Feb 22 01:35:50 neon kernel: [ 698.687166] Call Trace:
Feb 22 01:35:50 neon kernel: [ 698.687170] <IRQ>
Feb 22 01:35:50 neon kernel: [ 698.687174] [<ffffffff8135418c>] ? __const_udelay+0x2c/0x30
Feb 22 01:35:50 neon kernel: [ 698.687191] [<ffffffff81039d6a>] arch_trigger_all_cpu_backtrace+0x6a/0x90
Feb 22 01:35:50 neon kernel: [ 698.687201] [<ffffffff810f2935>] rcu_pending+0x565/0x5b0
Feb 22 01:35:50 neon kernel: [ 698.687210] [<ffffffff810f4a0b>] rcu_check_callbacks+0x9b/0x120
Feb 22 01:35:50 neon kernel: [ 698.687220] [<ffffffff8106a928>] update_process_times+0x48/0x90
Feb 22 01:35:50 neon kernel: [ 698.687229] [<ffffffff810b3a8e>] tick_sched_handle.isra.8+0x2e/0x70
Feb 22 01:35:50 neon kernel: [ 698.687237] [<ffffffff810b3c1c>] tick_sched_timer+0x4c/0x80
Feb 22 01:35:50 neon kernel: [ 698.687246] [<ffffffff810819d9>] __run_hrtimer+0x79/0x1c0
Feb 22 01:35:50 neon kernel: [ 698.687253] [<ffffffff810b3bd0>] ? tick_sched_do_timer+0x40/0x40
Feb 22 01:35:50 neon kernel: [ 698.687262] [<ffffffff810822c7>] hrtimer_interrupt+0xe7/0x230
Feb 22 01:35:50 neon kernel: [ 698.687272] [<ffffffff81574a50>] ? centrino_target+0x370/0x370
Feb 22 01:35:50 neon kernel: [ 698.687282] [<ffffffff816d8519>] smp_apic_timer_interrupt+0x69/0x99
Feb 22 01:35:50 neon kernel: [ 698.687291] [<ffffffff816d745d>] apic_timer_interrupt+0x6d/0x80
Feb 22 01:35:50 neon kernel: [ 698.687294] <EOI>
Feb 22 01:35:50 neon kernel: [ 698.687298] [<ffffffff81091a9d>] ? sched_clock_cpu+0xbd/0x110
Feb 22 01:35:50 neon kernel: [ 698.687314] [<ffffffff815754a8>] ? cpuidle_wrap_enter+0x58/0xa0
Feb 22 01:35:50 neon kernel: [ 698.687323] [<ffffffff81575500>] cpuidle_enter_tk+0x10/0x20
Feb 22 01:35:50 neon kernel: [ 698.687331] [<ffffffff815750e5>] cpuidle_idle_call+0xa5/0x270
Feb 22 01:35:50 neon kernel: [ 698.687340] [<ffffffff8101d62f>] cpu_idle+0xaf/0x120
Feb 22 01:35:50 neon kernel: [ 698.687348] [<ffffffff816b7620>] start_secondary+0x1e0/0x1e5
Feb 22 01:35:50 neon kernel: [ 698.687354] Code: 0c 12 48 c1 e2 06 48 89 e5 48 c1 e0 02 48 29 ca f7 e2 48 8d 7a 01 ff 15 97 24 92 00 5d c3 66 66 66 66 2e 0f 1f 84 00 00 00 00 00 <66> 66 66 66 90 55 48 89 e5 41 55 41 54 41 89 fc 53 65 44 8b 2c
Feb 22 01:35:50 neon kernel: [ 698.687460] NMI backtrace for cpu 4
Feb 22 01:35:50 neon kernel: [ 698.687464] CPU 4
Feb 22 01:35:50 neon kernel: [ 698.687472] Pid: 7557, comm: zfs Tainted: PF W O 3.8.0-35-generic #50-Ubuntu To be filled by O.E.M. To be filled by O.E.M./SABERTOOTH 990FX R2.0
Feb 22 01:35:50 neon kernel: [ 698.687476] RIP: 0010:[<ffffffff81044ac2>] [<ffffffff81044ac2>] __ticket_spin_lock+0x22/0x30
Feb 22 01:35:50 neon kernel: [ 698.687488] RSP: 0018:ffff88055774b988 EFLAGS: 00000006
Feb 22 01:35:50 neon kernel: [ 698.687493] RAX: 0000000000002d4b RBX: ffff8805d5af1740 RCX: 0000000000000000
Feb 22 01:35:50 neon kernel: [ 698.687497] RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff880503870848
Feb 22 01:35:50 neon kernel: [ 698.687501] RBP: ffff88055774b988 R08: 0000000000016d40 R09: ffff88063ed16d40
Feb 22 01:35:50 neon kernel: [ 698.687505] R10: ffffea001776c200 R11: ffffffffa02cb83b R12: ffff880503870840
Feb 22 01:35:50 neon kernel: [ 698.687509] R13: ffff880503870848 R14: ffffffffffffffff R15: 0000000000000001
Feb 22 01:35:50 neon kernel: [ 698.687514] FS: 00007fbe10597700(0000) GS:ffff88063ed00000(0000) knlGS:0000000000000000
Feb 22 01:35:50 neon kernel: [ 698.687519] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Feb 22 01:35:50 neon kernel: [ 698.687524] CR2: 0000000001d8efe0 CR3: 00000005a4493000 CR4: 00000000000407e0
Feb 22 01:35:50 neon kernel: [ 698.687528] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Feb 22 01:35:50 neon kernel: [ 698.687532] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Feb 22 01:35:50 neon kernel: [ 698.687537] Process zfs (pid: 7557, threadinfo ffff88055774a000, task ffff8805d5af1740)
Feb 22 01:35:50 neon kernel: [ 698.687540] Stack:
Feb 22 01:35:50 neon kernel: [ 698.687544] ffff88055774b998 ffffffff816cde65 ffff88055774ba00 ffffffff816cdca6
Feb 22 01:35:50 neon kernel: [ 698.687555] 0000000000000000 0000000000000000 000000005774ba00 ffffffff00000000
Feb 22 01:35:50 neon kernel: [ 698.687566] ffffffff816cb7ad ffff880503b22248 ffff880503870840 0000000000000002
Feb 22 01:35:50 neon kernel: [ 698.687578] Call Trace:
Feb 22 01:35:50 neon kernel: [ 698.687588] [<ffffffff816cde65>] _raw_spin_lock_irq+0x15/0x20
Feb 22 01:35:50 neon kernel: [ 698.687596] [<ffffffff816cdca6>] rwsem_down_failed_common+0x46/0x170
Feb 22 01:35:50 neon kernel: [ 698.687604] [<ffffffff816cb7ad>] ? mutex_lock+0x1d/0x50
Feb 22 01:35:50 neon kernel: [ 698.687613] [<ffffffff816cde05>] rwsem_down_read_failed+0x15/0x17
Feb 22 01:35:50 neon kernel: [ 698.687622] [<ffffffff813555d4>] call_rwsem_down_read_failed+0x14/0x30
Feb 22 01:35:50 neon kernel: [ 698.687666] [<ffffffffa02cb83b>] ? kmem_free_debug+0x4b/0x150 [spl]
Feb 22 01:35:50 neon kernel: [ 698.687679] [<ffffffff816cc0e0>] ? down_read+0x20/0x23
Feb 22 01:35:50 neon kernel: [ 698.687761] [<ffffffffa03b28f0>] zap_get_leaf_byblk+0xd0/0x2c0 [zfs]
Feb 22 01:35:50 neon kernel: [ 698.687829] [<ffffffffa03b22f3>] ? zap_idx_to_blk+0x133/0x140 [zfs]
Feb 22 01:35:50 neon kernel: [ 698.687898] [<ffffffffa03b2b4d>] zap_deref_leaf+0x6d/0x80 [zfs]
Feb 22 01:35:50 neon kernel: [ 698.687967] [<ffffffffa03b46d1>] fzap_cursor_retrieve+0xe1/0x280 [zfs]
Feb 22 01:35:50 neon kernel: [ 698.688036] [<ffffffffa03b7ef8>] zap_cursor_retrieve+0x68/0x2e0 [zfs]
Feb 22 01:35:50 neon kernel: [ 698.688103] [<ffffffffa038f453>] ? sa_lookup_impl+0x13/0x20 [zfs]
Feb 22 01:35:50 neon kernel: [ 698.688169] [<ffffffffa038f4b0>] ? sa_bulk_lookup+0x40/0x60 [zfs]
Feb 22 01:35:50 neon kernel: [ 698.688241] [<ffffffffa03b3db1>] zap_value_search+0x91/0xd0 [zfs]
Feb 22 01:35:50 neon kernel: [ 698.688308] [<ffffffffa03e1e70>] zfs_obj_to_path_impl+0x190/0x280 [zfs]
Feb 22 01:35:50 neon kernel: [ 698.688376] [<ffffffffa038f453>] ? sa_lookup_impl+0x13/0x20 [zfs]
Feb 22 01:35:50 neon kernel: [ 698.688442] [<ffffffffa038f4b0>] ? sa_bulk_lookup+0x40/0x60 [zfs]
Feb 22 01:35:50 neon kernel: [ 698.688507] [<ffffffffa03dd9d1>] ? zfs_obj_to_stats_impl+0xa1/0xb0 [zfs]
Feb 22 01:35:50 neon kernel: [ 698.688573] [<ffffffffa03e20bb>] zfs_obj_to_stats+0xab/0xd0 [zfs]
Feb 22 01:35:50 neon kernel: [ 698.688643] [<ffffffffa03c51b4>] zfs_ioc_obj_to_stats+0x84/0xa0 [zfs]
Feb 22 01:35:50 neon kernel: [ 698.688710] [<ffffffffa03cc30d>] zfsdev_ioctl+0xdd/0x1d0 [zfs]
Feb 22 01:35:50 neon kernel: [ 698.688720] [<ffffffff811a6659>] do_vfs_ioctl+0x99/0x570
Feb 22 01:35:50 neon kernel: [ 698.688730] [<ffffffff811a6bc1>] sys_ioctl+0x91/0xb0
Feb 22 01:35:50 neon kernel: [ 698.688739] [<ffffffff816d671d>] system_call_fastpath+0x1a/0x1f
Feb 22 01:35:50 neon kernel: [ 698.688744] Code: 84 00 00 00 00 00 0f 1f 00 55 b8 00 00 01 00 48 89 e5 f0 0f c1 07 89 c1 c1 e9 10 66 39 c1 89 ca 74 11 0f 1f 80 00 00 00 00 f3 90 <0f> b7 07 66 39 d0 75 f6 5d c3 0f 1f 40 00 8b 17 55 31 c0 48 89
Feb 22 01:35:50 neon kernel: [ 698.688864] NMI backtrace for cpu 3
Feb 22 01:35:50 neon kernel: [ 698.688872] CPU 3
Feb 22 01:35:50 neon kernel: [ 698.688881] Pid: 0, comm: swapper/3 Tainted: PF W O 3.8.0-35-generic #50-Ubuntu To be filled by O.E.M. To be filled by O.E.M./SABERTOOTH 990FX R2.0
Feb 22 01:35:50 neon kernel: [ 698.688887] RIP: 0010:[<ffffffff813e3eb7>] [<ffffffff813e3eb7>] acpi_idle_do_entry+0x21/0x2b
Feb 22 01:35:50 neon kernel: [ 698.688903] RSP: 0018:ffff88061cd87e10 EFLAGS: 00000093
Feb 22 01:35:50 neon kernel: [ 698.688908] RAX: 000000a2acc29000 RBX: ffff88061cdfd4a0 RCX: 000000000000c648
Feb 22 01:35:50 neon kernel: [ 698.688913] RDX: 0000000000000815 RSI: ffff88063ecc0000 RDI: ffff88061cdfd4a0
Feb 22 01:35:50 neon kernel: [ 698.688917] RBP: ffff88061cd87e10 R08: 0000000000005d5b R09: 0000000000000018
Feb 22 01:35:50 neon kernel: [ 698.688922] R10: 0000000000002ebc R11: 0000000000000000 R12: 0000000000000002
Feb 22 01:35:50 neon kernel: [ 698.688926] R13: ffff88061cd86000 R14: ffff88061cdfd400 R15: ffffffff81574a50
Feb 22 01:35:50 neon kernel: [ 698.688932] FS: 00007fc1d49ee740(0000) GS:ffff88063ecc0000(0000) knlGS:0000000000000000
Feb 22 01:35:50 neon kernel: [ 698.688937] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
Feb 22 01:35:50 neon kernel: [ 698.688941] CR2: 00007ff53018e48f CR3: 00000005dff0c000 CR4: 00000000000407e0
Feb 22 01:35:50 neon kernel: [ 698.688946] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Feb 22 01:35:50 neon kernel: [ 698.688951] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Feb 22 01:35:50 neon kernel: [ 698.688956] Process swapper/3 (pid: 0, threadinfo ffff88061cd86000, task ffff88061cd7c5c0)
Feb 22 01:35:50 neon kernel: [ 698.688959] Stack:
Feb 22 01:35:50 neon kernel: [ 698.688963] ffff88061cd87e40 ffffffff813e3faa ffff880616078000 ffffffff81c7e060
Feb 22 01:35:50 neon kernel: [ 698.688974] 000000a2ec7a1cd9 0000000000000002 ffff88061cd87e50 ffffffff81574a69
Feb 22 01:35:50 neon kernel: [ 698.688984] ffff88061cd87eb0 ffffffff81575499 7735940000000001 ffff880616078000
Feb 22 01:35:50 neon kernel: [ 698.688995] Call Trace:
Feb 22 01:35:50 neon kernel: [ 698.689005] [<ffffffff813e3faa>] acpi_idle_enter_simple+0x87/0xc5
Feb 22 01:35:50 neon kernel: [ 698.689016] [<ffffffff81574a69>] cpuidle_enter+0x19/0x20
Feb 22 01:35:50 neon kernel: [ 698.689024] [<ffffffff81575499>] cpuidle_wrap_enter+0x49/0xa0
Feb 22 01:35:50 neon kernel: [ 698.689033] [<ffffffff81575500>] cpuidle_enter_tk+0x10/0x20
Feb 22 01:35:50 neon kernel: [ 698.689041] [<ffffffff815750e5>] cpuidle_idle_call+0xa5/0x270
Feb 22 01:35:50 neon kernel: [ 698.689051] [<ffffffff8101d62f>] cpu_idle+0xaf/0x120
Feb 22 01:35:50 neon kernel: [ 698.689060] [<ffffffff816b7620>] start_secondary+0x1e0/0x1e5
Feb 22 01:35:50 neon kernel: [ 698.689065] Code: 00 83 88 3c e0 ff ff 04 5d c3 8a 47 08 55 48 89 e5 3c 01 75 07 e8 3a 35 c5 ff eb 17 3c 02 75 07 e8 a2 ff ff ff eb 0c 8b 57 04 ec <48> 8b 15 86 e1 b2 00 ed 5d c3 66 66 66 66 90 55 48 63 c2 48 c1
Feb 22 01:35:50 neon kernel: [ 698.689171] NMI backtrace for cpu 2
Feb 22 01:35:50 neon kernel: [ 698.689174] CPU 2
Feb 22 01:35:50 neon kernel: [ 698.689179] Pid: 18, comm: ksoftirqd/2 Tainted: PF W O 3.8.0-35-generic #50-Ubuntu To be filled by O.E.M. To be filled by O.E.M./SABERTOOTH 990FX R2.0
Feb 22 01:35:50 neon kernel: [ 698.689183] RIP: 0010:[<ffffffff81092755>] [<ffffffff81092755>] tg_load_down+0x5/0x80
Feb 22 01:35:50 neon kernel: [ 698.689190] RSP: 0018:ffff88061cdbdc70 EFLAGS: 00000086
Feb 22 01:35:50 neon kernel: [ 698.689192] RAX: ffff88063ed13ec0 RBX: ffffffff81e51520 RCX: 0000000000000004
Feb 22 01:35:50 neon kernel: [ 698.689195] RDX: ffffffff810865c0 RSI: 0000000000000004 RDI: ffffffff81e51520
Feb 22 01:35:50 neon kernel: [ 698.689198] RBP: ffff88061cdbdcb0 R08: ffff88061cdef678 R09: 0000000000000002
Feb 22 01:35:50 neon kernel: [ 698.689201] R10: 0000000000000001 R11: 000000000003698e R12: 0000000000000004
Feb 22 01:35:50 neon kernel: [ 698.689203] R13: ffffffff81092750 R14: ffffffff81e51520 R15: 0000000000000000
Feb 22 01:35:50 neon kernel: [ 698.689207] FS: 00007fbddf316740(0000) GS:ffff88063ec80000(0000) knlGS:0000000000000000
Feb 22 01:35:50 neon kernel: [ 698.689210] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
Feb 22 01:35:50 neon kernel: [ 698.689213] CR2: 00007ff530977618 CR3: 0000000594662000 CR4: 00000000000407e0
Feb 22 01:35:50 neon kernel: [ 698.689215] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Feb 22 01:35:50 neon kernel: [ 698.689218] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Feb 22 01:35:50 neon kernel: [ 698.689221] Process ksoftirqd/2 (pid: 18, threadinfo ffff88061cdbc000, task ffff88061cdaae80)
Feb 22 01:35:50 neon kernel: [ 698.689224] Stack:
Feb 22 01:35:50 neon kernel: [ 698.689226] ffffffff8108c74c ffffffff810865c0 0000000000000000 ffff88061ce79200
Feb 22 01:35:50 neon kernel: [ 698.689232] ffff88061cdef658 0000000000000478 ffff88061cdef640 0000000000000000
Feb 22 01:35:50 neon kernel: [ 698.689238] ffff88061cdbddc0 ffffffff8109906c ffff88061cdbdcb8 ffff880615b9c138
Feb 22 01:35:50 neon kernel: [ 698.689244] Call Trace:
Feb 22 01:35:50 neon kernel: [ 698.689251] [<ffffffff8108c74c>] ? walk_tg_tree_from+0x3c/0xd0
Feb 22 01:35:50 neon kernel: [ 698.689256] [<ffffffff810865c0>] ? smpboot_park_threads+0x70/0x70
Feb 22 01:35:50 neon kernel: [ 698.689263] [<ffffffff8109906c>] load_balance+0x2cc/0x870
Feb 22 01:35:50 neon kernel: [ 698.689271] [<ffffffff81099a9a>] idle_balance+0x18a/0x300
Feb 22 01:35:50 neon kernel: [ 698.689277] [<ffffffff816ccbdf>] __schedule+0x7df/0x800
Feb 22 01:35:50 neon kernel: [ 698.689284] [<ffffffff816ccf39>] schedule+0x29/0x70
Feb 22 01:35:50 neon kernel: [ 698.689289] [<ffffffff8108609e>] smpboot_thread_fn+0xce/0x1a0
Feb 22 01:35:50 neon kernel: [ 698.689294] [<ffffffff816ccf39>] ? schedule+0x29/0x70
Feb 22 01:35:50 neon kernel: [ 698.689299] [<ffffffff81085fd0>] ? lg_global_lock+0x60/0x60
Feb 22 01:35:50 neon kernel: [ 698.689305] [<ffffffff8107d5e0>] kthread+0xc0/0xd0
Feb 22 01:35:50 neon kernel: [ 698.689310] [<ffffffff8107d520>] ? kthread_create_on_node+0x120/0x120
Feb 22 01:35:50 neon kernel: [ 698.689317] [<ffffffff816d666c>] ret_from_fork+0x7c/0xb0
Feb 22 01:35:50 neon kernel: [ 698.689322] [<ffffffff8107d520>] ? kthread_create_on_node+0x120/0x120
Feb 22 01:35:50 neon kernel: [ 698.689326] Code: 84 00 00 00 00 00 66 66 66 66 90 48 8b 87 90 01 00 00 55 48 89 e5 48 8b 40 20 48 29 87 98 00 00 00 5d c3 0f 1f 00 66 66 66 66 90 <48> 8b 87 18 01 00 00 55 48 89 e5 48 85 c0 74 4b 48 8b 40 48 48
Feb 22 01:35:50 neon kernel: [ 698.689383] NMI backtrace for cpu 1
Feb 22 01:35:50 neon kernel: [ 698.689391] CPU 1
Feb 22 01:35:50 neon kernel: [ 698.689401] Pid: 0, comm: swapper/1 Tainted: PF W O 3.8.0-35-generic #50-Ubuntu To be filled by O.E.M. To be filled by O.E.M./SABERTOOTH 990FX R2.0
Feb 22 01:35:50 neon kernel: [ 698.689407] RIP: 0010:[<ffffffff81043fa6>] [<ffffffff81043fa6>] native_safe_halt+0x6/0x10
Feb 22 01:35:50 neon kernel: [ 698.689421] RSP: 0018:ffff88061cd83de8 EFLAGS: 00000246
Feb 22 01:35:50 neon kernel: [ 698.689427] RAX: 0000000000000000 RBX: ffff8806167cd46c RCX: ffffffff81c7e060
Feb 22 01:35:50 neon kernel: [ 698.689431] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffff8806167cd46c
Feb 22 01:35:50 neon kernel: [ 698.689436] RBP: ffff88061cd83de8 R08: 0000000000004d7c R09: 000000000000001c
Feb 22 01:35:50 neon kernel: [ 698.689440] R10: 0000000000002e6a R11: 0000000000000000 R12: 0000000000000001
Feb 22 01:35:50 neon kernel: [ 698.689445] R13: ffff8806167cd400 R14: 0000000000000001 R15: ffffffff81574a50
Feb 22 01:35:50 neon kernel: [ 698.689451] FS: 00007fc8b9ffb700(0000) GS:ffff88063ec40000(0000) knlGS:0000000000000000
Feb 22 01:35:50 neon kernel: [ 698.689456] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
Feb 22 01:35:50 neon kernel: [ 698.689460] CR2: 00007f87ac49f000 CR3: 00000005d5a57000 CR4: 00000000000407e0
Feb 22 01:35:50 neon kernel: [ 698.689465] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Feb 22 01:35:50 neon kernel: [ 698.689470] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Feb 22 01:35:50 neon kernel: [ 698.689475] Process swapper/1 (pid: 0, threadinfo ffff88061cd82000, task ffff88061cd79740)
Feb 22 01:35:50 neon kernel: [ 698.689479] Stack:
Feb 22 01:35:50 neon kernel: [ 698.689482] ffff88061cd83df8 ffffffff813e3769 ffff88061cd83e08 ffffffff813e3e7d
Feb 22 01:35:50 neon kernel: [ 698.689494] ffff88061cd83e18 ffffffff813e3eb1 ffff88061cd83e40 ffffffff813e3f04
Feb 22 01:35:50 neon kernel: [ 698.689504] ffff880616054000 ffffffff81c7e060 000000a2ebc3d4e7 ffff88061cd83e50
Feb 22 01:35:50 neon kernel: [ 698.689514] Call Trace:
Feb 22 01:35:50 neon kernel: [ 698.689526] [<ffffffff813e3769>] arch_safe_halt+0x9/0xd
Feb 22 01:35:50 neon kernel: [ 698.689535] [<ffffffff813e3e7d>] acpi_safe_halt+0x2a/0x43
Feb 22 01:35:50 neon kernel: [ 698.689543] [<ffffffff813e3eb1>] acpi_idle_do_entry+0x1b/0x2b
Feb 22 01:35:50 neon kernel: [ 698.689551] [<ffffffff813e3f04>] acpi_idle_enter_c1+0x43/0x62
Feb 22 01:35:50 neon kernel: [ 698.689561] [<ffffffff81574a69>] cpuidle_enter+0x19/0x20
Feb 22 01:35:50 neon kernel: [ 698.689569] [<ffffffff81575499>] cpuidle_wrap_enter+0x49/0xa0
Feb 22 01:35:50 neon kernel: [ 698.689578] [<ffffffff81575500>] cpuidle_enter_tk+0x10/0x20
Feb 22 01:35:50 neon kernel: [ 698.689586] [<ffffffff815750e5>] cpuidle_idle_call+0xa5/0x270
Feb 22 01:35:50 neon kernel: [ 698.689596] [<ffffffff8101d62f>] cpu_idle+0xaf/0x120
Feb 22 01:35:50 neon kernel: [ 698.689605] [<ffffffff816b7620>] start_secondary+0x1e0/0x1e5
Feb 22 01:35:50 neon kernel: [ 698.689611] Code: 00 00 00 00 00 55 48 89 e5 fa 5d c3 66 0f 1f 84 00 00 00 00 00 55 48 89 e5 fb 5d c3 66 0f 1f 84 00 00 00 00 00 55 48 89 e5 fb f4 <5d> c3 0f 1f 84 00 00 00 00 00 55 48 89 e5 f4 5d c3 66 0f 1f 84
Feb 22 01:35:50 neon kernel: [ 698.689717] NMI backtrace for cpu 0
Feb 22 01:35:50 neon kernel: [ 698.689719] CPU 0
Feb 22 01:35:50 neon kernel: [ 698.689725] Pid: 0, comm: swapper/0 Tainted: PF W O 3.8.0-35-generic #50-Ubuntu To be filled by O.E.M. To be filled by O.E.M./SABERTOOTH 990FX R2.0
Feb 22 01:35:50 neon kernel: [ 698.689728] RIP: 0010:[<ffffffff813e3eb7>] [<ffffffff813e3eb7>] acpi_idle_do_entry+0x21/0x2b
Feb 22 01:35:50 neon kernel: [ 698.689735] RSP: 0018:ffffffff81c01e10 EFLAGS: 00000093
Feb 22 01:35:50 neon kernel: [ 698.689738] RAX: 000000a2acc24800 RBX: ffff88061cdfcca0 RCX: 000000000000c648
Feb 22 01:35:50 neon kernel: [ 698.689741] RDX: 0000000000000815 RSI: ffff88063ec00000 RDI: ffff88061cdfcca0
Feb 22 01:35:50 neon kernel: [ 698.689744] RBP: ffffffff81c01e10 R08: 0000000000005d6e R09: 0000000000000018
Feb 22 01:35:50 neon kernel: [ 698.689746] R10: 0000000000004de4 R11: 0000000000000000 R12: 0000000000000002
Feb 22 01:35:50 neon kernel: [ 698.689749] R13: ffffffff81c00000 R14: ffff88061cdfcc00 R15: ffffffff81574a50
Feb 22 01:35:50 neon kernel: [ 698.689753] FS: 00007f46053ce700(0000) GS:ffff88063ec00000(0000) knlGS:0000000000000000
Feb 22 01:35:50 neon kernel: [ 698.689756] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
Feb 22 01:35:50 neon kernel: [ 698.689759] CR2: 00007f460728d000 CR3: 00000005b9537000 CR4: 00000000000407f0
Feb 22 01:35:50 neon kernel: [ 698.689761] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Feb 22 01:35:50 neon kernel: [ 698.689764] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Feb 22 01:35:50 neon kernel: [ 698.689767] Process swapper/0 (pid: 0, threadinfo ffffffff81c00000, task ffffffff81c15440)
Feb 22 01:35:50 neon kernel: [ 698.689770] Stack:
Feb 22 01:35:50 neon kernel: [ 698.689772] ffffffff81c01e40 ffffffff813e3faa ffff880616741600 ffffffff81c7e060
Feb 22 01:35:50 neon kernel: [ 698.689778] 000000a2ec79d551 0000000000000002 ffffffff81c01e50 ffffffff81574a69
Feb 22 01:35:50 neon kernel: [ 698.689784] ffffffff81c01eb0 ffffffff81575499 7735940000000001 ffff880616741600
Feb 22 01:35:50 neon kernel: [ 698.689790] Call Trace:
Feb 22 01:35:50 neon kernel: [ 698.689797] [<ffffffff813e3faa>] acpi_idle_enter_simple+0x87/0xc5
Feb 22 01:35:50 neon kernel: [ 698.689803] [<ffffffff81574a69>] cpuidle_enter+0x19/0x20
Feb 22 01:35:50 neon kernel: [ 698.689809] [<ffffffff81575499>] cpuidle_wrap_enter+0x49/0xa0
Feb 22 01:35:50 neon kernel: [ 698.689815] [<ffffffff81575500>] cpuidle_enter_tk+0x10/0x20
Feb 22 01:35:50 neon kernel: [ 698.689821] [<ffffffff815750e5>] cpuidle_idle_call+0xa5/0x270
Feb 22 01:35:50 neon kernel: [ 698.689827] [<ffffffff8101d62f>] cpu_idle+0xaf/0x120
Feb 22 01:35:50 neon kernel: [ 698.689833] [<ffffffff816abc32>] rest_init+0x72/0x80
Feb 22 01:35:50 neon kernel: [ 698.689841] [<ffffffff81d05be9>] start_kernel+0x3d1/0x3dc
Feb 22 01:35:50 neon kernel: [ 698.689847] [<ffffffff81d0566e>] ? do_early_param+0x8e/0x8e
Feb 22 01:35:50 neon kernel: [ 698.689854] [<ffffffff81d05355>] x86_64_start_reservations+0x130/0x133
Feb 22 01:35:50 neon kernel: [ 698.689860] [<ffffffff81d05458>] x86_64_start_kernel+0x100/0x10f
Feb 22 01:35:50 neon kernel: [ 698.689863] Code: 00 83 88 3c e0 ff ff 04 5d c3 8a 47 08 55 48 89 e5 3c 01 75 07 e8 3a 35 c5 ff eb 17 3c 02 75 07 e8 a2 ff ff ff eb 0c 8b 57 04 ec <48> 8b 15 86 e1 b2 00 ed 5d c3 66 66 66 66 90 55 48 63 c2 48 c1
Feb 22 01:35:59 neon rtkit-daemon[3933]: The canary thread is apparently starving. Taking action.
Feb 22 01:35:59 neon rtkit-daemon[3933]: Demoting known real-time threads.
Feb 22 01:35:59 neon rtkit-daemon[3933]: Successfully demoted thread 4021 of process 3931 (n/a).
Feb 22 01:35:59 neon rtkit-daemon[3933]: Successfully demoted thread 4015 of process 3931 (n/a).
Feb 22 01:35:59 neon rtkit-daemon[3933]: Successfully demoted thread 4000 of process 3931 (n/a).
Feb 22 01:35:59 neon rtkit-daemon[3933]: Successfully demoted thread 3931 of process 3931 (n/a).
Feb 22 01:35:59 neon rtkit-daemon[3933]: Demoted 4 threads.
Feb 22 01:36:09 neon rtkit-daemon[3933]: The canary thread is apparently starving. Taking action.
Feb 22 01:36:09 neon rtkit-daemon[3933]: Demoting known real-time threads.
Feb 22 01:36:09 neon rtkit-daemon[3933]: Successfully demoted thread 4021 of process 3931 (n/a).
Feb 22 01:36:09 neon rtkit-daemon[3933]: Successfully demoted thread 4015 of process 3931 (n/a).
Feb 22 01:36:09 neon rtkit-daemon[3933]: Successfully demoted thread 4000 of process 3931 (n/a).
Feb 22 01:36:09 neon rtkit-daemon[3933]: Successfully demoted thread 3931 of process 3931 (n/a).
Feb 22 01:36:09 neon rtkit-daemon[3933]: Demoted 4 threads.
Feb 22 01:36:19 neon rtkit-daemon[3933]: The canary thread is apparently starving. Taking action.
Feb 22 01:36:19 neon rtkit-daemon[3933]: Demoting known real-time threads.
Feb 22 01:36:19 neon rtkit-daemon[3933]: Successfully demoted thread 4021 of process 3931 (n/a).
Feb 22 01:36:19 neon rtkit-daemon[3933]: Successfully demoted thread 4015 of process 3931 (n/a).
Feb 22 01:36:19 neon rtkit-daemon[3933]: Successfully demoted thread 4000 of process 3931 (n/a).
Feb 22 01:36:19 neon rtkit-daemon[3933]: Successfully demoted thread 3931 of process 3931 (n/a).
Feb 22 01:36:19 neon rtkit-daemon[3933]: Demoted 4 threads.
Feb 22 01:36:29 neon rtkit-daemon[3933]: The canary thread is apparently starving. Taking action.
Feb 22 01:36:29 neon rtkit-daemon[3933]: Demoting known real-time threads.
Feb 22 01:36:29 neon rtkit-daemon[3933]: Successfully demoted thread 4021 of process 3931 (n/a).
Feb 22 01:36:29 neon rtkit-daemon[3933]: Successfully demoted thread 4015 of process 3931 (n/a).
Feb 22 01:36:29 neon rtkit-daemon[3933]: Successfully demoted thread 4000 of process 3931 (n/a).
Feb 22 01:36:29 neon rtkit-daemon[3933]: Successfully demoted thread 3931 of process 3931 (n/a).
Feb 22 01:36:29 neon rtkit-daemon[3933]: Demoted 4 threads.
Feb 22 01:36:39 neon rtkit-daemon[3933]: The canary thread is apparently starving. Taking action.
Feb 22 01:36:39 neon rtkit-daemon[3933]: Demoting known real-time threads.
Feb 22 01:36:39 neon rtkit-daemon[3933]: Successfully demoted thread 4021 of process 3931 (n/a).
Feb 22 01:36:39 neon rtkit-daemon[3933]: Successfully demoted thread 4015 of process 3931 (n/a).
Feb 22 01:36:39 neon rtkit-daemon[3933]: Successfully demoted thread 4000 of process 3931 (n/a).
Feb 22 01:36:39 neon rtkit-daemon[3933]: Successfully demoted thread 3931 of process 3931 (n/a).
Feb 22 01:36:39 neon rtkit-daemon[3933]: Demoted 4 threads.
Feb 22 01:36:49 neon rtkit-daemon[3933]: The canary thread is apparently starving. Taking action.
Feb 22 01:36:49 neon rtkit-daemon[3933]: Demoting known real-time threads.
Feb 22 01:36:49 neon rtkit-daemon[3933]: Successfully demoted thread 4021 of process 3931 (n/a).
Feb 22 01:36:49 neon rtkit-daemon[3933]: Successfully demoted thread 4015 of process 3931 (n/a).
Feb 22 01:36:49 neon rtkit-daemon[3933]: Successfully demoted thread 4000 of process 3931 (n/a).
Feb 22 01:36:49 neon rtkit-daemon[3933]: Successfully demoted thread 3931 of process 3931 (n/a).
Feb 22 01:36:49 neon rtkit-daemon[3933]: Demoted 4 threads.
Feb 22 01:36:59 neon rtkit-daemon[3933]: The canary thread is apparently starving. Taking action.
Feb 22 01:36:59 neon rtkit-daemon[3933]: Demoting known real-time threads.
Feb 22 01:36:59 neon rtkit-daemon[3933]: Successfully demoted thread 4021 of process 3931 (n/a).
Feb 22 01:36:59 neon rtkit-daemon[3933]: Successfully demoted thread 4015 of process 3931 (n/a).
Feb 22 01:36:59 neon rtkit-daemon[3933]: Successfully demoted thread 4000 of process 3931 (n/a).
Feb 22 01:36:59 neon rtkit-daemon[3933]: Successfully demoted thread 3931 of process 3931 (n/a).
Feb 22 01:36:59 neon rtkit-daemon[3933]: Demoted 4 threads.
Feb 22 01:37:09 neon rtkit-daemon[3933]: The canary thread is apparently starving. Taking action.
Feb 22 01:37:09 neon rtkit-daemon[3933]: Demoting known real-time threads.
Feb 22 01:37:09 neon rtkit-daemon[3933]: Successfully demoted thread 4021 of process 3931 (n/a).
Feb 22 01:37:09 neon rtkit-daemon[3933]: Successfully demoted thread 4015 of process 3931 (n/a).
Feb 22 01:37:09 neon rtkit-daemon[3933]: Successfully demoted thread 4000 of process 3931 (n/a).
Feb 22 01:37:09 neon rtkit-daemon[3933]: Successfully demoted thread 3931 of process 3931 (n/a).
Feb 22 01:37:09 neon rtkit-daemon[3933]: Demoted 4 threads.
Feb 22 01:37:19 neon rtkit-daemon[3933]: The canary thread is apparently starving. Taking action.
Feb 22 01:37:19 neon rtkit-daemon[3933]: Demoting known real-time threads.
Feb 22 01:37:19 neon rtkit-daemon[3933]: Successfully demoted thread 4021 of process 3931 (n/a).
Feb 22 01:37:19 neon rtkit-daemon[3933]: Successfully demoted thread 4015 of process 3931 (n/a).
Feb 22 01:37:19 neon rtkit-daemon[3933]: Successfully demoted thread 4000 of process 3931 (n/a).
Feb 22 01:37:19 neon rtkit-daemon[3933]: Successfully demoted thread 3931 of process 3931 (n/a).
Feb 22 01:37:19 neon rtkit-daemon[3933]: Demoted 4 threads.
Feb 22 01:37:29 neon rtkit-daemon[3933]: The canary thread is apparently starving. Taking action.
Feb 22 01:37:29 neon rtkit-daemon[3933]: Demoting known real-time threads.
Feb 22 01:37:29 neon rtkit-daemon[3933]: Successfully demoted thread 4021 of process 3931 (n/a).
Feb 22 01:37:29 neon rtkit-daemon[3933]: Successfully demoted thread 4015 of process 3931 (n/a).
Feb 22 01:37:29 neon rtkit-daemon[3933]: Successfully demoted thread 4000 of process 3931 (n/a).
Feb 22 01:37:29 neon rtkit-daemon[3933]: Successfully demoted thread 3931 of process 3931 (n/a).
Feb 22 01:37:29 neon rtkit-daemon[3933]: Demoted 4 threads.
Feb 22 01:37:39 neon rtkit-daemon[3933]: The canary thread is apparently starving. Taking action.
Feb 22 01:37:39 neon rtkit-daemon[3933]: Demoting known real-time threads.
Feb 22 01:37:39 neon rtkit-daemon[3933]: Successfully demoted thread 4021 of process 3931 (n/a).
Feb 22 01:37:39 neon rtkit-daemon[3933]: Successfully demoted thread 4015 of process 3931 (n/a).
Feb 22 01:37:39 neon rtkit-daemon[3933]: Successfully demoted thread 4000 of process 3931 (n/a).
Feb 22 01:37:39 neon rtkit-daemon[3933]: Successfully demoted thread 3931 of process 3931 (n/a).
Feb 22 01:37:39 neon rtkit-daemon[3933]: Demoted 4 threads.
Feb 22 01:37:49 neon rtkit-daemon[3933]: The canary thread is apparently starving. Taking action.
Feb 22 01:37:49 neon rtkit-daemon[3933]: Demoting known real-time threads.
Feb 22 01:37:49 neon rtkit-daemon[3933]: Successfully demoted thread 4021 of process 3931 (n/a).
Feb 22 01:37:49 neon rtkit-daemon[3933]: Successfully demoted thread 4015 of process 3931 (n/a).
Feb 22 01:37:49 neon rtkit-daemon[3933]: Successfully demoted thread 4000 of process 3931 (n/a).
Feb 22 01:37:49 neon rtkit-daemon[3933]: Successfully demoted thread 3931 of process 3931 (n/a).
Feb 22 01:37:49 neon rtkit-daemon[3933]: Demoted 4 threads.
Feb 22 01:37:59 neon rtkit-daemon[3933]: The canary thread is apparently starving. Taking action.
Feb 22 01:37:59 neon rtkit-daemon[3933]: Demoting known real-time threads.
Feb 22 01:37:59 neon rtkit-daemon[3933]: Successfully demoted thread 4021 of process 3931 (n/a).
Feb 22 01:37:59 neon rtkit-daemon[3933]: Successfully demoted thread 4015 of process 3931 (n/a).
Feb 22 01:37:59 neon rtkit-daemon[3933]: Successfully demoted thread 4000 of process 3931 (n/a).
Feb 22 01:37:59 neon rtkit-daemon[3933]: Successfully demoted thread 3931 of process 3931 (n/a).
Feb 22 01:37:59 neon rtkit-daemon[3933]: Demoted 4 threads.
Feb 22 01:38:08 neon kernel: [ 836.412199] ------------[ cut here ]------------
Feb 22 01:38:08 neon kernel: [ 836.412217] WARNING: at /build/buildd/linux-3.8.0/net/sched/sch_generic.c:254 dev_watchdog+0x242/0x250()
Feb 22 01:38:08 neon kernel: [ 836.412223] Hardware name: To be filled by O.E.M.
Feb 22 01:38:08 neon kernel: [ 836.412228] NETDEV WATCHDOG: eth1 (e1000e): transmit queue 0 timed out
Feb 22 01:38:08 neon kernel: [ 836.412232] Modules linked in: pci_stub vboxpci(OF) vboxnetadp(OF) vboxnetflt(OF) vboxdrv(OF) ib_srpt tcm_qla2xxx qla2xxx tcm_loop tcm_fc libfc scsi_transport_fc(F) scsi_tgt(F) iscsi_target_mod target_core_pscsi target_core_file target_core_iblock target_core_mod configfs(F) ib_iser rdma_cm parport_pc(F) ib_addr iw_cm ppdev(F) ib_cm ib_sa ib_mad ib_core iscsi_tcp(F) bnep rfcomm libiscsi_tcp(F) libiscsi(F) scsi_transport_iscsi(F) nfsv4(F) bluetooth nfsd(F) binfmt_misc(F) auth_rpcgss(F) nfs_acl(F) nfs(F) lockd(F) sunrpc(F) fscache(F) snd_hda_codec_hdmi eeepc_wmi asus_wmi sparse_keymap video(F) mxm_wmi joydev(F) dm_multipath(F) kvm_amd(F) scsi_dh(F) kvm(F) ghash_clmulni_intel(F) aesni_intel(F) aes_x86_64(F) snd_hda_codec_realtek xts(F) lrw(F) gf128mul(F) ablk_helper(F) cryptd(F) psmouse(F) fam15h_power serio_raw(F) edac_core microcode(F) snd_hda_intel k10temp snd_hda_codec edac_mce_amd nvidia(POF) snd_hwdep(F) sp5100_tco i2c_piix4 snd_pcm(F) snd_page_alloc(F) snd_seq_midi(F) snd_se
Feb 22 01:38:08 neon kernel: q_midi_event(F) snd_rawmidi(F) snd_seq(F) snd_seq_device(F) snd_timer(F) snd(F) soundcore(F) wmi mac_hid lp(F) parport(F) zfs(POF) zunicode(POF) zavl(POF) zcommon(POF) znvpair(POF) spl(OF) xfs(F) btrfs(F) zlib_deflate(F) libcrc32c(F) dm_raid45 xor(F) dm_mirror(F) dm_region_hash(F) dm_log(F) hid_generic hid_microsoft usbhid hid usb_storage(F) r8169 e1000e(F) ahci(F) libahci(F)
Feb 22 01:38:08 neon kernel: [ 836.412458] Pid: 0, comm: swapper/5 Tainted: PF W O 3.8.0-35-generic #50-Ubuntu
Feb 22 01:38:08 neon kernel: [ 836.412463] Call Trace:
Feb 22 01:38:08 neon kernel: [ 836.412468] <IRQ> [<ffffffff81058a3f>] warn_slowpath_common+0x7f/0xc0
Feb 22 01:38:08 neon kernel: [ 836.412487] [<ffffffff81058b3c>] warn_slowpath_fmt+0x4c/0x50
Feb 22 01:38:08 neon kernel: [ 836.412498] [<ffffffff81075728>] ? insert_work+0x98/0xc0
Feb 22 01:38:08 neon kernel: [ 836.412513] [<ffffffff815e91c2>] dev_watchdog+0x242/0x250
Feb 22 01:38:08 neon kernel: [ 836.412522] [<ffffffff815e8f80>] ? dev_graft_qdisc+0x90/0x90
Feb 22 01:38:08 neon kernel: [ 836.412531] [<ffffffff810682a6>] call_timer_fn+0x36/0x110
Feb 22 01:38:08 neon kernel: [ 836.412539] [<ffffffff815e8f80>] ? dev_graft_qdisc+0x90/0x90
Feb 22 01:38:08 neon kernel: [ 836.412548] [<ffffffff81069ed6>] run_timer_softirq+0x1f6/0x2a0
Feb 22 01:38:08 neon kernel: [ 836.412558] [<ffffffff8106118f>] __do_softirq+0xcf/0x200
Feb 22 01:38:08 neon kernel: [ 836.412568] [<ffffffff81574a50>] ? centrino_target+0x370/0x370
Feb 22 01:38:08 neon kernel: [ 836.412577] [<ffffffff816d7b9c>] call_softirq+0x1c/0x30
Feb 22 01:38:08 neon kernel: [ 836.412587] [<ffffffff81016605>] do_softirq+0x75/0xb0
Feb 22 01:38:08 neon kernel: [ 836.412595] [<ffffffff81061425>] irq_exit+0xa5/0xb0
Feb 22 01:38:08 neon kernel: [ 836.412605] [<ffffffff816d851e>] smp_apic_timer_interrupt+0x6e/0x99
Feb 22 01:38:08 neon kernel: [ 836.412614] [<ffffffff816d745d>] apic_timer_interrupt+0x6d/0x80
Feb 22 01:38:08 neon kernel: [ 836.412618] <EOI> [<ffffffff81091a9d>] ? sched_clock_cpu+0xbd/0x110
Feb 22 01:38:08 neon kernel: [ 836.412633] [<ffffffff815754a8>] ? cpuidle_wrap_enter+0x58/0xa0
Feb 22 01:38:08 neon kernel: [ 836.412643] [<ffffffff81575500>] cpuidle_enter_tk+0x10/0x20
Feb 22 01:38:08 neon kernel: [ 836.412651] [<ffffffff815750e5>] cpuidle_idle_call+0xa5/0x270
Feb 22 01:38:08 neon kernel: [ 836.412660] [<ffffffff8101d62f>] cpu_idle+0xaf/0x120
Feb 22 01:38:08 neon kernel: [ 836.412668] [<ffffffff816b7620>] start_secondary+0x1e0/0x1e5
Feb 22 01:38:08 neon kernel: [ 836.412674] ---[ end trace 134857e3f42317e6 ]---
Feb 22 01:38:08 neon kernel: [ 836.412701] e1000e 0000:05:00.0 eth1: Reset adapter
Feb 22 01:38:09 neon rtkit-daemon[3933]: The canary thread is apparently starving. Taking action.
Feb 22 01:38:09 neon rtkit-daemon[3933]: Demoting known real-time threads.
Feb 22 01:38:09 neon rtkit-daemon[3933]: Successfully demoted thread 4021 of process 3931 (n/a).
Feb 22 01:38:09 neon rtkit-daemon[3933]: Successfully demoted thread 4015 of process 3931 (n/a).
Feb 22 01:38:09 neon rtkit-daemon[3933]: Successfully demoted thread 4000 of process 3931 (n/a).
Feb 22 01:38:09 neon rtkit-daemon[3933]: Successfully demoted thread 3931 of process 3931 (n/a).
Feb 22 01:38:09 neon rtkit-daemon[3933]: Demoted 4 threads.
Feb 22 01:38:19 neon rtkit-daemon[3933]: The canary thread is apparently starving. Taking action.
Feb 22 01:38:19 neon rtkit-daemon[3933]: Demoting known real-time threads.
Feb 22 01:38:19 neon rtkit-daemon[3933]: Successfully demoted thread 4021 of process 3931 (n/a).
Feb 22 01:38:19 neon rtkit-daemon[3933]: Successfully demoted thread 4015 of process 3931 (n/a).
Feb 22 01:38:19 neon rtkit-daemon[3933]: Successfully demoted thread 4000 of process 3931 (n/a).
Feb 22 01:38:19 neon rtkit-daemon[3933]: Successfully demoted thread 3931 of process 3931 (n/a).
Feb 22 01:38:19 neon rtkit-daemon[3933]: Demoted 4 threads.
Feb 22 01:38:29 neon rtkit-daemon[3933]: The canary thread is apparently starving. Taking action.
Feb 22 01:38:29 neon rtkit-daemon[3933]: Demoting known real-time threads.
Feb 22 01:38:29 neon rtkit-daemon[3933]: Successfully demoted thread 4021 of process 3931 (n/a).
Feb 22 01:38:29 neon rtkit-daemon[3933]: Successfully demoted thread 4015 of process 3931 (n/a).
Feb 22 01:38:29 neon rtkit-daemon[3933]: Successfully demoted thread 4000 of process 3931 (n/a).
Feb 22 01:38:29 neon rtkit-daemon[3933]: Successfully demoted thread 3931 of process 3931 (n/a).
Feb 22 01:38:29 neon rtkit-daemon[3933]: Demoted 4 threads.
Feb 22 01:38:39 neon rtkit-daemon[3933]: The canary thread is apparently starving. Taking action.
Feb 22 01:38:39 neon rtkit-daemon[3933]: Demoting known real-time threads.
Feb 22 01:38:39 neon rtkit-daemon[3933]: Successfully demoted thread 4021 of process 3931 (n/a).
Feb 22 01:38:39 neon rtkit-daemon[3933]: Successfully demoted thread 4015 of process 3931 (n/a).
Feb 22 01:38:39 neon rtkit-daemon[3933]: Successfully demoted thread 4000 of process 3931 (n/a).
Feb 22 01:38:39 neon rtkit-daemon[3933]: Successfully demoted thread 3931 of process 3931 (n/a).
Feb 22 01:38:39 neon rtkit-daemon[3933]: Demoted 4 threads.
Feb 22 01:38:49 neon rtkit-daemon[3933]: The canary thread is apparently starving. Taking action.
Feb 22 01:38:49 neon rtkit-daemon[3933]: Demoting known real-time threads.
Feb 22 01:38:49 neon rtkit-daemon[3933]: Successfully demoted thread 4021 of process 3931 (n/a).
Feb 22 01:38:49 neon rtkit-daemon[3933]: Successfully demoted thread 4015 of process 3931 (n/a).
Feb 22 01:38:49 neon rtkit-daemon[3933]: Successfully demoted thread 4000 of process 3931 (n/a).
Feb 22 01:38:49 neon rtkit-daemon[3933]: Successfully demoted thread 3931 of process 3931 (n/a).
Feb 22 01:38:49 neon rtkit-daemon[3933]: Demoted 4 threads.
Feb 22 01:38:50 neon kernel: [ 878.342835] INFO: rcu_sched detected stalls on CPUs/tasks: { 4} (detected by 5, t=105012 jiffies, g=46247, c=46246, q=101119)
Feb 22 01:38:50 neon kernel: [ 878.342851] sending NMI to all CPUs:
Feb 22 01:38:50 neon kernel: [ 878.342860] NMI backtrace for cpu 5
Feb 22 01:38:50 neon kernel: [ 878.342865] CPU 5
Feb 22 01:38:50 neon kernel: [ 878.342874] Pid: 0, comm: swapper/5 Tainted: PF W O 3.8.0-35-generic #50-Ubuntu To be filled by O.E.M. To be filled by O.E.M./SABERTOOTH 990FX R2.0
Feb 22 01:38:50 neon kernel: [ 878.342880] RIP: 0010:[<ffffffff81354210>] [<ffffffff81354210>] __ndelay+0x40/0x40
Feb 22 01:38:50 neon kernel: [ 878.342893] RSP: 0018:ffff88063ed43dd0 EFLAGS: 00000807
Feb 22 01:38:50 neon kernel: [ 878.342898] RAX: 00000000bbec9c00 RBX: 0000000000002710 RCX: 0000000001acad60
Feb 22 01:38:50 neon kernel: [ 878.342903] RDX: 0000000000352808 RSI: 0000000000000100 RDI: 0000000000352809
Feb 22 01:38:50 neon kernel: [ 878.342908] RBP: ffff88063ed43dd8 R08: 000000000000000a R09: 0000000000000000
Feb 22 01:38:50 neon kernel: [ 878.342912] R10: 000000000000064d R11: 0000000000000002 R12: ffffffff81ce70c0
Feb 22 01:38:50 neon kernel: [ 878.342917] R13: ffff88063ed4ee60 R14: ffffffff81c3f3c0 R15: ffffffff81c3f480
Feb 22 01:38:50 neon kernel: [ 878.342923] FS: 00007fc8b9ffb700(0000) GS:ffff88063ed40000(0000) knlGS:0000000000000000
Feb 22 01:38:50 neon kernel: [ 878.342928] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
Feb 22 01:38:50 neon kernel: [ 878.342933] CR2: 00007f786c013f58 CR3: 00000005d5a57000 CR4: 00000000000407e0
Feb 22 01:38:50 neon kernel: [ 878.342937] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Feb 22 01:38:50 neon kernel: [ 878.342942] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Feb 22 01:38:50 neon kernel: [ 878.342948] Process swapper/5 (pid: 0, threadinfo ffff88061cd8a000, task ffff88061cd90000)
Feb 22 01:38:50 neon kernel: [ 878.342951] Stack:
Feb 22 01:38:50 neon kernel: [ 878.342955] ffffffff8135418c ffff88063ed43df0 ffffffff81039d6a ffffffff81c3f3c0
Feb 22 01:38:50 neon kernel: [ 878.342967] ffff88063ed43e50 ffffffff810f2935 0000000000018aff 0000000000000082
Feb 22 01:38:50 neon kernel: [ 878.342977] 000000010002362e 0000000000000005 ffff88061cd8a000 ffff88061cd90000
Feb 22 01:38:50 neon kernel: [ 878.342988] Call Trace:
Feb 22 01:38:50 neon kernel: [ 878.342992] <IRQ>
Feb 22 01:38:50 neon kernel: [ 878.342996] [<ffffffff8135418c>] ? __const_udelay+0x2c/0x30
Feb 22 01:38:50 neon kernel: [ 878.343013] [<ffffffff81039d6a>] arch_trigger_all_cpu_backtrace+0x6a/0x90
Feb 22 01:38:50 neon kernel: [ 878.343023] [<ffffffff810f2935>] rcu_pending+0x565/0x5b0
Feb 22 01:38:50 neon kernel: [ 878.343032] [<ffffffff810f4a0b>] rcu_check_callbacks+0x9b/0x120
Feb 22 01:38:50 neon kernel: [ 878.343041] [<ffffffff8106a928>] update_process_times+0x48/0x90
Feb 22 01:38:50 neon kernel: [ 878.343050] [<ffffffff810b3a8e>] tick_sched_handle.isra.8+0x2e/0x70
Feb 22 01:38:50 neon kernel: [ 878.343058] [<ffffffff810b3c1c>] tick_sched_timer+0x4c/0x80
Feb 22 01:38:50 neon kernel: [ 878.343067] [<ffffffff810819d9>] __run_hrtimer+0x79/0x1c0
Feb 22 01:38:50 neon kernel: [ 878.343075] [<ffffffff810b3bd0>] ? tick_sched_do_timer+0x40/0x40
Feb 22 01:38:50 neon kernel: [ 878.343083] [<ffffffff810822c7>] hrtimer_interrupt+0xe7/0x230
Feb 22 01:38:50 neon kernel: [ 878.343093] [<ffffffff81574a50>] ? centrino_target+0x370/0x370
Feb 22 01:38:50 neon kernel: [ 878.343102] [<ffffffff816d8519>] smp_apic_timer_interrupt+0x69/0x99
Feb 22 01:38:50 neon kernel: [ 878.343111] [<ffffffff816d745d>] apic_timer_interrupt+0x6d/0x80
Feb 22 01:38:50 neon kernel: [ 878.343115] <EOI>
Feb 22 01:38:50 neon kernel: [ 878.343119] [<ffffffff81091a9d>] ? sched_clock_cpu+0xbd/0x110
Feb 22 01:38:50 neon kernel: [ 878.343134] [<ffffffff815754a8>] ? cpuidle_wrap_enter+0x58/0xa0
Feb 22 01:38:50 neon kernel: [ 878.343143] [<ffffffff81575500>] cpuidle_enter_tk+0x10/0x20
Feb 22 01:38:50 neon kernel: [ 878.343151] [<ffffffff815750e5>] cpuidle_idle_call+0xa5/0x270
Feb 22 01:38:50 neon kernel: [ 878.343160] [<ffffffff8101d62f>] cpu_idle+0xaf/0x120
Feb 22 01:38:50 neon kernel: [ 878.343169] [<ffffffff816b7620>] start_secondary+0x1e0/0x1e5
Feb 22 01:38:50 neon kernel: [ 878.343174] Code: 0c 12 48 c1 e2 06 48 89 e5 48 c1 e0 02 48 29 ca f7 e2 48 8d 7a 01 ff 15 97 24 92 00 5d c3 66 66 66 66 2e 0f 1f 84 00 00 00 00 00 <66> 66 66 66 90 55 48 89 e5 41 55 41 54 41 89 fc 53 65 44 8b 2c
Feb 22 01:38:50 neon kernel: [ 878.343279] NMI backtrace for cpu 4
Feb 22 01:38:50 neon kernel: [ 878.343283] CPU 4
Feb 22 01:38:50 neon kernel: [ 878.343290] Pid: 7557, comm: zfs Tainted: PF W O 3.8.0-35-generic #50-Ubuntu To be filled by O.E.M. To be filled by O.E.M./SABERTOOTH 990FX R2.0
Feb 22 01:38:50 neon kernel: [ 878.343295] RIP: 0010:[<ffffffff81044ac2>] [<ffffffff81044ac2>] __ticket_spin_lock+0x22/0x30
Feb 22 01:38:50 neon kernel: [ 878.343306] RSP: 0018:ffff88055774b988 EFLAGS: 00000006
Feb 22 01:38:50 neon kernel: [ 878.343311] RAX: 0000000000002d4b RBX: ffff8805d5af1740 RCX: 0000000000000000
Feb 22 01:38:50 neon kernel: [ 878.343315] RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff880503870848
Feb 22 01:38:50 neon kernel: [ 878.343320] RBP: ffff88055774b988 R08: 0000000000016d40 R09: ffff88063ed16d40
Feb 22 01:38:50 neon kernel: [ 878.343324] R10: ffffea001776c200 R11: ffffffffa02cb83b R12: ffff880503870840
Feb 22 01:38:50 neon kernel: [ 878.343328] R13: ffff880503870848 R14: ffffffffffffffff R15: 0000000000000001
Feb 22 01:38:50 neon kernel: [ 878.343334] FS: 00007fbe10597700(0000) GS:ffff88063ed00000(0000) knlGS:0000000000000000
Feb 22 01:38:50 neon kernel: [ 878.343339] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Feb 22 01:38:50 neon kernel: [ 878.343343] CR2: 0000000001d8efe0 CR3: 00000005a4493000 CR4: 00000000000407e0
Feb 22 01:38:50 neon kernel: [ 878.343348] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Feb 22 01:38:50 neon kernel: [ 878.343352] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Feb 22 01:38:50 neon kernel: [ 878.343357] Process zfs (pid: 7557, threadinfo ffff88055774a000, task ffff8805d5af1740)
Feb 22 01:38:50 neon kernel: [ 878.343361] Stack:
Feb 22 01:38:50 neon kernel: [ 878.343364] ffff88055774b998 ffffffff816cde65 ffff88055774ba00 ffffffff816cdca6
Feb 22 01:38:50 neon kernel: [ 878.343376] 0000000000000000 0000000000000000 000000005774ba00 ffffffff00000000
Feb 22 01:38:50 neon kernel: [ 878.343387] ffffffff816cb7ad ffff880503b22248 ffff880503870840 0000000000000002
Feb 22 01:38:50 neon kernel: [ 878.343398] Call Trace:
Feb 22 01:38:50 neon kernel: [ 878.343408] [<ffffffff816cde65>] _raw_spin_lock_irq+0x15/0x20
Feb 22 01:38:50 neon kernel: [ 878.343416] [<ffffffff816cdca6>] rwsem_down_failed_common+0x46/0x170
Feb 22 01:38:50 neon kernel: [ 878.343425] [<ffffffff816cb7ad>] ? mutex_lock+0x1d/0x50
Feb 22 01:38:50 neon kernel: [ 878.343433] [<ffffffff816cde05>] rwsem_down_read_failed+0x15/0x17
Feb 22 01:38:50 neon kernel: [ 878.343442] [<ffffffff813555d4>] call_rwsem_down_read_failed+0x14/0x30
Feb 22 01:38:50 neon kernel: [ 878.343480] [<ffffffffa02cb83b>] ? kmem_free_debug+0x4b/0x150 [spl]
Feb 22 01:38:50 neon kernel: [ 878.343493] [<ffffffff816cc0e0>] ? down_read+0x20/0x23
Feb 22 01:38:50 neon kernel: [ 878.343577] [<ffffffffa03b28f0>] zap_get_leaf_byblk+0xd0/0x2c0 [zfs]
Feb 22 01:38:50 neon kernel: [ 878.343646] [<ffffffffa03b22f3>] ? zap_idx_to_blk+0x133/0x140 [zfs]
Feb 22 01:38:50 neon kernel: [ 878.343715] [<ffffffffa03b2b4d>] zap_deref_leaf+0x6d/0x80 [zfs]
Feb 22 01:38:50 neon kernel: [ 878.343784] [<ffffffffa03b46d1>] fzap_cursor_retrieve+0xe1/0x280 [zfs]
Feb 22 01:38:50 neon kernel: [ 878.343852] [<ffffffffa03b7ef8>] zap_cursor_retrieve+0x68/0x2e0 [zfs]
Feb 22 01:38:50 neon kernel: [ 878.343918] [<ffffffffa038f453>] ? sa_lookup_impl+0x13/0x20 [zfs]
Feb 22 01:38:50 neon kernel: [ 878.343984] [<ffffffffa038f4b0>] ? sa_bulk_lookup+0x40/0x60 [zfs]
Feb 22 01:38:50 neon kernel: [ 878.344057] [<ffffffffa03b3db1>] zap_value_search+0x91/0xd0 [zfs]
Feb 22 01:38:50 neon kernel: [ 878.344125] [<ffffffffa03e1e70>] zfs_obj_to_path_impl+0x190/0x280 [zfs]
Feb 22 01:38:50 neon kernel: [ 878.344193] [<ffffffffa038f453>] ? sa_lookup_impl+0x13/0x20 [zfs]
Feb 22 01:38:50 neon kernel: [ 878.344259] [<ffffffffa038f4b0>] ? sa_bulk_lookup+0x40/0x60 [zfs]
Feb 22 01:38:50 neon kernel: [ 878.344325] [<ffffffffa03dd9d1>] ? zfs_obj_to_stats_impl+0xa1/0xb0 [zfs]
Feb 22 01:38:50 neon kernel: [ 878.344393] [<ffffffffa03e20bb>] zfs_obj_to_stats+0xab/0xd0 [zfs]
Feb 22 01:38:50 neon kernel: [ 878.344464] [<ffffffffa03c51b4>] zfs_ioc_obj_to_stats+0x84/0xa0 [zfs]
Feb 22 01:38:50 neon kernel: [ 878.344531] [<ffffffffa03cc30d>] zfsdev_ioctl+0xdd/0x1d0 [zfs]
Feb 22 01:38:50 neon kernel: [ 878.344541] [<ffffffff811a6659>] do_vfs_ioctl+0x99/0x570
Feb 22 01:38:50 neon kernel: [ 878.344550] [<ffffffff811a6bc1>] sys_ioctl+0x91/0xb0
Feb 22 01:38:50 neon kernel: [ 878.344560] [<ffffffff816d671d>] system_call_fastpath+0x1a/0x1f
Feb 22 01:38:50 neon kernel: [ 878.344564] Code: 84 00 00 00 00 00 0f 1f 00 55 b8 00 00 01 00 48 89 e5 f0 0f c1 07 89 c1 c1 e9 10 66 39 c1 89 ca 74 11 0f 1f 80 00 00 00 00 f3 90 <0f> b7 07 66 39 d0 75 f6 5d c3 0f 1f 40 00 8b 17 55 31 c0 48 89
Feb 22 01:38:50 neon kernel: [ 878.344684] NMI backtrace for cpu 2
Feb 22 01:38:50 neon kernel: [ 878.344692] CPU 2
Feb 22 01:38:50 neon kernel: [ 878.344701] Pid: 18, comm: ksoftirqd/2 Tainted: PF W O 3.8.0-35-generic #50-Ubuntu To be filled by O.E.M. To be filled by O.E.M./SABERTOOTH 990FX R2.0
Feb 22 01:38:50 neon kernel: [ 878.344708] RIP: 0010:[<ffffffff810984d7>] [<ffffffff810984d7>] update_sd_lb_stats+0x1b7/0x5f0
Feb 22 01:38:50 neon kernel: [ 878.344722] RSP: 0018:ffff88061cdbdb30 EFLAGS: 00000093
Feb 22 01:38:50 neon kernel: [ 878.344727] RAX: 0000000000000000 RBX: 0000000000000000 RCX: 0000000000000000
Feb 22 01:38:50 neon kernel: [ 878.344732] RDX: 0000000000013ec0 RSI: 0000000000000000 RDI: 0000000000000005
Feb 22 01:38:50 neon kernel: [ 878.344737] RBP: ffff88061cdbdc00 R08: ffff88061cdef658 R09: 0000000000000000
Feb 22 01:38:50 neon kernel: [ 878.344741] R10: ffff88061cdef558 R11: 0000000000000001 R12: 0000000000000005
Feb 22 01:38:50 neon kernel: [ 878.344746] R13: 0000000000000005 R14: 0000000000000000 R15: ffff88061cdbdd48
Feb 22 01:38:50 neon kernel: [ 878.344752] FS: 00007fb09bfff700(0000) GS:ffff88063ec80000(0000) knlGS:0000000000000000
Feb 22 01:38:50 neon kernel: [ 878.344757] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
Feb 22 01:38:50 neon kernel: [ 878.344761] CR2: 00007f78640018c8 CR3: 00000005d711e000 CR4: 00000000000407e0
Feb 22 01:38:50 neon kernel: [ 878.344766] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Feb 22 01:38:50 neon kernel: [ 878.344771] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Feb 22 01:38:50 neon kernel: [ 878.344776] Process ksoftirqd/2 (pid: 18, threadinfo ffff88061cdbc000, task ffff88061cdaae80)
Feb 22 01:38:50 neon kernel: [ 878.344779] Stack:
Feb 22 01:38:50 neon kernel: [ 878.344783] 00ff88061600dd00 ffff88061cdbdddc ffff88061cdbdb98 00000000ffffffff
Feb 22 01:38:50 neon kernel: [ 878.344795] 0000000000013ec0 ffff88061cdef640 0000000000013ec0 ffff88061cdbdc10
Feb 22 01:38:50 neon kernel: [ 878.344805] ffff88061cdef658 0000000000000000 0000000000000000 0000000000000003
Feb 22 01:38:50 neon kernel: [ 878.344815] Call Trace:
Feb 22 01:38:50 neon kernel: [ 878.344828] [<ffffffff81098946>] find_busiest_group+0x36/0x490
Feb 22 01:38:50 neon kernel: [ 878.344838] [<ffffffff81098eb7>] load_balance+0x117/0x870
Feb 22 01:38:50 neon kernel: [ 878.344849] [<ffffffff81099a9a>] idle_balance+0x18a/0x300
Feb 22 01:38:50 neon kernel: [ 878.344860] [<ffffffff816ccbdf>] __schedule+0x7df/0x800
Feb 22 01:38:50 neon kernel: [ 878.344869] [<ffffffff816ccf39>] schedule+0x29/0x70
Feb 22 01:38:50 neon kernel: [ 878.344877] [<ffffffff8108609e>] smpboot_thread_fn+0xce/0x1a0
Feb 22 01:38:50 neon kernel: [ 878.344885] [<ffffffff816ccf39>] ? schedule+0x29/0x70
Feb 22 01:38:50 neon kernel: [ 878.344893] [<ffffffff81085fd0>] ? lg_global_lock+0x60/0x60
Feb 22 01:38:50 neon kernel: [ 878.344901] [<ffffffff8107d5e0>] kthread+0xc0/0xd0
Feb 22 01:38:50 neon kernel: [ 878.344910] [<ffffffff8107d520>] ? kthread_create_on_node+0x120/0x120
Feb 22 01:38:50 neon kernel: [ 878.344919] [<ffffffff816d666c>] ret_from_fork+0x7c/0xb0
Feb 22 01:38:50 neon kernel: [ 878.344927] [<ffffffff8107d520>] ? kthread_create_on_node+0x120/0x120
Feb 22 01:38:50 neon kernel: [ 878.344932] Code: 8d 48 ff ff ff 85 c0 41 0f 45 cc 89 8d 48 ff ff ff 0f 95 c1 0f b6 c9 89 8d 4c ff ff ff 8b b5 78 ff ff ff 44 89 e7 e8 09 a2 ff ff <48> 01 45 a0 48 8b b5 50 ff ff ff 44 89 e7 4a 8b 04 ed 80 63 ce
Feb 22 01:38:50 neon kernel: [ 878.345036] NMI backtrace for cpu 3
Feb 22 01:38:50 neon kernel: [ 878.345039] CPU 3
Feb 22 01:38:50 neon kernel: [ 878.345045] Pid: 73, comm: kworker/3:1 Tainted: PF W O 3.8.0-35-generic #50-Ubuntu To be filled by O.E.M. To be filled by O.E.M./SABERTOOTH 990FX R2.0
Feb 22 01:38:50 neon kernel: [ 878.345049] RIP: 0010:[<ffffffff8108c749>] [<ffffffff8108c749>] walk_tg_tree_from+0x39/0xd0
Feb 22 01:38:50 neon kernel: [ 878.345059] RSP: 0018:ffff8806161cbc50 EFLAGS: 00000083
Feb 22 01:38:50 neon kernel: [ 878.345063] RAX: ffff880501cda000 RBX: ffff880501cda000 RCX: 00000000000002a1
Feb 22 01:38:50 neon kernel: [ 878.345066] RDX: ffffffff81e51520 RSI: 0000000000000004 RDI: ffff880501cda000
Feb 22 01:38:50 neon kernel: [ 878.345070] RBP: ffff8806161cbc88 R08: 0000000000000020 R09: 0000000000000002
Feb 22 01:38:50 neon kernel: [ 878.345074] R10: 0000000000000001 R11: 0000000000000184 R12: 0000000000000004
Feb 22 01:38:50 neon kernel: [ 878.345077] R13: ffffffff81092750 R14: ffffffff81e51520 R15: 0000000000000000
Feb 22 01:38:50 neon kernel: [ 878.345082] FS: 00007fc1d49ee740(0000) GS:ffff88063ecc0000(0000) knlGS:0000000000000000
Feb 22 01:38:50 neon kernel: [ 878.345086] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
Feb 22 01:38:50 neon kernel: [ 878.345089] CR2: 00007f78600018c8 CR3: 00000005dff0c000 CR4: 00000000000407e0
Feb 22 01:38:50 neon kernel: [ 878.345093] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Feb 22 01:38:50 neon kernel: [ 878.345097] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Feb 22 01:38:50 neon kernel: [ 878.345101] Process kworker/3:1 (pid: 73, threadinfo ffff8806161ca000, task ffff88061c9add00)
Feb 22 01:38:50 neon kernel: [ 878.345104] Stack:
Feb 22 01:38:50 neon kernel: [ 878.345106] ffffffff810865c0 ffff880501cda120 ffff88061ce79400 ffff88061cdef658
Feb 22 01:38:50 neon kernel: [ 878.345112] 0000000000000492 ffff88061cdef640 0000000000000000 ffff8806161cbd98
Feb 22 01:38:50 neon kernel: [ 878.345118] ffffffff8109906c ffffffff8105ff06 ffffffff8101b5f9 0000000000013ec0
Feb 22 01:38:50 neon kernel: [ 878.345124] Call Trace:
Feb 22 01:38:50 neon kernel: [ 878.345130] [<ffffffff810865c0>] ? smpboot_park_threads+0x70/0x70
Feb 22 01:38:50 neon kernel: [ 878.345136] [<ffffffff8109906c>] load_balance+0x2cc/0x870
Feb 22 01:38:50 neon kernel: [ 878.345142] [<ffffffff8105ff06>] ? ns_to_timeval+0x16/0x40
Feb 22 01:38:50 neon kernel: [ 878.345149] [<ffffffff8101b5f9>] ? read_tsc+0x9/0x20
Feb 22 01:38:50 neon kernel: [ 878.345157] [<ffffffff81099a9a>] idle_balance+0x18a/0x300
Feb 22 01:38:50 neon kernel: [ 878.345163] [<ffffffff816ccbdf>] __schedule+0x7df/0x800
Feb 22 01:38:50 neon kernel: [ 878.345170] [<ffffffff816ccf39>] schedule+0x29/0x70
Feb 22 01:38:50 neon kernel: [ 878.345176] [<ffffffff81078307>] worker_thread+0x237/0x490
Feb 22 01:38:50 neon kernel: [ 878.345182] [<ffffffff810780d0>] ? manage_workers+0x2b0/0x2b0
Feb 22 01:38:50 neon kernel: [ 878.345187] [<ffffffff8107d5e0>] kthread+0xc0/0xd0
Feb 22 01:38:50 neon kernel: [ 878.345193] [<ffffffff8107d520>] ? kthread_create_on_node+0x120/0x120
Feb 22 01:38:50 neon kernel: [ 878.345199] [<ffffffff816d666c>] ret_from_fork+0x7c/0xb0
Feb 22 01:38:50 neon kernel: [ 878.345205] [<ffffffff8107d520>] ? kthread_create_on_node+0x120/0x120
Feb 22 01:38:50 neon kernel: [ 878.345208] Code: 89 fe 41 55 49 89 f5 41 54 49 89 cc 53 48 89 fb 48 83 ec 10 48 89 55 c8 eb 0b 0f 1f 84 00 00 00 00 00 48 89 c3 4c 89 e6 48 89 df <41> ff d5 85 c0 41 89 c7 75 6d 48 8b 83 30 01 00 00 48 8d b3 30
Feb 22 01:38:50 neon kernel: [ 878.345265] NMI backtrace for cpu 0
Feb 22 01:38:50 neon kernel: [ 878.345273] CPU 0
Feb 22 01:38:50 neon kernel: [ 878.345282] Pid: 0, comm: swapper/0 Tainted: PF W O 3.8.0-35-generic #50-Ubuntu To be filled by O.E.M. To be filled by O.E.M./SABERTOOTH 990FX R2.0
Feb 22 01:38:50 neon kernel: [ 878.345288] RIP: 0010:[<ffffffff813e3eb7>] [<ffffffff813e3eb7>] acpi_idle_do_entry+0x21/0x2b
Feb 22 01:38:50 neon kernel: [ 878.345303] RSP: 0018:ffffffff81c01e10 EFLAGS: 00000093
Feb 22 01:38:50 neon kernel: [ 878.345308] RAX: 000000cc809ba200 RBX: ffff88061cdfcca0 RCX: 000000000000c648
Feb 22 01:38:50 neon kernel: [ 878.345313] RDX: 0000000000000815 RSI: ffff88063ec00000 RDI: ffff88061cdfcca0
Feb 22 01:38:50 neon kernel: [ 878.345317] RBP: ffffffff81c01e10 R08: 0000000000006ccc R09: 0000000000000018
Feb 22 01:38:50 neon kernel: [ 878.345322] R10: 0000000000002e8e R11: 0000000000000000 R12: 0000000000000002
Feb 22 01:38:50 neon kernel: [ 878.345326] R13: ffffffff81c00000 R14: ffff88061cdfcc00 R15: ffffffff81574a50
Feb 22 01:38:50 neon kernel: [ 878.345332] FS: 00007fdb05f9d740(0000) GS:ffff88063ec00000(0000) knlGS:0000000000000000
Feb 22 01:38:50 neon kernel: [ 878.345337] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
Feb 22 01:38:50 neon kernel: [ 878.345342] CR2: 00007f460728d000 CR3: 00000005de4b0000 CR4: 00000000000407f0
Feb 22 01:38:50 neon kernel: [ 878.345346] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Feb 22 01:38:50 neon kernel: [ 878.345351] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Feb 22 01:38:50 neon kernel: [ 878.345356] Process swapper/0 (pid: 0, threadinfo ffffffff81c00000, task ffffffff81c15440)
Feb 22 01:38:50 neon kernel: [ 878.345360] Stack:
Feb 22 01:38:50 neon kernel: [ 878.345364] ffffffff81c01e40 ffffffff813e3faa ffff880616741600 ffffffff81c7e060
Feb 22 01:38:50 neon kernel: [ 878.345375] 000000ccd607e296 0000000000000002 ffffffff81c01e50 ffffffff81574a69
Feb 22 01:38:50 neon kernel: [ 878.345386] ffffffff81c01eb0 ffffffff81575499 773594000000000b ffff880616741600
Feb 22 01:38:50 neon kernel: [ 878.345396] Call Trace:
Feb 22 01:38:50 neon kernel: [ 878.345407] [<ffffffff813e3faa>] acpi_idle_enter_simple+0x87/0xc5
Feb 22 01:38:50 neon kernel: [ 878.345417] [<ffffffff81574a69>] cpuidle_enter+0x19/0x20
Feb 22 01:38:50 neon kernel: [ 878.345426] [<ffffffff81575499>] cpuidle_wrap_enter+0x49/0xa0
Feb 22 01:38:50 neon kernel: [ 878.345435] [<ffffffff81575500>] cpuidle_enter_tk+0x10/0x20
Feb 22 01:38:50 neon kernel: [ 878.345443] [<ffffffff815750e5>] cpuidle_idle_call+0xa5/0x270
Feb 22 01:38:50 neon kernel: [ 878.345453] [<ffffffff8101d62f>] cpu_idle+0xaf/0x120
Feb 22 01:38:50 neon kernel: [ 878.345462] [<ffffffff816abc32>] rest_init+0x72/0x80
Feb 22 01:38:50 neon kernel: [ 878.345472] [<ffffffff81d05be9>] start_kernel+0x3d1/0x3dc
Feb 22 01:38:50 neon kernel: [ 878.345481] [<ffffffff81d0566e>] ? do_early_param+0x8e/0x8e
Feb 22 01:38:50 neon kernel: [ 878.345491] [<ffffffff81d05355>] x86_64_start_reservations+0x130/0x133
Feb 22 01:38:50 neon kernel: [ 878.345500] [<ffffffff81d05458>] x86_64_start_kernel+0x100/0x10f
Feb 22 01:38:50 neon kernel: [ 878.345504] Code: 00 83 88 3c e0 ff ff 04 5d c3 8a 47 08 55 48 89 e5 3c 01 75 07 e8 3a 35 c5 ff eb 17 3c 02 75 07 e8 a2 ff ff ff eb 0c 8b 57 04 ec <48> 8b 15 86 e1 b2 00 ed 5d c3 66 66 66 66 90 55 48 63 c2 48 c1
Feb 22 01:38:50 neon kernel: [ 878.345610] NMI backtrace for cpu 1
Feb 22 01:38:50 neon kernel: [ 878.345614] CPU 1
Feb 22 01:38:50 neon kernel: [ 878.345619] Pid: 0, comm: swapper/1 Tainted: PF W O 3.8.0-35-generic #50-Ubuntu To be filled by O.E.M. To be filled by O.E.M./SABERTOOTH 990FX R2.0
Feb 22 01:38:50 neon kernel: [ 878.345623] RIP: 0010:[<ffffffff813e3eb7>] [<ffffffff813e3eb7>] acpi_idle_do_entry+0x21/0x2b
Feb 22 01:38:50 neon kernel: [ 878.345631] RSP: 0018:ffff88061cd83e10 EFLAGS: 00000093
Feb 22 01:38:50 neon kernel: [ 878.345635] RAX: 000000cc809b6900 RBX: ffff8806167cd4a0 RCX: 000000000000c648
Feb 22 01:38:50 neon kernel: [ 878.345648] RDX: 0000000000000815 RSI: ffff88063ec40000 RDI: ffff8806167cd4a0
Feb 22 01:38:50 neon kernel: [ 878.345661] RBP: ffff88061cd83e10 R08: 0000000000006ce3 R09: 0000000000000018
Feb 22 01:38:50 neon kernel: [ 878.345674] R10: 0000000000002e39 R11: 0000000000000000 R12: 0000000000000002
Feb 22 01:38:50 neon kernel: [ 878.345686] R13: ffff88061cd82000 R14: ffff8806167cd400 R15: ffffffff81574a50
Feb 22 01:38:50 neon kernel: [ 878.345700] FS: 00007fb0be9cf700(0000) GS:ffff88063ec40000(0000) knlGS:0000000000000000
Feb 22 01:38:50 neon kernel: [ 878.345712] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
Feb 22 01:38:50 neon kernel: [ 878.345725] CR2: 00007f87ac49f000 CR3: 00000005d711e000 CR4: 00000000000407e0
Feb 22 01:38:50 neon kernel: [ 878.345736] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Feb 22 01:38:50 neon kernel: [ 878.345748] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Feb 22 01:38:50 neon kernel: [ 878.345761] Process swapper/1 (pid: 0, threadinfo ffff88061cd82000, task ffff88061cd79740)
Feb 22 01:38:50 neon kernel: [ 878.345772] Stack:
Feb 22 01:38:50 neon kernel: [ 878.345781] ffff88061cd83e40 ffffffff813e3faa ffff880616054000 ffffffff81c7e060
Feb 22 01:38:50 neon kernel: [ 878.345788] 000000ccd607a828 0000000000000002 ffff88061cd83e50 ffffffff81574a69
Feb 22 01:38:50 neon kernel: [ 878.345795] ffff88061cd83eb0 ffffffff81575499 7735940000000001 ffff880616054000
Feb 22 01:38:50 neon kernel: [ 878.345801] Call Trace:
Feb 22 01:38:50 neon kernel: [ 878.345808] [<ffffffff813e3faa>] acpi_idle_enter_simple+0x87/0xc5
Feb 22 01:38:50 neon kernel: [ 878.345815] [<ffffffff81574a69>] cpuidle_enter+0x19/0x20
Feb 22 01:38:50 neon kernel: [ 878.345821] [<ffffffff81575499>] cpuidle_wrap_enter+0x49/0xa0
Feb 22 01:38:50 neon kernel: [ 878.345827] [<ffffffff81575500>] cpuidle_enter_tk+0x10/0x20
Feb 22 01:38:50 neon kernel: [ 878.345833] [<ffffffff815750e5>] cpuidle_idle_call+0xa5/0x270
Feb 22 01:38:50 neon kernel: [ 878.345839] [<ffffffff8101d62f>] cpu_idle+0xaf/0x120
Feb 22 01:38:50 neon kernel: [ 878.345845] [<ffffffff816b7620>] start_secondary+0x1e0/0x1e5
Feb 22 01:38:50 neon kernel: [ 878.345849] Code: 00 83 88 3c e0 ff ff 04 5d c3 8a 47 08 55 48 89 e5 3c 01 75 07 e8 3a 35 c5 ff eb 17 3c 02 75 07 e8 a2 ff ff ff eb 0c 8b 57 04 ec <48> 8b 15 86 e1 b2 00 ed 5d c3 66 66 66 66 90 55 48 63 c2 48 c1
Feb 22 01:38:59 neon rtkit-daemon[3933]: The canary thread is apparently starving. Taking action.
Feb 22 01:38:59 neon rtkit-daemon[3933]: Demoting known real-time threads.
Feb 22 01:38:59 neon rtkit-daemon[3933]: Successfully demoted thread 4021 of process 3931 (n/a).
Feb 22 01:38:59 neon rtkit-daemon[3933]: Successfully demoted thread 4015 of process 3931 (n/a).
Feb 22 01:38:59 neon rtkit-daemon[3933]: Successfully demoted thread 4000 of process 3931 (n/a).
Feb 22 01:38:59 neon rtkit-daemon[3933]: Successfully demoted thread 3931 of process 3931 (n/a).
Feb 22 01:38:59 neon rtkit-daemon[3933]: Demoted 4 threads.
Feb 22 01:39:09 neon rtkit-daemon[3933]: The canary thread is apparently starving. Taking action.
Feb 22 01:39:09 neon rtkit-daemon[3933]: Demoting known real-time threads.
Feb 22 01:39:09 neon rtkit-daemon[3933]: Successfully demoted thread 4021 of process 3931 (n/a).
Feb 22 01:39:09 neon rtkit-daemon[3933]: Successfully demoted thread 4015 of process 3931 (n/a).
Feb 22 01:39:09 neon rtkit-daemon[3933]: Successfully demoted thread 4000 of process 3931 (n/a).
Feb 22 01:39:09 neon rtkit-daemon[3933]: Successfully demoted thread 3931 of process 3931 (n/a).
Feb 22 01:39:09 neon rtkit-daemon[3933]: Demoted 4 threads.
Feb 22 01:39:19 neon rtkit-daemon[3933]: The canary thread is apparently starving. Taking action.
Feb 22 01:39:19 neon rtkit-daemon[3933]: Demoting known real-time threads.
Feb 22 01:39:19 neon rtkit-daemon[3933]: Successfully demoted thread 4021 of process 3931 (n/a).
Feb 22 01:39:19 neon rtkit-daemon[3933]: Successfully demoted thread 4015 of process 3931 (n/a).
Feb 22 01:39:19 neon rtkit-daemon[3933]: Successfully demoted thread 4000 of process 3931 (n/a).
Feb 22 01:39:19 neon rtkit-daemon[3933]: Successfully demoted thread 3931 of process 3931 (n/a).
Feb 22 01:39:19 neon rtkit-daemon[3933]: Demoted 4 threads.
Feb 22 01:39:29 neon rtkit-daemon[3933]: The canary thread is apparently starving. Taking action.
Feb 22 01:39:29 neon rtkit-daemon[3933]: Demoting known real-time threads.
Feb 22 01:39:29 neon rtkit-daemon[3933]: Successfully demoted thread 4021 of process 3931 (n/a).
Feb 22 01:39:29 neon rtkit-daemon[3933]: Successfully demoted thread 4015 of process 3931 (n/a).
Feb 22 01:39:29 neon rtkit-daemon[3933]: Successfully demoted thread 4000 of process 3931 (n/a).
Feb 22 01:39:29 neon rtkit-daemon[3933]: Successfully demoted thread 3931 of process 3931 (n/a).
Feb 22 01:39:29 neon rtkit-daemon[3933]: Demoted 4 threads.
Feb 22 01:39:39 neon rtkit-daemon[3933]: The canary thread is apparently starving. Taking action.
Feb 22 01:39:39 neon rtkit-daemon[3933]: Demoting known real-time threads.
Feb 22 01:39:39 neon rtkit-daemon[3933]: Successfully demoted thread 4021 of process 3931 (n/a).
Feb 22 01:39:39 neon rtkit-daemon[3933]: Successfully demoted thread 4015 of process 3931 (n/a).
Feb 22 01:39:39 neon rtkit-daemon[3933]: Successfully demoted thread 4000 of process 3931 (n/a).
Feb 22 01:39:39 neon rtkit-daemon[3933]: Successfully demoted thread 3931 of process 3931 (n/a).
Feb 22 01:39:39 neon rtkit-daemon[3933]: Demoted 4 threads.
Feb 22 01:39:49 neon rtkit-daemon[3933]: The canary thread is apparently starving. Taking action.
Feb 22 01:39:49 neon rtkit-daemon[3933]: Demoting known real-time threads.
Feb 22 01:39:49 neon rtkit-daemon[3933]: Successfully demoted thread 4021 of process 3931 (n/a).
Feb 22 01:39:49 neon rtkit-daemon[3933]: Successfully demoted thread 4015 of process 3931 (n/a).
Feb 22 01:39:49 neon rtkit-daemon[3933]: Successfully demoted thread 4000 of process 3931 (n/a).
Feb 22 01:39:49 neon rtkit-daemon[3933]: Successfully demoted thread 3931 of process 3931 (n/a).
Feb 22 01:39:49 neon rtkit-daemon[3933]: Demoted 4 threads.
Feb 22 01:39:59 neon rtkit-daemon[3933]: The canary thread is apparently starving. Taking action.
Feb 22 01:39:59 neon rtkit-daemon[3933]: Demoting known real-time threads.
Feb 22 01:39:59 neon rtkit-daemon[3933]: Successfully demoted thread 4021 of process 3931 (n/a).
Feb 22 01:39:59 neon rtkit-daemon[3933]: Successfully demoted thread 4015 of process 3931 (n/a).
Feb 22 01:39:59 neon rtkit-daemon[3933]: Successfully demoted thread 4000 of process 3931 (n/a).
Feb 22 01:39:59 neon rtkit-daemon[3933]: Successfully demoted thread 3931 of process 3931 (n/a).
Feb 22 01:39:59 neon rtkit-daemon[3933]: Demoted 4 threads.
Feb 22 01:40:01 neon CRON[8532]: (munin) CMD (if [ -x /usr/bin/munin-cron ]; then /usr/bin/munin-cron; fi)
Feb 22 01:40:01 neon CRON[8533]: (root) CMD (if [ -x /etc/munin/plugins/apt_all ]; then /etc/munin/plugins/apt_all update 7200 12 >/dev/null; elif [ -x /etc/munin/plugins/apt ]; then /etc/munin/plugins/apt update 7200 12 >/dev/null; fi)
Feb 22 01:40:09 neon rtkit-daemon[3933]: The canary thread is apparently starving. Taking action.
Feb 22 01:40:09 neon rtkit-daemon[3933]: Demoting known real-time threads.
Feb 22 01:40:09 neon rtkit-daemon[3933]: Successfully demoted thread 4021 of process 3931 (n/a).
Feb 22 01:40:09 neon rtkit-daemon[3933]: Successfully demoted thread 4015 of process 3931 (n/a).
Feb 22 01:40:09 neon rtkit-daemon[3933]: Successfully demoted thread 4000 of process 3931 (n/a).
Feb 22 01:40:09 neon rtkit-daemon[3933]: Successfully demoted thread 3931 of process 3931 (n/a).
Feb 22 01:40:09 neon rtkit-daemon[3933]: Demoted 4 threads.
Feb 22 01:40:19 neon rtkit-daemon[3933]: The canary thread is apparently starving. Taking action.
Feb 22 01:40:19 neon rtkit-daemon[3933]: Demoting known real-time threads.
Feb 22 01:40:19 neon rtkit-daemon[3933]: Successfully demoted thread 4021 of process 3931 (n/a).
Feb 22 01:40:19 neon rtkit-daemon[3933]: Successfully demoted thread 4015 of process 3931 (n/a).
Feb 22 01:40:19 neon rtkit-daemon[3933]: Successfully demoted thread 4000 of process 3931 (n/a).
Feb 22 01:40:19 neon rtkit-daemon[3933]: Successfully demoted thread 3931 of process 3931 (n/a).
Feb 22 01:40:19 neon rtkit-daemon[3933]: Demoted 4 threads.
Feb 22 01:40:29 neon rtkit-daemon[3933]: The canary thread is apparently starving. Taking action.
Feb 22 01:40:29 neon rtkit-daemon[3933]: Demoting known real-time threads.
Feb 22 01:40:29 neon rtkit-daemon[3933]: Successfully demoted thread 4021 of process 3931 (n/a).
Feb 22 01:40:29 neon rtkit-daemon[3933]: Successfully demoted thread 4015 of process 3931 (n/a).
Feb 22 01:40:29 neon rtkit-daemon[3933]: Successfully demoted thread 4000 of process 3931 (n/a).
Feb 22 01:40:29 neon rtkit-daemon[3933]: Successfully demoted thread 3931 of process 3931 (n/a).
Feb 22 01:40:29 neon rtkit-daemon[3933]: Demoted 4 threads.
Feb 22 01:40:39 neon rtkit-daemon[3933]: The canary thread is apparently starving. Taking action.
Feb 22 01:40:39 neon rtkit-daemon[3933]: Demoting known real-time threads.
Feb 22 01:40:39 neon rtkit-daemon[3933]: Successfully demoted thread 4021 of process 3931 (n/a).
Feb 22 01:40:39 neon rtkit-daemon[3933]: Successfully demoted thread 4015 of process 3931 (n/a).
Feb 22 01:40:39 neon rtkit-daemon[3933]: Successfully demoted thread 4000 of process 3931 (n/a).
Feb 22 01:40:39 neon rtkit-daemon[3933]: Successfully demoted thread 3931 of process 3931 (n/a).
Feb 22 01:40:39 neon rtkit-daemon[3933]: Demoted 4 threads.
Feb 22 01:40:49 neon rtkit-daemon[3933]: The canary thread is apparently starving. Taking action.
Feb 22 01:40:49 neon rtkit-daemon[3933]: Demoting known real-time threads.
Feb 22 01:40:49 neon rtkit-daemon[3933]: Successfully demoted thread 4021 of process 3931 (n/a).
Feb 22 01:40:49 neon rtkit-daemon[3933]: Successfully demoted thread 4015 of process 3931 (n/a).
Feb 22 01:40:49 neon rtkit-daemon[3933]: Successfully demoted thread 4000 of process 3931 (n/a).
Feb 22 01:40:49 neon rtkit-daemon[3933]: Successfully demoted thread 3931 of process 3931 (n/a).
Feb 22 01:40:49 neon rtkit-daemon[3933]: Demoted 4 threads.
Feb 22 01:40:59 neon rtkit-daemon[3933]: The canary thread is apparently starving. Taking action.
Feb 22 01:40:59 neon rtkit-daemon[3933]: Demoting known real-time threads.
Feb 22 01:40:59 neon rtkit-daemon[3933]: Successfully demoted thread 4021 of process 3931 (n/a).
Feb 22 01:40:59 neon rtkit-daemon[3933]: Successfully demoted thread 4015 of process 3931 (n/a).
Feb 22 01:40:59 neon rtkit-daemon[3933]: Successfully demoted thread 4000 of process 3931 (n/a).
Feb 22 01:40:59 neon rtkit-daemon[3933]: Successfully demoted thread 3931 of process 3931 (n/a).
Feb 22 01:40:59 neon rtkit-daemon[3933]: Demoted 4 threads.
Feb 22 01:41:09 neon rtkit-daemon[3933]: The canary thread is apparently starving. Taking action.
Feb 22 01:41:09 neon rtkit-daemon[3933]: Demoting known real-time threads.
Feb 22 01:41:09 neon rtkit-daemon[3933]: Successfully demoted thread 4021 of process 3931 (n/a).
Feb 22 01:41:09 neon rtkit-daemon[3933]: Successfully demoted thread 4015 of process 3931 (n/a).
Feb 22 01:41:09 neon rtkit-daemon[3933]: Successfully demoted thread 4000 of process 3931 (n/a).
Feb 22 01:41:09 neon rtkit-daemon[3933]: Successfully demoted thread 3931 of process 3931 (n/a).
Feb 22 01:41:09 neon rtkit-daemon[3933]: Demoted 4 threads.
Feb 22 01:41:19 neon rtkit-daemon[3933]: The canary thread is apparently starving. Taking action.
Feb 22 01:41:19 neon rtkit-daemon[3933]: Demoting known real-time threads.
Feb 22 01:41:19 neon rtkit-daemon[3933]: Successfully demoted thread 4021 of process 3931 (n/a).
Feb 22 01:41:19 neon rtkit-daemon[3933]: Successfully demoted thread 4015 of process 3931 (n/a).
Feb 22 01:41:19 neon rtkit-daemon[3933]: Successfully demoted thread 4000 of process 3931 (n/a).
Feb 22 01:41:19 neon rtkit-daemon[3933]: Successfully demoted thread 3931 of process 3931 (n/a).
Feb 22 01:41:19 neon rtkit-daemon[3933]: Demoted 4 threads.
Feb 22 01:41:29 neon rtkit-daemon[3933]: The canary thread is apparently starving. Taking action.
Feb 22 01:41:29 neon rtkit-daemon[3933]: Demoting known real-time threads.
Feb 22 01:41:29 neon rtkit-daemon[3933]: Successfully demoted thread 4021 of process 3931 (n/a).
Feb 22 01:41:29 neon rtkit-daemon[3933]: Successfully demoted thread 4015 of process 3931 (n/a).
Feb 22 01:41:29 neon rtkit-daemon[3933]: Successfully demoted thread 4000 of process 3931 (n/a).
Feb 22 01:41:29 neon rtkit-daemon[3933]: Successfully demoted thread 3931 of process 3931 (n/a).
Feb 22 01:41:29 neon rtkit-daemon[3933]: Demoted 4 threads.
Feb 22 01:41:39 neon rtkit-daemon[3933]: The canary thread is apparently starving. Taking action.
Feb 22 01:41:39 neon rtkit-daemon[3933]: Demoting known real-time threads.
Feb 22 01:41:39 neon rtkit-daemon[3933]: Successfully demoted thread 4021 of process 3931 (n/a).
Feb 22 01:41:39 neon rtkit-daemon[3933]: Successfully demoted thread 4015 of process 3931 (n/a).
Feb 22 01:41:39 neon rtkit-daemon[3933]: Successfully demoted thread 4000 of process 3931 (n/a).
Feb 22 01:41:39 neon rtkit-daemon[3933]: Successfully demoted thread 3931 of process 3931 (n/a).
Feb 22 01:41:39 neon rtkit-daemon[3933]: Demoted 4 threads.
Feb 22 01:41:45 neon kernel: [ 1052.899219] nfs: server 192.168.68.254 not responding, timed out
Feb 22 01:41:49 neon rtkit-daemon[3933]: The canary thread is apparently starving. Taking action.
Feb 22 01:41:49 neon rtkit-daemon[3933]: Demoting known real-time threads.
Feb 22 01:41:49 neon rtkit-daemon[3933]: Successfully demoted thread 4021 of process 3931 (n/a).
Feb 22 01:41:49 neon rtkit-daemon[3933]: Successfully demoted thread 4015 of process 3931 (n/a).
Feb 22 01:41:49 neon rtkit-daemon[3933]: Successfully demoted thread 4000 of process 3931 (n/a).
Feb 22 01:41:49 neon rtkit-daemon[3933]: Successfully demoted thread 3931 of process 3931 (n/a).
Feb 22 01:41:49 neon rtkit-daemon[3933]: Demoted 4 threads.
Feb 22 01:41:50 neon kernel: [ 1057.996807] INFO: rcu_sched detected stalls on CPUs/tasks: { 4} (detected by 2, t=150017 jiffies, g=46247, c=46246, q=119174)
Feb 22 01:41:50 neon kernel: [ 1057.996819] sending NMI to all CPUs:
Feb 22 01:41:50 neon kernel: [ 1057.996839] NMI backtrace for cpu 4
Feb 22 01:41:50 neon kernel: [ 1057.996846] CPU 4
Feb 22 01:41:50 neon kernel: [ 1057.996857] Pid: 7557, comm: zfs Tainted: PF W O 3.8.0-35-generic #50-Ubuntu To be filled by O.E.M. To be filled by O.E.M./SABERTOOTH 990FX R2.0
Feb 22 01:41:50 neon kernel: [ 1057.996863] RIP: 0010:[<ffffffff81044ac2>] [<ffffffff81044ac2>] __ticket_spin_lock+0x22/0x30
Feb 22 01:41:50 neon kernel: [ 1057.996879] RSP: 0018:ffff88055774b988 EFLAGS: 00000006
Feb 22 01:41:50 neon kernel: [ 1057.996884] RAX: 0000000000002d4b RBX: ffff8805d5af1740 RCX: 0000000000000000
Feb 22 01:41:50 neon kernel: [ 1057.996889] RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff880503870848
Feb 22 01:41:50 neon kernel: [ 1057.996893] RBP: ffff88055774b988 R08: 0000000000016d40 R09: ffff88063ed16d40
Feb 22 01:41:50 neon kernel: [ 1057.996898] R10: ffffea001776c200 R11: ffffffffa02cb83b R12: ffff880503870840
Feb 22 01:41:50 neon kernel: [ 1057.996903] R13: ffff880503870848 R14: ffffffffffffffff R15: 0000000000000001
Feb 22 01:41:50 neon kernel: [ 1057.996909] FS: 00007fbe10597700(0000) GS:ffff88063ed00000(0000) knlGS:0000000000000000
Feb 22 01:41:50 neon kernel: [ 1057.996914] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Feb 22 01:41:50 neon kernel: [ 1057.996919] CR2: 0000000001d8efe0 CR3: 00000005a4493000 CR4: 00000000000407e0
Feb 22 01:41:50 neon kernel: [ 1057.996923] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Feb 22 01:41:50 neon kernel: [ 1057.996928] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Feb 22 01:41:50 neon kernel: [ 1057.996934] Process zfs (pid: 7557, threadinfo ffff88055774a000, task ffff8805d5af1740)
Feb 22 01:41:50 neon kernel: [ 1057.996937] Stack:
Feb 22 01:41:50 neon kernel: [ 1057.996941] ffff88055774b998 ffffffff816cde65 ffff88055774ba00 ffffffff816cdca6
Feb 22 01:41:50 neon kernel: [ 1057.996953] 0000000000000000 0000000000000000 000000005774ba00 ffffffff00000000
Feb 22 01:41:50 neon kernel: [ 1057.996963] ffffffff816cb7ad ffff880503b22248 ffff880503870840 0000000000000002
Feb 22 01:41:50 neon kernel: [ 1057.996974] Call Trace:
Feb 22 01:41:50 neon kernel: [ 1057.996986] [<ffffffff816cde65>] _raw_spin_lock_irq+0x15/0x20
Feb 22 01:41:50 neon kernel: [ 1057.996995] [<ffffffff816cdca6>] rwsem_down_failed_common+0x46/0x170
Feb 22 01:41:50 neon kernel: [ 1057.997004] [<ffffffff816cb7ad>] ? mutex_lock+0x1d/0x50
Feb 22 01:41:50 neon kernel: [ 1057.997013] [<ffffffff816cde05>] rwsem_down_read_failed+0x15/0x17
Feb 22 01:41:50 neon kernel: [ 1057.997022] [<ffffffff813555d4>] call_rwsem_down_read_failed+0x14/0x30
Feb 22 01:41:50 neon kernel: [ 1057.997065] [<ffffffffa02cb83b>] ? kmem_free_debug+0x4b/0x150 [spl]
Feb 22 01:41:50 neon kernel: [ 1057.997079] [<ffffffff816cc0e0>] ? down_read+0x20/0x23
Feb 22 01:41:50 neon kernel: [ 1057.997162] [<ffffffffa03b28f0>] zap_get_leaf_byblk+0xd0/0x2c0 [zfs]
Feb 22 01:41:50 neon kernel: [ 1057.997231] [<ffffffffa03b22f3>] ? zap_idx_to_blk+0x133/0x140 [zfs]
Feb 22 01:41:50 neon kernel: [ 1057.997301] [<ffffffffa03b2b4d>] zap_deref_leaf+0x6d/0x80 [zfs]
Feb 22 01:41:50 neon kernel: [ 1057.997370] [<ffffffffa03b46d1>] fzap_cursor_retrieve+0xe1/0x280 [zfs]
Feb 22 01:41:50 neon kernel: [ 1057.997440] [<ffffffffa03b7ef8>] zap_cursor_retrieve+0x68/0x2e0 [zfs]
Feb 22 01:41:50 neon kernel: [ 1057.997506] [<ffffffffa038f453>] ? sa_lookup_impl+0x13/0x20 [zfs]
Feb 22 01:41:50 neon kernel: [ 1057.997573] [<ffffffffa038f4b0>] ? sa_bulk_lookup+0x40/0x60 [zfs]
Feb 22 01:41:50 neon kernel: [ 1057.997647] [<ffffffffa03b3db1>] zap_value_search+0x91/0xd0 [zfs]
Feb 22 01:41:50 neon kernel: [ 1057.997716] [<ffffffffa03e1e70>] zfs_obj_to_path_impl+0x190/0x280 [zfs]
Feb 22 01:41:50 neon kernel: [ 1057.997784] [<ffffffffa038f453>] ? sa_lookup_impl+0x13/0x20 [zfs]
Feb 22 01:41:50 neon kernel: [ 1057.997850] [<ffffffffa038f4b0>] ? sa_bulk_lookup+0x40/0x60 [zfs]
Feb 22 01:41:50 neon kernel: [ 1057.997917] [<ffffffffa03dd9d1>] ? zfs_obj_to_stats_impl+0xa1/0xb0 [zfs]
Feb 22 01:41:50 neon kernel: [ 1057.997987] [<ffffffffa03e20bb>] zfs_obj_to_stats+0xab/0xd0 [zfs]
Feb 22 01:41:50 neon kernel: [ 1057.998059] [<ffffffffa03c51b4>] zfs_ioc_obj_to_stats+0x84/0xa0 [zfs]
Feb 22 01:41:50 neon kernel: [ 1057.998130] [<ffffffffa03cc30d>] zfsdev_ioctl+0xdd/0x1d0 [zfs]
Feb 22 01:41:50 neon kernel: [ 1057.998139] [<ffffffff811a6659>] do_vfs_ioctl+0x99/0x570
Feb 22 01:41:50 neon kernel: [ 1057.998148] [<ffffffff811a6bc1>] sys_ioctl+0x91/0xb0
Feb 22 01:41:50 neon kernel: [ 1057.998158] [<ffffffff816d671d>] system_call_fastpath+0x1a/0x1f
Feb 22 01:41:50 neon kernel: [ 1057.998162] Code: 84 00 00 00 00 00 0f 1f 00 55 b8 00 00 01 00 48 89 e5 f0 0f c1 07 89 c1 c1 e9 10 66 39 c1 89 ca 74 11 0f 1f 80 00 00 00 00 f3 90 <0f> b7 07 66 39 d0 75 f6 5d c3 0f 1f 40 00 8b 17 55 31 c0 48 89
Feb 22 01:41:50 neon kernel: [ 1057.998268] NMI backtrace for cpu 5
Feb 22 01:41:50 neon kernel: [ 1057.998272] CPU 5
Feb 22 01:41:50 neon kernel: [ 1057.998279] Pid: 0, comm: swapper/5 Tainted: PF W O 3.8.0-35-generic #50-Ubuntu To be filled by O.E.M. To be filled by O.E.M./SABERTOOTH 990FX R2.0
Feb 22 01:41:50 neon kernel: [ 1057.998284] RIP: 0010:[<ffffffff813e3eb7>] [<ffffffff813e3eb7>] acpi_idle_do_entry+0x21/0x2b
Feb 22 01:41:50 neon kernel: [ 1057.998295] RSP: 0018:ffff88061cd8be10 EFLAGS: 00000093
Feb 22 01:41:50 neon kernel: [ 1057.998300] RAX: 000000f6554ae900 RBX: ffff88062600e0a0 RCX: 000000000000c648
Feb 22 01:41:50 neon kernel: [ 1057.998304] RDX: 0000000000000815 RSI: ffff88063ed40000 RDI: ffff88062600e0a0
Feb 22 01:41:50 neon kernel: [ 1057.998309] RBP: ffff88061cd8be10 R08: 0000000000002e77 R09: 0000000000000018
Feb 22 01:41:50 neon kernel: [ 1057.998313] R10: 0000000000003e40 R11: 0000000000000000 R12: 0000000000000002
Feb 22 01:41:50 neon kernel: [ 1057.998317] R13: ffff88061cd8a000 R14: ffff88062600e000 R15: ffffffff81574a50
Feb 22 01:41:50 neon kernel: [ 1057.998323] FS: 00007fc8b9ffb700(0000) GS:ffff88063ed40000(0000) knlGS:0000000000000000
Feb 22 01:41:50 neon kernel: [ 1057.998328] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
Feb 22 01:41:50 neon kernel: [ 1057.998332] CR2: 00007fb0d4b0e000 CR3: 00000005d5a57000 CR4: 00000000000407e0
Feb 22 01:41:50 neon kernel: [ 1057.998337] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Feb 22 01:41:50 neon kernel: [ 1057.998341] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Feb 22 01:41:50 neon kernel: [ 1057.998346] Process swapper/5 (pid: 0, threadinfo ffff88061cd8a000, task ffff88061cd90000)
Feb 22 01:41:50 neon kernel: [ 1057.998349] Stack:
Feb 22 01:41:50 neon kernel: [ 1057.998353] ffff88061cd8be40 ffffffff813e3faa ffff88061607a000 ffffffff81c7e060
Feb 22 01:41:50 neon kernel: [ 1057.998363] 000000f6c0887ed8 0000000000000002 ffff88061cd8be50 ffffffff81574a69
Feb 22 01:41:50 neon kernel: [ 1057.998374] ffff88061cd8beb0 ffffffff81575499 7735940000000001 ffff88061607a000
Feb 22 01:41:50 neon kernel: [ 1057.998384] Call Trace:
Feb 22 01:41:50 neon kernel: [ 1057.998393] [<ffffffff813e3faa>] acpi_idle_enter_simple+0x87/0xc5
Feb 22 01:41:50 neon kernel: [ 1057.998403] [<ffffffff81574a69>] cpuidle_enter+0x19/0x20
Feb 22 01:41:50 neon kernel: [ 1057.998411] [<ffffffff81575499>] cpuidle_wrap_enter+0x49/0xa0
Feb 22 01:41:50 neon kernel: [ 1057.998420] [<ffffffff81575500>] cpuidle_enter_tk+0x10/0x20
Feb 22 01:41:50 neon kernel: [ 1057.998428] [<ffffffff815750e5>] cpuidle_idle_call+0xa5/0x270
Feb 22 01:41:50 neon kernel: [ 1057.998437] [<ffffffff8101d62f>] cpu_idle+0xaf/0x120
Feb 22 01:41:50 neon kernel: [ 1057.998445] [<ffffffff816b7620>] start_secondary+0x1e0/0x1e5
Feb 22 01:41:50 neon kernel: [ 1057.998451] Code: 00 83 88 3c e0 ff ff 04 5d c3 8a 47 08 55 48 89 e5 3c 01 75 07 e8 3a 35 c5 ff eb 17 3c 02 75 07 e8 a2 ff ff ff eb 0c 8b 57 04 ec <48> 8b 15 86 e1 b2 00 ed 5d c3 66 66 66 66 90 55 48 63 c2 48 c1
Feb 22 01:41:50 neon kernel: [ 1057.998556] NMI backtrace for cpu 3
Feb 22 01:41:50 neon kernel: [ 1057.998561] CPU 3
Feb 22 01:41:50 neon kernel: [ 1057.998570] Pid: 0, comm: swapper/3 Tainted: PF W O 3.8.0-35-generic #50-Ubuntu To be filled by O.E.M. To be filled by O.E.M./SABERTOOTH 990FX R2.0
Feb 22 01:41:50 neon kernel: [ 1057.998576] RIP: 0010:[<ffffffff81043fa6>] [<ffffffff81043fa6>] native_safe_halt+0x6/0x10
Feb 22 01:41:50 neon kernel: [ 1057.998591] RSP: 0018:ffff88061cd87de8 EFLAGS: 00000246
Feb 22 01:41:50 neon kernel: [ 1057.998596] RAX: 0000000000000000 RBX: ffff88061cdfd46c RCX: ffffffff81c7e060
Feb 22 01:41:50 neon kernel: [ 1057.998600] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffff88061cdfd46c
Feb 22 01:41:50 neon kernel: [ 1057.998605] RBP: ffff88061cd87de8 R08: 0000000000003e2e R09: 000000000000001c
Feb 22 01:41:50 neon kernel: [ 1057.998610] R10: 0000000000002e86 R11: 0000000000000000 R12: 0000000000000001
Feb 22 01:41:50 neon kernel: [ 1057.998614] R13: ffff88061cdfd400 R14: 0000000000000001 R15: ffffffff81574a50
Feb 22 01:41:50 neon kernel: [ 1057.998620] FS: 00007fdb05f9d740(0000) GS:ffff88063ecc0000(0000) knlGS:0000000000000000
Feb 22 01:41:50 neon kernel: [ 1057.998625] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
Feb 22 01:41:50 neon kernel: [ 1057.998630] CR2: 00007f781c0018c8 CR3: 00000005de4b0000 CR4: 00000000000407e0
Feb 22 01:41:50 neon kernel: [ 1057.998635] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Feb 22 01:41:50 neon kernel: [ 1057.998640] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Feb 22 01:41:50 neon kernel: [ 1057.998645] Process swapper/3 (pid: 0, threadinfo ffff88061cd86000, task ffff88061cd7c5c0)
Feb 22 01:41:50 neon kernel: [ 1057.998649] Stack:
Feb 22 01:41:50 neon kernel: [ 1057.998652] ffff88061cd87df8 ffffffff813e3769 ffff88061cd87e08 ffffffff813e3e7d
Feb 22 01:41:50 neon kernel: [ 1057.998664] ffff88061cd87e18 ffffffff813e3eb1 ffff88061cd87e40 ffffffff813e3f04
Feb 22 01:41:50 neon kernel: [ 1057.998674] ffff880616078000 ffffffff81c7e060 000000f6c0882c71 ffff88061cd87e50
Feb 22 01:41:50 neon kernel: [ 1057.998685] Call Trace:
Feb 22 01:41:50 neon kernel: [ 1057.998697] [<ffffffff813e3769>] arch_safe_halt+0x9/0xd
Feb 22 01:41:50 neon kernel: [ 1057.998705] [<ffffffff813e3e7d>] acpi_safe_halt+0x2a/0x43
Feb 22 01:41:50 neon kernel: [ 1057.998714] [<ffffffff813e3eb1>] acpi_idle_do_entry+0x1b/0x2b
Feb 22 01:41:50 neon kernel: [ 1057.998722] [<ffffffff813e3f04>] acpi_idle_enter_c1+0x43/0x62
Feb 22 01:41:50 neon kernel: [ 1057.998732] [<ffffffff81574a69>] cpuidle_enter+0x19/0x20
Feb 22 01:41:50 neon kernel: [ 1057.998740] [<ffffffff81575499>] cpuidle_wrap_enter+0x49/0xa0
Feb 22 01:41:50 neon kernel: [ 1057.998749] [<ffffffff81575500>] cpuidle_enter_tk+0x10/0x20
Feb 22 01:41:50 neon kernel: [ 1057.998757] [<ffffffff815750e5>] cpuidle_idle_call+0xa5/0x270
Feb 22 01:41:50 neon kernel: [ 1057.998767] [<ffffffff8101d62f>] cpu_idle+0xaf/0x120
Feb 22 01:41:50 neon kernel: [ 1057.998776] [<ffffffff816b7620>] start_secondary+0x1e0/0x1e5
Feb 22 01:41:50 neon kernel: [ 1057.998781] Code: 00 00 00 00 00 55 48 89 e5 fa 5d c3 66 0f 1f 84 00 00 00 00 00 55 48 89 e5 fb 5d c3 66 0f 1f 84 00 00 00 00 00 55 48 89 e5 fb f4 <5d> c3 0f 1f 84 00 00 00 00 00 55 48 89 e5 f4 5d c3 66 0f 1f 84
Feb 22 01:41:50 neon kernel: [ 1057.998889] NMI backtrace for cpu 2
Feb 22 01:41:50 neon kernel: [ 1057.998892] CPU 2
Feb 22 01:41:50 neon kernel: [ 1057.998898] Pid: 0, comm: swapper/2 Tainted: PF W O 3.8.0-35-generic #50-Ubuntu To be filled by O.E.M. To be filled by O.E.M./SABERTOOTH 990FX R2.0
Feb 22 01:41:50 neon kernel: [ 1057.998901] RIP: 0010:[<ffffffff81354172>] [<ffffffff81354172>] __const_udelay+0x12/0x30
Feb 22 01:41:50 neon kernel: [ 1057.998908] RSP: 0018:ffff88063ec83dd8 EFLAGS: 00000046
Feb 22 01:41:50 neon kernel: [ 1057.998911] RAX: 0000000001062560 RBX: 0000000000002710 RCX: 0000000000000004
Feb 22 01:41:50 neon kernel: [ 1057.998914] RDX: 0000000000d656b0 RSI: 0000000000000100 RDI: 0000000000418958
Feb 22 01:41:50 neon kernel: [ 1057.998917] RBP: ffff88063ec83df0 R08: 000000000000000a R09: 0000000000000000
Feb 22 01:41:50 neon kernel: [ 1057.998919] R10: 000000000000072f R11: 0000000000000002 R12: ffffffff81ce70c0
Feb 22 01:41:50 neon kernel: [ 1057.998922] R13: ffff88063ec8ee60 R14: ffffffff81c3f3c0 R15: ffffffff81c3f480
Feb 22 01:41:50 neon kernel: [ 1057.998926] FS: 00007fc1d49ee740(0000) GS:ffff88063ec80000(0000) knlGS:0000000000000000
Feb 22 01:41:50 neon kernel: [ 1057.998929] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
Feb 22 01:41:50 neon kernel: [ 1057.998932] CR2: 00007f78297f9fb8 CR3: 00000005dff0c000 CR4: 00000000000407e0
Feb 22 01:41:50 neon kernel: [ 1057.998935] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Feb 22 01:41:50 neon kernel: [ 1057.998938] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Feb 22 01:41:50 neon kernel: [ 1057.998941] Process swapper/2 (pid: 0, threadinfo ffff88061cd84000, task ffff88061cd7ae80)
Feb 22 01:41:50 neon kernel: [ 1057.998943] Stack:
Feb 22 01:41:50 neon kernel: [ 1057.998945] ffff88063ec83df0 ffffffff81039d6a ffffffff81c3f3c0 ffff88063ec83e50
Feb 22 01:41:50 neon kernel: [ 1057.998952] ffffffff810f2935 000000000001d186 0000000000000082 0000000100000086
Feb 22 01:41:50 neon kernel: [ 1057.998958] 0000000000000002 ffff88061cd84000 ffff88061cd7ae80 0000000000000002
Feb 22 01:41:50 neon kernel: [ 1057.998964] Call Trace:
Feb 22 01:41:50 neon kernel: [ 1057.998966] <IRQ>
Feb 22 01:41:50 neon kernel: [ 1057.998969] [<ffffffff81039d6a>] ? arch_trigger_all_cpu_backtrace+0x6a/0x90
Feb 22 01:41:50 neon kernel: [ 1057.998981] [<ffffffff810f2935>] rcu_pending+0x565/0x5b0
Feb 22 01:41:50 neon kernel: [ 1057.998988] [<ffffffff810f4a0b>] rcu_check_callbacks+0x9b/0x120
Feb 22 01:41:50 neon kernel: [ 1057.998995] [<ffffffff8106a928>] update_process_times+0x48/0x90
Feb 22 01:41:50 neon kernel: [ 1057.999001] [<ffffffff810b3a8e>] tick_sched_handle.isra.8+0x2e/0x70
Feb 22 01:41:50 neon kernel: [ 1057.999006] [<ffffffff810b3c1c>] tick_sched_timer+0x4c/0x80
Feb 22 01:41:50 neon kernel: [ 1057.999013] [<ffffffff810819d9>] __run_hrtimer+0x79/0x1c0
Feb 22 01:41:50 neon kernel: [ 1057.999018] [<ffffffff810b3bd0>] ? tick_sched_do_timer+0x40/0x40
Feb 22 01:41:50 neon kernel: [ 1057.999024] [<ffffffff810822c7>] hrtimer_interrupt+0xe7/0x230
Feb 22 01:41:50 neon kernel: [ 1057.999030] [<ffffffff81574a50>] ? centrino_target+0x370/0x370
Feb 22 01:41:50 neon kernel: [ 1057.999037] [<ffffffff816d8519>] smp_apic_timer_interrupt+0x69/0x99
Feb 22 01:41:50 neon kernel: [ 1057.999044] [<ffffffff816d745d>] apic_timer_interrupt+0x6d/0x80
Feb 22 01:41:50 neon kernel: [ 1057.999046] <EOI>
Feb 22 01:41:50 neon kernel: [ 1057.999049] [<ffffffff81043fa6>] ? native_safe_halt+0x6/0x10
Feb 22 01:41:50 neon kernel: [ 1057.999060] [<ffffffff813e3769>] arch_safe_halt+0x9/0xd
Feb 22 01:41:50 neon kernel: [ 1057.999066] [<ffffffff813e3e7d>] acpi_safe_halt+0x2a/0x43
Feb 22 01:41:50 neon kernel: [ 1057.999072] [<ffffffff813e3eb1>] acpi_idle_do_entry+0x1b/0x2b
Feb 22 01:41:50 neon kernel: [ 1057.999078] [<ffffffff813e3f04>] acpi_idle_enter_c1+0x43/0x62
Feb 22 01:41:50 neon kernel: [ 1057.999084] [<ffffffff81574a69>] cpuidle_enter+0x19/0x20
Feb 22 01:41:50 neon kernel: [ 1057.999089] [<ffffffff81575499>] cpuidle_wrap_enter+0x49/0xa0
Feb 22 01:41:50 neon kernel: [ 1057.999096] [<ffffffff81575500>] cpuidle_enter_tk+0x10/0x20
Feb 22 01:41:50 neon kernel: [ 1057.999101] [<ffffffff815750e5>] cpuidle_idle_call+0xa5/0x270
Feb 22 01:41:50 neon kernel: [ 1057.999107] [<ffffffff8101d62f>] cpu_idle+0xaf/0x120
Feb 22 01:41:50 neon kernel: [ 1057.999112] [<ffffffff816b7620>] start_secondary+0x1e0/0x1e5
Feb 22 01:41:50 neon kernel: [ 1057.999117] Code: 89 e5 ff 15 49 25 92 00 5d c3 66 66 66 66 66 66 2e 0f 1f 84 00 00 00 00 00 55 48 8d 04 bd 00 00 00 00 65 48 8b 14 25 18 3e 01 00 <48> 8d 0c 12 48 c1 e2 06 48 89 e5 48 29 ca f7 e2 48 8d 7a 01 ff
Feb 22 01:41:50 neon kernel: [ 1057.999175] NMI backtrace for cpu 1
Feb 22 01:41:50 neon kernel: [ 1057.999183] CPU 1
Feb 22 01:41:50 neon kernel: [ 1057.999193] Pid: 0, comm: swapper/1 Tainted: PF W O 3.8.0-35-generic #50-Ubuntu To be filled by O.E.M. To be filled by O.E.M./SABERTOOTH 990FX R2.0
Feb 22 01:41:50 neon kernel: [ 1057.999199] RIP: 0010:[<ffffffff813e3eb7>] [<ffffffff813e3eb7>] acpi_idle_do_entry+0x21/0x2b
Feb 22 01:41:50 neon kernel: [ 1057.999213] RSP: 0018:ffff88061cd83e10 EFLAGS: 00000093
Feb 22 01:41:50 neon kernel: [ 1057.999218] RAX: 000000f6554bcf00 RBX: ffff8806167cd4a0 RCX: 000000000000c648
Feb 22 01:41:50 neon kernel: [ 1057.999223] RDX: 0000000000000815 RSI: ffff88063ec40000 RDI: ffff8806167cd4a0
Feb 22 01:41:50 neon kernel: [ 1057.999228] RBP: ffff88061cd83e10 R08: 0000000000002e39 R09: 0000000000000018
Feb 22 01:41:50 neon kernel: [ 1057.999232] R10: 0000000000003e49 R11: 0000000000000000 R12: 0000000000000002
Feb 22 01:41:50 neon kernel: [ 1057.999237] R13: ffff88061cd82000 R14: ffff8806167cd400 R15: ffffffff81574a50
Feb 22 01:41:50 neon kernel: [ 1057.999243] FS: 00007fda35d337c0(0000) GS:ffff88063ec40000(0000) knlGS:0000000000000000
Feb 22 01:41:50 neon kernel: [ 1057.999247] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
Feb 22 01:41:50 neon kernel: [ 1057.999252] CR2: 00007f87ac49f000 CR3: 00000005d9eec000 CR4: 00000000000407e0
Feb 22 01:41:50 neon kernel: [ 1057.999257] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Feb 22 01:41:50 neon kernel: [ 1057.999261] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Feb 22 01:41:50 neon kernel: [ 1057.999267] Process swapper/1 (pid: 0, threadinfo ffff88061cd82000, task ffff88061cd79740)
Feb 22 01:41:50 neon kernel: [ 1057.999270] Stack:
Feb 22 01:41:50 neon kernel: [ 1057.999274] ffff88061cd83e40 ffffffff813e3faa ffff880616054000 ffffffff81c7e060
Feb 22 01:41:50 neon kernel: [ 1057.999286] 000000f6c08965cf 0000000000000002 ffff88061cd83e50 ffffffff81574a69
Feb 22 01:41:50 neon kernel: [ 1057.999296] ffff88061cd83eb0 ffffffff81575499 7735940000000001 ffff880616054000
Feb 22 01:41:50 neon kernel: [ 1057.999307] Call Trace:
Feb 22 01:41:50 neon kernel: [ 1057.999317] [<ffffffff813e3faa>] acpi_idle_enter_simple+0x87/0xc5
Feb 22 01:41:50 neon kernel: [ 1057.999328] [<ffffffff81574a69>] cpuidle_enter+0x19/0x20
Feb 22 01:41:50 neon kernel: [ 1057.999336] [<ffffffff81575499>] cpuidle_wrap_enter+0x49/0xa0
Feb 22 01:41:50 neon kernel: [ 1057.999345] [<ffffffff81575500>] cpuidle_enter_tk+0x10/0x20
Feb 22 01:41:50 neon kernel: [ 1057.999353] [<ffffffff815750e5>] cpuidle_idle_call+0xa5/0x270
Feb 22 01:41:50 neon kernel: [ 1057.999363] [<ffffffff8101d62f>] cpu_idle+0xaf/0x120
Feb 22 01:41:50 neon kernel: [ 1057.999372] [<ffffffff816b7620>] start_secondary+0x1e0/0x1e5
Feb 22 01:41:50 neon kernel: [ 1057.999377] Code: 00 83 88 3c e0 ff ff 04 5d c3 8a 47 08 55 48 89 e5 3c 01 75 07 e8 3a 35 c5 ff eb 17 3c 02 75 07 e8 a2 ff ff ff eb 0c 8b 57 04 ec <48> 8b 15 86 e1 b2 00 ed 5d c3 66 66 66 66 90 55 48 63 c2 48 c1
Feb 22 01:41:50 neon kernel: [ 1057.999485] NMI backtrace for cpu 0
Feb 22 01:41:50 neon kernel: [ 1057.999488] CPU 0
Feb 22 01:41:50 neon kernel: [ 1057.999494] Pid: 0, comm: swapper/0 Tainted: PF W O 3.8.0-35-generic #50-Ubuntu To be filled by O.E.M. To be filled by O.E.M./SABERTOOTH 990FX R2.0
Feb 22 01:41:50 neon kernel: [ 1057.999497] RIP: 0010:[<ffffffff813e3eb7>] [<ffffffff813e3eb7>] acpi_idle_do_entry+0x21/0x2b
Feb 22 01:41:50 neon kernel: [ 1057.999504] RSP: 0018:ffffffff81c01e10 EFLAGS: 00000093
Feb 22 01:41:50 neon kernel: [ 1057.999507] RAX: 000000f6554b5000 RBX: ffff88061cdfcca0 RCX: 000000000000c648
Feb 22 01:41:50 neon kernel: [ 1057.999510] RDX: 0000000000000815 RSI: ffff88063ec00000 RDI: ffff88061cdfcca0
Feb 22 01:41:50 neon kernel: [ 1057.999513] RBP: ffffffff81c01e10 R08: 0000000000003e03 R09: 0000000000000018
Feb 22 01:41:50 neon kernel: [ 1057.999516] R10: 0000000000002eaf R11: 0000000000000000 R12: 0000000000000002
Feb 22 01:41:50 neon kernel: [ 1057.999518] R13: ffffffff81c00000 R14: ffff88061cdfcc00 R15: ffffffff81574a50
Feb 22 01:41:50 neon kernel: [ 1057.999522] FS: 00007f46053ce700(0000) GS:ffff88063ec00000(0000) knlGS:0000000000000000
Feb 22 01:41:50 neon kernel: [ 1057.999525] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
Feb 22 01:41:50 neon kernel: [ 1057.999528] CR2: 00007f460728d000 CR3: 00000005b9537000 CR4: 00000000000407f0
Feb 22 01:41:50 neon kernel: [ 1057.999531] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Feb 22 01:41:50 neon kernel: [ 1057.999534] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Feb 22 01:41:50 neon kernel: [ 1057.999537] Process swapper/0 (pid: 0, threadinfo ffffffff81c00000, task ffffffff81c15440)
Feb 22 01:41:50 neon kernel: [ 1057.999539] Stack:
Feb 22 01:41:50 neon kernel: [ 1057.999541] ffffffff81c01e40 ffffffff813e3faa ffff880616741600 ffffffff81c7e060
Feb 22 01:41:50 neon kernel: [ 1057.999547] 000000f6c088e558 0000000000000002 ffffffff81c01e50 ffffffff81574a69
Feb 22 01:41:50 neon kernel: [ 1057.999553] ffffffff81c01eb0 ffffffff81575499 7735940000000001 ffff880616741600
Feb 22 01:41:50 neon kernel: [ 1057.999559] Call Trace:
Feb 22 01:41:50 neon kernel: [ 1057.999565] [<ffffffff813e3faa>] acpi_idle_enter_simple+0x87/0xc5
Feb 22 01:41:50 neon kernel: [ 1057.999572] [<ffffffff81574a69>] cpuidle_enter+0x19/0x20
Feb 22 01:41:50 neon kernel: [ 1057.999577] [<ffffffff81575499>] cpuidle_wrap_enter+0x49/0xa0
Feb 22 01:41:50 neon kernel: [ 1057.999584] [<ffffffff81575500>] cpuidle_enter_tk+0x10/0x20
Feb 22 01:41:50 neon kernel: [ 1057.999589] [<ffffffff815750e5>] cpuidle_idle_call+0xa5/0x270
Feb 22 01:41:50 neon kernel: [ 1057.999595] [<ffffffff8101d62f>] cpu_idle+0xaf/0x120
Feb 22 01:41:50 neon kernel: [ 1057.999602] [<ffffffff816abc32>] rest_init+0x72/0x80
Feb 22 01:41:50 neon kernel: [ 1057.999609] [<ffffffff81d05be9>] start_kernel+0x3d1/0x3dc
Feb 22 01:41:50 neon kernel: [ 1057.999615] [<ffffffff81d0566e>] ? do_early_param+0x8e/0x8e
Feb 22 01:41:50 neon kernel: [ 1057.999622] [<ffffffff81d05355>] x86_64_start_reservations+0x130/0x133
Feb 22 01:41:50 neon kernel: [ 1057.999628] [<ffffffff81d05458>] x86_64_start_kernel+0x100/0x10f
Feb 22 01:41:50 neon kernel: [ 1057.999631] Code: 00 83 88 3c e0 ff ff 04 5d c3 8a 47 08 55 48 89 e5 3c 01 75 07 e8 3a 35 c5 ff eb 17 3c 02 75 07 e8 a2 ff ff ff eb 0c 8b 57 04 ec <48> 8b 15 86 e1 b2 00 ed 5d c3 66 66 66 66 90 55 48 63 c2 48 c1
Feb 22 01:41:59 neon rtkit-daemon[3933]: The canary thread is apparently starving. Taking action.
Feb 22 01:41:59 neon rtkit-daemon[3933]: Demoting known real-time threads.
Feb 22 01:41:59 neon rtkit-daemon[3933]: Successfully demoted thread 4021 of process 3931 (n/a).
Feb 22 01:41:59 neon rtkit-daemon[3933]: Successfully demoted thread 4015 of process 3931 (n/a).
Feb 22 01:41:59 neon rtkit-daemon[3933]: Successfully demoted thread 4000 of process 3931 (n/a).
Feb 22 01:41:59 neon rtkit-daemon[3933]: Successfully demoted thread 3931 of process 3931 (n/a).
Feb 22 01:41:59 neon rtkit-daemon[3933]: Demoted 4 threads.
Feb 22 01:42:09 neon rtkit-daemon[3933]: The canary thread is apparently starving. Taking action.
Feb 22 01:42:09 neon rtkit-daemon[3933]: Demoting known real-time threads.
Feb 22 01:42:09 neon rtkit-daemon[3933]: Successfully demoted thread 4021 of process 3931 (n/a).
Feb 22 01:42:09 neon rtkit-daemon[3933]: Successfully demoted thread 4015 of process 3931 (n/a).
Feb 22 01:42:09 neon rtkit-daemon[3933]: Successfully demoted thread 4000 of process 3931 (n/a).
Feb 22 01:42:09 neon rtkit-daemon[3933]: Successfully demoted thread 3931 of process 3931 (n/a).
Feb 22 01:42:09 neon rtkit-daemon[3933]: Demoted 4 threads.
Feb 22 01:42:19 neon rtkit-daemon[3933]: The canary thread is apparently starving. Taking action.
Feb 22 01:42:19 neon rtkit-daemon[3933]: Demoting known real-time threads.
Feb 22 01:42:19 neon rtkit-daemon[3933]: Successfully demoted thread 4021 of process 3931 (n/a).
Feb 22 01:42:19 neon rtkit-daemon[3933]: Successfully demoted thread 4015 of process 3931 (n/a).
Feb 22 01:42:19 neon rtkit-daemon[3933]: Successfully demoted thread 4000 of process 3931 (n/a).
Feb 22 01:42:19 neon rtkit-daemon[3933]: Successfully demoted thread 3931 of process 3931 (n/a).
Feb 22 01:42:19 neon rtkit-daemon[3933]: Demoted 4 threads.
Feb 22 01:42:29 neon rtkit-daemon[3933]: The canary thread is apparently starving. Taking action.
Feb 22 01:42:29 neon rtkit-daemon[3933]: Demoting known real-time threads.
Feb 22 01:42:29 neon rtkit-daemon[3933]: Successfully demoted thread 4021 of process 3931 (n/a).
Feb 22 01:42:29 neon rtkit-daemon[3933]: Successfully demoted thread 4015 of process 3931 (n/a).
Feb 22 01:42:29 neon rtkit-daemon[3933]: Successfully demoted thread 4000 of process 3931 (n/a).
Feb 22 01:42:29 neon rtkit-daemon[3933]: Successfully demoted thread 3931 of process 3931 (n/a).
Feb 22 01:42:29 neon rtkit-daemon[3933]: Demoted 4 threads.
Feb 22 01:42:39 neon rtkit-daemon[3933]: The canary thread is apparently starving. Taking action.
Feb 22 01:42:39 neon rtkit-daemon[3933]: Demoting known real-time threads.
Feb 22 01:42:39 neon rtkit-daemon[3933]: Successfully demoted thread 4021 of process 3931 (n/a).
Feb 22 01:42:39 neon rtkit-daemon[3933]: Successfully demoted thread 4015 of process 3931 (n/a).
Feb 22 01:42:39 neon rtkit-daemon[3933]: Successfully demoted thread 4000 of process 3931 (n/a).
Feb 22 01:42:39 neon rtkit-daemon[3933]: Successfully demoted thread 3931 of process 3931 (n/a).
Feb 22 01:42:39 neon rtkit-daemon[3933]: Demoted 4 threads.
Feb 22 01:42:49 neon rtkit-daemon[3933]: The canary thread is apparently starving. Taking action.
Feb 22 01:42:49 neon rtkit-daemon[3933]: Demoting known real-time threads.
Feb 22 01:42:49 neon rtkit-daemon[3933]: Successfully demoted thread 4021 of process 3931 (n/a).
Feb 22 01:42:49 neon rtkit-daemon[3933]: Successfully demoted thread 4015 of process 3931 (n/a).
Feb 22 01:42:49 neon rtkit-daemon[3933]: Successfully demoted thread 4000 of process 3931 (n/a).
Feb 22 01:42:49 neon rtkit-daemon[3933]: Successfully demoted thread 3931 of process 3931 (n/a).
Feb 22 01:42:49 neon rtkit-daemon[3933]: Demoted 4 threads.
Feb 22 01:42:59 neon rtkit-daemon[3933]: The canary thread is apparently starving. Taking action.
Feb 22 01:42:59 neon rtkit-daemon[3933]: Demoting known real-time threads.
Feb 22 01:42:59 neon rtkit-daemon[3933]: Successfully demoted thread 4021 of process 3931 (n/a).
Feb 22 01:42:59 neon rtkit-daemon[3933]: Successfully demoted thread 4015 of process 3931 (n/a).
Feb 22 01:42:59 neon rtkit-daemon[3933]: Successfully demoted thread 4000 of process 3931 (n/a).
Feb 22 01:42:59 neon rtkit-daemon[3933]: Successfully demoted thread 3931 of process 3931 (n/a).
Feb 22 01:42:59 neon rtkit-daemon[3933]: Demoted 4 threads.
Feb 22 01:43:09 neon rtkit-daemon[3933]: The canary thread is apparently starving. Taking action.
Feb 22 01:43:09 neon rtkit-daemon[3933]: Demoting known real-time threads.
Feb 22 01:43:09 neon rtkit-daemon[3933]: Successfully demoted thread 4021 of process 3931 (n/a).
Feb 22 01:43:09 neon rtkit-daemon[3933]: Successfully demoted thread 4015 of process 3931 (n/a).
Feb 22 01:43:09 neon rtkit-daemon[3933]: Successfully demoted thread 4000 of process 3931 (n/a).
Feb 22 01:43:09 neon rtkit-daemon[3933]: Successfully demoted thread 3931 of process 3931 (n/a).
Feb 22 01:43:09 neon rtkit-daemon[3933]: Demoted 4 threads.
Feb 22 01:43:19 neon rtkit-daemon[3933]: The canary thread is apparently starving. Taking action.
Feb 22 01:43:19 neon rtkit-daemon[3933]: Demoting known real-time threads.
Feb 22 01:43:19 neon rtkit-daemon[3933]: Successfully demoted thread 4021 of process 3931 (n/a).
Feb 22 01:43:19 neon rtkit-daemon[3933]: Successfully demoted thread 4015 of process 3931 (n/a).
Feb 22 01:43:19 neon rtkit-daemon[3933]: Successfully demoted thread 4000 of process 3931 (n/a).
Feb 22 01:43:19 neon rtkit-daemon[3933]: Successfully demoted thread 3931 of process 3931 (n/a).
Feb 22 01:43:19 neon rtkit-daemon[3933]: Demoted 4 threads.
Feb 22 01:43:29 neon rtkit-daemon[3933]: The canary thread is apparently starving. Taking action.
Feb 22 01:43:29 neon rtkit-daemon[3933]: Demoting known real-time threads.
Feb 22 01:43:29 neon rtkit-daemon[3933]: Successfully demoted thread 4021 of process 3931 (n/a).
Feb 22 01:43:29 neon rtkit-daemon[3933]: Successfully demoted thread 4015 of process 3931 (n/a).
Feb 22 01:43:29 neon rtkit-daemon[3933]: Successfully demoted thread 4000 of process 3931 (n/a).
Feb 22 01:43:29 neon rtkit-daemon[3933]: Successfully demoted thread 3931 of process 3931 (n/a).
Feb 22 01:43:29 neon rtkit-daemon[3933]: Demoted 4 threads.
Feb 22 01:43:39 neon rtkit-daemon[3933]: The canary thread is apparently starving. Taking action.
Feb 22 01:43:39 neon rtkit-daemon[3933]: Demoting known real-time threads.
Feb 22 01:43:39 neon rtkit-daemon[3933]: Successfully demoted thread 4021 of process 3931 (n/a).
Feb 22 01:43:39 neon rtkit-daemon[3933]: Successfully demoted thread 4015 of process 3931 (n/a).
Feb 22 01:43:39 neon rtkit-daemon[3933]: Successfully demoted thread 4000 of process 3931 (n/a).
Feb 22 01:43:39 neon rtkit-daemon[3933]: Successfully demoted thread 3931 of process 3931 (n/a).
Feb 22 01:43:39 neon rtkit-daemon[3933]: Demoted 4 threads.
Feb 22 01:43:49 neon rtkit-daemon[3933]: The canary thread is apparently starving. Taking action.
Feb 22 01:43:49 neon rtkit-daemon[3933]: Demoting known real-time threads.
Feb 22 01:43:49 neon rtkit-daemon[3933]: Successfully demoted thread 4021 of process 3931 (n/a).
Feb 22 01:43:49 neon rtkit-daemon[3933]: Successfully demoted thread 4015 of process 3931 (n/a).
Feb 22 01:43:49 neon rtkit-daemon[3933]: Successfully demoted thread 4000 of process 3931 (n/a).
Feb 22 01:43:49 neon rtkit-daemon[3933]: Successfully demoted thread 3931 of process 3931 (n/a).
Feb 22 01:43:49 neon rtkit-daemon[3933]: Demoted 4 threads.
Feb 22 01:43:59 neon rtkit-daemon[3933]: The canary thread is apparently starving. Taking action.
Feb 22 01:43:59 neon rtkit-daemon[3933]: Demoting known real-time threads.
Feb 22 01:43:59 neon rtkit-daemon[3933]: Successfully demoted thread 4021 of process 3931 (n/a).
Feb 22 01:43:59 neon rtkit-daemon[3933]: Successfully demoted thread 4015 of process 3931 (n/a).
Feb 22 01:43:59 neon rtkit-daemon[3933]: Successfully demoted thread 4000 of process 3931 (n/a).
Feb 22 01:43:59 neon rtkit-daemon[3933]: Successfully demoted thread 3931 of process 3931 (n/a).
Feb 22 01:43:59 neon rtkit-daemon[3933]: Demoted 4 threads.
Feb 22 01:44:01 neon CRON[8530]: (CRON) info (No MTA installed, discarding output)
Feb 22 01:44:09 neon rtkit-daemon[3933]: The canary thread is apparently starving. Taking action.
Feb 22 01:44:09 neon rtkit-daemon[3933]: Demoting known real-time threads.
Feb 22 01:44:09 neon rtkit-daemon[3933]: Successfully demoted thread 4021 of process 3931 (n/a).
Feb 22 01:44:09 neon rtkit-daemon[3933]: Successfully demoted thread 4015 of process 3931 (n/a).
Feb 22 01:44:09 neon rtkit-daemon[3933]: Successfully demoted thread 4000 of process 3931 (n/a).
Feb 22 01:44:09 neon rtkit-daemon[3933]: Successfully demoted thread 3931 of process 3931 (n/a).
Feb 22 01:44:09 neon rtkit-daemon[3933]: Demoted 4 threads.
Feb 22 01:45:59 neon kernel: imklog 5.8.11, log source = /proc/kmsg started.
Feb 22 01:45:59 neon rsyslogd: [origin software="rsyslogd" swVersion="5.8.11" x-pid="1592" x-info="http://www.rsyslog.com"] start
Feb 22 01:45:59 neon rsyslogd: rsyslogd's groupid changed to 103
Feb 22 01:45:59 neon rsyslogd: rsyslogd's userid changed to 101
Feb 22 01:45:59 neon rsyslogd-2039: Could not open output pipe '/dev/xconsole' [try http://www.rsyslog.com/e/2039 ]
Feb 22 01:45:59 neon kernel: [ 0.000000] Initializing cgroup subsys cpuset
Feb 22 01:45:59 neon kernel: [ 0.000000] Initializing cgroup subsys cpu
Feb 22 01:45:59 neon kernel: [ 0.000000] Linux version 3.8.0-35-generic (buildd@roseapple) (gcc version 4.7.3 (Ubuntu/Linaro 4.7.3-1ubuntu1) ) #50-Ubuntu SMP Tue Dec 3 01:24:59 UTC 2013 (Ubuntu 3.8.0-35.50-generic 3.8.13.13)
Feb 22 01:45:59 neon kernel: [ 0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-3.8.0-35-generic root=/dev/mapper/ssd1-root ro quiet splash
Feb 22 01:45:59 neon kernel: [ 0.000000] KERNEL supported cpus:
Feb 22 01:45:59 neon kernel: [ 0.000000] Intel GenuineIntel
Feb 22 01:45:59 neon kernel: [ 0.000000] AMD AuthenticAMD
Feb 22 01:45:59 neon kernel: [ 0.000000] Centaur CentaurHauls
Feb 22 01:45:59 neon kernel: [ 0.000000] e820: BIOS-provided physical RAM map:
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment