Skip to content

Instantly share code, notes, and snippets.

@azet azet/SHA2017-SCAN.md
Last active Aug 6, 2017

Embed
What would you like to do?
IPv4-wide Scans @ SHA2017

IPv4-wide Scans @ SHA2017

What? -- Outline & General Information

We're setting up infrastructure to utilize the available bandwidth at the SHA2017 hacker camp in the Netherlands. Participation is more than welcome! This doesn't mean you have to be at the camp physically -- you may suggest scanning proposals/ideas (see below) & do your research remotely via ssh(1) or have someone implement and run your idea at the camp. There will be a workshop on internet-wide scanning - we'll present our results and teach willing participants what we know, have learned scanning the internet in the past, from others and during the camp. We will also let the participants run their own scans -- if we feel they're valuable, ethical and non-disruptive.

Full attribution (professional, academic & otherwise) will go to the original authors of ideas and implementers of scans run during SHA2017 and developed at the mentioned workshop! We should not even have to mention this fact - as this should be the norm (hey there, academia!).


bear in mind: we're only doing ethical research. we won't actively exploit vulnerabilities, so some intrusive scans may be rejected if there's even a remote chance that they interfere with others infrastructure or services! all ideas and code will be peer reviewed by at least one person and undergo a Q/A process on site (as best as we can manage with available human heartbeat-cycles -> which means that ideas may be set aside because we didn't have enough time or people to look at them and provide feedback - unfortunately - we've only got a few days).

proposals/submissions: send to shascan@azet.org and what your goals/ideas are (+ code, if you already know how to).

template for submissions

participation: fork & comment on this gist. write code, search for papers, previous research and send proposals as described above. help with the Q/A process and reviewing code. help setting up the infrastructure on site, administer it, and monitor (if possible 24/7). help out during the workshop on the last evening of SHA (beer, etc. welcome) with your newly aquired knowledge -- so people can learn (faster & more in-depth) from you!

Point of Contact -- Main Workshop & Infrastructure Organization

@a_z_e_t (Twitter) || azet@azet.org (SMTP) || azet@jabber.ccc.de (XMPP) || azet @ freenode, OFTC (IRC)

this contact information is for emergencies and technical questions aside from scanning submissions (see above).


TODO / wanted

INFRASTRUCTURE STATUS:
currently there's a single 1u server that will be used
server info and build-up status @ https://gist.github.com/azet/54862407b7af1c2813e590ead83f7553#gistcomment-2161084

  • (pre) orga on-site @ SHA: 1) get in contact with server transport + NOC/Nick Farr 2) add info. on the scans to the SHA2017 Wiki 3) physically install server @ NOC

    1. get second 10GE NIC from Aaaaaaaaaaaa Village & add to server
    2. connect 10GE LACP trunks to NOC router and uplink (optional + OOB mgmt?)
  • set up server: 1) freebsd/linux? 2) drivers? 3) disks/raid/filesystem performance/kernel/network tuning 4) backups 5) monitoring

    1. virtualization/jails/docker/LXC/..
    2. all the userspace stuff & scanning itself
    3. do we want/need OOB management? (e.g. forkbomb, heavy network IO interferes with SSH/monitoring/scans/etc.)
  • find someone to bring:

    1. 8-16GB RAM 2) 2nd 10GE (dual port /w SFP+ tranciever) NIC

    2. 1-2 USB3 SSDs (fast & big) 4) fiber optics (i.e. cabling and trancievers)

  • benchmarks:

    1. disk IO
    2. Network IO
    3. NUMA + memory specifics
    4. in-memory FS?
  • abuse (mails/management) and how to deal with it

    1. do we want to and if: who answers all those mails?
    2. who is PoC there - scan team or SHA NOC?
    3. set up website on public v6/v4 IP and reverse DNS entry with disclaimer
      • that this is a scan server doing good/ethical stuff
      • who to contact in case of an emergency / network issues / ethical questions
      • provide information on ongoing scans and research, network utilization and AS numbers / IPs scanned
        • important (XXX/TODO): who sets that up and codes all that?

Ideas

  • OCSP
  • uPNP
  • FTP

(azet has more ;))

Link- & reading list

Kernel & Userspace

Scanning

v4-wide

  • masscan
  • zmap, "ztools"

general

Custom runs by participants

decide (FreeBSD 11 / Debian testing):

  • LXC/docker (have participants submit dockerfiles?)
  • KVM/qemu
  • bhyve
  • jails

Scripts / Ports / Data / Analytics

  • Scripts: e.g. Python -> AMQP (?) -> fanout LXC/docker, ..

Correlation & anomaly detection

System metrics / performance profiling & monitoring

Accounting (oh.. we could make ethics & science reproducible?!)

What do we want and need? Public system logs? (automated) Anonymization of datasets?

reproducible results, science, and builds (if possible and doable in a timely fashion)

@azet

This comment has been minimized.

Copy link
Owner Author

azet commented Jul 27, 2017

Server Hardware, currently (STATUS: in production [see: https://gist.github.com/azet/54862407b7af1c2813e590ead83f7553#gistcomment-2168758])

currently: debian testing + drivers installed, connected and benchmarked. LXC available, currently unused.

hardware details:

ip a:

1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
       valid_lft forever preferred_lft forever
    inet6 ::1/128 scope host 
       valid_lft forever preferred_lft forever
2: enp1s0f0: <BROADCAST,MULTICAST,PROMISC,UP,LOWER_UP> mtu 1500 qdisc mq state UP group default qlen 1000
    link/ether 90:e2:ba:e3:00:78 brd ff:ff:ff:ff:ff:ff
    inet 151.216.93.11/24 brd 151.216.93.255 scope global enp1s0f0
       valid_lft forever preferred_lft forever
    inet6 2a05:2d01:2017:1093::11/64 scope global 
       valid_lft forever preferred_lft forever
    inet6 fe80::92e2:baff:fee3:78/64 scope link 
       valid_lft forever preferred_lft forever
3: eno2: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN group default qlen 1000
    link/ether 0c:c4:7a:93:6f:a1 brd ff:ff:ff:ff:ff:ff
4: eno1: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN group default qlen 1000
    link/ether 0c:c4:7a:93:6f:a0 brd ff:ff:ff:ff:ff:ff
5: enp1s0f1: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN group default qlen 1000
    link/ether 90:e2:ba:e3:00:79 brd ff:ff:ff:ff:ff:ff
6: eno3: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN group default qlen 1000
    link/ether 0c:c4:7a:93:72:c0 brd ff:ff:ff:ff:ff:ff
7: eno4: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN group default qlen 1000
    link/ether 0c:c4:7a:93:72:c1 brd ff:ff:ff:ff:ff:ff
8: docker0: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc noqueue state DOWN group default qlen 1000
    link/ether 56:84:7a:fe:97:99 brd ff:ff:ff:ff:ff:ff
    inet 172.17.42.1/16 scope global docker0
       valid_lft forever preferred_lft forever

dmesg:

[    0.000000] Linux version 4.11.0-1-amd64 (debian-kernel@lists.debian.org) (gcc version 6.3.0 20170516 (Debian 6.3.0-18) ) #1 SMP Debian 4.11.6-1 (2017-06-19)
[    0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-4.11.0-1-amd64 root=UUID=eac70b67-fc4f-4197-8ce6-6e234b7c12f3 ro quiet
[    0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'
[    0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'
[    0.000000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'
[    0.000000] x86/fpu: Supporting XSAVE feature 0x008: 'MPX bounds registers'
[    0.000000] x86/fpu: Supporting XSAVE feature 0x010: 'MPX CSR'
[    0.000000] x86/fpu: xstate_offset[2]:  576, xstate_sizes[2]:  256
[    0.000000] x86/fpu: xstate_offset[3]:  832, xstate_sizes[3]:   64
[    0.000000] x86/fpu: xstate_offset[4]:  896, xstate_sizes[4]:   64
[    0.000000] x86/fpu: Enabled xstate features 0x1f, context size is 960 bytes, using 'compacted' format.
[    0.000000] e820: BIOS-provided physical RAM map:
[    0.000000] BIOS-e820: [mem 0x0000000000000000-0x0000000000098bff] usable
[    0.000000] BIOS-e820: [mem 0x0000000000098c00-0x000000000009ffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000000100000-0x0000000096e5dfff] usable
[    0.000000] BIOS-e820: [mem 0x0000000096e5e000-0x0000000096e5efff] ACPI NVS
[    0.000000] BIOS-e820: [mem 0x0000000096e5f000-0x0000000096e5ffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000096e60000-0x000000009dc70fff] usable
[    0.000000] BIOS-e820: [mem 0x000000009dc71000-0x000000009e023fff] reserved
[    0.000000] BIOS-e820: [mem 0x000000009e024000-0x000000009e159fff] usable
[    0.000000] BIOS-e820: [mem 0x000000009e15a000-0x000000009e82ffff] ACPI NVS
[    0.000000] BIOS-e820: [mem 0x000000009e830000-0x000000009effefff] reserved
[    0.000000] BIOS-e820: [mem 0x000000009efff000-0x000000009effffff] usable
[    0.000000] BIOS-e820: [mem 0x000000009f000000-0x000000009fffffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000e0000000-0x00000000efffffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fe000000-0x00000000fe010fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fec00000-0x00000000fec00fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fed00000-0x00000000fed00fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fee00000-0x00000000fee00fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000ff000000-0x00000000ffffffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000025dffffff] usable
[    0.000000] NX (Execute Disable) protection: active
[    0.000000] SMBIOS 3.0 present.
[    0.000000] DMI: Supermicro Super Server/X11SSZ-TLN4F, BIOS 2.0 01/26/2017
[    0.000000] e820: update [mem 0x00000000-0x00000fff] usable ==> reserved
[    0.000000] e820: remove [mem 0x000a0000-0x000fffff] usable
[    0.000000] e820: last_pfn = 0x25e000 max_arch_pfn = 0x400000000
[    0.000000] MTRR default type: write-back
[    0.000000] MTRR fixed ranges enabled:
[    0.000000]   00000-9FFFF write-back
[    0.000000]   A0000-BFFFF uncachable
[    0.000000]   C0000-FFFFF write-protect
[    0.000000] MTRR variable ranges enabled:
[    0.000000]   0 base 00C0000000 mask 7FC0000000 uncachable
[    0.000000]   1 base 00A0000000 mask 7FE0000000 uncachable
[    0.000000]   2 disabled
[    0.000000]   3 disabled
[    0.000000]   4 disabled
[    0.000000]   5 disabled
[    0.000000]   6 disabled
[    0.000000]   7 disabled
[    0.000000]   8 disabled
[    0.000000]   9 disabled
[    0.000000] x86/PAT: Configuration [0-7]: WB  WC  UC- UC  WB  WC  UC- WT  
[    0.000000] e820: last_pfn = 0x9f000 max_arch_pfn = 0x400000000
[    0.000000] found SMP MP-table at [mem 0x000fcd60-0x000fcd6f] mapped at [ffff8f7b400fcd60]
[    0.000000] Base memory trampoline at [ffff8f7b40092000] 92000 size 24576
[    0.000000] Using GB pages for direct mapping
[    0.000000] BRK [0x25b941000, 0x25b941fff] PGTABLE
[    0.000000] BRK [0x25b942000, 0x25b942fff] PGTABLE
[    0.000000] BRK [0x25b943000, 0x25b943fff] PGTABLE
[    0.000000] BRK [0x25b944000, 0x25b944fff] PGTABLE
[    0.000000] BRK [0x25b945000, 0x25b945fff] PGTABLE
[    0.000000] BRK [0x25b946000, 0x25b946fff] PGTABLE
[    0.000000] BRK [0x25b947000, 0x25b947fff] PGTABLE
[    0.000000] BRK [0x25b948000, 0x25b948fff] PGTABLE
[    0.000000] BRK [0x25b949000, 0x25b949fff] PGTABLE
[    0.000000] BRK [0x25b94a000, 0x25b94afff] PGTABLE
[    0.000000] RAMDISK: [mem 0x35cdf000-0x36e66fff]
[    0.000000] ACPI: Early table checksum verification disabled
[    0.000000] ACPI: RSDP 0x00000000000F05B0 000024 (v02 SUPERM)
[    0.000000] ACPI: XSDT 0x000000009E15A0C0 0000FC (v01 SUPERM SUPERM   01072009 AMI  00010013)
[    0.000000] ACPI: FACP 0x000000009E180320 000114 (v06                 01072009 AMI  00010013)
[    0.000000] ACPI: DSDT 0x000000009E15A250 0260CB (v02 SUPERM SMCI--MB 01072009 INTL 20160422)
[    0.000000] ACPI: FACS 0x000000009E82FC80 000040
[    0.000000] ACPI: APIC 0x000000009E180438 0000BC (v03                 01072009 AMI  00010013)
[    0.000000] ACPI: FPDT 0x000000009E1804F8 000044 (v01                 01072009 AMI  00010013)
[    0.000000] ACPI: SPMI 0x000000009E180540 000040 (v05 SUPERM SMCI--MB 00000000 AMI. 00000000)
[    0.000000] ACPI: MCFG 0x000000009E180580 00003C (v01 SUPERM SMCI--MB 01072009 MSFT 00000097)
[    0.000000] ACPI: SSDT 0x000000009E1805C0 000224 (v01 SataRe SataTabl 00001000 INTL 20160422)
[    0.000000] ACPI: FIDT 0x000000009E1807E8 00009C (v01 SUPERM SMCI--MB 01072009 AMI  00010013)
[    0.000000] ACPI: SSDT 0x000000009E180888 003159 (v02 SaSsdt SaSsdt   00003000 INTL 20160422)
[    0.000000] ACPI: SSDT 0x000000009E1839E8 00255F (v02 PegSsd PegSsdt  00001000 INTL 20160422)
[    0.000000] ACPI: HPET 0x000000009E185F48 000038 (v01 INTEL  SKL      00000001 MSFT 0000005F)
[    0.000000] ACPI: SSDT 0x000000009E185F80 000024 (v02 INTEL  OEM_RTD3 00001000 INTL 20160422)
[    0.000000] ACPI: SSDT 0x000000009E185FA8 000DE5 (v02 INTEL  Ther_Rvp 00001000 INTL 20160422)
[    0.000000] ACPI: SSDT 0x000000009E186D90 000AF2 (v02 INTEL  xh_rvp08 00000000 INTL 20160422)
[    0.000000] ACPI: UEFI 0x000000009E187888 000042 (v01 INTEL  EDK2     00000002      01000013)
[    0.000000] ACPI: SSDT 0x000000009E1878D0 000EDE (v02 CpuRef CpuSsdt  00003000 INTL 20160422)
[    0.000000] ACPI: LPIT 0x000000009E1887B0 000094 (v01 INTEL  SKL      00000000 MSFT 0000005F)
[    0.000000] ACPI: WSMT 0x000000009E188848 000028 (v01 INTEL  SKL      00000000 MSFT 0000005F)
[    0.000000] ACPI: SSDT 0x000000009E188870 00029F (v02 INTEL  sensrhub 00000000 INTL 20160422)
[    0.000000] ACPI: SSDT 0x000000009E188B10 003002 (v02 INTEL  PtidDevc 00001000 INTL 20160422)
[    0.000000] ACPI: DBGP 0x000000009E18BB18 000034 (v01 INTEL           00000002 MSFT 0000005F)
[    0.000000] ACPI: DBG2 0x000000009E18BB50 000054 (v00 INTEL           00000002 MSFT 0000005F)
[    0.000000] ACPI: DMAR 0x000000009E18BBA8 0000DC (v01 INTEL  SKL      00000001 INTL 00000001)
[    0.000000] ACPI: ASF! 0x000000009E18BC88 0000A0 (v32 INTEL   HCG     00000001 TFSM 000F4240)
[    0.000000] ACPI: EINJ 0x000000009E18BD28 000130 (v01 AMI    AMI.EINJ 00000000 AMI. 00000000)
[    0.000000] ACPI: ERST 0x000000009E18BE58 000230 (v01 AMIER  AMI.ERST 00000000 AMI. 00000000)
[    0.000000] ACPI: BERT 0x000000009E18C088 000030 (v01 AMI    AMI.BERT 00000000 AMI. 00000000)
[    0.000000] ACPI: HEST 0x000000009E18C0B8 0000A8 (v01 AMI    AMI.HEST 00000000 AMI. 00000000)
[    0.000000] ACPI: Local APIC address 0xfee00000
[    0.000000] No NUMA configuration found
[    0.000000] Faking a node at [mem 0x0000000000000000-0x000000025dffffff]
[    0.000000] NODE_DATA(0) allocated [mem 0x25dffb000-0x25dffffff]
[    0.000000] Zone ranges:
[    0.000000]   DMA      [mem 0x0000000000001000-0x0000000000ffffff]
[    0.000000]   DMA32    [mem 0x0000000001000000-0x00000000ffffffff]
[    0.000000]   Normal   [mem 0x0000000100000000-0x000000025dffffff]
[    0.000000]   Device   empty
[    0.000000] Movable zone start for each node
[    0.000000] Early memory node ranges
[    0.000000]   node   0: [mem 0x0000000000001000-0x0000000000097fff]
[    0.000000]   node   0: [mem 0x0000000000100000-0x0000000096e5dfff]
[    0.000000]   node   0: [mem 0x0000000096e60000-0x000000009dc70fff]
[    0.000000]   node   0: [mem 0x000000009e024000-0x000000009e159fff]
[    0.000000]   node   0: [mem 0x000000009efff000-0x000000009effffff]
[    0.000000]   node   0: [mem 0x0000000100000000-0x000000025dffffff]
[    0.000000] Initmem setup node 0 [mem 0x0000000000001000-0x000000025dffffff]
[    0.000000] On node 0 totalpages: 2080061
[    0.000000]   DMA zone: 64 pages used for memmap
[    0.000000]   DMA zone: 21 pages reserved
[    0.000000]   DMA zone: 3991 pages, LIFO batch:0
[    0.000000]   DMA32 zone: 10039 pages used for memmap
[    0.000000]   DMA32 zone: 642470 pages, LIFO batch:31
[    0.000000]   Normal zone: 22400 pages used for memmap
[    0.000000]   Normal zone: 1433600 pages, LIFO batch:31
[    0.000000] ACPI: PM-Timer IO Port: 0x1808
[    0.000000] ACPI: Local APIC address 0xfee00000
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x05] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x06] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x07] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x08] high edge lint[0x1])
[    0.000000] IOAPIC[0]: apic_id 2, version 32, address 0xfec00000, GSI 0-119
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
[    0.000000] ACPI: IRQ0 used by override.
[    0.000000] ACPI: IRQ9 used by override.
[    0.000000] Using ACPI (MADT) for SMP configuration information
[    0.000000] ACPI: HPET id: 0x8086a201 base: 0xfed00000
[    0.000000] smpboot: Allowing 8 CPUs, 0 hotplug CPUs
[    0.000000] PM: Registered nosave memory: [mem 0x00000000-0x00000fff]
[    0.000000] PM: Registered nosave memory: [mem 0x00098000-0x00098fff]
[    0.000000] PM: Registered nosave memory: [mem 0x00099000-0x0009ffff]
[    0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000dffff]
[    0.000000] PM: Registered nosave memory: [mem 0x000e0000-0x000fffff]
[    0.000000] PM: Registered nosave memory: [mem 0x96e5e000-0x96e5efff]
[    0.000000] PM: Registered nosave memory: [mem 0x96e5f000-0x96e5ffff]
[    0.000000] PM: Registered nosave memory: [mem 0x9dc71000-0x9e023fff]
[    0.000000] PM: Registered nosave memory: [mem 0x9e15a000-0x9e82ffff]
[    0.000000] PM: Registered nosave memory: [mem 0x9e830000-0x9effefff]
[    0.000000] PM: Registered nosave memory: [mem 0x9f000000-0x9fffffff]
[    0.000000] PM: Registered nosave memory: [mem 0xa0000000-0xdfffffff]
[    0.000000] PM: Registered nosave memory: [mem 0xe0000000-0xefffffff]
[    0.000000] PM: Registered nosave memory: [mem 0xf0000000-0xfdffffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfe000000-0xfe010fff]
[    0.000000] PM: Registered nosave memory: [mem 0xfe011000-0xfebfffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfec00000-0xfec00fff]
[    0.000000] PM: Registered nosave memory: [mem 0xfec01000-0xfecfffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfed00000-0xfed00fff]
[    0.000000] PM: Registered nosave memory: [mem 0xfed01000-0xfedfffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfee00000-0xfee00fff]
[    0.000000] PM: Registered nosave memory: [mem 0xfee01000-0xfeffffff]
[    0.000000] PM: Registered nosave memory: [mem 0xff000000-0xffffffff]
[    0.000000] e820: [mem 0xa0000000-0xdfffffff] available for PCI devices
[    0.000000] Booting paravirtualized kernel on bare hardware
[    0.000000] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645519600211568 ns
[    0.000000] setup_percpu: NR_CPUS:512 nr_cpumask_bits:512 nr_cpu_ids:8 nr_node_ids:1
[    0.000000] percpu: Embedded 37 pages/cpu @ffff8f7d9dc00000 s111512 r8192 d31848 u262144
[    0.000000] pcpu-alloc: s111512 r8192 d31848 u262144 alloc=1*2097152
[    0.000000] pcpu-alloc: [0] 0 1 2 3 4 5 6 7 
[    0.000000] Built 1 zonelists in Node order, mobility grouping on.  Total pages: 2047537
[    0.000000] Policy zone: Normal
[    0.000000] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-4.11.0-1-amd64 root=UUID=eac70b67-fc4f-4197-8ce6-6e234b7c12f3 ro quiet
[    0.000000] PID hash table entries: 4096 (order: 3, 32768 bytes)
[    0.000000] Calgary: detecting Calgary via BIOS EBDA area
[    0.000000] Calgary: Unable to locate Rio Grande table in EBDA - bailing!
[    0.000000] Memory: 8088252K/8320244K available (6464K kernel code, 1175K rwdata, 2788K rodata, 1436K init, 684K bss, 231992K reserved, 0K cma-reserved)
[    0.000000] Hierarchical RCU implementation.
[    0.000000] 	Build-time adjustment of leaf fanout to 64.
[    0.000000] 	RCU restricting CPUs from NR_CPUS=512 to nr_cpu_ids=8.
[    0.000000] RCU: Adjusting geometry for rcu_fanout_leaf=64, nr_cpu_ids=8
[    0.000000] NR_IRQS:33024 nr_irqs:2048 16
[    0.000000] Console: colour VGA+ 80x25
[    0.000000] console [tty0] enabled
[    0.000000] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 79635855245 ns
[    0.000000] hpet clockevent registered
[    0.004000] tsc: Detected 3400.000 MHz processor
[    0.004000] Calibrating delay loop (skipped), value calculated using timer frequency.. 6816.00 BogoMIPS (lpj=13632000)
[    0.004000] pid_max: default: 32768 minimum: 301
[    0.004000] ACPI: Core revision 20170119
[    0.030702] ACPI: 10 ACPI AML tables successfully acquired and loaded
[    0.030736] Security Framework initialized
[    0.030737] Yama: disabled by default; enable with sysctl kernel.yama.*
[    0.030741] AppArmor: AppArmor disabled by boot time parameter
[    0.031001] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes)
[    0.032469] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes)
[    0.033136] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes)
[    0.033140] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes)
[    0.033306] CPU: Physical Processor ID: 0
[    0.033306] CPU: Processor Core ID: 0
[    0.033309] ENERGY_PERF_BIAS: Set to 'normal', was 'performance'
[    0.033309] ENERGY_PERF_BIAS: View and update with x86_energy_perf_policy(8)
[    0.033312] mce: CPU supports 10 MCE banks
[    0.033319] CPU0: Thermal monitoring enabled (TM1)
[    0.033332] process: using mwait in idle threads
[    0.033334] Last level iTLB entries: 4KB 64, 2MB 8, 4MB 8
[    0.033334] Last level dTLB entries: 4KB 64, 2MB 0, 4MB 0, 1GB 4
[    0.033397] Freeing SMP alternatives memory: 24K
[    0.036006] ftrace: allocating 25929 entries in 102 pages
[    0.040037] smpboot: Max logical packages: 2
[    0.040040] DMAR: Host address width 39
[    0.040041] DMAR: DRHD base: 0x000000fed90000 flags: 0x1
[    0.040045] DMAR: dmar0: reg_base_addr fed90000 ver 1:0 cap d2008c40660462 ecap f050da
[    0.040046] DMAR: RMRR base: 0x0000009df46000 end: 0x0000009df65fff
[    0.040047] DMAR: ANDD device: 1 name: \_SB.PCI0.I2C0
[    0.040047] DMAR: ANDD device: 2 name: \_SB.PCI0.I2C1
[    0.040047] DMAR: ANDD device: 9 name: \_SB.PCI0.UA00
[    0.040049] DMAR-IR: IOAPIC id 2 under DRHD base  0xfed90000 IOMMU 0
[    0.040049] DMAR-IR: HPET id 0 under DRHD base 0xfed90000
[    0.040049] DMAR-IR: Queued invalidation will be enabled to support x2apic and Intr-remapping.
[    0.045243] DMAR-IR: Enabled IRQ remapping in x2apic mode
[    0.045244] x2apic enabled
[    0.045253] Switched APIC routing to cluster x2apic.
[    0.049242] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
[    0.088957] TSC deadline timer enabled
[    0.088962] smpboot: CPU0: Intel(R) Xeon(R) CPU E3-1230 v5 @ 3.40GHz (family: 0x6, model: 0x5e, stepping: 0x3)
[    0.088999] Performance Events: PEBS fmt3+, Skylake events, 32-deep LBR, full-width counters, Intel PMU driver.
[    0.089020] ... version:                4
[    0.089020] ... bit width:              48
[    0.089020] ... generic registers:      4
[    0.089021] ... value mask:             0000ffffffffffff
[    0.089021] ... max period:             00007fffffffffff
[    0.089021] ... fixed-purpose events:   3
[    0.089022] ... event mask:             000000070000000f
[    0.089380] NMI watchdog: enabled on all CPUs, permanently consumes one hw-PMU counter.
[    0.089389] smp: Bringing up secondary CPUs ...
[    0.089436] x86: Booting SMP configuration:
[    0.089436] .... node  #0, CPUs:      #1 #2 #3 #4 #5 #6 #7
[    0.648027] smp: Brought up 1 node, 8 CPUs
[    0.648027] smpboot: Total of 8 processors activated (54535.35 BogoMIPS)
[    0.652100] sched_clock: Marking stable (652000000, 0)->(663172958, -11172958)
[    0.652311] devtmpfs: initialized
[    0.652342] x86/mm: Memory block size: 128MB
[    0.653700] PM: Registering ACPI NVS region [mem 0x96e5e000-0x96e5efff] (4096 bytes)
[    0.653700] PM: Registering ACPI NVS region [mem 0x9e15a000-0x9e82ffff] (7168000 bytes)
[    0.653811] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns
[    0.653819] futex hash table entries: 2048 (order: 5, 131072 bytes)
[    0.653865] pinctrl core: initialized pinctrl subsystem
[    0.653931] NET: Registered protocol family 16
[    0.654045] cpuidle: using governor ladder
[    0.654059] cpuidle: using governor menu
[    0.654060] PCCT header not found.
[    0.654091] ACPI: bus type PCI registered
[    0.654091] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5
[    0.654138] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0xe0000000-0xefffffff] (base 0xe0000000)
[    0.654139] PCI: MMCONFIG at [mem 0xe0000000-0xefffffff] reserved in E820
[    0.654146] PCI: Using configuration type 1 for base access
[    0.654767] HugeTLB registered 1 GB page size, pre-allocated 0 pages
[    0.654767] HugeTLB registered 2 MB page size, pre-allocated 0 pages
[    0.654929] ACPI: Added _OSI(Module Device)
[    0.654930] ACPI: Added _OSI(Processor Device)
[    0.654930] ACPI: Added _OSI(3.0 _SCP Extensions)
[    0.654930] ACPI: Added _OSI(Processor Aggregator Device)
[    0.656041] ACPI: Executed 36 blocks of module-level executable AML code
[    0.663290] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored
[    0.711717] ACPI: Dynamic OEM Table Load:
[    0.711730] ACPI: SSDT 0xFFFF8F7D92411800 000717 (v02 PmRef  Cpu0Ist  00003000 INTL 20160422)
[    0.711837] ACPI: Executed 1 blocks of module-level executable AML code
[    0.711883] ACPI: \_PR_.CPU0: _OSC native thermal LVT Acked
[    0.712779] ACPI: Dynamic OEM Table Load:
[    0.712782] ACPI: SSDT 0xFFFF8F7D92509000 0003FF (v02 PmRef  Cpu0Cst  00003001 INTL 20160422)
[    0.712873] ACPI: Executed 1 blocks of module-level executable AML code
[    0.713148] ACPI: Dynamic OEM Table Load:
[    0.713152] ACPI: SSDT 0xFFFF8F7D92510000 00065C (v02 PmRef  ApIst    00003000 INTL 20160422)
[    0.713401] ACPI: Executed 1 blocks of module-level executable AML code
[    0.713534] ACPI: Dynamic OEM Table Load:
[    0.713537] ACPI: SSDT 0xFFFF8F7D9251A400 00018A (v02 PmRef  ApCst    00003000 INTL 20160422)
[    0.713627] ACPI: Executed 1 blocks of module-level executable AML code
[    0.716142] ACPI: Interpreter enabled
[    0.716171] ACPI: (supports S0 S3 S4 S5)
[    0.716172] ACPI: Using IOAPIC for interrupt routing
[    0.716213] HEST: Table parsing has been initialized.
[    0.716215] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug
[    0.718438] ACPI: Power Resource [PG00] (on)
[    0.718734] ACPI: Power Resource [PG01] (on)
[    0.719022] ACPI: Power Resource [PG02] (on)
[    0.720725] ACPI: Power Resource [WRST] (on)
[    0.720988] ACPI: Power Resource [WRST] (on)
[    0.721273] ACPI: Power Resource [WRST] (on)
[    0.721550] ACPI: Power Resource [WRST] (on)
[    0.721795] ACPI: Power Resource [WRST] (on)
[    0.722038] ACPI: Power Resource [WRST] (on)
[    0.722282] ACPI: Power Resource [WRST] (on)
[    0.722526] ACPI: Power Resource [WRST] (on)
[    0.722771] ACPI: Power Resource [WRST] (on)
[    0.723018] ACPI: Power Resource [WRST] (on)
[    0.723294] ACPI: Power Resource [WRST] (on)
[    0.723536] ACPI: Power Resource [WRST] (on)
[    0.723779] ACPI: Power Resource [WRST] (on)
[    0.724022] ACPI: Power Resource [WRST] (on)
[    0.724266] ACPI: Power Resource [WRST] (on)
[    0.724508] ACPI: Power Resource [WRST] (on)
[    0.724751] ACPI: Power Resource [WRST] (on)
[    0.725687] ACPI: Power Resource [WRST] (on)
[    0.725931] ACPI: Power Resource [WRST] (on)
[    0.726175] ACPI: Power Resource [WRST] (on)
[    0.731832] ACPI: Power Resource [FN00] (off)
[    0.731890] ACPI: Power Resource [FN01] (off)
[    0.731946] ACPI: Power Resource [FN02] (off)
[    0.732002] ACPI: Power Resource [FN03] (off)
[    0.732058] ACPI: Power Resource [FN04] (off)
[    0.732891] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-fe])
[    0.732895] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    0.734086] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME AER PCIeCapability]
[    0.734638] PCI host bridge to bus 0000:00
[    0.734639] pci_bus 0000:00: root bus resource [io  0x0000-0x0cf7 window]
[    0.734640] pci_bus 0000:00: root bus resource [io  0x0d00-0xffff window]
[    0.734640] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]
[    0.734641] pci_bus 0000:00: root bus resource [mem 0xa0000000-0xdfffffff window]
[    0.734642] pci_bus 0000:00: root bus resource [mem 0xfd000000-0xfe7fffff window]
[    0.734642] pci_bus 0000:00: root bus resource [bus 00-fe]
[    0.734647] pci 0000:00:00.0: [8086:1918] type 00 class 0x060000
[    0.734891] pci 0000:00:01.0: [8086:1901] type 01 class 0x060400
[    0.734919] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold
[    0.735018] pci 0000:00:01.0: System wakeup disabled by ACPI
[    0.735080] pci 0000:00:08.0: [8086:1911] type 00 class 0x088000
[    0.735087] pci 0000:00:08.0: reg 0x10: [mem 0xdf752000-0xdf752fff 64bit]
[    0.735213] pci 0000:00:14.0: [8086:a12f] type 00 class 0x0c0330
[    0.735228] pci 0000:00:14.0: reg 0x10: [mem 0xdf730000-0xdf73ffff 64bit]
[    0.735281] pci 0000:00:14.0: PME# supported from D3hot D3cold
[    0.735415] pci 0000:00:14.0: System wakeup disabled by ACPI
[    0.735438] pci 0000:00:14.2: [8086:a131] type 00 class 0x118000
[    0.735452] pci 0000:00:14.2: reg 0x10: [mem 0xdf751000-0xdf751fff 64bit]
[    0.735622] pci 0000:00:15.0: [8086:a160] type 00 class 0x118000
[    0.735663] pci 0000:00:15.0: reg 0x10: [mem 0xdf750000-0xdf750fff 64bit]
[    0.735871] pci 0000:00:15.1: [8086:a161] type 00 class 0x118000
[    0.735912] pci 0000:00:15.1: reg 0x10: [mem 0xdf74f000-0xdf74ffff 64bit]
[    0.736115] pci 0000:00:16.0: [8086:a13a] type 00 class 0x078000
[    0.736127] pci 0000:00:16.0: reg 0x10: [mem 0xdf74e000-0xdf74efff 64bit]
[    0.736171] pci 0000:00:16.0: PME# supported from D3hot
[    0.736288] pci 0000:00:17.0: [8086:a102] type 00 class 0x010601
[    0.736299] pci 0000:00:17.0: reg 0x10: [mem 0xdf748000-0xdf749fff]
[    0.736304] pci 0000:00:17.0: reg 0x14: [mem 0xdf74d000-0xdf74d0ff]
[    0.736310] pci 0000:00:17.0: reg 0x18: [io  0xf050-0xf057]
[    0.736316] pci 0000:00:17.0: reg 0x1c: [io  0xf040-0xf043]
[    0.736321] pci 0000:00:17.0: reg 0x20: [io  0xf020-0xf03f]
[    0.736326] pci 0000:00:17.0: reg 0x24: [mem 0xdf74c000-0xdf74c7ff]
[    0.736358] pci 0000:00:17.0: PME# supported from D3hot
[    0.736465] pci 0000:00:1b.0: [8086:a167] type 01 class 0x060400
[    0.736517] pci 0000:00:1b.0: PME# supported from D0 D3hot D3cold
[    0.736617] pci 0000:00:1b.0: System wakeup disabled by ACPI
[    0.736660] pci 0000:00:1c.0: [8086:a110] type 01 class 0x060400
[    0.736713] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold
[    0.736811] pci 0000:00:1c.0: System wakeup disabled by ACPI
[    0.736839] pci 0000:00:1c.4: [8086:a114] type 01 class 0x060400
[    0.736892] pci 0000:00:1c.4: PME# supported from D0 D3hot D3cold
[    0.736993] pci 0000:00:1c.4: System wakeup disabled by ACPI
[    0.737022] pci 0000:00:1d.0: [8086:a118] type 01 class 0x060400
[    0.737065] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold
[    0.737156] pci 0000:00:1d.0: System wakeup disabled by ACPI
[    0.737175] pci 0000:00:1d.1: [8086:a119] type 01 class 0x060400
[    0.737222] pci 0000:00:1d.1: PME# supported from D0 D3hot D3cold
[    0.737317] pci 0000:00:1d.1: System wakeup disabled by ACPI
[    0.737335] pci 0000:00:1d.2: [8086:a11a] type 01 class 0x060400
[    0.737381] pci 0000:00:1d.2: PME# supported from D0 D3hot D3cold
[    0.737476] pci 0000:00:1d.2: System wakeup disabled by ACPI
[    0.737549] pci 0000:00:1e.0: [8086:a127] type 00 class 0x118000
[    0.737591] pci 0000:00:1e.0: reg 0x10: [mem 0xdf74b000-0xdf74bfff 64bit]
[    0.737809] pci 0000:00:1f.0: [8086:a149] type 00 class 0x060100
[    0.737992] pci 0000:00:1f.2: [8086:a121] type 00 class 0x058000
[    0.738001] pci 0000:00:1f.2: reg 0x10: [mem 0xdf744000-0xdf747fff]
[    0.738139] pci 0000:00:1f.3: [8086:a170] type 00 class 0x040300
[    0.738159] pci 0000:00:1f.3: reg 0x10: [mem 0xdf740000-0xdf743fff 64bit]
[    0.738187] pci 0000:00:1f.3: reg 0x20: [mem 0xdf720000-0xdf72ffff 64bit]
[    0.738229] pci 0000:00:1f.3: PME# supported from D3hot D3cold
[    0.738358] pci 0000:00:1f.3: System wakeup disabled by ACPI
[    0.738384] pci 0000:00:1f.4: [8086:a123] type 00 class 0x0c0500
[    0.738431] pci 0000:00:1f.4: reg 0x10: [mem 0xdf74a000-0xdf74a0ff 64bit]
[    0.738499] pci 0000:00:1f.4: reg 0x20: [io  0xf000-0xf01f]
[    0.738671] pci 0000:00:1f.6: [8086:15b7] type 00 class 0x020000
[    0.738690] pci 0000:00:1f.6: reg 0x10: [mem 0xdf700000-0xdf71ffff]
[    0.738790] pci 0000:00:1f.6: PME# supported from D0 D3hot D3cold
[    0.738876] pci 0000:00:1f.6: System wakeup disabled by ACPI
[    0.738920] pci 0000:01:00.0: [8086:10fb] type 00 class 0x020000
[    0.738930] pci 0000:01:00.0: reg 0x10: [mem 0xdf200000-0xdf2fffff 64bit]
[    0.738934] pci 0000:01:00.0: reg 0x18: [io  0xe020-0xe03f]
[    0.738945] pci 0000:01:00.0: reg 0x20: [mem 0xdf404000-0xdf407fff 64bit]
[    0.738949] pci 0000:01:00.0: reg 0x30: [mem 0xdf380000-0xdf3fffff pref]
[    0.738983] pci 0000:01:00.0: PME# supported from D0 D3hot
[    0.738997] pci 0000:01:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref]
[    0.738998] pci 0000:01:00.0: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs)
[    0.739007] pci 0000:01:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref]
[    0.739008] pci 0000:01:00.0: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs)
[    0.739102] pci 0000:01:00.0: System wakeup disabled by ACPI
[    0.739124] pci 0000:01:00.1: [8086:10fb] type 00 class 0x020000
[    0.739134] pci 0000:01:00.1: reg 0x10: [mem 0xdf100000-0xdf1fffff 64bit]
[    0.739138] pci 0000:01:00.1: reg 0x18: [io  0xe000-0xe01f]
[    0.739149] pci 0000:01:00.1: reg 0x20: [mem 0xdf400000-0xdf403fff 64bit]
[    0.739153] pci 0000:01:00.1: reg 0x30: [mem 0xdf300000-0xdf37ffff pref]
[    0.739186] pci 0000:01:00.1: PME# supported from D0 D3hot
[    0.739200] pci 0000:01:00.1: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref]
[    0.739200] pci 0000:01:00.1: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs)
[    0.739209] pci 0000:01:00.1: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref]
[    0.739210] pci 0000:01:00.1: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs)
[    0.749001] pci 0000:00:01.0: PCI bridge to [bus 01]
[    0.749006] pci 0000:00:01.0:   bridge window [io  0xe000-0xefff]
[    0.749011] pci 0000:00:01.0:   bridge window [mem 0xdf100000-0xdf4fffff]
[    0.749019] pci 0000:00:01.0: bridge has subordinate 01 but max busn 02
[    0.749083] pci 0000:00:1b.0: PCI bridge to [bus 02]
[    0.749122] pci 0000:00:1c.0: PCI bridge to [bus 03]
[    0.749185] pci 0000:04:00.0: [8086:1563] type 00 class 0x020000
[    0.749204] pci 0000:04:00.0: reg 0x10: [mem 0xdfc00000-0xdfdfffff 64bit pref]
[    0.749234] pci 0000:04:00.0: reg 0x20: [mem 0xdfe04000-0xdfe07fff 64bit pref]
[    0.749243] pci 0000:04:00.0: reg 0x30: [mem 0xdf680000-0xdf6fffff pref]
[    0.749317] pci 0000:04:00.0: PME# supported from D0 D3hot D3cold
[    0.749353] pci 0000:04:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit]
[    0.749353] pci 0000:04:00.0: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit] (contains BAR0 for 64 VFs)
[    0.749373] pci 0000:04:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit]
[    0.749374] pci 0000:04:00.0: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit] (contains BAR3 for 64 VFs)
[    0.749638] pci 0000:04:00.0: System wakeup disabled by ACPI
[    0.749672] pci 0000:04:00.1: [8086:1563] type 00 class 0x020000
[    0.749691] pci 0000:04:00.1: reg 0x10: [mem 0xdfa00000-0xdfbfffff 64bit pref]
[    0.749721] pci 0000:04:00.1: reg 0x20: [mem 0xdfe00000-0xdfe03fff 64bit pref]
[    0.749730] pci 0000:04:00.1: reg 0x30: [mem 0xdf600000-0xdf67ffff pref]
[    0.749804] pci 0000:04:00.1: PME# supported from D0 D3hot D3cold
[    0.749835] pci 0000:04:00.1: reg 0x184: [mem 0x00000000-0x00003fff 64bit]
[    0.749836] pci 0000:04:00.1: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit] (contains BAR0 for 64 VFs)
[    0.749855] pci 0000:04:00.1: reg 0x190: [mem 0x00000000-0x00003fff 64bit]
[    0.749856] pci 0000:04:00.1: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit] (contains BAR3 for 64 VFs)
[    0.761024] pci 0000:00:1c.4: PCI bridge to [bus 04]
[    0.761032] pci 0000:00:1c.4:   bridge window [mem 0xdf600000-0xdf6fffff]
[    0.761040] pci 0000:00:1c.4:   bridge window [mem 0xdfa00000-0xdfefffff 64bit pref]
[    0.761097] acpiphp: Slot [1] registered
[    0.761100] pci 0000:00:1d.0: PCI bridge to [bus 05]
[    0.761172] pci 0000:06:00.0: [8086:1533] type 00 class 0x020000
[    0.761192] pci 0000:06:00.0: reg 0x10: [mem 0xdf500000-0xdf57ffff]
[    0.761215] pci 0000:06:00.0: reg 0x18: [io  0xd000-0xd01f]
[    0.761227] pci 0000:06:00.0: reg 0x1c: [mem 0xdf580000-0xdf583fff]
[    0.761355] pci 0000:06:00.0: PME# supported from D0 D3hot D3cold
[    0.761432] pci 0000:06:00.0: System wakeup disabled by ACPI
[    0.773035] pci 0000:00:1d.1: PCI bridge to [bus 06]
[    0.773040] pci 0000:00:1d.1:   bridge window [io  0xd000-0xdfff]
[    0.773045] pci 0000:00:1d.1:   bridge window [mem 0xdf500000-0xdf5fffff]
[    0.773121] pci 0000:07:00.0: [1a03:1150] type 01 class 0x060400
[    0.773229] pci 0000:07:00.0: supports D1 D2
[    0.773229] pci 0000:07:00.0: PME# supported from D0 D1 D2 D3hot D3cold
[    0.773293] pci 0000:07:00.0: System wakeup disabled by ACPI
[    0.773309] pci 0000:07:00.0: disabling ASPM on pre-1.1 PCIe device.  You can enable it with 'pcie_aspm=force'
[    0.773315] pci 0000:00:1d.2: PCI bridge to [bus 07-08]
[    0.773316] pci 0000:00:1d.2:   bridge window [io  0xc000-0xcfff]
[    0.773318] pci 0000:00:1d.2:   bridge window [mem 0xde000000-0xdf0fffff]
[    0.773370] pci 0000:08:00.0: [1a03:2000] type 00 class 0x030000
[    0.773391] pci 0000:08:00.0: reg 0x10: [mem 0xde000000-0xdeffffff]
[    0.773402] pci 0000:08:00.0: reg 0x14: [mem 0xdf000000-0xdf01ffff]
[    0.773413] pci 0000:08:00.0: reg 0x18: [io  0xc000-0xc07f]
[    0.773502] pci 0000:08:00.0: supports D1 D2
[    0.773502] pci 0000:08:00.0: PME# supported from D0 D1 D2 D3hot D3cold
[    0.773573] pci 0000:07:00.0: PCI bridge to [bus 08]
[    0.773578] pci 0000:07:00.0:   bridge window [io  0xc000-0xcfff]
[    0.773582] pci 0000:07:00.0:   bridge window [mem 0xde000000-0xdf0fffff]
[    0.776847] ACPI: PCI Interrupt Link [LNKA] (IRQs 3 4 5 6 10 *11 12 14 15)
[    0.776884] ACPI: PCI Interrupt Link [LNKB] (IRQs 3 4 5 6 *10 11 12 14 15)
[    0.776919] ACPI: PCI Interrupt Link [LNKC] (IRQs 3 4 5 6 10 *11 12 14 15)
[    0.776954] ACPI: PCI Interrupt Link [LNKD] (IRQs 3 4 5 6 10 *11 12 14 15)
[    0.776989] ACPI: PCI Interrupt Link [LNKE] (IRQs 3 4 5 6 10 *11 12 14 15)
[    0.777028] ACPI: PCI Interrupt Link [LNKF] (IRQs 3 4 5 6 10 *11 12 14 15)
[    0.777062] ACPI: PCI Interrupt Link [LNKG] (IRQs 3 4 5 6 10 *11 12 14 15)
[    0.777097] ACPI: PCI Interrupt Link [LNKH] (IRQs 3 4 5 6 10 *11 12 14 15)
[    0.777392] ACPI: Enabled 4 GPEs in block 00 to 7F
[    0.777449] pci 0000:08:00.0: vgaarb: setting as boot VGA device
[    0.777450] pci 0000:08:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none
[    0.777451] pci 0000:08:00.0: vgaarb: bridge control possible
[    0.777451] vgaarb: loaded
[    0.777487] PCI: Using ACPI for IRQ routing
[    0.804947] PCI: pci_cache_line_size set to 64 bytes
[    0.805089] e820: reserve RAM buffer [mem 0x00098c00-0x0009ffff]
[    0.805090] e820: reserve RAM buffer [mem 0x96e5e000-0x97ffffff]
[    0.805090] e820: reserve RAM buffer [mem 0x9dc71000-0x9fffffff]
[    0.805091] e820: reserve RAM buffer [mem 0x9e15a000-0x9fffffff]
[    0.805091] e820: reserve RAM buffer [mem 0x9f000000-0x9fffffff]
[    0.805092] e820: reserve RAM buffer [mem 0x25e000000-0x25fffffff]
[    0.805202] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0
[    0.805205] hpet0: 8 comparators, 64-bit 24.000000 MHz counter
[    0.807245] clocksource: Switched to clocksource hpet
[    0.812521] VFS: Disk quotas dquot_6.6.0
[    0.812541] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[    0.812590] pnp: PnP ACPI init
[    0.812831] system 00:00: [io  0x0a00-0x0a0f] has been reserved
[    0.812832] system 00:00: [io  0x0a10-0x0a1f] has been reserved
[    0.812833] system 00:00: [io  0x0a20-0x0a2f] has been reserved
[    0.812833] system 00:00: [io  0x0a30-0x0a3f] has been reserved
[    0.812834] system 00:00: [io  0x0a40-0x0a4f] has been reserved
[    0.812836] system 00:00: Plug and Play ACPI device, IDs PNP0c02 (active)
[    0.813057] pnp 00:01: [dma 0 disabled]
[    0.813081] pnp 00:01: Plug and Play ACPI device, IDs PNP0501 (active)
[    0.813291] pnp 00:02: [dma 0 disabled]
[    0.813312] pnp 00:02: Plug and Play ACPI device, IDs PNP0501 (active)
[    0.813415] system 00:03: [io  0x0680-0x069f] has been reserved
[    0.813416] system 00:03: [io  0xffff] has been reserved
[    0.813417] system 00:03: [io  0xffff] has been reserved
[    0.813418] system 00:03: [io  0xffff] has been reserved
[    0.813418] system 00:03: [io  0x1800-0x18fe] has been reserved
[    0.813419] system 00:03: [io  0x164e-0x164f] has been reserved
[    0.813420] system 00:03: Plug and Play ACPI device, IDs PNP0c02 (active)
[    0.813487] system 00:04: [io  0x0800-0x087f] has been reserved
[    0.813488] system 00:04: Plug and Play ACPI device, IDs PNP0c02 (active)
[    0.813500] pnp 00:05: Plug and Play ACPI device, IDs PNP0b00 (active)
[    0.813525] system 00:06: [io  0x1854-0x1857] has been reserved
[    0.813526] system 00:06: Plug and Play ACPI device, IDs INT3f0d PNP0c02 (active)
[    0.813727] system 00:07: [mem 0xfed10000-0xfed17fff] has been reserved
[    0.813728] system 00:07: [mem 0xfed18000-0xfed18fff] has been reserved
[    0.813729] system 00:07: [mem 0xfed19000-0xfed19fff] has been reserved
[    0.813730] system 00:07: [mem 0xe0000000-0xefffffff] has been reserved
[    0.813730] system 00:07: [mem 0xfed20000-0xfed3ffff] has been reserved
[    0.813731] system 00:07: [mem 0xfed90000-0xfed93fff] could not be reserved
[    0.813732] system 00:07: [mem 0xfed45000-0xfed8ffff] has been reserved
[    0.813733] system 00:07: [mem 0xff000000-0xffffffff] has been reserved
[    0.813734] system 00:07: [mem 0xfee00000-0xfeefffff] could not be reserved
[    0.813734] system 00:07: [mem 0xdffe0000-0xdfffffff] has been reserved
[    0.813736] system 00:07: Plug and Play ACPI device, IDs PNP0c02 (active)
[    0.813764] system 00:08: [mem 0xfd000000-0xfdabffff] has been reserved
[    0.813764] system 00:08: [mem 0xfdad0000-0xfdadffff] has been reserved
[    0.813765] system 00:08: [mem 0xfdb00000-0xfdffffff] has been reserved
[    0.813766] system 00:08: [mem 0xfe000000-0xfe01ffff] could not be reserved
[    0.813767] system 00:08: [mem 0xfe036000-0xfe03bfff] has been reserved
[    0.813768] system 00:08: [mem 0xfe03d000-0xfe3fffff] has been reserved
[    0.813768] system 00:08: [mem 0xfe410000-0xfe7fffff] has been reserved
[    0.813769] system 00:08: Plug and Play ACPI device, IDs PNP0c02 (active)
[    0.813990] system 00:09: [io  0xff00-0xfffe] has been reserved
[    0.813991] system 00:09: Plug and Play ACPI device, IDs PNP0c02 (active)
[    0.814747] system 00:0a: Plug and Play ACPI device, IDs PNP0c02 (active)
[    0.815443] pnp: PnP ACPI: found 11 devices
[    0.822849] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns
[    0.822852] pci_bus 0000:00: max bus depth: 2 pci_try_num: 3
[    0.822892] pci 0000:00:01.0: BAR 15: assigned [mem 0xa0000000-0xa03fffff 64bit pref]
[    0.822894] pci 0000:01:00.0: BAR 7: assigned [mem 0xa0000000-0xa00fffff 64bit pref]
[    0.822897] pci 0000:01:00.0: BAR 10: assigned [mem 0xa0100000-0xa01fffff 64bit pref]
[    0.822899] pci 0000:01:00.1: BAR 7: assigned [mem 0xa0200000-0xa02fffff 64bit pref]
[    0.822901] pci 0000:01:00.1: BAR 10: assigned [mem 0xa0300000-0xa03fffff 64bit pref]
[    0.822903] pci 0000:00:01.0: PCI bridge to [bus 01]
[    0.822904] pci 0000:00:01.0:   bridge window [io  0xe000-0xefff]
[    0.822906] pci 0000:00:01.0:   bridge window [mem 0xdf100000-0xdf4fffff]
[    0.822907] pci 0000:00:01.0:   bridge window [mem 0xa0000000-0xa03fffff 64bit pref]
[    0.822910] pci 0000:00:1b.0: PCI bridge to [bus 02]
[    0.822916] pci 0000:00:1c.0: PCI bridge to [bus 03]
[    0.822923] pci 0000:04:00.0: BAR 7: no space for [mem size 0x00100000 64bit]
[    0.822924] pci 0000:04:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit]
[    0.822925] pci 0000:04:00.0: BAR 10: no space for [mem size 0x00100000 64bit]
[    0.822926] pci 0000:04:00.0: BAR 10: failed to assign [mem size 0x00100000 64bit]
[    0.822926] pci 0000:04:00.1: BAR 7: no space for [mem size 0x00100000 64bit]
[    0.822927] pci 0000:04:00.1: BAR 7: failed to assign [mem size 0x00100000 64bit]
[    0.822928] pci 0000:04:00.1: BAR 10: no space for [mem size 0x00100000 64bit]
[    0.822928] pci 0000:04:00.1: BAR 10: failed to assign [mem size 0x00100000 64bit]
[    0.822929] pci 0000:00:1c.4: PCI bridge to [bus 04]
[    0.822932] pci 0000:00:1c.4:   bridge window [mem 0xdf600000-0xdf6fffff]
[    0.822934] pci 0000:00:1c.4:   bridge window [mem 0xdfa00000-0xdfefffff 64bit pref]
[    0.822937] pci 0000:00:1d.0: PCI bridge to [bus 05]
[    0.822943] pci 0000:00:1d.1: PCI bridge to [bus 06]
[    0.822944] pci 0000:00:1d.1:   bridge window [io  0xd000-0xdfff]
[    0.822946] pci 0000:00:1d.1:   bridge window [mem 0xdf500000-0xdf5fffff]
[    0.822950] pci 0000:07:00.0: PCI bridge to [bus 08]
[    0.822952] pci 0000:07:00.0:   bridge window [io  0xc000-0xcfff]
[    0.822956] pci 0000:07:00.0:   bridge window [mem 0xde000000-0xdf0fffff]
[    0.822965] pci 0000:00:1d.2: PCI bridge to [bus 07-08]
[    0.822966] pci 0000:00:1d.2:   bridge window [io  0xc000-0xcfff]
[    0.822968] pci 0000:00:1d.2:   bridge window [mem 0xde000000-0xdf0fffff]
[    0.822973] pci_bus 0000:00: No. 2 try to assign unassigned res
[    0.822973] release child resource [mem 0xdf600000-0xdf67ffff pref]
[    0.822974] release child resource [mem 0xdf680000-0xdf6fffff pref]
[    0.822974] pci 0000:00:1c.4: resource 14 [mem 0xdf600000-0xdf6fffff] released
[    0.822975] pci 0000:00:1c.4: PCI bridge to [bus 04]
[    0.823012] pci 0000:00:1c.4: BAR 14: assigned [mem 0xa0400000-0xa08fffff]
[    0.823013] pci 0000:00:01.0: PCI bridge to [bus 01]
[    0.823014] pci 0000:00:01.0:   bridge window [io  0xe000-0xefff]
[    0.823015] pci 0000:00:01.0:   bridge window [mem 0xdf100000-0xdf4fffff]
[    0.823017] pci 0000:00:01.0:   bridge window [mem 0xa0000000-0xa03fffff 64bit pref]
[    0.823019] pci 0000:00:1b.0: PCI bridge to [bus 02]
[    0.823025] pci 0000:00:1c.0: PCI bridge to [bus 03]
[    0.823032] pci 0000:04:00.0: BAR 6: assigned [mem 0xa0400000-0xa047ffff pref]
[    0.823033] pci 0000:04:00.1: BAR 6: assigned [mem 0xa0480000-0xa04fffff pref]
[    0.823034] pci 0000:04:00.0: BAR 7: assigned [mem 0xa0500000-0xa05fffff 64bit]
[    0.823041] pci 0000:04:00.0: BAR 10: assigned [mem 0xa0600000-0xa06fffff 64bit]
[    0.823045] pci 0000:04:00.1: BAR 7: assigned [mem 0xa0700000-0xa07fffff 64bit]
[    0.823049] pci 0000:04:00.1: BAR 10: assigned [mem 0xa0800000-0xa08fffff 64bit]
[    0.823053] pci 0000:00:1c.4: PCI bridge to [bus 04]
[    0.823055] pci 0000:00:1c.4:   bridge window [mem 0xa0400000-0xa08fffff]
[    0.823057] pci 0000:00:1c.4:   bridge window [mem 0xdfa00000-0xdfefffff 64bit pref]
[    0.823060] pci 0000:00:1d.0: PCI bridge to [bus 05]
[    0.823065] pci 0000:00:1d.1: PCI bridge to [bus 06]
[    0.823066] pci 0000:00:1d.1:   bridge window [io  0xd000-0xdfff]
[    0.823069] pci 0000:00:1d.1:   bridge window [mem 0xdf500000-0xdf5fffff]
[    0.823073] pci 0000:07:00.0: PCI bridge to [bus 08]
[    0.823075] pci 0000:07:00.0:   bridge window [io  0xc000-0xcfff]
[    0.823079] pci 0000:07:00.0:   bridge window [mem 0xde000000-0xdf0fffff]
[    0.823088] pci 0000:00:1d.2: PCI bridge to [bus 07-08]
[    0.823089] pci 0000:00:1d.2:   bridge window [io  0xc000-0xcfff]
[    0.823091] pci 0000:00:1d.2:   bridge window [mem 0xde000000-0xdf0fffff]
[    0.823095] pci_bus 0000:00: resource 4 [io  0x0000-0x0cf7 window]
[    0.823096] pci_bus 0000:00: resource 5 [io  0x0d00-0xffff window]
[    0.823097] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]
[    0.823097] pci_bus 0000:00: resource 7 [mem 0xa0000000-0xdfffffff window]
[    0.823098] pci_bus 0000:00: resource 8 [mem 0xfd000000-0xfe7fffff window]
[    0.823099] pci_bus 0000:01: resource 0 [io  0xe000-0xefff]
[    0.823099] pci_bus 0000:01: resource 1 [mem 0xdf100000-0xdf4fffff]
[    0.823100] pci_bus 0000:01: resource 2 [mem 0xa0000000-0xa03fffff 64bit pref]
[    0.823101] pci_bus 0000:04: resource 1 [mem 0xa0400000-0xa08fffff]
[    0.823101] pci_bus 0000:04: resource 2 [mem 0xdfa00000-0xdfefffff 64bit pref]
[    0.823102] pci_bus 0000:06: resource 0 [io  0xd000-0xdfff]
[    0.823103] pci_bus 0000:06: resource 1 [mem 0xdf500000-0xdf5fffff]
[    0.823103] pci_bus 0000:07: resource 0 [io  0xc000-0xcfff]
[    0.823104] pci_bus 0000:07: resource 1 [mem 0xde000000-0xdf0fffff]
[    0.823104] pci_bus 0000:08: resource 0 [io  0xc000-0xcfff]
[    0.823105] pci_bus 0000:08: resource 1 [mem 0xde000000-0xdf0fffff]
[    0.823276] NET: Registered protocol family 2
[    0.823374] TCP established hash table entries: 65536 (order: 7, 524288 bytes)
[    0.823461] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes)
[    0.823619] TCP: Hash tables configured (established 65536 bind 65536)
[    0.823641] UDP hash table entries: 4096 (order: 5, 131072 bytes)
[    0.823664] UDP-Lite hash table entries: 4096 (order: 5, 131072 bytes)
[    0.823715] NET: Registered protocol family 1
[    0.823982] pci 0000:08:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]
[    0.823984] PCI: CLS 64 bytes, default 64
[    0.824008] Unpacking initramfs...
[    1.040233] Freeing initrd memory: 17952K
[    1.040295] DMAR: ACPI device "device:7d" under DMAR at fed90000 as 00:15.0
[    1.040297] DMAR: ACPI device "device:7e" under DMAR at fed90000 as 00:15.1
[    1.040299] DMAR: ACPI device "device:7f" under DMAR at fed90000 as 00:1e.0
[    1.040323] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)
[    1.040325] software IO TLB [mem 0x99c71000-0x9dc71000] (64MB) mapped at [ffff8f7bd9c71000-ffff8f7bddc70fff]
[    1.040342] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x311fd3cd494, max_idle_ns: 440795223879 ns
[    1.040754] audit: initializing netlink subsys (disabled)
[    1.040831] audit: type=2000 audit(1501895097.992:1): state=initialized audit_enabled=0 res=1
[    1.041046] workingset: timestamp_bits=40 max_order=21 bucket_order=0
[    1.041209] zbud: loaded
[    1.042241] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 250)
[    1.042288] io scheduler noop registered
[    1.042288] io scheduler deadline registered
[    1.042304] io scheduler cfq registered (default)
[    1.042304] io scheduler mq-deadline registered
[    1.043417] pcieport 0000:00:01.0: AER enabled with IRQ 313
[    1.043432] pcieport 0000:00:1b.0: AER enabled with IRQ 314
[    1.043448] pcieport 0000:00:1c.0: AER enabled with IRQ 315
[    1.043463] pcieport 0000:00:1c.4: AER enabled with IRQ 316
[    1.043476] pcieport 0000:00:1d.1: AER enabled with IRQ 318
[    1.043489] pcieport 0000:00:1d.2: AER enabled with IRQ 319
[    1.043495] pcieport 0000:00:01.0: Signaling PME with IRQ 313
[    1.043502] pcieport 0000:00:1b.0: Signaling PME with IRQ 314
[    1.043509] pcieport 0000:00:1c.0: Signaling PME with IRQ 315
[    1.043516] pcieport 0000:00:1c.4: Signaling PME with IRQ 316
[    1.043525] pcieport 0000:00:1d.0: Signaling PME with IRQ 317
[    1.043532] pcieport 0000:00:1d.1: Signaling PME with IRQ 318
[    1.043538] pcieport 0000:00:1d.2: Signaling PME with IRQ 319
[    1.043552] intel_idle: MWAIT substates: 0x142120
[    1.043552] intel_idle: v0.4.1 model 0x5E
[    1.043837] intel_idle: lapic_timer_reliable_states 0xffffffff
[    1.043975] ERST: Error Record Serialization Table (ERST) support is initialized.
[    1.043975] pstore: using zlib compression
[    1.043977] pstore: Registered erst as persistent store backend
[    1.044020] GHES: APEI firmware first mode is enabled by APEI bit.
[    1.044065] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled
[    1.064869] 00:01: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A
[    1.085744] 00:02: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A
[    1.086138] Linux agpgart interface v0.103
[    1.086185] AMD IOMMUv2 driver by Joerg Roedel <jroedel@suse.de>
[    1.086186] AMD IOMMUv2 functionality not available on this system
[    1.086648] i8042: PNP: No PS/2 controller found.
[    1.086765] mousedev: PS/2 mouse device common for all mice
[    1.086784] rtc_cmos 00:05: RTC can wake from S4
[    1.087179] rtc_cmos 00:05: rtc core: registered rtc_cmos as rtc0
[    1.087295] rtc_cmos 00:05: alarms up to one month, y3k, 242 bytes nvram, hpet irqs
[    1.087299] intel_pstate: Intel P-state driver initializing
[    1.088103] intel_pstate: HWP enabled
[    1.088384] ledtrig-cpu: registered to indicate activity on CPUs
[    1.088660] NET: Registered protocol family 10
[    1.088912] Segment Routing with IPv6
[    1.088932] mip6: Mobile IPv6
[    1.088933] NET: Registered protocol family 17
[    1.088934] mpls_gso: MPLS GSO support
[    1.089504] microcode: sig=0x506e3, pf=0x2, revision=0xa6
[    1.089849] microcode: Microcode Update Driver: v2.2.
[    1.089982] registered taskstats version 1
[    1.089991] zswap: loaded using pool lzo/zbud
[    1.090208] ima: No TPM chip found, activating TPM-bypass! (rc=-19)
[    1.091309] rtc_cmos 00:05: setting system clock to 2017-08-05 01:04:58 UTC (1501895098)
[    1.091349] PM: Hibernation image not present or could not be loaded.
[    1.092080] Freeing unused kernel memory: 1436K
[    1.092081] Write protecting the kernel read-only data: 12288k
[    1.092596] Freeing unused kernel memory: 1712K
[    1.094008] Freeing unused kernel memory: 1308K
[    1.094753] x86/mm: Checked W+X mappings: passed, no W+X pages found.
[    1.132116] hidraw: raw HID events driver (C) Jiri Kosina
[    1.133847] (NULL device *): hwmon_device_register() is deprecated. Please convert the driver to use hwmon_device_register_with_info().
[    1.133877] thermal LNXTHERM:00: registered as thermal_zone0
[    1.133878] ACPI: Thermal Zone [TZ00] (28 C)
[    1.133962] thermal LNXTHERM:01: registered as thermal_zone1
[    1.133963] ACPI: Thermal Zone [TZ01] (30 C)
[    1.135027] pps_core: LinuxPPS API ver. 1 registered
[    1.135027] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
[    1.135365] PTP clock support registered
[    1.135949] dca service started, version 1.12.1
[    1.136226] SCSI subsystem initialized
[    1.136478] ACPI: bus type USB registered
[    1.136489] usbcore: registered new interface driver usbfs
[    1.136493] usbcore: registered new interface driver hub
[    1.136514] usbcore: registered new device driver usb
[    1.137471] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver - version 5.0.0-k
[    1.137472] ixgbe: Copyright (c) 1999-2016 Intel Corporation.
[    1.137537] libata version 3.00 loaded.
[    1.138323] xhci_hcd 0000:00:14.0: xHCI Host Controller
[    1.138328] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 1
[    1.138513] igb: Intel(R) Gigabit Ethernet Network Driver - version 5.4.0-k
[    1.138513] igb: Copyright (c) 2007-2014 Intel Corporation.
[    1.139504] xhci_hcd 0000:00:14.0: hcc params 0x200077c1 hci version 0x100 quirks 0x00109810
[    1.139514] xhci_hcd 0000:00:14.0: cache line size of 64 is not supported
[    1.139587] e1000e: Intel(R) PRO/1000 Network Driver - 3.2.6-k
[    1.139588] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.
[    1.139618] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002
[    1.139619] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    1.139620] usb usb1: Product: xHCI Host Controller
[    1.139620] usb usb1: Manufacturer: Linux 4.11.0-1-amd64 xhci-hcd
[    1.139621] usb usb1: SerialNumber: 0000:00:14.0
[    1.139702] hub 1-0:1.0: USB hub found
[    1.139730] hub 1-0:1.0: 16 ports detected
[    1.143992] AVX2 version of gcm_enc/dec engaged.
[    1.143993] AES CTR mode by8 optimization enabled
[    1.150030] xhci_hcd 0000:00:14.0: xHCI Host Controller
[    1.150033] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 2
[    1.150059] usb usb2: New USB device found, idVendor=1d6b, idProduct=0003
[    1.150059] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    1.150060] usb usb2: Product: xHCI Host Controller
[    1.150061] usb usb2: Manufacturer: Linux 4.11.0-1-amd64 xhci-hcd
[    1.150061] usb usb2: SerialNumber: 0000:00:14.0
[    1.150146] hub 2-0:1.0: USB hub found
[    1.150164] hub 2-0:1.0: 10 ports detected
[    1.153618] usb: port power management may be unreliable
[    1.162646] ahci 0000:00:17.0: version 3.0
[    1.173014] ahci 0000:00:17.0: AHCI 0001.0301 32 slots 4 ports 6 Gbps 0xf impl SATA mode
[    1.173017] ahci 0000:00:17.0: flags: 64bit ncq sntf led clo only pio slum part ems deso sadm sds apst 
[    1.208919] scsi host0: ahci
[    1.209127] scsi host1: ahci
[    1.209379] scsi host2: ahci
[    1.209700] scsi host3: ahci
[    1.209771] ata1: SATA max UDMA/133 abar m2048@0xdf74c000 port 0xdf74c100 irq 321
[    1.209773] ata2: SATA max UDMA/133 abar m2048@0xdf74c000 port 0xdf74c180 irq 321
[    1.209775] ata3: SATA max UDMA/133 abar m2048@0xdf74c000 port 0xdf74c200 irq 321
[    1.209777] ata4: SATA max UDMA/133 abar m2048@0xdf74c000 port 0xdf74c280 irq 321
[    1.210104] i801_smbus 0000:00:1f.4: SPD Write Disable is set
[    1.210145] i801_smbus 0000:00:1f.4: SMBus using PCI interrupt
[    1.213607] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode
[    1.305043] ixgbe 0000:01:00.0: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8
[    1.305174] ixgbe 0000:01:00.0: PCI Express bandwidth of 32GT/s available
[    1.305176] ixgbe 0000:01:00.0: (Speed:5.0GT/s, Width: x8, Encoding Loss:20%)
[    1.305510] ixgbe 0000:01:00.0: MAC: 2, PHY: 12, SFP+: 3, PBA No: G63082-006
[    1.305511] ixgbe 0000:01:00.0: 90:e2:ba:e3:00:78
[    1.307431] ixgbe 0000:01:00.0: Intel(R) 10 Gigabit Network Connection
[    1.371119] pps pps0: new PPS source ptp0
[    1.371123] igb 0000:06:00.0: added PHC on eth1
[    1.371125] igb 0000:06:00.0: Intel(R) Gigabit Ethernet Network Connection
[    1.371127] igb 0000:06:00.0: eth1: (PCIe:2.5Gb/s:Width x1) 0c:c4:7a:93:6f:a1
[    1.371186] igb 0000:06:00.0: eth1: PBA No: 010B00-000
[    1.371188] igb 0000:06:00.0: Using MSI-X interrupts. 4 rx queue(s), 4 tx queue(s)
[    1.372401] igb 0000:06:00.0 eno2: renamed from eth1
[    1.407781] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock
[    1.475505] usb 1-10: new high-speed USB device number 2 using xhci_hcd
[    1.486452] e1000e 0000:00:1f.6 eth1: (PCI Express:2.5GT/s:Width x1) 0c:c4:7a:93:6f:a0
[    1.486455] e1000e 0000:00:1f.6 eth1: Intel(R) PRO/1000 Network Connection
[    1.486575] e1000e 0000:00:1f.6 eth1: MAC: 12, PHY: 12, PBA No: 010BFF-0FF
[    1.487614] e1000e 0000:00:1f.6 eno1: renamed from eth1
[    1.520830] ata2: SATA link up 6.0 Gbps (SStatus 133 SControl 300)
[    1.520854] ata4: SATA link down (SStatus 4 SControl 300)
[    1.520880] ata3: SATA link down (SStatus 4 SControl 300)
[    1.520904] ata1: SATA link up 6.0 Gbps (SStatus 133 SControl 300)
[    1.522534] ata2.00: ATA-8: HGST HTE725050A7E630, GS2OA3E0, max UDMA/133
[    1.522537] ata2.00: 976773168 sectors, multi 16: LBA48 NCQ (depth 31/32), AA
[    1.522550] ata1.00: ATA-8: HGST HTE725050A7E630, GS2OA3E0, max UDMA/133
[    1.522553] ata1.00: 976773168 sectors, multi 16: LBA48 NCQ (depth 31/32), AA
[    1.524528] ata1.00: configured for UDMA/133
[    1.524547] ata2.00: configured for UDMA/133
[    1.525215] scsi 0:0:0:0: Direct-Access     ATA      HGST HTE725050A7 A3E0 PQ: 0 ANSI: 5
[    1.564495] scsi 1:0:0:0: Direct-Access     ATA      HGST HTE725050A7 A3E0 PQ: 0 ANSI: 5
[    1.598770] sd 0:0:0:0: [sda] 976773168 512-byte logical blocks: (500 GB/466 GiB)
[    1.598774] sd 0:0:0:0: [sda] 4096-byte physical blocks
[    1.598792] sd 0:0:0:0: [sda] Write Protect is off
[    1.598795] sd 0:0:0:0: [sda] Mode Sense: 00 3a 00 00
[    1.598821] sd 0:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[    1.598824] sd 1:0:0:0: [sdb] 976773168 512-byte logical blocks: (500 GB/466 GiB)
[    1.598828] sd 1:0:0:0: [sdb] 4096-byte physical blocks
[    1.598845] sd 1:0:0:0: [sdb] Write Protect is off
[    1.598849] sd 1:0:0:0: [sdb] Mode Sense: 00 3a 00 00
[    1.598875] sd 1:0:0:0: [sdb] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[    1.616186] usb 1-10: New USB device found, idVendor=0557, idProduct=7000
[    1.616189] usb 1-10: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[    1.616816] hub 1-10:1.0: USB hub found
[    1.616955] hub 1-10:1.0: 4 ports detected
[    1.639298]  sdb: sdb1
[    1.639799] sd 1:0:0:0: [sdb] Attached SCSI disk
[    1.645765]  sda: sda1 sda2 < sda5 >
[    1.647270] sd 0:0:0:0: [sda] Attached SCSI disk
[    1.923563] usb 1-10.1: new low-speed USB device number 3 using xhci_hcd
[    2.052664] usb 1-10.1: New USB device found, idVendor=0557, idProduct=2419
[    2.052668] usb 1-10.1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[    2.057238] usbcore: registered new interface driver usbhid
[    2.057240] usbhid: USB HID core driver
[    2.058428] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb1/1-10/1-10.1/1-10.1:1.0/0003:0557:2419.0001/input/input0
[    2.059472] clocksource: Switched to clocksource tsc
[    2.115566] hid-generic 0003:0557:2419.0001: input,hidraw0: USB HID v1.00 Keyboard [HID 0557:2419] on usb-0000:00:14.0-10.1/input0
[    2.115722] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb1/1-10/1-10.1/1-10.1:1.1/0003:0557:2419.0002/input/input1
[    2.115971] hid-generic 0003:0557:2419.0002: input,hidraw1: USB HID v1.00 Mouse [HID 0557:2419] on usb-0000:00:14.0-10.1/input1
[    2.483641] ixgbe 0000:01:00.1: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8
[    2.483765] ixgbe 0000:01:00.1: PCI Express bandwidth of 32GT/s available
[    2.483766] ixgbe 0000:01:00.1: (Speed:5.0GT/s, Width: x8, Encoding Loss:20%)
[    2.484087] ixgbe 0000:01:00.1: MAC: 2, PHY: 1, PBA No: G63082-006
[    2.484087] ixgbe 0000:01:00.1: 90:e2:ba:e3:00:79
[    2.485072] ixgbe 0000:01:00.1: Intel(R) 10 Gigabit Network Connection
[    3.158030] ixgbe 0000:04:00.0: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8
[    3.200518] ixgbe 0000:04:00.0: PCI Express bandwidth of 16GT/s available
[    3.200520] ixgbe 0000:04:00.0: (Speed:5.0GT/s, Width: x4, Encoding Loss:20%)
[    3.200522] ixgbe 0000:04:00.0: This is not sufficient for optimal performance of this card.
[    3.200523] ixgbe 0000:04:00.0: For optimal performance, at least 20GT/s of bandwidth is required.
[    3.200524] ixgbe 0000:04:00.0: A slot with more lanes and/or higher speed is suggested.
[    3.228839] ixgbe 0000:04:00.0: MAC: 4, PHY: 0, PBA No: 020B00-000
[    3.228841] ixgbe 0000:04:00.0: 0c:c4:7a:93:72:c0
[    3.390428] ixgbe 0000:04:00.0: Intel(R) 10 Gigabit Network Connection
[    4.063510] ixgbe 0000:04:00.1: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8
[    4.107950] ixgbe 0000:04:00.1: PCI Express bandwidth of 16GT/s available
[    4.107954] ixgbe 0000:04:00.1: (Speed:5.0GT/s, Width: x4, Encoding Loss:20%)
[    4.107956] ixgbe 0000:04:00.1: This is not sufficient for optimal performance of this card.
[    4.107958] ixgbe 0000:04:00.1: For optimal performance, at least 20GT/s of bandwidth is required.
[    4.107959] ixgbe 0000:04:00.1: A slot with more lanes and/or higher speed is suggested.
[    4.137573] ixgbe 0000:04:00.1: MAC: 4, PHY: 0, PBA No: 020B00-000
[    4.137577] ixgbe 0000:04:00.1: 0c:c4:7a:93:72:c1
[    4.305252] ixgbe 0000:04:00.1: Intel(R) 10 Gigabit Network Connection
[    4.306053] ixgbe 0000:01:00.1 enp1s0f1: renamed from eth1
[    4.343355] ixgbe 0000:01:00.0 enp1s0f0: renamed from eth0
[    4.395507] ixgbe 0000:04:00.1 eno4: renamed from eth3
[    4.431362] ixgbe 0000:04:00.0 eno3: renamed from eth2
[    4.478621] PM: Starting manual resume from disk
[    4.478623] PM: Hibernation image partition 8:5 present
[    4.478623] PM: Looking for hibernation image.
[    4.478686] PM: Image not found (code -22)
[    4.478687] PM: Hibernation image not present or could not be loaded.
[    4.693434] EXT4-fs (sda1): mounted filesystem with ordered data mode. Opts: (null)
[    4.714198] random: fast init done
[    5.853188] ip_tables: (C) 2000-2006 Netfilter Core Team
[    5.933889] systemd[1]: systemd 234 running in system mode. (+PAM +AUDIT +SELINUX +IMA +APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD -IDN2 +IDN default-hierarchy=hybrid)
[    5.934312] systemd[1]: Detected architecture x86-64.
[    5.955057] systemd[1]: Set hostname to <scan-sha2017.external.meta.southbound.io>.
[    6.255949] random: crng init done
[    6.550725] systemd[1]: Listening on Journal Socket (/dev/log).
[    6.550764] systemd[1]: Listening on udev Kernel Socket.
[    6.550786] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.
[    6.550872] systemd[1]: Created slice User and Session Slice.
[    6.550905] systemd[1]: Listening on Journal Audit Socket.
[    6.550923] systemd[1]: Started Forward Password Requests to Wall Directory Watch.
[    6.550929] systemd[1]: Reached target Paths.
[    6.978836] EXT4-fs (sda1): re-mounted. Opts: errors=remount-ro
[    7.289352] systemd-journald[274]: Received request to flush runtime journal from PID 1
[    8.371635] input: Sleep Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0E:00/input/input2
[    8.371638] ACPI: Sleep Button [SLPB]
[    8.371660] input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input3
[    8.371661] ACPI: Power Button [PWRB]
[    8.371681] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input4
[    8.371682] ACPI: Power Button [PWRF]
[    8.382302] (NULL device *): hwmon_device_register() is deprecated. Please convert the driver to use hwmon_device_register_with_info().
[    8.454019] ipmi message handler version 39.2
[    8.463414] EDAC MC: Ver: 3.0.0
[    8.463596] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4
[    8.511505] EDAC MC0: Giving out device to module ie31200_edac controller IE31200: DEV 0000:00:00.0 (POLLED)
[    8.514882] input: PC Speaker as /devices/platform/pcspkr/input/input5
[    8.518190] intel-lpss 0000:00:15.0: enabling device (0000 -> 0002)
[    8.557242] ipmi device interface
[    8.560717] sd 0:0:0:0: Attached scsi generic sg0 type 0
[    8.560734] sd 1:0:0:0: Attached scsi generic sg1 type 0
[    8.566709] idma64 idma64.0: Found Intel integrated DMA 64-bit
[    8.566949] intel-lpss 0000:00:15.1: enabling device (0000 -> 0002)
[    8.567095] idma64 idma64.1: Found Intel integrated DMA 64-bit
[    8.567306] intel-lpss 0000:00:1e.0: enabling device (0000 -> 0002)
[    8.567471] idma64 idma64.2: Found Intel integrated DMA 64-bit
[    8.567548] dw-apb-uart.2: ttyS2 at MMIO 0xdf74b000 (irq = 20, base_baud = 115200) is a 16550A
[    8.639037] ipmi_si IPI0001:00: ipmi_si: probing via ACPI
[    8.639068] ipmi_si IPI0001:00: [io  0x0ca4] regsize 1 spacing 1 irq 0
[    8.639071] ipmi_si: Adding ACPI-specified kcs state machine
[    8.639106] IPMI System Interface driver.
[    8.639134] ipmi_si: probing via SMBIOS
[    8.639137] ipmi_si: SMBIOS: io 0xca2 regsize 1 spacing 1 irq 0
[    8.639139] ipmi_si: Adding SMBIOS-specified kcs state machine
[    8.639141] ipmi_si: probing via SPMI
[    8.639143] ipmi_si: SPMI: io 0xca2 regsize 1 spacing 1 irq 0
[    8.639144] ipmi_si: SPMI-specified kcs state machine: duplicate
[    8.639147] ipmi_si: Trying ACPI-specified kcs state machine at i/o address 0xca4, slave address 0x0, irq 0
[    8.725277] mei_me 0000:00:16.0: enabling device (0000 -> 0002)
[    8.745443] Bluetooth: Core ver 2.22
[    8.745460] NET: Registered protocol family 31
[    8.745461] Bluetooth: HCI device and connection manager initialized
[    8.745465] Bluetooth: HCI socket layer initialized
[    8.745468] Bluetooth: L2CAP socket layer initialized
[    8.745481] Bluetooth: SCO socket layer initialized
[    8.766426] iTCO_vendor_support: vendor-support=0
[    8.766784] iTCO_wdt: Intel TCO WatchDog Timer Driver v1.11
[    8.766904] iTCO_wdt: unable to reset NO_REBOOT flag, device disabled by hardware/BIOS
[    8.811536] RAPL PMU: API unit is 2^-32 Joules, 5 fixed
@BenBE

This comment has been minimized.

Copy link

BenBE commented Jul 28, 2017

Here's a small template of what your submission should include (example being a project I proposed):

Subject:

Internet-wide deployment of RFC 864-based services (chargen)

Abstract:

The chargen service is an optional service for both TCP and UDP that
generates a stream of response data for any incoming communication on
the service's port. Hosts choosing to implement such a service provide a
simple aid in debugging throughput or other networking issues. In May
1983 ARPA proposed a standard for such character stream generating
services, which became adopted as RFC 864 and were assigned the TCP and
UDP port numbers 19 by IANA.

This proposal tries to examine the number of such hosts on the internet,
differences in implementations in-the-wild and if significant
differences in QoS can be detected.

Motivation:

Hasn't been done before AFAIK.

Keywords:

RFC864, chargen, QoS

Involved Parties:

Benny "BenBE" Baumann (unaffiliated)

Involved Funding Grants:

none

Prior Research:

None known

Related Research:

Various other scans of privileged ports at e.g. scans.io

Relevant Documentation:

RFC 864, Character Generator Protocol, J. Postel

Data to be collected

TCP scan on port 19

Collect first 64KiB per successful connection,
measuring speed/packet loss of connection
Result: IP,RTT,Speed,Data Stream

UDP scan on port 19

Collect responses and timing for up to 256
datagrams sending minimal request datagrams.
Result: IP,Packet #,RTT,Response Data

Additionally relevant information (e.g. for correlation):

Host Fingerprints (e.g. Host OS, TCP Stack)
Geolocation (Spatial grouping of found hosts)
Host Up/Down Status Information

Possible analysis:

  • Clustering hosts by characteristics of generated output
  • Clustering hosts by geolocation, OS, ...
  • Clustering hosts by QoS, performance
  • Analysis of entropy of generated random data (in particular UDP)

Prior Experience with such scans:

none, heard presentations about them

Required support:

Will need help with implementation and deployment of scan.
Depending on number of found hosts also with analysis.

Security Considerations:

none

Remarks:

Looking forward to SHA2017.

@azet

This comment has been minimized.

Copy link
Owner Author

azet commented Aug 5, 2017

automated scan project folder creation (otherwise we'll have no idea who did/does what)

in /data/scans/new_scan:

#!/usr/bin/env bash
# ----------------------------------------
# Copyright: Aaron Zauner <azet@azet.org>
#            CC0 1.0 -- "Public Domain"
# ----------------------------------------
set -eu -o pipefail 

readonly supplied_name="${1// /_}"
readonly scan_name="${supplied_name}_started-$(date -Ru | tr ' ' '_')"

: ${1?$'-- Missing argument!\n\nUsage:\n\t'$(basename ${0})' <scan title/name>\n'}

if mkdir -p ${scan_name}; then
        printf "created %s by %s.\n" ${scan_name} ${USER}
else
        printf "ERROR: failed to create %s (user: %s)!\n" ${scan_name} ${USER}
fi >> new_scan.log
@azet

This comment has been minimized.

Copy link
Owner Author

azet commented Aug 5, 2017

How to scan once you've got access to the scanning infrastructure:

azet@scan-sha2017:/data/scans$ cat README_zmap 
# Scanning with `zmap`:

1) create a new scan directory:
   - `cd /data/scans`
   - `sudo ./new_scan NAMEOFSCAN` e.g. `sudo ./new_scan https_banners_2`
   - `cd` into the newly created project directory
 
2) run `zmap` as follows to scan for specific ports or the entire internet:
   - sudo /usr/local/sbin/zmap -i enp1s0f0 -o scan_result.csv -b /data/scans/blacklist.txt -v5 -T4 -B10G -p443` 
     (to scan the entire IPv4 rage on port 443 [https])
   - to grab banners you'll need to combine with `zgrab` and `ztools`:
      - https://github.com/zmap/zgrab
      - https://github.com/zmap/zgrab2
      - https://github.com/zmap/zdns
        (more at https://github.com/zmap)
   - take a look at other `zmap` options, too!


azet

azet@scan-sha2017:/data/scans$ cat README_masscan 
# Scanning with `masscan`:

1) create a new scan directory:
   - `cd /data/scans`
   - `sudo ./new_scan NAMEOFSCAN` e.g. `sudo ./new_scan https_banners_2`
   - `cd` into the newly created project directory
 
2) run `masscan` as follows to scan for specific ports or the entire internet:
   - `sudo masscan -c ../masscan_ip4-wide_all_ports.conf -p443`
     (to scan the entire IPv4 rage on port 443 [https])
   - to grab banners add `--banners`
   - take a look at other `masscan` options, too!


azet

If there are any questions, please send a mail to shascan@azet.org. In case of emergencies get in contact with the information provided over there: https://wiki.sha2017.org/index.php?title=Internet-wide_Scanning#Emergencies

@azet

This comment has been minimized.

Copy link
Owner Author

azet commented Aug 5, 2017

Keeping motd up to date:

Please fill in any changes to the infrastructure, system users, tools and scans you're doing!

currently /etc/motd looks like this:

==============================================
   scan-sha2017.external.meta.southbound.io
==============================================

  * Emergency contact:
   - +43 664 6394757 (Phone, Signal, WhatsApp)
   - azet@azet.org (SMTP)
   - azet@jabber.ccc.de (Jabber/XMPP)
   - @a_z_e_t (Twitter)

  * Status:
   - scanning machine set up & operational 
   - >> IN PRODUCTION <<
   - local users allowed to scan (+ sudo):
      - "azet", "hanno", "fr333k".
   - `/data/scans/` contains all scanning info. & data 
      - take a look at `README_masscan` and `README_zmap`!
      - blacklist: `/data/scans/blacklist.txt` (CIDR notation)

  * Ongoing scans:
   - !DONE! ~~no-limit on 0.0.0.0/0 - all ports [azet]~~
   - https/http/ftp scans (with & without banners/data)


-- EOF (azet)
@azet

This comment has been minimized.

Copy link
Owner Author

azet commented Aug 5, 2017

Public "ntopng" Traffic Dashboard:

http://151.216.93.11:8080

Credentials

user: public
password: guest

@azet

This comment has been minimized.

Copy link
Owner Author

azet commented Aug 5, 2017

@BenBE:

your chargen scan request has just started collecting data.

azet@scan-sha2017:/data/scans/chargen-p19-auth:BenBE_started-Sat,_05_Aug_2017_20:50:45_+0000$ sudo masscan -c ../masscan_ip4-wide_all_ports.conf -p19 --banners
/data/scans/blacklist.txt: excluding 1 ranges from file

Starting masscan 1.0.4 (http://bit.ly/14GZzcT) at 2017-08-05 20:52:15 GMT
 -- forced options: -sS -Pn -n --randomize-hosts -v --send-eth
Initiating SYN Stealth Scan
Scanning 4294967295 hosts [1 port/host]
rate:1184.81-kpps,  0.76% done,   1:08:46 remaining, found=5224       
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
You can’t perform that action at this time.