Skip to content
This repository has been archived by the owner on Oct 16, 2020. It is now read-only.

Frequent CoreOS crashing on HP Gen9 #2108

Open
x86brandon opened this issue Aug 17, 2017 · 13 comments
Open

Frequent CoreOS crashing on HP Gen9 #2108

x86brandon opened this issue Aug 17, 2017 · 13 comments
Labels
area/stability component/kernel kind/bug kind/support needs/more-information team/os

Comments

@x86brandon
Copy link

x86brandon commented Aug 17, 2017 •
edited

Issue Report

We are seeing frequent CoreOS crashes across a fleet of DL 380 Gen 9's. Sometimes every few hours to every day or two. It's difficult to get a panic captured, but I managed to get a video from the iLO. pstore wasn't getting them.

Apologies in advance for the lack of quality on the screenshots. It took a lot just to get these.

Container Linux Version

$ cat /etc/os-release

NAME="Container Linux by CoreOS"
ID=coreos
VERSION=1409.6.0
VERSION_ID=1409.6.0
BUILD_ID=2017-07-06-0128
PRETTY_NAME="Container Linux by CoreOS 1409.6.0 (Ladybug)"
ANSI_COLOR="38;5;75"
HOME_URL="https://coreos.com/"
BUG_REPORT_URL="https://issues.coreos.com"
COREOS_BOARD="amd64-usr"

### Environment ###

HP DL 380 Gen 9, 256 GB RAM, Intel(R) Xeon(R) CPU E5-2630 v3 @ 2.40GHz

Running Spark/Cassandra






![screen shot 2017-08-16 at 5 02 15 pm](https://user-images.githubusercontent.com/423954/29390434-3154210c-82a5-11e7-9176-00ae5f6bd50d.png)
![screen shot 2017-08-16 at 5 02 32 pm](https://user-images.githubusercontent.com/423954/29390437-315630d2-82a5-11e7-9d57-c18ff25c1718.png)
![screen shot 2017-08-16 at 5 02 36 pm](https://user-images.githubusercontent.com/423954/29390435-315466e4-82a5-11e7-90bb-d4632bd3d2ea.png)
![screen shot 2017-08-16 at 5 02 40 pm](https://user-images.githubusercontent.com/423954/29390436-31555360-82a5-11e7-8aa7-5959a147866b.png)
@x86brandon
Copy link
Author

screen shot 2017-08-16 at 5 02 15 pm

@x86brandon
Copy link
Author

screen shot 2017-08-16 at 5 02 32 pm

@x86brandon
Copy link
Author

screen shot 2017-08-16 at 5 02 36 pm

@x86brandon
Copy link
Author

Here is as slowed of a video as I can get.

https://www.youtube.com/watch?v=kUgeI3Zoelo

@bgilbert
Copy link
Contributor

Was there a previous version of Container Linux that did not have this problem?

We'll shortly be rolling out a new stable release that updates to the 4.12 kernel. Please give that a try and let us know whether you're still seeing the issue.

@x86brandon
Copy link
Author

@bgilbert Previous version also seemed to have issues.

@x86brandon
Copy link
Author

x86brandon commented Aug 18, 2017 •
edited by bgilbert

@bgilbert Finally got a real good one. This is the 4.12 kernel that was released yesterday.

 [93390.395353]  run_timer_softirq+0x1db/0x440                                   
 [93390.400078]  ? sched_clock+0x9/0x10                                          
 [93390.404130]  ? sched_clock+0x9/0x10                                          
 [93390.408182]  ? sched_clock_cpu+0x11/0xb0                                     
 [93390.412707]  __do_softirq+0xf5/0x278                                         
 [93390.416844]  irq_exit+0xae/0xb0                                              
 [93390.420500]  smp_apic_timer_interrupt+0x3d/0x50                              
 [93390.425683]  apic_timer_interrupt+0x89/0x90                                  
 [93390.430496] RIP: 0033:0x7f8c15aae57d                                         
 [93390.434627] RSP: 002b:00007f8bb88dacc0 EFLAGS: 00000246 ORIG_RAX: ffffffffffffff10                                                                           
 [93390.443302] RAX: 0000000005675d00 RBX: 0000000542352440 RCX: 000000070d6e8fc8
 [93390.451362] RDX: 0000000542352440 RSI: 000000054470d7d8 RDI: 00000000f807bdac
 [93390.459460] RBP: 00000007137c4158 R08: 00000000a80077c3 R09: 00000000a80077c3
 [93390.467523] R10: 00000000000071ba R11: 0000006d05675d09 R12: 0000000000000000
 [93390.475574] R13: 000000054470d7d8 R14: 000000070d73f000 R15: 00007f8ae0004000
 [93390.483626]  </IRQ>                                                          
 [93390.486136] Code: 8b 45 00 85 c0 0f 84 d3 00 00 00 41 f6 46 18 80 0f 84 02 01 00 00 85 c0 0f 8e b8 00 00 00 31 db eb 3b ba ff ff ff ff 49 0f bd d4 <41> 80 bb 04 03 00 00 00 75 7d 49 8d bb 18 03 00 00 4c 89 e2 4c                          
 [93390.507431] RIP: flush_unmaps_timeout+0xa7/0x1c0 RSP: ffff8c5e3f403e50       
 [93390.514834] CR2: 0000000000000304                                            
 [93390.518692] ---[ end trace 779ed8dd6dfa457e ]---                             
 [93390.529123] Kernel panic - not syncing: Fatal exception in interrupt         
 [93390.400078]  ? sched_clock+0x9/0x10                                          
 [93390.404130]  ? sched_clock+0x9/0x10                                          
 [93390.408182]  ? sched_clock_cpu+0x11/0xb0                                     
 [93390.412707]  __do_softirq+0xf5/0x278                                         
 [93390.416844]  irq_exit+0xae/0xb0                                              
 [93390.420500]  smp_apic_timer_interrupt+0x3d/0x50                              
 [93390.425683]  apic_timer_interrupt+0x89/0x90                                  
 [93390.430496] RIP: 0033:0x7f8c15aae57d                                         
 [93390.434627] RSP: 002b:00007f8bb88dacc0 EFLAGS: 00000246 ORIG_RAX: ffffffffffffff10                                                                           
 [93390.443302] RAX: 0000000005675d00 RBX: 0000000542352440 RCX: 000000070d6e8fc8
 [93390.451362] RDX: 0000000542352440 RSI: 000000054470d7d8 RDI: 00000000f807bdac
 [93390.459460] RBP: 00000007137c4158 R08: 00000000a80077c3 R09: 00000000a80077c3
 [93390.467523] R10: 00000000000071ba R11: 0000006d05675d09 R12: 0000000000000000
 [93390.475574] R13: 000000054470d7d8 R14: 000000070d73f000 R15: 00007f8ae0004000
 [93390.483626]  </IRQ>                                                          
 [93390.486136] Code: 8b 45 00 85 c0 0f 84 d3 00 00 00 41 f6 46 18 80 0f 84 02 01 00 00 85 c0 0f 8e b8 00 00 00 31 db eb 3b ba ff ff ff ff 49 0f bd d4 <41> 80 bb 04 03 00 00 00 75 7d 49 8d bb 18 03 00 00 4c 89 e2 4c                          
 [93390.507431] RIP: flush_unmaps_timeout+0xa7/0x1c0 RSP: ffff8c5e3f403e50       
 [93390.514834] CR2: 0000000000000304                                            
 [93390.518692] ---[ end trace 779ed8dd6dfa457e ]---                             
 [93390.529123] Kernel panic - not syncing: Fatal exception in interrupt         
 [93391.591854] Shutting down cpus with NMI                                       04 03 00 00 00 75 7d 49 8d bb 18 03 00 00 4c 89 e2 4c                          
 [93390.507431] RIP: flush_unmaps_timeout+0xa7/0x1c0 RSP: ffff8c5e3f403e50       
 [93390.514834] CR2: 0000000000000304                                            
 [93390.518692] ---[ end trace 779ed8dd6dfa457e ]---                             
 [93390.529123] Kernel panic - not syncing: Fatal exception in interrupt         
 [93391.591854] Shutting down cpus with NMI                                      
 [93391.833985] Kernel Offset: 0x2c000000 from 0xffffffff81000000 (relocation range: 0xffffffff80000000-0xffffffffbfffffff)                                      
 [93391.851218] ---[ end Kernel panic - not syncing: Fatal exception in interrupt
 [93391.859288] sched: Unexpected reschedule of offline CPU#0!                   
 [93391.865531] ------------[ cut here ]------------                             
 [93391.870820] WARNING: CPU: 24 PID: 21589 at ../source/arch/x86/kernel/smp.c:128 native_smp_send_reschedule+0x3c/0x40                                          
 [93391.882661] Modules linked in: binfmt_misc xt_nat veth xfrm_user xfrm_algo xt_addrtype iptable_filter xt_conntrack br_netfilter bridge stp llc ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack libcrc32c crc32c_generic vxlan ip6_udp_tunnel udp_tunnel overlay bonding ipmi_ssif nls_ascii nls_cp437 vfat fat sb_edac edac_core coretemp x86_pkg_temp_thermal kvm_intel kvm irqbypass psmouse mousedev ipmi_si evdev pcc_cpufreq ipmi_devintf hpilo i2c_i801 ipmi_msghandler button sch_fq_codel ext4 crc16 jbd2 fscrypto mbcache sd_mod hid_generic usbhid hid crc32c_intel uhci_hcd igb xhci_pci i2c_algo_bit aesni_intel aes_x86_64 ehci_pci ixgbe xhci_hcd tg3 crypto_simd i2c_core hpsa ehci_hcd cryptd glue_helper hwmon ptp scsi_transport_sas usbcore pps_core                                                                                                                                                                                                                                                                                                                                                                                                   
 [93392.837633] R13: ffff8c5e2eb01f48 R14: ffff8c5e32903800 R15: 00000000000ff2a1
 [93392.845687]  ? iommu_flush_iotlb_psi+0x120/0x120                             
 [93392.850964]  call_timer_fn+0x35/0x140                                        
 [93392.855192]  run_timer_softirq+0x1db/0x440                                   
 [93392.859897]  ? sched_clock+0x9/0x10                                          
 [93392.863931]  ? sched_clock+0x9/0x10                                          
 [93392.867969]  ? sched_clock_cpu+0x11/0xb0                                     
 [93392.872484]  __do_softirq+0xf5/0x278                                         
 [93392.876616]  irq_exit+0xae/0xb0                                              
 [93392.880271]  smp_apic_timer_interrupt+0x3d/0x50                              
 [93392.885454]  apic_timer_interrupt+0x89/0x90                                  
 [93392.890256] RIP: 0033:0x7f8c15aae57d                                         
 [93392.894388] RSP: 002b:00007f8bb88dacc0 EFLAGS: 00000246 ORIG_RAX: ffffffffffffff10                                                                           
 [93392.903067] RAX: 0000000005675d00 RBX: 0000000542352440 RCX: 000000070d6e8fc8
 [93392.911116] RDX: 0000000542352440 RSI: 000000054470d7d8 RDI: 00000000f807bdac
 [93392.919171] RBP: 00000007137c4158 R08: 00000000a80077c3 R09: 00000000a80077c3
 [93392.927222] R10: 00000000000071ba R11: 0000006d05675d09 R12: 0000000000000000
 [93392.935276] R13: 000000054470d7d8 R14: 000000070d73f000 R15: 00007f8ae0004000
 [93392.943331]  </IRQ>                                                          
 [93392.945838] Code: cd 00 0f 92 c0 84 c0 74 14 48 8b 05 7f b0 9f 00 be fd 00 00 00 ff 90 a0 00 00 00 5d c3 89 fe 48 c7 c7 88 8a 9c ad e8 07 a2 13 00 <0f> ff 5d c3 0f 1f 44 00 00 8b 05 bd ef cb 02 85 c0 74 01 c3 55                          
 [93392.967127] ---[ end trace 779ed8dd6dfa4580 ]---

@x86brandon
Copy link
Author 

   [108889.367676] BUG: unable to handle kernel NULL pointer dereference at 0000000000000304                                                                       
   [108889.376753] IP: flush_unmaps_timeout+0xa7/0x1c0                             
   [108889.382045] PGD 207174a067                                                  
   [108889.382045] P4D 207174a067                                                  
   [108889.385414] PUD 1fd1078067                                                  
   [108889.388780] PMD 0                                                           
   [108889.392145]                                                                 
   [108889.396586] Oops: 0000 [#1] SMP                                             
   [108889.400335] Modules linked in: mousedev hid_generic usbhid hid binfmt_misc xt_nat veth xfrm_user xfrm_algo xt_addrtype iptable_filter xt_conntrack br_netfilter bridge stp llc ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack libcrc32c crc32c_generic vxlan ip6_udp_tunnel udp_tunnel overlay bonding nls_ascii nls_cp437 ipmi_ssif vfat fat sb_edac edac_core coretemp x86_pkg_temp_thermal kvm_intel kvm psmouse evdev irqbypass ipmi_si pcc_cpufreq ipmi_devintf i2c_i801 hpilo ipmi_msghandler button sch_fq_codel ext4 crc16 jbd2 fscrypto mbcache sd_mod uhci_hcd crc32c_intel igb aesni_intel ehci_pci xhci_pci ehci_hcd aes_x86_64 i2c_algo_bit crypto_simd ixgbe xhci_hcd tg3 i2c_core cryptd hpsa glue_helper hwmon ptp usbcore scsi_transport_sas pps_core                                                                  
   [108889.655892] RDX: 0000000000000000 RSI: ffff8d9fbf218618 RDI: 0000000000000000                                                                               
   [108889.664182] RBP: ffffa21b58983ea0 R08: 0000000000000001 R09: 00000000fffffff
   [108889.672473] R10: ffffa21b58983e38 R11: ffff8d9fbf217e24 R12: 0000000000000001                                                                               
   [108889.680767] R13: 0000000000000001 R14: 0000000000000008 R15: 00006308c813a51
   [108889.689105]  </IRQ>                                                         
   [108889.691707]  ? cpuidle_enter_state+0xd4/0x270                               
   [108889.696795]  cpuidle_enter+0x17/0x20                                        
   [108889.701024]  call_cpuidle+0x23/0x40                                         
   [108889.705157]  do_idle+0x17f/0x1d0                                            
   [108889.709003]  cpu_startup_entry+0x71/0x80                                    
   [108889.713615]  start_secondary+0x151/0x190                                    
   [108889.718225]  secondary_startup_64+0x9f/0x9f                                 
   [108889.723120] Code: 8b 45 00 85 c0 0f 84 d3 00 00 00 41 f6 46 18 80 0f 84 02 01 00 00 85 c0 0f 8e b8 00 00 00 31 db eb 3b ba ff ff ff ff 49 0f bd d4 <41> 80 bb 04 03 00 00 00 75 7d 49 8d bb 18 03 00 00 4c 89 e2 4c                         
   [108889.744483] RIP: flush_unmaps_timeout+0xa7/0x1c0 RSP: ffff8d9fbf203e50      
   [108889.751960] CR2: 0000000000000304                                           
   [108889.755909] ---[ end trace be85bac082d84df1 ]---                            
   [108889.765360] Kernel panic - not syncing: Fatal exception in interrupt                                                                                        
   [108889.744483] RIP: flush_unmaps_timeout+0xa7/0x1c0 RSP: ffff8d9fbf203e50      
   [108889.751960] CR2: 0000000000000304                                           
   [108889.755909] ---[ end trace be85bac082d84df1 ]---                            
   [108889.765360] Kernel panic - not syncing: Fatal exception in interrupt        
   [108890.127488] Kernel Offset: 0x1a000000 from 0xffffffff81000000 (relocation range: 0xffffffff80000000-0xffffffffbfffffff)                                     
   [108890.146085] ERST: [Firmware Warn]: Firmware does not respond in time.       
   [108890.153470] ---[ end Kernel panic - not syncing: Fatal exception in interrupt                                                                               
   [108890.161776] sched: Unexpected reschedule of offline CPU#0!                  
   [108890.168117] ------------[ cut here ]------------                            
   [108890.173499] WARNING: CPU: 8 PID: 0 at ../source/arch/x86/kernel/smp.c:128 native_smp_send_reschedule+0x3c/0x40                                              
   [108890.188499] Modules linked in: mousedev hid_generic usbhid hid binfmt_misc xt_nat veth xfrm_user xfrm_algo xt_addrtype iptable_filter xt_conntrack br_netfilter bridge stp llc ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack libcrc32c crc32c_generic vxlan ip6_udp_tunnel udp_tunnel overlay bonding nls_ascii nls_cp437 ipmi_ssif vfat fat sb_edac edac_core coretemp x86_pkg_temp_thermal kvm_intel kvm psmouse evdev irqbypass ipmi_si pcc_cpufreq ipmi_devintf i2c_i801 hpilo ipmi_msghandler button sch_fq_codel ext4 crc16 jbd2 fscrypto mbcache sd_mod uhci_hcd crc32c_intel igb aesni_intel ehci_pci xhci_pci ehci_hcd aes_x86_64 i2c_algo_bit crypto_simd ixgbe xhci_hcd tg3 i2c_core cryptd hpsa glue_helper hwmon ptp usbcore scsi_transport_sas pps_core                                                                                                                                                  6                                                                                                                                                               
   [108890.663280] RSP: 0018:ffffa21b58983e68 EFLAGS: 00000246 ORIG_RAX: ffffffffffffff10                                                                          
   [108890.672046] RAX: ffff8d9fbf21ae00 RBX: ffffc21b3fa02100 RCX: 000000000000001f                                                                               
   [108890.680336] RDX: 0000000000000000 RSI: ffff8d9fbf218618 RDI: 0000000000000000                                                                               
   [108890.688681] RBP: ffffa21b58983ea0 R08: 0000000000000001 R09: 00000000ffffffff                                                                               
   [108890.696976] R10: ffffa21b58983e38 R11: ffff8d9fbf217e24 R12: 0000000000000001                                                                               
   [108890.705267] R13: 0000000000000001 R14: 0000000000000008 R15: 00006308c813a51f                                                                               
   [108890.713552]  </IRQ>                                                         
   [108890.716155]  ? cpuidle_enter_state+0xd4/0x270                               
   [108890.721243]  cpuidle_enter+0x17/0x20                                        
   [108890.725469]  call_cpuidle+0x23/0x40                                         
   [108890.729600]  do_idle+0x17f/0x1d0                                            
   [108890.733445]  cpu_startup_entry+0x71/0x80                                    
   [108890.738057]  start_secondary+0x151/0x190                                    
   [108890.742671]  secondary_startup_64+0x9f/0x9f                                 
   [108890.747570] Code: cd 00 0f 92 c0 84 c0 74 14 48 8b 05 7f b0 9f 00 be fd 00 00 00 ff 90 a0 00 00 00 5d c3 89 fe 48 c7 c7 88 8a 9c 9b e8 07 a2 13 00 <0f> ff 5d c3 0f 1f 44 00 00 8b 05 bd ef cb 02 85 c0 74 01 c3 55                         
   [108890.768935] ---[ end trace be85bac082d84df2 ]---

@x86brandon
Copy link
Author

From another host.

@x86brandon
Copy link
Author

x86brandon commented Aug 22, 2017 •
edited by bgilbert 

 [441582.843551] BUG: unable to handle kernel NULL pointer dereference at 0000000000000304                                                                       
 [441582.852624] IP: flush_unmaps_timeout+0xa7/0x1c0                             
 [441582.857904] PGD 0                                                           
 [441582.857904] P4D 0                                                           
 [441582.860414]                                                                 
 [441582.864867] Oops: 0000 [#1] SMP                                             
 [441582.868616] Modules linked in: binfmt_misc xt_nat veth xfrm_user xfrm_algo xt_addrtype iptable_filter xt_conntrack br_netfilter bridge stp llc ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack libcrc32c crc32c_generic vxlan ip6_udp_tunnel udp_tunnel overlay bonding ipmi_ssif sb_edac nls_ascii edac_core nls_cp437 vfat fat coretemp x86_pkg_temp_thermal kvm_intel kvm ipmi_si irqbypass psmouse mousedev evdev pcc_cpufreq ipmi_devintf i2c_i801 hpilo ipmi_msghandler button sch_fq_codel ext4 crc16 jbd2 fscrypto mbcache sd_mod hid_generic usbhid hid uhci_hcd crc32c_intel igb aesni_intel i2c_algo_bit aes_x86_64 tg3 xhci_pci ehci_pci i2c_core ixgbe crypto_simd cryptd xhci_hcd ehci_hcd glue_helper hpsa hwmon ptp scsi_transport_sas usbcore pps_core                                                                  f                                                                               
 [441583.133184] RDX: 0000000000000000 RSI: ffff8a723f258618 RDI: 0000000000000000                                                                               
 [441583.141473] RBP: ffff9aaed898bea0 R08: 0000000000000001 R09: 0000000000000036                                                                               
 [441583.149799] R10: ffff9aaed898be38 R11: ffff8a723f257e24 R12: 0000000000000001                                                                               
 [441583.158108] R13: 0000000000000001 R14: 0000000000000009 R15: 0001919e0486aa27                                                                               
 [441583.170102]  </IRQ>                                                         
 [441583.172706]  ? cpuidle_enter_state+0xd4/0x270                               
 [441583.177816]  cpuidle_enter+0x17/0x20                                        
 [441583.182054]  call_cpuidle+0x23/0x40                                         
 [441583.186183]  do_idle+0x17f/0x1d0                                            
 [441583.190028]  cpu_startup_entry+0x71/0x80                                    
 [441583.194639]  start_secondary+0x151/0x190                                    
 [441583.199272]  secondary_startup_64+0x9f/0x9f                                 
 [441583.204168] Code: 8b 45 00 85 c0 0f 84 d3 00 00 00 41 f6 46 18 80 0f 84 02 01 00 00 85 c0 0f 8e b8 00 00 00 31 db eb 3b ba ff ff ff ff 49 0f bd d4 <41> 80 bb 04 03 00 00 00 75 7d 49 8d bb 18 03 00 00 4c 89 e2 4c                         
 [441583.225544] RIP: flush_unmaps_timeout+0xa7/0x1c0 RSP: ffff8a723f243e50      
 [441583.233035] CR2: 0000000000000304                                           
 [441583.236984] ---[ end trace e2608e03bf6fdf7d ]---                            
 [441583.246798] Kernel panic - not syncing: Fatal exception in interrupt                                                                                        
 [441583.133184] RDX: 0000000000000000 RSI: ffff8a723f258618 RDI: 0000000000000000                                                                               
 [441583.141473] RBP: ffff9aaed898bea0 R08: 0000000000000001 R09: 0000000000000036                                                                               
 [441583.149799] R10: ffff9aaed898be38 R11: ffff8a723f257e24 R12: 0000000000000001                                                                               
 [441583.158108] R13: 0000000000000001 R14: 0000000000000009 R15: 0001919e0486aa27                                                                               
 [441583.170102]  </IRQ>                                                         
 [441583.172706]  ? cpuidle_enter_state+0xd4/0x270                               
 [441583.177816]  cpuidle_enter+0x17/0x20                                        
 [441583.182054]  call_cpuidle+0x23/0x40                                        
 [441583.186183]  do_idle+0x17f/0x1d0                                            
 [441583.190028]  cpu_startup_entry+0x71/0x80                                    
 [441583.194639]  start_secondary+0x151/0x190                                    
 [441583.199272]  secondary_startup_64+0x9f/0x9f                                 
 [441583.204168] Code: 8b 45 00 85 c0 0f 84 d3 00 00 00 41 f6 46 18 80 0f 84 02 01 00 00 85 c0 0f 8e b8 00 00 00 31 db eb 3b ba ff ff ff ff 49 0f bd d4 <41> 80 bb 04 03 00 00 00 75 7d 49 8d bb 18 03 00 00 4c 89 e2 4c                         
 [441583.225544] RIP: flush_unmaps_timeout+0xa7/0x1c0 RSP: ffff8a723f243e50      
 [441583.233035] CR2: 0000000000000304                                           
 [441583.236984] ---[ end trace e2608e03bf6fdf7d ]---                            
 [441583.246798] Kernel panic - not syncing: Fatal exception in interrupt        
 [441584.298981] Shutting down cpus with NMI                                     
 [441583.149799] R10: ffff9aaed898be38 R11: ffff8a723f257e24 R12: 0000000000000001                                                                               
 [441583.158108] R13: 0000000000000001 R14: 0000000000000009 R15: 0001919e0486aa27                                                                               
 [441583.170102]  </IRQ>                                                         
 [441583.172706]  ? cpuidle_enter_state+0xd4/0x270                               
 [441583.177816]  cpuidle_enter+0x17/0x20                                        
 [441583.182054]  call_cpuidle+0x23/0x40                                         
 [441583.186183]  do_idle+0x17f/0x1d0                                            
 [441583.190028]  cpu_startup_entry+0x71/0x80                                    
 [441583.194639]  start_secondary+0x151/0x190                                    
 [441583.199272]  secondary_startup_64+0x9f/0x9f                                
 [441583.204168] Code: 8b 45 00 85 c0 0f 84 d3 00 00 00 41 f6 46 18 80 0f 84 02 01 00 00 85 c0 0f 8e b8 00 00 00 31 db eb 3b ba ff ff ff ff 49 0f bd d4 <41> 80 bb 04 03 00 00 00 75 7d 49 8d bb 18 03 00 00 4c 89 e2 4c                         
 [441583.225544] RIP: flush_unmaps_timeout+0xa7/0x1c0 RSP: ffff8a723f243e50      
 [441583.233035] CR2: 0000000000000304                                           
 [441583.236984] ---[ end trace e2608e03bf6fdf7d ]---                            
 [441583.246798] Kernel panic - not syncing: Fatal exception in interrupt        
 [441584.298981] Shutting down cpus with NMI                                     
 [441584.487072] Kernel Offset: 0x38000000 from 0xffffffff81000000 (relocation range: 0xffffffff80000000-0xffffffffbfffffff)                                     
 [441584.504464] ---[ end Kernel panic - not syncing: Fatal exception in interrupt

Another one

@bgilbert
Copy link
Contributor

Thanks for the detailed info. flush_unmaps_timeout+0xa7 is this line:

https://github.com/coreos/linux/blob/5614d6af6222fab53adddc3258cf8c28b9be3030/drivers/iommu/intel-iommu.c#L1575

Could you post the output of dmesg from one of these machines when it's running normally?

As a workaround, you could try passing intel_iommu=strict on the kernel command line, or if that doesn't work, intel_iommu=off. If you're booting from disk rather than PXE, see these examples for adding kernel arguments to the GRUB config.

@x86brandon
Copy link
Author

x86brandon commented Aug 23, 2017 •
edited by bgilbert 

[    0.000000] Linux version 4.12.7-coreos (jenkins@jenkins-worker-1) (gcc version 4.9.4 (Gentoo Hardened 4.9.4 p1.0, pie-0.6.4) ) #1 SMP Tue Aug 15 23:54:56 UTC 2017
[    0.000000] Command line: BOOT_IMAGE=/coreos/vmlinuz-b mount.usr=PARTUUID=e03dd35c-7c2d-4a47-b3fe-27f15780a57c rootflags=rw mount.usrflags=ro consoleblank=0 root=LABEL=ROOT console=ttyS0,115200n8 console=tty0 verity.usrhash=909bed8701dbc93906cc0d718e308d1e415366a23cc5a4868ad7a6538a2e6dca
[    0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'
[    0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'
[    0.000000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'
[    0.000000] x86/fpu: xstate_offset[2]:  576, xstate_sizes[2]:  256
[    0.000000] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format.
[    0.000000] e820: BIOS-provided physical RAM map:
[    0.000000] BIOS-e820: [mem 0x0000000000000000-0x0000000000093fff] usable
[    0.000000] BIOS-e820: [mem 0x0000000000094000-0x000000000009ffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005a700fff] usable
[    0.000000] BIOS-e820: [mem 0x000000005a701000-0x000000005b540fff] reserved
[    0.000000] BIOS-e820: [mem 0x000000005b541000-0x00000000790fefff] usable
[    0.000000] BIOS-e820: [mem 0x00000000790ff000-0x00000000791fefff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000791ff000-0x000000007b5fefff] ACPI NVS
[    0.000000] BIOS-e820: [mem 0x000000007b5ff000-0x000000007b7fefff] ACPI data
[    0.000000] BIOS-e820: [mem 0x000000007b7ff000-0x000000007b7fffff] usable
[    0.000000] BIOS-e820: [mem 0x000000007b800000-0x000000008fffffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000ff800000-0x00000000ffffffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000407fffffff] usable
[    0.000000] NX (Execute Disable) protection: active
[    0.000000] SMBIOS 2.8 present.
[    0.000000] DMI: HP ProLiant DL380 Gen9/ProLiant DL380 Gen9, BIOS P89 02/17/2017
[    0.000000] tsc: Fast TSC calibration using PIT
[    0.000000] e820: update [mem 0x00000000-0x00000fff] usable ==> reserved
[    0.000000] e820: remove [mem 0x000a0000-0x000fffff] usable
[    0.000000] e820: last_pfn = 0x4080000 max_arch_pfn = 0x400000000
[    0.000000] MTRR default type: write-back
[    0.000000] MTRR fixed ranges enabled:
[    0.000000]   00000-9FFFF write-back
[    0.000000]   A0000-BFFFF uncachable
[    0.000000]   C0000-DFFFF write-protect
[    0.000000]   E0000-EFFFF uncachable
[    0.000000]   F0000-FFFFF write-protect
[    0.000000] MTRR variable ranges enabled:
[    0.000000]   0 base 000080000000 mask 3FFF80000000 uncachable
[    0.000000]   1 base 004080000000 mask 3FFF80000000 uncachable
[    0.000000]   2 base 008000000000 mask 3F8000000000 uncachable
[    0.000000]   3 base 010000000000 mask 3F0000000000 uncachable
[    0.000000]   4 base 038000000000 mask 3FC000000000 uncachable
[    0.000000]   5 base 00007C000000 mask 3FFFFC000000 uncachable
[    0.000000]   6 base 00007FC00000 mask 3FFFFFC00000 uncachable
[    0.000000]   7 disabled
[    0.000000]   8 disabled
[    0.000000]   9 disabled
[    0.000000] x86/PAT: Configuration [0-7]: WB  WC  UC- UC  WB  WC  UC- WT
[    0.000000] e820: last_pfn = 0x7b800 max_arch_pfn = 0x400000000
[    0.000000] Base memory trampoline at [ffff9e02c008d000] 8d000 size 28672
[    0.000000] Using GB pages for direct mapping
[    0.000000] BRK [0x1cdbda6000, 0x1cdbda6fff] PGTABLE
[    0.000000] BRK [0x1cdbda7000, 0x1cdbda7fff] PGTABLE
[    0.000000] BRK [0x1cdbda8000, 0x1cdbda8fff] PGTABLE
[    0.000000] BRK [0x1cdbda9000, 0x1cdbda9fff] PGTABLE
[    0.000000] BRK [0x1cdbdaa000, 0x1cdbdaafff] PGTABLE
[    0.000000] BRK [0x1cdbdab000, 0x1cdbdabfff] PGTABLE
[    0.000000] BRK [0x1cdbdac000, 0x1cdbdacfff] PGTABLE
[    0.000000] BRK [0x1cdbdad000, 0x1cdbdadfff] PGTABLE
[    0.000000] BRK [0x1cdbdae000, 0x1cdbdaefff] PGTABLE
[    0.000000] ACPI: Early table checksum verification disabled
[    0.000000] ACPI: RSDP 0x00000000000F4F00 000024 (v02 HP    )
[    0.000000] ACPI: XSDT 0x000000007B7E8188 0000EC (v01 HP     ProLiant 00000001      01000013)
[    0.000000] ACPI: FACP 0x000000007B7F6000 00010C (v05 HP     ProLiant 00000001 HP   00000001)
[    0.000000] ACPI: DSDT 0x000000007B7DF000 0080E4 (v02 HP     DSDT     00000002 HPAG 00020000)
[    0.000000] ACPI: FACS 0x000000007B541000 000040
[    0.000000] ACPI: UEFI 0x000000007B579000 000042 (v01 HP     ProLiant 00000002      01000013)
[    0.000000] ACPI: MCEJ 0x000000007B7FC000 000130 (v01 HP     ProLiant 00000001 INTL 0100000D)
[    0.000000] ACPI: SSDT 0x000000007B7FB000 000064 (v02 HP     SpsNvs   00000002 INTL 20130328)
[    0.000000] ACPI: HEST 0x000000007B7FA000 0000A8 (v01 HP     ProLiant 00000001 INTL 00000001)
[    0.000000] ACPI: BERT 0x000000007B7F9000 000030 (v01 HP     ProLiant 00000001 INTL 00000001)
[    0.000000] ACPI: ERST 0x000000007B7F8000 000230 (v01 HP     ProLiant 00000001 INTL 00000001)
[    0.000000] ACPI: EINJ 0x000000007B7F7000 000150 (v01 HP     ProLiant 00000001 INTL 00000001)
[    0.000000] ACPI: HPET 0x000000007B7F5000 000038 (v01 HP     ProLiant 00000001 HP   00000001)
[    0.000000] ACPI: PMCT 0x000000007B7F4000 000064 (v01 HP     ProLiant 00000001 HP   00000001)
[    0.000000] ACPI: WDDT 0x000000007B7F3000 000040 (v01 HP     ProLiant 00000001 HP   00000001)
[    0.000000] ACPI: APIC 0x000000007B7F2000 0003EA (v03 HP     ProLiant 00000001 HP   00000001)
[    0.000000] ACPI: MCFG 0x000000007B7F1000 00003C (v01 HP     ProLiant 00000001 HP   00000001)
[    0.000000] ACPI: SLIT 0x000000007B7F0000 000030 (v01 HP     ProLiant 00000001 HP   00000001)
[    0.000000] ACPI: SRAT 0x000000007B7EF000 000380 (v03 HP     ProLiant 00000001 HP   00000001)
[    0.000000] ACPI: SPMI 0x000000007B7EE000 000041 (v05 HP     ProLiant 00000001 HP   00000001)
[    0.000000] ACPI: RASF 0x000000007B7ED000 000030 (v01 HP     ProLiant 00000001 HP   00000001)
[    0.000000] ACPI: SPCR 0x000000007B7EC000 000050 (v01 HP     ProLiant 00000001 HP   00000001)
[    0.000000] ACPI: MSCT 0x000000007B7EB000 000064 (v01 HP     ProLiant 00000001 HP   00000001)
[    0.000000] ACPI: BDAT 0x000000007B7EA000 000030 (v01 HP     ProLiant 00000001 HP   00000001)
[    0.000000] ACPI: PCCT 0x000000007B7E9000 00006E (v01 HP     ProLiant 00000001 HP   00000001)
[    0.000000] ACPI: SSDT 0x000000007B7D8000 006FBE (v02 HP     PCISSDT  00000002 HPAG 00020000)
[    0.000000] ACPI: SSDT 0x000000007B7D7000 0001CB (v02 HP     TIMESSDT 00000002 HPAG 00020000)
[    0.000000] ACPI: SSDT 0x000000007B7D6000 0002F2 (v01 HP     pmab     00000001 INTL 20130328)
[    0.000000] ACPI: DMAR 0x000000007B7FD000 000380 (v01 INTEL  INTEL ID 00000001 ?    00000001)
[    0.000000] ACPI: Local APIC address 0xfee00000
[    0.000000] SRAT: PXM 0 -> APIC 0x0000 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0002 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0004 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0006 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0008 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x000a -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x000c -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x000e -> Node 0
[    0.000000] SRAT: PXM 1 -> APIC 0x0010 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x0012 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x0014 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x0016 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x0018 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x001a -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x001c -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x001e -> Node 1
[    0.000000] SRAT: PXM 0 -> APIC 0x0001 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0003 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0005 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0007 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0009 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x000b -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x000d -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x000f -> Node 0
[    0.000000] SRAT: PXM 1 -> APIC 0x0011 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x0013 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x0015 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x0017 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x0019 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x001b -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x001d -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x001f -> Node 1
[    0.000000] ACPI: SRAT: Node 0 PXM 0 [mem 0x00000000-0x207fffffff]
[    0.000000] ACPI: SRAT: Node 1 PXM 1 [mem 0x2080000000-0x407fffffff]
[    0.000000] NUMA: Initialized distance table, cnt=2
[    0.000000] NODE_DATA(0) allocated [mem 0x207fffa000-0x207fffffff]
[    0.000000] NODE_DATA(1) allocated [mem 0x407fff9000-0x407fffefff]
[    0.000000] Zone ranges:
[    0.000000]   DMA      [mem 0x0000000000001000-0x0000000000ffffff]
[    0.000000]   DMA32    [mem 0x0000000001000000-0x00000000ffffffff]
[    0.000000]   Normal   [mem 0x0000000100000000-0x000000407fffffff]
[    0.000000] Movable zone start for each node
[    0.000000] Early memory node ranges
[    0.000000]   node   0: [mem 0x0000000000001000-0x0000000000093fff]
[    0.000000]   node   0: [mem 0x0000000000100000-0x000000005a700fff]
[    0.000000]   node   0: [mem 0x000000005b541000-0x00000000790fefff]
[    0.000000]   node   0: [mem 0x000000007b7ff000-0x000000007b7fffff]
[    0.000000]   node   0: [mem 0x0000000100000000-0x000000207fffffff]
[    0.000000]   node   1: [mem 0x0000002080000000-0x000000407fffffff]
[    0.000000] Initmem setup node 0 [mem 0x0000000000001000-0x000000207fffffff]
[    0.000000] On node 0 totalpages: 33522259
[    0.000000]   DMA zone: 64 pages used for memmap
[    0.000000]   DMA zone: 22 pages reserved
[    0.000000]   DMA zone: 3987 pages, LIFO batch:0
[    0.000000]   DMA32 zone: 7627 pages used for memmap
[    0.000000]   DMA32 zone: 488128 pages, LIFO batch:31
[    0.000000]   Normal zone: 516096 pages used for memmap
[    0.000000]   Normal zone: 33030144 pages, LIFO batch:31
[    0.000000] Initmem setup node 1 [mem 0x0000002080000000-0x000000407fffffff]
[    0.000000] On node 1 totalpages: 33554432
[    0.000000]   Normal zone: 524288 pages used for memmap
[    0.000000]   Normal zone: 33554432 pages, LIFO batch:31
[    0.000000] ACPI: PM-Timer IO Port: 0x408
[    0.000000] ACPI: Local APIC address 0xfee00000
[    0.000000] ACPI: X2APIC_NMI (uid[0x00] high level lint[0x1])
[    0.000000] ACPI: X2APIC_NMI (uid[0x01] high level lint[0x1])
[    0.000000] ACPI: X2APIC_NMI (uid[0x02] high level lint[0x1])
[    0.000000] ACPI: X2APIC_NMI (uid[0x03] high level lint[0x1])
[    0.000000] ACPI: X2APIC_NMI (uid[0x04] high level lint[0x1])
[    0.000000] ACPI: X2APIC_NMI (uid[0x05] high level lint[0x1])
[    0.000000] ACPI: X2APIC_NMI (uid[0x06] high level lint[0x1])
[    0.000000] ACPI: X2APIC_NMI (uid[0x07] high level lint[0x1])
[    0.000000] ACPI: X2APIC_NMI (uid[0x08] high level lint[0x1])
[    0.000000] ACPI: X2APIC_NMI (uid[0x09] high level lint[0x1])
[    0.000000] ACPI: X2APIC_NMI (uid[0x0a] high level lint[0x1])
[    0.000000] ACPI: X2APIC_NMI (uid[0x0b] high level lint[0x1])
[    0.000000] ACPI: X2APIC_NMI (uid[0x0c] high level lint[0x1])
[    0.000000] ACPI: X2APIC_NMI (uid[0x0d] high level lint[0x1])
[    0.000000] ACPI: X2APIC_NMI (uid[0x0e] high level lint[0x1])
[    0.000000] ACPI: X2APIC_NMI (uid[0x0f] high level lint[0x1])
[    0.000000] ACPI: X2APIC_NMI (uid[0x10] high level lint[0x1])
[    0.000000] ACPI: X2APIC_NMI (uid[0x11] high level lint[0x1])
[    0.000000] ACPI: X2APIC_NMI (uid[0x12] high level lint[0x1])
[    0.000000] ACPI: X2APIC_NMI (uid[0x13] high level lint[0x1])
[    0.000000] ACPI: X2APIC_NMI (uid[0x14] high level lint[0x1])
[    0.000000] ACPI: X2APIC_NMI (uid[0x15] high level lint[0x1])
[    0.000000] ACPI: X2APIC_NMI (uid[0x16] high level lint[0x1])
[    0.000000] ACPI: X2APIC_NMI (uid[0x17] high level lint[0x1])
[    0.000000] ACPI: X2APIC_NMI (uid[0x18] high level lint[0x1])
[    0.000000] ACPI: X2APIC_NMI (uid[0x19] high level lint[0x1])
[    0.000000] ACPI: X2APIC_NMI (uid[0x1a] high level lint[0x1])
[    0.000000] ACPI: X2APIC_NMI (uid[0x1b] high level lint[0x1])
[    0.000000] ACPI: X2APIC_NMI (uid[0x1c] high level lint[0x1])
[    0.000000] ACPI: X2APIC_NMI (uid[0x1d] high level lint[0x1])
[    0.000000] ACPI: X2APIC_NMI (uid[0x1e] high level lint[0x1])
[    0.000000] ACPI: X2APIC_NMI (uid[0x1f] high level lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0xff] high level lint[0x1])
[    0.000000] IOAPIC[0]: apic_id 8, version 32, address 0xfec00000, GSI 0-23
[    0.000000] IOAPIC[1]: apic_id 9, version 32, address 0xfec01000, GSI 24-47
[    0.000000] IOAPIC[2]: apic_id 10, version 32, address 0xfec40000, GSI 48-71
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
[    0.000000] ACPI: IRQ0 used by override.
[    0.000000] ACPI: IRQ9 used by override.
[    0.000000] Using ACPI (MADT) for SMP configuration information
[    0.000000] ACPI: HPET id: 0x8086a701 base: 0xfed00000
[    0.000000] smpboot: Allowing 32 CPUs, 0 hotplug CPUs
[    0.000000] e820: [mem 0x90000000-0xff7fffff] available for PCI devices
[    0.000000] Booting paravirtualized kernel on bare hardware
[    0.000000] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns
[    0.000000] setup_percpu: NR_CPUS:512 nr_cpumask_bits:512 nr_cpu_ids:32 nr_node_ids:2
[    0.000000] percpu: Embedded 37 pages/cpu @ffff9e22bfa00000 s114648 r8192 d28712 u262144
[    0.000000] pcpu-alloc: s114648 r8192 d28712 u262144 alloc=1*2097152
[    0.000000] pcpu-alloc: [0] 00 01 02 03 04 05 06 07 [0] 16 17 18 19 20 21 22 23
[    0.000000] pcpu-alloc: [1] 08 09 10 11 12 13 14 15 [1] 24 25 26 27 28 29 30 31
[    0.000000] Built 2 zonelists in Node order, mobility grouping on.  Total pages: 66028594
[    0.000000] Policy zone: Normal
[    0.000000] Kernel command line: rootflags=rw mount.usrflags=ro BOOT_IMAGE=/coreos/vmlinuz-b mount.usr=PARTUUID=e03dd35c-7c2d-4a47-b3fe-27f15780a57c rootflags=rw mount.usrflags=ro consoleblank=0 root=LABEL=ROOT console=ttyS0,115200n8 console=tty0 verity.usrhash=909bed8701dbc93906cc0d718e308d1e415366a23cc5a4868ad7a6538a2e6dca
[    0.000000] PID hash table entries: 4096 (order: 3, 32768 bytes)
[    0.000000] Memory: 263994676K/268306764K available (6239K kernel code, 1215K rwdata, 2652K rodata, 32412K init, 744K bss, 4312088K reserved, 0K cma-reserved)
[    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=32, Nodes=2
[    0.000000] ftrace: allocating 26291 entries in 103 pages
[    0.000000] Hierarchical RCU implementation.
[    0.000000] 	RCU debugfs-based tracing is enabled.
[    0.000000] 	RCU restricting CPUs from NR_CPUS=512 to nr_cpu_ids=32.
[    0.000000] RCU: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=32
[    0.000000] NR_IRQS:33024 nr_irqs:1496 16
[    0.000000] Console: colour VGA+ 80x25
[    0.000000] console [tty0] enabled
[    0.000000] console [ttyS0] enabled
[    0.000000] mempolicy: Enabling automatic NUMA balancing. Configure with numa_balancing= or the kernel.numa_balancing sysctl
[    0.000000] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484882848 ns
[    0.000000] hpet clockevent registered
[    0.000000] tsc: Fast TSC calibration using PIT
[    0.001000] tsc: Detected 2397.081 MHz processor
[    0.002000] Calibrating delay loop (skipped), value calculated using timer frequency.. 4794.16 BogoMIPS (lpj=2397081)
[    0.003005] pid_max: default: 32768 minimum: 301
[    0.004021] ACPI: Core revision 20170303
[    0.008366] ACPI: 5 ACPI AML tables successfully acquired and loaded
[    0.009054] Security Framework initialized
[    0.010002] SELinux:  Initializing.
[    0.011010] SELinux:  Starting in permissive mode
[    0.021367] Dentry cache hash table entries: 33554432 (order: 16, 268435456 bytes)
[    0.066550] Inode-cache hash table entries: 16777216 (order: 15, 134217728 bytes)
[    0.086531] Mount-cache hash table entries: 524288 (order: 10, 4194304 bytes)
[    0.087185] Mountpoint-cache hash table entries: 524288 (order: 10, 4194304 bytes)
[    0.089924] CPU: Physical Processor ID: 0
[    0.090003] CPU: Processor Core ID: 0
[    0.091008] mce: CPU supports 22 MCE banks
[    0.092017] CPU0: Thermal monitoring enabled (TM1)
[    0.093020] process: using mwait in idle threads
[    0.094004] Last level iTLB entries: 4KB 1024, 2MB 1024, 4MB 1024
[    0.095002] Last level dTLB entries: 4KB 1024, 2MB 1024, 4MB 1024, 1GB 4
[    0.097199] Freeing SMP alternatives memory: 24K
[    0.099590] smpboot: Max logical packages: 4
[    0.100020] DMAR: Host address width 46
[    0.101003] DMAR: DRHD base: 0x000000fbffc000 flags: 0x0
[    0.102009] DMAR: dmar0: reg_base_addr fbffc000 ver 1:0 cap d2078c106f0466 ecap f020de
[    0.103002] DMAR: DRHD base: 0x000000c7ffc000 flags: 0x1
[    0.104009] DMAR: dmar1: reg_base_addr c7ffc000 ver 1:0 cap d2078c106f0466 ecap f020de
[    0.105002] DMAR: RMRR base: 0x00000079170000 end: 0x00000079172fff
[    0.106005] DMAR: RMRR base: 0x000000791f4000 end: 0x000000791f7fff
[    0.107004] DMAR: RMRR base: 0x000000791de000 end: 0x000000791f3fff
[    0.108008] DMAR: RMRR base: 0x000000791cb000 end: 0x000000791dbfff
[    0.109004] DMAR: RMRR base: 0x000000791dc000 end: 0x000000791ddfff
[    0.110002] DMAR: RMRR base: 0x0000005a701000 end: 0x0000005a740fff
[    0.111004] DMAR: ATSR flags: 0x0
[    0.112005] DMAR: ATSR flags: 0x0
[    0.113006] DMAR-IR: IOAPIC id 10 under DRHD base  0xfbffc000 IOMMU 0
[    0.114002] DMAR-IR: IOAPIC id 8 under DRHD base  0xc7ffc000 IOMMU 1
[    0.115002] DMAR-IR: IOAPIC id 9 under DRHD base  0xc7ffc000 IOMMU 1
[    0.116002] DMAR-IR: HPET id 0 under DRHD base 0xc7ffc000
[    0.117005] DMAR-IR: Queued invalidation will be enabled to support x2apic and Intr-remapping.
[    0.118840] DMAR-IR: Enabled IRQ remapping in x2apic mode
[    0.119000] x2apic enabled
[    0.119005] Switched APIC routing to cluster x2apic.
[    0.121560] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
[    0.131376] TSC deadline timer enabled
[    0.131381] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-2630 v3 @ 2.40GHz (family: 0x6, model: 0x3f, stepping: 0x2)
[    0.132118] Performance Events: PEBS fmt2+, Haswell events, full-width counters, Broken BIOS detected, complain to your hardware vendor.
[    0.133002] [Firmware Bug]: the BIOS has corrupted hw-PMU resources (MSR 38d is 330)
[    0.134001] Intel PMU driver.
[    0.135006] ... version:                3
[    0.136001] ... bit width:              48
[    0.137000] ... generic registers:      4
[    0.138001] ... value mask:             0000ffffffffffff
[    0.139001] ... max period:             00007fffffffffff
[    0.140000] ... fixed-purpose events:   3
[    0.141001] ... event mask:             000000070000000f
[    0.143802] NMI watchdog: enabled on all CPUs, permanently consumes one hw-PMU counter.
[    0.144018] smp: Bringing up secondary CPUs ...
[    0.145091] x86: Booting SMP configuration:
[    0.146001] .... node  #0, CPUs:        #1  #2  #3  #4  #5  #6  #7
[    0.567002] .... node  #1, CPUs:    #8  #9 #10 #11 #12 #13 #14 #15
[    1.051003] .... node  #0, CPUs:   #16 #17 #18 #19 #20 #21 #22 #23
[    1.533002] .... node  #1, CPUs:   #24 #25 #26 #27 #28 #29 #30 #31
[    2.016058] smp: Brought up 2 nodes, 32 CPUs
[    2.018002] smpboot: Total of 32 processors activated (153639.02 BogoMIPS)
[    2.020752] sched_clock: Marking stable (2020000000, 0)->(2439500342, -419500342)
[    2.036239] devtmpfs: initialized
[    2.040129] x86/mm: Memory block size: 2048MB
[    2.047566] PM: Registering ACPI NVS region [mem 0x791ff000-0x7b5fefff] (37748736 bytes)
[    2.057728] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns
[    2.068823] futex hash table entries: 8192 (order: 7, 524288 bytes)
[    2.076152] pinctrl core: initialized pinctrl subsystem
[    2.082874] NET: Registered protocol family 16
[    2.088117] cpuidle: using governor menu
[    2.092641] Error parsing PCC subspaces from PCCT
[    2.098057] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it
[    2.106724] ACPI: bus type PCI registered
[    2.111329] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5
[    2.118674] dca service started, version 1.12.1
[    2.123867] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0x80000000-0x8fffffff] (base 0x80000000)
[    2.134455] PCI: MMCONFIG at [mem 0x80000000-0x8fffffff] reserved in E820
[    2.142133] PCI: Using configuration type 1 for base access
[    2.148460] PCI: HP ProLiant DL380 detected, enabling pci=bfsort.
[    2.155656] core: PMU erratum BJ122, BV98, HSD29 worked around, HT is on
[    2.165315] HugeTLB registered 1 GB page size, pre-allocated 0 pages
[    2.172523] HugeTLB registered 2 MB page size, pre-allocated 0 pages
[    2.180393] ACPI: Added _OSI(Module Device)
[    2.185205] ACPI: Added _OSI(Processor Device)
[    2.190301] ACPI: Added _OSI(3.0 _SCP Extensions)
[    2.195681] ACPI: Added _OSI(Processor Aggregator Device)
[    2.207974] ACPI: Interpreter enabled
[    2.212218] ACPI: (supports S0 S5)
[    2.216165] ACPI: Using IOAPIC for interrupt routing
[    2.226015] HEST: Table parsing has been initialized.
[    2.231781] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug
[    2.248213] ACPI: PCI Root Bridge [UNC0] (domain 0000 [bus 7f])
[    2.254936] acpi PNP0A03:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    2.264294] acpi PNP0A03:00: _OSC failed (AE_NOT_FOUND); disabling ASPM
[    2.271810] PCI host bridge to bus 0000:7f
[    2.276522] pci_bus 0000:7f: root bus resource [bus 7f]
[    2.282482] pci 0000:7f:08.0: [8086:2f80] type 00 class 0x088000
[    2.282537] pci 0000:7f:08.3: [8086:2f83] type 00 class 0x088000
[    2.282584] pci 0000:7f:09.0: [8086:2f90] type 00 class 0x088000
[    2.282628] pci 0000:7f:09.3: [8086:2f93] type 00 class 0x088000
[    2.282673] pci 0000:7f:0b.0: [8086:2f81] type 00 class 0x088000
[    2.282707] pci 0000:7f:0b.1: [8086:2f36] type 00 class 0x110100
[    2.282746] pci 0000:7f:0b.2: [8086:2f37] type 00 class 0x110100
[    2.282787] pci 0000:7f:0c.0: [8086:2fe0] type 00 class 0x088000
[    2.282824] pci 0000:7f:0c.1: [8086:2fe1] type 00 class 0x088000
[    2.282863] pci 0000:7f:0c.2: [8086:2fe2] type 00 class 0x088000
[    2.282901] pci 0000:7f:0c.3: [8086:2fe3] type 00 class 0x088000
[    2.282940] pci 0000:7f:0c.4: [8086:2fe4] type 00 class 0x088000
[    2.282978] pci 0000:7f:0c.5: [8086:2fe5] type 00 class 0x088000
[    2.283014] pci 0000:7f:0c.6: [8086:2fe6] type 00 class 0x088000
[    2.283050] pci 0000:7f:0c.7: [8086:2fe7] type 00 class 0x088000
[    2.283094] pci 0000:7f:0f.0: [8086:2ff8] type 00 class 0x088000
[    2.283127] pci 0000:7f:0f.1: [8086:2ff9] type 00 class 0x088000
[    2.283166] pci 0000:7f:0f.4: [8086:2ffc] type 00 class 0x088000
[    2.283203] pci 0000:7f:0f.5: [8086:2ffd] type 00 class 0x088000
[    2.283241] pci 0000:7f:0f.6: [8086:2ffe] type 00 class 0x088000
[    2.283283] pci 0000:7f:10.0: [8086:2f1d] type 00 class 0x088000
[    2.283320] pci 0000:7f:10.1: [8086:2f34] type 00 class 0x110100
[    2.283359] pci 0000:7f:10.5: [8086:2f1e] type 00 class 0x088000
[    2.283395] pci 0000:7f:10.6: [8086:2f7d] type 00 class 0x110100
[    2.283432] pci 0000:7f:10.7: [8086:2f1f] type 00 class 0x088000
[    2.283470] pci 0000:7f:12.0: [8086:2fa0] type 00 class 0x088000
[    2.283512] pci 0000:7f:12.1: [8086:2f30] type 00 class 0x110100
[    2.283554] pci 0000:7f:12.2: [8086:2f70] type 00 class 0x088000
[    2.283593] pci 0000:7f:13.0: [8086:2fa8] type 00 class 0x088000
[    2.283636] pci 0000:7f:13.1: [8086:2f71] type 00 class 0x088000
[    2.283679] pci 0000:7f:13.2: [8086:2faa] type 00 class 0x088000
[    2.283722] pci 0000:7f:13.3: [8086:2fab] type 00 class 0x088000
[    2.283764] pci 0000:7f:13.4: [8086:2fac] type 00 class 0x088000
[    2.283806] pci 0000:7f:13.5: [8086:2fad] type 00 class 0x088000
[    2.283847] pci 0000:7f:13.6: [8086:2fae] type 00 class 0x088000
[    2.283886] pci 0000:7f:13.7: [8086:2faf] type 00 class 0x088000
[    2.283926] pci 0000:7f:14.0: [8086:2fb0] type 00 class 0x088000
[    2.283969] pci 0000:7f:14.1: [8086:2fb1] type 00 class 0x088000
[    2.284013] pci 0000:7f:14.2: [8086:2fb2] type 00 class 0x088000
[    2.284051] pci 0000:7f:14.3: [8086:2fb3] type 00 class 0x088000
[    2.284095] pci 0000:7f:14.4: [8086:2fbc] type 00 class 0x088000
[    2.284135] pci 0000:7f:14.5: [8086:2fbd] type 00 class 0x088000
[    2.284175] pci 0000:7f:14.6: [8086:2fbe] type 00 class 0x088000
[    2.284218] pci 0000:7f:14.7: [8086:2fbf] type 00 class 0x088000
[    2.284265] pci 0000:7f:15.0: [8086:2fb4] type 00 class 0x088000
[    2.284308] pci 0000:7f:15.1: [8086:2fb5] type 00 class 0x088000
[    2.284350] pci 0000:7f:15.2: [8086:2fb6] type 00 class 0x088000
[    2.284393] pci 0000:7f:15.3: [8086:2fb7] type 00 class 0x088000
[    2.284439] pci 0000:7f:16.0: [8086:2f68] type 00 class 0x088000
[    2.284487] pci 0000:7f:16.6: [8086:2f6e] type 00 class 0x088000
[    2.284524] pci 0000:7f:16.7: [8086:2f6f] type 00 class 0x088000
[    2.284565] pci 0000:7f:17.0: [8086:2fd0] type 00 class 0x088000
[    2.284607] pci 0000:7f:17.4: [8086:2fb8] type 00 class 0x088000
[    2.284646] pci 0000:7f:17.5: [8086:2fb9] type 00 class 0x088000
[    2.284685] pci 0000:7f:17.6: [8086:2fba] type 00 class 0x088000
[    2.284724] pci 0000:7f:17.7: [8086:2fbb] type 00 class 0x088000
[    2.284768] pci 0000:7f:1e.0: [8086:2f98] type 00 class 0x088000
[    2.284810] pci 0000:7f:1e.1: [8086:2f99] type 00 class 0x088000
[    2.284848] pci 0000:7f:1e.2: [8086:2f9a] type 00 class 0x088000
[    2.284887] pci 0000:7f:1e.3: [8086:2fc0] type 00 class 0x088000
[    2.284913] pci 0000:7f:1e.4: [8086:2f9c] type 00 class 0x088000
[    2.285125] pci 0000:7f:1f.0: [8086:2f88] type 00 class 0x088000
[    2.285160] pci 0000:7f:1f.2: [8086:2f8a] type 00 class 0x088000
[    2.285228] ACPI: PCI Root Bridge [UNC1] (domain 0000 [bus ff])
[    2.291948] acpi PNP0A03:01: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    2.301308] acpi PNP0A03:01: _OSC failed (AE_NOT_FOUND); disabling ASPM
[    2.308823] PCI host bridge to bus 0000:ff
[    2.313535] pci_bus 0000:ff: root bus resource [bus ff]
[    2.319493] pci 0000:ff:08.0: [8086:2f80] type 00 class 0x088000
[    2.319542] pci 0000:ff:08.3: [8086:2f83] type 00 class 0x088000
[    2.319582] pci 0000:ff:09.0: [8086:2f90] type 00 class 0x088000
[    2.319619] pci 0000:ff:09.3: [8086:2f93] type 00 class 0x088000
[    2.319660] pci 0000:ff:0b.0: [8086:2f81] type 00 class 0x088000
[    2.319694] pci 0000:ff:0b.1: [8086:2f36] type 00 class 0x110100
[    2.319727] pci 0000:ff:0b.2: [8086:2f37] type 00 class 0x110100
[    2.319759] pci 0000:ff:0c.0: [8086:2fe0] type 00 class 0x088000
[    2.319792] pci 0000:ff:0c.1: [8086:2fe1] type 00 class 0x088000
[    2.319825] pci 0000:ff:0c.2: [8086:2fe2] type 00 class 0x088000
[    2.319857] pci 0000:ff:0c.3: [8086:2fe3] type 00 class 0x088000
[    2.319889] pci 0000:ff:0c.4: [8086:2fe4] type 00 class 0x088000
[    2.319922] pci 0000:ff:0c.5: [8086:2fe5] type 00 class 0x088000
[    2.319954] pci 0000:ff:0c.6: [8086:2fe6] type 00 class 0x088000
[    2.319986] pci 0000:ff:0c.7: [8086:2fe7] type 00 class 0x088000
[    2.320020] pci 0000:ff:0f.0: [8086:2ff8] type 00 class 0x088000
[    2.320052] pci 0000:ff:0f.1: [8086:2ff9] type 00 class 0x088000
[    2.320087] pci 0000:ff:0f.4: [8086:2ffc] type 00 class 0x088000
[    2.320117] pci 0000:ff:0f.5: [8086:2ffd] type 00 class 0x088000
[    2.320150] pci 0000:ff:0f.6: [8086:2ffe] type 00 class 0x088000
[    2.320187] pci 0000:ff:10.0: [8086:2f1d] type 00 class 0x088000
[    2.320221] pci 0000:ff:10.1: [8086:2f34] type 00 class 0x110100
[    2.320255] pci 0000:ff:10.5: [8086:2f1e] type 00 class 0x088000
[    2.320288] pci 0000:ff:10.6: [8086:2f7d] type 00 class 0x110100
[    2.320319] pci 0000:ff:10.7: [8086:2f1f] type 00 class 0x088000
[    2.320352] pci 0000:ff:12.0: [8086:2fa0] type 00 class 0x088000
[    2.320386] pci 0000:ff:12.1: [8086:2f30] type 00 class 0x110100
[    2.320420] pci 0000:ff:12.2: [8086:2f70] type 00 class 0x088000
[    2.320459] pci 0000:ff:13.0: [8086:2fa8] type 00 class 0x088000
[    2.320498] pci 0000:ff:13.1: [8086:2f71] type 00 class 0x088000
[    2.320532] pci 0000:ff:13.2: [8086:2faa] type 00 class 0x088000
[    2.320569] pci 0000:ff:13.3: [8086:2fab] type 00 class 0x088000
[    2.320606] pci 0000:ff:13.4: [8086:2fac] type 00 class 0x088000
[    2.320649] pci 0000:ff:13.5: [8086:2fad] type 00 class 0x088000
[    2.320687] pci 0000:ff:13.6: [8086:2fae] type 00 class 0x088000
[    2.320722] pci 0000:ff:13.7: [8086:2faf] type 00 class 0x088000
[    2.320759] pci 0000:ff:14.0: [8086:2fb0] type 00 class 0x088000
[    2.320797] pci 0000:ff:14.1: [8086:2fb1] type 00 class 0x088000
[    2.320835] pci 0000:ff:14.2: [8086:2fb2] type 00 class 0x088000
[    2.320874] pci 0000:ff:14.3: [8086:2fb3] type 00 class 0x088000
[    2.320912] pci 0000:ff:14.4: [8086:2fbc] type 00 class 0x088000
[    2.320948] pci 0000:ff:14.5: [8086:2fbd] type 00 class 0x088000
[    2.320983] pci 0000:ff:14.6: [8086:2fbe] type 00 class 0x088000
[    2.321018] pci 0000:ff:14.7: [8086:2fbf] type 00 class 0x088000
[    2.321056] pci 0000:ff:15.0: [8086:2fb4] type 00 class 0x088000
[    2.321094] pci 0000:ff:15.1: [8086:2fb5] type 00 class 0x088000
[    2.321134] pci 0000:ff:15.2: [8086:2fb6] type 00 class 0x088000
[    2.321176] pci 0000:ff:15.3: [8086:2fb7] type 00 class 0x088000
[    2.321218] pci 0000:ff:16.0: [8086:2f68] type 00 class 0x088000
[    2.321259] pci 0000:ff:16.6: [8086:2f6e] type 00 class 0x088000
[    2.321296] pci 0000:ff:16.7: [8086:2f6f] type 00 class 0x088000
[    2.321334] pci 0000:ff:17.0: [8086:2fd0] type 00 class 0x088000
[    2.321371] pci 0000:ff:17.4: [8086:2fb8] type 00 class 0x088000
[    2.321409] pci 0000:ff:17.5: [8086:2fb9] type 00 class 0x088000
[    2.321446] pci 0000:ff:17.6: [8086:2fba] type 00 class 0x088000
[    2.321482] pci 0000:ff:17.7: [8086:2fbb] type 00 class 0x088000
[    2.321526] pci 0000:ff:1e.0: [8086:2f98] type 00 class 0x088000
[    2.321562] pci 0000:ff:1e.1: [8086:2f99] type 00 class 0x088000
[    2.321598] pci 0000:ff:1e.2: [8086:2f9a] type 00 class 0x088000
[    2.321635] pci 0000:ff:1e.3: [8086:2fc0] type 00 class 0x088000
[    2.321663] pci 0000:ff:1e.4: [8086:2f9c] type 00 class 0x088000
[    2.321705] pci 0000:ff:1f.0: [8086:2f88] type 00 class 0x088000
[    2.321743] pci 0000:ff:1f.2: [8086:2f8a] type 00 class 0x088000
[    2.322349] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-7e])
[    2.329359] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    2.338783] acpi PNP0A08:00: _OSC: platform does not support [AER]
[    2.345853] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability]
[    2.354635] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration
[    2.364154] acpi PNP0A08:00: ignoring host bridge window [mem 0x000c4000-0x000cbfff window] (conflicts with Video ROM [mem 0x000c0000-0x000c7fff])
[    2.379206] PCI host bridge to bus 0000:00
[    2.383920] pci_bus 0000:00: root bus resource [io  0x0000-0x03af window]
[    2.391599] pci_bus 0000:00: root bus resource [io  0x03e0-0x0cf7 window]
[    2.399275] pci_bus 0000:00: root bus resource [io  0x03b0-0x03bb window]
[    2.406954] pci_bus 0000:00: root bus resource [io  0x03c0-0x03df window]
[    2.414715] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]
[    2.423304] pci_bus 0000:00: root bus resource [io  0x1000-0x9fff window]
[    2.430980] pci_bus 0000:00: root bus resource [mem 0x90000000-0xc7ffbfff window]
[    2.439569] pci_bus 0000:00: root bus resource [mem 0x38000000000-0x39fffffffff window]
[    2.448734] pci_bus 0000:00: root bus resource [bus 00-7e]
[    2.454982] pci 0000:00:00.0: [8086:2f00] type 00 class 0x060000
[    2.455118] pci 0000:00:01.0: [8086:2f02] type 01 class 0x060400
[    2.455171] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold
[    2.455260] pci 0000:00:01.1: [8086:2f03] type 01 class 0x060400
[    2.455311] pci 0000:00:01.1: PME# supported from D0 D3hot D3cold
[    2.455403] pci 0000:00:02.0: [8086:2f04] type 01 class 0x060400
[    2.455455] pci 0000:00:02.0: PME# supported from D0 D3hot D3cold
[    2.455526] pci 0000:00:02.0: System wakeup disabled by ACPI
[    2.461993] pci 0000:00:02.1: [8086:2f05] type 01 class 0x060400
[    2.462045] pci 0000:00:02.1: PME# supported from D0 D3hot D3cold
[    2.462136] pci 0000:00:02.2: [8086:2f06] type 01 class 0x060400
[    2.462187] pci 0000:00:02.2: PME# supported from D0 D3hot D3cold
[    2.462249] pci 0000:00:02.2: System wakeup disabled by ACPI
[    2.468705] pci 0000:00:02.3: [8086:2f07] type 01 class 0x060400
[    2.468756] pci 0000:00:02.3: PME# supported from D0 D3hot D3cold
[    2.468847] pci 0000:00:03.0: [8086:2f08] type 01 class 0x060400
[    2.468898] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold
[    2.468960] pci 0000:00:03.0: System wakeup disabled by ACPI
[    2.475427] pci 0000:00:03.1: [8086:2f09] type 01 class 0x060400
[    2.475478] pci 0000:00:03.1: PME# supported from D0 D3hot D3cold
[    2.475567] pci 0000:00:03.2: [8086:2f0a] type 01 class 0x060400
[    2.475618] pci 0000:00:03.2: PME# supported from D0 D3hot D3cold
[    2.475680] pci 0000:00:03.2: System wakeup disabled by ACPI
[    2.482138] pci 0000:00:03.3: [8086:2f0b] type 01 class 0x060400
[    2.482189] pci 0000:00:03.3: PME# supported from D0 D3hot D3cold
[    2.482281] pci 0000:00:04.0: [8086:2f20] type 00 class 0x088000
[    2.482291] pci 0000:00:04.0: reg 0x10: [mem 0x39ffff2c000-0x39ffff2ffff 64bit]
[    2.482405] pci 0000:00:04.1: [8086:2f21] type 00 class 0x088000
[    2.482415] pci 0000:00:04.1: reg 0x10: [mem 0x39ffff28000-0x39ffff2bfff 64bit]
[    2.482531] pci 0000:00:04.2: [8086:2f22] type 00 class 0x088000
[    2.482541] pci 0000:00:04.2: reg 0x10: [mem 0x39ffff24000-0x39ffff27fff 64bit]
[    2.482654] pci 0000:00:04.3: [8086:2f23] type 00 class 0x088000
[    2.482664] pci 0000:00:04.3: reg 0x10: [mem 0x39ffff20000-0x39ffff23fff 64bit]
[    2.482777] pci 0000:00:04.4: [8086:2f24] type 00 class 0x088000
[    2.482786] pci 0000:00:04.4: reg 0x10: [mem 0x39ffff1c000-0x39ffff1ffff 64bit]
[    2.482898] pci 0000:00:04.5: [8086:2f25] type 00 class 0x088000
[    2.482908] pci 0000:00:04.5: reg 0x10: [mem 0x39ffff18000-0x39ffff1bfff 64bit]
[    2.483019] pci 0000:00:04.6: [8086:2f26] type 00 class 0x088000
[    2.483029] pci 0000:00:04.6: reg 0x10: [mem 0x39ffff14000-0x39ffff17fff 64bit]
[    2.483144] pci 0000:00:04.7: [8086:2f27] type 00 class 0x088000
[    2.483154] pci 0000:00:04.7: reg 0x10: [mem 0x39ffff10000-0x39ffff13fff 64bit]
[    2.483273] pci 0000:00:05.0: [8086:2f28] type 00 class 0x088000
[    2.483380] pci 0000:00:05.1: [8086:2f29] type 00 class 0x088000
[    2.483505] pci 0000:00:05.2: [8086:2f2a] type 00 class 0x088000
[    2.483617] pci 0000:00:05.4: [8086:2f2c] type 00 class 0x080020
[    2.483624] pci 0000:00:05.4: reg 0x10: [mem 0x93803000-0x93803fff]
[    2.483748] pci 0000:00:11.0: [8086:8d7c] type 00 class 0xff0000
[    2.483926] pci 0000:00:14.0: [8086:8d31] type 00 class 0x0c0330
[    2.483942] pci 0000:00:14.0: reg 0x10: [mem 0x39ffff00000-0x39ffff0ffff 64bit]
[    2.483994] pci 0000:00:14.0: PME# supported from D3hot D3cold
[    2.484082] pci 0000:00:1a.0: [8086:8d2d] type 00 class 0x0c0320
[    2.484098] pci 0000:00:1a.0: reg 0x10: [mem 0x93801000-0x938013ff]
[    2.484182] pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold
[    2.484275] pci 0000:00:1c.0: [8086:8d10] type 01 class 0x060401
[    2.484339] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold
[    2.484377] pci 0000:00:1c.0: Enabling MPC IRBNCE
[    2.493309] pci 0000:00:1c.0: Intel PCH root port ACS workaround enabled
[    2.500967] pci 0000:00:1c.2: [8086:8d14] type 01 class 0x060400
[    2.501032] pci 0000:00:1c.2: PME# supported from D0 D3hot D3cold
[    2.501050] pci 0000:00:1c.2: Enabling MPC IRBNCE
[    2.506431] pci 0000:00:1c.2: Intel PCH root port ACS workaround enabled
[    2.514102] pci 0000:00:1c.4: [8086:8d18] type 01 class 0x060400
[    2.514166] pci 0000:00:1c.4: PME# supported from D0 D3hot D3cold
[    2.514180] pci 0000:00:1c.4: Enabling MPC IRBNCE
[    2.519564] pci 0000:00:1c.4: Intel PCH root port ACS workaround enabled
[    2.527195] pci 0000:00:1c.4: System wakeup disabled by ACPI
[    2.533661] pci 0000:00:1c.6: [8086:8d1c] type 01 class 0x060400
[    2.533726] pci 0000:00:1c.6: PME# supported from D0 D3hot D3cold
[    2.533740] pci 0000:00:1c.6: Enabling MPC IRBNCE
[    2.539151] pci 0000:00:1c.6: Intel PCH root port ACS workaround enabled
[    2.546824] pci 0000:00:1c.7: [8086:8d1e] type 01 class 0x060400
[    2.546889] pci 0000:00:1c.7: PME# supported from D0 D3hot D3cold
[    2.546903] pci 0000:00:1c.7: Enabling MPC IRBNCE
[    2.552285] pci 0000:00:1c.7: Intel PCH root port ACS workaround enabled
[    2.559949] pci 0000:00:1d.0: [8086:8d26] type 00 class 0x0c0320
[    2.559965] pci 0000:00:1d.0: reg 0x10: [mem 0x93800000-0x938003ff]
[    2.560047] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold
[    2.560145] pci 0000:00:1f.0: [8086:8d44] type 00 class 0x060100
[    2.560317] pci 0000:00:1f.3: [8086:8d22] type 00 class 0x0c0500
[    2.560330] pci 0000:00:1f.3: reg 0x10: [mem 0x39ffff31000-0x39ffff310ff 64bit]
[    2.560350] pci 0000:00:1f.3: reg 0x20: [io  0x3000-0x301f]
[    2.560466] pci 0000:00:01.0: PCI bridge to [bus 03]
[    2.566163] pci 0000:00:01.1: PCI bridge to [bus 0e]
[    2.571913] pci 0000:00:02.0: PCI bridge to [bus 05]
[    2.577610] pci 0000:00:02.1: PCI bridge to [bus 0f]
[    2.583363] pci 0000:04:00.0: [8086:1528] type 00 class 0x020000
[    2.583376] pci 0000:04:00.0: reg 0x10: [mem 0x92e00000-0x92ffffff pref]
[    2.583393] pci 0000:04:00.0: reg 0x1c: [mem 0x93004000-0x93007fff pref]
[    2.583411] pci 0000:04:00.0: reg 0x30: [mem 0x00000000-0x0007ffff pref]
[    2.583456] pci 0000:04:00.0: PME# supported from D0 D3hot D3cold
[    2.583479] pci 0000:04:00.0: reg 0x184: [mem 0x93400000-0x93403fff 64bit]
[    2.583481] pci 0000:04:00.0: VF(n) BAR0 space: [mem 0x93400000-0x934fffff 64bit] (contains BAR0 for 64 VFs)
[    2.594666] pci 0000:04:00.0: reg 0x190: [mem 0x93500000-0x93503fff 64bit]
[    2.594667] pci 0000:04:00.0: VF(n) BAR3 space: [mem 0x93500000-0x935fffff 64bit] (contains BAR3 for 64 VFs)
[    2.606049] pci 0000:04:00.1: [8086:1528] type 00 class 0x020000
[    2.606062] pci 0000:04:00.1: reg 0x10: [mem 0x92c00000-0x92dfffff pref]
[    2.606080] pci 0000:04:00.1: reg 0x1c: [mem 0x93000000-0x93003fff pref]
[    2.606097] pci 0000:04:00.1: reg 0x30: [mem 0x00000000-0x0007ffff pref]
[    2.606141] pci 0000:04:00.1: PME# supported from D0 D3hot D3cold
[    2.606161] pci 0000:04:00.1: reg 0x184: [mem 0x93600000-0x93603fff 64bit]
[    2.606163] pci 0000:04:00.1: VF(n) BAR0 space: [mem 0x93600000-0x936fffff 64bit] (contains BAR0 for 64 VFs)
[    2.617352] pci 0000:04:00.1: reg 0x190: [mem 0x93700000-0x93703fff 64bit]
[    2.617353] pci 0000:04:00.1: VF(n) BAR3 space: [mem 0x93700000-0x937fffff 64bit] (contains BAR3 for 64 VFs)
[    2.631557] pci 0000:00:02.2: PCI bridge to [bus 04]
[    2.637244] pci 0000:00:02.2:   bridge window [mem 0x93400000-0x937fffff]
[    2.637247] pci 0000:00:02.2:   bridge window [mem 0x92c00000-0x930fffff 64bit pref]
[    2.637280] pci 0000:00:02.3: PCI bridge to [bus 10]
[    2.643037] pci 0000:08:00.0: [103c:3239] type 00 class 0x010400
[    2.643049] pci 0000:08:00.0: reg 0x10: [mem 0x93200000-0x932fffff 64bit]
[    2.643056] pci 0000:08:00.0: reg 0x18: [mem 0x93300000-0x933003ff 64bit]
[    2.643062] pci 0000:08:00.0: reg 0x20: [io  0x2000-0x20ff]
[    2.643071] pci 0000:08:00.0: reg 0x30: [mem 0x00000000-0x0007ffff pref]
[    2.643104] pci 0000:08:00.0: PME# supported from D0 D1 D3hot
[    2.643159] pci 0000:00:03.0: PCI bridge to [bus 08]
[    2.648830] pci 0000:00:03.0:   bridge window [io  0x2000-0x2fff]
[    2.648832] pci 0000:00:03.0:   bridge window [mem 0x93200000-0x933fffff]
[    2.648859] pci 0000:00:03.1: PCI bridge to [bus 11]
[    2.654609] pci 0000:00:03.2: PCI bridge to [bus 0b]
[    2.660379] pci 0000:00:03.3: PCI bridge to [bus 12]
[    2.666088] pci 0000:00:1c.0: PCI bridge to [bus 13] (subtractive decode)
[    2.673772] pci 0000:00:1c.0:   bridge window [io  0x0000-0x03af window] (subtractive decode)
[    2.673773] pci 0000:00:1c.0:   bridge window [io  0x03e0-0x0cf7 window] (subtractive decode)
[    2.673774] pci 0000:00:1c.0:   bridge window [io  0x03b0-0x03bb window] (subtractive decode)
[    2.673778] pci 0000:00:1c.0:   bridge window [io  0x03c0-0x03df window] (subtractive decode)
[    2.673779] pci 0000:00:1c.0:   bridge window [mem 0x000a0000-0x000bffff window] (subtractive decode)
[    2.673780] pci 0000:00:1c.0:   bridge window [io  0x1000-0x9fff window] (subtractive decode)
[    2.673781] pci 0000:00:1c.0:   bridge window [mem 0x90000000-0xc7ffbfff window] (subtractive decode)
[    2.673782] pci 0000:00:1c.0:   bridge window [mem 0x38000000000-0x39fffffffff window] (subtractive decode)
[    2.673831] pci 0000:01:00.0: [103c:3306] type 00 class 0x088000
[    2.673853] pci 0000:01:00.0: reg 0x10: [io  0x1200-0x12ff]
[    2.673866] pci 0000:01:00.0: reg 0x14: [mem 0x92a8d000-0x92a8d1ff]
[    2.673878] pci 0000:01:00.0: reg 0x18: [io  0x1100-0x11ff]
[    2.674053] pci 0000:01:00.1: [102b:0533] type 00 class 0x030000
[    2.674075] pci 0000:01:00.1: reg 0x10: [mem 0x91000000-0x91ffffff pref]
[    2.674088] pci 0000:01:00.1: reg 0x14: [mem 0x92a88000-0x92a8bfff]
[    2.674100] pci 0000:01:00.1: reg 0x18: [mem 0x92000000-0x927fffff]
[    2.674264] pci 0000:01:00.2: [103c:3307] type 00 class 0x088000
[    2.674285] pci 0000:01:00.2: reg 0x10: [io  0x1000-0x10ff]
[    2.674298] pci 0000:01:00.2: reg 0x14: [mem 0x92a8c000-0x92a8c0ff]
[    2.674310] pci 0000:01:00.2: reg 0x18: [mem 0x92900000-0x929fffff]
[    2.674323] pci 0000:01:00.2: reg 0x1c: [mem 0x92a00000-0x92a7ffff]
[    2.674335] pci 0000:01:00.2: reg 0x20: [mem 0x92a80000-0x92a87fff]
[    2.674348] pci 0000:01:00.2: reg 0x24: [mem 0x92800000-0x928fffff]
[    2.674360] pci 0000:01:00.2: reg 0x30: [mem 0x00000000-0x0000ffff pref]
[    2.674424] pci 0000:01:00.2: PME# supported from D0 D3hot D3cold
[    2.674490] pci 0000:01:00.4: [103c:3300] type 00 class 0x0c0300
[    2.674557] pci 0000:01:00.4: reg 0x20: [io  0x1300-0x131f]
[    2.677796] pci 0000:00:1c.2: PCI bridge to [bus 01]
[    2.683484] pci 0000:00:1c.2:   bridge window [io  0x1000-0x1fff]
[    2.683487] pci 0000:00:1c.2:   bridge window [mem 0x90000000-0x92afffff]
[    2.683561] pci 0000:02:00.0: [14e4:1657] type 00 class 0x020000
[    2.683589] pci 0000:02:00.0: reg 0x10: [mem 0x93190000-0x9319ffff 64bit pref]
[    2.683606] pci 0000:02:00.0: reg 0x18: [mem 0x931a0000-0x931affff 64bit pref]
[    2.683622] pci 0000:02:00.0: reg 0x20: [mem 0x931b0000-0x931bffff 64bit pref]
[    2.683633] pci 0000:02:00.0: reg 0x30: [mem 0x00000000-0x0003ffff pref]
[    2.683721] pci 0000:02:00.0: PME# supported from D0 D3hot D3cold
[    2.683826] pci 0000:02:00.1: [14e4:1657] type 00 class 0x020000
[    2.683854] pci 0000:02:00.1: reg 0x10: [mem 0x93160000-0x9316ffff 64bit pref]
[    2.683870] pci 0000:02:00.1: reg 0x18: [mem 0x93170000-0x9317ffff 64bit pref]
[    2.683887] pci 0000:02:00.1: reg 0x20: [mem 0x93180000-0x9318ffff 64bit pref]
[    2.683898] pci 0000:02:00.1: reg 0x30: [mem 0x00000000-0x0003ffff pref]
[    2.683985] pci 0000:02:00.1: PME# supported from D0 D3hot D3cold
[    2.684077] pci 0000:02:00.2: [14e4:1657] type 00 class 0x020000
[    2.684105] pci 0000:02:00.2: reg 0x10: [mem 0x93130000-0x9313ffff 64bit pref]
[    2.684121] pci 0000:02:00.2: reg 0x18: [mem 0x93140000-0x9314ffff 64bit pref]
[    2.684138] pci 0000:02:00.2: reg 0x20: [mem 0x93150000-0x9315ffff 64bit pref]
[    2.684148] pci 0000:02:00.2: reg 0x30: [mem 0x00000000-0x0003ffff pref]
[    2.684236] pci 0000:02:00.2: PME# supported from D0 D3hot D3cold
[    2.684326] pci 0000:02:00.3: [14e4:1657] type 00 class 0x020000
[    2.684353] pci 0000:02:00.3: reg 0x10: [mem 0x93100000-0x9310ffff 64bit pref]
[    2.684370] pci 0000:02:00.3: reg 0x18: [mem 0x93110000-0x9311ffff 64bit pref]
[    2.684386] pci 0000:02:00.3: reg 0x20: [mem 0x93120000-0x9312ffff 64bit pref]
[    2.684397] pci 0000:02:00.3: reg 0x30: [mem 0x00000000-0x0003ffff pref]
[    2.684487] pci 0000:02:00.3: PME# supported from D0 D3hot D3cold
[    2.687539] pci 0000:00:1c.4: PCI bridge to [bus 02]
[    2.693214] pci 0000:00:1c.4:   bridge window [mem 0x93100000-0x931fffff 64bit pref]
[    2.693257] pci 0000:00:1c.6: PCI bridge to [bus 14]
[    2.698965] pci 0000:00:1c.7: PCI bridge to [bus 15]
[    2.704699] pci_bus 0000:00: on NUMA node 0
[    2.704829] ACPI: PCI Interrupt Link [LNKA] (IRQs 3 4 5 6 7 9 10 *11 12 14 15)
[    2.713181] ACPI: PCI Interrupt Link [LNKB] (IRQs 3 4 5 6 7 9 *10 11 12 14 15)
[    2.721529] ACPI: PCI Interrupt Link [LNKC] (IRQs 3 4 5 6 7 *9 10 11 12 14 15)
[    2.729881] ACPI: PCI Interrupt Link [LNKD] (IRQs 3 4 *5 6 7 9 10 11 12 14 15)
[    2.738229] ACPI: PCI Interrupt Link [LNKE] (IRQs 3 4 5 6 7 9 10 11 12 14 15) *0, disabled.
[    2.747829] ACPI: PCI Interrupt Link [LNKF] (IRQs 3 4 5 6 7 9 10 11 12 14 15) *0, disabled.
[    2.757416] ACPI: PCI Interrupt Link [LNKG] (IRQs 3 4 5 6 7 9 10 11 12 14 15) *0, disabled.
[    2.767007] ACPI: PCI Interrupt Link [LNKH] (IRQs 3 4 5 6 7 9 10 11 12 14 15) *0, disabled.
[    2.776797] ACPI: PCI Root Bridge [PCI1] (domain 0000 [bus 80-fe])
[    2.783808] acpi PNP0A08:01: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    2.793252] acpi PNP0A08:01: _OSC: platform does not support [AER]
[    2.800319] acpi PNP0A08:01: _OSC: OS now controls [PCIeHotplug PME PCIeCapability]
[    2.809111] acpi PNP0A08:01: FADT indicates ASPM is unsupported, using BIOS configuration
[    2.818556] PCI host bridge to bus 0000:80
[    2.823268] pci_bus 0000:80: root bus resource [io  0xa000-0xffff window]
[    2.830944] pci_bus 0000:80: root bus resource [mem 0xc8000000-0xfbffbfff window]
[    2.839546] pci_bus 0000:80: root bus resource [mem 0x3a000000000-0x3bfffffffff window]
[    2.848708] pci_bus 0000:80: root bus resource [bus 80-fe]
[    2.854955] pci 0000:80:00.0: [8086:2f01] type 01 class 0x060400
[    2.854999] pci 0000:80:00.0: PME# supported from D0 D3hot D3cold
[    2.855070] pci 0000:80:01.0: [8086:2f02] type 01 class 0x060400
[    2.855112] pci 0000:80:01.0: PME# supported from D0 D3hot D3cold
[    2.855139] pci 0000:80:01.0: System wakeup disabled by ACPI
[    2.861602] pci 0000:80:01.1: [8086:2f03] type 01 class 0x060400
[    2.861643] pci 0000:80:01.1: PME# supported from D0 D3hot D3cold
[    2.861696] pci 0000:80:02.0: [8086:2f04] type 01 class 0x060400
[    2.861737] pci 0000:80:02.0: PME# supported from D0 D3hot D3cold
[    2.861765] pci 0000:80:02.0: System wakeup disabled by ACPI
[    2.868221] pci 0000:80:02.1: [8086:2f05] type 01 class 0x060400
[    2.868262] pci 0000:80:02.1: PME# supported from D0 D3hot D3cold
[    2.868316] pci 0000:80:02.2: [8086:2f06] type 01 class 0x060400
[    2.868357] pci 0000:80:02.2: PME# supported from D0 D3hot D3cold
[    2.868412] pci 0000:80:02.3: [8086:2f07] type 01 class 0x060400
[    2.868453] pci 0000:80:02.3: PME# supported from D0 D3hot D3cold
[    2.868503] pci 0000:80:03.0: [8086:2f08] type 01 class 0x060400
[    2.868543] pci 0000:80:03.0: PME# supported from D0 D3hot D3cold
[    2.868569] pci 0000:80:03.0: System wakeup disabled by ACPI
[    2.875028] pci 0000:80:03.1: [8086:2f09] type 01 class 0x060400
[    2.875069] pci 0000:80:03.1: PME# supported from D0 D3hot D3cold
[    2.875122] pci 0000:80:03.2: [8086:2f0a] type 01 class 0x060400
[    2.875163] pci 0000:80:03.2: PME# supported from D0 D3hot D3cold
[    2.875216] pci 0000:80:03.3: [8086:2f0b] type 01 class 0x060400
[    2.875256] pci 0000:80:03.3: PME# supported from D0 D3hot D3cold
[    2.875305] pci 0000:80:04.0: [8086:2f20] type 00 class 0x088000
[    2.875314] pci 0000:80:04.0: reg 0x10: [mem 0x3bffff1c000-0x3bffff1ffff 64bit]
[    2.875381] pci 0000:80:04.1: [8086:2f21] type 00 class 0x088000
[    2.875389] pci 0000:80:04.1: reg 0x10: [mem 0x3bffff18000-0x3bffff1bfff 64bit]
[    2.875456] pci 0000:80:04.2: [8086:2f22] type 00 class 0x088000
[    2.875464] pci 0000:80:04.2: reg 0x10: [mem 0x3bffff14000-0x3bffff17fff 64bit]
[    2.875531] pci 0000:80:04.3: [8086:2f23] type 00 class 0x088000
[    2.875539] pci 0000:80:04.3: reg 0x10: [mem 0x3bffff10000-0x3bffff13fff 64bit]
[    2.875605] pci 0000:80:04.4: [8086:2f24] type 00 class 0x088000
[    2.875613] pci 0000:80:04.4: reg 0x10: [mem 0x3bffff0c000-0x3bffff0ffff 64bit]
[    2.875681] pci 0000:80:04.5: [8086:2f25] type 00 class 0x088000
[    2.875689] pci 0000:80:04.5: reg 0x10: [mem 0x3bffff08000-0x3bffff0bfff 64bit]
[    2.875753] pci 0000:80:04.6: [8086:2f26] type 00 class 0x088000
[    2.875761] pci 0000:80:04.6: reg 0x10: [mem 0x3bffff04000-0x3bffff07fff 64bit]
[    2.875830] pci 0000:80:04.7: [8086:2f27] type 00 class 0x088000
[    2.875838] pci 0000:80:04.7: reg 0x10: [mem 0x3bffff00000-0x3bffff03fff 64bit]
[    2.875904] pci 0000:80:05.0: [8086:2f28] type 00 class 0x088000
[    2.875967] pci 0000:80:05.1: [8086:2f29] type 00 class 0x088000
[    2.876043] pci 0000:80:05.2: [8086:2f2a] type 00 class 0x088000
[    2.876106] pci 0000:80:05.4: [8086:2f2c] type 00 class 0x080020
[    2.876112] pci 0000:80:05.4: reg 0x10: [mem 0xc8600000-0xc8600fff]
[    2.876211] pci 0000:80:00.0: PCI bridge to [bus 91]
[    2.881963] pci 0000:81:00.0: [8086:1521] type 00 class 0x020000
[    2.881978] pci 0000:81:00.0: reg 0x10: [mem 0xc8300000-0xc83fffff]
[    2.881995] pci 0000:81:00.0: reg 0x1c: [mem 0xc850c000-0xc850ffff]
[    2.882012] pci 0000:81:00.0: reg 0x30: [mem 0x00000000-0x0007ffff pref]
[    2.882060] pci 0000:81:00.0: PME# supported from D0 D3hot D3cold
[    2.882081] pci 0000:81:00.0: reg 0x184: [mem 0xc84ec000-0xc84effff]
[    2.882082] pci 0000:81:00.0: VF(n) BAR0 space: [mem 0xc84ec000-0xc850bfff] (contains BAR0 for 8 VFs)
[    2.892598] pci 0000:81:00.0: reg 0x190: [mem 0xc84cc000-0xc84cffff]
[    2.892599] pci 0000:81:00.0: VF(n) BAR3 space: [mem 0xc84cc000-0xc84ebfff] (contains BAR3 for 8 VFs)
[    2.903200] pci 0000:81:00.1: [8086:1521] type 00 class 0x020000
[    2.903214] pci 0000:81:00.1: reg 0x10: [mem 0xc8200000-0xc82fffff]
[    2.903231] pci 0000:81:00.1: reg 0x1c: [mem 0xc84c8000-0xc84cbfff]
[    2.903248] pci 0000:81:00.1: reg 0x30: [mem 0x00000000-0x0007ffff pref]
[    2.903294] pci 0000:81:00.1: PME# supported from D0 D3hot D3cold
[    2.903312] pci 0000:81:00.1: reg 0x184: [mem 0xc84a8000-0xc84abfff]
[    2.903313] pci 0000:81:00.1: VF(n) BAR0 space: [mem 0xc84a8000-0xc84c7fff] (contains BAR0 for 8 VFs)
[    2.913909] pci 0000:81:00.1: reg 0x190: [mem 0xc8488000-0xc848bfff]
[    2.913910] pci 0000:81:00.1: VF(n) BAR3 space: [mem 0xc8488000-0xc84a7fff] (contains BAR3 for 8 VFs)
[    2.924506] pci 0000:81:00.2: [8086:1521] type 00 class 0x020000
[    2.924519] pci 0000:81:00.2: reg 0x10: [mem 0xc8100000-0xc81fffff]
[    2.924536] pci 0000:81:00.2: reg 0x1c: [mem 0xc8484000-0xc8487fff]
[    2.924554] pci 0000:81:00.2: reg 0x30: [mem 0x00000000-0x0007ffff pref]
[    2.924599] pci 0000:81:00.2: PME# supported from D0 D3hot D3cold
[    2.924617] pci 0000:81:00.2: reg 0x184: [mem 0xc8464000-0xc8467fff]
[    2.924619] pci 0000:81:00.2: VF(n) BAR0 space: [mem 0xc8464000-0xc8483fff] (contains BAR0 for 8 VFs)
[    2.935135] pci 0000:81:00.2: reg 0x190: [mem 0xc8444000-0xc8447fff]
[    2.935136] pci 0000:81:00.2: VF(n) BAR3 space: [mem 0xc8444000-0xc8463fff] (contains BAR3 for 8 VFs)
[    2.945719] pci 0000:81:00.3: [8086:1521] type 00 class 0x020000
[    2.945733] pci 0000:81:00.3: reg 0x10: [mem 0xc8000000-0xc80fffff]
[    2.945749] pci 0000:81:00.3: reg 0x1c: [mem 0xc8440000-0xc8443fff]
[    2.945766] pci 0000:81:00.3: reg 0x30: [mem 0x00000000-0x0007ffff pref]
[    2.945812] pci 0000:81:00.3: PME# supported from D0 D3hot D3cold
[    2.945833] pci 0000:81:00.3: reg 0x184: [mem 0xc8420000-0xc8423fff]
[    2.945834] pci 0000:81:00.3: VF(n) BAR0 space: [mem 0xc8420000-0xc843ffff] (contains BAR0 for 8 VFs)
[    2.956351] pci 0000:81:00.3: reg 0x190: [mem 0xc8400000-0xc8403fff]
[    2.956352] pci 0000:81:00.3: VF(n) BAR3 space: [mem 0xc8400000-0xc841ffff] (contains BAR3 for 8 VFs)
[    2.969880] pci 0000:80:01.0: PCI bridge to [bus 81]
[    2.975556] pci 0000:80:01.0:   bridge window [mem 0xc8000000-0xc85fffff]
[    2.975587] pci 0000:80:01.1: PCI bridge to [bus 8e]
[    2.981323] pci 0000:80:02.0: PCI bridge to [bus 84]
[    2.987030] pci 0000:80:02.1: PCI bridge to [bus 8f]
[    2.992726] pci 0000:80:02.2: PCI bridge to [bus 87]
[    2.998425] pci 0000:80:02.3: PCI bridge to [bus 90]
[    3.004159] pci 0000:80:03.0: PCI bridge to [bus 88]
[    3.009855] pci 0000:80:03.1: PCI bridge to [bus 8b]
[    3.015549] pci 0000:80:03.2: PCI bridge to [bus 8c]
[    3.021247] pci 0000:80:03.3: PCI bridge to [bus 8d]
[    3.026952] pci_bus 0000:80: on NUMA node 1
[    3.027070] ACPI: Enabled 9 GPEs in block 00 to 3F
[    3.032776] pci 0000:01:00.1: vgaarb: setting as boot VGA device
[    3.039638] pci 0000:01:00.1: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none
[    3.049384] pci 0000:01:00.1: vgaarb: bridge control possible
[    3.055908] vgaarb: loaded
[    3.059175] PCI: Using ACPI for IRQ routing
[    3.067889] PCI: pci_cache_line_size set to 64 bytes
[    3.068155] e820: reserve RAM buffer [mem 0x00094000-0x0009ffff]
[    3.068156] e820: reserve RAM buffer [mem 0x5a701000-0x5bffffff]
[    3.068156] e820: reserve RAM buffer [mem 0x790ff000-0x7bffffff]
[    3.068157] e820: reserve RAM buffer [mem 0x7b800000-0x7bffffff]
[    3.068540] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0
[    3.075543] hpet0: 8 comparators, 64-bit 14.318180 MHz counter
[    3.084254] clocksource: Switched to clocksource hpet
[    3.100996] VFS: Disk quotas dquot_6.6.0
[    3.105558] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[    3.113419] pnp: PnP ACPI init
[    3.117320] pnp 00:00: Plug and Play ACPI device, IDs PNP0b00 (active)
[    3.117453] system 00:01: [io  0x0500-0x053f] has been reserved
[    3.124164] system 00:01: [io  0x0400-0x047f] has been reserved
[    3.130875] system 00:01: [io  0x0540-0x057f] has been reserved
[    3.137582] system 00:01: [io  0x0600-0x061f] has been reserved
[    3.144293] system 00:01: [io  0x0880-0x0883] has been reserved
[    3.151003] system 00:01: [io  0x0800-0x081f] has been reserved
[    3.157712] system 00:01: [mem 0xfed1c000-0xfed3ffff] has been reserved
[    3.165219] system 00:01: [mem 0xfed45000-0xfed8bfff] has been reserved
[    3.172692] system 00:01: [mem 0xff000000-0xffffffff] could not be reserved
[    3.180545] system 00:01: [mem 0xfee00000-0xfeefffff] has been reserved
[    3.188073] system 00:01: [mem 0xfed12000-0xfed1200f] has been reserved
[    3.195554] system 00:01: [mem 0xfed12010-0xfed1201f] has been reserved
[    3.203030] system 00:01: [mem 0xfed1b000-0xfed1bfff] has been reserved
[    3.210501] system 00:01: Plug and Play ACPI device, IDs PNP0c02 (active)
[    3.210533] pnp 00:02: Plug and Play ACPI device, IDs PNP0501 (active)
[    3.210553] pnp 00:03: Plug and Play ACPI device, IDs PNP0501 (active)
[    3.210674] pnp: PnP ACPI: found 4 devices
[    3.221300] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns
[    3.231479] pci 0000:00:1c.4: BAR 14: assigned [mem 0x92b00000-0x92bfffff]
[    3.239237] pci 0000:00:01.0: PCI bridge to [bus 03]
[    3.244900] pci 0000:00:01.1: PCI bridge to [bus 0e]
[    3.250561] pci 0000:00:02.0: PCI bridge to [bus 05]
[    3.256220] pci 0000:00:02.1: PCI bridge to [bus 0f]
[    3.261883] pci 0000:04:00.0: BAR 6: assigned [mem 0x93080000-0x930fffff pref]
[    3.270163] pci 0000:04:00.1: BAR 6: no space for [mem size 0x00080000 pref]
[    3.278114] pci 0000:04:00.1: BAR 6: failed to assign [mem size 0x00080000 pref]
[    3.286597] pci 0000:00:02.2: PCI bridge to [bus 04]
[    3.292256] pci 0000:00:02.2:   bridge window [mem 0x93400000-0x937fffff]
[    3.299927] pci 0000:00:02.2:   bridge window [mem 0x92c00000-0x930fffff 64bit pref]
[    3.308780] pci 0000:00:02.3: PCI bridge to [bus 10]
[    3.314441] pci 0000:08:00.0: BAR 6: assigned [mem 0x93380000-0x933fffff pref]
[    3.322721] pci 0000:00:03.0: PCI bridge to [bus 08]
[    3.328377] pci 0000:00:03.0:   bridge window [io  0x2000-0x2fff]
[    3.335280] pci 0000:00:03.0:   bridge window [mem 0x93200000-0x933fffff]
[    3.342947] pci 0000:00:03.1: PCI bridge to [bus 11]
[    3.348606] pci 0000:00:03.2: PCI bridge to [bus 0b]
[    3.354266] pci 0000:00:03.3: PCI bridge to [bus 12]
[    3.359925] pci 0000:00:1c.0: PCI bridge to [bus 13]
[    3.365586] pci 0000:01:00.2: BAR 6: assigned [mem 0x90000000-0x9000ffff pref]
[    3.373868] pci 0000:00:1c.2: PCI bridge to [bus 01]
[    3.379528] pci 0000:00:1c.2:   bridge window [io  0x1000-0x1fff]
[    3.386431] pci 0000:00:1c.2:   bridge window [mem 0x90000000-0x92afffff]
[    3.394100] pci 0000:02:00.0: BAR 6: assigned [mem 0x92b00000-0x92b3ffff pref]
[    3.402378] pci 0000:02:00.1: BAR 6: assigned [mem 0x92b40000-0x92b7ffff pref]
[    3.410656] pci 0000:02:00.2: BAR 6: assigned [mem 0x92b80000-0x92bbffff pref]
[    3.418936] pci 0000:02:00.3: BAR 6: assigned [mem 0x92bc0000-0x92bfffff pref]
[    3.427217] pci 0000:00:1c.4: PCI bridge to [bus 02]
[    3.432875] pci 0000:00:1c.4:   bridge window [mem 0x92b00000-0x92bfffff]
[    3.440541] pci 0000:00:1c.4:   bridge window [mem 0x93100000-0x931fffff 64bit pref]
[    3.449401] pci 0000:00:1c.6: PCI bridge to [bus 14]
[    3.455068] pci 0000:00:1c.7: PCI bridge to [bus 15]
[    3.460732] pci_bus 0000:00: resource 4 [io  0x0000-0x03af window]
[    3.460733] pci_bus 0000:00: resource 5 [io  0x03e0-0x0cf7 window]
[    3.460737] pci_bus 0000:00: resource 6 [io  0x03b0-0x03bb window]
[    3.460737] pci_bus 0000:00: resource 7 [io  0x03c0-0x03df window]
[    3.460738] pci_bus 0000:00: resource 8 [mem 0x000a0000-0x000bffff window]
[    3.460739] pci_bus 0000:00: resource 9 [io  0x1000-0x9fff window]
[    3.460741] pci_bus 0000:00: resource 10 [mem 0x90000000-0xc7ffbfff window]
[    3.460742] pci_bus 0000:00: resource 11 [mem 0x38000000000-0x39fffffffff window]
[    3.460743] pci_bus 0000:04: resource 1 [mem 0x93400000-0x937fffff]
[    3.460744] pci_bus 0000:04: resource 2 [mem 0x92c00000-0x930fffff 64bit pref]
[    3.460745] pci_bus 0000:08: resource 0 [io  0x2000-0x2fff]
[    3.460746] pci_bus 0000:08: resource 1 [mem 0x93200000-0x933fffff]
[    3.460748] pci_bus 0000:13: resource 4 [io  0x0000-0x03af window]
[    3.460749] pci_bus 0000:13: resource 5 [io  0x03e0-0x0cf7 window]
[    3.460749] pci_bus 0000:13: resource 6 [io  0x03b0-0x03bb window]
[    3.460750] pci_bus 0000:13: resource 7 [io  0x03c0-0x03df window]
[    3.460751] pci_bus 0000:13: resource 8 [mem 0x000a0000-0x000bffff window]
[    3.460752] pci_bus 0000:13: resource 9 [io  0x1000-0x9fff window]
[    3.460753] pci_bus 0000:13: resource 10 [mem 0x90000000-0xc7ffbfff window]
[    3.460754] pci_bus 0000:13: resource 11 [mem 0x38000000000-0x39fffffffff window]
[    3.460755] pci_bus 0000:01: resource 0 [io  0x1000-0x1fff]
[    3.460756] pci_bus 0000:01: resource 1 [mem 0x90000000-0x92afffff]
[    3.460757] pci_bus 0000:02: resource 1 [mem 0x92b00000-0x92bfffff]
[    3.460758] pci_bus 0000:02: resource 2 [mem 0x93100000-0x931fffff 64bit pref]
[    3.460859] pci 0000:80:00.0: PCI bridge to [bus 91]
[    3.466521] pci 0000:81:00.0: BAR 6: assigned [mem 0xc8580000-0xc85fffff pref]
[    3.474802] pci 0000:81:00.1: BAR 6: no space for [mem size 0x00080000 pref]
[    3.482750] pci 0000:81:00.1: BAR 6: failed to assign [mem size 0x00080000 pref]
[    3.491220] pci 0000:81:00.2: BAR 6: no space for [mem size 0x00080000 pref]
[    3.499170] pci 0000:81:00.2: BAR 6: failed to assign [mem size 0x00080000 pref]
[    3.507642] pci 0000:81:00.3: BAR 6: no space for [mem size 0x00080000 pref]
[    3.515593] pci 0000:81:00.3: BAR 6: failed to assign [mem size 0x00080000 pref]
[    3.524063] pci 0000:80:01.0: PCI bridge to [bus 81]
[    3.529723] pci 0000:80:01.0:   bridge window [mem 0xc8000000-0xc85fffff]
[    3.540737] pci 0000:80:01.1: PCI bridge to [bus 8e]
[    3.546401] pci 0000:80:02.0: PCI bridge to [bus 84]
[    3.552060] pci 0000:80:02.1: PCI bridge to [bus 8f]
[    3.557727] pci 0000:80:02.2: PCI bridge to [bus 87]
[    3.563396] pci 0000:80:02.3: PCI bridge to [bus 90]
[    3.569059] pci 0000:80:03.0: PCI bridge to [bus 88]
[    3.574719] pci 0000:80:03.1: PCI bridge to [bus 8b]
[    3.580377] pci 0000:80:03.2: PCI bridge to [bus 8c]
[    3.586041] pci 0000:80:03.3: PCI bridge to [bus 8d]
[    3.591704] pci_bus 0000:80: resource 4 [io  0xa000-0xffff window]
[    3.591705] pci_bus 0000:80: resource 5 [mem 0xc8000000-0xfbffbfff window]
[    3.591708] pci_bus 0000:80: resource 6 [mem 0x3a000000000-0x3bfffffffff window]
[    3.591710] pci_bus 0000:81: resource 1 [mem 0xc8000000-0xc85fffff]
[    3.591783] NET: Registered protocol family 2
[    3.597171] TCP established hash table entries: 524288 (order: 10, 4194304 bytes)
[    3.606348] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes)
[    3.614066] TCP: Hash tables configured (established 524288 bind 65536)
[    3.621683] UDP hash table entries: 65536 (order: 9, 2097152 bytes)
[    3.629118] UDP-Lite hash table entries: 65536 (order: 9, 2097152 bytes)
[    3.637117] NET: Registered protocol family 1
[    3.855457] pci 0000:01:00.1: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]
[    3.865426] PCI: CLS 64 bytes, default 64
[    4.318572] DMAR: dmar0: Using Queued invalidation
[    4.324054] DMAR: dmar1: Using Queued invalidation
[    4.329566] DMAR: Setting RMRR:
[    4.333687] DMAR: Setting identity map for device 0000:00:14.0 [0x5a701000 - 0x5a740fff]
[    4.343273] DMAR: Setting identity map for device 0000:00:1a.0 [0x5a701000 - 0x5a740fff]
[    4.352837] DMAR: Setting identity map for device 0000:00:1d.0 [0x5a701000 - 0x5a740fff]
[    4.362476] DMAR: Setting identity map for device 0000:01:00.0 [0x5a701000 - 0x5a740fff]
[    4.372099] DMAR: Setting identity map for device 0000:01:00.1 [0x5a701000 - 0x5a740fff]
[    4.381697] DMAR: Setting identity map for device 0000:01:00.2 [0x5a701000 - 0x5a740fff]
[    4.391278] DMAR: Setting identity map for device 0000:01:00.4 [0x5a701000 - 0x5a740fff]
[    4.400535] DMAR: Setting identity map for device 0000:01:00.0 [0x791dc000 - 0x791ddfff]
[    4.409785] DMAR: Setting identity map for device 0000:01:00.1 [0x791dc000 - 0x791ddfff]
[    4.419030] DMAR: Setting identity map for device 0000:01:00.2 [0x791dc000 - 0x791ddfff]
[    4.428278] DMAR: Setting identity map for device 0000:01:00.4 [0x791dc000 - 0x791ddfff]
[    4.437878] DMAR: Setting identity map for device 0000:08:00.0 [0x791dc000 - 0x791ddfff]
[    4.447132] DMAR: Setting identity map for device 0000:01:00.0 [0x791cb000 - 0x791dbfff]
[    4.456370] DMAR: Setting identity map for device 0000:01:00.1 [0x791cb000 - 0x791dbfff]
[    4.465610] DMAR: Setting identity map for device 0000:01:00.2 [0x791cb000 - 0x791dbfff]
[    4.474848] DMAR: Setting identity map for device 0000:01:00.4 [0x791cb000 - 0x791dbfff]
[    4.484089] DMAR: Setting identity map for device 0000:01:00.0 [0x791de000 - 0x791f3fff]
[    4.493335] DMAR: Setting identity map for device 0000:01:00.1 [0x791de000 - 0x791f3fff]
[    4.502570] DMAR: Setting identity map for device 0000:01:00.2 [0x791de000 - 0x791f3fff]
[    4.511811] DMAR: Setting identity map for device 0000:01:00.4 [0x791de000 - 0x791f3fff]
[    4.521441] DMAR: Setting identity map for device 0000:02:00.0 [0x791de000 - 0x791f3fff]
[    4.531017] DMAR: Setting identity map for device 0000:04:00.0 [0x791de000 - 0x791f3fff]
[    4.540610] DMAR: Setting identity map for device 0000:81:00.0 [0x791de000 - 0x791f3fff]
[    4.549868] DMAR: Setting identity map for device 0000:01:00.0 [0x791f4000 - 0x791f7fff]
[    4.559107] DMAR: Setting identity map for device 0000:01:00.1 [0x791f4000 - 0x791f7fff]
[    4.568341] DMAR: Setting identity map for device 0000:01:00.2 [0x791f4000 - 0x791f7fff]
[    4.577582] DMAR: Setting identity map for device 0000:01:00.4 [0x791f4000 - 0x791f7fff]
[    4.586822] DMAR: Setting identity map for device 0000:02:00.0 [0x791f4000 - 0x791f7fff]
[    4.596365] DMAR: Setting identity map for device 0000:02:00.1 [0x791f4000 - 0x791f7fff]
[    4.605940] DMAR: Setting identity map for device 0000:02:00.2 [0x791f4000 - 0x791f7fff]
[    4.615564] DMAR: Setting identity map for device 0000:02:00.3 [0x791f4000 - 0x791f7fff]
[    4.624845] DMAR: Setting identity map for device 0000:04:00.0 [0x791f4000 - 0x791f7fff]
[    4.634462] DMAR: Setting identity map for device 0000:04:00.1 [0x791f4000 - 0x791f7fff]
[    4.643714] DMAR: Setting identity map for device 0000:08:00.0 [0x791f4000 - 0x791f7fff]
[    4.652947] DMAR: Setting identity map for device 0000:81:00.0 [0x791f4000 - 0x791f7fff]
[    4.662569] DMAR: Setting identity map for device 0000:81:00.1 [0x791f4000 - 0x791f7fff]
[    4.672198] DMAR: Setting identity map for device 0000:81:00.2 [0x791f4000 - 0x791f7fff]
[    4.681827] DMAR: Setting identity map for device 0000:81:00.3 [0x791f4000 - 0x791f7fff]
[    4.691078] DMAR: Setting identity map for device 0000:00:1a.0 [0x79170000 - 0x79172fff]
[    4.700329] DMAR: Setting identity map for device 0000:00:1d.0 [0x79170000 - 0x79172fff]
[    4.709578] DMAR: Prepare 0-16MiB unity mapping for LPC
[    4.715894] DMAR: Setting identity map for device 0000:00:1f.0 [0x0 - 0xffffff]
[    4.724287] DMAR: Intel(R) Virtualization Technology for Directed I/O
[    4.731701] iommu: Adding device 0000:00:00.0 to group 0
[    4.737774] iommu: Adding device 0000:00:01.0 to group 1
[    4.743862] iommu: Adding device 0000:00:01.1 to group 2
[    4.749933] iommu: Adding device 0000:00:02.0 to group 3
[    4.756004] iommu: Adding device 0000:00:02.1 to group 4
[    4.762075] iommu: Adding device 0000:00:02.2 to group 5
[    4.768147] iommu: Adding device 0000:00:02.3 to group 6
[    4.774222] iommu: Adding device 0000:00:03.0 to group 7
[    4.780292] iommu: Adding device 0000:00:03.1 to group 8
[    4.786368] iommu: Adding device 0000:00:03.2 to group 9
[    4.792441] iommu: Adding device 0000:00:03.3 to group 10
[    4.798795] iommu: Adding device 0000:00:04.0 to group 11
[    4.804965] iommu: Adding device 0000:00:04.1 to group 11
[    4.811133] iommu: Adding device 0000:00:04.2 to group 11
[    4.817296] iommu: Adding device 0000:00:04.3 to group 11
[    4.823472] iommu: Adding device 0000:00:04.4 to group 11
[    4.829635] iommu: Adding device 0000:00:04.5 to group 11
[    4.835797] iommu: Adding device 0000:00:04.6 to group 11
[    4.841963] iommu: Adding device 0000:00:04.7 to group 11
[    4.848226] iommu: Adding device 0000:00:05.0 to group 12
[    4.854396] iommu: Adding device 0000:00:05.1 to group 12
[    4.860559] iommu: Adding device 0000:00:05.2 to group 12
[    4.866726] iommu: Adding device 0000:00:05.4 to group 12
[    4.872894] iommu: Adding device 0000:00:11.0 to group 13
[    4.879059] iommu: Adding device 0000:00:14.0 to group 14
[    4.885228] iommu: Adding device 0000:00:1a.0 to group 15
[    4.891401] iommu: Adding device 0000:00:1c.0 to group 16
[    4.897567] iommu: Adding device 0000:00:1c.2 to group 17
[    4.903733] iommu: Adding device 0000:00:1c.4 to group 18
[    4.909899] iommu: Adding device 0000:00:1c.6 to group 19
[    4.916065] iommu: Adding device 0000:00:1c.7 to group 20
[    4.922236] iommu: Adding device 0000:00:1d.0 to group 21
[    4.928451] iommu: Adding device 0000:00:1f.0 to group 22
[    4.934618] iommu: Adding device 0000:00:1f.3 to group 22
[    4.940884] iommu: Adding device 0000:01:00.0 to group 23
[    4.947054] iommu: Adding device 0000:01:00.1 to group 23
[    4.953223] iommu: Adding device 0000:01:00.2 to group 23
[    4.959395] iommu: Adding device 0000:01:00.4 to group 23
[    4.965669] iommu: Adding device 0000:02:00.0 to group 24
[    4.971847] iommu: Adding device 0000:02:00.1 to group 24
[    4.978018] iommu: Adding device 0000:02:00.2 to group 24
[    4.984206] iommu: Adding device 0000:02:00.3 to group 24
[    4.990380] iommu: Adding device 0000:04:00.0 to group 25
[    4.996551] iommu: Adding device 0000:04:00.1 to group 26
[    5.002727] iommu: Adding device 0000:08:00.0 to group 27
[    5.008939] iommu: Adding device 0000:7f:08.0 to group 28
[    5.015106] iommu: Adding device 0000:7f:08.3 to group 28
[    5.021320] iommu: Adding device 0000:7f:09.0 to group 29
[    5.027488] iommu: Adding device 0000:7f:09.3 to group 29
[    5.033730] iommu: Adding device 0000:7f:0b.0 to group 30
[    5.039904] iommu: Adding device 0000:7f:0b.1 to group 30
[    5.046074] iommu: Adding device 0000:7f:0b.2 to group 30
[    5.052431] iommu: Adding device 0000:7f:0c.0 to group 31
[    5.058600] iommu: Adding device 0000:7f:0c.1 to group 31
[    5.064770] iommu: Adding device 0000:7f:0c.2 to group 31
[    5.070940] iommu: Adding device 0000:7f:0c.3 to group 31
[    5.077106] iommu: Adding device 0000:7f:0c.4 to group 31
[    5.083283] iommu: Adding device 0000:7f:0c.5 to group 31
[    5.089453] iommu: Adding device 0000:7f:0c.6 to group 31
[    5.095626] iommu: Adding device 0000:7f:0c.7 to group 31
[    5.101905] iommu: Adding device 0000:7f:0f.0 to group 32
[    5.108078] iommu: Adding device 0000:7f:0f.1 to group 32
[    5.114245] iommu: Adding device 0000:7f:0f.4 to group 32
[    5.120413] iommu: Adding device 0000:7f:0f.5 to group 32
[    5.126583] iommu: Adding device 0000:7f:0f.6 to group 32
[    5.132874] iommu: Adding device 0000:7f:10.0 to group 33
[    5.139046] iommu: Adding device 0000:7f:10.1 to group 33
[    5.145219] iommu: Adding device 0000:7f:10.5 to group 33
[    5.151395] iommu: Adding device 0000:7f:10.6 to group 33
[    5.157564] iommu: Adding device 0000:7f:10.7 to group 33
[    5.163794] iommu: Adding device 0000:7f:12.0 to group 34
[    5.169963] iommu: Adding device 0000:7f:12.1 to group 34
[    5.176149] iommu: Adding device 0000:7f:12.2 to group 34
[    5.182504] iommu: Adding device 0000:7f:13.0 to group 35
[    5.192054] iommu: Adding device 0000:7f:13.1 to group 35
[    5.198224] iommu: Adding device 0000:7f:13.2 to group 35
[    5.204394] iommu: Adding device 0000:7f:13.3 to group 35
[    5.210564] iommu: Adding device 0000:7f:13.4 to group 35
[    5.216737] iommu: Adding device 0000:7f:13.5 to group 35
[    5.222915] iommu: Adding device 0000:7f:13.6 to group 35
[    5.229083] iommu: Adding device 0000:7f:13.7 to group 35
[    5.235437] iommu: Adding device 0000:7f:14.0 to group 36
[    5.241608] iommu: Adding device 0000:7f:14.1 to group 36
[    5.247813] iommu: Adding device 0000:7f:14.2 to group 36
[    5.253983] iommu: Adding device 0000:7f:14.3 to group 36
[    5.260154] iommu: Adding device 0000:7f:14.4 to group 36
[    5.266327] iommu: Adding device 0000:7f:14.5 to group 36
[    5.272504] iommu: Adding device 0000:7f:14.6 to group 36
[    5.278671] iommu: Adding device 0000:7f:14.7 to group 36
[    5.284930] iommu: Adding device 0000:7f:15.0 to group 37
[    5.291101] iommu: Adding device 0000:7f:15.1 to group 37
[    5.297273] iommu: Adding device 0000:7f:15.2 to group 37
[    5.303447] iommu: Adding device 0000:7f:15.3 to group 37
[    5.309684] iommu: Adding device 0000:7f:16.0 to group 38
[    5.315866] iommu: Adding device 0000:7f:16.6 to group 38
[    5.322043] iommu: Adding device 0000:7f:16.7 to group 38
[    5.328327] iommu: Adding device 0000:7f:17.0 to group 39
[    5.334499] iommu: Adding device 0000:7f:17.4 to group 39
[    5.340673] iommu: Adding device 0000:7f:17.5 to group 39
[    5.346846] iommu: Adding device 0000:7f:17.6 to group 39
[    5.353018] iommu: Adding device 0000:7f:17.7 to group 39
[    5.359305] iommu: Adding device 0000:7f:1e.0 to group 40
[    5.365483] iommu: Adding device 0000:7f:1e.1 to group 40
[    5.371692] iommu: Adding device 0000:7f:1e.2 to group 40
[    5.377865] iommu: Adding device 0000:7f:1e.3 to group 40
[    5.384041] iommu: Adding device 0000:7f:1e.4 to group 40
[    5.390250] iommu: Adding device 0000:7f:1f.0 to group 41
[    5.396426] iommu: Adding device 0000:7f:1f.2 to group 41
[    5.402594] iommu: Adding device 0000:80:00.0 to group 42
[    5.408755] iommu: Adding device 0000:80:01.0 to group 43
[    5.414923] iommu: Adding device 0000:80:01.1 to group 44
[    5.421086] iommu: Adding device 0000:80:02.0 to group 45
[    5.427252] iommu: Adding device 0000:80:02.1 to group 46
[    5.433422] iommu: Adding device 0000:80:02.2 to group 47
[    5.439589] iommu: Adding device 0000:80:02.3 to group 48
[    5.445756] iommu: Adding device 0000:80:03.0 to group 49
[    5.451922] iommu: Adding device 0000:80:03.1 to group 50
[    5.458094] iommu: Adding device 0000:80:03.2 to group 51
[    5.464266] iommu: Adding device 0000:80:03.3 to group 52
[    5.470619] iommu: Adding device 0000:80:04.0 to group 53
[    5.476793] iommu: Adding device 0000:80:04.1 to group 53
[    5.482969] iommu: Adding device 0000:80:04.2 to group 53
[    5.489146] iommu: Adding device 0000:80:04.3 to group 53
[    5.495363] iommu: Adding device 0000:80:04.4 to group 53
[    5.501539] iommu: Adding device 0000:80:04.5 to group 53
[    5.507722] iommu: Adding device 0000:80:04.6 to group 53
[    5.513905] iommu: Adding device 0000:80:04.7 to group 53
[    5.520166] iommu: Adding device 0000:80:05.0 to group 54
[    5.526343] iommu: Adding device 0000:80:05.1 to group 54
[    5.532518] iommu: Adding device 0000:80:05.2 to group 54
[    5.538697] iommu: Adding device 0000:80:05.4 to group 54
[    5.544862] iommu: Adding device 0000:81:00.0 to group 55
[    5.551029] iommu: Adding device 0000:81:00.1 to group 56
[    5.557196] iommu: Adding device 0000:81:00.2 to group 57
[    5.563357] iommu: Adding device 0000:81:00.3 to group 58
[    5.569571] iommu: Adding device 0000:ff:08.0 to group 59
[    5.575748] iommu: Adding device 0000:ff:08.3 to group 59
[    5.581963] iommu: Adding device 0000:ff:09.0 to group 60
[    5.588145] iommu: Adding device 0000:ff:09.3 to group 60
[    5.594383] iommu: Adding device 0000:ff:0b.0 to group 61
[    5.600561] iommu: Adding device 0000:ff:0b.1 to group 61
[    5.606732] iommu: Adding device 0000:ff:0b.2 to group 61
[    5.613079] iommu: Adding device 0000:ff:0c.0 to group 62
[    5.619315] iommu: Adding device 0000:ff:0c.1 to group 62
[    5.625501] iommu: Adding device 0000:ff:0c.2 to group 62
[    5.631682] iommu: Adding device 0000:ff:0c.3 to group 62
[    5.637859] iommu: Adding device 0000:ff:0c.4 to group 62
[    5.644041] iommu: Adding device 0000:ff:0c.5 to group 62
[    5.650217] iommu: Adding device 0000:ff:0c.6 to group 62
[    5.656400] iommu: Adding device 0000:ff:0c.7 to group 62
[    5.662679] iommu: Adding device 0000:ff:0f.0 to group 63
[    5.668857] iommu: Adding device 0000:ff:0f.1 to group 63
[    5.675047] iommu: Adding device 0000:ff:0f.4 to group 63
[    5.681223] iommu: Adding device 0000:ff:0f.5 to group 63
[    5.687407] iommu: Adding device 0000:ff:0f.6 to group 63
[    5.693694] iommu: Adding device 0000:ff:10.0 to group 64
[    5.699875] iommu: Adding device 0000:ff:10.1 to group 64
[    5.706054] iommu: Adding device 0000:ff:10.5 to group 64
[    5.712233] iommu: Adding device 0000:ff:10.6 to group 64
[    5.718416] iommu: Adding device 0000:ff:10.7 to group 64
[    5.724657] iommu: Adding device 0000:ff:12.0 to group 65
[    5.730839] iommu: Adding device 0000:ff:12.1 to group 65
[    5.737016] iommu: Adding device 0000:ff:12.2 to group 65
[    5.743369] iommu: Adding device 0000:ff:13.0 to group 66
[    5.749549] iommu: Adding device 0000:ff:13.1 to group 66
[    5.755731] iommu: Adding device 0000:ff:13.2 to group 66
[    5.761915] iommu: Adding device 0000:ff:13.3 to group 66
[    5.768104] iommu: Adding device 0000:ff:13.4 to group 66
[    5.774283] iommu: Adding device 0000:ff:13.5 to group 66
[    5.780465] iommu: Adding device 0000:ff:13.6 to group 66
[    5.786647] iommu: Adding device 0000:ff:13.7 to group 66
[    5.793001] iommu: Adding device 0000:ff:14.0 to group 67
[    5.799188] iommu: Adding device 0000:ff:14.1 to group 67
[    5.805370] iommu: Adding device 0000:ff:14.2 to group 67
[    5.811559] iommu: Adding device 0000:ff:14.3 to group 67
[    5.817744] iommu: Adding device 0000:ff:14.4 to group 67
[    5.823925] iommu: Adding device 0000:ff:14.5 to group 67
[    5.830109] iommu: Adding device 0000:ff:14.6 to group 67
[    5.836289] iommu: Adding device 0000:ff:14.7 to group 67
[    5.842547] iommu: Adding device 0000:ff:15.0 to group 68
[    5.848736] iommu: Adding device 0000:ff:15.1 to group 68
[    5.854920] iommu: Adding device 0000:ff:15.2 to group 68
[    5.861104] iommu: Adding device 0000:ff:15.3 to group 68
[    5.867491] iommu: Adding device 0000:ff:16.0 to group 69
[    5.873674] iommu: Adding device 0000:ff:16.6 to group 69
[    5.879854] iommu: Adding device 0000:ff:16.7 to group 69
[    5.886132] iommu: Adding device 0000:ff:17.0 to group 70
[    5.892315] iommu: Adding device 0000:ff:17.4 to group 70
[    5.898497] iommu: Adding device 0000:ff:17.5 to group 70
[    5.904683] iommu: Adding device 0000:ff:17.6 to group 70
[    5.910867] iommu: Adding device 0000:ff:17.7 to group 70
[    5.917148] iommu: Adding device 0000:ff:1e.0 to group 71
[    5.923332] iommu: Adding device 0000:ff:1e.1 to group 71
[    5.929518] iommu: Adding device 0000:ff:1e.2 to group 71
[    5.935704] iommu: Adding device 0000:ff:1e.3 to group 71
[    5.941890] iommu: Adding device 0000:ff:1e.4 to group 71
[    5.948101] iommu: Adding device 0000:ff:1f.0 to group 72
[    5.954286] iommu: Adding device 0000:ff:1f.2 to group 72
[    5.961813] Intel CQM monitoring enabled
[    5.967069] RAPL PMU: API unit is 2^-32 Joules, 4 fixed counters, 655360 ms ovfl timer
[    5.976163] RAPL PMU: hw unit of domain pp0-core 2^-14 Joules
[    5.982702] RAPL PMU: hw unit of domain package 2^-14 Joules
[    5.989145] RAPL PMU: hw unit of domain dram 2^-14 Joules
[    5.995401] RAPL PMU: hw unit of domain pp1-gpu 2^-14 Joules
[    6.004635] audit: initializing netlink subsys (disabled)
[    6.010862] audit: type=2000 audit(1503106895.894:1): state=initialized audit_enabled=0 res=1
[    6.011444] Initialise system trusted keyrings
[    6.011535] workingset: timestamp_bits=39 max_order=26 bucket_order=0
[    6.013003] SELinux:  Registering netfilter hooks
[    6.330576] Key type asymmetric registered
[    6.335279] Asymmetric key parser 'x509' registered
[    6.340856] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 251)
[    6.349420] io scheduler noop registered
[    6.353934] io scheduler deadline registered
[    6.358870] io scheduler cfq registered (default)
[    6.364240] io scheduler mq-deadline registered
[    6.369448] io scheduler kyber registered
[    6.379442] pcieport 0000:00:01.0: Signaling PME with IRQ 25
[    6.385892] pcieport 0000:00:01.1: Signaling PME with IRQ 26
[    6.392325] pcieport 0000:00:02.0: Signaling PME with IRQ 28
[    6.398775] pcieport 0000:00:02.1: Signaling PME with IRQ 29
[    6.405211] pcieport 0000:00:02.2: Signaling PME with IRQ 30
[    6.411643] pcieport 0000:00:02.3: Signaling PME with IRQ 31
[    6.418080] pcieport 0000:00:03.0: Signaling PME with IRQ 33
[    6.424526] pcieport 0000:00:03.1: Signaling PME with IRQ 34
[    6.430963] pcieport 0000:00:03.2: Signaling PME with IRQ 35
[    6.437403] pcieport 0000:00:03.3: Signaling PME with IRQ 36
[    6.443845] pcieport 0000:00:1c.2: Signaling PME with IRQ 37
[    6.450281] pcieport 0000:00:1c.4: Signaling PME with IRQ 38
[    6.456726] pcieport 0000:00:1c.6: Signaling PME with IRQ 39
[    6.463170] pcieport 0000:00:1c.7: Signaling PME with IRQ 40
[    6.469610] pcieport 0000:80:00.0: Signaling PME with IRQ 41
[    6.476082] pcieport 0000:80:01.0: Signaling PME with IRQ 43
[    6.482552] pcieport 0000:80:01.1: Signaling PME with IRQ 44
[    6.507515] pcieport 0000:80:02.0: Signaling PME with IRQ 46
[    6.525510] pcieport 0000:80:02.1: Signaling PME with IRQ 47
[    6.543518] pcieport 0000:80:02.2: Signaling PME with IRQ 48
[    6.561515] pcieport 0000:80:02.3: Signaling PME with IRQ 49
[    6.579524] pcieport 0000:80:03.0: Signaling PME with IRQ 51
[    6.597504] pcieport 0000:80:03.1: Signaling PME with IRQ 52
[    6.615508] pcieport 0000:80:03.2: Signaling PME with IRQ 53
[    6.633516] pcieport 0000:80:03.3: Signaling PME with IRQ 54
[    6.639974] intel_idle: MWAIT substates: 0x2120
[    6.639975] intel_idle: v0.4.1 model 0x3F
[    6.641417] intel_idle: lapic_timer_reliable_states 0xffffffff
[    6.642350] ERST: Error Record Serialization Table (ERST) support is initialized.
[    6.650926] pstore: using zlib compression
[    6.655662] pstore: Registered erst as persistent store backend
[    6.662600] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC.
[    6.671129] ioatdma: Intel(R) QuickData Technology Driver 4.00
[    6.824020] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled
[    6.851718] 00:02: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A
[    6.884028] 00:03: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A
[    6.896192] i8042: PNP: No PS/2 controller found.
[    6.901621] i8042: Probing ports directly.
[    6.908141] serio: i8042 KBD port at 0x60,0x64 irq 1
[    6.913823] serio: i8042 AUX port at 0x60,0x64 irq 12
[    6.919664] rtc_cmos 00:00: RTC can wake from S4
[    6.925127] rtc_cmos 00:00: rtc core: registered rtc_cmos as rtc0
[    6.932075] rtc_cmos 00:00: alarms up to one month, y3k, 114 bytes nvram, hpet irqs
[    6.941122] ip_tables: (C) 2000-2006 Netfilter Core Team
[    6.947320] NET: Registered protocol family 10
[    6.952814] Segment Routing with IPv6
[    6.957331] NET: Registered protocol family 17
[    6.962444] Key type dns_resolver registered
[    6.970010] microcode: sig=0x306f2, pf=0x1, revision=0x39
[    6.977101] microcode: Microcode Update Driver: v2.2.
[    6.977282] registered taskstats version 1
[    6.987800] Loading compiled-in X.509 certificates
[    6.995091] alg: No test for pkcs1pad(rsa,sha256) (pkcs1pad(rsa-generic,sha256))
[    7.004448] Loaded X.509 cert 'CoreOS, Inc: Module signing key for 4.12.7-coreos: ce09240b0423dc9a9afc51976e5bd459bb818b48'
[    7.017117] ima: No TPM chip found, activating TPM-bypass! (rc=-19)
[    7.025406] rtc_cmos 00:00: setting system clock to 2017-08-19 01:41:39 UTC (1503106899)
[    7.043859] Freeing unused kernel memory: 32412K
[    7.049171] Write protecting the kernel read-only data: 12288k
[    7.056616] Freeing unused kernel memory: 1936K
[    7.061819] tsc: Refined TSC clocksource calibration: 2397.223 MHz
[    7.068846] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x228df8107c2, max_idle_ns: 440795272256 ns
[    7.080591] Freeing unused kernel memory: 1444K
[    7.090378] random: systemd: uninitialized urandom read (16 bytes read)
[    7.098114] random: systemd: uninitialized urandom read (16 bytes read)
[    7.105599] random: systemd: uninitialized urandom read (16 bytes read)
[    7.115621] systemd[1]: systemd 233 running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK -SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT -GNUTLS -ACL +XZ +LZ4 +SECCOMP +BLKID -ELFUTILS +KMOD -IDN default-hierarchy=legacy)
[    7.138816] systemd[1]: Detected architecture x86-64.
[    7.144572] systemd[1]: Running in initial RAM disk.
[    7.151067] systemd[1]: No hostname configured.
[    7.156256] systemd[1]: Set hostname to <localhost>.
[    7.161944] random: systemd: uninitialized urandom read (16 bytes read)
[    7.169426] systemd[1]: Initializing machine ID from random generator.
[    7.179076] random: systemd: uninitialized urandom read (16 bytes read)
[    7.187770] random: systemd: uninitialized urandom read (16 bytes read)
[    7.189346] random: systemd-cryptse: uninitialized urandom read (16 bytes read)
[    7.213808] random: systemd: uninitialized urandom read (16 bytes read)
[    7.221297] random: systemd: uninitialized urandom read (16 bytes read)
[    7.228827] random: systemd: uninitialized urandom read (16 bytes read)
[    7.240531] systemd[1]: Listening on udev Control Socket.
[    7.247367] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.
[    7.257103] systemd[1]: Listening on Journal Audit Socket.
[    7.263930] systemd[1]: Reached target Local File Systems.
[    7.282509] audit: type=1130 audit(1503106899.757:2): pid=1 uid=0 auid=4294967295 ses=4294967295 subj=kernel msg='unit=kmod-static-nodes comm="systemd" exe="/usr/lib64/systemd/systemd" hostname=? addr=? terminal=? res=success'
[    7.306793] audit: type=1130 audit(1503106899.781:3): pid=1 uid=0 auid=4294967295 ses=4294967295 subj=kernel msg='unit=systemd-tmpfiles-setup-dev comm="systemd" exe="/usr/lib64/systemd/systemd" hostname=? addr=? terminal=? res=success'
[    7.333907] audit: type=1130 audit(1503106899.808:4): pid=1 uid=0 auid=4294967295 ses=4294967295 subj=kernel msg='unit=dracut-cmdline comm="systemd" exe="/usr/lib64/systemd/systemd" hostname=? addr=? terminal=? res=success'
[    7.358080] audit: type=1130 audit(1503106899.832:5): pid=1 uid=0 auid=4294967295 ses=4294967295 subj=kernel msg='unit=systemd-journald comm="systemd" exe="/usr/lib64/systemd/systemd" hostname=? addr=? terminal=? res=success'
[    7.380789] device-mapper: uevent: version 1.0.3
[    7.386188] device-mapper: ioctl: 4.35.0-ioctl (2016-06-23) initialised: dm-devel@redhat.com
[    7.413391] audit: type=1130 audit(1503106899.887:6): pid=1 uid=0 auid=4294967295 ses=4294967295 subj=kernel msg='unit=dracut-pre-udev comm="systemd" exe="/usr/lib64/systemd/systemd" hostname=? addr=? terminal=? res=success'
[    7.440635] audit: type=1130 audit(1503106899.915:7): pid=1 uid=0 auid=4294967295 ses=4294967295 subj=kernel msg='unit=systemd-udevd comm="systemd" exe="/usr/lib64/systemd/systemd" hostname=? addr=? terminal=? res=success'
[    7.478660] audit: type=1130 audit(1503106899.953:8): pid=1 uid=0 auid=4294967295 ses=4294967295 subj=kernel msg='unit=dracut-pre-trigger comm="systemd" exe="/usr/lib64/systemd/systemd" hostname=? addr=? terminal=? res=success'
[    7.579646] audit: type=1130 audit(1503106900.054:9): pid=1 uid=0 auid=4294967295 ses=4294967295 subj=kernel msg='unit=systemd-udev-trigger comm="systemd" exe="/usr/lib64/systemd/systemd" hostname=? addr=? terminal=? res=success'
[    7.604207] SCSI subsystem initialized
[    7.608827] pps_core: LinuxPPS API ver. 1 registered
[    7.608828] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
[    7.625735] ACPI: bus type USB registered
[    7.625771] usbcore: registered new interface driver usbfs
[    7.625783] usbcore: registered new interface driver hub
[    7.625893] usbcore: registered new device driver usb
[    7.648664] PTP clock support registered
[    7.655428] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
[    7.664431] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver - version 5.0.0-k
[    7.664554] tg3.c:v3.137 (May 11, 2014)
[    7.664971] HP HPSA Driver (v 3.4.18-0)
[    7.664984] hpsa 0000:08:00.0: can't disable ASPM; OS doesn't have ASPM control
[    7.665592] hpsa 0000:08:00.0: Logical aborts not supported
[    7.682432] tg3 0000:02:00.0 eth0: Tigon3 [partno(N/A) rev 5719001] (PCI Express) MAC address e0:07:1b:f6:6c:a4
[    7.682435] tg3 0000:02:00.0 eth0: attached PHY is 5719C (10/100/1000Base-T Ethernet) (WireSpeed[1], EEE[1])
[    7.682438] tg3 0000:02:00.0 eth0: RXcsums[1] LinkChgREG[0] MIirq[0] ASF[1] TSOcap[1]
[    7.682439] tg3 0000:02:00.0 eth0: dma_rwctrl[00000001] dma_mask[64-bit]
[    7.696105] tg3 0000:02:00.1 eth1: Tigon3 [partno(N/A) rev 5719001] (PCI Express) MAC address e0:07:1b:f6:6c:a5
[    7.696107] tg3 0000:02:00.1 eth1: attached PHY is 5719C (10/100/1000Base-T Ethernet) (WireSpeed[1], EEE[1])
[    7.696109] tg3 0000:02:00.1 eth1: RXcsums[1] LinkChgREG[0] MIirq[0] ASF[1] TSOcap[1]
[    7.696110] tg3 0000:02:00.1 eth1: dma_rwctrl[00000001] dma_mask[64-bit]
[    7.704610] scsi host0: hpsa
[    7.710173] tg3 0000:02:00.2 eth2: Tigon3 [partno(N/A) rev 5719001] (PCI Express) MAC address e0:07:1b:f6:6c:a6
[    7.710175] tg3 0000:02:00.2 eth2: attached PHY is 5719C (10/100/1000Base-T Ethernet) (WireSpeed[1], EEE[1])
[    7.710177] tg3 0000:02:00.2 eth2: RXcsums[1] LinkChgREG[0] MIirq[0] ASF[1] TSOcap[1]
[    7.710178] tg3 0000:02:00.2 eth2: dma_rwctrl[00000001] dma_mask[64-bit]
[    7.725192] tg3 0000:02:00.3 eth3: Tigon3 [partno(N/A) rev 5719001] (PCI Express) MAC address e0:07:1b:f6:6c:a7
[    7.725193] tg3 0000:02:00.3 eth3: attached PHY is 5719C (10/100/1000Base-T Ethernet) (WireSpeed[1], EEE[1])
[    7.725194] tg3 0000:02:00.3 eth3: RXcsums[1] LinkChgREG[0] MIirq[0] ASF[1] TSOcap[1]
[    7.725195] tg3 0000:02:00.3 eth3: dma_rwctrl[00000001] dma_mask[64-bit]
[    7.729988] random: fast init done
[    7.730277] hpsa 0000:08:00.0: scsi 0:0:0:0: added RAID              HP       P840             controller SSDSmartPathCap- En- Exp=1
[    7.730279] hpsa 0000:08:00.0: scsi 0:0:1:0: masked Direct-Access     ATA      MK0480GFDKR      PHYS DRV SSDSmartPathCap- En- Exp=0
[    7.730281] hpsa 0000:08:00.0: scsi 0:0:2:0: masked Direct-Access     ATA      MK0480GFDKR      PHYS DRV SSDSmartPathCap- En- Exp=0
[    7.730283] hpsa 0000:08:00.0: scsi 0:0:3:0: masked Direct-Access     ATA      MK0480GFDKR      PHYS DRV SSDSmartPathCap- En- Exp=0
[    7.730285] hpsa 0000:08:00.0: scsi 0:0:4:0: masked Direct-Access     ATA      MK0480GFDKR      PHYS DRV SSDSmartPathCap- En- Exp=0
[    7.730287] hpsa 0000:08:00.0: scsi 0:0:5:0: masked Direct-Access     ATA      MK0480GFDKR      PHYS DRV SSDSmartPathCap- En- Exp=0
[    7.730288] hpsa 0000:08:00.0: scsi 0:0:6:0: masked Direct-Access     ATA      MK0480GFDKR      PHYS DRV SSDSmartPathCap- En- Exp=0
[    7.730290] hpsa 0000:08:00.0: scsi 0:0:7:0: masked Direct-Access     ATA      MK0480GFDKR      PHYS DRV SSDSmartPathCap- En- Exp=0
[    7.730292] hpsa 0000:08:00.0: scsi 0:0:8:0: masked Direct-Access     ATA      MK0480GFDKR      PHYS DRV SSDSmartPathCap- En- Exp=0
[    7.730293] hpsa 0000:08:00.0: scsi 0:0:9:0: masked Direct-Access     ATA      MK0480GFDKR      PHYS DRV SSDSmartPathCap- En- Exp=0
[    7.730295] hpsa 0000:08:00.0: scsi 0:0:10:0: masked Direct-Access     ATA      MK0480GFDKR      PHYS DRV SSDSmartPathCap- En- Exp=0
[    7.730297] hpsa 0000:08:00.0: scsi 0:0:11:0: masked Direct-Access     ATA      MK0480GFDKR      PHYS DRV SSDSmartPathCap- En- Exp=0
[    7.730299] hpsa 0000:08:00.0: scsi 0:0:12:0: masked Direct-Access     ATA      MK0480GFDKR      PHYS DRV SSDSmartPathCap- En- Exp=0
[    7.730301] hpsa 0000:08:00.0: scsi 0:1:0:0: added Direct-Access     HP       LOGICAL VOLUME   RAID-1(+0) SSDSmartPathCap+ En+ Exp=1
[    7.730303] hpsa 0000:08:00.0: scsi 0:1:0:1: added Direct-Access     HP       LOGICAL VOLUME   RAID-0 SSDSmartPathCap+ En+ Exp=1
[    7.730304] hpsa 0000:08:00.0: scsi 0:1:0:2: added Direct-Access     HP       LOGICAL VOLUME   RAID-0 SSDSmartPathCap+ En+ Exp=1
[    7.730306] hpsa 0000:08:00.0: scsi 0:1:0:3: added Direct-Access     HP       LOGICAL VOLUME   RAID-0 SSDSmartPathCap+ En+ Exp=1
[    7.730308] hpsa 0000:08:00.0: scsi 0:1:0:4: added Direct-Access     HP       LOGICAL VOLUME   RAID-0 SSDSmartPathCap+ En+ Exp=1
[    7.730309] hpsa 0000:08:00.0: scsi 0:1:0:5: added Direct-Access     HP       LOGICAL VOLUME   RAID-0 SSDSmartPathCap+ En+ Exp=1
[    7.730311] hpsa 0000:08:00.0: scsi 0:1:0:6: added Direct-Access     HP       LOGICAL VOLUME   RAID-0 SSDSmartPathCap+ En+ Exp=1
[    7.730313] hpsa 0000:08:00.0: scsi 0:1:0:7: added Direct-Access     HP       LOGICAL VOLUME   RAID-0 SSDSmartPathCap+ En+ Exp=1
[    7.730314] hpsa 0000:08:00.0: scsi 0:1:0:8: added Direct-Access     HP       LOGICAL VOLUME   RAID-0 SSDSmartPathCap+ En+ Exp=1
[    7.730316] hpsa 0000:08:00.0: scsi 0:1:0:9: added Direct-Access     HP       LOGICAL VOLUME   RAID-0 SSDSmartPathCap+ En+ Exp=1
[    7.730318] hpsa 0000:08:00.0: scsi 0:1:0:10: added Direct-Access     HP       LOGICAL VOLUME   RAID-0 SSDSmartPathCap+ En+ Exp=1
[    7.730869] scsi 0:0:0:0: RAID              HP       P840             5.04 PQ: 0 ANSI: 5
[    7.763661] ehci-pci: EHCI PCI platform driver
[    7.763948] ehci-pci 0000:00:1a.0: EHCI Host Controller
[    7.763955] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 1
[    7.763969] ehci-pci 0000:00:1a.0: debug port 2
[    7.767898] ehci-pci 0000:00:1a.0: cache line size of 64 is not supported
[    7.767909] ehci-pci 0000:00:1a.0: irq 18, io mem 0x93801000
[    7.774553] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00
[    7.774705] hub 1-0:1.0: USB hub found
[    7.774708] hub 1-0:1.0: 2 ports detected
[    7.775100] ehci-pci 0000:00:1d.0: EHCI Host Controller
[    7.775105] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 2
[    7.775131] ehci-pci 0000:00:1d.0: debug port 2
[    7.779038] ehci-pci 0000:00:1d.0: cache line size of 64 is not supported
[    7.779042] ehci-pci 0000:00:1d.0: irq 18, io mem 0x93800000
[    7.785537] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00
[    7.785682] hub 2-0:1.0: USB hub found
[    7.785687] hub 2-0:1.0: 2 ports detected
[    8.282844] ixgbe: Copyright (c) 1999-2016 Intel Corporation.
[    8.282866] usb 2-1: new high-speed USB device number 2 using ehci-pci
[    8.282867] clocksource: Switched to clocksource tsc
[    8.282869] usb 1-1: new high-speed USB device number 2 using ehci-pci
[    8.310819] AVX2 version of gcm_enc/dec engaged.
[    8.310820] AES CTR mode by8 optimization enabled
[    8.311328] uhci_hcd: USB Universal Host Controller Interface driver
[    8.313281] xhci_hcd 0000:00:14.0: xHCI Host Controller
[    8.313289] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 3
[    8.314499] xhci_hcd 0000:00:14.0: hcc params 0x200077c1 hci version 0x100 quirks 0x00009810
[    8.314507] xhci_hcd 0000:00:14.0: cache line size of 64 is not supported
[    8.314708] hub 3-0:1.0: USB hub found
[    8.314745] hub 3-0:1.0: 15 ports detected
[    8.315579] xhci_hcd 0000:00:14.0: xHCI Host Controller
[    8.315581] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 4
[    8.315642] uhci_hcd 0000:01:00.4: UHCI Host Controller
[    8.316008] hub 4-0:1.0: USB hub found
[    8.316019] igb: Intel(R) Gigabit Ethernet Network Driver - version 5.4.0-k
[    8.316020] igb: Copyright (c) 2007-2014 Intel Corporation.
[    8.316027] hub 4-0:1.0: 6 ports detected
[    8.316380] uhci_hcd 0000:01:00.4: new USB bus registered, assigned bus number 5
[    8.316403] uhci_hcd 0000:01:00.4: detected 8 ports
[    8.316404] uhci_hcd 0000:01:00.4: port count misdetected? forcing to 2 ports
[    8.316438] uhci_hcd 0000:01:00.4: irq 19, io base 0x00001300
[    8.316973] hub 5-0:1.0: USB hub found
[    8.316977] hub 5-0:1.0: 2 ports detected
[    8.382945] igb 0000:81:00.0: DCA enabled
[    8.383067] igb 0000:81:00.0: added PHC on eth4
[    8.383069] igb 0000:81:00.0: Intel(R) Gigabit Ethernet Network Connection
[    8.383072] igb 0000:81:00.0: eth4: (PCIe:5.0Gb/s:Width x4) 3c:a8:2a:5c:6a:d4
[    8.383365] igb 0000:81:00.0: eth4: PBA No: H73100-004
[    8.383366] igb 0000:81:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
[    8.402260] hub 1-1:1.0: USB hub found
[    8.402361] hub 1-1:1.0: 6 ports detected
[    8.403132] hub 2-1:1.0: USB hub found
[    8.403239] hub 2-1:1.0: 8 ports detected
[    8.450901] igb 0000:81:00.1: DCA enabled
[    8.450980] igb 0000:81:00.1: added PHC on eth5
[    8.450980] igb 0000:81:00.1: Intel(R) Gigabit Ethernet Network Connection
[    8.450982] igb 0000:81:00.1: eth5: (PCIe:5.0Gb/s:Width x4) 3c:a8:2a:5c:6a:d5
[    8.451266] igb 0000:81:00.1: eth5: PBA No: H73100-004
[    8.451267] igb 0000:81:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
[    8.518921] igb 0000:81:00.2: DCA enabled
[    8.518984] igb 0000:81:00.2: added PHC on eth6
[    8.518984] igb 0000:81:00.2: Intel(R) Gigabit Ethernet Network Connection
[    8.518985] igb 0000:81:00.2: eth6: (PCIe:5.0Gb/s:Width x4) 3c:a8:2a:5c:6a:d6
[    8.519270] igb 0000:81:00.2: eth6: PBA No: H73100-004
[    8.519271] igb 0000:81:00.2: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
[    8.548287] ixgbe 0000:04:00.0: Multiqueue Enabled: Rx Queue count = 32, Tx Queue count = 32 XDP Queue count = 0
[    8.583628] ixgbe 0000:04:00.0: PCI Express bandwidth of 32GT/s available
[    8.583629] ixgbe 0000:04:00.0: (Speed:5.0GT/s, Width: x8, Encoding Loss:20%)
[    8.586949] igb 0000:81:00.3: DCA enabled
[    8.587108] igb 0000:81:00.3: added PHC on eth7
[    8.587109] igb 0000:81:00.3: Intel(R) Gigabit Ethernet Network Connection
[    8.587110] igb 0000:81:00.3: eth7: (PCIe:5.0Gb/s:Width x4) 3c:a8:2a:5c:6a:d7
[    8.587395] igb 0000:81:00.3: eth7: PBA No: H73100-004
[    8.587395] igb 0000:81:00.3: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
[    8.628630] usb 5-1: new full-speed USB device number 2 using uhci_hcd
[    8.679619] ixgbe 0000:04:00.0: MAC: 3, PHY: 0, PBA No: G74768-012
[    8.686647] ixgbe 0000:04:00.0: 5c:b9:01:9c:c8:dc
[    8.686659] usb 3-3: new high-speed USB device number 2 using xhci_hcd
[    8.689131] scsi 0:1:0:0: Direct-Access     HP       LOGICAL VOLUME   5.04 PQ: 0 ANSI: 5
[    8.721915] scsi 0:1:0:1: Direct-Access     HP       LOGICAL VOLUME   5.04 PQ: 0 ANSI: 5
[    8.746906] scsi 0:1:0:2: Direct-Access     HP       LOGICAL VOLUME   5.04 PQ: 0 ANSI: 5
[    8.781161] hidraw: raw HID events driver (C) Jiri Kosina
[    8.791830] scsi 0:1:0:3: Direct-Access     HP       LOGICAL VOLUME   5.04 PQ: 0 ANSI: 5
[    8.793894] usbcore: registered new interface driver usbhid
[    8.793895] usbhid: USB HID core driver
[    8.813231] input: BMC Virtual Keyboard  as /devices/pci0000:00/0000:00:1c.2/0000:01:00.4/usb5/5-1/5-1:1.0/0003:03F0:7029.0001/input/input2
[    8.838598] ixgbe 0000:04:00.0: Intel(R) 10 Gigabit Network Connection
[    8.838779] scsi 0:1:0:4: Direct-Access     HP       LOGICAL VOLUME   5.04 PQ: 0 ANSI: 5
[    8.866881] hub 3-3:1.0: USB hub found
[    8.871293] hub 3-3:1.0: 2 ports detected
[    8.871777] scsi 0:1:0:5: Direct-Access     HP       LOGICAL VOLUME   5.04 PQ: 0 ANSI: 5
[    8.878669] hid-generic 0003:03F0:7029.0001: input,hidraw0: USB HID v1.01 Keyboard [BMC Virtual Keyboard ] on usb-0000:01:00.4-1/input0
[    8.878755] input: BMC Virtual Keyboard  as /devices/pci0000:00/0000:00:1c.2/0000:01:00.4/usb5/5-1/5-1:1.1/0003:03F0:7029.0002/input/input3
[    8.878779] hid-generic 0003:03F0:7029.0002: input,hidraw1: USB HID v1.01 Mouse [BMC Virtual Keyboard ] on usb-0000:01:00.4-1/input1
[    8.941956] scsi 0:1:0:6: Direct-Access     HP       LOGICAL VOLUME   5.04 PQ: 0 ANSI: 5
[    8.966873] scsi 0:1:0:7: Direct-Access     HP       LOGICAL VOLUME   5.04 PQ: 0 ANSI: 5
[    8.992001] scsi 0:1:0:8: Direct-Access     HP       LOGICAL VOLUME   5.04 PQ: 0 ANSI: 5
[    9.016855] scsi 0:1:0:9: Direct-Access     HP       LOGICAL VOLUME   5.04 PQ: 0 ANSI: 5
[    9.041937] scsi 0:1:0:10: Direct-Access     HP       LOGICAL VOLUME   5.04 PQ: 0 ANSI: 5
[    9.069427] sd 0:1:0:0: [sda] 937637552 512-byte logical blocks: (480 GB/447 GiB)
[    9.069604] sd 0:1:0:1: [sdb] 937637552 512-byte logical blocks: (480 GB/447 GiB)
[    9.069606] sd 0:1:0:1: [sdb] 4096-byte physical blocks
[    9.069621] sd 0:1:0:2: [sdc] 937637552 512-byte logical blocks: (480 GB/447 GiB)
[    9.069622] sd 0:1:0:2: [sdc] 4096-byte physical blocks
[    9.069650] sd 0:1:0:1: [sdb] Write Protect is off
[    9.069651] sd 0:1:0:1: [sdb] Mode Sense: 73 00 00 08
[    9.069679] sd 0:1:0:2: [sdc] Write Protect is off
[    9.069681] sd 0:1:0:2: [sdc] Mode Sense: 73 00 00 08
[    9.069691] sd 0:1:0:3: [sdd] 937637552 512-byte logical blocks: (480 GB/447 GiB)
[    9.069693] sd 0:1:0:3: [sdd] 4096-byte physical blocks
[    9.069755] sd 0:1:0:3: [sdd] Write Protect is off
[    9.069756] sd 0:1:0:3: [sdd] Mode Sense: 73 00 00 08
[    9.069767] sd 0:1:0:1: [sdb] Write cache: disabled, read cache: disabled, doesn't support DPO or FUA
[    9.069775] sd 0:1:0:4: [sde] 937637552 512-byte logical blocks: (480 GB/447 GiB)
[    9.069776] sd 0:1:0:4: [sde] 4096-byte physical blocks
[    9.069804] sd 0:1:0:2: [sdc] Write cache: disabled, read cache: disabled, doesn't support DPO or FUA
[    9.069844] sd 0:1:0:4: [sde] Write Protect is off
[    9.069846] sd 0:1:0:4: [sde] Mode Sense: 73 00 00 08
[    9.069880] sd 0:1:0:3: [sdd] Write cache: disabled, read cache: disabled, doesn't support DPO or FUA
[    9.069883] sd 0:1:0:5: [sdf] 937637552 512-byte logical blocks: (480 GB/447 GiB)
[    9.069885] sd 0:1:0:5: [sdf] 4096-byte physical blocks
[    9.069918] sd 0:1:0:5: [sdf] Write Protect is off
[    9.069920] sd 0:1:0:5: [sdf] Mode Sense: 73 00 00 08
[    9.069933] sd 0:1:0:7: [sdh] 937637552 512-byte logical blocks: (480 GB/447 GiB)
[    9.069934] sd 0:1:0:7: [sdh] 4096-byte physical blocks
[    9.069940] sd 0:1:0:4: [sde] Write cache: disabled, read cache: disabled, doesn't support DPO or FUA
[    9.069953] sd 0:1:0:6: [sdg] 937637552 512-byte logical blocks: (480 GB/447 GiB)
[    9.069955] sd 0:1:0:6: [sdg] 4096-byte physical blocks
[    9.069971] sd 0:1:0:7: [sdh] Write Protect is off
[    9.069973] sd 0:1:0:7: [sdh] Mode Sense: 73 00 00 08
[    9.069994] sd 0:1:0:6: [sdg] Write Protect is off
[    9.069996] sd 0:1:0:6: [sdg] Mode Sense: 73 00 00 08
[    9.070001] sd 0:1:0:5: [sdf] Write cache: disabled, read cache: disabled, doesn't support DPO or FUA
[    9.070041] sd 0:1:0:7: [sdh] Write cache: disabled, read cache: disabled, doesn't support DPO or FUA
[    9.070069] sd 0:1:0:6: [sdg] Write cache: disabled, read cache: disabled, doesn't support DPO or FUA
[    9.070465] sd 0:1:0:8: [sdi] 937637552 512-byte logical blocks: (480 GB/447 GiB)
[    9.070466] sd 0:1:0:8: [sdi] 4096-byte physical blocks
[    9.070502] sd 0:1:0:8: [sdi] Write Protect is off
[    9.070503] sd 0:1:0:8: [sdi] Mode Sense: 73 00 00 08
[    9.070628] sd 0:1:0:8: [sdi] Write cache: disabled, read cache: disabled, doesn't support DPO or FUA
[    9.070736] sd 0:1:0:9: [sdj] 937637552 512-byte logical blocks: (480 GB/447 GiB)
[    9.070738] sd 0:1:0:9: [sdj] 4096-byte physical blocks
[    9.070781] sd 0:1:0:9: [sdj] Write Protect is off
[    9.070783] sd 0:1:0:9: [sdj] Mode Sense: 73 00 00 08
[    9.070826] sd 0:1:0:10: [sdk] 937637552 512-byte logical blocks: (480 GB/447 GiB)
[    9.070828] sd 0:1:0:10: [sdk] 4096-byte physical blocks
[    9.070879] sd 0:1:0:10: [sdk] Write Protect is off
[    9.070881] sd 0:1:0:10: [sdk] Mode Sense: 73 00 00 08
[    9.070928] sd 0:1:0:9: [sdj] Write cache: disabled, read cache: disabled, doesn't support DPO or FUA
[    9.070940] sd 0:1:0:10: [sdk] Write cache: disabled, read cache: disabled, doesn't support DPO or FUA
[    9.073116] sd 0:1:0:6: [sdg] Attached SCSI disk
[    9.073226] sd 0:1:0:7: [sdh] Attached SCSI disk
[    9.074277] sd 0:1:0:9: [sdj] Attached SCSI disk
[    9.075025] sd 0:1:0:2: [sdc] Attached SCSI disk
[    9.075030] sd 0:1:0:4: [sde] Attached SCSI disk
[    9.075099] sd 0:1:0:3: [sdd] Attached SCSI disk
[    9.075149] sd 0:1:0:1: [sdb] Attached SCSI disk
[    9.075258] sd 0:1:0:5: [sdf] Attached SCSI disk
[    9.075997] sd 0:1:0:8: [sdi] Attached SCSI disk
[    9.076018] sd 0:1:0:10: [sdk] Attached SCSI disk
[    9.164199] ixgbe 0000:04:00.1: Multiqueue Enabled: Rx Queue count = 32, Tx Queue count = 32 XDP Queue count = 0
[    9.199652] ixgbe 0000:04:00.1: PCI Express bandwidth of 32GT/s available
[    9.199655] ixgbe 0000:04:00.1: (Speed:5.0GT/s, Width: x8, Encoding Loss:20%)
[    9.295661] ixgbe 0000:04:00.1: MAC: 3, PHY: 0, PBA No: G74768-012
[    9.295663] ixgbe 0000:04:00.1: 5c:b9:01:9c:c8:dd
[    9.442710] ixgbe 0000:04:00.1: Intel(R) 10 Gigabit Network Connection
[    9.485376] sd 0:1:0:0: [sda] 4096-byte physical blocks
[    9.485417] sd 0:1:0:0: [sda] Write Protect is off
[    9.485418] sd 0:1:0:0: [sda] Mode Sense: 73 00 00 08
[    9.485469] sd 0:1:0:0: [sda] Write cache: disabled, read cache: disabled, doesn't support DPO or FUA
[    9.488416]  sda: sda1 sda2 sda3 sda4 sda6 sda7 sda9
[    9.493514] sd 0:1:0:0: [sda] Attached SCSI disk
[    9.540663] audit: type=1130 audit(1503106902.015:10): pid=1 uid=0 auid=4294967295 ses=4294967295 subj=kernel msg='unit=dracut-initqueue comm="systemd" exe="/usr/lib64/systemd/systemd" hostname=? addr=? terminal=? res=success'
[    9.910234] EXT4-fs (sda9): mounted filesystem with ordered data mode. Opts: (null)
[    9.927446] EXT4-fs (sda4): mounted filesystem without journal. Opts: (null)
[   10.096367] systemd-journald[351]: Received SIGTERM from PID 1 (systemd).
[   10.110668] systemd: 22 output lines suppressed due to ratelimiting
[   10.143600] SELinux: 4096 avtab hash slots, 13428 rules.
[   10.145077] SELinux: 4096 avtab hash slots, 13428 rules.
[   10.145526] SELinux:  6 users, 6 roles, 1327 types, 55 bools, 1 sens, 1024 cats
[   10.145528] SELinux:  92 classes, 13428 rules
[   10.146043] SELinux:  Permission validate_trans in class security not defined in policy.
[   10.155304] SELinux:  Permission getrlimit in class process not defined in policy.
[   10.163984] SELinux:  Permission module_load in class system not defined in policy.
[   10.172814] SELinux:  Class cap_userns not defined in policy.
[   10.179338] SELinux:  Class cap2_userns not defined in policy.
[   10.185958] SELinux:  Class sctp_socket not defined in policy.
[   10.192580] SELinux:  Class icmp_socket not defined in policy.
[   10.199200] SELinux:  Class ax25_socket not defined in policy.
[   10.205823] SELinux:  Class ipx_socket not defined in policy.
[   10.212352] SELinux:  Class netrom_socket not defined in policy.
[   10.219161] SELinux:  Class atmpvc_socket not defined in policy.
[   10.225973] SELinux:  Class x25_socket not defined in policy.
[   10.232499] SELinux:  Class rose_socket not defined in policy.
[   10.239117] SELinux:  Class decnet_socket not defined in policy.
[   10.245932] SELinux:  Class atmsvc_socket not defined in policy.
[   10.252773] SELinux:  Class rds_socket not defined in policy.
[   10.259317] SELinux:  Class irda_socket not defined in policy.
[   10.265957] SELinux:  Class pppox_socket not defined in policy.
[   10.272690] SELinux:  Class llc_socket not defined in policy.
[   10.279231] SELinux:  Class can_socket not defined in policy.
[   10.285774] SELinux:  Class tipc_socket not defined in policy.
[   10.292417] SELinux:  Class bluetooth_socket not defined in policy.
[   10.299539] SELinux:  Class iucv_socket not defined in policy.
[   10.306191] SELinux:  Class rxrpc_socket not defined in policy.
[   10.312919] SELinux:  Class isdn_socket not defined in policy.
[   10.319572] SELinux:  Class phonet_socket not defined in policy.
[   10.326402] SELinux:  Class ieee802154_socket not defined in policy.
[   10.333612] SELinux:  Class caif_socket not defined in policy.
[   10.340246] SELinux:  Class alg_socket not defined in policy.
[   10.346799] SELinux:  Class nfc_socket not defined in policy.
[   10.353336] SELinux:  Class vsock_socket not defined in policy.
[   10.360079] SELinux:  Class kcm_socket not defined in policy.
[   10.366620] SELinux:  Class qipcrtr_socket not defined in policy.
[   10.373682] SELinux:  Class smc_socket not defined in policy.
[   10.380228] SELinux: the above unknown classes and permissions will be allowed
[   10.388582] SELinux:  Completing initialization.
[   10.388583] SELinux:  Setting up existing superblocks.
[   10.406011] systemd[1]: Successfully loaded SELinux policy in 277.447ms.
[   10.421570] systemd[1]: Relabelled /dev and /run in 5.792ms.
[   11.216369] kauditd_printk_skb: 34 callbacks suppressed
[   11.222351] audit: type=1130 audit(1503106903.690:45): pid=1 uid=0 auid=4294967295 ses=4294967295 subj=system_u:system_r:kernel_t:s0 msg='unit=systemd-journald comm="systemd" exe="/usr/lib64/systemd/systemd" hostname=? addr=? terminal=? res=success'
[   11.222354] audit: type=1131 audit(1503106903.690:46): pid=1 uid=0 auid=4294967295 ses=4294967295 subj=system_u:system_r:kernel_t:s0 msg='unit=systemd-journald comm="systemd" exe="/usr/lib64/systemd/systemd" hostname=? addr=? terminal=? res=success'
[   11.273185] audit: type=1130 audit(1503106903.747:47): pid=1 uid=0 auid=4294967295 ses=4294967295 subj=system_u:system_r:kernel_t:s0 msg='unit=initrd-switch-root comm="systemd" exe="/usr/lib64/systemd/systemd" hostname=? addr=? terminal=? res=success'
[   11.301854] audit: type=1131 audit(1503106903.747:48): pid=1 uid=0 auid=4294967295 ses=4294967295 subj=system_u:system_r:kernel_t:s0 msg='unit=initrd-switch-root comm="systemd" exe="/usr/lib64/systemd/systemd" hostname=? addr=? terminal=? res=success'
[   11.327646] audit: type=1130 audit(1503106903.802:49): pid=1 uid=0 auid=4294967295 ses=4294967295 subj=system_u:system_r:kernel_t:s0 msg='unit=systemd-journald comm="systemd" exe="/usr/lib64/systemd/systemd" hostname=? addr=? terminal=? res=success'
[   11.352596] audit: type=1131 audit(1503106903.802:50): pid=1 uid=0 auid=4294967295 ses=4294967295 subj=system_u:system_r:kernel_t:s0 msg='unit=systemd-journald comm="systemd" exe="/usr/lib64/systemd/systemd" hostname=? addr=? terminal=? res=success'
[   11.384322] audit: type=1305 audit(1503106903.858:51): audit_enabled=1 old=1 auid=4294967295 ses=4294967295 subj=system_u:system_r:kernel_t:s0 res=1
[   11.404689] audit: type=1130 audit(1503106903.879:52): pid=1 uid=0 auid=4294967295 ses=4294967295 subj=system_u:system_r:kernel_t:s0 msg='unit=systemd-fsck@dev-disk-by\x2dpartuuid-e03dd35c\x2d7c2d\x2d4a47\x2db3fe\x2d27f15780a57c comm="systemd" exe="/usr/lib64/systemd/systemd" hostname=? addr=? terminal=? res=success'
[   11.436436] audit: type=1131 audit(1503106903.879:53): pid=1 uid=0 auid=4294967295 ses=4294967295 subj=system_u:system_r:kernel_t:s0 msg='unit=systemd-fsck@dev-disk-by\x2dpartuuid-e03dd35c\x2d7c2d\x2d4a47\x2db3fe\x2d27f15780a57c comm="systemd" exe="/usr/lib64/systemd/systemd" hostname=? addr=? terminal=? res=success'
[   11.485222] audit: type=1130 audit(1503106903.959:54): pid=1 uid=0 auid=4294967295 ses=4294967295 subj=system_u:system_r:kernel_t:s0 msg='unit=systemd-fsck-root comm="systemd" exe="/usr/lib64/systemd/systemd" hostname=? addr=? terminal=? res=success'
[   11.537926] systemd-journald[852]: Received request to flush runtime journal from PID 1
[   11.549153] systemd-journald[852]: File /var/log/journal/5febec48382b49d2b9bb70a77b4934aa/system.journal corrupted or uncleanly shut down, renaming and replacing.
[   11.609877] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input4
[   11.618374] ACPI: Power Button [PWRF]
[   11.623113] ipmi message handler version 39.2
[   11.630081] ipmi device interface
[   11.636367] pcc-cpufreq: (v1.10.00) driver loaded with frequency limits: 1200 MHz, 2400 MHz
[   11.649861] ipmi_si IPI0001:00: ipmi_si: probing via ACPI
[   11.657476] ipmi_si IPI0001:00: [io  0x0ca2-0x0ca3] regsize 1 spacing 1 irq 0
[   11.658255] ixgbe 0000:04:00.0 eno49: renamed from eth8
[   11.671485] ipmi_si: Adding ACPI-specified kcs state machine
[   11.677997] IPMI System Interface driver.
[   11.680435] random: crng init done
[   11.686689] ipmi_si: probing via SMBIOS
[   11.691117] ipmi_si: SMBIOS: io 0xca2 regsize 1 spacing 1 irq 0
[   11.692991] ixgbe 0000:04:00.1 eno50: renamed from eth9
[   11.703802] ipmi_si: SMBIOS-specified kcs state machine: duplicate
[   11.710818] ipmi_si: probing via SPMI
[   11.715075] ipmi_si: SPMI: io 0xca3 regsize 1 spacing 1 irq 0
[   11.715154] ipmi_si: Adding SPMI-specified kcs state machine
[   11.715157] ipmi_si: Trying ACPI-specified kcs state machine at i/o address 0xca2, slave address 0x20, irq 0
[   11.739798] mousedev: PS/2 mouse device common for all mice
[   11.747588] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt
[   11.766072] EXT4-fs (sda6): recovery complete
[   11.771084] EXT4-fs (sda6): mounted filesystem with ordered data mode. Opts: commit=600
[   11.775261] igb 0000:81:00.1 ens6f1: renamed from eth5
[   11.789852] igb 0000:81:00.2 ens6f2: renamed from eth6
[   11.796212] FAT-fs (sda1): Volume was not properly unmounted. Some data may be corrupt. Please run fsck.
[   11.816946] EDAC MC: Ver: 3.0.0
[   11.821884] igb 0000:81:00.3 ens6f3: renamed from eth7
[   11.827963] EDAC sbridge: Seeking for: PCI ID 8086:2fa0
[   11.827983] EDAC sbridge: Seeking for: PCI ID 8086:2fa0
[   11.828005] EDAC sbridge: Seeking for: PCI ID 8086:2fa0
[   11.828013] EDAC sbridge: Seeking for: PCI ID 8086:2ffc
[   11.828019] EDAC sbridge: Seeking for: PCI ID 8086:2ffc
[   11.828026] EDAC sbridge: Seeking for: PCI ID 8086:2ffc
[   11.828029] EDAC sbridge: Seeking for: PCI ID 8086:2ffd
[   11.828035] EDAC sbridge: Seeking for: PCI ID 8086:2ffd
[   11.828042] EDAC sbridge: Seeking for: PCI ID 8086:2ffd
[   11.828045] EDAC sbridge: Seeking for: PCI ID 8086:2f60
[   11.828057] EDAC sbridge: Seeking for: PCI ID 8086:2fa8
[   11.828064] EDAC sbridge: Seeking for: PCI ID 8086:2fa8
[   11.828073] EDAC sbridge: Seeking for: PCI ID 8086:2fa8
[   11.828076] EDAC sbridge: Seeking for: PCI ID 8086:2f71
[   11.828082] EDAC sbridge: Seeking for: PCI ID 8086:2f71
[   11.828091] EDAC sbridge: Seeking for: PCI ID 8086:2f71
[   11.828094] EDAC sbridge: Seeking for: PCI ID 8086:2faa
[   11.828100] EDAC sbridge: Seeking for: PCI ID 8086:2faa
[   11.828107] EDAC sbridge: Seeking for: PCI ID 8086:2faa
[   11.828110] EDAC sbridge: Seeking for: PCI ID 8086:2fab
[   11.828116] EDAC sbridge: Seeking for: PCI ID 8086:2fab
[   11.828124] EDAC sbridge: Seeking for: PCI ID 8086:2fab
[   11.828127] EDAC sbridge: Seeking for: PCI ID 8086:2fac
[   11.828133] EDAC sbridge: Seeking for: PCI ID 8086:2fac
[   11.828140] EDAC sbridge: Seeking for: PCI ID 8086:2fac
[   11.828143] EDAC sbridge: Seeking for: PCI ID 8086:2fad
[   11.828149] EDAC sbridge: Seeking for: PCI ID 8086:2fad
[   11.828157] EDAC sbridge: Seeking for: PCI ID 8086:2fad
[   11.828160] EDAC sbridge: Seeking for: PCI ID 8086:2fbd
[   11.828167] EDAC sbridge: Seeking for: PCI ID 8086:2fbd
[   11.828175] EDAC sbridge: Seeking for: PCI ID 8086:2fbd
[   11.828177] EDAC sbridge: Seeking for: PCI ID 8086:2fbf
[   11.828184] EDAC sbridge: Seeking for: PCI ID 8086:2fbf
[   11.828192] EDAC sbridge: Seeking for: PCI ID 8086:2fbf
[   11.828194] EDAC sbridge: Seeking for: PCI ID 8086:2fb9
[   11.828213] EDAC sbridge: Seeking for: PCI ID 8086:2fb9
[   11.828232] EDAC sbridge: Seeking for: PCI ID 8086:2fb9
[   11.828234] EDAC sbridge: Seeking for: PCI ID 8086:2fbb
[   11.828241] EDAC sbridge: Seeking for: PCI ID 8086:2fbb
[   11.828247] EDAC sbridge: Seeking for: PCI ID 8086:2fbb
[   11.828248] EDAC sbridge: Seeking for: PCI ID 8086:2f68
[   11.828256] EDAC sbridge: Seeking for: PCI ID 8086:2f68
[   11.828263] EDAC sbridge: Seeking for: PCI ID 8086:2f68
[   11.828265] EDAC sbridge: Seeking for: PCI ID 8086:2f79
[   11.828275] EDAC sbridge: Seeking for: PCI ID 8086:2f6a
[   11.828287] EDAC sbridge: Seeking for: PCI ID 8086:2f6b
[   11.828309] EDAC sbridge: Seeking for: PCI ID 8086:2f6c
[   11.828320] EDAC sbridge: Seeking for: PCI ID 8086:2f6d
[   11.828513] EDAC MC0: Giving out device to module sbridge_edac.c controller Haswell Socket#0: DEV 0000:7f:12.0 (INTERRUPT)
[   11.841191] EDAC MC1: Giving out device to module sbridge_edac.c controller Haswell Socket#1: DEV 0000:ff:12.0 (INTERRUPT)
[   11.853716] EDAC sbridge:  Ver: 1.1.1
[   11.877903] igb 0000:81:00.0 ens6f0: renamed from eth4
[   11.899071] tg3 0000:02:00.1 eno2: renamed from eth1
[   11.911470] ipmi_si IPI0001:00: Found new BMC (man_id: 0x00000b, prod_id: 0x2000, dev_id: 0x13)
[   11.917879] tg3 0000:02:00.0 eno1: renamed from eth0
[   11.927140] ipmi_si IPI0001:00: IPMI kcs interface initialized
[   11.935608] IPMI SSIF Interface driver
[   11.946867] tg3 0000:02:00.2 eno3: renamed from eth2
[   11.973872] tg3 0000:02:00.3 eno4: renamed from eth3
[   12.244229] Ethernet Channel Bonding Driver: v3.7.1 (April 27, 2011)
[   12.251673] bond1 (uninitialized): Setting MII monitoring interval to 1000
[   12.251674] bond1 (uninitialized): Setting resend_igmp to 1
[   12.265803] IPv6: ADDRCONF(NETDEV_UP): bond1: link is not ready
[   12.411895] pps pps0: new PPS source ptp8
[   12.416507] ixgbe 0000:04:00.1: registered PHC device on eno50
[   12.556817] IPv6: ADDRCONF(NETDEV_UP): eno50: link is not ready
[   12.710227] pps pps1: new PPS source ptp9
[   12.714836] ixgbe 0000:04:00.0: registered PHC device on eno49
[   12.855139] IPv6: ADDRCONF(NETDEV_UP): eno49: link is not ready
[   12.974244] bond1: Enslaving ens6f3 as a backup interface with a down link
[   13.095131] IPv6: ADDRCONF(NETDEV_UP): ens6f2: link is not ready
[   13.165968] EXT4-fs (sdb): recovery complete
[   13.170914] EXT4-fs (sdb): mounted filesystem with ordered data mode. Opts: (null)
[   13.297904] bond1: Enslaving ens6f1 as a backup interface with a down link
[   13.322979] EXT4-fs (sdc): recovery complete
[   13.327937] EXT4-fs (sdc): mounted filesystem with ordered data mode. Opts: (null)
[   13.417522] IPv6: ADDRCONF(NETDEV_UP): ens6f0: link is not ready
[   13.472357] EXT4-fs (sdd): recovery complete
[   13.477343] EXT4-fs (sdd): mounted filesystem with ordered data mode. Opts: (null)
[   13.544911] IPv6: ADDRCONF(NETDEV_UP): eno4: link is not ready
[   13.622459] EXT4-fs (sde): recovery complete
[   13.627439] EXT4-fs (sde): mounted filesystem with ordered data mode. Opts: (null)
[   13.672077] bond1: Enslaving eno3 as a backup interface with a down link
[   13.679971] EXT4-fs (sdf): recovery complete
[   13.684946] EXT4-fs (sdf): mounted filesystem with ordered data mode. Opts: (null)
[   13.777284] EXT4-fs (sdg): recovery complete
[   13.782267] EXT4-fs (sdg): mounted filesystem with ordered data mode. Opts: (null)
[   13.799727] IPv6: ADDRCONF(NETDEV_UP): eno2: link is not ready
[   13.890977] EXT4-fs (sdh): recovery complete
[   13.896095] EXT4-fs (sdh): mounted filesystem with ordered data mode. Opts: (null)
[   13.927760] bond1: Enslaving eno1 as a backup interface with a down link
[   13.964489] EXT4-fs (sdi): recovery complete
[   13.969527] EXT4-fs (sdi): mounted filesystem with ordered data mode. Opts: (null)
[   14.121271] EXT4-fs (sdj): recovery complete
[   14.126332] EXT4-fs (sdj): mounted filesystem with ordered data mode. Opts: (null)
[   14.283652] EXT4-fs (sdk): recovery complete
[   14.288736] EXT4-fs (sdk): mounted filesystem with ordered data mode. Opts: (null)
[   16.419395] igb 0000:81:00.3 ens6f3: igb: ens6f3 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX
[   16.570407] igb 0000:81:00.2 ens6f2: igb: ens6f2 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX
[   16.581211] IPv6: ADDRCONF(NETDEV_CHANGE): ens6f2: link becomes ready
[   16.947464] igb 0000:81:00.1 ens6f1: igb: ens6f1 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX
[   17.365128] bond1: link status definitely up for interface ens6f3, 1000 Mbps full duplex
[   17.374117] bond1: making interface ens6f3 the new active one
[   17.380746] bond1: first active interface up!
[   17.385596] bond1: link status definitely up for interface ens6f1, 1000 Mbps full duplex
[   17.394715] IPv6: ADDRCONF(NETDEV_CHANGE): bond1: link becomes ready
[   37.959643] hpsa 0000:08:00.0: Acknowledging event: 0xc0000000 (HP SSD Smart Path configuration change)
[   38.018204] hpsa 0000:08:00.0: scsi 0:1:0:0: updated Direct-Access     HP       LOGICAL VOLUME   RAID-1(+0) SSDSmartPathCap+ En+ Exp=1
[   38.031569] hpsa 0000:08:00.0: scsi 0:1:0:1: updated Direct-Access     HP       LOGICAL VOLUME   RAID-0 SSDSmartPathCap+ En+ Exp=1
[   38.044687] hpsa 0000:08:00.0: scsi 0:1:0:2: updated Direct-Access     HP       LOGICAL VOLUME   RAID-0 SSDSmartPathCap+ En+ Exp=1
[   38.057943] hpsa 0000:08:00.0: scsi 0:1:0:3: updated Direct-Access     HP       LOGICAL VOLUME   RAID-0 SSDSmartPathCap+ En+ Exp=1
[   38.071204] hpsa 0000:08:00.0: scsi 0:1:0:4: updated Direct-Access     HP       LOGICAL VOLUME   RAID-0 SSDSmartPathCap+ En+ Exp=1
[   38.084455] hpsa 0000:08:00.0: scsi 0:1:0:5: updated Direct-Access     HP       LOGICAL VOLUME   RAID-0 SSDSmartPathCap+ En+ Exp=1
[   38.097704] hpsa 0000:08:00.0: scsi 0:1:0:6: updated Direct-Access     HP       LOGICAL VOLUME   RAID-0 SSDSmartPathCap+ En+ Exp=1
[   38.110953] hpsa 0000:08:00.0: scsi 0:1:0:7: updated Direct-Access     HP       LOGICAL VOLUME   RAID-0 SSDSmartPathCap+ En+ Exp=1
[   38.124271] hpsa 0000:08:00.0: scsi 0:1:0:8: updated Direct-Access     HP       LOGICAL VOLUME   RAID-0 SSDSmartPathCap+ En+ Exp=1
[   38.137523] hpsa 0000:08:00.0: scsi 0:1:0:9: updated Direct-Access     HP       LOGICAL VOLUME   RAID-0 SSDSmartPathCap+ En+ Exp=1
[   38.150771] hpsa 0000:08:00.0: scsi 0:1:0:10: updated Direct-Access     HP       LOGICAL VOLUME   RAID-0 SSDSmartPathCap+ En+ Exp=1
[   39.285572] nf_conntrack version 0.5.0 (65536 buckets, 262144 max)
[   39.834556] bridge: filtering via arp/ip/ip6tables is no longer available by default. Update your scripts to load br_netfilter if you need this.
[   39.850385] Bridge firewalling registered
[   39.895052] Initializing XFRM netlink socket
[   39.920473] IPv6: ADDRCONF(NETDEV_UP): docker0: link is not ready
[   40.475860] docker0: port 1(veth616b696) entered blocking state
[   40.482445] docker0: port 1(veth616b696) entered disabled state
[   40.489121] device veth616b696 entered promiscuous mode
[   40.495424] IPv6: ADDRCONF(NETDEV_UP): veth616b696: link is not ready
[   40.502738] docker0: port 1(veth616b696) entered blocking state
[   40.509456] docker0: port 1(veth616b696) entered forwarding state
[   40.516531] docker0: port 1(veth616b696) entered disabled state
[   40.562760] SELinux: mount invalid.  Same superblock, different security settings for (dev mqueue, type mqueue)
[   40.603627] eth0: renamed from vethca7f846
[   40.618590] IPv6: ADDRCONF(NETDEV_CHANGE): veth616b696: link becomes ready
[   40.626412] docker0: port 1(veth616b696) entered blocking state
[   40.633135] docker0: port 1(veth616b696) entered forwarding state
[   40.640142] IPv6: ADDRCONF(NETDEV_CHANGE): docker0: link becomes ready

@bgilbert
Copy link
Contributor

Are you still seeing this on current versions of Container Linux?

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees
No one assigned
Labels
area/stability component/kernel kind/bug kind/support needs/more-information team/os
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@bgilbert @x86brandon