Scott Cheloha <scottchel...@gmail.com> writes:
> Hi,
>
> Once again, I am trying to change our approach to TSC sync testing to
> eliminate false positive results. Instead of trying to repair the TSC
> by measuring skew, we just spin in a lockless loop looking for skew
> and mark the TSC as broken if we detect any.
>
> This is motivated in part by some multisocket machines that do not use
> the TSC as a timecounter because the current sync test confuses NUMA
> latency for TSC skew.
>
> The only difference between this version and the prior version (v2) is
> that we check whether we have the IA32_TSC_ADJUST register by hand in
> tsc_reset_adjust(). If someone wants to help me rearrange cpu_hatch()
> so we do CPU identification before TSC sync testing we can remove the
> workaround later.
>
> If you have the IA32_TSC_ADJUST register and it is non-zero going into
> the test, you will see something on the console like this:
>
> tsc: cpu5: IA32_TSC_ADJUST: -150 -> 0
>
> This does *not* mean you failed the test. It just means you probably
> have a bug in your BIOS (or some other firmware) and you should report
> it to your vendor.
>
> If you fail the test you will see something like this:
>
> tsc: cpu0/cpu2: sync test round 1/2 failed
> tsc: cpu0/cpu2: cpu2: 13043 lags 438 cycles
>
> A printout like this would mean that the sync test for cpu2 failed.
> In particular, cpu2's TSC trails cpu0's TSC by at least 438 cycles.
> If this happens for *any* CPU we mark the TSC timecounter as
> defective.
I think this passes now on my dual-socket Xeon box?
Full dmesg at the end of the email[1], but just the `tsc:' lines look
like:
$ grep tsc dmesg.txt
tsc: cpu0: IA32_TSC_ADJUST: -5774382067215574 -> 0
tsc: cpu1: IA32_TSC_ADJUST: -5774382076335870 -> 0
tsc: cpu2: IA32_TSC_ADJUST: -5774382073829798 -> 0
tsc: cpu3: IA32_TSC_ADJUST: -5774382071913818 -> 0
tsc: cpu4: IA32_TSC_ADJUST: -5774382075956770 -> 0
tsc: cpu5: IA32_TSC_ADJUST: -5774382074583181 -> 0
tsc: cpu6: IA32_TSC_ADJUST: -5774382073199574 -> 0
tsc: cpu7: IA32_TSC_ADJUST: -5774382076500135 -> 0
tsc: cpu8: IA32_TSC_ADJUST: -5774382074705354 -> 0
tsc: cpu9: IA32_TSC_ADJUST: -5774382075954945 -> 0
tsc: cpu10: IA32_TSC_ADJUST: -5774382070567294 -> 0
tsc: cpu11: IA32_TSC_ADJUST: -5774382075968443 -> 0
tsc: cpu12: IA32_TSC_ADJUST: -5774382067353478 -> 0
tsc: cpu13: IA32_TSC_ADJUST: -5774382071926523 -> 0
tsc: cpu14: IA32_TSC_ADJUST: -5774382074619890 -> 0
tsc: cpu15: IA32_TSC_ADJUST: -5774382070107058 -> 0
tsc: cpu16: IA32_TSC_ADJUST: -5774382076196640 -> 0
tsc: cpu17: IA32_TSC_ADJUST: -5774382075090665 -> 0
tsc: cpu18: IA32_TSC_ADJUST: -5774382073529646 -> 0
tsc: cpu19: IA32_TSC_ADJUST: -5774382076443616 -> 0
tsc: cpu20: IA32_TSC_ADJUST: -5774382074994536 -> 0
tsc: cpu21: IA32_TSC_ADJUST: -5774382076309520 -> 0
tsc: cpu22: IA32_TSC_ADJUST: -5774382070947686 -> 0
tsc: cpu23: IA32_TSC_ADJUST: -5774382073056320 -> 0
It does look like there's a newer BIOS version for this machine, so I'll
try updating it later today and repeating the test to see if anything
changes.
-dv
[1]
OpenBSD 7.1-current (GENERIC.MP) #6: Tue Jul 5 07:07:34 EDT 2022
d...@minmin.sisu.home:/usr/src/sys/arch/amd64/compile/GENERIC.MP
real mem = 85769121792 (81795MB)
avail mem = 83152367616 (79300MB)
random: good seed from bootblocks
mpath0 at root
scsibus0 at mpath0: 256 targets
mainbus0 at root
bios0 at mainbus0: SMBIOS rev. 2.8 @ 0xec0f0 (105 entries)
bios0: vendor Dell Inc. version "A32" date 09/25/2019
bios0: Dell Inc. Precision Tower 7810
acpi0 at bios0: ACPI 5.0
acpi0: sleep states S0 S3 S4 S5
acpi0: tables DSDT FACP APIC FPDT FIDT MCFG UEFI HPET MSCT SLIT SRAT SRAT WDDT
SSDT NITR SLIC MSDM DMAR ASF!
acpi0: wakeup devices IP2P(S3) RP01(S4) RP02(S4) RP03(S4) RP04(S4) RP06(S4)
RP07(S4) RP08(S4) BR1A(S4) BR1B(S4) BR2A(S4) BR2B(S4) BR2C(S4) BR2D(S4)
BR3A(S4) BR3B(S4) [...]
acpitimer0 at acpi0: 3579545 Hz, 24 bits
acpimadt0 at acpi0 addr 0xfee00000: PC-AT compat
cpu0 at mainbus0: apid 0 (boot processor)
cpu0: Intel(R) Xeon(R) CPU E5-2643 v3 @ 3.40GHz, 3392.65 MHz, 06-3f-02
cpu0:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,PERF,ITSC,FSGSBASE,TSC_ADJUST,BMI1,AVX2,SMEP,BMI2,ERMS,INVPCID,PQM,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
cpu0: 32KB 64b/line 8-way D-cache, 32KB 64b/line 8-way I-cache, 256KB 64b/line
8-way L2 cache, 20MB 64b/line 20-way L3 cache
cpu0: smt 0, core 0, package 0
mtrr: Pentium Pro MTRR support, 10 var ranges, 88 fixed ranges
cpu0: apic clock running at 99MHz
cpu0: mwait min=64, max=64, C-substates=0.2.1.2, IBE
cpu1 at mainbus0: apid 2 (application processor)
tsc: cpu0: IA32_TSC_ADJUST: -5774382067215574 -> 0
tsc: cpu1: IA32_TSC_ADJUST: -5774382076335870 -> 0
cpu1: Intel(R) Xeon(R) CPU E5-2643 v3 @ 3.40GHz, 3392.16 MHz, 06-3f-02
cpu1:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,PERF,ITSC,FSGSBASE,TSC_ADJUST,BMI1,AVX2,SMEP,BMI2,ERMS,INVPCID,PQM,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
cpu1: 32KB 64b/line 8-way D-cache, 32KB 64b/line 8-way I-cache, 256KB 64b/line
8-way L2 cache, 20MB 64b/line 20-way L3 cache
cpu1: smt 0, core 1, package 0
cpu2 at mainbus0: apid 4 (application processor)
tsc: cpu2: IA32_TSC_ADJUST: -5774382073829798 -> 0
cpu2: Intel(R) Xeon(R) CPU E5-2643 v3 @ 3.40GHz, 3392.16 MHz, 06-3f-02
cpu2:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,PERF,ITSC,FSGSBASE,TSC_ADJUST,BMI1,AVX2,SMEP,BMI2,ERMS,INVPCID,PQM,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
cpu2: 32KB 64b/line 8-way D-cache, 32KB 64b/line 8-way I-cache, 256KB 64b/line
8-way L2 cache, 20MB 64b/line 20-way L3 cache
cpu2: smt 0, core 2, package 0
cpu3 at mainbus0: apid 6 (application processor)
tsc: cpu3: IA32_TSC_ADJUST: -5774382071913818 -> 0
cpu3: Intel(R) Xeon(R) CPU E5-2643 v3 @ 3.40GHz, 3392.16 MHz, 06-3f-02
cpu3:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,PERF,ITSC,FSGSBASE,TSC_ADJUST,BMI1,AVX2,SMEP,BMI2,ERMS,INVPCID,PQM,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
cpu3: 32KB 64b/line 8-way D-cache, 32KB 64b/line 8-way I-cache, 256KB 64b/line
8-way L2 cache, 20MB 64b/line 20-way L3 cache
cpu3: smt 0, core 3, package 0
cpu4 at mainbus0: apid 8 (application processor)
tsc: cpu4: IA32_TSC_ADJUST: -5774382075956770 -> 0
cpu4: Intel(R) Xeon(R) CPU E5-2643 v3 @ 3.40GHz, 3392.16 MHz, 06-3f-02
cpu4:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,PERF,ITSC,FSGSBASE,TSC_ADJUST,BMI1,AVX2,SMEP,BMI2,ERMS,INVPCID,PQM,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
cpu4: 32KB 64b/line 8-way D-cache, 32KB 64b/line 8-way I-cache, 256KB 64b/line
8-way L2 cache, 20MB 64b/line 20-way L3 cache
cpu4: smt 0, core 4, package 0
cpu5 at mainbus0: apid 10 (application processor)
tsc: cpu5: IA32_TSC_ADJUST: -5774382074583181 -> 0
cpu5: Intel(R) Xeon(R) CPU E5-2643 v3 @ 3.40GHz, 3392.18 MHz, 06-3f-02
cpu5:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,PERF,ITSC,FSGSBASE,TSC_ADJUST,BMI1,AVX2,SMEP,BMI2,ERMS,INVPCID,PQM,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
cpu5: 32KB 64b/line 8-way D-cache, 32KB 64b/line 8-way I-cache, 256KB 64b/line
8-way L2 cache, 20MB 64b/line 20-way L3 cache
cpu5: smt 0, core 5, package 0
cpu6 at mainbus0: apid 16 (application processor)
tsc: cpu6: IA32_TSC_ADJUST: -5774382073199574 -> 0
cpu6: Intel(R) Xeon(R) CPU E5-2643 v3 @ 3.40GHz, 3387.09 MHz, 06-3f-02
cpu6:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,PERF,ITSC,FSGSBASE,TSC_ADJUST,BMI1,AVX2,SMEP,BMI2,ERMS,INVPCID,PQM,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
cpu6: 32KB 64b/line 8-way D-cache, 32KB 64b/line 8-way I-cache, 256KB 64b/line
8-way L2 cache, 20MB 64b/line 20-way L3 cache
cpu6: smt 0, core 0, package 1
cpu7 at mainbus0: apid 18 (application processor)
tsc: cpu7: IA32_TSC_ADJUST: -5774382076500135 -> 0
cpu7: Intel(R) Xeon(R) CPU E5-2643 v3 @ 3.40GHz, 3389.78 MHz, 06-3f-02
cpu7:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,PERF,ITSC,FSGSBASE,TSC_ADJUST,BMI1,AVX2,SMEP,BMI2,ERMS,INVPCID,PQM,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
cpu7: 32KB 64b/line 8-way D-cache, 32KB 64b/line 8-way I-cache, 256KB 64b/line
8-way L2 cache, 20MB 64b/line 20-way L3 cache
cpu7: smt 0, core 1, package 1
cpu8 at mainbus0: apid 20 (application processor)
tsc: cpu8: IA32_TSC_ADJUST: -5774382074705354 -> 0
cpu8: Intel(R) Xeon(R) CPU E5-2643 v3 @ 3.40GHz, 3392.16 MHz, 06-3f-02
cpu8:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,PERF,ITSC,FSGSBASE,TSC_ADJUST,BMI1,AVX2,SMEP,BMI2,ERMS,INVPCID,PQM,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
cpu8: 32KB 64b/line 8-way D-cache, 32KB 64b/line 8-way I-cache, 256KB 64b/line
8-way L2 cache, 20MB 64b/line 20-way L3 cache
cpu8: smt 0, core 2, package 1
cpu9 at mainbus0: apid 22 (application processor)
tsc: cpu9: IA32_TSC_ADJUST: -5774382075954945 -> 0
cpu9: Intel(R) Xeon(R) CPU E5-2643 v3 @ 3.40GHz, 3392.16 MHz, 06-3f-02
cpu9:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,PERF,ITSC,FSGSBASE,TSC_ADJUST,BMI1,AVX2,SMEP,BMI2,ERMS,INVPCID,PQM,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
cpu9: 32KB 64b/line 8-way D-cache, 32KB 64b/line 8-way I-cache, 256KB 64b/line
8-way L2 cache, 20MB 64b/line 20-way L3 cache
cpu9: smt 0, core 3, package 1
cpu10 at mainbus0: apid 24 (application processor)
tsc: cpu10: IA32_TSC_ADJUST: -5774382070567294 -> 0
cpu10: Intel(R) Xeon(R) CPU E5-2643 v3 @ 3.40GHz, 3392.16 MHz, 06-3f-02
cpu10:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,PERF,ITSC,FSGSBASE,TSC_ADJUST,BMI1,AVX2,SMEP,BMI2,ERMS,INVPCID,PQM,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
cpu10: 32KB 64b/line 8-way D-cache, 32KB 64b/line 8-way I-cache, 256KB 64b/line
8-way L2 cache, 20MB 64b/line 20-way L3 cache
cpu10: smt 0, core 4, package 1
cpu11 at mainbus0: apid 26 (application processor)
tsc: cpu11: IA32_TSC_ADJUST: -5774382075968443 -> 0
cpu11: Intel(R) Xeon(R) CPU E5-2643 v3 @ 3.40GHz, 3392.16 MHz, 06-3f-02
cpu11:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,PERF,ITSC,FSGSBASE,TSC_ADJUST,BMI1,AVX2,SMEP,BMI2,ERMS,INVPCID,PQM,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
cpu11: 32KB 64b/line 8-way D-cache, 32KB 64b/line 8-way I-cache, 256KB 64b/line
8-way L2 cache, 20MB 64b/line 20-way L3 cache
cpu11: smt 0, core 5, package 1
cpu12 at mainbus0: apid 1 (application processor)
tsc: cpu12: IA32_TSC_ADJUST: -5774382067353478 -> 0
cpu12: Intel(R) Xeon(R) CPU E5-2643 v3 @ 3.40GHz, 3392.15 MHz, 06-3f-02
cpu12:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,PERF,ITSC,FSGSBASE,TSC_ADJUST,BMI1,AVX2,SMEP,BMI2,ERMS,INVPCID,PQM,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
cpu12: 32KB 64b/line 8-way D-cache, 32KB 64b/line 8-way I-cache, 256KB 64b/line
8-way L2 cache, 20MB 64b/line 20-way L3 cache
cpu12: smt 1, core 0, package 0
cpu13 at mainbus0: apid 3 (application processor)
tsc: cpu13: IA32_TSC_ADJUST: -5774382071926523 -> 0
cpu13: Intel(R) Xeon(R) CPU E5-2643 v3 @ 3.40GHz, 3392.15 MHz, 06-3f-02
cpu13:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,PERF,ITSC,FSGSBASE,TSC_ADJUST,BMI1,AVX2,SMEP,BMI2,ERMS,INVPCID,PQM,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
cpu13: 32KB 64b/line 8-way D-cache, 32KB 64b/line 8-way I-cache, 256KB 64b/line
8-way L2 cache, 20MB 64b/line 20-way L3 cache
cpu13: smt 1, core 1, package 0
cpu14 at mainbus0: apid 5 (application processor)
tsc: cpu14: IA32_TSC_ADJUST: -5774382074619890 -> 0
cpu14: Intel(R) Xeon(R) CPU E5-2643 v3 @ 3.40GHz, 3392.15 MHz, 06-3f-02
cpu14:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,PERF,ITSC,FSGSBASE,TSC_ADJUST,BMI1,AVX2,SMEP,BMI2,ERMS,INVPCID,PQM,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
cpu14: 32KB 64b/line 8-way D-cache, 32KB 64b/line 8-way I-cache, 256KB 64b/line
8-way L2 cache, 20MB 64b/line 20-way L3 cache
cpu14: smt 1, core 2, package 0
cpu15 at mainbus0: apid 7 (application processor)
tsc: cpu15: IA32_TSC_ADJUST: -5774382070107058 -> 0
cpu15: Intel(R) Xeon(R) CPU E5-2643 v3 @ 3.40GHz, 3392.15 MHz, 06-3f-02
cpu15:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,PERF,ITSC,FSGSBASE,TSC_ADJUST,BMI1,AVX2,SMEP,BMI2,ERMS,INVPCID,PQM,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
cpu15: 32KB 64b/line 8-way D-cache, 32KB 64b/line 8-way I-cache, 256KB 64b/line
8-way L2 cache, 20MB 64b/line 20-way L3 cache
cpu15: smt 1, core 3, package 0
cpu16 at mainbus0: apid 9 (application processor)
tsc: cpu16: IA32_TSC_ADJUST: -5774382076196640 -> 0
cpu16: Intel(R) Xeon(R) CPU E5-2643 v3 @ 3.40GHz, 3392.15 MHz, 06-3f-02
cpu16:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,PERF,ITSC,FSGSBASE,TSC_ADJUST,BMI1,AVX2,SMEP,BMI2,ERMS,INVPCID,PQM,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
cpu16: 32KB 64b/line 8-way D-cache, 32KB 64b/line 8-way I-cache, 256KB 64b/line
8-way L2 cache, 20MB 64b/line 20-way L3 cache
cpu16: smt 1, core 4, package 0
cpu17 at mainbus0: apid 11 (application processor)
tsc: cpu17: IA32_TSC_ADJUST: -5774382075090665 -> 0
cpu17: Intel(R) Xeon(R) CPU E5-2643 v3 @ 3.40GHz, 3392.15 MHz, 06-3f-02
cpu17:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,PERF,ITSC,FSGSBASE,TSC_ADJUST,BMI1,AVX2,SMEP,BMI2,ERMS,INVPCID,PQM,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
cpu17: 32KB 64b/line 8-way D-cache, 32KB 64b/line 8-way I-cache, 256KB 64b/line
8-way L2 cache, 20MB 64b/line 20-way L3 cache
cpu17: smt 1, core 5, package 0
cpu18 at mainbus0: apid 17 (application processor)
tsc: cpu18: IA32_TSC_ADJUST: -5774382073529646 -> 0
cpu18: Intel(R) Xeon(R) CPU E5-2643 v3 @ 3.40GHz, 3392.15 MHz, 06-3f-02
cpu18:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,PERF,ITSC,FSGSBASE,TSC_ADJUST,BMI1,AVX2,SMEP,BMI2,ERMS,INVPCID,PQM,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
cpu18: 32KB 64b/line 8-way D-cache, 32KB 64b/line 8-way I-cache, 256KB 64b/line
8-way L2 cache, 20MB 64b/line 20-way L3 cache
cpu18: smt 1, core 0, package 1
cpu19 at mainbus0: apid 19 (application processor)
tsc: cpu19: IA32_TSC_ADJUST: -5774382076443616 -> 0
cpu19: Intel(R) Xeon(R) CPU E5-2643 v3 @ 3.40GHz, 3392.15 MHz, 06-3f-02
cpu19:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,PERF,ITSC,FSGSBASE,TSC_ADJUST,BMI1,AVX2,SMEP,BMI2,ERMS,INVPCID,PQM,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
cpu19: 32KB 64b/line 8-way D-cache, 32KB 64b/line 8-way I-cache, 256KB 64b/line
8-way L2 cache, 20MB 64b/line 20-way L3 cache
cpu19: smt 1, core 1, package 1
cpu20 at mainbus0: apid 21 (application processor)
tsc: cpu20: IA32_TSC_ADJUST: -5774382074994536 -> 0
cpu20: Intel(R) Xeon(R) CPU E5-2643 v3 @ 3.40GHz, 3392.15 MHz, 06-3f-02
cpu20:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,PERF,ITSC,FSGSBASE,TSC_ADJUST,BMI1,AVX2,SMEP,BMI2,ERMS,INVPCID,PQM,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
cpu20: 32KB 64b/line 8-way D-cache, 32KB 64b/line 8-way I-cache, 256KB 64b/line
8-way L2 cache, 20MB 64b/line 20-way L3 cache
cpu20: smt 1, core 2, package 1
cpu21 at mainbus0: apid 23 (application processor)
tsc: cpu21: IA32_TSC_ADJUST: -5774382076309520 -> 0
cpu21: Intel(R) Xeon(R) CPU E5-2643 v3 @ 3.40GHz, 3392.15 MHz, 06-3f-02
cpu21:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,PERF,ITSC,FSGSBASE,TSC_ADJUST,BMI1,AVX2,SMEP,BMI2,ERMS,INVPCID,PQM,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
cpu21: 32KB 64b/line 8-way D-cache, 32KB 64b/line 8-way I-cache, 256KB 64b/line
8-way L2 cache, 20MB 64b/line 20-way L3 cache
cpu21: smt 1, core 3, package 1
cpu22 at mainbus0: apid 25 (application processor)
tsc: cpu22: IA32_TSC_ADJUST: -5774382070947686 -> 0
cpu22: Intel(R) Xeon(R) CPU E5-2643 v3 @ 3.40GHz, 3392.15 MHz, 06-3f-02
cpu22:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,PERF,ITSC,FSGSBASE,TSC_ADJUST,BMI1,AVX2,SMEP,BMI2,ERMS,INVPCID,PQM,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
cpu22: 32KB 64b/line 8-way D-cache, 32KB 64b/line 8-way I-cache, 256KB 64b/line
8-way L2 cache, 20MB 64b/line 20-way L3 cache
cpu22: smt 1, core 4, package 1
cpu23 at mainbus0: apid 27 (application processor)
tsc: cpu23: IA32_TSC_ADJUST: -5774382073056320 -> 0
cpu23: Intel(R) Xeon(R) CPU E5-2643 v3 @ 3.40GHz, 3392.15 MHz, 06-3f-02
cpu23:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,PERF,ITSC,FSGSBASE,TSC_ADJUST,BMI1,AVX2,SMEP,BMI2,ERMS,INVPCID,PQM,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
cpu23: 32KB 64b/line 8-way D-cache, 32KB 64b/line 8-way I-cache, 256KB 64b/line
8-way L2 cache, 20MB 64b/line 20-way L3 cache
cpu23: smt 1, core 5, package 1
ioapic0 at mainbus0: apid 1 pa 0xfec00000, version 20, 24 pins
ioapic1 at mainbus0: apid 2 pa 0xfec01000, version 20, 24 pins
ioapic2 at mainbus0: apid 3 pa 0xfec40000, version 20, 24 pins
acpimcfg0 at acpi0
acpimcfg0: addr 0xd0000000, bus 0-255
acpihpet0 at acpi0: 14318179 Hz
acpiprt0 at acpi0: bus 255 (UNC1)
acpiprt1 at acpi0: bus 223 (UNC0)
acpiprt2 at acpi0: bus 0 (PCI0)
acpiprt3 at acpi0: bus 9 (RP02)
acpiprt4 at acpi0: bus -1 (RP03)
acpiprt5 at acpi0: bus 1 (BR1A)
acpiprt6 at acpi0: bus 2 (BR1B)
acpiprt7 at acpi0: bus 3 (BR2A)
acpiprt8 at acpi0: bus -1 (BR2B)
acpiprt9 at acpi0: bus -1 (BR2C)
acpiprt10 at acpi0: bus -1 (BR2D)
acpiprt11 at acpi0: bus 4 (BR3A)
acpiprt12 at acpi0: bus -1 (BR3B)
acpiprt13 at acpi0: bus -1 (BR3C)
acpiprt14 at acpi0: bus -1 (BR3D)
acpiprt15 at acpi0: bus 11 (RP05)
acpiprt16 at acpi0: bus 224 (PCI1)
acpipci0 at acpi0 UNC1: 0x00000010 0x00000011 0x00000000
acpipci1 at acpi0 UNC0: 0x00000010 0x00000011 0x00000000
"ACPI0004" at acpi0 not configured
"ACPI0004" at acpi0 not configured
"ACPI0004" at acpi0 not configured
"ACPI0004" at acpi0 not configured
"PNP0C14" at acpi0 not configured
acpipci2 at acpi0 PCI0: 0x00000010 0x00000011 0x00000000
"PNP0003" at acpi0 not configured
"PNP0C14" at acpi0 not configured
acpicmos0 at acpi0
com0 at acpi0 UAR1 addr 0x3f8/0x8 irq 4: ns16550a, 16 byte fifo
acpipci3 at acpi0 PCI1: 0x00000010 0x00000011 0x00000000
acpibtn0 at acpi0: PWRB
"PNP0C14" at acpi0 not configured
"PNP0C14" at acpi0 not configured
acpicpu0 at acpi0: C2(350@41 mwait.3@0x20), C1(1016@1 mwait.1), PSS
acpicpu1 at acpi0: C2(350@41 mwait.3@0x20), C1(1016@1 mwait.1), PSS
acpicpu2 at acpi0: C2(350@41 mwait.3@0x20), C1(1016@1 mwait.1), PSS
acpicpu3 at acpi0: C2(350@41 mwait.3@0x20), C1(1016@1 mwait.1), PSS
acpicpu4 at acpi0: C2(350@41 mwait.3@0x20), C1(1016@1 mwait.1), PSS
acpicpu5 at acpi0: C2(350@41 mwait.3@0x20), C1(1016@1 mwait.1), PSS
acpicpu6 at acpi0: C2(350@41 mwait.3@0x20), C1(1016@1 mwait.1), PSS
acpicpu7 at acpi0: C2(350@41 mwait.3@0x20), C1(1016@1 mwait.1), PSS
acpicpu8 at acpi0: C2(350@41 mwait.3@0x20), C1(1016@1 mwait.1), PSS
acpicpu9 at acpi0: C2(350@41 mwait.3@0x20), C1(1016@1 mwait.1), PSS
acpicpu10 at acpi0: C2(350@41 mwait.3@0x20), C1(1016@1 mwait.1), PSS
acpicpu11 at acpi0: C2(350@41 mwait.3@0x20), C1(1016@1 mwait.1), PSS
acpicpu12 at acpi0: C2(350@41 mwait.3@0x20), C1(1016@1 mwait.1), PSS
acpicpu13 at acpi0: C2(350@41 mwait.3@0x20), C1(1016@1 mwait.1), PSS
acpicpu14 at acpi0: C2(350@41 mwait.3@0x20), C1(1016@1 mwait.1), PSS
acpicpu15 at acpi0: C2(350@41 mwait.3@0x20), C1(1016@1 mwait.1), PSS
acpicpu16 at acpi0: C2(350@41 mwait.3@0x20), C1(1016@1 mwait.1), PSS
acpicpu17 at acpi0: C2(350@41 mwait.3@0x20), C1(1016@1 mwait.1), PSS
acpicpu18 at acpi0: C2(350@41 mwait.3@0x20), C1(1016@1 mwait.1), PSS
acpicpu19 at acpi0: C2(350@41 mwait.3@0x20), C1(1016@1 mwait.1), PSS
acpicpu20 at acpi0: C2(350@41 mwait.3@0x20), C1(1016@1 mwait.1), PSS
acpicpu21 at acpi0: C2(350@41 mwait.3@0x20), C1(1016@1 mwait.1), PSS
acpicpu22 at acpi0: C2(350@41 mwait.3@0x20), C1(1016@1 mwait.1), PSS
acpicpu23 at acpi0: C2(350@41 mwait.3@0x20), C1(1016@1 mwait.1), PSS
cpu0: using VERW MDS workaround (except on vmm entry)
cpu0: Enhanced SpeedStep 3392 MHz: speeds: 3401, 3400, 3200, 3100, 2900, 2800,
2600, 2500, 2300, 2100, 2000, 1800, 1700, 1500, 1400, 1200 MHz
pci0 at mainbus0 bus 255
"Intel E5 v3 QPI" rev 0x02 at pci0 dev 8 function 0 not configured
"Intel E5 v3 QPI" rev 0x02 at pci0 dev 8 function 2 not configured
"Intel E5 v3 QPI" rev 0x02 at pci0 dev 8 function 3 not configured
"Intel E5 v3 QPI" rev 0x02 at pci0 dev 9 function 0 not configured
"Intel E5 v3 QPI" rev 0x02 at pci0 dev 9 function 2 not configured
"Intel E5 v3 QPI" rev 0x02 at pci0 dev 9 function 3 not configured
"Intel E5 v3 QPI Monitor" rev 0x02 at pci0 dev 11 function 0 not configured
"Intel E5 v3 QPI Monitor" rev 0x02 at pci0 dev 11 function 1 not configured
"Intel E5 v3 QPI Monitor" rev 0x02 at pci0 dev 11 function 2 not configured
"Intel E5 v3 Unicast" rev 0x02 at pci0 dev 12 function 0 not configured
"Intel E5 v3 Unicast" rev 0x02 at pci0 dev 12 function 1 not configured
"Intel E5 v3 Unicast" rev 0x02 at pci0 dev 12 function 2 not configured
"Intel E5 v3 Unicast" rev 0x02 at pci0 dev 12 function 3 not configured
"Intel E5 v3 Unicast" rev 0x02 at pci0 dev 12 function 4 not configured
"Intel E5 v3 Unicast" rev 0x02 at pci0 dev 12 function 5 not configured
"Intel E5 v3 Unicast" rev 0x02 at pci0 dev 12 function 6 not configured
"Intel E5 v3 Unicast" rev 0x02 at pci0 dev 12 function 7 not configured
"Intel E5 v3 Ring Agent" rev 0x02 at pci0 dev 15 function 0 not configured
"Intel E5 v3 Ring Agent" rev 0x02 at pci0 dev 15 function 1 not configured
"Intel E5 v3 SAD" rev 0x02 at pci0 dev 15 function 4 not configured
"Intel E5 v3 SAD" rev 0x02 at pci0 dev 15 function 5 not configured
"Intel E5 v3 SAD" rev 0x02 at pci0 dev 15 function 6 not configured
"Intel E5 v3 PCIE Ring" rev 0x02 at pci0 dev 16 function 0 not configured
"Intel E5 v3 PCIE Monitor" rev 0x02 at pci0 dev 16 function 1 not configured
"Intel E5 v3 Scratch" rev 0x02 at pci0 dev 16 function 5 not configured
"Intel E5 v3 Scratch" rev 0x02 at pci0 dev 16 function 6 not configured
"Intel E5 v3 Scratch" rev 0x02 at pci0 dev 16 function 7 not configured
"Intel E5 v3 Home Agent" rev 0x02 at pci0 dev 18 function 0 not configured
"Intel E5 v3 Home Agent" rev 0x02 at pci0 dev 18 function 1 not configured
"Intel E5 v3 Memory" rev 0x02 at pci0 dev 19 function 0 not configured
"Intel E5 v3 RAS" rev 0x02 at pci0 dev 19 function 1 not configured
"Intel E5 v3 TAD" rev 0x02 at pci0 dev 19 function 2 not configured
"Intel E5 v3 TAD" rev 0x02 at pci0 dev 19 function 3 not configured
"Intel E5 v3 TAD" rev 0x02 at pci0 dev 19 function 4 not configured
"Intel E5 v3 TAD" rev 0x02 at pci0 dev 19 function 5 not configured
"Intel E5 v3 DDR Broadcast" rev 0x02 at pci0 dev 19 function 6 not configured
"Intel E5 v3 DDR Broadcast" rev 0x02 at pci0 dev 19 function 7 not configured
"Intel E5 v3 Thermal" rev 0x02 at pci0 dev 20 function 0 not configured
"Intel E5 v3 Thermal" rev 0x02 at pci0 dev 20 function 1 not configured
"Intel E5 v3 Error" rev 0x02 at pci0 dev 20 function 2 not configured
"Intel E5 v3 Error" rev 0x02 at pci0 dev 20 function 3 not configured
"Intel E5 v3 DDRIO" rev 0x02 at pci0 dev 20 function 4 not configured
"Intel E5 v3 DDRIO" rev 0x02 at pci0 dev 20 function 5 not configured
"Intel E5 v3 DDRIO" rev 0x02 at pci0 dev 20 function 6 not configured
"Intel E5 v3 DDRIO" rev 0x02 at pci0 dev 20 function 7 not configured
"Intel E5 v3 Thermal" rev 0x02 at pci0 dev 21 function 0 not configured
"Intel E5 v3 Thermal" rev 0x02 at pci0 dev 21 function 1 not configured
"Intel E5 v3 Error" rev 0x02 at pci0 dev 21 function 2 not configured
"Intel E5 v3 Error" rev 0x02 at pci0 dev 21 function 3 not configured
"Intel E5 v3 TA" rev 0x02 at pci0 dev 22 function 0 not configured
"Intel E5 v3 DDR Broadcast" rev 0x02 at pci0 dev 22 function 6 not configured
"Intel E5 v3 DDR Broadcast" rev 0x02 at pci0 dev 22 function 7 not configured
"Intel E5 v3 Thermal" rev 0x02 at pci0 dev 23 function 0 not configured
"Intel E5 v3 DDRIO" rev 0x02 at pci0 dev 23 function 4 not configured
"Intel E5 v3 DDRIO" rev 0x02 at pci0 dev 23 function 5 not configured
"Intel E5 v3 DDRIO" rev 0x02 at pci0 dev 23 function 6 not configured
"Intel E5 v3 DDRIO" rev 0x02 at pci0 dev 23 function 7 not configured
"Intel E5 v3 PCU" rev 0x02 at pci0 dev 30 function 0 not configured
"Intel E5 v3 PCU" rev 0x02 at pci0 dev 30 function 1 not configured
"Intel E5 v3 PCU" rev 0x02 at pci0 dev 30 function 2 not configured
"Intel E5 v3 PCU" rev 0x02 at pci0 dev 30 function 3 not configured
"Intel E5 v3 PCU" rev 0x02 at pci0 dev 30 function 4 not configured
"Intel E5 v3 VCU" rev 0x02 at pci0 dev 31 function 0 not configured
"Intel E5 v3 VCU" rev 0x02 at pci0 dev 31 function 2 not configured
pci1 at mainbus0 bus 223
"Intel E5 v3 QPI" rev 0x02 at pci1 dev 8 function 0 not configured
"Intel E5 v3 QPI" rev 0x02 at pci1 dev 8 function 2 not configured
"Intel E5 v3 QPI" rev 0x02 at pci1 dev 8 function 3 not configured
"Intel E5 v3 QPI" rev 0x02 at pci1 dev 9 function 0 not configured
"Intel E5 v3 QPI" rev 0x02 at pci1 dev 9 function 2 not configured
"Intel E5 v3 QPI" rev 0x02 at pci1 dev 9 function 3 not configured
"Intel E5 v3 QPI Monitor" rev 0x02 at pci1 dev 11 function 0 not configured
"Intel E5 v3 QPI Monitor" rev 0x02 at pci1 dev 11 function 1 not configured
"Intel E5 v3 QPI Monitor" rev 0x02 at pci1 dev 11 function 2 not configured
"Intel E5 v3 Unicast" rev 0x02 at pci1 dev 12 function 0 not configured
"Intel E5 v3 Unicast" rev 0x02 at pci1 dev 12 function 1 not configured
"Intel E5 v3 Unicast" rev 0x02 at pci1 dev 12 function 2 not configured
"Intel E5 v3 Unicast" rev 0x02 at pci1 dev 12 function 3 not configured
"Intel E5 v3 Unicast" rev 0x02 at pci1 dev 12 function 4 not configured
"Intel E5 v3 Unicast" rev 0x02 at pci1 dev 12 function 5 not configured
"Intel E5 v3 Unicast" rev 0x02 at pci1 dev 12 function 6 not configured
"Intel E5 v3 Unicast" rev 0x02 at pci1 dev 12 function 7 not configured
"Intel E5 v3 Ring Agent" rev 0x02 at pci1 dev 15 function 0 not configured
"Intel E5 v3 Ring Agent" rev 0x02 at pci1 dev 15 function 1 not configured
"Intel E5 v3 SAD" rev 0x02 at pci1 dev 15 function 4 not configured
"Intel E5 v3 SAD" rev 0x02 at pci1 dev 15 function 5 not configured
"Intel E5 v3 SAD" rev 0x02 at pci1 dev 15 function 6 not configured
"Intel E5 v3 PCIE Ring" rev 0x02 at pci1 dev 16 function 0 not configured
"Intel E5 v3 PCIE Monitor" rev 0x02 at pci1 dev 16 function 1 not configured
"Intel E5 v3 Scratch" rev 0x02 at pci1 dev 16 function 5 not configured
"Intel E5 v3 Scratch" rev 0x02 at pci1 dev 16 function 6 not configured
"Intel E5 v3 Scratch" rev 0x02 at pci1 dev 16 function 7 not configured
"Intel E5 v3 Home Agent" rev 0x02 at pci1 dev 18 function 0 not configured
"Intel E5 v3 Home Agent" rev 0x02 at pci1 dev 18 function 1 not configured
"Intel E5 v3 Memory" rev 0x02 at pci1 dev 19 function 0 not configured
"Intel E5 v3 RAS" rev 0x02 at pci1 dev 19 function 1 not configured
"Intel E5 v3 TAD" rev 0x02 at pci1 dev 19 function 2 not configured
"Intel E5 v3 TAD" rev 0x02 at pci1 dev 19 function 3 not configured
"Intel E5 v3 TAD" rev 0x02 at pci1 dev 19 function 4 not configured
"Intel E5 v3 TAD" rev 0x02 at pci1 dev 19 function 5 not configured
"Intel E5 v3 DDR Broadcast" rev 0x02 at pci1 dev 19 function 6 not configured
"Intel E5 v3 DDR Broadcast" rev 0x02 at pci1 dev 19 function 7 not configured
"Intel E5 v3 Thermal" rev 0x02 at pci1 dev 20 function 0 not configured
"Intel E5 v3 Thermal" rev 0x02 at pci1 dev 20 function 1 not configured
"Intel E5 v3 Error" rev 0x02 at pci1 dev 20 function 2 not configured
"Intel E5 v3 Error" rev 0x02 at pci1 dev 20 function 3 not configured
"Intel E5 v3 DDRIO" rev 0x02 at pci1 dev 20 function 4 not configured
"Intel E5 v3 DDRIO" rev 0x02 at pci1 dev 20 function 5 not configured
"Intel E5 v3 DDRIO" rev 0x02 at pci1 dev 20 function 6 not configured
"Intel E5 v3 DDRIO" rev 0x02 at pci1 dev 20 function 7 not configured
"Intel E5 v3 Thermal" rev 0x02 at pci1 dev 21 function 0 not configured
"Intel E5 v3 Thermal" rev 0x02 at pci1 dev 21 function 1 not configured
"Intel E5 v3 Error" rev 0x02 at pci1 dev 21 function 2 not configured
"Intel E5 v3 Error" rev 0x02 at pci1 dev 21 function 3 not configured
"Intel E5 v3 TA" rev 0x02 at pci1 dev 22 function 0 not configured
"Intel E5 v3 DDR Broadcast" rev 0x02 at pci1 dev 22 function 6 not configured
"Intel E5 v3 DDR Broadcast" rev 0x02 at pci1 dev 22 function 7 not configured
"Intel E5 v3 Thermal" rev 0x02 at pci1 dev 23 function 0 not configured
"Intel E5 v3 DDRIO" rev 0x02 at pci1 dev 23 function 4 not configured
"Intel E5 v3 DDRIO" rev 0x02 at pci1 dev 23 function 5 not configured
"Intel E5 v3 DDRIO" rev 0x02 at pci1 dev 23 function 6 not configured
"Intel E5 v3 DDRIO" rev 0x02 at pci1 dev 23 function 7 not configured
"Intel E5 v3 PCU" rev 0x02 at pci1 dev 30 function 0 not configured
"Intel E5 v3 PCU" rev 0x02 at pci1 dev 30 function 1 not configured
"Intel E5 v3 PCU" rev 0x02 at pci1 dev 30 function 2 not configured
"Intel E5 v3 PCU" rev 0x02 at pci1 dev 30 function 3 not configured
"Intel E5 v3 PCU" rev 0x02 at pci1 dev 30 function 4 not configured
"Intel E5 v3 VCU" rev 0x02 at pci1 dev 31 function 0 not configured
"Intel E5 v3 VCU" rev 0x02 at pci1 dev 31 function 2 not configured
pci2 at mainbus0 bus 0
pchb0 at pci2 dev 0 function 0 "Intel E5 v3 Host" rev 0x02
ppb0 at pci2 dev 1 function 0 "Intel E5 v3 PCIE" rev 0x02: msi
pci3 at ppb0 bus 1
ppb1 at pci2 dev 1 function 1 "Intel E5 v3 PCIE" rev 0x02: msi
pci4 at ppb1 bus 2
nvme0 at pci4 dev 0 function 0 "Samsung SM961/PM961 NVMe" rev 0x00: msix, NVMe
1.2
nvme0: Samsung SSD 960 PRO 512GB, firmware 2B6QCXP7, serial S3EWNX0J512049D
scsibus1 at nvme0: 2 targets, initiator 0
sd0 at scsibus1 targ 1 lun 0: <NVMe, Samsung SSD 960, 2B6Q>
sd0: 488386MB, 512 bytes/sector, 1000215216 sectors
ppb2 at pci2 dev 2 function 0 "Intel E5 v3 PCIE" rev 0x02: msi
pci5 at ppb2 bus 3
radeondrm0 at pci5 dev 0 function 0 "ATI Bonaire" rev 0x81
drm0 at radeondrm0
radeondrm0: msi
azalia0 at pci5 dev 0 function 1 vendor "ATI", unknown product 0xaac0 rev 0x00:
msi
azalia0: no supported codecs
ppb3 at pci2 dev 3 function 0 "Intel E5 v3 PCIE" rev 0x02: msi
pci6 at ppb3 bus 4
ppb4 at pci6 dev 0 function 0 vendor "PLX", unknown product 0x8718 rev 0xab
pci7 at ppb4 bus 5
ppb5 at pci7 dev 1 function 0 vendor "PLX", unknown product 0x8718 rev 0xab: msi
pci8 at ppb5 bus 6
nvme1 at pci8 dev 0 function 0 "Samsung SM961/PM961 NVMe" rev 0x00: msix, NVMe
1.2
nvme1: SAMSUNG MZ1LW960HMJP-00003, firmware CXV8401Q, serial S2X6NB0JA00696
scsibus2 at nvme1: 2 targets, initiator 0
sd1 at scsibus2 targ 1 lun 0: <NVMe, SAMSUNG MZ1LW960, CXV8>
sd1: 915715MB, 512 bytes/sector, 1875385008 sectors
ppb6 at pci7 dev 2 function 0 vendor "PLX", unknown product 0x8718 rev 0xab: msi
pci9 at ppb6 bus 7
nvme2 at pci9 dev 0 function 0 "Samsung SM961/PM961 NVMe" rev 0x00: msix, NVMe
1.2
nvme2: SAMSUNG MZ1LW960HMJP-00003, firmware CXV8401Q, serial S2X6NB0JA00679
scsibus3 at nvme2: 2 targets, initiator 0
sd2 at scsibus3 targ 1 lun 0: <NVMe, SAMSUNG MZ1LW960, CXV8>
sd2: 915715MB, 512 bytes/sector, 1875385008 sectors
"Intel E5 v3 Address Map" rev 0x02 at pci2 dev 5 function 0 not configured
"Intel E5 v3 Hot Plug" rev 0x02 at pci2 dev 5 function 1 not configured
"Intel E5 v3 Error Reporting" rev 0x02 at pci2 dev 5 function 2 not configured
"Intel E5 v3 I/O APIC" rev 0x02 at pci2 dev 5 function 4 not configured
"Intel C610 MS SPSR" rev 0x05 at pci2 dev 17 function 0 not configured
ahci0 at pci2 dev 17 function 4 "Intel C610 AHCI" rev 0x05: msi, AHCI 1.3
ahci0: port 0: 1.5Gb/s
scsibus4 at ahci0: 32 targets
cd0 at scsibus4 targ 0 lun 0: <hp, BD MLT UJ260AF, FW06> removable
xhci0 at pci2 dev 20 function 0 "Intel C610 xHCI" rev 0x05: apic 1 int 19, xHCI
1.0
usb0 at xhci0: USB revision 3.0
uhub0 at usb0 configuration 1 interface 0 "Intel xHCI root hub" rev 3.00/1.00
addr 1
"Intel C610 MEI" rev 0x05 at pci2 dev 22 function 0 not configured
em0 at pci2 dev 25 function 0 "Intel I217-LM" rev 0x05: msi, address
98:90:96:dc:72:1b
ehci0 at pci2 dev 26 function 0 "Intel C610 USB" rev 0x05: apic 1 int 18
usb1 at ehci0: USB revision 2.0
uhub1 at usb1 configuration 1 interface 0 "Intel EHCI root hub" rev 2.00/1.00
addr 1
azalia1 at pci2 dev 27 function 0 "Intel C610 HD Audio" rev 0x05: msi
azalia1: codecs: Realtek ALC280
audio0 at azalia1
ppb7 at pci2 dev 28 function 0 "Intel C610 PCIE" rev 0xd5: msi
pci10 at ppb7 bus 8
ppb8 at pci2 dev 28 function 1 "Intel C610 PCIE" rev 0xd5: msi
pci11 at ppb8 bus 9
ppb9 at pci11 dev 0 function 0 "TI XIO2001 PCIE-PCI" rev 0x00
pci12 at ppb9 bus 10
ppb10 at pci2 dev 28 function 4 "Intel C610 PCIE" rev 0xd5: msi
pci13 at ppb10 bus 11
iwx0 at pci13 dev 0 function 0 "Intel Wi-Fi 6 AX200" rev 0x1a, msix
ehci1 at pci2 dev 29 function 0 "Intel C610 USB" rev 0x05: apic 1 int 18
usb2 at ehci1: USB revision 2.0
uhub2 at usb2 configuration 1 interface 0 "Intel EHCI root hub" rev 2.00/1.00
addr 1
pcib0 at pci2 dev 31 function 0 "Intel C610 LPC" rev 0x05
ahci1 at pci2 dev 31 function 2 "Intel C610 AHCI" rev 0x05: msi, AHCI 1.3
ahci1: port 0: 6.0Gb/s
scsibus5 at ahci1: 32 targets
sd3 at scsibus5 targ 0 lun 0: <ATA, WDC WD40PURX-64G, 80.0> naa.50014ee2b7c94ed4
sd3: 3815447MB, 512 bytes/sector, 7814037168 sectors
ichiic0 at pci2 dev 31 function 3 "Intel C610 SMBus" rev 0x05: apic 1 int 18
iic0 at ichiic0
isa0 at pcib0
isadma0 at isa0
pckbc0 at isa0 port 0x60/5 irq 1 irq 12
pckbd0 at pckbc0 (kbd slot)
wskbd0 at pckbd0: console keyboard
pcppi0 at isa0 port 0x61
spkr0 at pcppi0
pci14 at mainbus0 bus 224
"Intel E5 v3 Address Map" rev 0x02 at pci14 dev 5 function 0 not configured
"Intel E5 v3 Hot Plug" rev 0x02 at pci14 dev 5 function 1 not configured
"Intel E5 v3 Error Reporting" rev 0x02 at pci14 dev 5 function 2 not configured
"Intel E5 v3 I/O APIC" rev 0x02 at pci14 dev 5 function 4 not configured
vmm0 at mainbus0: VMX/EPT
uhub3 at uhub1 port 1 configuration 1 interface 0 "Intel Rate Matching Hub" rev
2.00/0.05 addr 2
uhub4 at uhub2 port 1 configuration 1 interface 0 "Intel Rate Matching Hub" rev
2.00/0.05 addr 2
vscsi0 at root
scsibus6 at vscsi0: 256 targets
softraid0 at root
scsibus7 at softraid0: 256 targets
softraid0: trying to bring up sd4 degraded
sd4 at scsibus7 targ 1 lun 0: <OPENBSD, SR RAID 1, 006>
sd4: 915715MB, 512 bytes/sector, 1875384353 sectors
softraid0: roaming device -> sd2a
root on sd0a (c4bd76ea8f35417b.a) swap on sd0b dump on sd0b
radeondrm0: BONAIRE
radeondrm0: 1024x768, 32bpp
wsdisplay0 at radeondrm0 mux 1: console (std, vt100 emulation), using wskbd0
wsdisplay0: screen 1-5 added (std, vt100 emulation)
iwx0: hw rev 0x340, fw 67.8f59b80b.0, address b0:7d:64:86:b7:80
softraid0: chunk sd1a already in use
