Hi,
I have a pair of CARPed firewalls which have been talking BGP to two
upstream ISPs for years over numerous OpenBSD releases.
After I upgraded to 7.3 a few days ago, as well as applied 001_bgpd
errata patch, I noticed bgpd died on both CARP members almost at the
same time, leaving my AS inaccessible from the Internet.
I am pasting error messages, dmesg and bgpd.conf from both CARP
members, in hope someone can help me. I redacted some sensitive info
like public addresses and ISP names.
Thank you in advance.
bgp1 daemon log excerpt:
May 7 12:12:57 bgp1 bgpd[36608]: neighbor 192.0.2.57 (ISP1): sending
notification: HoldTimer expired
May 7 12:12:57 bgp1 bgpd[36608]: neighbor 192.0.2.57 (ISP1): state change
Established -> Idle, reason: HoldTimer expired
May 7 12:13:27 bgp1 bgpd[36608]: neighbor 192.0.2.57 (ISP1): state change Idle
-> Connect, reason: Start
May 7 12:14:42 bgp1 bgpd[36608]: neighbor 192.0.2.57 (ISP1): state change
Connect -> Active, reason: Connection open failed
May 7 13:57:09 bgp1 bgpd[36608]: neighbor 192.0.2.57 (ISP1): state change
Active -> OpenSent, reason: Connection opened
May 7 13:57:09 bgp1 bgpd[36608]: neighbor 192.0.2.57 (ISP1): state change
OpenSent -> Active, reason: Connection closed
May 7 13:57:57 bgp1 bgpd[36608]: neighbor 192.0.2.57 (ISP1): state change
Active -> OpenSent, reason: Connection opened
May 7 13:57:57 bgp1 bgpd[36608]: neighbor 192.0.2.57 (ISP1): state change
OpenSent -> OpenConfirm, reason: OPEN message received
May 7 13:57:57 bgp1 bgpd[36608]: neighbor 192.0.2.57 (ISP1): state change
OpenConfirm -> Established, reason: KEEPALIVE message received
May 7 13:58:46 bgp1 bgpd[52951]: fatal in RDE: nexthop_unref: refcnt error
May 7 13:58:46 bgp1 bgpd[90623]: peer closed imsg connection
May 7 13:58:46 bgp1 bgpd[36608]: peer closed imsg connection
May 7 13:58:46 bgp1 bgpd[36608]: SE: Lost connection to RDE
May 7 13:58:46 bgp1 bgpd[90623]: main: Lost connection to RDE
May 7 13:58:46 bgp1 bgpd[36608]: peer closed imsg connection
May 7 13:58:46 bgp1 bgpd[36608]: SE: Lost connection to RDE control
May 7 13:58:46 bgp1 bgpd[36608]: peer closed imsg connection
May 7 13:58:46 bgp1 bgpd[36608]: SE: Lost connection to parent
May 7 13:58:46 bgp1 bgpd[36608]: neighbor 192.0.2.57 (ISP1): sending
notification: Cease, administratively down
May 7 13:58:46 bgp1 bgpd[73254]: peer closed imsg connection
May 7 13:58:46 bgp1 bgpd[73254]: RTR: Lost connection to RDE
May 7 13:58:46 bgp1 bgpd[73254]: peer closed imsg connection
May 7 13:58:46 bgp1 bgpd[36608]: neighbor 192.0.2.57 (ISP1): state change
Established -> Idle, reason: Stop
May 7 13:58:46 bgp1 bgpd[73254]: fatal in RTR: Lost connection to parent
May 7 13:58:46 bgp1 bgpd[36608]: neighbor 192.0.66.121 (ISP2): sending
notification: Cease, administratively down
May 7 13:58:46 bgp1 bgpd[36608]: neighbor 192.0.66.121 (ISP2): state change
Established -> Idle, reason: Stop
May 7 13:58:46 bgp1 bgpd[36608]: session engine exiting
May 7 13:58:55 bgp1 bgpd[90623]: kernel routing table 0 (Loc-RIB) decoupled
May 7 13:58:55 bgp1 bgpd[90623]: terminating
bgp2 daemon log excerpt:
May 7 12:12:38 bgp2 bgpd[60357]: neighbor 192.0.2.57 (ISP1): sending
notification: HoldTimer expired
May 7 12:12:38 bgp2 bgpd[60357]: neighbor 192.0.2.57 (ISP1): state change
Established -> Idle, reason: HoldTimer expired
May 7 12:13:08 bgp2 bgpd[60357]: neighbor 192.0.2.57 (ISP1): state change Idle
-> Connect, reason: Start
May 7 12:14:23 bgp2 bgpd[60357]: neighbor 192.0.2.57 (ISP1): state change
Connect -> Active, reason: Connection open failed
May 7 12:37:22 bgp2 ntpd[89855]: peer 217.24.20.5 now invalid
May 7 12:50:11 bgp2 ntpd[89855]: peer 217.24.20.5 now valid
May 7 13:57:08 bgp2 bgpd[60357]: neighbor 192.0.2.57 (ISP1): state change
Connect -> OpenSent, reason: Connection opened
May 7 13:57:09 bgp2 bgpd[60357]: neighbor 192.0.2.57 (ISP1): state change
OpenSent -> OpenConfirm, reason: OPEN message received
May 7 13:57:09 bgp2 bgpd[60357]: neighbor 192.0.2.57 (ISP1): state change
OpenConfirm -> Established, reason: KEEPALIVE message received
May 7 13:57:09 bgp2 bgpd[77822]: peer closed imsg connection
May 7 13:57:09 bgp2 bgpd[77822]: main: Lost connection to RDE
May 7 13:57:09 bgp2 bgpd[77520]: peer closed imsg connection
May 7 13:57:09 bgp2 bgpd[77520]: RTR: Lost connection to RDE
May 7 13:57:09 bgp2 bgpd[77520]: peer closed imsg connection
May 7 13:57:09 bgp2 bgpd[77520]: fatal in RTR: Lost connection to parent
May 7 13:57:09 bgp2 bgpd[60357]: peer closed imsg connection
May 7 13:57:09 bgp2 bgpd[60357]: SE: Lost connection to RDE
May 7 13:57:09 bgp2 bgpd[60357]: peer closed imsg connection
May 7 13:57:09 bgp2 bgpd[60357]: SE: Lost connection to parent
May 7 13:57:09 bgp2 bgpd[60357]: neighbor 192.0.2.57 (ISP1): sending
notification: Cease, administratively down
May 7 13:57:09 bgp2 bgpd[60357]: neighbor 192.0.2.57 (ISP1): state change
Established -> Idle, reason: Stop
May 7 13:57:09 bgp2 bgpd[60357]: neighbor 192.0.66.121 (ISP2): sending
notification: Cease, administratively down
May 7 13:57:09 bgp2 bgpd[60357]: neighbor 192.0.66.121 (ISP2): state change
Established -> Idle, reason: Stop
May 7 13:57:09 bgp2 bgpd[60357]: session engine exiting
May 7 13:57:17 bgp2 bgpd[77822]: kernel routing table 0 (Loc-RIB) decoupled
May 7 13:57:18 bgp2 bgpd[77822]: route decision engine terminated; signal 11
May 7 13:57:18 bgp2 bgpd[77822]: terminating
bgp1 dmesg.boot:
OpenBSD 7.3 (GENERIC.MP) #1125: Sat Mar 25 10:36:29 MDT 2023
[email protected]:/usr/src/sys/arch/amd64/compile/GENERIC.MP
real mem = 17027289088 (16238MB)
avail mem = 16491827200 (15727MB)
random: good seed from bootblocks
mpath0 at root
scsibus0 at mpath0: 256 targets
mainbus0 at root
bios0 at mainbus0: SMBIOS rev. 2.8 @ 0x788cf000 (234 entries)
bios0: vendor HP version "P89" date 10/17/2018
bios0: HP ProLiant DL360 Gen9
efi0 at bios0: UEFI 2.4
efi0: HP rev 0x24000
acpi0 at bios0: ACPI 5.0
acpi0: sleep states S0 S5
acpi0: tables DSDT FACP UEFI MCEJ SSDT HEST BERT ERST EINJ BGRT HPET PMCT WDDT
APIC MCFG SLIT SRAT SPMI RASF SPCR MSCT BDAT PCCT DMAR SSDT SSDT SSDT
acpi0: wakeup devices PEX4(S4) BR05(S4) BR03(S4)
acpitimer0 at acpi0: 3579545 Hz, 24 bits
acpihpet0 at acpi0: 14318179 Hz
acpimadt0 at acpi0 addr 0xfee00000: PC-AT compat
cpu0 at mainbus0: apid 0 (boot processor)
cpu0: Intel(R) Xeon(R) CPU E5-2623 v4 @ 2.60GHz, 2597.01 MHz, 06-4f-01
cpu0:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,3DNOWP,PERF,ITSC,FSGSBASE,TSC_ADJUST,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,PQM,RDSEED,ADX,SMAP,PT,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
cpu0: 32KB 64b/line 8-way D-cache, 32KB 64b/line 8-way I-cache, 256KB 64b/line
8-way L2 cache, 10MB 64b/line 20-way L3 cache
cpu0: smt 0, core 0, package 0
mtrr: Pentium Pro MTRR support, 10 var ranges, 88 fixed ranges
cpu0: apic clock running at 99MHz
cpu0: mwait min=64, max=64, C-substates=0.2.1.2, IBE
cpu1 at mainbus0: apid 2 (application processor)
cpu1: Intel(R) Xeon(R) CPU E5-2623 v4 @ 2.60GHz, 2597.07 MHz, 06-4f-01
cpu1:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,3DNOWP,PERF,ITSC,FSGSBASE,TSC_ADJUST,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,PQM,RDSEED,ADX,SMAP,PT,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
cpu1: 32KB 64b/line 8-way D-cache, 32KB 64b/line 8-way I-cache, 256KB 64b/line
8-way L2 cache, 10MB 64b/line 20-way L3 cache
cpu1: smt 0, core 1, package 0
cpu2 at mainbus0: apid 4 (application processor)
cpu2: Intel(R) Xeon(R) CPU E5-2623 v4 @ 2.60GHz, 2597.06 MHz, 06-4f-01
cpu2:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,3DNOWP,PERF,ITSC,FSGSBASE,TSC_ADJUST,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,PQM,RDSEED,ADX,SMAP,PT,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
cpu2: 32KB 64b/line 8-way D-cache, 32KB 64b/line 8-way I-cache, 256KB 64b/line
8-way L2 cache, 10MB 64b/line 20-way L3 cache
cpu2: smt 0, core 2, package 0
cpu3 at mainbus0: apid 6 (application processor)
cpu3: Intel(R) Xeon(R) CPU E5-2623 v4 @ 2.60GHz, 2597.09 MHz, 06-4f-01
cpu3:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,3DNOWP,PERF,ITSC,FSGSBASE,TSC_ADJUST,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,PQM,RDSEED,ADX,SMAP,PT,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
cpu3: 32KB 64b/line 8-way D-cache, 32KB 64b/line 8-way I-cache, 256KB 64b/line
8-way L2 cache, 10MB 64b/line 20-way L3 cache
cpu3: smt 0, core 3, package 0
cpu4 at mainbus0: apid 1 (application processor)
cpu4: Intel(R) Xeon(R) CPU E5-2623 v4 @ 2.60GHz, 2597.10 MHz, 06-4f-01
cpu4:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,3DNOWP,PERF,ITSC,FSGSBASE,TSC_ADJUST,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,PQM,RDSEED,ADX,SMAP,PT,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
cpu4: 32KB 64b/line 8-way D-cache, 32KB 64b/line 8-way I-cache, 256KB 64b/line
8-way L2 cache, 10MB 64b/line 20-way L3 cache
cpu4: smt 1, core 0, package 0
cpu5 at mainbus0: apid 3 (application processor)
cpu5: Intel(R) Xeon(R) CPU E5-2623 v4 @ 2.60GHz, 2597.11 MHz, 06-4f-01
cpu5:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,3DNOWP,PERF,ITSC,FSGSBASE,TSC_ADJUST,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,PQM,RDSEED,ADX,SMAP,PT,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
cpu5: 32KB 64b/line 8-way D-cache, 32KB 64b/line 8-way I-cache, 256KB 64b/line
8-way L2 cache, 10MB 64b/line 20-way L3 cache
cpu5: smt 1, core 1, package 0
cpu6 at mainbus0: apid 5 (application processor)
cpu6: Intel(R) Xeon(R) CPU E5-2623 v4 @ 2.60GHz, 2597.04 MHz, 06-4f-01
cpu6:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,3DNOWP,PERF,ITSC,FSGSBASE,TSC_ADJUST,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,PQM,RDSEED,ADX,SMAP,PT,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
cpu6: 32KB 64b/line 8-way D-cache, 32KB 64b/line 8-way I-cache, 256KB 64b/line
8-way L2 cache, 10MB 64b/line 20-way L3 cache
cpu6: smt 1, core 2, package 0
cpu7 at mainbus0: apid 7 (application processor)
cpu7: Intel(R) Xeon(R) CPU E5-2623 v4 @ 2.60GHz, 2597.15 MHz, 06-4f-01
cpu7:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,3DNOWP,PERF,ITSC,FSGSBASE,TSC_ADJUST,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,PQM,RDSEED,ADX,SMAP,PT,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
cpu7: 32KB 64b/line 8-way D-cache, 32KB 64b/line 8-way I-cache, 256KB 64b/line
8-way L2 cache, 10MB 64b/line 20-way L3 cache
cpu7: smt 1, core 3, package 0
ioapic0 at mainbus0: apid 8 pa 0xfec00000, version 20, 24 pins
ioapic1 at mainbus0: apid 9 pa 0xfec01000, version 20, 24 pins
acpimcfg0 at acpi0
acpimcfg0: addr 0x80000000, bus 0-255
acpiprt0 at acpi0: bus 255 (UNC0)
acpiprt1 at acpi0: bus 0 (PCI0)
acpiprt2 at acpi0: bus 1 (PEX2)
acpiprt3 at acpi0: bus 2 (PEX4)
acpiprt4 at acpi0: bus 3 (BR01)
acpiprt5 at acpi0: bus 4 (BR05)
"PNP0C33" at acpi0 not configured
"PNP0C14" at acpi0 not configured
acpipci0 at acpi0 UNC0
"ACPI0004" at acpi0 not configured
acpicpu0 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1), PSS
acpicpu1 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1), PSS
acpicpu2 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1), PSS
acpicpu3 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1), PSS
acpicpu4 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1), PSS
acpicpu5 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1), PSS
acpicpu6 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1), PSS
acpicpu7 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1), PSS
acpipci1 at acpi0 PCI0: 0x00000010 0x00000011 0x00000000
"PNP0003" at acpi0 not configured
acpicmos0 at acpi0
"IPI0001" at acpi0 not configured
com0 at acpi0 UAR1 addr 0x3f8/0x8 irq 4: ns16550a, 16 byte fifo
com1 at acpi0 UAR2 addr 0x2f8/0x8 irq 3: ns16550a, 16 byte fifo
com1: probed fifo depth: 0 bytes
"ACPI000E" at acpi0 not configured
"ACPI000D" at acpi0 not configured
ipmi at mainbus0 not configured
cpu0: using VERW MDS workaround (except on vmm entry)
cpu0: Enhanced SpeedStep 2597 MHz: speeds: 2601, 2600, 2500, 2400, 2300, 2200,
2100, 2000, 1900, 1800, 1700, 1600, 1500, 1400, 1300, 1200 MHz
pci0 at mainbus0 bus 255
"Intel Xeon-D QPI Link" rev 0x01 at pci0 dev 11 function 0 not configured
"Intel Xeon-D QPI Link" rev 0x01 at pci0 dev 11 function 1 not configured
"Intel Xeon-D QPI Link" rev 0x01 at pci0 dev 11 function 2 not configured
"Intel Xeon-D QPI Debug" rev 0x01 at pci0 dev 11 function 3 not configured
"Intel Xeon-D Cache" rev 0x01 at pci0 dev 12 function 0 not configured
"Intel Xeon-D Cache" rev 0x01 at pci0 dev 12 function 1 not configured
"Intel Xeon-D Cache" rev 0x01 at pci0 dev 12 function 2 not configured
"Intel Xeon-D Cache" rev 0x01 at pci0 dev 12 function 3 not configured
"Intel Xeon-D Cache" rev 0x01 at pci0 dev 15 function 0 not configured
"Intel E5 v4 Cache" rev 0x01 at pci0 dev 15 function 1 not configured
"Intel Xeon-D Cache" rev 0x01 at pci0 dev 15 function 4 not configured
"Intel Xeon-D Cache" rev 0x01 at pci0 dev 15 function 5 not configured
"Intel Xeon-D Cache" rev 0x01 at pci0 dev 15 function 6 not configured
"Intel Xeon-D PCIE" rev 0x01 at pci0 dev 16 function 0 not configured
"Intel E5 v4 R2PCIe Agent" rev 0x01 at pci0 dev 16 function 1 not configured
"Intel Xeon-D Ubox" rev 0x01 at pci0 dev 16 function 5 not configured
"Intel Xeon-D Ubox" rev 0x01 at pci0 dev 16 function 6 not configured
"Intel Xeon-D Ubox" rev 0x01 at pci0 dev 16 function 7 not configured
"Intel Xeon-D Home Agent" rev 0x01 at pci0 dev 18 function 0 not configured
"Intel Xeon-D Home Agent" rev 0x01 at pci0 dev 18 function 1 not configured
vendor "Intel", unknown product 0x6f70 (class system subclass miscellaneous,
rev 0x01) at pci0 dev 18 function 2 not configured
"Intel Xeon-D Memory" rev 0x01 at pci0 dev 19 function 0 not configured
"Intel Xeon-D Memory" rev 0x01 at pci0 dev 19 function 1 not configured
"Intel Xeon-D Memory" rev 0x01 at pci0 dev 19 function 2 not configured
"Intel Xeon-D Memory" rev 0x01 at pci0 dev 19 function 3 not configured
"Intel Xeon-D Memory" rev 0x01 at pci0 dev 19 function 4 not configured
"Intel Xeon-D Memory" rev 0x01 at pci0 dev 19 function 5 not configured
"Intel Xeon-D Memory" rev 0x01 at pci0 dev 19 function 6 not configured
"Intel Xeon-D Memory" rev 0x01 at pci0 dev 19 function 7 not configured
"Intel Xeon-D Memory" rev 0x01 at pci0 dev 20 function 0 not configured
"Intel Xeon-D Memory" rev 0x01 at pci0 dev 20 function 1 not configured
"Intel Xeon-D Memory" rev 0x01 at pci0 dev 20 function 2 not configured
"Intel Xeon-D Memory" rev 0x01 at pci0 dev 20 function 3 not configured
"Intel Xeon-D Memory" rev 0x01 at pci0 dev 20 function 4 not configured
"Intel Xeon-D Memory" rev 0x01 at pci0 dev 20 function 5 not configured
"Intel Xeon-D Memory" rev 0x01 at pci0 dev 20 function 6 not configured
"Intel Xeon-D Memory" rev 0x01 at pci0 dev 20 function 7 not configured
"Intel Xeon-D Memory" rev 0x01 at pci0 dev 21 function 0 not configured
"Intel Xeon-D Memory" rev 0x01 at pci0 dev 21 function 1 not configured
"Intel Xeon-D Memory" rev 0x01 at pci0 dev 21 function 2 not configured
"Intel Xeon-D Memory" rev 0x01 at pci0 dev 21 function 3 not configured
"Intel E5 v4 RAS" rev 0x01 at pci0 dev 22 function 0 not configured
"Intel E5 v4 DDRIO" rev 0x01 at pci0 dev 22 function 6 not configured
"Intel E5 v4 DDRIO" rev 0x01 at pci0 dev 22 function 7 not configured
"Intel E5 v4 Thermal" rev 0x01 at pci0 dev 23 function 0 not configured
"Intel E5 v4 DDRIO" rev 0x01 at pci0 dev 23 function 4 not configured
"Intel E5 v4 DDRIO" rev 0x01 at pci0 dev 23 function 5 not configured
"Intel E5 v4 DDRIO" rev 0x01 at pci0 dev 23 function 6 not configured
"Intel E5 v4 DDRIO" rev 0x01 at pci0 dev 23 function 7 not configured
"Intel Xeon-D PCU" rev 0x01 at pci0 dev 30 function 0 not configured
"Intel Xeon-D PCU" rev 0x01 at pci0 dev 30 function 1 not configured
"Intel Xeon-D PCU" rev 0x01 at pci0 dev 30 function 2 not configured
"Intel Xeon-D PCU" rev 0x01 at pci0 dev 30 function 3 not configured
"Intel Xeon-D PCU" rev 0x01 at pci0 dev 30 function 4 not configured
"Intel Xeon-D PCU" rev 0x01 at pci0 dev 31 function 0 not configured
"Intel Xeon-D PCU" rev 0x01 at pci0 dev 31 function 2 not configured
pci1 at mainbus0 bus 0
pchb0 at pci1 dev 0 function 0 "Intel Xeon-D Host" rev 0x01
ppb0 at pci1 dev 1 function 0 "Intel Xeon-D PCIE" rev 0x01
pci2 at ppb0 bus 3
ppb1 at pci1 dev 1 function 1 "Intel Xeon-D PCIE" rev 0x01
pci3 at ppb1 bus 8
ppb2 at pci1 dev 2 function 0 "Intel Xeon-D PCIE" rev 0x01
pci4 at ppb2 bus 5
ppb3 at pci1 dev 2 function 1 "Intel Xeon-D PCIE" rev 0x01
pci5 at ppb3 bus 9
ppb4 at pci1 dev 2 function 2 "Intel Xeon-D PCIE" rev 0x01
pci6 at ppb4 bus 4
ppb5 at pci1 dev 2 function 3 "Intel Xeon-D PCIE" rev 0x01
pci7 at ppb5 bus 10
ppb6 at pci1 dev 3 function 0 "Intel Xeon-D PCIE" rev 0x01
pci8 at ppb6 bus 6
ppb7 at pci1 dev 3 function 1 "Intel Xeon-D PCIE" rev 0x01
pci9 at ppb7 bus 11
ppb8 at pci1 dev 3 function 2 "Intel Xeon-D PCIE" rev 0x01
pci10 at ppb8 bus 7
ppb9 at pci1 dev 3 function 3 "Intel Xeon-D PCIE" rev 0x01
pci11 at ppb9 bus 12
"Intel E5 v4 DMA" rev 0x01 at pci1 dev 4 function 0 not configured
"Intel E5 v4 DMA" rev 0x01 at pci1 dev 4 function 1 not configured
"Intel E5 v4 DMA" rev 0x01 at pci1 dev 4 function 2 not configured
"Intel E5 v4 DMA" rev 0x01 at pci1 dev 4 function 3 not configured
"Intel E5 v4 DMA" rev 0x01 at pci1 dev 4 function 4 not configured
"Intel E5 v4 DMA" rev 0x01 at pci1 dev 4 function 5 not configured
"Intel E5 v4 DMA" rev 0x01 at pci1 dev 4 function 6 not configured
"Intel E5 v4 DMA" rev 0x01 at pci1 dev 4 function 7 not configured
"Intel Xeon-D Address Map" rev 0x01 at pci1 dev 5 function 0 not configured
"Intel Xeon-D Hot Plug" rev 0x01 at pci1 dev 5 function 1 not configured
"Intel Xeon-D RAS" rev 0x01 at pci1 dev 5 function 2 not configured
"Intel Xeon-D I/O APIC" rev 0x01 at pci1 dev 5 function 4 not configured
"Intel C610 MS SPSR" rev 0x05 at pci1 dev 17 function 0 not configured
xhci0 at pci1 dev 20 function 0 "Intel C610 xHCI" rev 0x05: msi, xHCI 1.0
usb0 at xhci0: USB revision 3.0
uhub0 at usb0 configuration 1 interface 0 "Intel xHCI root hub" rev 3.00/1.00
addr 1
ehci0 at pci1 dev 26 function 0 "Intel C610 USB" rev 0x05: apic 8 int 18
usb1 at ehci0: USB revision 2.0
uhub1 at usb1 configuration 1 interface 0 "Intel EHCI root hub" rev 2.00/1.00
addr 1
ppb10 at pci1 dev 28 function 0 "Intel C610 PCIE" rev 0xd5
pci12 at ppb10 bus 13
ppb11 at pci1 dev 28 function 2 "Intel C610 PCIE" rev 0xd5
pci13 at ppb11 bus 1
"Hewlett-Packard iLO3 Slave" rev 0x06 at pci13 dev 0 function 0 not configured
"Matrox MGA G200eH" rev 0x01 at pci13 dev 0 function 1 not configured
"Hewlett-Packard iLO3 Management" rev 0x06 at pci13 dev 0 function 2 not
configured
uhci0 at pci13 dev 0 function 4 "Hewlett-Packard USB" rev 0x03: apic 8 int 19
usb2 at uhci0: USB revision 1.0
uhub2 at usb2 configuration 1 interface 0 "Hewlett-Packard UHCI root hub" rev
1.00/1.00 addr 1
ppb12 at pci1 dev 28 function 4 "Intel C610 PCIE" rev 0xd5
pci14 at ppb12 bus 2
bge0 at pci14 dev 0 function 0 "Broadcom BCM5719" rev 0x01, BCM5719 A1
(0x5719001), APE firmware NCSI 1.4.22.0: msi, address 20:67:7c:d8:85:80
brgphy0 at bge0 phy 1: BCM5719C 10/100/1000baseT PHY, rev. 0
bge1 at pci14 dev 0 function 1 "Broadcom BCM5719" rev 0x01, BCM5719 A1
(0x5719001), APE firmware NCSI 1.4.22.0: msi, address 20:67:7c:d8:85:81
brgphy1 at bge1 phy 2: BCM5719C 10/100/1000baseT PHY, rev. 0
bge2 at pci14 dev 0 function 2 "Broadcom BCM5719" rev 0x01, BCM5719 A1
(0x5719001), APE firmware NCSI 1.4.22.0: msi, address 20:67:7c:d8:85:82
brgphy2 at bge2 phy 3: BCM5719C 10/100/1000baseT PHY, rev. 0
bge3 at pci14 dev 0 function 3 "Broadcom BCM5719" rev 0x01, BCM5719 A1
(0x5719001), APE firmware NCSI 1.4.22.0: msi, address 20:67:7c:d8:85:83
brgphy3 at bge3 phy 4: BCM5719C 10/100/1000baseT PHY, rev. 0
ppb13 at pci1 dev 28 function 6 "Intel C610 PCIE" rev 0xd5
pci15 at ppb13 bus 14
ppb14 at pci1 dev 28 function 7 "Intel C610 PCIE" rev 0xd5
pci16 at ppb14 bus 15
ehci1 at pci1 dev 29 function 0 "Intel C610 USB" rev 0x05: apic 8 int 18
usb3 at ehci1: USB revision 2.0
uhub3 at usb3 configuration 1 interface 0 "Intel EHCI root hub" rev 2.00/1.00
addr 1
pcib0 at pci1 dev 31 function 0 "Intel C610 LPC" rev 0x05
ahci0 at pci1 dev 31 function 2 "Intel C610 AHCI" rev 0x05: msi, AHCI 1.3
ahci0: port 0: 6.0Gb/s
ahci0: port 1: 6.0Gb/s
scsibus1 at ahci0: 32 targets
sd0 at scsibus1 targ 0 lun 0: <ATA, MB001000GWFGF, HPG3> naa.5000c500b5c2959c
sd0: 953869MB, 512 bytes/sector, 1953525168 sectors
sd1 at scsibus1 targ 1 lun 0: <ATA, MB001000GWFGF, HPG3> naa.5000c500b5c29144
sd1: 953869MB, 512 bytes/sector, 1953525168 sectors
ichiic0 at pci1 dev 31 function 3 "Intel C610 SMBus" rev 0x05: apic 8 int 18
iic0 at ichiic0
isa0 at pcib0
isadma0 at isa0
pckbc0 at isa0 port 0x60/5 irq 1 irq 12
pckbd0 at pckbc0 (kbd slot)
wskbd0 at pckbd0: console keyboard
pcppi0 at isa0 port 0x61
spkr0 at pcppi0
vmm0 at mainbus0: VMX/EPT
efifb0 at mainbus0: 1280x1024, 32bpp
wsdisplay0 at efifb0 mux 1: console (std, vt100 emulation), using wskbd0
wsdisplay0: screen 1-5 added (std, vt100 emulation)
uhub4 at uhub0 port 3 configuration 1 interface 0 "Standard Microsystems
product 0x2660" rev 2.00/8.01 addr 2
uhub5 at uhub1 port 1 configuration 1 interface 0 "Intel Rate Matching Hub" rev
2.00/0.05 addr 2
uhub6 at uhub3 port 1 configuration 1 interface 0 "Intel Rate Matching Hub" rev
2.00/0.05 addr 2
vscsi0 at root
scsibus2 at vscsi0: 256 targets
softraid0 at root
scsibus3 at softraid0: 256 targets
sd2 at scsibus3 targ 1 lun 0: <OPENBSD, SR RAID 1, 006>
sd2: 953868MB, 512 bytes/sector, 1953523553 sectors
root on sd2a (22c1286429044ddf.a) swap on sd2b dump on sd2b
bgp2 dmesg.boot:
OpenBSD 7.3 (GENERIC.MP) #1125: Sat Mar 25 10:36:29 MDT 2023
[email protected]:/usr/src/sys/arch/amd64/compile/GENERIC.MP
real mem = 17027289088 (16238MB)
avail mem = 16491823104 (15727MB)
random: good seed from bootblocks
mpath0 at root
scsibus0 at mpath0: 256 targets
mainbus0 at root
bios0 at mainbus0: SMBIOS rev. 2.8 @ 0x788cf000 (234 entries)
bios0: vendor HP version "P89" date 05/21/2018
bios0: HP ProLiant DL360 Gen9
efi0 at bios0: UEFI 2.4
efi0: HP rev 0x23c00
acpi0 at bios0: ACPI 5.0
acpi0: sleep states S0 S5
acpi0: tables DSDT FACP UEFI MCEJ SSDT HEST BERT ERST EINJ BGRT HPET PMCT WDDT
APIC MCFG SLIT SRAT SPMI RASF SPCR MSCT BDAT PCCT DMAR SSDT SSDT SSDT
acpi0: wakeup devices PEX4(S4) BR05(S4) BR03(S4)
acpitimer0 at acpi0: 3579545 Hz, 24 bits
acpihpet0 at acpi0: 14318179 Hz
acpimadt0 at acpi0 addr 0xfee00000: PC-AT compat
cpu0 at mainbus0: apid 0 (boot processor)
cpu0: Intel(R) Xeon(R) CPU E5-2623 v4 @ 2.60GHz, 2597.08 MHz, 06-4f-01
cpu0:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,3DNOWP,PERF,ITSC,FSGSBASE,TSC_ADJUST,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,PQM,RDSEED,ADX,SMAP,PT,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
cpu0: 32KB 64b/line 8-way D-cache, 32KB 64b/line 8-way I-cache, 256KB 64b/line
8-way L2 cache, 10MB 64b/line 20-way L3 cache
cpu0: smt 0, core 0, package 0
mtrr: Pentium Pro MTRR support, 10 var ranges, 88 fixed ranges
cpu0: apic clock running at 99MHz
cpu0: mwait min=64, max=64, C-substates=0.2.1.2, IBE
cpu1 at mainbus0: apid 2 (application processor)
cpu1: Intel(R) Xeon(R) CPU E5-2623 v4 @ 2.60GHz, 2597.06 MHz, 06-4f-01
cpu1:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,3DNOWP,PERF,ITSC,FSGSBASE,TSC_ADJUST,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,PQM,RDSEED,ADX,SMAP,PT,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
cpu1: 32KB 64b/line 8-way D-cache, 32KB 64b/line 8-way I-cache, 256KB 64b/line
8-way L2 cache, 10MB 64b/line 20-way L3 cache
cpu1: smt 0, core 1, package 0
cpu2 at mainbus0: apid 4 (application processor)
cpu2: Intel(R) Xeon(R) CPU E5-2623 v4 @ 2.60GHz, 2597.07 MHz, 06-4f-01
cpu2:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,3DNOWP,PERF,ITSC,FSGSBASE,TSC_ADJUST,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,PQM,RDSEED,ADX,SMAP,PT,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
cpu2: 32KB 64b/line 8-way D-cache, 32KB 64b/line 8-way I-cache, 256KB 64b/line
8-way L2 cache, 10MB 64b/line 20-way L3 cache
cpu2: smt 0, core 2, package 0
cpu3 at mainbus0: apid 6 (application processor)
cpu3: Intel(R) Xeon(R) CPU E5-2623 v4 @ 2.60GHz, 2597.08 MHz, 06-4f-01
cpu3:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,3DNOWP,PERF,ITSC,FSGSBASE,TSC_ADJUST,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,PQM,RDSEED,ADX,SMAP,PT,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
cpu3: 32KB 64b/line 8-way D-cache, 32KB 64b/line 8-way I-cache, 256KB 64b/line
8-way L2 cache, 10MB 64b/line 20-way L3 cache
cpu3: smt 0, core 3, package 0
cpu4 at mainbus0: apid 1 (application processor)
cpu4: Intel(R) Xeon(R) CPU E5-2623 v4 @ 2.60GHz, 2597.16 MHz, 06-4f-01
cpu4:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,3DNOWP,PERF,ITSC,FSGSBASE,TSC_ADJUST,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,PQM,RDSEED,ADX,SMAP,PT,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
cpu4: 32KB 64b/line 8-way D-cache, 32KB 64b/line 8-way I-cache, 256KB 64b/line
8-way L2 cache, 10MB 64b/line 20-way L3 cache
cpu4: smt 1, core 0, package 0
cpu5 at mainbus0: apid 3 (application processor)
cpu5: Intel(R) Xeon(R) CPU E5-2623 v4 @ 2.60GHz, 2597.12 MHz, 06-4f-01
cpu5:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,3DNOWP,PERF,ITSC,FSGSBASE,TSC_ADJUST,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,PQM,RDSEED,ADX,SMAP,PT,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
cpu5: 32KB 64b/line 8-way D-cache, 32KB 64b/line 8-way I-cache, 256KB 64b/line
8-way L2 cache, 10MB 64b/line 20-way L3 cache
cpu5: smt 1, core 1, package 0
cpu6 at mainbus0: apid 5 (application processor)
cpu6: Intel(R) Xeon(R) CPU E5-2623 v4 @ 2.60GHz, 2597.16 MHz, 06-4f-01
cpu6:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,3DNOWP,PERF,ITSC,FSGSBASE,TSC_ADJUST,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,PQM,RDSEED,ADX,SMAP,PT,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
cpu6: 32KB 64b/line 8-way D-cache, 32KB 64b/line 8-way I-cache, 256KB 64b/line
8-way L2 cache, 10MB 64b/line 20-way L3 cache
cpu6: smt 1, core 2, package 0
cpu7 at mainbus0: apid 7 (application processor)
cpu7: Intel(R) Xeon(R) CPU E5-2623 v4 @ 2.60GHz, 2597.15 MHz, 06-4f-01
cpu7:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,3DNOWP,PERF,ITSC,FSGSBASE,TSC_ADJUST,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,PQM,RDSEED,ADX,SMAP,PT,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
cpu7: 32KB 64b/line 8-way D-cache, 32KB 64b/line 8-way I-cache, 256KB 64b/line
8-way L2 cache, 10MB 64b/line 20-way L3 cache
cpu7: smt 1, core 3, package 0
ioapic0 at mainbus0: apid 8 pa 0xfec00000, version 20, 24 pins
ioapic1 at mainbus0: apid 9 pa 0xfec01000, version 20, 24 pins
acpimcfg0 at acpi0
acpimcfg0: addr 0x80000000, bus 0-255
acpiprt0 at acpi0: bus 255 (UNC0)
acpiprt1 at acpi0: bus 0 (PCI0)
acpiprt2 at acpi0: bus 1 (PEX2)
acpiprt3 at acpi0: bus 2 (PEX4)
acpiprt4 at acpi0: bus 3 (BR01)
acpiprt5 at acpi0: bus 4 (BR05)
"PNP0C33" at acpi0 not configured
"PNP0C14" at acpi0 not configured
acpipci0 at acpi0 UNC0
"ACPI0004" at acpi0 not configured
acpicpu0 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1), PSS
acpicpu1 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1), PSS
acpicpu2 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1), PSS
acpicpu3 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1), PSS
acpicpu4 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1), PSS
acpicpu5 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1), PSS
acpicpu6 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1), PSS
acpicpu7 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1), PSS
acpipci1 at acpi0 PCI0: 0x00000010 0x00000011 0x00000000
"PNP0003" at acpi0 not configured
acpicmos0 at acpi0
"IPI0001" at acpi0 not configured
com0 at acpi0 UAR1 addr 0x3f8/0x8 irq 4: ns16550a, 16 byte fifo
com1 at acpi0 UAR2 addr 0x2f8/0x8 irq 3: ns16550a, 16 byte fifo
com1: probed fifo depth: 0 bytes
"ACPI000E" at acpi0 not configured
"ACPI000D" at acpi0 not configured
ipmi at mainbus0 not configured
cpu0: using VERW MDS workaround (except on vmm entry)
cpu0: Enhanced SpeedStep 2597 MHz: speeds: 2601, 2600, 2500, 2400, 2300, 2200,
2100, 2000, 1900, 1800, 1700, 1600, 1500, 1400, 1300, 1200 MHz
pci0 at mainbus0 bus 255
"Intel Xeon-D QPI Link" rev 0x01 at pci0 dev 11 function 0 not configured
"Intel Xeon-D QPI Link" rev 0x01 at pci0 dev 11 function 1 not configured
"Intel Xeon-D QPI Link" rev 0x01 at pci0 dev 11 function 2 not configured
"Intel Xeon-D QPI Debug" rev 0x01 at pci0 dev 11 function 3 not configured
"Intel Xeon-D Cache" rev 0x01 at pci0 dev 12 function 0 not configured
"Intel Xeon-D Cache" rev 0x01 at pci0 dev 12 function 1 not configured
"Intel Xeon-D Cache" rev 0x01 at pci0 dev 12 function 2 not configured
"Intel Xeon-D Cache" rev 0x01 at pci0 dev 12 function 3 not configured
"Intel Xeon-D Cache" rev 0x01 at pci0 dev 15 function 0 not configured
"Intel E5 v4 Cache" rev 0x01 at pci0 dev 15 function 1 not configured
"Intel Xeon-D Cache" rev 0x01 at pci0 dev 15 function 4 not configured
"Intel Xeon-D Cache" rev 0x01 at pci0 dev 15 function 5 not configured
"Intel Xeon-D Cache" rev 0x01 at pci0 dev 15 function 6 not configured
"Intel Xeon-D PCIE" rev 0x01 at pci0 dev 16 function 0 not configured
"Intel E5 v4 R2PCIe Agent" rev 0x01 at pci0 dev 16 function 1 not configured
"Intel Xeon-D Ubox" rev 0x01 at pci0 dev 16 function 5 not configured
"Intel Xeon-D Ubox" rev 0x01 at pci0 dev 16 function 6 not configured
"Intel Xeon-D Ubox" rev 0x01 at pci0 dev 16 function 7 not configured
"Intel Xeon-D Home Agent" rev 0x01 at pci0 dev 18 function 0 not configured
"Intel Xeon-D Home Agent" rev 0x01 at pci0 dev 18 function 1 not configured
vendor "Intel", unknown product 0x6f70 (class system subclass miscellaneous,
rev 0x01) at pci0 dev 18 function 2 not configured
"Intel Xeon-D Memory" rev 0x01 at pci0 dev 19 function 0 not configured
"Intel Xeon-D Memory" rev 0x01 at pci0 dev 19 function 1 not configured
"Intel Xeon-D Memory" rev 0x01 at pci0 dev 19 function 2 not configured
"Intel Xeon-D Memory" rev 0x01 at pci0 dev 19 function 3 not configured
"Intel Xeon-D Memory" rev 0x01 at pci0 dev 19 function 4 not configured
"Intel Xeon-D Memory" rev 0x01 at pci0 dev 19 function 5 not configured
"Intel Xeon-D Memory" rev 0x01 at pci0 dev 19 function 6 not configured
"Intel Xeon-D Memory" rev 0x01 at pci0 dev 19 function 7 not configured
"Intel Xeon-D Memory" rev 0x01 at pci0 dev 20 function 0 not configured
"Intel Xeon-D Memory" rev 0x01 at pci0 dev 20 function 1 not configured
"Intel Xeon-D Memory" rev 0x01 at pci0 dev 20 function 2 not configured
"Intel Xeon-D Memory" rev 0x01 at pci0 dev 20 function 3 not configured
"Intel Xeon-D Memory" rev 0x01 at pci0 dev 20 function 4 not configured
"Intel Xeon-D Memory" rev 0x01 at pci0 dev 20 function 5 not configured
"Intel Xeon-D Memory" rev 0x01 at pci0 dev 20 function 6 not configured
"Intel Xeon-D Memory" rev 0x01 at pci0 dev 20 function 7 not configured
"Intel Xeon-D Memory" rev 0x01 at pci0 dev 21 function 0 not configured
"Intel Xeon-D Memory" rev 0x01 at pci0 dev 21 function 1 not configured
"Intel Xeon-D Memory" rev 0x01 at pci0 dev 21 function 2 not configured
"Intel Xeon-D Memory" rev 0x01 at pci0 dev 21 function 3 not configured
"Intel E5 v4 RAS" rev 0x01 at pci0 dev 22 function 0 not configured
"Intel E5 v4 DDRIO" rev 0x01 at pci0 dev 22 function 6 not configured
"Intel E5 v4 DDRIO" rev 0x01 at pci0 dev 22 function 7 not configured
"Intel E5 v4 Thermal" rev 0x01 at pci0 dev 23 function 0 not configured
"Intel E5 v4 DDRIO" rev 0x01 at pci0 dev 23 function 4 not configured
"Intel E5 v4 DDRIO" rev 0x01 at pci0 dev 23 function 5 not configured
"Intel E5 v4 DDRIO" rev 0x01 at pci0 dev 23 function 6 not configured
"Intel E5 v4 DDRIO" rev 0x01 at pci0 dev 23 function 7 not configured
"Intel Xeon-D PCU" rev 0x01 at pci0 dev 30 function 0 not configured
"Intel Xeon-D PCU" rev 0x01 at pci0 dev 30 function 1 not configured
"Intel Xeon-D PCU" rev 0x01 at pci0 dev 30 function 2 not configured
"Intel Xeon-D PCU" rev 0x01 at pci0 dev 30 function 3 not configured
"Intel Xeon-D PCU" rev 0x01 at pci0 dev 30 function 4 not configured
"Intel Xeon-D PCU" rev 0x01 at pci0 dev 31 function 0 not configured
"Intel Xeon-D PCU" rev 0x01 at pci0 dev 31 function 2 not configured
pci1 at mainbus0 bus 0
pchb0 at pci1 dev 0 function 0 "Intel Xeon-D Host" rev 0x01
ppb0 at pci1 dev 1 function 0 "Intel Xeon-D PCIE" rev 0x01
pci2 at ppb0 bus 3
ppb1 at pci1 dev 1 function 1 "Intel Xeon-D PCIE" rev 0x01
pci3 at ppb1 bus 8
ppb2 at pci1 dev 2 function 0 "Intel Xeon-D PCIE" rev 0x01
pci4 at ppb2 bus 5
ppb3 at pci1 dev 2 function 1 "Intel Xeon-D PCIE" rev 0x01
pci5 at ppb3 bus 9
ppb4 at pci1 dev 2 function 2 "Intel Xeon-D PCIE" rev 0x01
pci6 at ppb4 bus 4
ppb5 at pci1 dev 2 function 3 "Intel Xeon-D PCIE" rev 0x01
pci7 at ppb5 bus 10
ppb6 at pci1 dev 3 function 0 "Intel Xeon-D PCIE" rev 0x01
pci8 at ppb6 bus 6
ppb7 at pci1 dev 3 function 1 "Intel Xeon-D PCIE" rev 0x01
pci9 at ppb7 bus 11
ppb8 at pci1 dev 3 function 2 "Intel Xeon-D PCIE" rev 0x01
pci10 at ppb8 bus 7
ppb9 at pci1 dev 3 function 3 "Intel Xeon-D PCIE" rev 0x01
pci11 at ppb9 bus 12
"Intel E5 v4 DMA" rev 0x01 at pci1 dev 4 function 0 not configured
"Intel E5 v4 DMA" rev 0x01 at pci1 dev 4 function 1 not configured
"Intel E5 v4 DMA" rev 0x01 at pci1 dev 4 function 2 not configured
"Intel E5 v4 DMA" rev 0x01 at pci1 dev 4 function 3 not configured
"Intel E5 v4 DMA" rev 0x01 at pci1 dev 4 function 4 not configured
"Intel E5 v4 DMA" rev 0x01 at pci1 dev 4 function 5 not configured
"Intel E5 v4 DMA" rev 0x01 at pci1 dev 4 function 6 not configured
"Intel E5 v4 DMA" rev 0x01 at pci1 dev 4 function 7 not configured
"Intel Xeon-D Address Map" rev 0x01 at pci1 dev 5 function 0 not configured
"Intel Xeon-D Hot Plug" rev 0x01 at pci1 dev 5 function 1 not configured
"Intel Xeon-D RAS" rev 0x01 at pci1 dev 5 function 2 not configured
"Intel Xeon-D I/O APIC" rev 0x01 at pci1 dev 5 function 4 not configured
"Intel C610 MS SPSR" rev 0x05 at pci1 dev 17 function 0 not configured
xhci0 at pci1 dev 20 function 0 "Intel C610 xHCI" rev 0x05: msi, xHCI 1.0
usb0 at xhci0: USB revision 3.0
uhub0 at usb0 configuration 1 interface 0 "Intel xHCI root hub" rev 3.00/1.00
addr 1
ehci0 at pci1 dev 26 function 0 "Intel C610 USB" rev 0x05: apic 8 int 18
usb1 at ehci0: USB revision 2.0
uhub1 at usb1 configuration 1 interface 0 "Intel EHCI root hub" rev 2.00/1.00
addr 1
ppb10 at pci1 dev 28 function 0 "Intel C610 PCIE" rev 0xd5
pci12 at ppb10 bus 13
ppb11 at pci1 dev 28 function 2 "Intel C610 PCIE" rev 0xd5
pci13 at ppb11 bus 1
"Hewlett-Packard iLO3 Slave" rev 0x06 at pci13 dev 0 function 0 not configured
"Matrox MGA G200eH" rev 0x01 at pci13 dev 0 function 1 not configured
"Hewlett-Packard iLO3 Management" rev 0x06 at pci13 dev 0 function 2 not
configured
uhci0 at pci13 dev 0 function 4 "Hewlett-Packard USB" rev 0x03: apic 8 int 19
usb2 at uhci0: USB revision 1.0
uhub2 at usb2 configuration 1 interface 0 "Hewlett-Packard UHCI root hub" rev
1.00/1.00 addr 1
ppb12 at pci1 dev 28 function 4 "Intel C610 PCIE" rev 0xd5
pci14 at ppb12 bus 2
bge0 at pci14 dev 0 function 0 "Broadcom BCM5719" rev 0x01, BCM5719 A1
(0x5719001), APE firmware NCSI 1.4.22.0: msi, address ec:eb:b8:95:29:30
brgphy0 at bge0 phy 1: BCM5719C 10/100/1000baseT PHY, rev. 0
bge1 at pci14 dev 0 function 1 "Broadcom BCM5719" rev 0x01, BCM5719 A1
(0x5719001), APE firmware NCSI 1.4.22.0: msi, address ec:eb:b8:95:29:31
brgphy1 at bge1 phy 2: BCM5719C 10/100/1000baseT PHY, rev. 0
bge2 at pci14 dev 0 function 2 "Broadcom BCM5719" rev 0x01, BCM5719 A1
(0x5719001), APE firmware NCSI 1.4.22.0: msi, address ec:eb:b8:95:29:32
brgphy2 at bge2 phy 3: BCM5719C 10/100/1000baseT PHY, rev. 0
bge3 at pci14 dev 0 function 3 "Broadcom BCM5719" rev 0x01, BCM5719 A1
(0x5719001), APE firmware NCSI 1.4.22.0: msi, address ec:eb:b8:95:29:33
brgphy3 at bge3 phy 4: BCM5719C 10/100/1000baseT PHY, rev. 0
ppb13 at pci1 dev 28 function 6 "Intel C610 PCIE" rev 0xd5
pci15 at ppb13 bus 14
ppb14 at pci1 dev 28 function 7 "Intel C610 PCIE" rev 0xd5
pci16 at ppb14 bus 15
ehci1 at pci1 dev 29 function 0 "Intel C610 USB" rev 0x05: apic 8 int 18
usb3 at ehci1: USB revision 2.0
uhub3 at usb3 configuration 1 interface 0 "Intel EHCI root hub" rev 2.00/1.00
addr 1
pcib0 at pci1 dev 31 function 0 "Intel C610 LPC" rev 0x05
ahci0 at pci1 dev 31 function 2 "Intel C610 AHCI" rev 0x05: msi, AHCI 1.3
ahci0: port 0: 6.0Gb/s
ahci0: port 1: 6.0Gb/s
scsibus1 at ahci0: 32 targets
sd0 at scsibus1 targ 0 lun 0: <ATA, MB001000GWFGF, HPG3> naa.5000c500b21244b2
sd0: 953869MB, 512 bytes/sector, 1953525168 sectors
sd1 at scsibus1 targ 1 lun 0: <ATA, MB001000GWFGF, HPG3> naa.5000c500b212ad9d
sd1: 953869MB, 512 bytes/sector, 1953525168 sectors
ichiic0 at pci1 dev 31 function 3 "Intel C610 SMBus" rev 0x05: apic 8 int 18
iic0 at ichiic0
isa0 at pcib0
isadma0 at isa0
pckbc0 at isa0 port 0x60/5 irq 1 irq 12
pckbd0 at pckbc0 (kbd slot)
wskbd0 at pckbd0: console keyboard
pcppi0 at isa0 port 0x61
spkr0 at pcppi0
vmm0 at mainbus0: VMX/EPT
efifb0 at mainbus0: 1280x1024, 32bpp
wsdisplay0 at efifb0 mux 1: console (std, vt100 emulation), using wskbd0
wsdisplay0: screen 1-5 added (std, vt100 emulation)
uhub4 at uhub0 port 3 configuration 1 interface 0 "Standard Microsystems
product 0x2660" rev 2.00/8.01 addr 2
uhub5 at uhub1 port 1 configuration 1 interface 0 "Intel Rate Matching Hub" rev
2.00/0.05 addr 2
uhub6 at uhub3 port 1 configuration 1 interface 0 "Intel Rate Matching Hub" rev
2.00/0.05 addr 2
vscsi0 at root
scsibus2 at vscsi0: 256 targets
softraid0 at root
scsibus3 at softraid0: 256 targets
sd2 at scsibus3 targ 1 lun 0: <OPENBSD, SR RAID 1, 006>
sd2: 953868MB, 512 bytes/sector, 1953523553 sectors
root on sd2a (c29ecfe59ea6c335.a) swap on sd2b dump on sd2b
bgp1 bgpd.conf:
# $OpenBSD: bgpd.conf,v 1.21 2021/02/02 00:34:03 danj Exp $
# define our own ASN as a macro
ASN = "SOMEAS"
ISP1 = "192.0.2.57"
ISP2 = "192.0.66.121"
# global configuration
AS $ASN
router-id IP.AD.RE.SS
# list of networks that may be originated by our ASN
prefix-set mynetworks {
IP.ADD.RE.0/24
}
include "/var/db/rpki-client/openbgpd"
# define bogon prefixes which should not be part of the DFZ
prefix-set bogons {
0.0.0.0/8 or-longer # 'this' network [RFC1122]
10.0.0.0/8 or-longer # private space [RFC1918]
100.64.0.0/10 or-longer # CGN Shared [RFC6598]
127.0.0.0/8 or-longer # localhost [RFC1122]
169.254.0.0/16 or-longer # link local [RFC3927]
172.16.0.0/12 or-longer # private space [RFC1918]
192.0.2.0/24 or-longer # TEST-NET-1 [RFC5737]
192.88.99.0/24 or-longer # 6to4 anycast relay [RFC7526]
192.168.0.0/16 or-longer # private space [RFC1918]
198.18.0.0/15 or-longer # benchmarking [RFC2544]
198.51.100.0/24 or-longer # TEST-NET-2 [RFC5737]
203.0.113.0/24 or-longer # TEST-NET-3 [RFC5737]
224.0.0.0/4 or-longer # multicast
240.0.0.0/4 or-longer # reserved for future use
::/8 or-longer # RFC 4291
IPv4-compatible, loopback, et al 0100::/64 or-longer #
Discard-Only [RFC6666] 2001:2::/48 or-longer # BMWG
[RFC5180] 2001:10::/28 or-longer # ORCHID [RFC4843]
2001:db8::/32 or-longer # docu range [RFC3849]
2002::/16 or-longer # 6to4 anycast relay
[RFC7526] 3ffe::/16 or-longer # old 6bone
fc00::/7 or-longer # unique local unicast
fe80::/10 or-longer # link local unicast
fec0::/10 or-longer # old site local unicast
ff00::/8 or-longer # multicast
}
# Generate routes for the networks our ASN will originate.
# The communities (read 'tags') are later used to match on what
# is announced to EBGP neighbors
network prefix-set mynetworks set large-community $ASN:1:1
# upstream providers
group "upstreams" {
neighbor $ISP1 {
remote-as ASONE
descr "ISP1"
local-address 192.0.2.58
}
neighbor $ISP2 {
remote-as ASTWO
descr "ISP2"
local-address 192.0.66.122
}
}
## rules section
match to $ISP1 set nexthop 192.0.2.60
match to $ISP2 set nexthop 192.0.66.124
match from $ISP1 prefix { IP.NET.WK.0/15, IP.NET.WK2.0/17 IP.NET.WK3/24
} set localpref 200
# uncomment the following two lines to accept a default route from
upstreams #allow from group upstreams prefix 0.0.0.0/0
#allow from group upstreams prefix ::/0
### for simple BGP setups, no editing below this line is required ###
# Outbound EBGP: only allow self originated networks to ebgp peers
# Don't leak any routes from upstream or peering sessions. This is done
# by checking for routes that are tagged with the large-community
$ASN:1:1 allow to $ISP1 prefix-set mynetworks large-community $ASN:1:1
allow to $ISP2 prefix-set mynetworks large-community $ASN:1:1
# deny more-specifics of our own originated prefixes
deny quick from ebgp prefix-set mynetworks or-longer
# IBGP: allow all updates to and from our IBGP neighbors
allow from ibgp
allow to ibgp
# Scrub normal and large communities relevant to our ASN from EBGP
neighbors # https://tools.ietf.org/html/rfc7454#section-11
match from ebgp set { community delete $ASN:* }
match from ebgp set { large-community delete $ASN:*:* }
# filter out prefixes longer than 24 or shorter than 8 bits for IPv4
# and longer than 48 or shorter than 16 bits for IPv6.
allow from any inet prefixlen 8 - 24
allow from any inet6 prefixlen 16 - 48
# Honor requests to gracefully shutdown BGP sessions
# https://tools.ietf.org/html/rfc8326
match from any community GRACEFUL_SHUTDOWN set { localpref 0 }
deny quick from any prefix-set bogons
# deny RPKI invalid, built by rpki-client(8), see root crontab
deny quick from ebgp ovs invalid
# filter bogon AS numbers
# AS_TRANS (23456) is not supposed to show up in any path and indicates
a # misconfiguration. Additionally Private or Reserved ASNs have no
place in # the public DFZ.
https://www.iana.org/assignments/as-numbers/as-numbers.xhtml deny quick
from any AS 23456 deny quick from any AS 64496 - 131071
deny quick from any AS 4200000000 - 4294967295
# filter out too long paths
deny from any max-as-len 100
bgp2 bgpd.conf:
# $OpenBSD: bgpd.conf,v 1.21 2021/02/02 00:34:03 danj Exp $
# define our own ASN as a macro
ASN = "SOMEAS"
ISP1 = "192.0.2.57"
ISP2 = "192.0.66.121"
# global configuration
AS $ASN
router-id IP.AD.RE.253
# list of networks that may be originated by our ASN
prefix-set mynetworks {
IP.ADD.RE.0/24
}
include "/var/db/rpki-client/openbgpd"
# define bogon prefixes which should not be part of the DFZ
prefix-set bogons {
0.0.0.0/8 or-longer # 'this' network [RFC1122]
10.0.0.0/8 or-longer # private space [RFC1918]
100.64.0.0/10 or-longer # CGN Shared [RFC6598]
127.0.0.0/8 or-longer # localhost [RFC1122]
169.254.0.0/16 or-longer # link local [RFC3927]
172.16.0.0/12 or-longer # private space [RFC1918]
192.0.2.0/24 or-longer # TEST-NET-1 [RFC5737]
192.88.99.0/24 or-longer # 6to4 anycast relay [RFC7526]
192.168.0.0/16 or-longer # private space [RFC1918]
198.18.0.0/15 or-longer # benchmarking [RFC2544]
198.51.100.0/24 or-longer # TEST-NET-2 [RFC5737]
203.0.113.0/24 or-longer # TEST-NET-3 [RFC5737]
224.0.0.0/4 or-longer # multicast
240.0.0.0/4 or-longer # reserved for future use
::/8 or-longer # RFC 4291 IPv4-compatible, loopback,
et al
0100::/64 or-longer # Discard-Only [RFC6666]
2001:2::/48 or-longer # BMWG [RFC5180]
2001:10::/28 or-longer # ORCHID [RFC4843]
2001:db8::/32 or-longer # docu range [RFC3849]
2002::/16 or-longer # 6to4 anycast relay [RFC7526]
3ffe::/16 or-longer # old 6bone
fc00::/7 or-longer # unique local unicast
fe80::/10 or-longer # link local unicast
fec0::/10 or-longer # old site local unicast
ff00::/8 or-longer # multicast
}
# Generate routes for the networks our ASN will originate.
# The communities (read 'tags') are later used to match on what
# is announced to EBGP neighbors
network prefix-set mynetworks set large-community $ASN:1:1
# upstream providers
group "upstreams" {
neighbor $ISP1 {
remote-as ASONE
descr "ISP1"
local-address 192.0.2.59
}
neighbor $ISP2 {
remote-as ASTWO
descr "ISP2"
local-address 192.0.66.123
}
}
## rules section
match to $ISP1 set nexthop 192.0.2.60
match to $ISP2 set nexthop 192.0.66.124
match from $ISP1 prefix { IP.NET.WK.0/15, IP.NET.WK2.0/17 IP.NET.WK3/24 } set
localpref 200
# uncomment the following two lines to accept a default route from upstreams
#allow from group upstreams prefix 0.0.0.0/0
#allow from group upstreams prefix ::/0
### for simple BGP setups, no editing below this line is required ###
# Outbound EBGP: only allow self originated networks to ebgp peers
# Don't leak any routes from upstream or peering sessions. This is done
# by checking for routes that are tagged with the large-community $ASN:1:1
allow to $ISP1 prefix-set mynetworks large-community $ASN:1:1
allow to $ISP2 prefix-set mynetworks large-community $ASN:1:1
# deny more-specifics of our own originated prefixes
deny quick from ebgp prefix-set mynetworks or-longer
# IBGP: allow all updates to and from our IBGP neighbors
allow from ibgp
allow to ibgp
# Scrub normal and large communities relevant to our ASN from EBGP neighbors
# https://tools.ietf.org/html/rfc7454#section-11
match from ebgp set { community delete $ASN:* }
match from ebgp set { large-community delete $ASN:*:* }
# filter out prefixes longer than 24 or shorter than 8 bits for IPv4
# and longer than 48 or shorter than 16 bits for IPv6.
allow from any inet prefixlen 8 - 24
allow from any inet6 prefixlen 16 - 48
# Honor requests to gracefully shutdown BGP sessions
# https://tools.ietf.org/html/rfc8326
match from any community GRACEFUL_SHUTDOWN set { localpref 0 }
deny quick from any prefix-set bogons
# deny RPKI invalid, built by rpki-client(8), see root crontab
deny quick from ebgp ovs invalid
# filter bogon AS numbers
# AS_TRANS (23456) is not supposed to show up in any path and indicates a
# misconfiguration. Additionally Private or Reserved ASNs have no place in
# the public DFZ. https://www.iana.org/assignments/as-numbers/as-numbers.xhtml
deny quick from any AS 23456
deny quick from any AS 64496 - 131071
deny quick from any AS 4200000000 - 4294967295
# filter out too long paths
deny from any max-as-len 100
--
Before enlightenment - chop wood, draw water.
After enlightenment - chop wood, draw water.
Marko Cupać
https://www.mimar.rs/
