Hello All, with the help of Jonathan, I was able to resolve this interrupt issue by enabling the machine type as q35, in proxmox, you just need to add the following line to the guest configuration file in proxmox machine:q35 to the config file of your vm (usually in proxmox) /etc/pve/qemu-server/machine_id_no.conf
I then set the PCI-Passthrough device as PCI-E (this option is only available once you enable the vm type as q35) the reason that these changes are necessary are because the standard qemu machine PCI bridge has MSI disabled. in OpenBSD. using the PCI-E bridge in the q35 seems to resolve this issue Thanks again Jonathan for your tip it really helped me Tom Smyth now the Card can be fully passed through to OpenBSD.. (PF (physical function) ) Thanks to all, Im just writing this up on the list incase someone else encounters the issue On Fri, 5 Jul 2019 at 22:50, Tom Smyth <[email protected]> wrote: > Hello all, > im running SR-IOV on Proxmox and im trying to present 40G intel PCI-E NICs > direct to the Guest using SR-IOV, XL710 QSFP+ > > > In openBSD during the boot up we get an unable to map interrupt as shown > below > > virtio1: msix shared > ixl0 at pci0 dev 16 function 0 "Intel XL710 QSFP+" rev 0x02: port 0, FW > 6.0.48442 API 1.7, unable to map interrupt > ixl1 at pci0 dev 17 function 0 "Intel XL710 QSFP+" rev 0x02: port 1, FW > 6.0.48442 API 1.7, unable to map interrupt > ixl2 at pci0 dev 27 function 0 "Intel XL710 QSFP+" rev 0x02: port 0, FW > 6.0.48442 API 1.7, unable to map interrupt > ixl3 at pci0 dev 28 function 0 "Intel XL710 QSFP+" rev 0x02: port 1, FW > 6.0.48442 API 1.7, unable to map interrupt > ppb0 at pci0 dev 30 function 0 "Red Hat Qemu PCI-PCI" rev 0x00 > pci1 at ppb0 bus 1 > ppb1 at pci0 dev 31 function 0 "Red Hat Qemu PCI-PCI" rev 0x00 > pci2 at ppb1 bus 2 > > Im running OPENBSD 6.5 Current as of 05/07/2019 (5th of July) > I have tested the same configuration with Debian linux guest and the > Network cards are recognised and connect to the network fine ... > > Does any one have any suggestions on that unable to map interrupt error > ... > > Thanks, > Tom Smyth > > > Full DMESG Below > > test# cat /root/tomdemesg > OpenBSD 6.5-current (GENERIC.MP) #101: Fri Jul 5 08:19:55 MDT 2019 > [email protected]:/usr/src/sys/arch/amd64/compile/GENERIC.MP > real mem = 2130554880 (2031MB) > avail mem = 2055946240 (1960MB) > mpath0 at root > scsibus0 at mpath0: 256 targets > mainbus0 at root > bios0 at mainbus0: SMBIOS rev. 2.8 @ 0xf59b0 (9 entries) > bios0: vendor SeaBIOS version " > rel-1.11.1-0-g0551a4be2c-prebuilt.qemu-project.org" date 04/01/2014 > bios0: QEMU Standard PC (i440FX + PIIX, 1996) > acpi0 at bios0: ACPI 1.0 > acpi0: sleep states S3 S4 S5 > acpi0: tables DSDT FACP APIC SSDT HPET > acpi0: wakeup devices > acpitimer0 at acpi0: 3579545 Hz, 24 bits > acpimadt0 at acpi0 addr 0xfee00000: PC-AT compat > cpu0 at mainbus0: apid 0 (boot processor) > cpu0: Intel(R) Xeon(R) CPU E5-2660 v2 @ 2.20GHz, 273.27 MHz, 06-3e-04 > cpu0: > FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,MMX,FXSR,SSE,SSE2,SS,HTT,SSE3,PCLMUL,SSSE3,CX16,PCID,SSE4.1,SSE4.2,x2APIC,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,HV,NXE,PAGE1GB,RDTSCP,LONG,LAHF,PERF,FSGSBASE,TSC_ADJUST,SMEP,ERMS,ARAT,XSAVEOPT,MELTDOWN > cpu0: 64KB 64b/line 2-way I-cache, 64KB 64b/line 2-way D-cache, 512KB > 64b/line 16-way L2 cache > cpu0: ITLB 255 4KB entries direct-mapped, 255 4MB entries direct-mapped > cpu0: DTLB 255 4KB entries direct-mapped, 255 4MB entries direct-mapped > cpu0: smt 0, core 0, package 0 > mtrr: Pentium Pro MTRR support, 8 var ranges, 88 fixed ranges > cpu0: apic clock running at 999MHz > cpu1 at mainbus0: apid 1 (application processor) > cpu1: Intel(R) Xeon(R) CPU E5-2660 v2 @ 2.20GHz, 584.21 MHz, 06-3e-04 > cpu1: > FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,MMX,FXSR,SSE,SSE2,SS,HTT,SSE3,PCLMUL,SSSE3,CX16,PCID,SSE4.1,SSE4.2,x2APIC,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,HV,NXE,PAGE1GB,RDTSCP,LONG,LAHF,PERF,FSGSBASE,TSC_ADJUST,SMEP,ERMS,ARAT,XSAVEOPT,MELTDOWN > cpu1: 64KB 64b/line 2-way I-cache, 64KB 64b/line 2-way D-cache, 512KB > 64b/line 16-way L2 cache > cpu1: ITLB 255 4KB entries direct-mapped, 255 4MB entries direct-mapped > cpu1: DTLB 255 4KB entries direct-mapped, 255 4MB entries direct-mapped > cpu1: smt 0, core 1, package 0 > ioapic0 at mainbus0: apid 0 pa 0xfec00000, version 11, 24 pins > acpihpet0 at acpi0: 100000000 Hz > acpiprt0 at acpi0: bus 0 (PCI0) > acpicpu0 at acpi0: C1(@1 halt!) > acpicpu1 at acpi0: C1(@1 halt!) > "ACPI0006" at acpi0 not configured > acpipci0 at acpi0 PCI0: _OSC failed > acpicmos0 at acpi0 > "PNP0A06" at acpi0 not configured > "PNP0A06" at acpi0 not configured > "PNP0A06" at acpi0 not configured > "QEMU0002" at acpi0 not configured > "ACPI0010" at acpi0 not configured > "QEMUVGID" at acpi0 not configured > cpu0: using IvyBridge MDS workaround > pvbus0 at mainbus0: KVM > pvclock0 at pvbus0 > pci0 at mainbus0 bus 0 > pchb0 at pci0 dev 0 function 0 "Intel 82441FX" rev 0x02 > pcib0 at pci0 dev 1 function 0 "Intel 82371SB ISA" rev 0x00 > pciide0 at pci0 dev 1 function 1 "Intel 82371SB IDE" rev 0x00: DMA, > channel 0 wired to compatibility, channel 1 wired to compatibility > pciide0: channel 0 disabled (no drives) > atapiscsi0 at pciide0 channel 1 drive 0 > scsibus1 at atapiscsi0: 2 targets > cd0 at scsibus1 targ 0 lun 0: <QEMU, QEMU DVD-ROM, 2.5+> ATAPI 5/cdrom > removable > cd0(pciide0:1:0): using PIO mode 4, DMA mode 2 > uhci0 at pci0 dev 1 function 2 "Intel 82371SB USB" rev 0x01: apic 0 int 11 > piixpm0 at pci0 dev 1 function 3 "Intel 82371AB Power" rev 0x03: apic 0 > int 9 > iic0 at piixpm0 > vga1 at pci0 dev 2 function 0 "Bochs VGA" rev 0x02 > wsdisplay0 at vga1 mux 1: console (80x25, vt100 emulation) > wsdisplay0: screen 1-5 added (80x25, vt100 emulation) > virtio0 at pci0 dev 3 function 0 "Qumranet Virtio Memory Balloon" rev 0x00 > viomb0 at virtio0 > virtio0: apic 0 int 11 > virtio1 at pci0 dev 5 function 0 "Qumranet Virtio SCSI" rev 0x00 > vioscsi0 at virtio1: qsize 128 > scsibus2 at vioscsi0: 255 targets > sd0 at scsibus2 targ 0 lun 0: <QEMU, QEMU HARDDISK, 2.5+> SCSI3 0/direct > fixed > sd0: 8192MB, 512 bytes/sector, 16777216 sectors, thin > virtio1: msix shared > ixl0 at pci0 dev 16 function 0 "Intel XL710 QSFP+" rev 0x02: port 0, FW > 6.0.48442 API 1.7, unable to map interrupt > ixl1 at pci0 dev 17 function 0 "Intel XL710 QSFP+" rev 0x02: port 1, FW > 6.0.48442 API 1.7, unable to map interrupt > ixl2 at pci0 dev 27 function 0 "Intel XL710 QSFP+" rev 0x02: port 0, FW > 6.0.48442 API 1.7, unable to map interrupt > ixl3 at pci0 dev 28 function 0 "Intel XL710 QSFP+" rev 0x02: port 1, FW > 6.0.48442 API 1.7, unable to map interrupt > ppb0 at pci0 dev 30 function 0 "Red Hat Qemu PCI-PCI" rev 0x00 > pci1 at ppb0 bus 1 > ppb1 at pci0 dev 31 function 0 "Red Hat Qemu PCI-PCI" rev 0x00 > pci2 at ppb1 bus 2 > isa0 at pcib0 > isadma0 at isa0 > fdc0 at isa0 port 0x3f0/6 irq 6 drq 2 > pckbc0 at isa0 port 0x60/5 irq 1 irq 12 > pckbd0 at pckbc0 (kbd slot) > wskbd0 at pckbd0: console keyboard, using wsdisplay0 > pms0 at pckbc0 (aux slot) > wsmouse0 at pms0 mux 0 > pcppi0 at isa0 port 0x61 > spkr0 at pcppi0 > usb0 at uhci0: USB revision 1.0 > uhub0 at usb0 configuration 1 interface 0 "Intel UHCI root hub" rev > 1.00/1.00 addr 1 > uhidev0 at uhub0 port 1 configuration 1 interface 0 "QEMU QEMU USB Tablet" > rev 2.00/0.00 addr 2 > uhidev0: iclass 3/0 > ums0 at uhidev0: 3 buttons, Z dir > wsmouse1 at ums0 mux 0 > vscsi0 at root > scsibus3 at vscsi0: 256 targets > softraid0 at root > scsibus4 at softraid0: 256 targets > root on sd0a (053640a954c00285.a) swap on sd0b dump on sd0b > fd0 at fdc0 drive 1: density unknown > syncing disks... done > rebooting... > OpenBSD 6.5-current (GENERIC.MP) #101: Fri Jul 5 08:19:55 MDT 2019 > [email protected]:/usr/src/sys/arch/amd64/compile/GENERIC.MP > real mem = 2130554880 (2031MB) > avail mem = 2055942144 (1960MB) > mpath0 at root > scsibus0 at mpath0: 256 targets > mainbus0 at root > bios0 at mainbus0: SMBIOS rev. 2.8 @ 0xf59b0 (9 entries) > bios0: vendor SeaBIOS version " > rel-1.11.1-0-g0551a4be2c-prebuilt.qemu-project.org" date 04/01/2014 > bios0: QEMU Standard PC (i440FX + PIIX, 1996) > acpi0 at bios0: ACPI 1.0 > acpi0: sleep states S3 S4 S5 > acpi0: tables DSDT FACP APIC SSDT HPET > acpi0: wakeup devices > acpitimer0 at acpi0: 3579545 Hz, 24 bits > acpimadt0 at acpi0 addr 0xfee00000: PC-AT compat > cpu0 at mainbus0: apid 0 (boot processor) > cpu0: Intel(R) Xeon(R) CPU E5-2660 v2 @ 2.20GHz, 270.19 MHz, 06-3e-04 > cpu0: > FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,MMX,FXSR,SSE,SSE2,SS,HTT,SSE3,PCLMUL,SSSE3,CX16,PCID,SSE4.1,SSE4.2,x2APIC,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,HV,NXE,PAGE1GB,RDTSCP,LONG,LAHF,PERF,FSGSBASE,TSC_ADJUST,SMEP,ERMS,ARAT,XSAVEOPT,MELTDOWN > cpu0: 64KB 64b/line 2-way I-cache, 64KB 64b/line 2-way D-cache, 512KB > 64b/line 16-way L2 cache > cpu0: ITLB 255 4KB entries direct-mapped, 255 4MB entries direct-mapped > cpu0: DTLB 255 4KB entries direct-mapped, 255 4MB entries direct-mapped > cpu0: smt 0, core 0, package 0 > mtrr: Pentium Pro MTRR support, 8 var ranges, 88 fixed ranges > cpu0: apic clock running at 1000MHz > cpu1 at mainbus0: apid 1 (application processor) > cpu1: Intel(R) Xeon(R) CPU E5-2660 v2 @ 2.20GHz, 599.48 MHz, 06-3e-04 > cpu1: > FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,MMX,FXSR,SSE,SSE2,SS,HTT,SSE3,PCLMUL,SSSE3,CX16,PCID,SSE4.1,SSE4.2,x2APIC,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,HV,NXE,PAGE1GB,RDTSCP,LONG,LAHF,PERF,FSGSBASE,TSC_ADJUST,SMEP,ERMS,ARAT,XSAVEOPT,MELTDOWN > cpu1: 64KB 64b/line 2-way I-cache, 64KB 64b/line 2-way D-cache, 512KB > 64b/line 16-way L2 cache > cpu1: ITLB 255 4KB entries direct-mapped, 255 4MB entries direct-mapped > cpu1: DTLB 255 4KB entries direct-mapped, 255 4MB entries direct-mapped > cpu1: smt 0, core 1, package 0 > ioapic0 at mainbus0: apid 0 pa 0xfec00000, version 11, 24 pins > acpihpet0 at acpi0: 100000000 Hz > acpiprt0 at acpi0: bus 0 (PCI0) > acpicpu0 at acpi0: C1(@1 halt!) > acpicpu1 at acpi0: C1(@1 halt!) > "ACPI0006" at acpi0 not configured > acpipci0 at acpi0 PCI0: _OSC failed > acpicmos0 at acpi0 > "PNP0A06" at acpi0 not configured > "PNP0A06" at acpi0 not configured > "PNP0A06" at acpi0 not configured > "QEMU0002" at acpi0 not configured > "ACPI0010" at acpi0 not configured > "QEMUVGID" at acpi0 not configured > cpu0: using IvyBridge MDS workaround > pvbus0 at mainbus0: KVM > pvclock0 at pvbus0 > pci0 at mainbus0 bus 0 > pchb0 at pci0 dev 0 function 0 "Intel 82441FX" rev 0x02 > pcib0 at pci0 dev 1 function 0 "Intel 82371SB ISA" rev 0x00 > pciide0 at pci0 dev 1 function 1 "Intel 82371SB IDE" rev 0x00: DMA, > channel 0 wired to compatibility, channel 1 wired to compatibility > pciide0: channel 0 disabled (no drives) > atapiscsi0 at pciide0 channel 1 drive 0 > scsibus1 at atapiscsi0: 2 targets > cd0 at scsibus1 targ 0 lun 0: <QEMU, QEMU DVD-ROM, 2.5+> ATAPI 5/cdrom > removable > cd0(pciide0:1:0): using PIO mode 4, DMA mode 2 > uhci0 at pci0 dev 1 function 2 "Intel 82371SB USB" rev 0x01: apic 0 int 11 > piixpm0 at pci0 dev 1 function 3 "Intel 82371AB Power" rev 0x03: apic 0 > int 9 > iic0 at piixpm0 > vga1 at pci0 dev 2 function 0 "Bochs VGA" rev 0x02 > wsdisplay0 at vga1 mux 1: console (80x25, vt100 emulation) > wsdisplay0: screen 1-5 added (80x25, vt100 emulation) > virtio0 at pci0 dev 3 function 0 "Qumranet Virtio Memory Balloon" rev 0x00 > viomb0 at virtio0 > virtio0: apic 0 int 11 > virtio1 at pci0 dev 5 function 0 "Qumranet Virtio SCSI" rev 0x00 > vioscsi0 at virtio1: qsize 128 > scsibus2 at vioscsi0: 255 targets > sd0 at scsibus2 targ 0 lun 0: <QEMU, QEMU HARDDISK, 2.5+> SCSI3 0/direct > fixed > sd0: 8192MB, 512 bytes/sector, 16777216 sectors, thin > virtio1: msix shared > ixl0 at pci0 dev 16 function 0 "Intel XL710 QSFP+" rev 0x02: port 0, FW > 6.0.48442 API 1.7, unable to map interrupt > ixl1 at pci0 dev 17 function 0 "Intel XL710 QSFP+" rev 0x02: port 1, FW > 6.0.48442 API 1.7, unable to map interrupt > ixl2 at pci0 dev 27 function 0 "Intel XL710 QSFP+" rev 0x02: port 0, FW > 6.0.48442 API 1.7, unable to map interrupt > ixl3 at pci0 dev 28 function 0 "Intel XL710 QSFP+" rev 0x02: port 1, FW > 6.0.48442 API 1.7, unable to map interrupt > ppb0 at pci0 dev 30 function 0 "Red Hat Qemu PCI-PCI" rev 0x00 > pci1 at ppb0 bus 1 > ppb1 at pci0 dev 31 function 0 "Red Hat Qemu PCI-PCI" rev 0x00 > pci2 at ppb1 bus 2 > isa0 at pcib0 > isadma0 at isa0 > fdc0 at isa0 port 0x3f0/6 irq 6 drq 2 > pckbc0 at isa0 port 0x60/5 irq 1 irq 12 > pckbd0 at pckbc0 (kbd slot) > wskbd0 at pckbd0: console keyboard, using wsdisplay0 > pms0 at pckbc0 (aux slot) > wsmouse0 at pms0 mux 0 > pcppi0 at isa0 port 0x61 > spkr0 at pcppi0 > usb0 at uhci0: USB revision 1.0 > uhub0 at usb0 configuration 1 interface 0 "Intel UHCI root hub" rev > 1.00/1.00 addr 1 > uhidev0 at uhub0 port 1 configuration 1 interface 0 "QEMU QEMU USB Tablet" > rev 2.00/0.00 addr 2 > uhidev0: iclass 3/0 > ums0 at uhidev0: 3 buttons, Z dir > wsmouse1 at ums0 mux 0 > vscsi0 at root > scsibus3 at vscsi0: 256 targets > softraid0 at root > scsibus4 at softraid0: 256 targets > root on sd0a (053640a954c00285.a) swap on sd0b dump on sd0b > fd0 at fdc0 drive 1: density unknown > > -- > Kindest regards, > Tom Smyth. > -- Kindest regards, Tom Smyth.
