>Synopsis: panic in VOP (memory related)
>Category: kernel
>Environment:
System : OpenBSD 6.5
Details : OpenBSD 6.5 (GENERIC.MP) #1356: Sat Apr 13 15:16:41 MDT
2019
[email protected]:/usr/src/sys/arch/i386/compile/GENERIC.MP
Architecture: OpenBSD.i386
Machine : i386
>Description:
After changing from a trunk failover to a trunk lacp I noticed a
panic 3 days later. It may be unrelated though. This computer also runs
a BIND named with TSIG'ed forwarders. Also this box is vanilla 6.5 with
no patches afaik.
Script started on Tue Jun 18 15:52:25 2019
saturn# cu -l /dev/cuaU0 -s 115200
Connected to /dev/cuaU0 (speed 115200)
show panic
malloc: out of space in kmem_map
ddb{1}> bt
db_enter() at db_enter+0x4
panic() at panic+0xcc
malloc(10000,7f,1) at malloc+0x601
ufs_readdir(fb83c978) at ufs_readdir+0xdd
VOP_READDIR(d341726c,fb83c9c0,d349ad20,fb83c9b4) at VOP_READDIR+0x47
sys_getdents(d2c335dc,fb83ca30,fb83ca28) at sys_getdents+0x138
syscall(fb83ca70) at syscall+0x25e
Xsyscall_untramp(2b,246,cf7ce0c4,33,0) at Xsyscall_untramp+0xa9
end of kernel
ddb{1}> ps
PID TID PPID UID S FLAGS WAIT COMMAND
*82004 250927 90998 0 7 0x100002 find
90998 463353 61977 0 3 0x10008a pause sh
61977 491445 59318 0 3 0x10008a pause sh
59318 280811 2432 0 3 0x100090 piperd cron
51469 9786 4833 0 3 0x100083 ttyin ksh
4833 79481 44872 1000 3 0x10008b pause ksh
44872 506679 90735 1000 3 0x90 select sshd
90735 103812 52066 0 3 0x92 poll sshd
72995 334323 1 741 3 0x98 sigwait named
72995 241894 1 741 3 0x4000090 fsleep named
72995 478553 1 741 3 0x4000090 fsleep named
72995 213039 1 741 3 0x4000090 fsleep named
72995 459014 1 741 3 0x4000090 kqread named
51692 281771 1 0 3 0x80 kqread apmd
8376 214098 1 0 3 0x100083 ttyin getty
88506 212288 1 0 3 0x100083 ttyin getty
54578 419748 1 0 3 0x100083 ttyin getty
43812 76222 1 0 3 0x100083 ttyin getty
7639 275556 1 0 3 0x100083 ttyin getty
36544 357093 1 0 3 0x100083 ttyin getty
2432 52659 1 0 3 0x100098 poll cron
-30552or294329 1 99 3 0x100090 poll sndiod
-29305ore27672 1 110 3 0x100090 poll sndiod
36118 129582 29216 95 3 0x100092 kqread smtpd
21400 119838 29216 103 3 0x100092 kqread smtpd
24042 317812 29216 95 3 0x100092 kqread smtpd
53392 13677 29216 95 3 0x100092 kqread smtpd
94681 319002 29216 95 3 0x100092 kqread smtpd
95503 61245 29216 95 3 0x100092 kqread smtpd
29216 344734 1 0 3 0x100080 kqread smtpd
52066 219650 1 0 3 0x80 select sshd
38759 110608 9470 83 3 0x100092 poll ntpd
9470 206353 66304 83 3 0x100092 poll ntpd
66304 269532 1 0 3 0x100080 poll ntpd
63037 272766 49277 74 3 0x100092 bpf pflogd
49277 461075 1 0 3 0x80 netio pflogd
16256 250727 80346 73 3 0x100090 kqread syslogd
80346 153115 1 0 3 0x100082 netio syslogd
62821 389914 0 0 3 0x14200 pgzero zerothread
3520 174281 0 0 3 0x14200 aiodoned aiodoned
12773 513074 0 0 3 0x14200 syncer update
67870 378242 0 0 3 0x14200 cleaner cleaner
34835 317153 0 0 3 0x14200 reaper reaper
10663 336018 0 0 3 0x14200 pgdaemon pagedaemon
48171 492791 0 0 3 0x14200 bored crynlk
-50203or523271 0 0 3 0x14200 bored crypto
13291 324418 0 0 3 0x14200 usbtsk usbtask
62988 271438 0 0 3 0x14200 usbatsk usbatsk
77058 323742 0 0 3 0x14200 bored i915-hangcheck
8286 412695 0 0 3 0x14200 bored i915-dp
31829 22624 0 0 3 0x14200 bored i915
45420 129928 0 0 3 0x14200 bored sensors
4544 493833 0 0 3 0x40014200 acpi0 acpi0
75453 97411 0 0 3 0x40014200 idle1
21036 325882 0 0 3 0x14200 bored softnet
93805 4127 0 0 3 0x14200 bored systqmp
84409 167054 0 0 3 0x14200 bored systq
66609 397062 0 0 3 0x40014200 bored softclock
92442 147463 0 0 7 0x40014200 idle0
1563 454999 0 0 3 0x14200 bored smr
34281 385429 0 0 3 0x14200 kmalloc kmthread
1 280660 0 0 3 0x82 wait init
0 0 -1 0 3 0x10200 scheduler swapper
>How-To-Repeat:
unknown.
>Fix:
unknown.
dmesg:
OpenBSD 6.5 (GENERIC.MP) #1356: Sat Apr 13 15:16:41 MDT 2019
[email protected]:/usr/src/sys/arch/i386/compile/GENERIC.MP
real mem = 1064574976 (1015MB)
avail mem = 1029804032 (982MB)
mpath0 at root
scsibus0 at mpath0: 256 targets
mainbus0 at root
bios0 at mainbus0: date 11/25/09, BIOS32 rev. 0 @ 0xf0010, SMBIOS rev. 2.4 @
0xfc990 (28 entries)
bios0: vendor American Megatrends Inc. version "080015" date 11/25/2009
acpi0 at bios0: rev 0
acpi0: sleep states S0 S1 S4 S5
acpi0: tables DSDT FACP APIC MCFG OEMB ASF!
acpi0: wakeup devices P0P2(S4) P0P1(S4) USB0(S4) USB1(S4) USB2(S4) USB3(S4)
EUSB(S4) MC97(S4) P0P4(S4) P0P5(S4) P0P6(S4) P0P7(S4) P0P8(S4) P0P9(S4)
acpitimer0 at acpi0: 3579545 Hz, 24 bits
acpimadt0 at acpi0 addr 0xfee00000: PC-AT compat
cpu0 at mainbus0: apid 0 (boot processor)
cpu0: Genuine Intel(R) CPU N270 @ 1.60GHz ("GenuineIntel" 686-class) 1.60 GHz,
06-1c-02
cpu0:
FPU,V86,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,DTES64,MWAIT,DS-CPL,EST,TM2,SSSE3,xTPR,PDCM,MOVBE,NXE,LAHF,PERF,SENSOR,MELTDOWN
mtrr: Pentium Pro MTRR support, 8 var ranges, 88 fixed ranges
cpu0: apic clock running at 132MHz
cpu0: mwait min=64, max=64, C-substates=0.2.2.0.2, IBE
cpu1 at mainbus0: apid 1 (application processor)
cpu1: Genuine Intel(R) CPU N270 @ 1.60GHz ("GenuineIntel" 686-class) 1.60 GHz,
06-1c-02
cpu1:
FPU,V86,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,DTES64,MWAIT,DS-CPL,EST,TM2,SSSE3,xTPR,PDCM,MOVBE,NXE,LAHF,PERF,SENSOR,MELTDOWN
ioapic0 at mainbus0: apid 2 pa 0xfec00000, version 20, 24 pins, remapped
acpimcfg0 at acpi0
acpimcfg0: addr 0xe0000000, bus 0-255
acpiprt0 at acpi0: bus 0 (PCI0)
acpiprt1 at acpi0: bus 5 (P0P1)
acpiprt2 at acpi0: bus 1 (P0P4)
acpiprt3 at acpi0: bus 2 (P0P5)
acpiprt4 at acpi0: bus 3 (P0P6)
acpiprt5 at acpi0: bus 4 (P0P7)
acpiprt6 at acpi0: bus -1 (P0P8)
acpiprt7 at acpi0: bus -1 (P0P9)
acpicpu0 at acpi0: C1(@1 halt!)
acpicpu1 at acpi0: C1(@1 halt!)
"PNP0A08" at acpi0 not configured
acpicmos0 at acpi0
acpibtn0 at acpi0: PWRB
bios0: ROM list: 0xc0000/0xec00!
cpu0: unknown Enhanced SpeedStep CPU, msr 0x060f0c2706000c27
cpu0: using only highest and lowest power states
cpu0: Enhanced SpeedStep 1596 MHz: speeds: 1600, 800 MHz
pci0 at mainbus0 bus 0: configuration mode 1 (bios)
pchb0 at pci0 dev 0 function 0 "Intel 82945GME Host" rev 0x03
inteldrm0 at pci0 dev 2 function 0 "Intel 82945GME Video" rev 0x03
drm0 at inteldrm0
intagp0 at inteldrm0
agp0 at intagp0: aperture at 0xd0000000, size 0x10000000
inteldrm0: apic 2 int 16
inteldrm0: 1024x768, 32bpp
wsdisplay0 at inteldrm0 mux 1: console (std, vt100 emulation)
wsdisplay0: screen 1-5 added (std, vt100 emulation)
"Intel 82945GM Video" rev 0x03 at pci0 dev 2 function 1 not configured
ppb0 at pci0 dev 28 function 0 "Intel 82801GB PCIE" rev 0x02: apic 2 int 16
pci1 at ppb0 bus 1
em0 at pci1 dev 0 function 0 "Intel 82574L" rev 0x00: msi, address
00:90:0b:19:56:04
ppb1 at pci0 dev 28 function 1 "Intel 82801GB PCIE" rev 0x02: apic 2 int 17
pci2 at ppb1 bus 2
em1 at pci2 dev 0 function 0 "Intel 82574L" rev 0x00: msi, address
00:90:0b:19:56:05
ppb2 at pci0 dev 28 function 2 "Intel 82801GB PCIE" rev 0x02: apic 2 int 18
pci3 at ppb2 bus 3
em2 at pci3 dev 0 function 0 "Intel 82574L" rev 0x00: msi, address
00:90:0b:19:56:06
ppb3 at pci0 dev 28 function 3 "Intel 82801GB PCIE" rev 0x02: apic 2 int 19
pci4 at ppb3 bus 4
em3 at pci4 dev 0 function 0 "Intel 82574L" rev 0x00: msi, address
00:90:0b:19:56:07
uhci0 at pci0 dev 29 function 0 "Intel 82801GB USB" rev 0x02: apic 2 int 23
uhci1 at pci0 dev 29 function 1 "Intel 82801GB USB" rev 0x02: apic 2 int 19
uhci2 at pci0 dev 29 function 2 "Intel 82801GB USB" rev 0x02: apic 2 int 18
uhci3 at pci0 dev 29 function 3 "Intel 82801GB USB" rev 0x02: apic 2 int 16
ehci0 at pci0 dev 29 function 7 "Intel 82801GB USB" rev 0x02: apic 2 int 23
usb0 at ehci0: USB revision 2.0
uhub0 at usb0 configuration 1 interface 0 "Intel EHCI root hub" rev 2.00/1.00
addr 1
ppb4 at pci0 dev 30 function 0 "Intel 82801BAM Hub-to-PCI" rev 0xe2
pci5 at ppb4 bus 5
em4 at pci5 dev 2 function 0 "Intel 82541GI" rev 0x05: apic 2 int 18, address
00:90:0b:19:56:08
em5 at pci5 dev 3 function 0 "Intel 82541GI" rev 0x05: apic 2 int 19, address
00:90:0b:19:56:09
ichpcib0 at pci0 dev 31 function 0 "Intel 82801GBM LPC" rev 0x02: PM disabled
pciide0 at pci0 dev 31 function 1 "Intel 82801GB IDE" rev 0x02: DMA, channel 0
configured to compatibility, channel 1 configured to compatibility
pciide0: channel 0 disabled (no drives)
pciide0: channel 1 ignored (disabled)
pciide1 at pci0 dev 31 function 2 "Intel 82801GBM SATA" rev 0x02: DMA, channel
0 configured to native-PCI, channel 1 configured to native-PCI
pciide1: using apic 2 int 19 for native-PCI interrupt
wd0 at pciide1 channel 0 drive 1: <SanDisk SDSSDHII240G>
wd0: 1-sector PIO, LBA48, 228936MB, 468862128 sectors
wd0(pciide1:0:1): using PIO mode 4, Ultra-DMA mode 6
ichiic0 at pci0 dev 31 function 3 "Intel 82801GB SMBus" rev 0x02: apic 2 int 19
iic0 at ichiic0
spdmem0 at iic0 addr 0x50: 1GB DDR2 SDRAM non-parity PC2-5300CL5 SO-DIMM
usb1 at uhci0: USB revision 1.0
uhub1 at usb1 configuration 1 interface 0 "Intel UHCI root hub" rev 1.00/1.00
addr 1
usb2 at uhci1: USB revision 1.0
uhub2 at usb2 configuration 1 interface 0 "Intel UHCI root hub" rev 1.00/1.00
addr 1
usb3 at uhci2: USB revision 1.0
uhub3 at usb3 configuration 1 interface 0 "Intel UHCI root hub" rev 1.00/1.00
addr 1
usb4 at uhci3: USB revision 1.0
uhub4 at usb4 configuration 1 interface 0 "Intel UHCI root hub" rev 1.00/1.00
addr 1
isa0 at ichpcib0
isadma0 at isa0
com0 at isa0 port 0x3f8/8 irq 4: ns16550a, 16 byte fifo
com0: console
com1 at isa0 port 0x2f8/8 irq 3: ns16550a, 16 byte fifo
pckbc0 at isa0 port 0x60/5 irq 1 irq 12
pckbd0 at pckbc0 (kbd slot)
wskbd0 at pckbd0: console keyboard, using wsdisplay0
pcppi0 at isa0 port 0x61
spkr0 at pcppi0
lpt0 at isa0 port 0x378/4 irq 7
wbsio0 at isa0 port 0x2e/2: W83627THF rev 0x85
lm1 at wbsio0 port 0xa00/8: W83627THF
npx0 at isa0 port 0xf0/16: reported by CPUID; using exception 16
vscsi0 at root
scsibus1 at vscsi0: 256 targets
softraid0 at root
scsibus2 at softraid0: 256 targets
root on wd0a (75918ed5bff4301b.a) swap on wd0b dump on wd0b
usbdevs:
Controller /dev/usb0:
addr 01: 8086:0000 Intel, EHCI root hub
high speed, self powered, config 1, rev 1.00
driver: uhub0
Controller /dev/usb1:
addr 01: 8086:0000 Intel, UHCI root hub
full speed, self powered, config 1, rev 1.00
driver: uhub1
Controller /dev/usb2:
addr 01: 8086:0000 Intel, UHCI root hub
full speed, self powered, config 1, rev 1.00
driver: uhub2
Controller /dev/usb3:
addr 01: 8086:0000 Intel, UHCI root hub
full speed, self powered, config 1, rev 1.00
driver: uhub3
Controller /dev/usb4:
addr 01: 8086:0000 Intel, UHCI root hub
full speed, self powered, config 1, rev 1.00
driver: uhub4
