You ran out of swap.
On Feb 6, 2009, at 7:46 PM, Uwe Dippel <[email protected]> wrote:
Dear all,
for the first time ever I had one of my production boxes crashing.
And that was just a few hours after I allowed one of my users
ExecCGI in her home, in the chrooted, default, Apache.
The user was deploying some perl-script.
Can anyone with insight please look at the trace and point out to me
if there is a link between the +ExecCGI and the panic?
Was I blue-eyed when I allowed the deployment of perl as a non-
privileged user in the chrooted Apache, thinking that Apache and
perl would handle any exception well enough to not crash?
Thanks for advice,
Uwe
root on sd0a swap on sd0b dump on
sd0b panic: kernel
diagnostic assertion "uvmexp.swpgonly <= uvmexp.swpages" failed: f
ile "/usr/src/sys/uvm/uvm_pdaemon.c", line
573 Stopped at Debugger+0x5:
leave RUN AT LEAST 'trace'
AND 'ps' AND INCLUDE OUTPUT WHEN REPORTING THIS PANIC! DO NOT
EVEN BOTHER REPORTING THIS WITHOUT INCLUDING THAT INFORMATION!
ddb{1}>
trace
Debugger() at Debugger
+0x5 panic() at
panic+0x122
__assert() at __assert
+0x21
uvm_aiodone_daemon() at uvm_aiodone_daemon
+0x2fd uvm_aiodone_daemon() at
uvm_aiodone_daemon+0x9e8 uvm_pageout()
at uvm_pageout+0xca end
trace frame: 0x0, count: -6
ddb{1}>
PID PPID PGRP UID S FLAGS WAIT
COMMAND 11671 7706 11671 0 7
0 cron 7706 12712 12712 0
3 0x2000080 piperd cron 10810 18329
18329 67 3 0x2000180 netcon httpd
7948 18329 18329 67 3 0x2000180 netio
httpd 7911 18329 18329 67 3 0x2000180
netcon httpd 26768 18329 18329 67 3
0x2000180 netcon httpd 22062 18329
18329 67 2 0x100 httpd
1169 18329 18329 67 3 0x2000180 netcon
httpd 22624 18329 18329 67 2
0x100 httpd 18841 18329 18329
67 2 0x100 httpd 11509 18329
18329 67 7 0x100 httpd
22935 18329 18329 67 2 0x100
httpd 9398 18329 18329 67 2
0x100 httpd 23859 6501 23859
0 2 0x4000 sshd 10659 6501
10659 0 2 0x4000 sshd
27338 1 27338 1231 2 0x4002
vi 26143 18329 18329 67 2
0x100 httpd 5820 18329 18329
67 3 0x2000180 netio httpd 5758 18329
18329 67 2 0x100 httpd
12944 18329 18329 67 3 0x2000180 netio
httpd 2760 18329 18329 67 2
0x100 httpd 17215 18329 18329
67 3 0x2000180 netio httpd 26725 18329
18329 67 2 0x100 httpd
13133 18329 18329 67 3 0x2000180 netio
httpd 4211 18329 18329 67 2
0x100 httpd 3040 18329 18329
67 3 0x2000180 netio httpd 19165 18329
18329 67 2 0x100 httpd
30747 18329 18329 67 2 0x100
httpd 2122 18329 18329 67 3 0x2000180
netio httpd 30941 18329 18329 67 3
0x2000180 netio httpd 10089 18329
18329 67 3 0x2000180 netio httpd
8959 18329 18329 67 2 0x100
httpd 24254 18329 18329 67 2
0x100 httpd 23026 19319 19319
507 3 0x2004180 kqread pickup 30424 18329
18329 67 2 0x100 httpd
24054 18329 18329 67 2 0x100
httpd 18990 18329 18329 67 2
0x100 httpd 17856 18329 18329
67 2 0x100 httpd 29787 18329
18329 67 2 0x100 httpd
15163 18329 18329 67 3 0x2000180 netcon
httpd 3460 18329 18329 67 3 0x2000180
netcon httpd 29781 18329 18329 67
7 0x100 httpd 18890 18329
18329 67 2 0x100 httpd
23671 18329 18329 67 2 0x100
httpd 18329 1 18329 67 3 0x2000180
select httpd 16523 6501 16523 0
2 0x4000 sshd 5584 28667
5584 0 3 0x2004082 ttyin ksh
28667 1964 28667 1000 3 0x2004082 pause
ksh 1964 3128 3128 1000 3 0x2000180
select sshd 3128 6501 3128 0 3
0x2004180 netio sshd 23155 1 23155 0 3 0
x2004082 ttyin getty 26458 1 26458 0 3 0
x2004082 ttyin getty 20376 1 20376 0 3 0
x2004082 ttyin getty 10749 1 10749 0 3 0
x2004082 ttyin getty 25784 1 25784 0 3 0
x2004082 ttyin getty 8955 1 8955 0 3 0
x2004082 ttyin getty 12712 1 12712 0 3 0
x2000080 select cron 8769 1 8769 0 2 0
apcupsd 6275 2853 34 502 3
0x2004182 poll mysqld 4266 1 4266 0 3 0
x2000080 poll popa3d 2853 1 34 0 3 0
x2004082 pause sh 6501 1 6501 0 3 0
x2000080 select sshd 5531 1 5531 0 3 0
x2000180 select inetd 6371 1 6371 0 3 0
x2000080 poll ftpd 5689 19319 19319
507 3 0x2004180 kqread qmgr 19319 1 19319 0 3 0
x2004188 kqread master 27634 0 0 0 3 0
x2100200 acct acct 16891 30113 30113
83 3 0x2000180 poll ntpd 30113 1 30113 0 3 0
x2000080 poll ntpd 795 23463 23463
74 3 0x2000180 bpf pflogd 23463 1 23463 0 3 0
x2000080 netio pflogd 3030 6197 6197
73 3 0x2000180 poll syslogd 6197 1 6197 0 3 0
x2000088 netio syslogd 18 0 0 0 3 0
x2100200 bored crypto 17 0 0 0 3 0
x2100200 aiodoned aiodoned 16 0 0 0 3 0
x2100200 syncer update 15 0 0 0 3 0
x2100200 cleaner cleaner 14 0 0 0 3 0
x100200 reaper reaper * 13 0 0 0 7 0
x2100200 pagedaemon 12 0 0 0 3 0
x2100200 pftm pfpurge 11 0 0 0 3 0
x2100200 usbevt usb2 10 0 0 0 3 0
x2100200 usbevt usb1 9 0
0 0 3 0x2100200 usbtsk usbtask
8 0 0 0 3 0x2100200 usbevt
usb0 7 0 0 0 3 0x2100200
acpi_idle acpi0 6 0 0 0 3
0x100200 idle3 5 0
0 0 3 0x100200 idle2
4 0 0 0 3 0x100200
idle1 3 0 0 0 3 0x2100200
bored syswq 2 0 0 0 3
0x100200 idle0 1 0
1 0 3 0x2004080 wait init
0 -1 0 0 3 0x2080200 scheduler swapper
OpenBSD 4.4 (GENERIC.MP) #0: Tue Nov 25 17:31:06 SGT
2008 [email protected]:/usr/src/
sys/arch/amd64/compile/GENERIC.MP real mem = 2134089728
(2035MB) avail mem = 2072219648
(1976MB) mainbus0 at
root
bios0 at mainbus0: SMBIOS rev. 2.3 @ 0xec000 (62
entries) bios0: vendor HP version "D17" date
02/15/2006 bios0: HP ProLiant ML350
G4 acpi0 at
bios0: rev
2 acpi0:
tables DSDT FACP SPCR MCFG
APIC acpi0: wakeup
devices
acpitimer0 at acpi0: 3579545 Hz, 24
bits acpimadt0 at acpi0 addr
0xfee00000: PC-AT compat cpu0 at
mainbus0: apid 0 (boot
processor) cpu0: Intel(R)
Xeon(TM) CPU 3.00GHz, 3000.50 MHz
cpu0:
FPU,
VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CG
cpu0: 1MB 64b/line 8-way L2
cache cpu0: apic clock
running at 200MHz cpu1
at mainbus0: apid 6 (application
processor) cpu1: Intel(R) Xeon(TM) CPU
3.00GHz, 3000.11 MHz cpu1:
FPU,
VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CG
cpu1: 1MB 64b/line 8-way L2
cache cpu2 at mainbus0:
apid 1 (application processor) cpu2:
Intel(R) Xeon(TM) CPU 3.00GHz, 3000.13
MHz cpu2:
FPU,
VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CG
cpu2: 1MB 64b/line 8-way L2
cache cpu3 at mainbus0:
apid 7 (application processor) cpu3:
Intel(R) Xeon(TM) CPU 3.00GHz, 3000.11
MHz cpu3:
FPU,
VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CG
cpu3: 1MB 64b/line 8-way L2
cache ioapic0 at
mainbus0 apid 8 pa 0xfec00000, version 20, 24 pins
ioapic1 at mainbus0 apid 9 pa 0xfec10000, version 20, 24
pins ioapic1: misconfigured as apic 0, remapped to
apid 9 ioapic2 at mainbus0 apid 10 pa
0xfec80000, version 20, 24 pins ioapic3 at mainbus0
apid 11 pa 0xfec80400, version 20, 24 pins acpiprt0
at acpi0: bus 1
(IP2P) acpiprt1 at
acpi0: bus 2 (IPXB)
acpiprt2 at acpi0: bus 6
(PCXA) acpiprt3 at
acpi0: bus 9 (PCXB)
acpiprt4 at acpi0: bus 5
(PTA0) acpiprt5 at
acpi0: bus 13 (PTB0)
acpiprt6 at acpi0: bus 16
(PTC0) acpiprt7 at
acpi0: bus 0 (PCI0)
acpicpu0 at
acpi0
acpicpu1 at
acpi0
acpicpu2 at
acpi0
acpicpu3 at
acpi0
acpitz0 at acpi0: critical temperature 31
degC pci0 at mainbus0 bus 0:
configuration mode 1 pchb0 at pci0
dev 0 function 0 "Intel E7520 Host" rev 0x0c
ppb0 at pci0 dev 2 function 0 "Intel E7520 PCIE" rev
0x0c pci1 at ppb0 bus
5 ppb1
at pci1 dev 0 function 0 "Intel PCIE-PCIE" rev
0x09 pci2 at ppb1 bus
6 ppb2
at pci1 dev 0 function 2 "Intel PCIE-PCIE" rev
0x09 pci3 at ppb2 bus
9 ppb3
at pci0 dev 4 function 0 "Intel E7520 PCIE" rev
0x0c pci4 at ppb3 bus
13 ppb4
at pci0 dev 6 function 0 "Intel E7520 PCIE" rev
0x0c pci5 at ppb4 bus
16 ppb5
at pci0 dev 28 function 0 "Intel 6300ESB PCIX" rev
0x02 pci6 at ppb5 bus
2 mpi0
at pci6 dev 3 function 0 "Symbios Logic 53c1030" rev 0x08: apic 9
int 0 (i)
scsibus0 at mpi0: 16 targets, initiator
7 sd0 at scsibus0 targ 0 lun 0:
<COMPAQ, BF14686842, HPB4> SCSI3 0/direct fixed sd0: 140014MB,
41991 cyl, 10 head, 682 sec, 512 bytes/sec, 286749488 sec total sd1
at scsibus0 targ 2 lun 0: <COMPAQ, BD1468A4C5, HPB4> SCSI3 0/direct
fixed sd1: 140014MB, 90774 cyl, 4 head, 789 sec, 512 bytes/sec,
286749488 sec total mpi0: target 0 Sync at 160MHz width 16bit
offset 127 QAS 1 DT 1 IU 1 mpi0: target 2 Sync at 160MHz
width 16bit offset 63 QAS 1 DT 1 IU 1 mpi1 at pci6 dev 3
function 1 "Symbios Logic 53c1030" rev 0x08: apic 9 int 1 (i)
scsibus1 at mpi1: 16 targets, initiator
7 uhci0 at pci0 dev 29 function
0 "Intel 6300ESB USB" rev 0x02: apic 8 int 16 (ir)
uhci1 at pci0 dev 29 function 1 "Intel 6300ESB USB" rev 0x02: apic 8
int 19 (ir)
"Intel 6300ESB WDT" rev 0x02 at pci0 dev 29 function 4 not
configured "Intel 6300ESB APIC" rev 0x02 at pci0 dev 29
function 5 not configured ehci0 at pci0 dev 29 function 7
"Intel 6300ESB USB" rev 0x02: apic 8 int 23 (ir)
usb0 at ehci0: USB revision
2.0 uhub0 at usb0
"Intel EHCI root hub" rev 2.00/1.00 addr 1
ppb6 at pci0 dev 30 function 0 "Intel 82801BA Hub-to-PCI" rev
0x0a pci7 at ppb6 bus
1 bge0
at pci7 dev 2 function 0 "Broadcom BCM5705K" rev 0x03, BCM5705 A3
(0x3003)5
brgphy0 at bge0 phy 1: BCM5705 10/100/1000baseT PHY, rev.
2 vga1 at pci7 dev 3 function 0 "ATI Rage XL" rev
0x27 wsdisplay0 at vga1 mux 1: console
(80x25, vt100 emulation) wsdisplay0: screen 1-5
added (80x25, vt100 emulation) drm at vga1
unsupported
vendor "Compaq", unknown product 0x00d7 (class system subclass
miscellaneous, rd
pcib0 at pci0 dev 31 function 0 "Intel 6300ESB LPC" rev
0x02 pciide0 at pci0 dev 31 function 1 "Intel
6300ESB IDE" rev 0x02: DMA, channel 0 y
pciide0: channel 0 disabled (no
drives) atapiscsi0 at pciide0
channel 1 drive 0 scsibus2 at
atapiscsi0: 2 targets, initiator 7
cd0 at scsibus2 targ 0 lun 0: <HL-DT-ST, RW/DVD GCC-4481B, 2.05>
ATAPI 5/cdrom e
cd0(pciide0:1:0): using PIO mode 4, Ultra-DMA mode
2 usb1 at uhci0: USB revision
1.0 uhub1 at usb1
"Intel UHCI root hub" rev 1.00/1.00 addr 1
usb2 at uhci1: USB revision
1.0 uhub2 at usb2
"Intel UHCI root hub" rev 1.00/1.00 addr 1
isa0 at
pcib0
isadma0 at
isa0
com0 at isa0 port 0x3f8/8 irq 4: ns16550a, 16 byte
fifo com0:
console
pckbc0 at isa0 port
0x60/5 pckbd0 at
pckbc0 (kbd slot)
pckbc0: using irq 1 for kbd
slot wskbd0 at pckbd0:
console keyboard, using wsdisplay0 pcppi0
at isa0 port
0x61 midi0 at
pcppi0: <PC
speaker> spkr0 at
pcppi0
fdc0
at isa0 port 0x3f0/6 irq 6 drq
2 fd0 at fdc0 drive 0:
1.44MB 80 cyl, 2 head, 18 sec mtrr:
Pentium Pro MTRR
support ugen0 at
uhub2 port 1 "American Power Conversion Back-UPS RS 1000 FW:7.g8 .I
US2
softraid0 at
root
root on sd0a swap on sd0b dump on sd0b