Hi,
when using softraid crypto with OpenBSD 4.6-current I never get more
than ~10-11 MB/s disk writing speed even though the disk (WD Raptor 73
GB) itself, without crypto, can do way more.
What I see during transfer in top/systat is a high interrupt load,
however the interrupt load when writing to a not encrypted partition is
even higher and the speed faster, so that doesn't seem to be the issue.
The crypto system process is shown as mostly bored in top. So, I am
wondering why softraid crypto never exceeds ~10-11 MB/s for me?
Ideas are welcome. It would also be nice if someone could check the
speed with their own softraid crypto setups.
To test the speed I downloaded a huge file (~3,5 GB) using FTP over gbit
ethernet.
Write performance measured:
to mfs partition: ~40 MB/s
to ffs partition: ~40 MB/s (doesn't matter if using softdep or not)
to softraid crypto partition: ~11 MB/s (+- 1 MB/s)
Those 40 MB/s are limited due to the other systems read performance.
However, softraid crypto seems (unreasonably ?) slow to me.
Michael
OpenBSD 4.6-current (GENERIC.MP) #0: Tue Nov 10 19:17:15 CET 2009
r...@***************:/usr/src/sys/arch/i386/compile/GENERIC.MP
cpu0: Intel(R) Pentium(R) 4 CPU 2.80GHz ("GenuineIntel" 686-class) 2.81
GHz
cpu0:
FPU,V86,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,SBF,SSE3,MWAIT,DS-CPL,CNXT-ID,xTPR
real mem = 4025843712 (3839MB)
avail mem = 3921633280 (3739MB)
mainbus0 at root
bios0 at mainbus0: AT/286+ BIOS, date 01/04/06, BIOS32 rev. 0 @ 0xffe90,
SMBIOS rev. 2.3 @ 0xfb030 (83 entries)
bios0: vendor Dell Computer Corporation version "A06" date 01/04/2006
bios0: Dell Computer Corporation PowerEdge 750
acpi0 at bios0: rev 0
acpi0: tables DSDT FACP APIC SPCR
acpi0: wakeup devices PCI0(S5) PCI1(S5) PCI2(S5) PCI3(S5)
acpitimer0 at acpi0: 3579545 Hz, 24 bits
acpimadt0 at acpi0 addr 0xfee00000: PC-AT compat
cpu0 at mainbus0: apid 0 (boot processor)
cpu0: apic clock running at 200MHz
cpu1 at mainbus0: apid 1 (application processor)
cpu1: Intel(R) Pentium(R) 4 CPU 2.80GHz ("GenuineIntel" 686-class) 2.81
GHz
cpu1:
FPU,V86,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,SBF,SSE3,MWAIT,DS-CPL,CNXT-ID,xTPR
ioapic0 at mainbus0: apid 2 pa 0xfec00000, version 20, 24 pins
ioapic0: misconfigured as apic 0, remapped to apid 2
ioapic1 at mainbus0: apid 3 pa 0xfec10000, version 20, 24 pins
ioapic1: misconfigured as apic 0, remapped to apid 3
acpiprt0 at acpi0: bus 0 (PCI0)
acpiprt1 at acpi0: bus 3 (PCI1)
acpiprt2 at acpi0: bus 2 (PCI2)
acpiprt3 at acpi0: bus 1 (PCI3)
acpicpu0 at acpi0
acpicpu1 at acpi0
bios0: ROM list: 0xc0000/0x8000 0xc8000/0x1000 0xc9000/0x4000
0xcd000/0x1000 0xce000/0x600 0xec000/0x4000!
ipmi at mainbus0 not configured
pci0 at mainbus0 bus 0: configuration mode 1 (bios)
pchb0 at pci0 dev 0 function 0 "Intel 82875P Host" rev 0x02
ppb0 at pci0 dev 3 function 0 "Intel 82875P CSA" rev 0x02
pci1 at ppb0 bus 1
em0 at pci1 dev 1 function 0 "Intel PRO/1000CT (82547GI)" rev 0x00: apic
2 int 18 (irq 11), address 00:14:22:0a:60:ea
ppb1 at pci0 dev 28 function 0 "Intel 6300ESB PCIX" rev 0x02
pci2 at ppb1 bus 2
aac0 at pci2 dev 1 function 0 "Adaptec ASR-2200S" rev 0x01: Dell
CERC-SATA apic 3 int 0 (irq 10)
aac0: Intel GC80302 IOP 100MHz, 48MB cache memory, optional battery not
installed
aac0: Kernel 4.1-0, Build 7419, S/N C748F4
scsibus0 at aac0: 64 targets
sd0 at scsibus0 targ 0 lun 0: <Adaptec, Container #00, > SCSI2 0/direct
fixed
sd0: 76253MB, 512 bytes/sec, 156167865 sec total
uhci0 at pci0 dev 29 function 0 "Intel 6300ESB USB" rev 0x02: apic 2 int
16 (irq 11)
uhci1 at pci0 dev 29 function 1 "Intel 6300ESB USB" rev 0x02: apic 2 int
19 (irq 10)
"Intel 6300ESB WDT" rev 0x02 at pci0 dev 29 function 4 not configured
"Intel 6300ESB APIC" rev 0x02 at pci0 dev 29 function 5 not configured
ehci0 at pci0 dev 29 function 7 "Intel 6300ESB USB" rev 0x02: apic 2 int
23 (irq 7)
usb0 at ehci0: USB revision 2.0
uhub0 at usb0 "Intel EHCI root hub" rev 2.00/1.00 addr 1
ppb2 at pci0 dev 30 function 0 "Intel 82801BA Hub-to-PCI" rev 0x0a
pci3 at ppb2 bus 3
em1 at pci3 dev 2 function 0 "Intel PRO/1000MT (82541GI)" rev 0x00: apic
2 int 21 (irq 7), address 00:14:22:0a:60:eb
"Dell DRAC 4 Embedded/Optional" rev 0x00 at pci3 dev 3 function 0 not
configured
puc0 at pci3 dev 3 function 1 "Dell DRAC 3 Virtual UART" rev 0x00:
ports: 1 com
com3 at puc0 port 0 apic 2 int 21 (irq 7): ns16550a, 16 byte fifo
com3: probed fifo depth: 0 bytes
"Dell DRAC 3 Optional" rev 0x00 at pci3 dev 3 function 2 not configured
vga1 at pci3 dev 14 function 0 "ATI Rage XL" rev 0x27
wsdisplay0 at vga1 mux 1: console (80x25, vt100 emulation)
wsdisplay0: screen 1-5 added (80x25, vt100 emulation)
ichpcib0 at pci0 dev 31 function 0 "Intel 6300ESB LPC" rev 0x02
pciide0 at pci0 dev 31 function 2 "Intel 6300ESB SATA" rev 0x02: DMA,
channel 0 configured to compatibility, channel 1 configured to
compatibility
atapiscsi0 at pciide0 channel 0 drive 0
scsibus1 at atapiscsi0: 2 targets
cd0 at scsibus1 targ 0 lun 0: <HL-DT-ST, CD-ROM GCR-8240N, 1.06> ATAPI
5/cdrom removable
cd0(pciide0:0:0): using PIO mode 4, Ultra-DMA mode 2
wd0 at pciide0 channel 1 drive 0: <WDC WD740GD-00FLA0>
wd0: 16-sector PIO, LBA48, 70911MB, 145226112 sectors
wd1 at pciide0 channel 1 drive 1: <WDC WD740GD-50FLA2>
wd1: 16-sector PIO, LBA48, 70911MB, 145226112 sectors
wd0(pciide0:1:0): using PIO mode 4, Ultra-DMA mode 6
wd1(pciide0:1:1): using PIO mode 4, Ultra-DMA mode 6
ichiic0 at pci0 dev 31 function 3 "Intel 6300ESB SMBus" rev 0x02: apic 2
int 17 (irq 5)
iic0 at ichiic0
spdmem0 at iic0 addr 0x50: 1GB DDR SDRAM ECC PC3200CL3.0
spdmem1 at iic0 addr 0x51: 1GB DDR SDRAM ECC PC3200CL3.0
spdmem2 at iic0 addr 0x52: 1GB DDR SDRAM ECC PC3200CL3.0
spdmem3 at iic0 addr 0x53: 1GB DDR SDRAM ECC PC3200CL3.0
usb1 at uhci0: USB revision 1.0
uhub1 at usb1 "Intel UHCI root hub" rev 1.00/1.00 addr 1
usb2 at uhci1: USB revision 1.0
uhub2 at usb2 "Intel UHCI root hub" rev 1.00/1.00 addr 1
isa0 at ichpcib0
isadma0 at isa0
com0 at isa0 port 0x3f8/8 irq 4: ns16550a, 16 byte fifo
com1 at isa0 port 0x2f8/8 irq 3: ns16550a, 16 byte fifo
pckbc0 at isa0 port 0x60/5
pckbd0 at pckbc0 (kbd slot)
pckbc0: using irq 1 for kbd slot
wskbd0 at pckbd0: console keyboard, using wsdisplay0
pcppi0 at isa0 port 0x61
midi0 at pcppi0: <PC speaker>
spkr0 at pcppi0
npx0 at isa0 port 0xf0/16: reported by CPUID; using exception 16
fdc0 at isa0 port 0x3f0/6 irq 6 drq 2
fd0 at fdc0 drive 0: 1.44MB 80 cyl, 2 head, 18 sec
mtrr: Pentium Pro MTRR support
uhidev0 at uhub2 port 1 configuration 1 interface 0 "Microsoft Microsoft
IntelliMouse\M-. Explorer" rev 2.00/4.24 addr 2
uhidev0: iclass 3/1, 3 report ids
ums0 at uhidev0 reportid 1: 5 buttons, Z dir
wsmouse0 at ums0 mux 0
uhid0 at uhidev0 reportid 2: input=0, output=0, feature=1
uhid1 at uhidev0 reportid 3: input=1, output=0, feature=1
vscsi0 at root
scsibus2 at vscsi0: 256 targets
softraid0 at root
scsibus3 at softraid0: 1 targets
sd1 at scsibus3 targ 0 lun 0: <OPENBSD, SR RAID 1, 003> SCSI2 0/direct fixed
sd1: 41685MB, 512 bytes/sec, 85371367 sec total
softraid0: volume sd1 is roaming, it used to be sd0, updating metadata
root on wd0a swap on wd0b dump on wd0b
scsibus4 at softraid0: 1 targets
sd2 at scsibus4 targ 0 lun 0: <OPENBSD, SR CRYPTO, 003> SCSI2 0/direct fixed
sd2: 41684MB, 512 bytes/sec, 85369268 sec total
softraid0: volume sd2 is roaming, it used to be sd1, updating metadata
softraid0: roaming device sd0a -> sd1a
scsibus5 at softraid0: 1 targets
sd3 at scsibus5 targ 0 lun 0: <OPENBSD, SR CRYPTO, 003> SCSI2 0/direct fixed
sd3: 29218MB, 512 bytes/sec, 59839947 sec total
softraid0: volume sd3 is roaming, it used to be sd2, updating metadata
scsibus6 at softraid0: 1 targets
sd4 at scsibus6 targ 0 lun 0: <OPENBSD, SR CRYPTO, 003> SCSI2 0/direct fixed
sd4: 76253MB, 512 bytes/sec, 156167723 sec total
