Hi again,
I have repeated softraid tests using six pcs of 1TB Samsung HDD 3G SATA
drives as RAID5 and I do not face the crash issue of the OS when using
SSDs in the RAID5.
Details of the RAID5 setting are in the attached file.
It looks like using SSD drives as RAID5 leads for some reason to the
OpenBSD 6.8 crash. Samsung 512MB PRO 860 SSDs have 6G SATA interface
(what is different compared to tested HDDs)
NB: Using those SSDs as RAID6 on debian Linux (buster - mdadm /
cryptoLUKS) does not face any issues
There are also no issues using those SSDs as RAID on FreeBSD
(TrueNAS).
Kind regards
Mark
On 27.02.21 04:30, Mark Schneider wrote:
Hi,
I face system crash on OpenBSD 6.8 when trying to use softraid RAID5
drive trying to write big files (like 10GBytes) to it.
I can reproduce the error (tested on two different systems with
OpenBSD 6.8 installed on an SSD drive or an USB stick). The RAID5
drive itself consist of six Samsung PRO 860 512GB SSDs.
In short:
bioctl -c 5 -l sd0a,sd1a,sd2a,sd3a,sd4a,sd5a softraid0
obsdssdarc# disklabel sd7
# /dev/rsd7c:
type: SCSI
disk: SCSI disk
label: SR RAID 5
duid: a50fb9a25bf07243
flags:
bytes/sector: 512
sectors/track: 255
tracks/cylinder: 511
sectors/cylinder: 130305
cylinders: 38379
total sectors: 5001073280
boundstart: 0
boundend: 5001073280
drivedata: 0
16 partitions:
# size offset fstype [fsize bsize cpg]
a: 5001073280 0 4.2BSD 8192 65536 52270
c: 5001073280 0 unused
#
--------------------------------------------------------------------------------
obsdssdarc# time dd if=/dev/urandom of=/arc-ssd/1GB-urandom.bin bs=1M
count=1024
1024+0 records in
1024+0 records out
1073741824 bytes transferred in 8.120 secs (132218264 bytes/sec)
0m08.13s real 0m00.00s user 0m08.14s system
# Working as expected
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
obsdssdarc# time dd if=/dev/urandom of=/arc-ssd/10GB-urandom.bin
bs=10M count=1024
# Error messages
uvm_fault(0xffffffff821f5490, 0x40, 0, 1) -> e
kernel: page fault trap, code=0
Stopped at sr_validate_io+0x44: cmpl $0,0x40(%r9)
ddb{2}>
# Crashing OpenBSD 6.8
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
# After reboot:
obsdssdarc# mount /dev/sd7a /arc-ssd/
mount_ffs: /dev/sd7a on /arc-ssd: Device not configure
obsdssdarc# grep sd7 /var/run/dmesg.boot
softraid0: trying to bring up sd7 degraded
softraid0: sd7 was not shutdown properly
softraid0: sd7 is offline, will not be brought online
More details in attached files. Thanks a lot in advance for short
feedback.
Kind regards
Mark
obsdarc# history -0
1 sysctl hw.disknames
3 dd if=/dev/zero of=/dev/rsd1c bs=1m count=1024
4 dd if=/dev/zero of=/dev/rsd2c bs=1m count=1024
5 dd if=/dev/zero of=/dev/rsd3c bs=1m count=1024
6 dd if=/dev/zero of=/dev/rsd4c bs=1m count=1024
7 dd if=/dev/zero of=/dev/rsd5c bs=1m count=1024
8 dd if=/dev/zero of=/dev/rsd6c bs=1m count=1024
9 fdisk -iy sd1
10 fdisk -iy sd2
11 fdisk -iy sd3
12 fdisk -iy sd4
13 fdisk -iy sd5
14 fdisk -iy sd6
15 disklabel -E sd1
16 disklabel -E sd2
17 disklabel -E sd3
18 disklabel -E sd4
19 disklabel -E sd5
20 disklabel -E sd6
21 bioctl -c 5 -l sd1a,sd2a,sd3a,sd4a,sd5a,sd6a softraid0
22 disklabel -E sd7
23 fdisk sd7
24 disklabel sd7
25 newfs sd7a
26 mkdir /arc-hdd
27 mount /dev/sd7a /arc-hdd/
30 dd if=/dev/urandom of=/arc-hdd/1GB-urandom.bin bs=1M count=1024
31 dd if=/dev/urandom of=/arc-hdd/512MB-urandom.bin bs=1M count=512
32 dd if=/dev/urandom of=/arc-hdd/2GB-urandom.bin bs=2M count=1024
33 dd if=/dev/urandom of=/arc-hdd/10GB-urandom.bin bs=10M count=1024
# ---
obsdarc# dd if=/dev/urandom of=/arc-hdd/10GB-urandom.bin bs=10M count=1024
1024+0 records in
1024+0 records out
10737418240 bytes transferred in 229.232 secs (46840774 bytes/sec)
/dev/sd7a 4.5T 13.5G 4.3T 0% /arc-hdd
# ---
obsdarc# disklabel sd1
# /dev/rsd1c:
type: SCSI
disk: SCSI disk
label: SAMSUNG HN-M101M
duid: 5107567be1a8f7aa
flags:
bytes/sector: 512
sectors/track: 63
tracks/cylinder: 255
sectors/cylinder: 16065
cylinders: 121601
total sectors: 1953525168
boundstart: 64
boundend: 1953520065
drivedata: 0
16 partitions:
# size offset fstype [fsize bsize cpg]
a: 1953520001 64 RAID
c: 1953525168 0 unused
