After sourcing a new backup store and backing up the live data, we've updated the server and rebooted. On mount errors were reported with the filesystem so e2fsck used. Some errors were found and fixed, remounted, no errors. First attempted write to the volume (a simple save of new text file) returns an error, with the following logged (where the entries below are from the point the disk was remounted after e2fsck):
Apr 27 17:52:05 oaedata1 kernel: EXT4-fs (sda1): mounted filesystem with ordered data mode. Opts: (null) Apr 27 17:52:48 oaedata1 kernel: scsi_io_completion: 20 callbacks suppressed Apr 27 17:52:48 oaedata1 kernel: sd 2:0:0:0: [sda] tag#0 FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE Apr 27 17:52:48 oaedata1 kernel: sd 2:0:0:0: [sda] tag#0 Sense Key : Medium Error [current] Apr 27 17:52:48 oaedata1 kernel: sd 2:0:0:0: [sda] tag#0 Add. Sense: Peripheral device write fault Apr 27 17:52:48 oaedata1 kernel: sd 2:0:0:0: [sda] tag#0 CDB: Write(16) 8a 00 00 00 00 00 16 3e 48 00 00 00 00 08 00 00 Apr 27 17:52:48 oaedata1 kernel: blk_update_request: 20 callbacks suppressed Apr 27 17:52:48 oaedata1 kernel: blk_update_request: I/O error, dev sda, sector 373180416 Apr 27 17:52:48 oaedata1 kernel: EXT4-fs warning (device sda1): ext4_end_bio:329: I/O error -5 writing to inode 5571545 (offset 0 size 4096 starting block 46647553) Apr 27 17:52:48 oaedata1 kernel: Buffer I/O error on device sda1, logical block 46647296 Apr 27 17:52:52 oaedata1 kernel: sd 2:0:0:0: [sda] tag#0 FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE Apr 27 17:52:52 oaedata1 kernel: sd 2:0:0:0: [sda] tag#0 Sense Key : Medium Error [current] Apr 27 17:52:52 oaedata1 kernel: sd 2:0:0:0: [sda] tag#0 Add. Sense: Peripheral device write fault Apr 27 17:52:52 oaedata1 kernel: sd 2:0:0:0: [sda] tag#0 CDB: Write(16) 8a 00 00 00 00 00 16 3e 48 08 00 00 00 18 00 00 Apr 27 17:52:52 oaedata1 kernel: blk_update_request: I/O error, dev sda, sector 373180424 Apr 27 17:52:52 oaedata1 kernel: EXT4-fs warning (device sda1): ext4_end_bio:329: I/O error -5 writing to inode 5571544 (offset 0 size 12288 starting block 46647556) Apr 27 17:52:52 oaedata1 kernel: Buffer I/O error on device sda1, logical block 46647297 Apr 27 17:52:52 oaedata1 kernel: Buffer I/O error on device sda1, logical block 46647298 Apr 27 17:52:52 oaedata1 kernel: Buffer I/O error on device sda1, logical block 46647299 lines 741-793/793 (END) -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1418339 Title: kernel set the wrong max_sectors_kb for 4K disks(sd.c) Status in linux package in Ubuntu: Fix Released Bug description: [Impact] Problem Description =========================== We get following error messages on the console and IO fails. [ 63.322503] sd 0:2:2:0: [sdc] [ 63.322603] Result: hostbyte=DID_ERROR driverbyte=DRIVER_SENSE [ 63.322661] sd 0:2:2:0: [sdc] [ 63.322697] Sense Key : Illegal Request [current] [ 63.322757] sd 0:2:2:0: [sdc] [ 63.322792] Add. Sense: Invalid field in cdb [ 63.322839] sd 0:2:2:0: [sdc] CDB: [ 63.322874] Write(10): 2a 00 03 02 17 a0 00 00 80 00 [ 63.323038] blk_update_request: critical target error, dev sdc, sector 403750144 [ 63.323117] sd 0:2:2:0: [sdc] [ 63.323152] Result: hostbyte=DID_ERROR driverbyte=DRIVER_SENSE [ 63.323210] sd 0:2:2:0: [sdc] [ 63.323245] Sense Key : Illegal Request [current] [ 63.323303] sd 0:2:2:0: [sdc] [ 63.323338] Add. Sense: Invalid field in cdb [ 63.323385] sd 0:2:2:0: [sdc] CDB: [ 63.323420] Write(10): 2a 00 03 02 17 20 00 00 80 00 [ 63.323580] blk_update_request: critical target error, dev sdc, sector 403749120 [ 138.410612] EXT4-fs warning (device dm-2): ext4_end_bio:317: I/O error -121 writing to inode 265776 (offset 0 size 393216 starting block 33920) [ 138.410727] Buffer I/O error on device dm-2, logical block 33920 [ 138.410785] Buffer I/O error on device dm-2, logical block 33921 [ 138.410842] Buffer I/O error on device dm-2, logical block 33922 [ 138.410900] Buffer I/O error on device dm-2, logical block 33923 [ 138.410957] Buffer I/O error on device dm-2, logical block 33924 ---uname output--- Ubuntu 15.04 Machine Type = P8(Alpine) [Test Case] Steps to Reproduce ===================== read/write to a 4K array. [Fix] commit 3a9794d32984b67a6d8992226918618f0e51e5d5 upstream To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1418339/+subscriptions -- Mailing list: https://launchpad.net/~kernel-packages Post to : kernel-packages@lists.launchpad.net Unsubscribe : https://launchpad.net/~kernel-packages More help : https://help.launchpad.net/ListHelp