Hi Russel
If I interpret the output correctly some Sync and Wait times are average
per Request. So you are seeing millisecond delays per request not in total.
See for example this:
------------- ----- ----- ----- ----- ----- ----- ----- -----
----- ----- ----- ----- ----- ----- ----- -----
uhome 16.1T 42.1T 0 360 0 2.56M - 26ms
- 4ms - 589ns - 26ms - -
raidz2 16.1T 42.1T 0 360 0 2.56M - 26ms
- 4ms - 589ns - 26ms - -
c5t8d1p0 - - 0 42 0 315K - 28ms
- 4ms - 548ns - 28ms - -
c5t9d1p0 - - 0 42 0 311K - 33ms
- 4ms - 438ns - 33ms - -
c5t10d1p0 - - 0 45 0 331K - 22ms
- 4ms - 493ns - 21ms - -
c5t11d1p0 - - 0 42 0 339K - 28ms
- 4ms - 768ns - 28ms - -
c5t12d1p0 - - 0 44 0 355K - 27ms
- 4ms - 987ns - 26ms - -
c5t13d1p0 - - 0 46 0 331K - 26ms
- 4ms - 493ns - 25ms - -
c5t14d1p0 - - 0 49 0 327K - 25ms
- 4ms - 493ns - 23ms - -
c5t15d1p0 - - 0 44 0 311K - 24ms
- 5ms - 493ns - 21ms - -
If I my interpretation is correct that is 360 Requests at about a flush
rate of 26ms each. And 90% of that is waiting for the disk.
A bit later we have:
------------- ----- ----- ----- ----- ----- ----- ----- -----
----- ----- ----- ----- ----- ----- ----- -----
uhome 16.1T 42.1T 0 529 0 25.8M - 1ms
- 416us - - - 1ms - -
raidz2 16.1T 42.1T 0 529 0 25.8M - 1ms
- 416us - - - 1ms - -
c5t8d1p0 - - 0 72 0 3.20M - 1ms
- 387us - - - 1ms - -
c5t9d1p0 - - 0 63 0 3.19M - 1ms
- 371us - - - 1ms - -
c5t10d1p0 - - 0 65 0 3.20M - 1ms
- 387us - - - 1ms - -
c5t11d1p0 - - 0 64 0 3.23M - 1ms
- 396us - - - 1ms - -
c5t12d1p0 - - 0 65 0 3.26M - 1ms
- 461us - - - 1ms - -
c5t13d1p0 - - 0 62 0 3.25M - 1ms
- 472us - - - 1ms - -
c5t14d1p0 - - 0 67 0 3.24M - 1ms
- 425us - - - 1ms - -
c5t15d1p0 - - 0 65 0 3.22M - 1ms
- 436us - - - 1ms - -
------------- ----- ----- ----- ----- ----- ----- ----- -----
----- ----- ----- ----- ----- ----- ----- -----
Still meh but better.
In comparison on the OI builderserver at Hetzner (AX161) NVME SSD I get
between 200 microseconds to 1 milisecond on asyncq_wait and 1-3
microseconds on syncq_wait
<snip>
capacity operations bandwidth total_wait
disk_wait syncq_wait asyncq_wait scrub trim
pool alloc free read write read write read write
read write read write read write wait wait
---------- ----- ----- ----- ----- ----- ----- ----- -----
----- ----- ----- ----- ----- ----- ----- -----
rpool 763G 6.24T 0 51 0 2.16M - 61us
- 60us - 2us - - - -
raidz1 763G 6.24T 0 51 0 2.16M - 61us
- 60us - 2us - - - -
c2t1d0 - - 0 12 0 552K - 60us
- 56us - 2us - - - -
c3t1d0 - - 0 12 0 552K - 64us
- 64us - 1us - - - -
c5t1d0 - - 0 12 0 552K - 60us
- 60us - 2us - - - -
c6t1d0 - - 0 12 0 552K - 60us
- 60us - 2us - - - -
---------- ----- ----- ----- ----- ----- ----- ----- -----
----- ----- ----- ----- ----- ----- ----- -----
capacity operations bandwidth total_wait
disk_wait syncq_wait asyncq_wait scrub trim
pool alloc free read write read write read write
read write read write read write wait wait
---------- ----- ----- ----- ----- ----- ----- ----- -----
----- ----- ----- ----- ----- ----- ----- -----
rpool 762G 6.24T 0 1.74K 0 30.6M - 794us
- 94us - 2us - 714us - -
raidz1 762G 6.24T 0 1.74K 0 30.6M - 794us
- 94us - 2us - 714us - -
c2t1d0 - - 0 453 0 7.65M - 810us
- 92us - 1us - 746us - -
c3t1d0 - - 0 443 0 7.64M - 849us
- 90us - 2us - 755us - -
c5t1d0 - - 0 449 0 7.65M - 699us
- 98us - 1us - 625us - -
c6t1d0 - - 0 441 0 7.63M - 818us
- 96us - 2us - 731us - -
---------- ----- ----- ----- ----- ----- ----- ----- -----
----- ----- ----- ----- ----- ----- ----- -----
capacity operations bandwidth total_wait
disk_wait syncq_wait asyncq_wait scrub trim
pool alloc free read write read write read write
read write read write read write wait wait
---------- ----- ----- ----- ----- ----- ----- ----- -----
----- ----- ----- ----- ----- ----- ----- -----
rpool 762G 6.24T 0 63 0 2.66M - 57us
- 56us - 2us - - - -
raidz1 762G 6.24T 0 63 0 2.66M - 57us
- 56us - 2us - - - -
c2t1d0 - - 0 15 0 680K - 58us
- 58us - 1us - - - -
c3t1d0 - - 0 15 0 680K - 55us
- 55us - 2us - - - -
c5t1d0 - - 0 15 0 681K - 58us
- 55us - 2us - - - -
c6t1d0 - - 0 15 0 681K - 58us
- 55us - 2us - - - -
---------- ----- ----- ----- ----- ----- ----- ----- -----
----- ----- ----- ----- ----- ----- ----- -----
capacity operations bandwidth total_wait
disk_wait syncq_wait asyncq_wait scrub trim
pool alloc free read write read write read write
read write read write read write wait wait
---------- ----- ----- ----- ----- ----- ----- ----- -----
----- ----- ----- ----- ----- ----- ----- -----
rpool 762G 6.24T 0 7 0 340K - 67us
- 61us - 2us - - - -
raidz1 762G 6.24T 0 7 0 340K - 67us
- 61us - 2us - - - -
c2t1d0 - - 0 1 0 84.9K - 73us
- 49us - 2us - - - -
c3t1d0 - - 0 1 0 84.9K - 73us
- 73us - 3us - - - -
c5t1d0 - - 0 1 0 84.9K - 49us
- 49us - 1us - - - -
c6t1d0 - - 0 1 0 84.9K - 73us
- 73us - 2us - - - -
---------- ----- ----- ----- ----- ----- ----- ----- -----
----- ----- ----- ----- ----- ----- ----- -----
capacity operations bandwidth total_wait
disk_wait syncq_wait asyncq_wait scrub trim
pool alloc free read write read write read write
read write read write read write wait wait
---------- ----- ----- ----- ----- ----- ----- ----- -----
----- ----- ----- ----- ----- ----- ----- -----
rpool 762G 6.24T 0 31 0 1.33M - 59us
- 55us - 2us - - - -
raidz1 762G 6.24T 0 31 0 1.33M - 59us
- 55us - 2us - - - -
c2t1d0 - - 0 7 0 340K - 61us
- 49us - 1us - - - -
c3t1d0 - - 0 7 0 340K - 61us
- 61us - 2us - - - -
c5t1d0 - - 0 7 0 340K - 61us
- 61us - 2us - - - -
c6t1d0 - - 0 7 0 340K - 55us
- 49us - 1us - - - -
---------- ----- ----- ----- ----- ----- ----- ----- -----
----- ----- ----- ----- ----- ----- ----- -----
capacity operations bandwidth total_wait
disk_wait syncq_wait asyncq_wait scrub trim
pool alloc free read write read write read write
read write read write read write wait wait
---------- ----- ----- ----- ----- ----- ----- ----- -----
----- ----- ----- ----- ----- ----- ----- -----
rpool 762G 6.24T 0 11 0 510K - 61us
- 57us - 2us - - - -
raidz1 762G 6.24T 0 11 0 510K - 61us
- 57us - 2us - - - -
c2t1d0 - - 0 2 0 128K - 49us
- 49us - 2us - - - -
c3t1d0 - - 0 2 0 128K - 65us
- 65us - 2us - - - -
c5t1d0 - - 0 2 0 127K - 81us
- 65us - 2us - - - -
c6t1d0 - - 0 2 0 127K - 49us
- 49us - 3us - - - -
---------- ----- ----- ----- ----- ----- ----- ----- -----
----- ----- ----- ----- ----- ----- ----- -----
capacity operations bandwidth total_wait
disk_wait syncq_wait asyncq_wait scrub trim
pool alloc free read write read write read write
read write read write read write wait wait
---------- ----- ----- ----- ----- ----- ----- ----- -----
----- ----- ----- ----- ----- ----- ----- -----
rpool 762G 6.24T 0 684 0 6.38M - 308us
- 63us - 2us - 273us - -
raidz1 762G 6.24T 0 684 0 6.38M - 308us
- 63us - 2us - 273us - -
c2t1d0 - - 0 167 0 1.60M - 319us
- 67us - 2us - 298us - -
c3t1d0 - - 0 164 0 1.59M - 342us
- 67us - 1us - 300us - -
c5t1d0 - - 0 180 0 1.60M - 269us
- 55us - 1us - 228us - -
c6t1d0 - - 0 170 0 1.59M - 305us
- 64us - 2us - 270us - -
---------- ----- ----- ----- ----- ----- ----- ----- -----
----- ----- ----- ----- ----- ----- ----- -----
capacity operations bandwidth total_wait
disk_wait syncq_wait asyncq_wait scrub trim
pool alloc free read write read write read write
read write read write read write wait wait
---------- ----- ----- ----- ----- ----- ----- ----- -----
----- ----- ----- ----- ----- ----- ----- -----
rpool 762G 6.24T 0 27 0 1.16M - 56us
- 56us - 2us - - - -
raidz1 762G 6.24T 0 27 0 1.16M - 56us
- 56us - 2us - - - -
c2t1d0 - - 0 6 0 298K - 56us
- 56us - 1us - - - -
c3t1d0 - - 0 6 0 298K - 63us
- 63us - 2us - - - -
c5t1d0 - - 0 6 0 297K - 56us
- 56us - 2us - - - -
c6t1d0 - - 0 6 0 297K - 49us
- 49us - 2us - - - -
---------- ----- ----- ----- ----- ----- ----- ----- -----
----- ----- ----- ----- ----- ----- ----- -----
</snip>
So the High Capacity of your disks comes with a Price (Speed). Also
there are some high Capacity disks people have been warning against, due
to poor performance.
In general You will see some improvement by tweaking things. But my gut
tells me you won't see massive improvement unless you but the home of
that user on the RPOOL and use the Disks only as Datastorage mounted
somewhere underneath the users home.
Hope this helps
-Till
On 06.09.21 17:14, russell wrote:
Hi
Thank you for the all the advice and suggestions.
After overclocking the Memory and CPU from 3.7GHz to 4GHz I managed to
reduce the previous login by 20 seconds, so it now 1 minute 30 seconds.
In an effort to discovery why the logout time is so long I login in via
ssh and ran both iostat 1 and zpool iostat -lv 1 before logging out on
the GUI
Apologises the long email I thave tried to remove as much unnecessary
information
iostat results are below
tty rpool1 sd0 sd1 sd2 cpu
tin tout kps tps serv kps tps serv kps tps serv kps tps serv us sy
dt id
1 467 2485 61 3 1221 30 0 1264 32 0 0 0 0 1
1 0 98
0 2649 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
100
0 2495 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
100
0 2493 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
100 <- line repeats 19 times
tin tout kps tps serv kps tps serv kps tps serv kps tps serv us
sy dt id
0 2494 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
100
0 2649 48 6 0 40 4 0 8 2 0 0 0 0 1 0
0 99
0 2493 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
100
0 2492 0 0 0 0 0 0 0 0 0 0 0 0 2 3 0
96 <- logout started
0 2496 8473 29 6 4240 16 3 4232 15 3 0 0 0 2
6 0 92
0 2494 3966 191 2 1991 99 0 1975 96 0 0 0 0 5
12 0 83
0 2495 0 0 0 0 0 0 0 0 0 0 0 0 5 12
0 83
0 2494 0 0 0 0 0 0 0 0 0 0 0 0 5 12 0
83 <- line repeats 13 times
tin tout kps tps serv kps tps serv kps tps serv kps tps serv us sy dt id
0 2493 0 0 0 0 0 0 0 0 0 0 0 0 5 12
0 83
0 2649 1184 109 1 592 55 0 592 58 0 0 0 0 5 12
0 83
0 2494 0 0 0 0 0 0 0 0 0 0 0 0 5 12 0
83 <- line repeats 16 times
tty rpool1 sd0 sd1 sd2 cpu
tin tout kps tps serv kps tps serv kps tps serv kps tps serv us sy
dt id
0 2493 0 0 0 0 0 0 0 0 0 0 0 0 5 12
0 83
0 2649 0 0 0 0 0 0 0 0 0 0 0 0 5 12
0 83
0 2493 1232 114 1 616 59 0 616 59 0 0 0 0 5 12
0 83
0 2493 0 0 0 0 0 0 0 0 0 0 0 0 5 12 0
83 <- line repeats 24 times
0 2493 1096 120 1 548 62 0 548 62 0 0 0 0 5 12
0 83
0 2494 0 0 0 0 0 0 0 0 0 0 0 0 5 12 0
83 <- line repeats 34 times
0 2493 1712 135 1 856 69 0 856 70 0 0 0 0 5 12
0 83
0 2494 0 0 0 0 0 0 0 0 0 0 0 0 5 12 0
83 0 2493 0 0 0 0 0 0 0 0 0 0 0 0 5 12
0 83
0 2493 0 0 0 0 0 0 0 0 0 0 0 0 5 12
0 83
0 2493 0 0 0 0 0 0 0 0 0 0 0 0 5 12
0 83
0 2492 1272 117 1 636 61 0 636 60 0 0 0 0 5 12
0 83
0 2495 0 0 0 0 0 0 0 0 0 0 0 0 5 12
0 83
0 2493 0 0 0 0 0 0 0 0 0 0 0 0 5 12
0 83
0 2493 0 0 0 0 0 0 0 0 0 0 0 0 5 12
0 83
0 2492 8 2 1 4 2 0 4 2 0 0 0 0 5 11
0 84
0 2493 1528 146 1 764 75 0 764 75 0 0 0 0 5 10
0 84
0 2493 8 2 1 4 2 0 4 2 0 0 0 0 6 5
0 89
0 2619 24 6 0 12 6 0 12 6 0 0 0 0 9 4
0 87
0 2494 0 0 0 0 0 0 0 0 0 0 0 0 6 3
0 91
tty rpool1 sd0 sd1 sd2 cpu
tin tout kps tps serv kps tps serv kps tps serv kps tps serv us sy
dt id
0 2493 0 0 0 0 0 0 0 0 0 0 0 0 6 3
0 91
0 2648 4256 184 3 2128 93 0 2128 95 0 0 0 0 5
3 0 91
0 2497 0 0 0 0 0 0 0 0 0 0 0 0 6 3
0 91
0 2492 0 0 0 0 0 0 0 0 0 0 0 0 5 3
0 91
0 2493 0 0 0 0 0 0 0 0 0 0 0 0 6 3
0 91
0 2494 0 0 0 0 0 0 0 0 0 0 0 0 6 3
0 91
1 2523 0 0 0 0 0 0 0 0 0 0 0 0 6 3
0 91
0 80 0 0 0 0 0 0 0 0 0 0 0 0 6 3 0
91 <- GUI Login presented
zpool iostat -lv 1
capacity operations bandwidth total_wait
disk_wait syncq_wait asyncq_wait scrub trim
pool alloc free read write read write read write
read write read write read write wait wait
------------- ----- ----- ----- ----- ----- ----- ----- -----
----- ----- ----- ----- ----- ----- ----- -----
rpool1 146G 318G 0 0 0 0 - - -
- - - - - - -
mirror 146G 318G 0 0 0 0 - - -
- - - - - - -
c4t0d0 - - 0 0 0 0 - - -
- - - - - - -
c4t2d0 - - 0 0 0 0 - - -
- - - - - - -
------------- ----- ----- ----- ----- ----- ----- ----- -----
----- ----- ----- ----- ----- ----- ----- -----
uhome 16.1T 42.1T 0 0 0 0 - - -
- - - - - - -
raidz2 16.1T 42.1T 0 0 0 0 - - -
- - - - - - -
c5t8d1p0 - - 0 0 0 0 - - -
- - - - - - -
c5t9d1p0 - - 0 0 0 0 - - -
- - - - - - -
c5t10d1p0 - - 0 0 0 0 - - -
- - - - - - -
c5t11d1p0 - - 0 0 0 0 - - -
- - - - - - -
c5t12d1p0 - - 0 0 0 0 - - -
- - - - - - -
c5t13d1p0 - - 0 0 0 0 - - -
- - - - - - -
c5t14d1p0 - - 0 0 0 0 - - -
- - - - - - -
c5t15d1p0 - - 0 0 0 0 - - -
- - - - - - -
------------- ----- ----- ----- ----- ----- ----- ----- -----
----- ----- ----- ----- ----- ----- ----- -----
capacity operations bandwidth total_wait
disk_wait syncq_wait asyncq_wait scrub trim
pool alloc free read write read write read write
read write read write read write wait wait
------------- ----- ----- ----- ----- ----- ----- ----- -----
----- ----- ----- ----- ----- ----- ----- -----
rpool1 146G 318G 5 0 47.9K 0 376us -
376us - 832ns - - - -
- GUI Logout starts
mirror 146G 318G 5 0 47.9K 0 376us -
376us - 832ns - - - - -
c4t0d0 - - 3 0 39.9K 0 344us -
344us - 864ns - - - - -
c4t2d0 - - 1 0 7.98K 0 442us -
442us - 768ns - - - - -
------------- ----- ----- ----- ----- ----- ----- ----- -----
----- ----- ----- ----- ----- ----- ----- -----
uhome 16.1T 42.1T 0 0 0 0 - - -
- - - - - - -
raidz2 16.1T 42.1T 0 0 0 0 - - -
- - - - - - -
------------- ----- ----- ----- ----- ----- ----- ----- -----
----- ----- ----- ----- ----- ----- ----- -----
capacity operations bandwidth total_wait
disk_wait syncq_wait asyncq_wait scrub trim
pool alloc free read write read write read write
read write read write read write wait wait
------------- ----- ----- ----- ----- ----- ----- ----- -----
----- ----- ----- ----- ----- ----- ----- -----
rpool1 146G 318G 0 0 0 0 - - -
- - - - - - -
mirror 146G 318G 0 0 0 0 - - -
- - - - - - -
c4t0d0 - - 0 0 0 0 - - -
- - - - - - -
c4t2d0 - - 0 0 0 0 - - -
- - - - - - -
------------- ----- ----- ----- ----- ----- ----- ----- -----
----- ----- ----- ----- ----- ----- ----- -----
uhome 16.1T 42.1T 0 7 0 35.9K -
393us - 393us - - - 864ns - -
raidz2 16.1T 42.1T 0 7 0 35.9K -
393us - 393us - - - 864ns - -
c5t8d1p0 - - 0 0 0 3.99K -
393us - 393us - - - 768ns - -
c5t9d1p0 - - 0 0 0 3.99K -
393us - 393us - - - 768ns - -
c5t10d1p0 - - 0 0 0 3.99K -
393us - 393us - - - 768ns - -
c5t11d1p0 - - 0 0 0 3.99K -
393us - 393us - - - 768ns - -
c5t12d1p0 - - 0 0 0 3.99K -
393us - 393us - - - 1us - -
c5t13d1p0 - - 0 0 0 3.99K -
393us - 393us - - - 768ns - -
c5t14d1p0 - - 0 0 0 3.99K -
393us - 393us - - - 768ns - -
c5t15d1p0 - - 0 0 0 7.98K -
393us - 393us - - - 768ns - -
------------- ----- ----- ----- ----- ----- ----- ----- -----
----- ----- ----- ----- ----- ----- ----- -----
capacity operations bandwidth total_wait
disk_wait syncq_wait asyncq_wait scrub trim
pool alloc free read write read write read write
read write read write read write wait wait
------------- ----- ----- ----- ----- ----- ----- ----- -----
----- ----- ----- ----- ----- ----- ----- -----
rpool1 146G 318G 0 0 0 0 - - -
- - - - - - -
mirror 146G 318G 0 0 0 0 - - -
- - - - - - -
c4t0d0 - - 0 0 0 0 - - -
- - - - - - -
c4t2d0 - - 0 0 0 0 - - -
- - - - - - -
------------- ----- ----- ----- ----- ----- ----- ----- -----
----- ----- ----- ----- ----- ----- ----- -----
uhome 16.1T 42.1T 0 360 0 2.56M - 26ms -
4ms - 589ns - 26ms - -
raidz2 16.1T 42.1T 0 360 0 2.56M -
26ms - 4ms - 589ns - 26ms - -
c5t8d1p0 - - 0 42 0 315K -
28ms - 4ms - 548ns - 28ms - -
c5t9d1p0 - - 0 42 0 311K -
33ms - 4ms - 438ns - 33ms - -
c5t10d1p0 - - 0 45 0 331K -
22ms - 4ms - 493ns - 21ms - -
c5t11d1p0 - - 0 42 0 339K -
28ms - 4ms - 768ns - 28ms - -
c5t12d1p0 - - 0 44 0 355K -
27ms - 4ms - 987ns - 26ms - -
c5t13d1p0 - - 0 46 0 331K -
26ms - 4ms - 493ns - 25ms - -
c5t14d1p0 - - 0 49 0 327K -
25ms - 4ms - 493ns - 23ms - -
c5t15d1p0 - - 0 44 0 311K -
24ms - 5ms - 493ns - 21ms - -
------------- ----- ----- ----- ----- ----- ----- ----- -----
----- ----- ----- ----- ----- ----- ----- -----
capacity operations bandwidth total_wait
disk_wait syncq_wait asyncq_wait scrub trim
pool alloc free read write read write read write
read write read write read write wait wait
------------- ----- ----- ----- ----- ----- ----- ----- -----
----- ----- ----- ----- ----- ----- ----- -----
rpool1 146G 318G 26 1 8.23M 7.98K 4ms 786us
4ms 786us 725ns 1us 1ms - - -
mirror 146G 318G 26 1 8.23M 7.98K 4ms 786us
4ms 786us 725ns 1us 1ms - - -
c4t0d0 - - 13 0 4.12M 3.99K 4ms 786us
3ms 786us 691ns 1us 1ms - - -
c4t2d0 - - 12 0 4.11M 3.99K 4ms 786us
4ms 786us 768ns 1us 1ms - - -
------------- ----- ----- ----- ----- ----- ----- ----- -----
----- ----- ----- ----- ----- ----- ----- -----
uhome 16.1T 42.1T 1 15 7.98K 351K 3ms 417us
3ms 417us 1us 840ns - - - -
raidz2 16.1T 42.1T 1 15 7.98K 351K 3ms 417us
3ms 417us 1us 840ns - - - -
c5t8d1p0 - - 0 1 0 43.9K -
393us - 393us - 768ns - - - -
c5t9d1p0 - - 0 1 3.99K 47.9K 196us 589us
196us 589us 768ns 1us - - - -
c5t10d1p0 - - 0 1 3.99K 43.9K 6ms 393us
6ms 393us 1us 768ns - - - -
c5t11d1p0 - - 0 1 0 43.9K -
393us - 393us - 768ns - - - -
c5t12d1p0 - - 0 1 0 43.9K -
393us - 393us - 768ns - - - -
c5t13d1p0 - - 0 1 0 39.9K -
393us - 393us - 768ns - - - -
c5t14d1p0 - - 0 1 0 43.9K -
393us - 393us - 1us - - - -
c5t15d1p0 - - 0 1 0 43.9K -
393us - 393us - 576ns - - - -
------------- ----- ----- ----- ----- ----- ----- ----- -----
----- ----- ----- ----- ----- ----- ----- -----
capacity operations bandwidth total_wait
disk_wait syncq_wait asyncq_wait scrub trim
pool alloc free read write read write read write
read write read write read write wait wait
------------- ----- ----- ----- ----- ----- ----- ----- -----
----- ----- ----- ----- ----- ----- ----- -----
rpool1 146G 318G 2 187 16.0K 3.85M 360us 565us
360us 74us 896ns 720ns - 529us - -
mirror 146G 318G 2 187 16.0K 3.85M 360us 565us
360us 74us 896ns 720ns - 529us - -
c4t0d0 - - 2 93 16.0K 1.92M 360us 540us
360us 75us 896ns 864ns - 503us - -
c4t2d0 - - 0 93 0 1.92M -
590us - 72us - 576ns - 556us - -
------------- ----- ----- ----- ----- ----- ----- ----- -----
----- ----- ----- ----- ----- ----- ----- -----
uhome 16.1T 42.1T 0 0 0 0 - - -
- - - - - - -
raidz2 16.1T 42.1T 0 0 0 0 - - -
- - - - - - -
------------- ----- ----- ----- ----- ----- ----- ----- -----
----- ----- ----- ----- ----- ----- ----- -----
capacity operations bandwidth total_wait
disk_wait syncq_wait asyncq_wait scrub trim
pool alloc free read write read write read write
read write read write read write wait wait
------------- ----- ----- ----- ----- ----- ----- ----- -----
----- ----- ----- ----- ----- ----- ----- -----
rpool1 146G 318G 0 0 0 0 - - -
- - - - - - -
mirror 146G 318G 0 0 0 0 - - -
- - - - - - -
c4t0d0 - - 0 0 0 0 - - -
- - - - - - -
c4t2d0 - - 0 0 0 0 - - -
- - - - - - -
------------- ----- ----- ----- ----- ----- ----- ----- -----
----- ----- ----- ----- ----- ----- ----- -----
uhome 16.1T 42.1T 0 0 0 0 - - -
- - - - - - -
raidz2 16.1T 42.1T 0 0 0 0 - - -
- - - - - - -
------------- ----- ----- ----- ----- ----- ----- ----- -----
----- ----- ----- ----- ----- ----- ----- -----
capacity operations bandwidth total_wait disk_wait
syncq_wait asyncq_wait scrub trim
pool alloc free read write read write read write
read write read write read write wait wait
------------- ----- ----- ----- ----- ----- ----- ----- -----
----- ----- ----- ----- ----- ----- ----- -----
rpool1 146G 318G 0 0 0 0 - - -
- - - - - - -
mirror 146G 318G 0 0 0 0 - - -
- - - - - - -
c4t0d0 - - 0 0 0 0 - - -
- - - - - - -
c4t2d0 - - 0 0 0 0 - - -
- - - - - - -
------------- ----- ----- ----- ----- ----- ----- ----- -----
----- ----- ----- ----- ----- ----- ----- -----
uhome 16.1T 42.1T 0 529 0 25.8M - 1ms -
416us - - - 1ms - -
raidz2 16.1T 42.1T 0 529 0 25.8M - 1ms -
416us - - - 1ms - -
c5t8d1p0 - - 0 72 0 3.20M - 1ms -
387us - - - 1ms - -
c5t9d1p0 - - 0 63 0 3.19M - 1ms -
371us - - - 1ms - -
c5t10d1p0 - - 0 65 0 3.20M - 1ms -
387us - - - 1ms - -
c5t11d1p0 - - 0 64 0 3.23M - 1ms -
396us - - - 1ms - -
c5t12d1p0 - - 0 65 0 3.26M - 1ms -
461us - - - 1ms - -
c5t13d1p0 - - 0 62 0 3.25M - 1ms -
472us - - - 1ms - -
c5t14d1p0 - - 0 67 0 3.24M - 1ms -
425us - - - 1ms - -
c5t15d1p0 - - 0 65 0 3.22M - 1ms -
436us - - - 1ms - -
------------- ----- ----- ----- ----- ----- ----- ----- -----
----- ----- ----- ----- ----- ----- ----- -----
capacity operations bandwidth total_wait
disk_wait syncq_wait asyncq_wait scrub trim
pool alloc free read write read write read write
read write read write read write wait wait
------------- ----- ----- ----- ----- ----- ----- ----- -----
----- ----- ----- ----- ----- ----- ----- -----
rpool1 146G 318G 0 0 0 0 - - -
- - - - - - -
mirror 146G 318G 0 0 0 0 - - -
- - - - - - -
c4t0d0 - - 0 0 0 0 - - -
- - - - - - -
c4t2d0 - - 0 0 0 0 - - -
- - - - - - -
------------- ----- ----- ----- ----- ----- ----- ----- -----
----- ----- ----- ----- ----- ----- ----- -----
uhome 16.1T 42.1T 0 31 0 128K - 2ms -
2ms - 432ns - - - -
raidz2 16.1T 42.1T 0 31 0 128K - 2ms -
2ms - 432ns - - - -
c5t8d1p0 - - 0 3 0 16.0K -
688us - 688us - 672ns - - - -
c5t9d1p0 - - 0 3 0 16.0K -
688us - 688us - 384ns - - - -
c5t10d1p0 - - 0 3 0 16.0K - 1ms -
1ms - 384ns - - - -
c5t11d1p0 - - 0 3 0 16.0K - 1ms -
1ms - 480ns - - - -
c5t12d1p0 - - 0 3 0 16.0K - 1ms -
1ms - 384ns - - - -
c5t13d1p0 - - 0 3 0 16.0K -
638us - 638us - 384ns �� - - - -
c5t14d1p0 - - 0 3 0 16.0K -
983us - 983us - 384ns - - - -
c5t15d1p0 - - 0 3 0 16.0K -
12ms - 12ms - 384ns - - - -
------------- ----- ----- ----- ----- ----- ----- ----- -----
----- ----- ----- ----- ----- ----- ----- -----
capacity operations bandwidth total_wait
disk_wait syncq_wait asyncq_wait scrub trim
pool alloc free read write read write read write
read write read write read write wait wait
------------- ----- ----- ----- ----- ----- ----- ----- -----
----- ----- ----- ----- ----- ----- ----- -----
rpool1 146G 318G 0 0 0 0 - - -
- - - - - -
- <-- This rpool1 and uhome
section of zero activity
mirror 146G 318G 0 0 0 0 - - -
- - - - - -
- repeats 12 times
c4t0d0 - - 0 0 0 0 - - -
- - - - - - -
c4t2d0 - - 0 0 0 0 - - -
- - - - - - -
------------- ----- ----- ----- ----- ----- ----- ----- -----
----- ----- ----- ----- ----- ----- ----- -----
uhome 16.1T 42.1T 0 0 0 0 - - -
- - - - - - -
raidz2 16.1T 42.1T 0 0 0 0 - - -
- - - - - - -
------------- ----- ----- ----- ----- ----- ----- ----- -----
----- ----- ----- ----- ----- ----- ----- -----
capacity operations bandwidth total_wait
disk_wait syncq_wait asyncq_wait scrub trim
pool alloc free read write read write read write
read write read write read write wait wait
------------- ----- ----- ----- ----- ----- ----- ----- -----
----- ----- ----- ----- ----- ----- ----- -----
rpool1 146G 318G 0 108 0 1.15M -
412us - 60us - 432ns - 380us - -
mirror 146G 318G 0 108 0 1.15M -
412us - 60us - 432ns - 380us - -
c4t0d0 - - 0 52 0 590K -
390us - 58us - 480ns - 362us - -
c4t2d0 - - 0 55 0 590K -
432us - 61us - 384ns - 398us - -
------------- ----- ----- ----- ----- ----- ----- ----- -----
----- ----- ----- ----- ----- ----- ----- -----
uhome 16.1T 42.1T 0 0 0 0 - - -
- - - - - - -
raidz2 16.1T 42.1T 0 0 0 0 - - -
- - - - - - -
------------- ----- ----- ----- ----- ----- ----- ----- -----
----- ----- ----- ----- ----- ----- ----- -----
capacity operations bandwidth total_wait
disk_wait syncq_wait asyncq_wait scrub trim
pool alloc free read write read write read write
read write read write read write wait wait
------------- ----- ----- ----- ----- ----- ----- ----- -----
----- ----- ----- ----- ----- ----- ----- -----
rpool1 146G 318G 0 0 0 0 - - -
- - - - - - -
<-- This rpool1 and uhome section of zero activity
mirror 146G 318G 0 0 0 0 - - -
- - - - - -
- repeats 14 times
c4t0d0 - - 0 0 0 0 - - -
- - - - - - -
c4t2d0 - - 0 0 0 0 - - -
- - - - - - -
------------- ----- ----- ----- ----- ----- ----- ----- -----
----- ----- ----- ----- ----- ----- ----- -----
uhome 16.1T 42.1T 0 0 0 0 - - -
- - - - - - -
raidz2 16.1T 42.1T 0 0 0 0 - - -
- - - - - - -
------------- ----- ----- ----- ----- ----- ----- ----- -----
----- ----- ----- ----- ----- ----- ----- -----
capacity operations bandwidth total_wait
disk_wait syncq_wait asyncq_wait scrub trim
pool alloc free read write read write read write
read write read write read write wait wait
------------- ----- ----- ----- ----- ----- ----- ----- -----
----- ----- ----- ----- ----- ----- ----- -----
rpool1 146G 318G 0 0 0 0 - - -
- - - - - - -
mirror 146G 318G 0 0 0 0 - - -
- - - - - - -
c4t0d0 - - 0 0 0 0 - - -
- - - - - - -
c4t2d0 - - 0 0 0 0 - - -
- - - - - - -
------------- ----- ----- ----- ----- ----- ----- ----- -----
----- ----- ----- ----- ----- ----- ----- -----
uhome 16.1T 42.1T 0 380 0 2.36M - 1ms -
377us - 408ns - 755us - -
raidz2 16.1T 42.1T 0 380 0 2.36M - 1ms -
377us - 408ns - 755us - -
capacity operations bandwidth total_wait
disk_wait syncq_wait asyncq_wait scrub trim
pool alloc free read write read write read write
read write read write read write wait wait
------------- ----- ----- ----- ----- ----- ----- ----- -----
----- ----- ----- ----- ----- ----- ----- -----
rpool1 146G 318G 0 0 0 0 - - -
- - - - - - -
mirror 146G 318G 0 0 0 0 - - -
- - - - - - -
c4t0d0 - - 0 0 0 0 - - -
- - - - - - -
c4t2d0 - - 0 0 0 0 - - -
- - - - - - -
------------- ----- ----- ----- ----- ----- ----- ----- -----
----- ----- ----- ----- ----- ----- ----- -----
uhome 16.1T 42.1T 0 0 0 0 - - -
- - - - - - - <- from this
point there is no further access to the uhome zfs pool
raidz2 16.1T 42.1T 0 0 0 0 - - -
- - - - - - - all activity is the rpool only
c5t8d1p0 - - 0 0 0 0 - - -
- - - - - - -
c5t9d1p0 - - 0 0 0 0 - - -
- - - - - - -
c5t10d1p0 - - 0 0 0 0 - - -
- - - - - - -
c5t11d1p0 - - 0 0 0 0 - - -
- - - - - - -
c5t12d1p0 - - 0 0 0 0 - - -
- - - - - - -
c5t13d1p0 - - 0 0 0 0 - - -
- - - - - - -
c5t14d1p0 - - 0 0 0 0 - - -
- - - - - - -
c5t15d1p0 - - 0 0 0 0 - - -
- - - - - - -
------------- ----- ----- ----- ----- ----- ----- ----- -----
----- ----- ----- ----- ----- ----- ----- -----
capacity operations bandwidth total_wait
disk_wait syncq_wait asyncq_wait scrub trim
pool alloc free read write read write read write
read write read write read write wait wait
------------- ----- ----- ----- ----- ----- ----- ----- -----
----- ----- ----- ----- ----- ----- ----- -----
rpool1 146G 318G 0 113 0 1.20M -
439us - 57us - 480ns - 402us - -
mirror 146G 318G 0 113 0 1.20M -
439us - 57us - 480ns - 402us - -
c4t0d0 - - 0 56 0 614K -
420us - 56us - 576ns - 377us - -
c4t2d0 - - 0 56 0 614K -
459us - 59us - 384ns - 427us - -
capacity operations bandwidth total_wait
disk_wait syncq_wait asyncq_wait scrub trim
pool alloc free read write read write read write
read write read write read write wait wait
------------- ----- ----- ----- ----- ----- ----- ----- -----
----- ----- ----- ----- ----- ----- ----- -----
rpool1 146G 318G 0 0 0 0 - - -
- - - - - - - <- repeats
24 times
mirror 146G 318G 0 0 0 0 - - -
- - - - - - -
c4t0d0 - - 0 0 0 0 - - -
- - - - - - -
c4t2d0 - - 0 0 0 0 - - -
- - - - - - -
capacity operations bandwidth total_wait
disk_wait syncq_wait asyncq_wait scrub trim
pool alloc free read write read write read write
read write read write read write wait wait
------------- ----- ----- ----- ----- ----- ----- ----- -----
----- ----- ----- ----- ----- ----- ----- -----
rpool1 146G 318G 0 119 0 1.07M -
408us - 55us - 432ns - 363us - -
mirror 146G 318G 0 119 0 1.07M -
408us - 55us - 432ns - 363us - -
c4t0d0 - - 0 59 0 546K -
409us - 53us - 480ns - 359us - -
c4t2d0 - - 0 59 0 546K -
407us - 57us - 384ns - 367us - -
capacity operations bandwidth total_wait
disk_wait syncq_wait asyncq_wait scrub trim
pool alloc free read write read write read write
read write read write read write wait wait
------------- ----- ----- ----- ----- ----- ----- ----- -----
----- ----- ----- ----- ----- ----- ----- -----
rpool1 146G 318G 0 0 0 0 - - -
- - - - - - - <- repeats 9 times
mirror 146G 318G 0 0 0 0 - - -
- - - - - - -
c4t0d0 - - 0 0 0 0 - - -
- - - - - - -
c4t2d0 - - 0 0 0 0 - - -
- - - - - - -
capacity operations bandwidth total_wait
disk_wait syncq_wait asyncq_wait scrub trim
pool alloc free read write read write read write
read write read write read write wait wait
------------- ----- ----- ----- ----- ----- ----- ----- -----
----- ----- ----- ----- ----- ----- ----- -----
rpool1 146G 318G 0 119 0 1.18M -
424us - 57us - 480ns - 394us - -
mirror 146G 318G 0 119 0 1.18M -
424us - 57us - 480ns - 394us - -
c4t0d0 - - 0 58 0 602K -
417us - 59us - 576ns - 397us - -
c4t2d0 - - 0 60 0 602K -
431us - 56us - 384ns - 391us - -
capacity operations bandwidth total_wait
disk_wait syncq_wait asyncq_wait scrub trim
pool alloc free read write read write read write
read write read write read write wait wait
------------- ----- ----- ----- ----- ----- ----- ----- -----
----- ----- ----- ----- ----- ----- ----- -----
rpool1 146G 318G 0 0 0 0 - - -
- - - - - - - <- repeats 24 times
mirror 146G 318G 0 0 0 0 - - -
- - - - - - -
c4t0d0 - - 0 0 0 0 - - -
- - - - - - -
c4t2d0 - - 0 0 0 0 - - -
- - - - - - -
capacity operations bandwidth total_wait
disk_wait syncq_wait asyncq_wait scrub trim
pool alloc free read write read write read write
read write read write read write wait wait
------------- ----- ----- ----- ----- ----- ----- ----- -----
----- ----- ----- ----- ----- ----- ----- -----
rpool1 146G 318G 0 134 0 1.67M -
476us - 56us - 432ns - 430us - -
mirror 146G 318G 0 134 0 1.67M -
476us - 56us - 432ns - 430us - -
c4t0d0 - - 0 66 0 854K -
460us - 56us - 480ns - 424us - -
c4t2d0 - - 0 67 0 854K -
492us - 57us - 384ns - 436us - -
capacity operations bandwidth total_wait
disk_wait syncq_wait asyncq_wait scrub trim
pool alloc free read write read write read write
read write read write read write wait wait
------------- ----- ----- ----- ----- ----- ----- ----- -----
----- ----- ----- ----- ----- ----- ----- -----
rpool1 146G 318G 0 119 0 1.07M -
408us - 55us - 432ns - 363us - - <- repeats
5 times
mirror 146G 318G 0 119 0 1.07M -
408us - 55us - 432ns - 363us - -
c4t0d0 - - 0 59 0 546K -
409us - 53us - 480ns - 359us - -
c4t2d0 - - 0 59 0 546K -
407us - 57us - 384ns - 367us - -
capacity operations bandwidth total_wait
disk_wait syncq_wait asyncq_wait scrub trim
pool alloc free read write read write read write
read write read write read write wait wait
------------- ----- ----- ----- ----- ----- ----- ----- -----
----- ----- ----- ----- ----- ----- ----- -----
rpool1 146G 318G 0 116 0 1.24M -
394us - 56us - 384ns - 347us - -
mirror 146G 318G 0 116 0 1.24M -
394us - 56us - 384ns - 347us - -
c4t0d0 - - 0 58 0 634K -
378us - 52us - 384ns - 318us - -
c4t2d0 - - 0 57 0 634K -
411us - 59us - 384ns - 377us - -
capacity operations bandwidth total_wait
disk_wait syncq_wait asyncq_wait scrub trim
pool alloc free read write read write read write
read write read write read write wait wait
------------- ----- ----- ----- ----- ----- ----- ----- -----
----- ----- ----- ----- ----- ----- ----- -----
rpool1 146G 318G 0 0 0 0 - - -
- - - - - - - <- repeats 3 times
mirror 146G 318G 0 0 0 0 - - -
- - - - - - -
c4t0d0 - - 0 0 0 0 - - -
- - - - - - -
c4t2d0 - - 0 0 0 0 - - -
- - - - - - -
capacity operations bandwidth total_wait
disk_wait syncq_wait asyncq_wait scrub trim
pool alloc free read write read write read write
read write read write read write wait wait
------------- ----- ----- ----- ----- ----- ----- ----- -----
----- ----- ----- ----- ----- ----- ----- -----
rpool1 146G 318G 0 1 0 7.98K -
786us - 786us - 768ns - - - -
mirror 146G 318G 0 1 0 7.98K -
786us - 786us - 768ns - - - -
c4t0d0 - - 0 0 0 3.99K -
786us - 786us - 768ns - - - -
c4t2d0 - - 0 0 0 3.99K -
786us - 786us - 768ns - - - -
------------- ----- ----- ----- ----- ----- ----- ----- -----
----- ----- ----- ----- ----- ----- ----- -----
capacity operations bandwidth total_wait
disk_wait syncq_wait asyncq_wait scrub trim
pool alloc free read write read write read write
read write read write read write wait wait
------------- ----- ----- ----- ----- ----- ----- ----- -----
----- ----- ----- ----- ----- ----- ----- -----
rpool1 146G 318G 0 145 0 1.49M -
465us - 53us - 432ns - 418us - -
mirror 146G 318G 0 145 0 1.49M -
465us - 53us - 432ns - 418us - -
c4t0d0 - - 0 72 0 762K -
456us - 51us - 480ns - 400us - -
c4t2d0 - - 0 72 0 762K -
473us - 55us - 384ns - 436us - -
------------- ----- ----- ----- ----- ----- ----- ----- -----
----- ----- ----- ----- ----- ----- ----- -----
capacity operations bandwidth total_wait
disk_wait syncq_wait asyncq_wait scrub trim
pool alloc free read write read write read write
read write read write read write wait wait
------------- ----- ----- ----- ----- ----- ----- ----- -----
----- ----- ----- ----- ----- ----- ----- -----
rpool1 146G 318G 0 1 0 7.98K -
786us - 786us - 1us - - - -
mirror 146G 318G 0 1 0 7.98K -
786us - 786us - 1us - - - -
c4t0d0 - - 0 0 0 3.99K -
786us - 786us - 1us - - - -
c4t2d0 - - 0 0 0 3.99K -
786us - 786us - 768ns - - - -
------------- ----- ----- ----- ----- ----- ----- ----- -----
----- ----- ----- ----- ----- ----- ----- -----
capacity operations bandwidth total_wait
disk_wait syncq_wait asyncq_wait scrub trim
pool alloc free read write read write read write
read write read write read write wait wait
------------- ----- ----- ----- ----- ----- ----- ----- -----
----- ----- ----- ----- ----- ----- ----- -----
rpool1 146G 318G 0 5 0 23.9K -
536us - 536us - 960ns - - - -
mirror 146G 318G 0 5 0 23.9K -
536us - 536us - 960ns - - - -
c4t0d0 - - 0 2 0 12.0K -
532us - 532us - 1us - - - -
c4t2d0 - - 0 2 0 12.0K -
540us - 540us - 640ns - - - -
------------- ----- ----- ----- ----- ----- ----- ----- -----
----- ----- ----- ----- ----- ----- ----- -----
capacity operations bandwidth total_wait
disk_wait syncq_wait asyncq_wait scrub trim
pool alloc free read write read write read write
read write read write read write wait wait
------------- ----- ----- ----- ----- ----- ----- ----- -----
----- ----- ----- ----- ----- ----- ----- -----
rpool1 146G 318G 0 0 0 0 - - -
- - - - - - -
mirror 146G 318G 0 0 0 0 - - -
- - - - - - -
c4t0d0 - - 0 0 0 0 - - -
- - - - - - -
c4t2d0 - - 0 0 0 0 - - -
- - - - - - -
------------- ----- ----- ----- ----- ----- ----- ----- -----
----- ----- ----- ----- ----- ----- ----- -----
capacity operations bandwidth total_wait
disk_wait syncq_wait asyncq_wait scrub trim
pool alloc free read write read write read write
read write read write read write wait wait
------------- ----- ----- ----- ----- ----- ----- ----- -----
----- ----- ----- ----- ----- ----- ----- -----
rpool1 146G 318G 0 0 0 0 - - -
- - - - - - -
mirror 146G 318G 0 0 0 0 - - -
- - - - - - -
c4t0d0 - - 0 0 0 0 - - -
- - - - - - -
c4t2d0 - - 0 0 0 0 - - -
- - - - - - -
------------- ----- ----- ----- ----- ----- ----- ----- -----
----- ----- ----- ----- ----- ----- ----- -----
capacity operations bandwidth total_wait
disk_wait syncq_wait asyncq_wait scrub trim
pool alloc free read write read write read write
read write read write read write wait wait
------------- ----- ----- ----- ----- ----- ----- ----- -----
----- ----- ----- ----- ----- ----- ----- -----
rpool1 146G 318G 0 183 0 4.14M -
666us - 81us - 432ns - 612us - - <- GUI Login
mirror 146G 318G 0 183 0 4.14M -
666us - 81us - 432ns - 612us - -
c4t0d0 - - 0 90 0 2.07M -
695us - 77us - 480ns - 646us - -
c4t2d0 - - 0 92 0 2.07M -
637us - 85us - 384ns - 578us - -
------------- ----- ----- ----- ----- ----- ----- ----- -----
----- ----- ----- ----- ----- ----- ----- -----
uhome 16.1T 42.1T 0 0 0 0 - - -
- - - - - - -
raidz2 16.1T 42.1T 0 0 0 0 - - -
- - - - - - -
c5t8d1p0 - - 0 0 0 0 - - -
- - - - - - -
c5t9d1p0 - - 0 0 0 0 - - -
- - - - - - -
c5t10d1p0 - - 0 0 0 0 - - -
- - - - - - -
c5t11d1p0 - - 0 0 0 0 - - -
- - - - - - -
c5t12d1p0 - - 0 0 0 0 - - -
- - - - - - -
c5t13d1p0 - - 0 0 0 0 - - -
- - - - - - -
c5t14d1p0 - - 0 0 0 0 - - -
- - - - - - -
c5t15d1p0 - - 0 0 0 0 - - -
- - - - - - -
------------- ----- ----- ----- ----- ----- ----- ----- -----
----- ----- ----- ----- ----- ----- ----- -----
It appears that most of the time ZFS pools are no being accessed?
Correct me if I am wrong but I do not think a power supply issue cause
this ZFS activity weirdness.
Regards
Russell
_______________________________________________
openindiana-discuss mailing list
[email protected]
https://openindiana.org/mailman/listinfo/openindiana-discuss
_______________________________________________
openindiana-discuss mailing list
[email protected]
https://openindiana.org/mailman/listinfo/openindiana-discuss
