> You could test with noatime if you don't need access times. > And perhaps with lazytime instead of relatime. Mountoptions are: type zfs (rw,xattr,noacl) I get you point, but when you look at my fio output, the performance is quiet good
> Could you provide us > nfsstat -v server: nfsstat -v Server packet stats: packets udp tcp tcpconn 509979521 0 510004972 2 Server rpc stats: calls badcalls badfmt badauth badclnt 509971853 0 0 0 0 Server reply cache: hits misses nocache 0 0 509980028 Server io stats: read write 1587531840 3079615002 Server read ahead cache: size 0-10% 10-20% 20-30% 30-40% 40-50% 50-60% 60-70% 70-80% 80-90% 90-100% notfound 0 0 0 0 0 0 0 0 0 0 0 0 Server file handle cache: lookup anon ncachedir ncachenondir stale 0 0 0 0 0 Server nfs v4: null compound 2 0% 509976662 99% Server nfs v4 operations: op0-unused op1-unused op2-future access close 0 0% 0 0% 0 0% 5015903 0% 3091693 0% commit create delegpurge delegreturn getattr 314634 0% 149836 0% 0 0% 1615740 0% 390748077 20% getfh link lock lockt locku 2573550 0% 0 0% 17 0% 0 0% 15 0% lookup lookup_root nverify open openattr 3931149 0% 0 0% 0 0% 3131045 0% 0 0% open_conf open_dgrd putfh putpubfh putrootfh 0 0% 3 0% 510522216 26% 0 0% 4 0% read readdir readlink remove rename 59976532 3% 421791 0% 0 0% 429965 0% 244564 0% renew restorefh savefh secinfo setattr 0 0% 0 0% 542231 0% 0 0% 845324 0% setcltid setcltidconf verify write rellockowner 0 0% 0 0% 0 0% 404569758 21% 0 0% bc_ctl bind_conn exchange_id create_ses destroy_ses 0 0% 0 0% 4 0% 2 0% 1 0% free_stateid getdirdeleg getdevinfo getdevlist layoutcommit 15 0% 0 0% 0 0% 0 0% 0 0% layoutget layoutreturn secinfononam sequence set_ssv 0 0% 0 0% 2 0% 509980018 26% 0 0% test_stateid want_deleg destroy_clid reclaim_comp allocate 10 0% 0 0% 1 0% 2 0% 164 0% copy copy_notify deallocate ioadvise layouterror 297667 0% 0 0% 0 0% 0 0% 0 0% layoutstats offloadcancel offloadstatus readplus seek 0 0% 0 0% 0 0% 0 0% 0 0% write_same 0 0% client: nfsstat -v Client packet stats: packets udp tcp tcpconn 0 0 0 0 Client rpc stats: calls retrans authrefrsh 37415730 0 37425651 Client nfs v4: null read write commit open 1 0% 4107833 10% 30388717 81% 2516 0% 55493 0% open_conf open_noat open_dgrd close setattr 0 0% 194252 0% 0 0% 247380 0% 75890 0% fsinfo renew setclntid confirm lock 459 0% 0 0% 0 0% 0 0% 4 0% lockt locku access getattr lookup 0 0% 2 0% 131533 0% 1497029 4% 318056 0% lookup_root remove rename link symlink 1 0% 31656 0% 15877 0% 0 0% 0 0% create pathconf statfs readlink readdir 7019 0% 458 0% 170522 0% 0 0% 30007 0% server_caps delegreturn getacl setacl fs_locations 917 0% 118109 0% 0 0% 0 0% 0 0% rel_lkowner secinfo fsid_present exchange_id create_session 0 0% 0 0% 0 0% 2 0% 1 0% destroy_session sequence get_lease_time reclaim_comp layoutget 0 0% 0 0% 0 0% 1 0% 0 0% getdevinfo layoutcommit layoutreturn secinfo_no test_stateid 0 0% 0 0% 0 0% 1 0% 0 0% free_stateid getdevicelist bind_conn_to_ses destroy_clientid seek 2 0% 0 0% 0 0% 0 0% 0 0% allocate deallocate layoutstats clone 10 0% 0 0% 0 0% 0 0% thanks for your help best regards Stefan