James Carlson <[email protected]> writes: > On 1/3/2015 7:32 AM, Harry Putnam wrote: >> Server OS: OI 115_a9 client OS: Gentoo linux (up to date) >> >> On client: I recently decided I'd like to write rsnapshot (using >> rsync) backups to an nfs mounted zfs share on OI nfs server. >> >> The first trial seem pretty outrageous in terms of time taken to >> complete. > > What does your invocation line look like? Is it like this: > > ... /path/on/linux/ /net/server/path/on/OI/ > > or like this: > > ... /path/on/linux/ server:/path/on/OI/
If you mean the mounting line: >From OP (taken from linux (client) /etc/fstab): > 2x.local.lan:/rrsnap/gv /nfs/bk nfs4 defaults 0 0 ^^^^^^^^^^^^^ ^^^^^ OI server linux localhost Like your second example only nfs server (Solaris) first. Client last. ------- ------- ---=--- ------- ------- But if you mean the rsnapshot invocation then: rsnapshot (using rsync) is running on linux client so rsync line (one of serveral) would be: rsync /var/ >>> (nfs Mounted share on lchost) /nfs/bk/ The later being the nfs mount point. I'd guess the most small files would be in the /var hierarchy but that is only one of the local source pths. Even there, it is a newish install so not really that many small files, way less than the millions you mentioned. More like: # find /var/ -type f|wc -l 66269 # find /etc/ -type f|wc -l 678 And another 2200 from various sources. Really pretty small potatoes for such a hefty time consumption. >From OP: real 314m10.421s user 0m0.454s sys 3m52.071s 318 minutes for 1.3 GB > I assume it's the former, and you're trying to write zillions of tiny > files via NFS. If so, I suspect you're seeing the action of NFS COMMIT: > https://blogs.oracle.com/roch/entry/nfs_and_zfs_a_fine I got lost after a few paragrapths there. Is it really like what I'm doing? > The simple answer is "don't do that." You can serialize the stream, > transfer the serialized stream over the network (via ssh or rsync's > own protocol), and then write locally. This is what I do with my > rsync jobs, regardless of whether the target server is Solaris, Linux, > AIX, or something else. Not sure what you mean by `serialize' (in rotation perhaps?) but if what you are saying is that ssh is faster... yes .. in my case it is orders of magnitude faster. Running the same rsnapshot/ rsync over an sshfs mounted share located on zfs server is dozens of times faster than what I reported for nfs. Can't find the `time' report now but I think single digits, maybe 8 minutes. > https://blogs.oracle.com/perrin/entry/slog_blog_or_blogging_on Looking into your last URL now, but do you think your original thoughts on this still hold? _______________________________________________ openindiana-discuss mailing list [email protected] http://openindiana.org/mailman/listinfo/openindiana-discuss
