Re: W: best way to clone server data using rsync

2012-05-02 Thread Dan Ritter
On Tue, May 01, 2012 at 10:19:42PM +0200, Tuxoholic wrote: > I noticed rsh is not installed, it's linked to > /etc/alternatives/rsh, which is linked to /usr/bin/ssh. > > Calling rsh instead of ssh should avoid file encryption during > transfer, at least that was the intention. That isn't what wil

Re: W: best way to clone server data using rsync

2012-05-02 Thread Jon Dowland
On Tue, May 01, 2012 at 01:08:14PM +0200, Tuxoholic wrote: > rsync seems like the right choice, but how will it handle job canceling when > I'm done for the day? Yes. But, for the initial sync, I tend to prefer a tarpipe which is a lot quicker. ( cd /srcdir && tar cf - . ) | ssh user@somehost '

Re: W: best way to clone server data using rsync

2012-05-01 Thread Indulekha
On Wed, May 02, 2012 at 06:16:59PM +1200, Chris Bannister wrote: > On Tue, May 01, 2012 at 11:38:26AM -0500, Indulekha wrote: > > Often I use something like: > > > > rsync --archive --one-file-system --hard-links --human-readable --inplace > > --numeric-ids --delete ... >

Re: W: best way to clone server data using rsync

2012-05-01 Thread Chris Bannister
On Tue, May 01, 2012 at 11:38:26AM -0500, Indulekha wrote: > Often I use something like: > > rsync --archive --one-file-system --hard-links --human-readable --inplace > --numeric-ids --delete ... >

Re: W: best way to clone server data using rsync

2012-05-01 Thread Tuxoholic
I noticed rsh is not installed, it's linked to /etc/alternatives/rsh, which is linked to /usr/bin/ssh. Calling rsh instead of ssh should avoid file encryption during transfer, at least that was the intention. The socket options boost transfer speed quite a lot, I usually have 65355 buffers o

Re: W: best way to clone server data using rsync

2012-05-01 Thread Dan Ritter
On Tue, May 01, 2012 at 01:08:14PM +0200, Tuxoholic wrote: > Here's what I got so far from google research: > > rsync --sockopts=SO_SNDBUF=128000,SO_RCVBUF=128000 -e rsh --archive \ > --recursive --partial --partial-dir=rsync-part --progress --append \ > --files-from=/root/LISTOFFILES.txt --log-fi

Re: W: best way to clone server data using rsync

2012-05-01 Thread Indulekha
On Tue, May 01, 2012 at 01:08:14PM +0200, Tuxoholic wrote: > Hi list > > I'm about to clone 1TB of server data to a new file server I'm building. > > Cloning will happen over the internal network, and it will take several days, > since I'll only run it while I'm awake/at home and checking up on

Re: W: best way to clone server data using rsync

2012-05-01 Thread Lars Noodén
On 5/1/12 2:08 PM, Tuxoholic wrote: [snip] > - will it resume files properly? > - will it run some sort of check sum to verify file integrity, or will I have > to run myself an integrity check like md5sum afterwards? Yes it will resume and it will verify file integrity. Using the archive option