Rodrigo Real wrote: > Carl Wilhelm Soderstrom <[EMAIL PROTECTED]> writes: > >> On 10/28 10:23 , Rodrigo Real wrote: >>> Can't you install rsync on 10.0.0.254? That should be the easiest way, >>> rsync can preserve hard links with the -H option, additionally it >>> would transfer only the differences between the two hosts. >> on the topic of server replication; the problem with using rsync is that it >> uses a tremendous amount of memory when dealing with millions of files. I >> tried it once; rsync'ing a 100GB pool (with perhaps 5 or 6 million files) >> from one disk to another on a box with 512MB RAM and perhaps 1GB swap. > > I had never tryed that, but I can't think of another way of doing > it. I am sure it is hard to rsync two huge mass of files. Maybe it is > possible to split the rsync process in some parts, but it will still > be hard. > > Best wishes, > Rodrigo > >> the box eventually ran out of memory to the point that I had to power-cycle >> it to regain control. it's the only time in recent memory that I can think >> of a linux box needing to be rebooted for a software problem. >> >> I know of people who do it; but they're doing it on machines with more >> memory and fewer files.
Just add lots of swap. I was able to rsync an archive with several million files on a machine with just 256 MB RAM; it had several gigabytes of swap. -- Tomasz Chmielewski http://wpkg.org ------------------------------------------------------------------------- Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642 _______________________________________________ BackupPC-users mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/backuppc-users http://backuppc.sourceforge.net/
