|
Re: [BackupPC-users] Backup backuppc pool with rsync offsite
2011-02-22 14:38:58
gregwm <backuppc-users AT whitleymott DOT net> wrote on
02/22/2011 11:26:51 AM:
> this issue sure comes up alot, and perhaps i should just keep quiet
> since i personally am in no position to do it or even go off looking
> for an rsync forum, nor do i have any knowledge of just how convoluted
> the rsync source may be to try to look at, but as a naive outsider
it
> seems still it ought not to be such a task to have a go at the rsync
> source and come out with a version that sorted its xferlist into
> [filesystem:inode] order if preserving hardlinks, or possibly just
> created a simple [filesystem:inode] index of files already transfered,
> in replacement of whatever mangy hardlink table is in there now.
The software is not far off from doing that. Now
multiply that by a billion files....
The reason why some people claim it works and some
people have it fail (or cancel it tens of hours into the process) is related
to how many files are in the pool and how much RAM they have. For
systems with 8GB of RAM each, and with a few hundred thousand files, it'll
most likely work. For systems with 1GB and a billion files, forget
it. They thrash terribly, and the time it would take to finish might
be measured in *months*.
Tim Massey
------------------------------------------------------------------------------
Free Software Download: Index, Search & Analyze Logs and other IT data in
Real-Time with Splunk. Collect, index and harness all the fast moving IT data
generated by your applications, servers and devices whether physical, virtual
or in the cloud. Deliver compliance at lower cost and gain new business
insights. http://p.sf.net/sfu/splunk-dev2dev _______________________________________________
BackupPC-users mailing list
BackupPC-users AT lists.sourceforge DOT net
List: https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki: http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/
|
|
|
