BackupPC-users

Re: [BackupPC-users] Backup backuppc pool with rsync offsite

2011-02-22 16:01:38
Subject: Re: [BackupPC-users] Backup backuppc pool with rsync offsite
From: "Jeffrey J. Kosowsky" <backuppc AT kosowsky DOT org>
To: "General list for user discussion, questions and support" <backuppc-users AT lists.sourceforge DOT net>
Date: Tue, 22 Feb 2011 15:53:28 -0500
gregwm wrote at about 10:26:51 -0600 on Tuesday, February 22, 2011:
 > > rsync'ing the BackupPC data pool is generally recommended against. The
 > > number of hardlinks causes an explosive growth in memory consumption by
 > > rsync and while you may be able to get away with it if you have 20GB of
 > > data (depending on how much memory you have); you will likely run out of
 > > memory when your amount of data gets larger.
 > 
 > this issue sure comes up alot, and perhaps i should just keep quiet
 > since i personally am in no position to do it or even go off looking
 > for an rsync forum, nor do i have any knowledge of just how convoluted
 > the rsync source may be to try to look at, but as a naive outsider it
 > seems still it ought not to be such a task to have a go at the rsync
 > source and come out with a version that sorted its xferlist into
 > [filesystem:inode] order if preserving hardlinks, or possibly just
 > created a simple [filesystem:inode] index of files already transfered,
 > in replacement of whatever mangy hardlink table is in there now.
 > 

Well I wrote a perl script that does something quite similar:
- Creates a pool indexed by inode number
- Creates a list of hard links
- Rsync the pool itself (without -H)
- Recreate the hard links

Search the archives in the past few weeks for BackupPC_copyPcPool.pl

------------------------------------------------------------------------------
Free Software Download: Index, Search & Analyze Logs and other IT data in 
Real-Time with Splunk. Collect, index and harness all the fast moving IT data 
generated by your applications, servers and devices whether physical, virtual
or in the cloud. Deliver compliance at lower cost and gain new business 
insights. http://p.sf.net/sfu/splunk-dev2dev 
_______________________________________________
BackupPC-users mailing list
BackupPC-users AT lists.sourceforge DOT net
List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:    http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/