There are several implied references here to likely problems with rsync and how 
they are all deal breakers.  I've been trying to find a solution to this 
problem for weeks and have not found any direct documentation or evidence to 
support what is being said here.  I'm not skeptical, though, I just need to 
understand what's going on.

Rsync is the only option for me, and I'm rather confused by the other solutions 
floated in this and other threads.  On-site backup is precarious and viable 
only in a datacenter type situation imho.  What about the fire scenario?  
Getting the data somewhere else is crucial, and in my case I am limited to 
rsync through rsh.  I'm running rsync 3.0.6 but the server is 2.6.x.  I have ~ 
1.9 files found by rsync and it always fails on some level.  I use -aH but it 
randomly exits with an unknown error during remote comparison or the initial 
transfers.  During the transfer phase it says its sending data, but nothing 
shows up on the server.  The server admins are not aware of any incompatibility 
with their filesystem and the internet does not seem to deal with this problem, 
which brings me back to the initial question.

What does one use if not rsync?  There's no way to justify or implement backing 
up the entire pool every time without a lot of bandwidth, which I don't have.  
What exactly is rsync's problem?  Do I really need to shut down backuppc every 
time I want to attempt a sync or would syncing to a local disk and rsync'ing 
from that be sufficient?  I'd really like to know the specifics of the hardlink 
and inode problem talked about in this thread like how to find out how many I 
have and what the threshold is for Trouble and how the rest of the community 
deals with getting pools of 100+GB offsite in less than a week of transfer time.

Lots of info requests, I know, but I really appreciate the help.  My ISP and 
all the experts I've tapped are completely stumped on this one.


Holger Parplies wrote:
> Hi,
> 
> Rob Terhaar wrote on 2009-05-21 13:01:58 -0400 [Re: [BackupPC-users] backup 
> the backuppc pool with bacula]:
> 
> > [...]
> > Try Rsync v3, it has much lower memory requirements since it builds
> > the file list incrementally.
> > 
> 
> by all means, try it. But it's not the file list that is the specific problem
> of BackupPC.
> 
> 
> > I used it at one company to do nightly
> > syncs of their ~4TB backuppc pool offsite.
> > 
> 
> It's still a matter of file count (used inodes, to be exact), not pool storage
> size. rsync V3 may perform significantly better if you have many links to
> comparatively few inodes, but if you have many inodes (for some unknown value
> of "many"), I am still convinced that you will hit a problem. Feel free to
> convince me otherwise, but "works for me" is unlikely to succeed ;-).
> 
> Regards,
> Holger
> 
> ------------------------------------------------------------------------------
> Register Now for Creativity and Technology (CaT), June 3rd, NYC. CaT
> is a gathering of tech-side developers & brand creativity professionals. Meet
> the minds behind Google Creative Lab, Visual Complexity, Processing, & 
> iPhoneDevCamp asthey present alongside digital heavyweights like Barbarian
> Group, R/GA, & Big Spaceship. http://www.creativitycat.com 
> _______________________________________________
> BackupPC-users mailing list
> BackupPC-users < at > lists.sourceforge.net
> List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
> Wiki:    http://backuppc.wiki.sourceforge.net
> Project: http://backuppc.sourceforge.net/


+----------------------------------------------------------------------
|This was sent by jonathan.haglund AT gotravelsites DOT com via Backup Central.
|Forward SPAM to abuse AT backupcentral DOT com.
+----------------------------------------------------------------------



------------------------------------------------------------------------------
Crystal Reports - New Free Runtime and 30 Day Trial
Check out the new simplified licensing option that enables unlimited
royalty-free distribution of the report engine for externally facing 
server and web deployment.
http://p.sf.net/sfu/businessobjects
_______________________________________________
BackupPC-users mailing list
BackupPC-users AT lists.sourceforge DOT net
List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:    http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/