BackupPC-users

Re: [BackupPC-users] An idea to fix both SIGPIPE and memory issues with rsync

2009-12-15 03:25:50
Subject: Re: [BackupPC-users] An idea to fix both SIGPIPE and memory issues with rsync
From: Robin Lee Powell <rlpowell AT digitalkingdom DOT org>
To: "General list for user discussion, questions and support" <backuppc-users AT lists.sourceforge DOT net>
Date: Tue, 15 Dec 2009 00:22:41 -0800
On Mon, Dec 14, 2009 at 08:20:07PM -0600, Les Mikesell wrote:
> Robin Lee Powell wrote:
> > 
> > Asking rsync, and ssh, and a pair of firewalls and load
> > balancers (it's complicated) to stay perfectly fine for almost a
> > full day is really asking a whole hell of a lot.
> 
> I don't think that should be true.  There's no reason for a
> program to quit just because it has been running for a day and no
> particular limit to what ssh can transfer.   And tcp can deal with
> quite a lot of lossage and problems - unless your load balancers
> are NATing to different sources or tossing RST's when they fail
> over.

Oh, I agree; in an ideal world, it wouldn't be an issue.  I'm afraid
I don't live there.  :)

> > For large data sets like this, rsync simple isn't robust enough
> > by itself.  Losing 15 hours worth of (BackupPC's) work because
> > the ssh connection goes down is *really* frustrating.
> 
> I don't think it is rsync or ssh's problem, although you are
> correct that rsync could be better about handling huge sets of
> files.  Both should be as reliable as the underlying hardware.

I don't want to talk about our underlying hardware.  ;'(

-Robin

-- 
They say:  "The first AIs will be built by the military as weapons."
And I'm  thinking:  "Does it even occur to you to try for something
other  than  the default  outcome?"  See http://shrunklink.com/cdiz
http://www.digitalkingdom.org/~rlpowell/ *** http://www.lojban.org/

------------------------------------------------------------------------------
Return on Information:
Google Enterprise Search pays you back
Get the facts.
http://p.sf.net/sfu/google-dev2dev
_______________________________________________
BackupPC-users mailing list
BackupPC-users AT lists.sourceforge DOT net
List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:    http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

<Prev in Thread] Current Thread [Next in Thread>