Re: [BackupPC-users] An idea to fix both SIGPIPE and memory issues with rsync
2009-12-15 03:25:50
On Mon, Dec 14, 2009 at 08:20:07PM -0600, Les Mikesell wrote:
> Robin Lee Powell wrote:
> >
> > Asking rsync, and ssh, and a pair of firewalls and load
> > balancers (it's complicated) to stay perfectly fine for almost a
> > full day is really asking a whole hell of a lot.
>
> I don't think that should be true. There's no reason for a
> program to quit just because it has been running for a day and no
> particular limit to what ssh can transfer. And tcp can deal with
> quite a lot of lossage and problems - unless your load balancers
> are NATing to different sources or tossing RST's when they fail
> over.
Oh, I agree; in an ideal world, it wouldn't be an issue. I'm afraid
I don't live there. :)
> > For large data sets like this, rsync simple isn't robust enough
> > by itself. Losing 15 hours worth of (BackupPC's) work because
> > the ssh connection goes down is *really* frustrating.
>
> I don't think it is rsync or ssh's problem, although you are
> correct that rsync could be better about handling huge sets of
> files. Both should be as reliable as the underlying hardware.
I don't want to talk about our underlying hardware. ;'(
-Robin
--
They say: "The first AIs will be built by the military as weapons."
And I'm thinking: "Does it even occur to you to try for something
other than the default outcome?" See http://shrunklink.com/cdiz
http://www.digitalkingdom.org/~rlpowell/ *** http://www.lojban.org/
------------------------------------------------------------------------------
Return on Information:
Google Enterprise Search pays you back
Get the facts.
http://p.sf.net/sfu/google-dev2dev
_______________________________________________
BackupPC-users mailing list
BackupPC-users AT lists.sourceforge DOT net
List: https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki: http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/
|
<Prev in Thread] |
Current Thread |
[Next in Thread>
|
- [BackupPC-users] An idea to fix both SIGPIPE and memory issues with rsync, Robin Lee Powell
- Re: [BackupPC-users] An idea to fix both SIGPIPE and memory issues with rsync, Jeffrey J. Kosowsky
- Re: [BackupPC-users] An idea to fix both SIGPIPE and memory issues with rsync, Shawn Perry
- Re: [BackupPC-users] An idea to fix both SIGPIPE and memory issues with rsync, Robin Lee Powell
- Re: [BackupPC-users] An idea to fix both SIGPIPE and memory issues with rsync, Jeffrey J. Kosowsky
- Re: [BackupPC-users] An idea to fix both SIGPIPE and memory issues with rsync, Robin Lee Powell
- Re: [BackupPC-users] An idea to fix both SIGPIPE and memory issues with rsync, Les Mikesell
- Re: [BackupPC-users] An idea to fix both SIGPIPE and memory issues with rsync,
Robin Lee Powell <=
- Re: [BackupPC-users] An idea to fix both SIGPIPE and memory issues with rsync, Holger Parplies
- Re: [BackupPC-users] An idea to fix both SIGPIPE and memory issues with rsync, Robin Lee Powell
- Re: [BackupPC-users] An idea to fix both SIGPIPE and memory issues with rsync, Les Mikesell
- Re: [BackupPC-users] An idea to fix both SIGPIPE and memory issues with rsync, Chris Robertson
- Re: [BackupPC-users] An idea to fix both SIGPIPE and memory issues with rsync, Robin Lee Powell
- Re: [BackupPC-users] An idea to fix both SIGPIPE and memory issues with rsync, Robin Lee Powell
- Re: [BackupPC-users] An idea to fix both SIGPIPE and memory issues with rsync, Robin Lee Powell
- Re: [BackupPC-users] An idea to fix both SIGPIPE and memory issues with rsync, Les Mikesell
- Re: [BackupPC-users] An idea to fix both SIGPIPE and memory issues with rsync, Robin Lee Powell
- [BackupPC-users] You were right (Re: An idea to fix both SIGPIPE and memory issues with rsync), Robin Lee Powell
|
|
|