BackupPC-users

Re: [BackupPC-users] Estimate rsync speed

2010-05-27 17:49:10
Subject: Re: [BackupPC-users] Estimate rsync speed
From: Gerald Brandt <gbr AT majentis DOT com>
To: "General list for user discussion, questions and support" <backuppc-users AT lists.sourceforge DOT net>
Date: Thu, 27 May 2010 16:55:28 -0500 (CDT)
----- "Les Mikesell" <lesmikesell AT gmail DOT com> wrote:

> On 5/27/2010 3:54 PM, Peter Doherty wrote:
> >
> >>
> >> But how can I estimate how long rsync needs to determine which
> files
> >> to
> >> transfer? I'd like to do the whole backup process at night, and I
> feel
> >> that this could be impossible.
> >>
> >> Thanks!
> >
> >
> > The biggest factor is how many files this is, which I don't see in
> > your message.  if it's 1 5GB file, then it might take seconds to
> > calculate the changes.
> > if it's 5 million files, then it's going to take a lot longer,
> perhaps
> > hours.
> 
> Basically it is going to transfer the entire directory listing then
> walk 
> through it.  On incremental runs it will skip anything where the
> length 
> and timestamp match the copy in your previous full.  On fulls it will
> 
> read all data and do a block checkum comparison. This doesn't take a
> lot 
> of bandwidth but it may take too much time for you - but perhaps you
> can 
> schedule the fulls to hit weekends if the target is less busy then.
> 
> Also, if the data is compressible, it may help if you add the -C
> option 
> the the ssh command.
> 
> -- 
>    Les Mikesell
>     lesmikesell AT gmail DOT com
> 

I have some Windows boxes I converted from smb to rsync.  When I did the 
switch, I forced a full backup.  On one system, the backup went from 182 
minutes to 108 minutes, on another system, is went from 22 minutes to 8 
minutes, on a third box, it went from 886 minutes to who knows what.  Almost 20 
hours later and it's still running.  Go figure.

Gerald

------------------------------------------------------------------------------

_______________________________________________
BackupPC-users mailing list
BackupPC-users AT lists.sourceforge DOT net
List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:    http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

<Prev in Thread] Current Thread [Next in Thread>