BackupPC-users

Re: [BackupPC-users] Is there a speed setting?

2009-08-19 16:28:37
Subject: Re: [BackupPC-users] Is there a speed setting?
From: Les Mikesell <lesmikesell AT gmail DOT com>
To: jeremy AT biochem.uthscsa DOT edu
Date: Wed, 19 Aug 2009 15:25:09 -0500
Jeremy Mann wrote:
> 
>> You still haven't said whether this is the first run where the files are
>> actually copied or not - if not you shouldn't expect much network
>> activity.  How long would it take the target to read all it's files?
>> Something like 'time tar -cf - / | cat >/dev/null' would be a reasonable
>> test.  (Don't do -cf /dev/null with gnutar because it will cheat and not
>> read the files.)  That would be the fastest an rsync run could possibly
>> complete with the --ignore times option even if you don't transfer any
>> data or create new files on the server.
> 
> This is the initial backup of the server. I am only running 1 session at a
> time until I solve this bandwidth problem.
> 
>>> Now if you tell me my hardware isn't fast enough, the BackupPC server is
>>> a
>>> dual Opteron 2.2 Ghz with 8 GB RAM and 24 300GB drives in a 3ware RAID5
>>> array, it isn't.
>> Either end can limit the speed.  How many concurrent runs do you do?
>> Also, you should expect much faster rates if you have a few large files
>> than if you have millions of tiny ones.
> 
> I am retrying the same server with --ignore-times but it doesn't seem to
> be any faster.

The --ignore-times option is only relevant where you have the matching 
file in the previous copy - and adding the option should make it slower. 
  Without it, files that have matching directory entries 
(timestamp/length) are skipped without looking at the contents.  With 
it, the files are compared with a block-checksum exchange which would 
make it slow down to disk read speed.  For example, my laptop's 15G 'My 
Documents' folder took approximately 73 minutes for the initial copy, 18 
minutes for a full where nothing changed, and an incremental where 
nothing changes just shows 0.0 elapsed time since it did nothing but 
read a few hundred directory entries.

-- 
   Les Mikesell
    lesmikesell AT gmail DOT com

------------------------------------------------------------------------------
Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day 
trial. Simplify your report design, integration and deployment - and focus on 
what you do best, core application coding. Discover what's new with 
Crystal Reports now.  http://p.sf.net/sfu/bobj-july
_______________________________________________
BackupPC-users mailing list
BackupPC-users AT lists.sourceforge DOT net
List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:    http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/