BackupPC-users

Re: [BackupPC-users] Wildly different speeds for hosts

2008-04-15 10:32:47
Subject: Re: [BackupPC-users] Wildly different speeds for hosts
From: Daniel Denson <dandenson AT gmail DOT com>
To: Raman Gupta <rocketraman AT fastmail DOT fm>
Date: Tue, 15 Apr 2008 08:30:11 -0600
yet another situation when IO is the enemy.   I know most people are 
most concerned with IO performance on the server, but the client also 
must be able to keep up or you get .66MB's or something.

Raman Gupta wrote:
> Raman Gupta wrote:
>   
>> I have three hosts configured to backup to my PC. Here are the speeds
>> from the host summary:
>>
>> host 1:  24.77 GB,  14,000 files, 18.78 MB/s (slower WAN link)
>> host 2:   1.27 GB,   4,000 files,  1.89 MB/s (faster WAN link)
>> host 3:   4.82 GB, 190,000 files,  0.66 MB/s (fast LAN link)
>>
>> They all use rsync with the same setup, other than the exclude list.
>> Backups are configured to run one at a time so there is no overlap
>> between them.
>>
>> The speed of host 3 concerns me. Host 3 is by far the beefiest
>> machine, and on the fastest network link of all the hosts, but yet
>> backs up at only 0.66 MB/s (incrementals are even slower).
>>     
>
> Ok, it seems that the number of files has a large non-linear affect on
> the performance of BackupPC. I excluded a bunch of stuff from my host
> 3 backup, and the new stats are:
>
> host 3:    4.2 GB,  85,000 files,  2.19 MB/s
>
> For a file count reduction factor of 2.2, there was a speed increase
> factor of 3.3.
>
> Cheers,
> Raman
>
> -------------------------------------------------------------------------
> This SF.net email is sponsored by the 2008 JavaOne(SM) Conference 
> Don't miss this year's exciting event. There's still time to save $100. 
> Use priority code J8TL2D2. 
> http://ad.doubleclick.net/clk;198757673;13503038;p?http://java.sun.com/javaone
> _______________________________________________
> BackupPC-users mailing list
> BackupPC-users AT lists.sourceforge DOT net
> List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
> Wiki:    http://backuppc.wiki.sourceforge.net
> Project: http://backuppc.sourceforge.net/
>   

-------------------------------------------------------------------------
This SF.net email is sponsored by the 2008 JavaOne(SM) Conference 
Don't miss this year's exciting event. There's still time to save $100. 
Use priority code J8TL2D2. 
http://ad.doubleclick.net/clk;198757673;13503038;p?http://java.sun.com/javaone
_______________________________________________
BackupPC-users mailing list
BackupPC-users AT lists.sourceforge DOT net
List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:    http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

<Prev in Thread] Current Thread [Next in Thread>