BackupPC-users

Re: [BackupPC-users] rsync over ssh, non-efficient datatransfer

2008-05-26 16:49:32
Subject: Re: [BackupPC-users] rsync over ssh, non-efficient datatransfer
From: Les Mikesell <les AT futuresource DOT com>
To: rejo AT zenger DOT nl
Date: Mon, 26 May 2008 15:50:13 -0500
Rejo Zenger wrote:
> EHLO,
> 
> I have this small but annoying problem: it seems my backuppc setup with 
> rsync over ssh is copying every file every time and only determines on 
> the local server what has changed - instead of copying only the changed 
> files. Needless to explain this isn't very optimal or efficient. :)
> 
> I noticed this issue when I was adding 30 GB of static data to the
> remote server. In the first night I saw a lot of extra traffic. But,
> in the following nights I saw that same pattern again (a lot more 
> bandwith being used). As these additional 30 GB are static content, I 
> would expect all nights but the first to see limited amount of traffic.
> 
> Both servers are running Debian 4.0 Etch. I am running BackupPC version
> 2.1.2-6, with the OpenSSH client version 4.3p2-9etch2 on the server that
> is doing the backup and OpenSSH server version 4.3p2-9etch2 and rsync
> version 2.6.9-2etch2 on the remote server. The data is stored on local 
> ext3 partitions.
> 
> Relevant snippets of the configuration files:
> 
>  | $Conf{RsyncArgs} = [
>  |             '--numeric-ids',
>  |             '--perms',
>  |             '--owner',
>  |             '--group',
>  |             '--devices',
>  |             '--links',
>  |             '--times',
>  |             '--block-size=2048',
>  |             '--recursive',
>  | ];
> 
> And:
>  
>  | $Conf{RsyncClientCmd} = '$sshPath -4 -q -l backuppc $host nice -n 19 
> /usr/bin/sudo $rsyncPath $argList+';
> 
> What is it that I am overseeing?

Do you have a complete full run? Incrementals should not transfer 
anything that was in the previous full, and subsequent fulls should only 
do block-checksum comparisons over the old files which takes some time 
but not a lot of bandwidth.

-- 
   Les Mikesell
    les AT futuresourece DOT com



-------------------------------------------------------------------------
This SF.net email is sponsored by: Microsoft
Defy all challenges. Microsoft(R) Visual Studio 2008.
http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/
_______________________________________________
BackupPC-users mailing list
BackupPC-users AT lists.sourceforge DOT net
List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:    http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/