BackupPC-users

Re: [BackupPC-users] very slow compression of big file

2008-07-03 18:14:44
Subject: Re: [BackupPC-users] very slow compression of big file
From: Tony Schreiner <schreian AT bc DOT edu>
Date: Thu, 03 Jul 2008 18:13:52 -0400
Evren Yurtesen wrote:
> Renke Brausse wrote:
>> Hello Tony,
>>
>>> I've written before about backups involving very big files that 
>>> seem  to execute slowly.
>>>
>>
>>> What can be slowing things down so much? Except for this operation,  
>>> everything else runs about as I would expect.
>>
>> I have no clue what the reason is but I experienced that backups of
>> large files are much faster with tar over ssh instead of rsync over ssh.
>>
>> Not an explanation but maybe this can solve your problem.
>>
>
> I believe the reason for this is how rsync works. It normally tries to 
> transfer only the changed parts of the file. This is to save 
> bandwidth, to do this, it has to scan the whole file on both sides(I 
> guess). This is unnecessary unless you are over slow links. You might 
> want to try the whole-file option with rsync:
>
>         -W, --whole-file            copy files whole (w/o delta-xfer 
> algorithm)
>
> Please let us know the results, as a side-note if you still want to 
> shrink the transferred file size you can use the ssh compression with 
> -C option of ssh.
>
> Thanks,
> Evren
Thank you, I will try that. Might be a few days before I have anything 
to report.
Tony


-------------------------------------------------------------------------
Sponsored by: SourceForge.net Community Choice Awards: VOTE NOW!
Studies have shown that voting for your favorite open source project,
along with a healthy diet, reduces your potential for chronic lameness
and boredom. Vote Now at http://www.sourceforge.net/community/cca08
_______________________________________________
BackupPC-users mailing list
BackupPC-users AT lists.sourceforge DOT net
List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:    http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/