BackupPC-users

Re: [BackupPC-users] Huge remote directory (20GB): how will it be transferred?

2010-11-09 09:00:50
Subject: Re: [BackupPC-users] Huge remote directory (20GB): how will it be transferred?
From: Pavel Hofman <pavel.hofman AT ivitera DOT com>
To: "General list for user discussion, questions and support" <backuppc-users AT lists.sourceforge DOT net>
Date: Tue, 09 Nov 2010 14:58:58 +0100
Les Mikesell napsal(a):
> On 11/9/10 2:13 AM, Boniforti Flavio wrote:
>> Hello everybody.
>>
>> One of my remote servers has grown a single directory from a couple of
>> GB to 20GB in one day. Now backups (rsync through ssh) seem to be taking
>> ages and time-out after 72000 seconds. My question: when such a backup
>> gets stopped, will the next task consider the already transferred amount
>> of data, or will it start from the beginning? How may I check this
>> behaviour?
> 
> An rsync full should be marked as a 'partial' with the completed portion 
> merged 
> into the previous full as the comparison base when it restarts.  I think an 
> incomplete incremental is discarded.  I'd bump up the timeout and add a -C 
> (compress) option to your ssh command if you haven't already, and if it is 
> trying an incremental, force a full run at the first opportunity.
> 


Hi,

for huge dirs with millions of files we got almost an order of magnitude
faster runs with the tar mode instead of rsync (which eventually
consumed all the memory anyways :) )

Pavel.

------------------------------------------------------------------------------
The Next 800 Companies to Lead America's Growth: New Video Whitepaper
David G. Thomson, author of the best-selling book "Blueprint to a 
Billion" shares his insights and actions to help propel your 
business during the next growth cycle. Listen Now!
http://p.sf.net/sfu/SAP-dev2dev
_______________________________________________
BackupPC-users mailing list
BackupPC-users AT lists.sourceforge DOT net
List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:    http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/