BackupPC-users

Re: [BackupPC-users] rsync: full backup more than twice faster than incremental backup

2012-08-16 08:43:35
Subject: Re: [BackupPC-users] rsync: full backup more than twice faster than incremental backup
From: Udo Rader <listudo AT bestsolution DOT at>
To: "General list for user discussion, questions and support" <backuppc-users AT lists.sourceforge DOT net>
Date: Thu, 16 Aug 2012 14:42:02 +0200
On 08/16/2012 12:02 PM, Tim Fletcher wrote:
> On 16/08/12 09:47, Udo Rader wrote:
>> One of the reasons I can think of is the file structure on that host. It
>> serves as a special storage pool for a customer developed application
>> and as such it has really really many subdirectories with really really
>> many subdirectories with really really many subdirectories. And by
>> really really many I mean really really many ... So my best guess would
>> be that building the file list diff takes much longer than just fetching
>> the files as they exist.
>>
>> I've now disabled incremental backups on this server, but maybe someone
>> has an idea how to enable incremental backups for this host as well.
>>
>> thanks in advance!
> 
> Try using tar instead of rsync, you are correct that for large file
> trees rsync is very slow and also RAM intensive when it's building the
> filetrees

ok thanks, I will try that.

But IIRC, tar's pitfall is that it does not remove deleted files when
doing incremental backups, right?

------------------------------------------------------------------------------
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and 
threat landscape has changed and how IT managers can respond. Discussions 
will include endpoint security, mobile security and the latest in malware 
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
_______________________________________________
BackupPC-users mailing list
BackupPC-users AT lists.sourceforge DOT net
List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:    http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/