BackupPC-users

Re: [BackupPC-users] What to do about long backup times on large partitions

2011-01-19 11:04:46
Subject: Re: [BackupPC-users] What to do about long backup times on large partitions
From: "Tyler J. Wagner" <tyler AT tolaris DOT com>
To: "General list for user discussion, questions and support" <backuppc-users AT lists.sourceforge DOT net>
Date: Wed, 19 Jan 2011 16:02:13 +0000
On Wed, 2011-01-19 at 04:37 -0800, Jeffrey Newman wrote:
> I'm trying to backup a large partition. About 1.1TB.
> The machine is few years old, so the data rate over the wire is about 12 
> MB/sec. The first full backup took over 40 hours. The incrementals are taking 
> over 12 hours. 
> 
> My assumption is that the file time and date stamp are sent over and possibly 
> a checksum. This is compared against the previously backed up files.

With rsync:

- For a Full backup, checksums are calculated on the client and compared
against the pool. If not found, they are copied over.

- For an Incremental backup, each file's date is compared against the
previous Full (or relevant Incremental, if using multiple levels of
Incremental) backup. If the date is newer, it is copied.

The archive bit on VFAT is ignored. No other mechanism exists to tag the
files manually.

> Or is there some other way to speed things up?

Speed up the machine. However, the first full is always slow. You can
use multiple levels of incremental:

$Conf{IncrLevels} = [1, 2, 3, 4, 5, 6];

This means dates will be compared against the last incremental instead
of the last full, so fewer files will be copied. However, it means
BackupPC will store more incrementals. IE, If Incremental 5 must be
preserved by the rules (IncrKeepCnt, etc), Incrementals 1-4 will always
be preserved.

The only real issue with doing so, aside from possible storing more data
in the pool for longer, is if you have some kind of messed up software
that changes files without changing date stamps. But that will make ANY
incremental unsafe.

Regards,
Tyler

-- 
"If one would give me six lines written by the hand of the most honest
man, I would find something in them to have him hanged."
  -- Armand Jean du Plessis, Cardinal Richelieu


------------------------------------------------------------------------------
Protect Your Site and Customers from Malware Attacks
Learn about various malware tactics and how to avoid them. Understand 
malware threats, the impact they can have on your business, and how you 
can protect your company and customers by using code signing.
http://p.sf.net/sfu/oracle-sfdevnl
_______________________________________________
BackupPC-users mailing list
BackupPC-users AT lists.sourceforge DOT net
List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:    http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/