BackupPC-users

[BackupPC-users] Incremental Seems To Backup Whole System

2010-02-18 10:52:52
Subject: [BackupPC-users] Incremental Seems To Backup Whole System
From: Mike Bydalek <mbydalek AT compunetconsulting DOT com>
To: backuppc-users AT lists.sourceforge DOT net
Date: Thu, 18 Feb 2010 07:51:13 -0700
Hello.

Recently I've started using BackupPC to backup my file server and am
seeing some things that just don't quite make much sense.  Lately
backups have been taking quite some time, in fact the current one
started on 2/16 @ 11pm and is still running.  I do have a lot of data,
around 330G, but not a whole lot changes on a daily basis.

Here are my latest backups with the times:

Compression performance for files already in the pool and newly
compressed files.
        Existing Files  New Files
Backup#         Type    Comp Level      Size/MB         Comp/MB         Comp    
Size/MB         Comp/MB         Comp
0       full    3       78446.6         45871.8         41.5%   258032.2        
155715.6        39.7%
2       incr    3       276482.0        165123.8        40.3%   143.0   70.3    
50.8%
3       incr    3       900.7   530.7   41.1%   964.7   469.5   51.3%
4       incr    3       113.5   2.7     97.6%   218.0   30.8    85.9%
5       incr    3       73.4    6.1     91.7%   194.8   32.2    83.5%
6       incr    3       304.3   172.2   43.4%   1735.9  944.0   45.6%
7       incr    3       275955.3        165019.1        40.2%   1337.0  658.0   
50.8%
8       incr    3       520.4   249.4   52.1%   672.7   282.5   58.0%
9       incr    3       502.9   243.5   51.6%   587.6   264.1   55.1%
10      incr    3       116.8   3.7     96.8%   201.5   24.3    88.0%
11      incr    3       14.0    3.0     78.7%   244.3   32.8    86.6%
12      incr    3       127.1   5.3     95.9%   82.2    22.3    72.8%
13      incr    3       276989.9        165643.4        40.2%   329.3   40.7    
87.7%
14      incr    3       275957.9        165146.0        40.2%   1503.5  615.1   
59.1%

My question is, why did backups 13 and 14 backup all that data?  Same
with 2 and 7 for that matter.

Here's the times for the first few backups to give you an idea of the
time it's taking:

Backup#          Type    Filled          Level           Start Date      
Duration/mins          
Age/days         Server Backup Path
0       full    yes     0       2/9 07:29       1767.6  9.0     
/backup/BackupPC/pc/fileserver/0
2       incr    no      1       2/10 23:59      1124.8  7.3     
/backup/BackupPC/pc/fileserver/2
3       incr    no      3       2/11 19:00      68.3    6.5     
/backup/BackupPC/pc/fileserver/3
4       incr    no      4       2/12 01:00      73.6    6.3     
/backup/BackupPC/pc/fileserver/4
5       incr    no      5       2/12 07:00      73.9    6.0     
/backup/BackupPC/pc/fileserver/5
6       incr    no      6       2/12 13:00      102.5   5.8     
/backup/BackupPC/pc/fileserver/6
7       incr    no      1       2/12 19:00      1097.0  5.5     
/backup/BackupPC/pc/fileserver/7

Below is my config.  I'm still messing with the IncrLevels and have a
super short period just to get some increments and all that going.

$Conf{PingMaxMsec} = '200';
$Conf{RsyncShareName} = [
  '/',
  '/data/secondary',
  '/boot'
];
$Conf{BackupFilesExclude} = {
  '*' => [
    '/dev',
    '/mnt',
    '/proc',
    '/sys',
    '/tmp',
    '/var/named/chroot/proc'
  ]
};
$Conf{BlackoutPeriods} = [];
$Conf{IncrKeepCnt} = '12';
$Conf{IncrLevels} = [
  '1',
  '2',
  '3',
  '4',
  '5',
  '6'
];
$Conf{IncrPeriod} = '0.24';
$Conf{RsyncArgs} = [
  '--numeric-ids',
  '--perms',
  '--owner',
  '--group',
  '-D',
  '--links',
  '--hard-links',
  '--times',
  '--block-size=2048',
  '--recursive'
];

I also have logging set to 1 and when looking at the XferLOG I do see
all the files, but I'm seeing a lot of "create d"  I'm not sure what
the column should be when it is transferring a file.

Any ideas as to what may be going on?  After the initial backup, I
would expect each increment to only take a short amount of time.

Thanks in advance for any insight!

Regards,
Mike

------------------------------------------------------------------------------
Download Intel&#174; Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
_______________________________________________
BackupPC-users mailing list
BackupPC-users AT lists.sourceforge DOT net
List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:    http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/