BackupPC-users

[BackupPC-users] Why does my rsync backup takes 7 hours?

2010-09-13 23:29:00
Subject: [BackupPC-users] Why does my rsync backup takes 7 hours?
From: George Adams <g_adams27 AT hotmail DOT com>
To: <backuppc-users AT lists.sourceforge DOT net>
Date: Mon, 13 Sep 2010 23:26:09 -0400
Hi, all.  I'm running BackupPC 3.1.0 on a Linux server (in my home), using it 
to backup my WinXP box (on the same network) via rsync (which is run as a 
service under WinXP via Cygwin).

The process seems to work, but it's really, really slow.  Here's what I mean:

Backup# Type Filled Level Start Date Duration/mins Age/days Server Backup Path
568     incr no     1     8/25 08:00 428.5         19.6     /backup/Photos/568
569     incr no     1     9/11 09:00 171.4         2.6      /backup/Photos/569
570     incr no     1     9/12 21:00 156.8         1.1      /backup/Photos/570

As you can see, the last couple of incremental backups of the photos 
directories on my XP box have taken between 2-3 hours, and the full backup 
takes a whopping 7 hours.

             TOTAL  TOTAL      TOTAL  EXIST  EXIST      NEW    NEW
Backup# Type #Files Size/MB    MB/sec #Files Size/MB    #Files Size/MB
568     full 21665  132328.3    5.15  21665  132328.3   1      0.0
569     incr 21702  132850.0   12.92  21673  132848.9   29     1.1
570     incr 21719  132850.4   14.12  21694  132849.8   80     0.6

Now granted, this is a lot of files - 21,000+ files, 132GB.  But even given 
that, are these incredibly long backup durations REALLY to be expected?  Even 
worse, the WinXP computer really is almost unusable while this is going on.  
The hard drive is so busy (and rsync so resource-intensive) that other 
applications take forever to launch, run, etc.  What I had hoped would be a 
quiet, unobtrusive way to backup the PC during the day actually makes it fairly 
unusable for several hours.

And in the end, when the result of a 2-3 hour incremental backup is that less 
than 100 files even needed to be backed up... well, it just makes me wonder if 
I'm doing something wrong.  I hope that this isn't just par-for-the-course.

I don't really know how to diagnose this problem, so here are some config 
details, from the PC config file and the header from the latest XferLog.  I'd 
be happy to provide any other configuration details if they'll help.

/ETC/BACKUPPC/PC/PHOTOS.PL

--------------------------

$Conf{ClientNameAlias} = 'myhostname-is-here.org';

$Conf{FullPeriod}      = '21';

$Conf{FullKeepCnt}     = '1';



$Conf{XferMethod}     = 'rsyncd';

$Conf{RsyncdUserName} = 'backuppc';

$Conf{RsyncdPasswd}   = 'password-is-here';



$Conf{RsyncShareName} = [

   'cDrive'

];

$Conf{BackupFilesOnly} = [

   'Documents and Settings/George Adams/My Documents/My Pictures',

   'Documents and Settings/George Adams/My Documents/Photos',

];




XFERLOG.570.Z
-------------------
incr backup started back to 2010-08-25 08:00:03 (backup #558) for directory 
cDrive
Connected to myhostname-is-here.org:873, remote version 30
Negotiated protocol version 28
Connected to module cDrive
Sending args: --server --sender --numeric-ids --perms --owner --group -D 
--links --hard-links --times --block-size=2048 --recursive 
--checksum-seed=32761 . .
Checksum caching enabled (checksumSeed = 32761)
Sent include: /Documents and Settings
Sent include: /Documents and Settings/George Adams
Sent include: /Documents and Settings/George Adams/My Documents
Sent include: /Documents and Settings/George Adams/My Documents/My Pictures
Sent include: /Documents and Settings/George Adams/My Documents/Photos
Sent exclude: /*
Sent exclude: /Documents and Settings/*
Sent exclude: /Documents and Settings/George Adams/*
Sent exclude: /Documents and Settings/George Adams/My Documents/*
Xfer PIDs are now 16059
  create d 775    544/18           0 .
  create d 775    544/18           0 Documents and Settings
  create d 770    544/18           0 Documents and Settings/George Adams
  create d 700  1003/513           0 Documents and Settings/George Adams/My 
Documents
  create d 700  1003/513           0 Documents and Settings/George Adams/My 
Documents/My Pictures
  create d   0 4294967295/4294967295           0 Documents and Settings/George 
Adams/My Documents/My Pictures/2002
  create d   0 4294967295/4294967295           0 Documents and Settings/George 
Adams/My Documents/My Pictures/2002/2002_04_30
  same       0 4294967295/4294967295      899062 Documents and Settings/George 
Adams/My Documents/My Pictures/2002/2002_04_30/100-0023_IMG.JPG
  same       0 4294967295/4294967295      900896 Documents and Settings/George 
Adams/My Documents/My Pictures/2002/2002_04_30/100-0024_IMG.JPG
  same       0 4294967295/4294967295      929666 Documents and Settings/George 
Adams/My Documents/My Pictures/2002/2002_04_30/100-0025_IMG.JPG
  same       0 4294967295/4294967295      820660 Documents and Settings/George 
Adams/My Documents/My Pictures/2002/2002_04_30/100-0026_IMG.JPG
... more files get processed ...
Done: 21719 files, 139303771902 bytes


Thanks to anyone who can help!
                                          
------------------------------------------------------------------------------
Start uncovering the many advantages of virtual appliances
and start using them to simplify application deployment and
accelerate your shift to cloud computing.
http://p.sf.net/sfu/novell-sfdev2dev
_______________________________________________
BackupPC-users mailing list
BackupPC-users AT lists.sourceforge DOT net
List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:    http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/