BackupPC-users

Re: [BackupPC-users] Why does my rsync backup takes 7 hours?

2010-09-14 00:12:00
Subject: Re: [BackupPC-users] Why does my rsync backup takes 7 hours?
From: "Kenneth L. Owen" <tx836519 AT bellsouth DOT net>
To: "General list for user discussion, questions and support" <backuppc-users AT lists.sourceforge DOT net>
Date: Tue, 14 Sep 2010 00:09:10 -0400
Hi George,

I run BackupPC on Ubuntu Linux to backup my data.  Several years ago, I
was running a windows network with a file server housing all of the
data.  I am trying desperately to totally stop using windows, but it's
tough when so many vendors will only support Windows systems.  But that
is not the issue here...

I am not any kind of expert on BackupPC and still consider myself a
little wet behind the ears when it comes to Linux as well.  While this
doesn't address your problem, it may be a direction that will get the
desired results.

My server is now a Linux box serving files to Windows machines via
samba.  All data is served from this machine.  Another machine is
located in a separate building, running Linux and hosts the BackupPC
system.  This machine is also set up as a samba server and can be
quickly placed into service if the primary server fails and cannot be
quickly repaired.

I manually make images of the windows OS for each machine (no data
files, just OS) after hardware changes or major system updates.  Now,
BackupPC is only backing up Linus systems via rsync.  (It doesn't know
or care that a lot of the backup data is for the windows clients.)

I am retired and some nights I can't sleep.  I work all night on
projects and I am unaware of the BackupPC process running in the 1 am to
7 am time span.  It doesn't impact my work whether I am working in
Windows or Linux.

Just some info that you may can use.  -- ken



On Mon, 2010-09-13 at 23:26 -0400, George Adams wrote:
> Hi, all.  I'm running BackupPC 3.1.0 on a Linux server (in my home), using it 
> to backup my WinXP box (on the same network) via rsync (which is run as a 
> service under WinXP via Cygwin).
> 
> The process seems to work, but it's really, really slow.  Here's what I mean:
> 
> Backup# Type Filled Level Start Date Duration/mins Age/days Server Backup Path
> 568     incr no     1     8/25 08:00 428.5         19.6     /backup/Photos/568
> 569     incr no     1     9/11 09:00 171.4         2.6      /backup/Photos/569
> 570     incr no     1     9/12 21:00 156.8         1.1      /backup/Photos/570
> 
> As you can see, the last couple of incremental backups of the photos 
> directories on my XP box have taken between 2-3 hours, and the full backup 
> takes a whopping 7 hours.
> 
>              TOTAL  TOTAL      TOTAL  EXIST  EXIST      NEW    NEW
> Backup# Type #Files Size/MB    MB/sec #Files Size/MB    #Files Size/MB
> 568     full 21665  132328.3    5.15  21665  132328.3   1      0.0
> 569     incr 21702  132850.0   12.92  21673  132848.9   29     1.1
> 570     incr 21719  132850.4   14.12  21694  132849.8   80     0.6
> 
> Now granted, this is a lot of files - 21,000+ files, 132GB.  But even given 
> that, are these incredibly long backup durations REALLY to be expected?  Even 
> worse, the WinXP computer really is almost unusable while this is going on.  
> The hard drive is so busy (and rsync so resource-intensive) that other 
> applications take forever to launch, run, etc.  What I had hoped would be a 
> quiet, unobtrusive way to backup the PC during the day actually makes it 
> fairly unusable for several hours.
> 
> And in the end, when the result of a 2-3 hour incremental backup is that less 
> than 100 files even needed to be backed up... well, it just makes me wonder 
> if I'm doing something wrong.  I hope that this isn't just par-for-the-course.
> 
> I don't really know how to diagnose this problem, so here are some config 
> details, from the PC config file and the header from the latest XferLog.  I'd 
> be happy to provide any other configuration details if they'll help.
> 
> /ETC/BACKUPPC/PC/PHOTOS.PL
> 
=============== snip================


------------------------------------------------------------------------------
Start uncovering the many advantages of virtual appliances
and start using them to simplify application deployment and
accelerate your shift to cloud computing.
http://p.sf.net/sfu/novell-sfdev2dev
_______________________________________________
BackupPC-users mailing list
BackupPC-users AT lists.sourceforge DOT net
List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:    http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/