BackupPC-users

Re: [BackupPC-users] Improving large rsync backup performance

2012-07-09 10:25:55
Subject: Re: [BackupPC-users] Improving large rsync backup performance
From: "Michael Stowe" <mstowe AT chicago.us.mensa DOT org>
To: "General list for user discussion, questions and support" <backuppc-users AT lists.sourceforge DOT net>
Date: Mon, 9 Jul 2012 09:24:36 -0500
> I've got a user running Win7-64 with 3 large drives: C (original boot), D
> (data), and G (Win7 boot). I've configured rsyncd on it to serve them as 3
> modules named for the drive letters. A "full" backup to my CentOS 5 box
> takes about 40 hours, and an "incremental" takes about 8, so I've
> configured his system to only back up on weekends. But even then, he often
> works weekends and will reboot his machine because it's running slow from
> the backup load, killing the backup.
>
> What can I do to optimize the backup to reduce the time taken so it's more
> likely to run to completion? I was thinking I could reconfigure it to be
> three hosts with one drive each, so that there's more chance of running to
> completion.

You don't say how big the drives are, but 40 hours says "terabytes" to me.
 If that's not the case, I'd seriously consider [re]examining your rsync
version on the client.  (Or perhaps beefing up your server.)

It's also possible that the client is underpowered in terms of CPU or RAM
for the vast numbers of files involved; it may be worth examining the
client during a backup to see what kind of resources it's using.  (I
generally don't see a lot of slowness, even on active machines, here, but
we're not backing up terabytes from workstations, either.)

The suggestion you already made (namely, breaking the three modules into
three hosts) is probably the next thing I'd try.

------------------------------------------------------------------------------
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and 
threat landscape has changed and how IT managers can respond. Discussions 
will include endpoint security, mobile security and the latest in malware 
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
_______________________________________________
BackupPC-users mailing list
BackupPC-users AT lists.sourceforge DOT net
List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:    http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/