BackupPC-users

Re: [BackupPC-users] backuppc for large scale env

2009-08-27 14:27:06
Subject: Re: [BackupPC-users] backuppc for large scale env
From: Les Mikesell <lesmikesell AT gmail DOT com>
To: "General list for user discussion, questions and support" <backuppc-users AT lists.sourceforge DOT net>
Date: Thu, 27 Aug 2009 13:23:47 -0500
Brent Clark wrote:
> Michael Stowe wrote:
>> It depends on what you mean by "large scale" and what your particular
>> plans are.  Having a BackupPC server in each of a dozen countries to back
>> up offices of 10-50 people each probably wouldn't require anything
>> special, while trying to back up a PC in Columbia from Germany may require
>> a special deal with the local militia not to blow up the leased lines, and
>> your problems would have very little to do with BackupPC.
>>
>> Typically in a large scale enterprise, any backup solution is part of a
>> larger backup plan that includes data retention policies, recovery
>> commitments, storage policies, and deployment considerations built around
>> the needs of the organization within the bounds of the infrastructure,
>> considering the characteristics of the data that requires protection.
> 
> Hiya
> 
> Thanks for replying, given additional food for thought.
> 
> Im looking at 107 servers (As said ... around the world, most of which are in 
> datacentres, and im expected to take on more in the foreseeable future).
> Currently I got a clunky rsync / scp, script solution going, which oddly 
> enough works, but I would like something better.

Usually the issue that limits performance with backuppc is disk seek 
time as it manages hardlinks and directories which have to be on a 
single file system.  About the only thing you can do to improve that is 
to use a raid scheme that includes a lot of drives and add RAM for 
buffering.  Next would be CPU use because the rsync implementation in 
perl is less efficient than the native C version and the files are 
normally compressed.  For remote targets, bandwidth may be also be the 
limiting factor - you can add the -C option to get ssh-level compression 
but backuppc's rsync does not support -z.

So, if you are currently managing this number of targets with rsync 
scripts, backuppc may or may not work at the same scale - but it might 
be easier to manage even if you have to break the set up and split them 
between two servers.

-- 
   Les Mikesell
    lesmikesell AT gmail DOT com


------------------------------------------------------------------------------
Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day 
trial. Simplify your report design, integration and deployment - and focus on 
what you do best, core application coding. Discover what's new with 
Crystal Reports now.  http://p.sf.net/sfu/bobj-july
_______________________________________________
BackupPC-users mailing list
BackupPC-users AT lists.sourceforge DOT net
List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:    http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/