BackupPC-users

Re: [BackupPC-users] Large Amounts of Data

2009-01-06 10:40:20
Subject: Re: [BackupPC-users] Large Amounts of Data
From: "Pedro M. S. Oliveira" <pmsoliveira AT gmail DOT com>
To: "General list for user discussion, questions and support" <backuppc-users AT lists.sourceforge DOT net>
Date: Tue, 6 Jan 2009 15:38:21 +0000
In one of the installations of backuppc I manage there are 6 real servers and about 15 virtual servers and a storage total size combined about 10 TB and it a works great with backuppc.
On the servers running VMware I do a full backup every 30 days with a weekly incremental backup. On the vmware hosts we backup the we retain 2 full backups with daily incremental backups for 30 days also and the same apply to the real servers.
With pooling and compression we don't have more than 8 TB, the fs is reiserfs.
Usually backups run at night in the weekdays and freely on weekends.


what take longer is the storage that has about 5TB and takes more than a day to do a full backup, i also allow multiple backups to run at the same time (10) this will allow to take full use of the gigacards, cpu, memory and cpu (it's a quad core) with 4 gb ram. if you do just a backup at a time you will waste your cpu as many of the files you do backup are small and your hosts don't send enough info to saturate the backuppc server hardware. with lots of backuppc at the same time we have steady mdstat stats of 50-60 Mb/s written to disk.


the backuppc has sata drives with hardware raid 5.
so i can say i'm real happy with backuppc. right now i have 4 major backuppc servers running with multiple configuration, backups over internet (if you teak a bit ssh options you can compress data on the move). i also have some minor installations at my house for my data for instance.
cheers
Pedro


On Monday 05 January 2009 23:39:43 Christopher Derr wrote:
> We're a mid-sized university academic department and are fairly happy
> with our current BackupPC setup. We currently backup an 800 GB
> fileserver (which has an iSCSI-attached drive), a few other sub-300 GB
> fileservers, a bunch of XP desktops. The 800 GB fileserver takes a long
> time to back up...almost a full day, and I think this is normal for
> BackupPC. We'd like to use BackupPC to backup some of our heftier linux
> servers -- moving into the multiple terabyte range (5-10 TB). We're
> considering a ZFS filesystem over gigabit for our backup target, but
> obviously are concerned that backing up 5 TB of data would take a week.
>
> Is this where we should consider multiple BackupPC servers to break up
> the backup time? Should we move to a solution with less overhead (if
> there is one)? Thanks for any input or experiences.
>
> Chris
>
> ------------------------------------------------------------------------------
> _______________________________________________
> BackupPC-users mailing list
> BackupPC-users AT lists.sourceforge DOT net
> List: https://lists.sourceforge.net/lists/listinfo/backuppc-users
> Wiki: http://backuppc.wiki.sourceforge.net
> Project: http://backuppc.sourceforge.net/
>


--
----------------------------------------------------------------------------------------------------------
Pedro M. S. Oliveira
IT Consultant
Email: pmsoliveira AT gmail DOT com
URL: http://pedro.linux-geex.com
Cellular: +351 96 5867227
----------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------
_______________________________________________
BackupPC-users mailing list
BackupPC-users AT lists.sourceforge DOT net
List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:    http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/
<Prev in Thread] Current Thread [Next in Thread>