BackupPC-users

Re: [BackupPC-users] experiences with very large pools?

2010-02-19 11:29:04
Subject: Re: [BackupPC-users] experiences with very large pools?
From: Ralf Gross <Ralf-Lists AT ralfgross DOT de>
To: backuppc-users AT lists.sourceforge DOT net
Date: Fri, 19 Feb 2010 17:27:40 +0100
Timothy J Massey schrieb:
> Ralf Gross <Ralf-Lists AT ralfgross DOT de> wrote on 02/19/2010 10:42:35 AM:
> 
> > bit off topic:
> > Right now I'm looking for a cheap storage solution that is based
> > on supermicro chassis with 36 drive bays (server) or 45 drive bays
> > (expansion unit) in 4 HU. Frightening, that would be 810 TB in one
> > Rack (36 + 45 HDDs x 5 x 2 TB, 40 HU) with 5 servers. Only problem is
> > power, cooling and.... backup.
> 
> That's why companies like EMC and NetApp get big money for selling you 
> nearly the *exact* same hardware:  but with software and services designed 
> to handle things like...backup.
> 
> With storage sets of that size, there's really very little you can do 
> outside of snapshots, volume management and lots and lots of disk (and 
> chassis and processor and power and ...) redundancy.  Simply traversing a 
> file system of that size is going to take more time than you have for a 
> backup window.  If you want anything approaching daily backups, you can't 
> do it at the filesystem level.  :(
> 
> And even for things like off-site backup, it's far easier to have a 
> smaller version of your big array off-site and sync a snapshot 
> periodically (taking advantage of the logging/COW filesystem of the array 
> system) than it is to try to traverse an entire 800TB filesystem (or 
> multiple filesystems that add up to 800TB).

Your are absolutely right. I hope we will realize part of the storage
with eg. NetApp and only a small part with a cheap solution which
doesn't need backup or only in a "best effort" way.

The data is not changing much, most of the files just lie there and
will not be read again.

Ralf

------------------------------------------------------------------------------
Download Intel&#174; Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
_______________________________________________
BackupPC-users mailing list
BackupPC-users AT lists.sourceforge DOT net
List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:    http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/