Bacula-users

[Bacula-users] Copying huge number of files - very slow

2010-03-02 12:14:40
Subject: [Bacula-users] Copying huge number of files - very slow
From: Sean Carolan <scarolan AT gmail DOT com>
To: bacula-users AT lists.sourceforge DOT net
Date: Tue, 2 Mar 2010 11:10:15 -0600
Hello bacula users:

We have a server that uses BackupPC to handle network-based backups of
a couple hundred hosts on our network.  If you're not familiar with
BackupPC, it uses rsync and a clever pooling technique to optimize
storage space.  The downside of this is that you can end up with
millions of obscure files in the backup partition and tons of hard
links pointing to the various files.  Currently our backup partition
has around 1.2 terabytes of data on it.

I'd like to use bacula to copy this data to tapes for off-site
storage.  We have an HP d2d device that gets speeds from 30-60
megabytes per second during testing with btape.  When I try to run a
bacula job for our backuppc partition however I only get around 25MB
per *minute*.  At this rate it will take days to back up the entire
partition.

Any suggestions on how we might speed this up?

Thanks

Sean

------------------------------------------------------------------------------
Download Intel&#174; Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
_______________________________________________
Bacula-users mailing list
Bacula-users AT lists.sourceforge DOT net
https://lists.sourceforge.net/lists/listinfo/bacula-users