Bacula-users

Re: [Bacula-users] Backup of many many files

2008-09-02 07:14:03
Subject: Re: [Bacula-users] Backup of many many files
From: Michael Galloway <mgx AT ornl DOT gov>
To: Daniel Betz <dbetz AT df DOT eu>
Date: Tue, 02 Sep 2008 07:13:51 -0400
On Tue, Sep 02, 2008 at 08:41:33AM +0200, Daniel Betz wrote:
> Hi Jose,
> 
> > -----Ursprüngliche Nachricht-----
> > Von: Jose Ildefonso Camargo Tolosa [mailto:ildefonso.camargo AT gmail DOT 
> > com]
> > Gesendet: Dienstag, 2. September 2008 03:11
> > An: Daniel Betz
> > Cc: bacula-users AT lists.sourceforge DOT net
> > Betreff: Re: [Bacula-users] Backup of many many files
> >
> > Hi!
> >
> > On Tue, Sep 2, 2008 at 3:15 AM, Daniel Betz <dbetz AT df DOT eu> wrote:
> > > Hi all,
> > >
> > >
> > >
> > > can you give me some tips for backing up an filesystem with many many
> > small
> > > files on it ?
> > >
> > > The problem is, that i must backup mailservers with about 300 GB and
> > more
> > > than 1-2 million of many small files (Maildir).

i'm going to jump into the middle of this thread as this is currrently my
biggest issue with bacula. my 'problematic' filesyste is this:

| 1,249 | birch         | 2008-07-27 00:25:05 | B    | F     | 16,060,382 | 
1,090,359,097,266 | T         |

16M files at just about 1.1TB. it currently takes me days go get this backup up 
via nfs mount to
a DLT-4 tape drive. the filesystem is on a Netapp, mounted via nfs with the 
netapp recommened nfs
options, 1000Mb/s network. here is the summary from the last full backup:

  Build OS:               x86_64-unknown-linux-gnu redhat
  JobId:                  1414
  Job:                    birch.2008-08-24_00.05.44
  Backup Level:           Full
  Client:                 "molbio-fd" 2.2.6 (10Nov07) 
x86_64-unknown-linux-gnu,redhat,
  FileSet:                "Birch Set" 2007-12-22 09:56:56
  Pool:                   "Full" (From Run pool override)
  Storage:                "LTO4" (From Job resource)
  Scheduled time:         24-Aug-2008 00:05:00
  Start time:             25-Aug-2008 11:32:24
  End time:               29-Aug-2008 12:45:00
  Elapsed time:           4 days 1 hour 12 mins 36 secs
  Priority:               10
  FD Files Written:       16,236,207
  SD Files Written:       16,236,207
  FD Bytes Written:       1,095,742,761,452 (1.095 TB)
  SD Bytes Written:       1,098,729,651,969 (1.098 TB)
  Rate:                   3131.1 KB/s
  Software Compression:   None
  VSS:                    no
  Encryption:             no
  Volume name(s):         020745L4|020746L4
  Volume Session Id:      135
  Volume Session Time:    1217593761
  Last Volume Bytes:      739,811,100,672 (739.8 GB)
  Non-fatal FD errors:    0
  SD Errors:              0
  FD termination status:  OK
  SD termination status:  OK
  Termination:            Backup OK

i'm using bacula 2.2.6, postgres 8.2.5, spooling of data and attributes. 

-- michael

-------------------------------------------------------------------------
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/
_______________________________________________
Bacula-users mailing list
Bacula-users AT lists.sourceforge DOT net
https://lists.sourceforge.net/lists/listinfo/bacula-users