Bacula-users

Re: [Bacula-users] Issues being encountered with spooling attributes (Bacula 2.2.10-b4)

2008-08-11 13:02:13
Subject: Re: [Bacula-users] Issues being encountered with spooling attributes (Bacula 2.2.10-b4)
From: Frank Sweetser <fs AT WPI DOT EDU>
To: Matthew Macdonald-Wallace <lists AT truthisfreedom.org DOT uk>
Date: Mon, 11 Aug 2008 13:01:58 -0400
Matthew Macdonald-Wallace wrote:
> Hi,
> 
> We've had a Bacula installation running using multiple pools for daily
> tapes as documented in the manual for the last few weeks.
> 
> The system is backing up approx. 1.4TB from two SCSI-attached arrays
> and the local disks to a Sony LIB-162 Tape library using AIT5 tapes for
> the weekly backups and AIT3 tapes for the incrementals.
> 
> This weekend, the backup took 2 days, 11 hours, 44 mins and 29 secs
> which seems a tad excessive to me!
> 
> We are spooling the data 50G at a time and the spool directory is
> excluded from the backup definitions.
> 
> The de-spooling of attributes started at 22:22 last night and finished
> at 10:45 this morning:
> 
> 10-Aug 22:18 dellserver-sd JobId 152: Committing spooled data to Volume
> "Friday13". Despooling 15,289,245,008 bytes ... 
> 10-Aug 22:22 dellserver-sd JobId 152: Despooling elapsed time =
> 00:03:51, Transfer rate = 66.18 M bytes/second 
> 10-Aug 22:22 dellserver-sd JobId 152: Sending spooled attrs to the
> Director. Despooling 5,646,193,682 bytes ... 
> 11-Aug 10:44 dellserver-dir JobId 152: Bacula dellserver-dir 2.2.10-b4
> (24May08): ... backup report starts...
> 
> What kind of information do people need to start helping me out on this
> one? I can post/upload configs, logs and any other info to the list if
> required.
> 
> My main concern is that the DIR, FD and SD are all on the same machine,
> yet it is still taking this long to complete.

I have two suggestions on speeding this up.

First, since the FD and SD are on the same machine, you're probably not going 
to get any gains from spooling.  Normally, spooling is used when backing up 
machines over a network to minmize tape shoe-shining.  The only purely local 
case in which spooling would help at all is if the disk that the data live on 
is not fast enough to feed the tape drive at a reasonable speed, but the spool 
disk is.  Otherwise, you're just copying around data unnecessarily.

Second, if you upgrade to the latest version (2.4.2), you can enable batch 
importing of attributes (at least, assuming you're using mysql or postgresql - 
and if you're not, you should be!).  This can speed up attribute inserting 
greatly, and given that you're around 12 hours of attribute despooling right 
now, this may help you out a lot.

There may be other tweaks you can do later on, but these two should be pretty 
simple to try and should give you a pretty substantial speedup.

-- 
Frank Sweetser fs at wpi.edu  |  For every problem, there is a solution that
WPI Senior Network Engineer   |  is simple, elegant, and wrong. - HL Mencken
     GPG fingerprint = 6174 1257 129E 0D21 D8D4  E8A3 8E39 29E3 E2E8 8CEC

-------------------------------------------------------------------------
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/
_______________________________________________
Bacula-users mailing list
Bacula-users AT lists.sourceforge DOT net
https://lists.sourceforge.net/lists/listinfo/bacula-users

<Prev in Thread] Current Thread [Next in Thread>