Bacula-users

Re: [Bacula-users] Need help with blocking factor and speeds

2008-08-19 05:19:43
Subject: Re: [Bacula-users] Need help with blocking factor and speeds
From: Ralf Gross <Ralf-Lists AT ralfgross DOT de>
To: bacula-users AT lists.sourceforge DOT net
Date: Tue, 19 Aug 2008 11:18:57 +0200
T. Horsnell schrieb:
> James Cort wrote:
> > Ralf Gross wrote:
> > 
> >>Does anyone get more than 80 MB/s with bacula and LTO-4 drives? That's
> >>the same limit I'm hitting all the time. It doesn't make any
> >>difference if I use spooling or get the data direct over the network.
> >>The limit is always around 80 MB/s.
> > 
> > 
> > Funny you should say that, I have an LTO-3 drive and I can't get much 
> > above 60MB/s with bacula 2.2.8 (debian-backports package), regardless of 
> > where the data is coming from or if it's large or small files.  On paper 
> > at least I should be able to beat that.  I'd assumed it was a limitation 
> > imposed by seek time and database overhead.
> > 
> > Perhaps I should test with a few large files and tar...
> > 
> > 
> > James.
> > 
> 
> I'm in a similar boat. I did tests with tar and dd, using a single large 
> (100GB) file full of random data to prevent compression (how do you 
> control compression on Linux /dev/stN drives...) and got max 
> 110MBytes/sec on my LTO4 drives (the LTO4 spec says 120MBytes/sec max). 
>    I never managed better than 70MBytes/sec backing up that same single 
> file with Bacula. This file lives on a raid6 system and it dd'd to 
> /dev/null at 450Mbytes/sec, so the disk wasnt the cause of delays.
> 
> One day I'll try using /dev/null as the backup device to try and isolate 
> other reasons for the delays.

I can get the native drive speed with other tools, but with bacula the
magical limit is always between 75 and 80 MB/s.

I've change some parameters but I see absolute no difference to the
default values. Attribute Spooling is enabled too.

Maximum Block Size = 512000
Maximum Network Buffer Size = 262144

The RAID array can deliver ~380 MB/s, I backup mainly large files and
the network connection are 2 bonded GbE NICs. 

But it seems that I'm not the only one that hits this limit. Again, is
there anybody getting more than 80 MB/s?

Ralf

-------------------------------------------------------------------------
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/
_______________________________________________
Bacula-users mailing list
Bacula-users AT lists.sourceforge DOT net
https://lists.sourceforge.net/lists/listinfo/bacula-users