Bacula-users

Re: [Bacula-users] Speed of backups

2011-04-29 03:36:44
Subject: Re: [Bacula-users] Speed of backups
From: Ralf Gross <Ralf-Lists AT ralfgross DOT de>
To: bacula-users AT lists.sourceforge DOT net
Date: Fri, 29 Apr 2011 09:33:00 +0200
Jason Voorhees schrieb:
> > I got the biggest gain by changing "Maximum File Size" to 5 GB. How
> > fast is the disk where you spool file is locatet?
> >
> > A different test would be to create a 10 GB file with data from
> > /dev/urandom in the spool directory and the write this file to tape
> > (eg. nst0). Note: this will overwrite your existing data on tape and
> > you might have to release the drive in bacula.
> >
> > dd if=/spoolfile-directory/testfile of=/dev/nst0 bs=xxxk (your bacula block 
> > size)
> >
> >
> > Ralf
> 
> Ok, I made this:
> [root@qsrpsbk1 spool]# dd if=/dev/urandom of=random.tst bs=1M count=10240
> 
> [root@qsrpsbk1 spool]# dd if=random.tst of=/dev/st0 bs=2048k count=5000
> 5000+0 records in
> 5000+0 records out
> 10485760000 bytes (10 GB) copied, 160.232 s, 65.4 MB/s
> 
> The block size of 2048k is the same I'm using at Bacula Storage Daemon
> configuration (Maximum Block Size = 2097152). Why the speed of dd was
> 65 MB/s when my Despooling speed is about ~80-90 MB/s?


This is too slow.  Try a block size of 256k with dd, this is what I
use in bacula too. Or try different block sizes beginning by 64k to see
how the speed changes.

This are my SD settings.

Maximum File Size = 5G
Maximum Block Size = 262144
Maximum Network Buffer Size = 262144


 
> Well, these are my results of a bonnie++ test:
> ...
> Version 1.03e       ------Sequential Output------ --Sequential Input- 
> --Random-
>                     -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- 
> --Seeks--
> Machine        Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP  /sec 
> %CP
> qsrpsbk1.qui 36200M 77100  96 108223  18 48701   7 77012  93 142733
> 8 681.7   0
>                     ------Sequential Create------ --------Random 
> Create--------
>                     -Create-- --Read--- -Delete-- -Create-- --Read--- 
> -Delete--
>               files  /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec 
> %CP
>                  16 +++++ +++ +++++ +++ +++++ +++ +++++ +++ +++++ +++ +++++ 
> +++
> qsrpsbk1.mydomain.com,36200M,77100,96,108223,18,48701,7,77012,93,142733,8,681.7,0,16,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++
> 
> 
> What do you think about these tests?



This disk is too slow for spooling. Even with LTO4 you need a drive
that is capable of stream the data with > 150 MB/s. I use a raid10
with 6 WD VelociRaptor drives. 


Ralf



------------------------------------------------------------------------------
WhatsUp Gold - Download Free Network Management Software
The most intuitive, comprehensive, and cost-effective network 
management toolset available today.  Delivers lowest initial 
acquisition cost and overall TCO of any competing solution.
http://p.sf.net/sfu/whatsupgold-sd
_______________________________________________
Bacula-users mailing list
Bacula-users AT lists.sourceforge DOT net
https://lists.sourceforge.net/lists/listinfo/bacula-users

<Prev in Thread] Current Thread [Next in Thread>