Bacula-users

Re: [Bacula-users] DesSpooling Attr

2013-11-27 08:20:20
Subject: Re: [Bacula-users] DesSpooling Attr
From: Iban Cabrillo <cabrillo AT ifca.unican DOT es>
To: Cejka Rudolf <cejkar AT fit.vutbr DOT cz>
Date: Wed, 27 Nov 2013 14:17:05 +0100
Hi Cejka,
  The server runs smooth :

top - 14:11:06 up 20:18,  2 users,  load average: 0.00, 0.01, 0.24
Tasks: 154 total,   1 running, 153 sleeping,   0 stopped,   0 zombie
Cpu0  :  0.0%us,  0.0%sy,  0.0%ni,100.0%id,  0.0%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu1  :  0.0%us,  0.0%sy,  0.0%ni,100.0%id,  0.0%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu2  :  0.0%us,  0.0%sy,  0.0%ni,100.0%id,  0.0%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu3  :  0.0%us,  0.3%sy,  0.0%ni, 99.7%id,  0.0%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu4  :  0.0%us,  0.0%sy,  0.0%ni,100.0%id,  0.0%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu5  :  0.0%us,  0.0%sy,  0.0%ni,100.0%id,  0.0%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu6  :  0.0%us,  0.0%sy,  0.0%ni,100.0%id,  0.0%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu7  :  0.0%us,  0.0%sy,  0.0%ni,100.0%id,  0.0%wa,  0.0%hi,  0.0%si,  0.0%st
Mem:   8177080k total,  6680440k used,  1496640k free,   151984k buffers
Swap:   585724k total,     2516k used,   583208k free,  1713752k cached


HDDs are not SSD but SAS over RAID1 hardware
my.cnf :

open-files-limit=8192
max_connections=500
wait_timeout=86800
innodb_data_home_dir=/data/mysql
innodb_file_per_table
innodb_lock_wait_timeout=500
innodb_log_file_size=1G
innodb_buffer_pool_size=4G

query_cache_size=128M
tmp_table_size=256M
thread_cache_size=16
query_cache_limit=16M
max_heap_table_size=256M
table_cache=256


I see my bacula version is 5.2.6 (21 February 2012) From Ubuntu 12.10 repo, yours 5.2.12 (12Sep12), I do not know if there are many improvements in th DB between both releases.


Regards, I




2013/11/27 Cejka Rudolf <cejkar AT fit.vutbr DOT cz>
Iban Cabrillo wrote (2013/11/27):
>  Data spooling: 0 active jobs, 0 bytes; 1 total jobs, 1,845,487,814 max
> bytes/job.
>  Attr spooling: 1 active jobs, 18,289,433 bytes; 0 total jobs, 18,289,433
> max bytes.
>
> Data spooling about 10 minutes, Attr Spooling more than 30 minutes and
> growing....
> This happen for LT03 and LT=5 tapes

Could you look at mysql server please? Its CPU usage, disk usage,
swapping, memory usage...

Here are examples from my backup server with mysql:

1) 18,688,335 files in 37 minutes, which is ~ 500,000 files per minute:

   03-Nov 08:37 backup-sd: Sending spooled attrs to the Director.
   +Despooling 6,159,834,448 bytes ...
   03-Nov 09:14 backup-dir: Bacula backup-dir 5.2.12 (12Sep12):

2) 309,936 files in time is under 1 minute:

   02-Nov 14:00 backup-sd: Sending spooled attrs to the Director.
   +Despooling 86,532,417 bytes ...
   02-Nov 14:00 backup-dir: Bacula backup-dir 5.2.12 (12Sep12):

I think that there are three key settings on my server:

1) MyISAM tables
2) delay_key_write = ALL in my.cnf
3) Database on SSD

Best regards.

--
Rudolf Cejka <cejkar at fit.vutbr.cz> http://www.fit.vutbr.cz/~cejkar
Brno University of Technology, Faculty of Information Technology
Bozetechova 2, 612 66  Brno, Czech Republic



--
####################################
Iban Cabrillo Bartolome
Instituto de Fisica de Cantabria (IFCA)
Santander, Spain
Tel: +34942200969
####################################
Bertrand Russell:
"El problema con el mundo es que los estúpidos están seguros de todo y los inteligentes están llenos de dudas"
------------------------------------------------------------------------------
Rapidly troubleshoot problems before they affect your business. Most IT 
organizations don't have a clear picture of how application performance 
affects their revenue. With AppDynamics, you get 100% visibility into your 
Java,.NET, & PHP application. Start your 15-day FREE TRIAL of AppDynamics Pro!
http://pubads.g.doubleclick.net/gampad/clk?id=84349351&iu=/4140/ostg.clktrk
_______________________________________________
Bacula-users mailing list
Bacula-users AT lists.sourceforge DOT net
https://lists.sourceforge.net/lists/listinfo/bacula-users
<Prev in Thread] Current Thread [Next in Thread>