Bacula-users

[Bacula-users] Slow Attribute spooling

2015-06-08 05:44:53
Subject: [Bacula-users] Slow Attribute spooling
From: Denis Witt <denis.witt AT concepts-and-training DOT de>
To: bacula-users AT lists.sourceforge DOT net
Date: Mon, 8 Jun 2015 11:39:57 +0200
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Hi List,

recently I turned on "Spool Data" as I was hoping to speed up my
Backups using Concurrent Jobs and be nice to my tapes (shoe shinning).

Not only that I wasn't able, yet, to get multiple FDs writing Spool-Data
at the same time, my Backup take several hours longer than before, as
Attribute Spooling is very slow.

A medium sized full job has about 35 MB of Attribute Data spooled.
Despooling takes more than one hour. Another job: Despooling of
378,030,349 bytes was started at 08:49 am, it was done at 7:30 pm.

My setup:

bacula-dir: Xen DomU, 4 Xeon E3-1220, 8 GB RAM, RAID1 (mdadm)
bacula-sd: Xen Dom0: 4 Xenon E3-1220, 8 GB RAM, RAID1 (mdadm), Spooling
(Same physical machine)

bacula-fd: several Xen DomUs, not running anything other bacula related
tasks

MySQL: Quad Xeon X3430, 8 GB RAM, RAID1 (mdadm), MySQL 5.5, InnoDB
(Dedicated Machine, only used by Bacula)

- -------- Performance Metrics -------------------------------------------------
[--] Up for: 2d 23h 21m 23s (2M q [10.464 qps], 80 conn, TX: 39M, RX: 674M)
[--] Reads / Writes: 0% / 100%
[--] Total buffers: 3.1G global + 2.7M per thread (151 max threads)
[OK] Maximum possible memory usage: 3.5G (51% of installed RAM)
[OK] Slow queries: 0% (96/2M)
[OK] Highest usage of available connections: 1% (3/151)
[OK] Key buffer size / total MyISAM indexes: 16.0M/124.0K
[OK] Key buffer hit rate: 100.0% (12M cached / 0 reads)
[!!] Query cache efficiency: 4.2% (268 cached / 6K selects)
[OK] Query cache prunes per day: 0
[OK] Sorts requiring temporary tables: 0% (0 temp sorts / 47 sorts)
[!!] Temporary tables created on disk: 32% (86 on disk / 264 total)
[OK] Thread cache hit rate: 96% (3 created / 80 connections)
[OK] Table cache hit rate: 79% (79 open / 100 opened)
[OK] Open file limit used: 0% (69/50K)
[OK] Table locks acquired immediately: 100% (2M immediate / 2M locks)
[OK] InnoDB buffer pool / data size: 3.0G/2.8G
[OK] InnoDB log waits: 0

slow-query-log is on, but it's not much in there. Longest Query took 33
Secs, but it was a one time INSERT event affecting 1567016 rows.

Any Ideas?

Regards.
Denis Witt
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2.0.22 (GNU/Linux)

iQIcBAEBAgAGBQJVdWLtAAoJELB26T3daKAJ0HYQAKH/dxW9kMg81+MFdNvDrQB6
481oZ02Tf5agFK+BinyM2lDmQHiu4B7nqfGg9PyWmdpOgvvs7e9y7l+3uEoKCmF6
RML8hmFN6j8ak9wYax3E0LW4nJsOOGl19L+oZz5Kdvrc2jeTUQzF4okFMsX3VpIB
fUGnTgo88sMitI9Jvivwg4zUItx5RtAGK/Fst0yTVR3oXz7bHMSupOrh1oAg7Ayc
Dy16H447qPd71v3TrLJNhTBWwIhO3ZZl2uBqL7XGe30uiJxstQbc5ajnhLAz/MUk
9kOla3Ox8c1BxMkAqKhgC781kzSEMCQBLHMtuSeMnQ/9is6JVTJ37Eo/ZxBcErok
kL3M3e63IJ/F6beJLtgzgXhFQUrAdiIHe7FlxrVI5uFzSKbT7HAg98jyJZgYPFjF
9xYglIbFe0UUCfywf0kGm8MtFi3+s14GxzKcg6tYBTJWNYqEmP8QpPcj2gZFqSRR
ZWTpuO4bbeHGHktxD1G9YOnB+DjxW5r/ilz7knkRE1YRggfDnjb0zm7WpNLCHvdi
mRZV/qaLOckroobMwtGzhfekLykWY+wkVwHQHtl7VkCEeure7F4KmUUBA/Xi/Hrz
QqbR/5rqSJY/7oez8/Q8PA5v/hDh1TQqWBCKQ0HjNJpRFRd4nCZFihyzEmXGo8Dh
5xc58tu9sA/qvSJm7UJV
=lXBn
-----END PGP SIGNATURE-----
------------------------------------------------------------------------------
_______________________________________________
Bacula-users mailing list
Bacula-users AT lists.sourceforge DOT net
https://lists.sourceforge.net/lists/listinfo/bacula-users