Hello list,
I was having a lousy 600 kb/s transfer rate on my jobs, even when
working with local filesystems, so I did some tunning to the SD :
Maximum Network Buffer Size = 65536
Maximum block size = 2M
The DIR :
Spool Attributes = yes
And changed all the MyISAM tables on the database backend to InnoDB.
Right now I'm hitting 20 mb/s which is fine with me, problem is I
canceled one job that was spending more than 1 hour to insert 36 mb of
attributes when the 8.15 gb backup finished in 15 minutes.
A SHOW FULL PROCESSLIST on the database shows queries like this :
Info: INSERT INTO batch VALUES
(17870,17647,'/home/db/backup/20120125.0409.mysql5/cms_manual_preproduccion/','nota_caracteristica.txt.gz','gD
IOo00 IG2 B p Br A EgJ BAA o BPH6wO BPH6wO BPH6wY A A
C','WGgrfMDAh9qpXPwJ2YUC+WWf3u8',0)
Info: INSERT INTO batch VALUES
(17891,17647,'/home/db/backup/20120125.0409.mysql5/cms_manual_preproduccion/','contenido.sql.gz','gD
IOowv IGk B A A A KA BAA I BPH6wD BPH6wD BPH6wa A A
C','Vg1w9AAkpMThsAmLznZFv54FCqA',0)
Info: INSERT INTO batch VALUES
(17905,17647,'/home/db/backup/20120125.0409.mysql5/cms_manual_preproduccion/','guia.txt.gz','gD
IOo1f IG2 B p Br A DaX BAA g BPH6wN BPH6wN BPH6wa A A
C','bLu9JVO3XZHEg8FZiVs2oN+JC7I',0)
Info: INSERT INTO batch VALUES
(17930,17647,'/home/db/backup/20120125.0409.mysql5/cms_manual_preproduccion/','dato_nosis_adrmex_extra.txt.gz','gD
IOo3r IG2 B p Br A J0 BAA I BPH6wJ BPH6wJ BPH6wa A A
C','x5JvXVtPOQwdc9l060v0iDZkG9Y',0)
Info: INSERT INTO batch VALUES
(17951,17647,'/home/db/backup/20120125.0409.mysql5/cms_manual_preproduccion/','formularioDato.sql.gz','gD
IOoxb IGk B A A A LC BAA I BPH6wN BPH6wN BPH6wZ A A
C','SRhMfRnqp6WKpLUkYNmKZMwyvDg',0)
When I was expecting :
INSERT INTO batch VALUES
(17870,17647,'/home/db/backup/20120125.0409.mysql5/cms_manual_preproduccion/','nota_caracteristica.txt.gz','gD
IOo00 IG2 B p Br A EgJ BAA o BPH6wO BPH6wO BPH6wY A A
C','WGgrfMDAh9qpXPwJ2YUC+WWf3u8',0),
(17891,17647,'/home/db/backup/20120125.0409.mysql5/cms_manual_preproduccion/','contenido.sql.gz','gD
IOowv IGk B A A A KA BAA I BPH6wD BPH6wD BPH6wa A A
C','Vg1w9AAkpMThsAmLznZFv54FCqA',0),
(17905,17647,'/home/db/backup/20120125.0409.mysql5/cms_manual_preproduccion/','guia.txt.gz','gD
IOo1f IG2 B p Br A DaX BAA g BPH6wN BPH6wN BPH6wa A A
C','bLu9JVO3XZHEg8FZiVs2oN+JC7I',0),
(17930,17647,'/home/db/backup/20120125.0409.mysql5/cms_manual_preproduccion/','dato_nosis_adrmex_extra.txt.gz','gD
IOo3r IG2 B p Br A J0 BAA I BPH6wJ BPH6wJ BPH6wa A A
C','x5JvXVtPOQwdc9l060v0iDZkG9Y',0),
(17951,17647,'/home/db/backup/20120125.0409.mysql5/cms_manual_preproduccion/','formularioDato.sql.gz','gD
IOoxb IGk B A A A LC BAA I BPH6wN BPH6wN BPH6wZ A A
C','SRhMfRnqp6WKpLUkYNmKZMwyvDg',0)
According to the rpmbuild output, batch insertion is enabled :
Large file support: yes
Bacula conio support: no -lreadline -lncurses
readline support: yes
TCP Wrappers support: no
TLS support: yes
Encryption support: yes
ZLIB support: yes
LZO support: no
enable-smartalloc: yes
enable-lockmgr: no
bat support: no
enable-gnome: no
enable-bwx-console: no
enable-tray-monitor: no
client-only: no
build-dird: yes
build-stored: yes
Plugin support: yes
ACL support: yes
XATTR support: yes
Python support: no
systemd support: no
Batch insert enabled: MySQL
Did I miss what "Spool Attributes" and "Batch insert enabled" should do
or there's something else to configure?
Thanks.-
------------------------------------------------------------------------------
Keep Your Developer Skills Current with LearnDevNow!
The most comprehensive online learning library for Microsoft developers
is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3,
Metro Style Apps, more. Free future releases when you subscribe now!
http://p.sf.net/sfu/learndevnow-d2d
_______________________________________________
Bacula-users mailing list
Bacula-users AT lists.sourceforge DOT net
https://lists.sourceforge.net/lists/listinfo/bacula-users
|
