Bacula-users

Re: [Bacula-users] very slow virtualfull job

2013-04-29 07:37:06
Subject: Re: [Bacula-users] very slow virtualfull job
From: Adrian Reyer <bacula-lists AT lihas DOT de>
To: James Harper <james.harper AT bendigoit.com DOT au>
Date: Mon, 29 Apr 2013 13:34:09 +0200
On Mon, Apr 29, 2013 at 08:33:42AM +0000, James Harper wrote:
> When loading the data into postgresql absolutely crawled along (~50kb/second 
> disk write speed with 100% iowait) I knew I had a problem.
> Something, somewhere has changed in my system that absolutely kills tiny sync 
> writes. Or alternatively, something has changed in my system that makes mysql 
> do tiny sync writes.

What do you expect from sync writes regarding bacula?
I don't use sync writes there as I am very sure they won't give me a
benefit. As soon as the DB-server dies, the job is failed, you can't add
the remaining attributes in a reasonable way later and sd/dir both
refuse to work without a database server.
I suggest turning sync writes off.
This is valid for bacula, not for some random other database
application.

> I'm working on trying to track down wtf is going on there, but in the 
> meantime I have set innodb_flush_log_at_trx_commit=0 which means it won't run 
> an fsync after each tiny little write but will instead wait for around a 
> second then flush everything. This means I stand to lose 1 second of database 
> commit in the event of a crash, but I also probably lose the whole backup job 
> anyway so I don't see it as a loss.

Exactly.

Regards,
        Adrian
-- 
LiHAS - Adrian Reyer - Hessenwiesenstraße 10 - D-70565 Stuttgart
Fon: +49 (7 11) 78 28 50 90 - Fax:  +49 (7 11) 78 28 50 91
Mail: lihas AT lihas DOT de - Web: http://lihas.de
Linux, Netzwerke, Consulting & Support - USt-ID: DE 227 816 626 Stuttgart

------------------------------------------------------------------------------
Try New Relic Now & We'll Send You this Cool Shirt
New Relic is the only SaaS-based application performance monitoring service 
that delivers powerful full stack analytics. Optimize and monitor your
browser, app, & servers with just a few lines of code. Try New Relic
and get this awesome Nerd Life shirt! http://p.sf.net/sfu/newrelic_d2d_apr
_______________________________________________
Bacula-users mailing list
Bacula-users AT lists.sourceforge DOT net
https://lists.sourceforge.net/lists/listinfo/bacula-users