Bacula-users

Re: [Bacula-users] very long "Dir inserting Attributes"

2014-10-20 12:13:44
Subject: Re: [Bacula-users] very long "Dir inserting Attributes"
From: Eric Bollengier <eric.bollengier AT baculasystems DOT com>
To: bacula-users AT lists.sourceforge DOT net
Date: Mon, 20 Oct 2014 18:06:33 +0200
Hello,

Le 20. 10. 14 11:14, Anton Gorlov a écrit :
> The problem is observed recently time.
>
> After database backup "Dir inserting Attributes" job runs more than 5 hours.
> Previously, it takes less time. Size of database changed slightly, current 
> size
> - 85Gb.
> the loads of io system: iotop read 5 M/s, write several Kb
> LA 1.4-2.2
> atop retruns postgres process with bacula INSERT ... argument
>
> hdparm -tT /dev/mapper/main-pgsql
>
> /dev/mapper/main-pgsql:
>    Timing cached reads:   14626 MB in  2.00 seconds = 7321.24 MB/sec
>    Timing buffered disk reads: 918 MB in  3.03 seconds = 302.72 MB/sec
>
>
>
> Request list contains:
> BEGIN; LOCK TABLE Path IN SHARE ROW EXCLUSIVE MODE
>
>
> ===
> Running Jobs:
> Console connected at 20-Ок-2014 11:52
>    JobId Level   Name                       Status
> ======================================================================
>     8116 Full    fluorine.2014-10-19_00.25.00_40 Dir inserting Attributes
>     8117 Full    hydrogen.2014-10-19_00.25.00_41 Dir inserting Attributes
>     8118 Full    neon.2014-10-19_00.32.01_42 Dir inserting Attributes
> > ====
>
>
> postgresql.conf:
> max_connections = 100
> shared_buffers = 128MB
> temp_buffers = 512MB
> work_mem = 64MB
> maintenance_work_mem = 32MB
> fsync = off
> checkpoint_segments = 90
>

You might want to take some advise on how to tune your database
and the hardware (raid controler with writeback for example) that is
related. Your shared_buffer and your wall_buffers are probably too
small, and running with fsync=off is just not something you can use in
production.

Please, also have a look to your database and see if your server is
properly sized, a good indicator is that the Filename table should
more or less fit in memory to have good performances with large jobs.

Using a recent version of Bacula (probably 5.2) should also help a bit
using the batch session limit feature.

Best Regards,

Eric

------------------------------------------------------------------------------
Comprehensive Server Monitoring with Site24x7.
Monitor 10 servers for $9/Month.
Get alerted through email, SMS, voice calls or mobile push notifications.
Take corrective actions from your mobile device.
http://p.sf.net/sfu/Zoho
_______________________________________________
Bacula-users mailing list
Bacula-users AT lists.sourceforge DOT net
https://lists.sourceforge.net/lists/listinfo/bacula-users