Bacula-users

Re: [Bacula-users] 2.2.8 inserting attributes taking a long time

2008-08-29 06:48:09
Subject: Re: [Bacula-users] 2.2.8 inserting attributes taking a long time
From: ebollengier <eric AT eb.homelinux DOT org>
To: bacula-users AT lists.sourceforge DOT net
Date: Fri, 29 Aug 2008 03:48:00 -0700 (PDT)
Hello,

Default parameters work with quite small/medium database. You have to modify
them according with your dba.

For 11M files, you will have something like 1G of data to insert in your
database in one transaction, i suggest you to increase some default values.

You can start with a shared_buffers at 2GB, the work_mem to 64MB or 92MB,
your checkpoint configuration have to be change, i suppose that your
database is doing checkpoint every 10s instead of 15min

Bye


Michael Galloway wrote:
> 
> On Fri, Aug 29, 2008 at 04:48:57PM +0000, Jose Ildefonso Camargo Tolosa
> wrote:
>> Hi!
>> 
>> That is a DB issue, did you correctly tuned pgsql's parameters? I
>> mean, you got plenety of ram, you must tell postgres to use it! (and
>> to use cache).
>>
> 
> :-\ its pretty much default paramters. 
> 
> shared_buffers = 32MB                 # min 128kB or max_connections*16kB
> max_fsm_pages = 204800                # min max_fsm_relations*16, 6 bytes each
> 
> 
> any suggestions? if i wait long enough i assume it will finish, pending
> queue 
> is getting long:
> 
>   1415 Increme  rockhopper.2008-08-24_21.05.46 is waiting on max Storage
> jobs
>   1416 Increme  mus.2008-08-24_21.05.47 is waiting on max Storage jobs
>   1417 Full    BackupCatalog.2008-08-24_23.10.48 is waiting execution
>   1419 Increme  molbio.2008-08-25_20.05.51 is waiting execution
>   1420 Increme  moldyn.2008-08-25_21.05.52 is waiting execution
>   1421 Increme  rockhopper.2008-08-25_21.05.53 is waiting execution
>   1422 Increme  mus.2008-08-25_21.05.54 is waiting execution
>   1423 Full    BackupCatalog.2008-08-25_23.10.55 is waiting execution
>   1424 Increme  birch.2008-08-25_23.25.56 is waiting execution
>   1425 Increme  bioinfo.2008-08-26_01.05.57 is waiting execution
>   1426 Increme  molbio.2008-08-26_20.05.58 is waiting execution
>   1427 Increme  moldyn.2008-08-26_21.05.59 is waiting execution
>   1428 Increme  rockhopper.2008-08-26_21.05.00 is waiting execution
>   1429 Increme  mus.2008-08-26_21.05.01 is waiting execution
>   1430 Full    BackupCatalog.2008-08-26_23.10.02 is waiting execution
>   1431 Increme  bioinfo.2008-08-27_01.05.03 is waiting execution
>   1432 Increme  molbio.2008-08-27_20.05.05 is waiting execution
>   1433 Increme  mspec.2008-08-27_20.06.06 is waiting execution
>   1434 Increme  moldyn.2008-08-27_21.05.07 is waiting execution
>   1435 Increme  rockhopper.2008-08-27_21.06.08 is waiting execution
>   1436 Increme  mus.2008-08-27_21.06.09 is waiting execution
>   1437 Full    BackupCatalog.2008-08-27_23.10.10 is waiting execution
>   1438 Increme  bioinfo.2008-08-28_01.05.11 is waiting execution
> 
> thanks for any help!
> 
> -- michael
> 
> 

-- 
View this message in context: 
http://www.nabble.com/2.2.8-inserting-attributes-taking-a-long-time-tp19209259p19217632.html
Sent from the Bacula - Users mailing list archive at Nabble.com.


-------------------------------------------------------------------------
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/
_______________________________________________
Bacula-users mailing list
Bacula-users AT lists.sourceforge DOT net
https://lists.sourceforge.net/lists/listinfo/bacula-users