When you do massive inserts into a database, it is often a good idea to 
drop the indexes on that database, do the insert, and then recreate the 
indexes.

mehma sarja wrote:
>
> MY SITUATION
>
> I can take your Megabytes and shame you with my 9,868,868 mostly 
> Maildir files and 690.8 GB space they take up. Take that! It took 25 
> hours to transfer and is currently "indexing." Before I ramble on, 
> here is some confguration info:
>
> CONFIGURATION
>
> dir Version: 2.4.2 (26 July 2008), amd64 freebsd7.1, PG version 8.2
>
> The OS is a stripe of mirrors (2x2) running on FreeBSD ZFS filesystem 
> and a spare (in a pear tree). Hey, it is still almost winter.
>
> WHAT?!
>
> Yes, this humongo transfer has been done TWICE before and the indexing 
> just runs for days till I get sick of it and kill PG. 
>
> WHAT HAVE YOU DONE?!
>
> I have tweaked FreeBSD to run on all 4 CPU cores and tweaked PG 
> (postgresql.conf) thus:
>
> # - Memory -
>
> shared_buffers = 10MB # min 128kB or max_connections*16kB
> temp_buffers = 10MB # min 800kB
> work_mem = 10MB # min 64kB
> maintenance_work_mem = 40MB # min 1MB
> max_stack_depth = 525kB # min 100kB
>
> # - Free Space Map -
> max_fsm_pages = 30000 # min max_fsm_relations*16, 6 bytes each
> max_fsm_relations = 1000 # min 100, ~70 bytes each
>
> WHAT DID THIS GET YOU?
>
> Well, the transfers for one finished 22% faster (25 instead of 32 
> hours). And "top" does not show a high number for IVCSW - involuntary 
> context switching. This means it is using more cores and maybe more 
> memory. I was hoping it would also speed up indexing but I am now 20 
> hours into indexing after the transfer completed.
>
> CAN SOMEONE HELP ME?
>
> I suspect the PG tweaks are not right and I am dealing with a large 
> number of files are my main problems. It could also have something to 
> do with the two previous indexing which I stopped.
>
> Yudhvir
>

-- 
Kevin Keane
Owner
The NetTech
Find the Uncommon: Expert Solutions for a Network You Never Have to Think About

Office: 866-642-7116
http://www.4nettech.com

This e-mail and attachments, if any, may contain confidential and/or 
proprietary information. Please be advised that the unauthorized use or 
disclosure of the information is strictly prohibited. The information herein is 
intended only for use by the intended recipient(s) named above. If you have 
received this transmission in error, please notify the sender immediately and 
permanently delete the e-mail and any copies, printouts or attachments thereof.


------------------------------------------------------------------------------
_______________________________________________
Bacula-users mailing list
Bacula-users AT lists.sourceforge DOT net
https://lists.sourceforge.net/lists/listinfo/bacula-users