MY SITUATION

I can take your Megabytes and shame you with my 9,868,868 mostly Maildir files and 690.8 GB space they take up. Take that! It took 25 hours to transfer and is currently "indexing." Before I ramble on, here is some confguration info:

CONFIGURATION

dir Version: 2.4.2 (26 July 2008), amd64 freebsd7.1, PG version 8.2

The OS is a stripe of mirrors (2x2) running on FreeBSD ZFS filesystem and a spare (in a pear tree). Hey, it is still almost winter.

WHAT?!

Yes, this humongo transfer has been done TWICE before and the indexing just runs for days till I get sick of it and kill PG. 

WHAT HAVE YOU DONE?!

I have tweaked FreeBSD to run on all 4 CPU cores and tweaked PG (postgresql.conf) thus:

# - Memory -

shared_buffers = 10MB # min 128kB or max_connections*16kB
temp_buffers = 10MB # min 800kB
work_mem = 10MB # min 64kB
maintenance_work_mem = 40MB # min 1MB
max_stack_depth = 525kB # min 100kB

# - Free Space Map -
max_fsm_pages = 30000 # min max_fsm_relations*16, 6 bytes each
max_fsm_relations = 1000 # min 100, ~70 bytes each

WHAT DID THIS GET YOU?

Well, the transfers for one finished 22% faster (25 instead of 32 hours). And "top" does not show a high number for IVCSW - involuntary context switching. This means it is using more cores and maybe more memory. I was hoping it would also speed up indexing but I am now 20 hours into indexing after the transfer completed.

CAN SOMEONE HELP ME?

I suspect the PG tweaks are not right and I am dealing with a large number of files are my main problems. It could also have something to do with the two previous indexing which I stopped.

Yudhvir

------------------------------------------------------------------------------

_______________________________________________
Bacula-users mailing list
Bacula-users AT lists.sourceforge DOT net
https://lists.sourceforge.net/lists/listinfo/bacula-users