Dan Langille wrote:
> Pascal Clermont wrote:
>> Dan Langille wrote:
>>> Pascal Clermont wrote:
>>>> Hi,
>>>> I was reading the archives and stumbled upon "[Bacula-users]
>>>> Improving Backup speed" thread which caught my eye since I am having
>>>> issues.
>>>> we backup over 6TB of small files during a full usually started on
>>>> Friday night these are far from being finished on Mondays. the
>>>> transfer on the wire is usually finished within 24 hours.
>>>> My bottleneck being "Dir inserting Attributes" in my database. I only
>>>> have 2.5 Gb of ram on that machine and intend to upgrade by the end
>>>> of the month. (so far we intend to upgrade to 8gb of ram)
>>>>
>>>> Something in the thread caught my eye :
>>>>
>>>> "
>>>> On Thu, 15 Jan 2009 13:31:54 +0100, Bruno Friedmann <bruno AT ioda-net DOT 
>>>> ch>
>>>> wrote:
>>>> I added the following indexes:
>>>>
>>>> CREATE INDEX File_JobId_idx ON File(JobId);
>>>> CREATE INDEX File_PathId_idx ON File(PathId);
>>>> CREATE INDEX File_FilenameId_idx ON File(FilenameId);
>>>> CREATE INDEX Path_PathId_idx ON Path(PathId);
>>>> CREATE INDEX Job_FileSetId_idx ON Job(FileSetId);
>>>> CREATE INDEX Job_ClientId_idx ON Job(ClientId);
>>>> CREATE INDEX File_FilenameId-PathId_idx ON File(FilenameId,PathId);
>>>> ....
>>>> ....
>>>> It remains to be seen whether the added indexing will impact
>>>> insert/update
>>>> performance, but I'll take a small performance hit if it means faster
>>>> restores and sanity checks. "
>>>>
>>>> As I am no database expert, Would I benefit from creating these
>>>> indexes in order to speed up attributes inserting?
>>>> My database is already at 137G in size with only about 3 months of
>>>> jobs. I've ran the dbcheck a few times ( which takes ~48 hours to
>>>> complete ) but do not feel an improvement once that is done.
>>>>
>>>>
>>>> Any tips/comments concerning improving database insertion would be
>>>> greatly appreciated.
>>> I don't see any mention of MySQL or PostgreSQL.  Which are you using?
>> I am using postgresql 8
> 
> 8.1?  8.3?  There are significant differences in performance there IIRC.
> 
> The following query will tell: "select version()"
> 
PostgreSQL 8.3.6 on i686-redhat-linux-gnu, compiled by GCC gcc (GCC) 4.1.2 
20071124 (Red Hat 4.1.2-42)
This was an RPM install, these are the only default settings changed in 
postgresql.conf :
shared_buffers = 140MB
work_mem = 132MB
maintenance_work_mem = 240MB
max_fsm_pages = 204800

This is with Bacula Version: 2.4.3 (10 October 2008)

Pascal S. Clermont

------------------------------------------------------------------------------
This SF.net email is sponsored by:
High Quality Requirements in a Collaborative Environment.
Download a free trial of Rational Requirements Composer Now!
http://p.sf.net/sfu/www-ibm-com
_______________________________________________
Bacula-users mailing list
Bacula-users AT lists.sourceforge DOT net
https://lists.sourceforge.net/lists/listinfo/bacula-users