Bacula-users

Re: [Bacula-users] bacula prunes files too early

2009-02-05 14:30:17
Subject: Re: [Bacula-users] bacula prunes files too early
From: Martin Simmons <martin AT lispworks DOT com>
To: Bacula-users AT lists.sourceforge DOT net
Date: Thu, 5 Feb 2009 19:26:29 GMT
>>>>> On Thu, 5 Feb 2009 14:39:05 +0300, Vladimir Vassiliev said:
> 
> On Четверг 05 февраля 2009, you wrote:
> > >>>>> On Thu, 5 Feb 2009 12:21:31 +0300, Vladimir Vassiliev said:
> > > 
> > > I did a couple of tests with empty files: in job with 1,001,002 files it's
> > > possible to select them but with 1,202,203 - is not.
> > 
> > Possibly the transaction and/or temporary tables used to insert the records 
> > is
> > too large?  I suggest checking your database logs.
> 
> Thanks for suggestion.
> I use Postgresql and have 
> 
> 2009-02-05 14:29:57 MSK 18899  LOG:  checkpoints are occurring too frequently 
> (3 seconds apart)
> 2009-02-05 14:29:57 MSK 18899  HINT:  Consider increasing the configuration 
> parameter "checkpoint_segments".
> 
> in log. 
> I'm not very experienced in Postgresql. Could this be the cause of the issue?

This is a hint about performance problems, but I think they are just warnings
so shouldn't cause it to fail.

Is the Director configured to use batch insert?  You could try with
--enable-batch-insert or --disable-batch-insert to see if that affects it.

__Martin

>  
> > __Martin
> > 
> > > 
> > > > Hello,
> > > > 
> > > > In fact I don't have the solution for your problem as I am looking for
> > > > it too ;)
> > > > As far as I can see, your job has a lot of files (> 1 million). I have
> > > > the same problem for a job with 1.3 million files. It seems that bacula
> > > > doesn't write the file entries in the catalog (in the "files" table) for
> > > > big jobs like that.
> > > > The result is that you can't select individual files when restoring, you
> > > > can just restore the whole job. Incremental job for this fileset is
> > > > working ok and the files are present in catalog. That's why I think this
> > > > is related with jobs with a lot of files.
> > > > 
> > > > I'm using Bacula 2.4.4 on Debian Etch (from backport.org) with
> > > > PostgreSQL as backend for the catalog.
> > > > 
> > > > If someone has information on this problem...
> > > > 
> > > > Regards,
> > > 
> > > 
> > > 
> > > -- 
> > > Vladimir Vassiliev <vova AT edu.yar DOT ru>
> > 
> 
> 
> 
> -- 
> Vladimir Vassiliev <vova AT edu.yar DOT ru>
> 

------------------------------------------------------------------------------
Create and Deploy Rich Internet Apps outside the browser with Adobe(R)AIR(TM)
software. With Adobe AIR, Ajax developers can use existing skills and code to
build responsive, highly engaging applications that combine the power of local
resources and data with the reach of the web. Download the Adobe AIR SDK and
Ajax docs to start building applications today-http://p.sf.net/sfu/adobe-com
_______________________________________________
Bacula-users mailing list
Bacula-users AT lists.sourceforge DOT net
https://lists.sourceforge.net/lists/listinfo/bacula-users