Bacula-users

Re: [Bacula-users] Bacula + Postgres : copy batch problem

2010-08-04 06:34:53
Subject: Re: [Bacula-users] Bacula + Postgres : copy batch problem
From: Rory Campbell-Lange <rory AT campbell-lange DOT net>
To: Marc Cousin <cousinmarc AT gmail DOT com>
Date: Wed, 4 Aug 2010 11:32:27 +0100
On 04/08/10, Marc Cousin (cousinmarc AT gmail DOT com) wrote:

> > Changes to one part of Bacula has to be compatible with all other parts 
> > of Bacula.  For example, given that we support SQLite, PostgreSQL, and 
> > MySQL, we have to keep each in mind.  Yes, it's a compromise.

> Moreover, yes, PostgreSQL is a robust DB. Capable of doing very high end 
> transactionnal work. But that's not what bacula requires. Bacula requires 
> very high throughput (some of us have to insert 50 millions rows a day)

Touche -- I've been thinking too much of my single server backing itself
up.

> > The running out of space is a PostgreSQL issue.

> I wouldn't say that. I would say that configuring a 10GB /var for the
> database filesystem when doing 7TB backups is the issue. Give it more
> space and stop wasting time.
> 
...
> I totally agree with Dan : try the insert mode. And don't forget to
> post your results back.

OK.

> > > This is a cludge (with an inefficient correlated subquery!) that could
> > > easily miss paths which exist from previous, unrelated backups. A
> > > continuous insert process against a job and mediaid simply wouldn't need
> > > to do this.
> > 
> > If you want to patch it, we'll certainly look at it.

> Yes, so what ? Do you propose doing a transaction for every file
> backed up ? It is used as a data dump, because that is what the
> catalog is (for the tape part). And we have to be fast when inserting
> there, there are some configurations with hundreds of client
> spooling??? not juste one backup.

Fair enough.

Thanks for your comments.

Regards
Rory

-- 
Rory Campbell-Lange
rory AT campbell-lange DOT net

------------------------------------------------------------------------------
The Palm PDK Hot Apps Program offers developers who use the
Plug-In Development Kit to bring their C/C++ apps to Palm for a share
of $1 Million in cash or HP Products. Visit us here for more details:
http://p.sf.net/sfu/dev2dev-palm
_______________________________________________
Bacula-users mailing list
Bacula-users AT lists.sourceforge DOT net
https://lists.sourceforge.net/lists/listinfo/bacula-users