Re: [Bacula-users] Bacula + Postgres : copy batch problem
2010-08-04 06:34:53
On 04/08/10, Marc Cousin (cousinmarc AT gmail DOT com) wrote:
> > Changes to one part of Bacula has to be compatible with all other parts
> > of Bacula. For example, given that we support SQLite, PostgreSQL, and
> > MySQL, we have to keep each in mind. Yes, it's a compromise.
> Moreover, yes, PostgreSQL is a robust DB. Capable of doing very high end
> transactionnal work. But that's not what bacula requires. Bacula requires
> very high throughput (some of us have to insert 50 millions rows a day)
Touche -- I've been thinking too much of my single server backing itself
up.
> > The running out of space is a PostgreSQL issue.
> I wouldn't say that. I would say that configuring a 10GB /var for the
> database filesystem when doing 7TB backups is the issue. Give it more
> space and stop wasting time.
>
...
> I totally agree with Dan : try the insert mode. And don't forget to
> post your results back.
OK.
> > > This is a cludge (with an inefficient correlated subquery!) that could
> > > easily miss paths which exist from previous, unrelated backups. A
> > > continuous insert process against a job and mediaid simply wouldn't need
> > > to do this.
> >
> > If you want to patch it, we'll certainly look at it.
> Yes, so what ? Do you propose doing a transaction for every file
> backed up ? It is used as a data dump, because that is what the
> catalog is (for the tape part). And we have to be fast when inserting
> there, there are some configurations with hundreds of client
> spooling??? not juste one backup.
Fair enough.
Thanks for your comments.
Regards
Rory
--
Rory Campbell-Lange
rory AT campbell-lange DOT net
------------------------------------------------------------------------------
The Palm PDK Hot Apps Program offers developers who use the
Plug-In Development Kit to bring their C/C++ apps to Palm for a share
of $1 Million in cash or HP Products. Visit us here for more details:
http://p.sf.net/sfu/dev2dev-palm
_______________________________________________
Bacula-users mailing list
Bacula-users AT lists.sourceforge DOT net
https://lists.sourceforge.net/lists/listinfo/bacula-users
|
|
|