Bacula-users

Re: [Bacula-users] Bacula limits

2008-08-29 09:43:41
Subject: Re: [Bacula-users] Bacula limits
From: Dan Langille <dan AT langille DOT org>
To: ebollengier <eric AT eb.homelinux DOT org>
Date: Fri, 29 Aug 2008 09:43:28 -0400
ebollengier wrote:
> T. Horsnell wrote:
>> I will be backing up maybe 70million files in one job.
>> Am I approaching any Bacula/catalog limit on the number of files?
>> What is the maximum number of files which Bacula can handle,
>> and are there any other limits which we should know about?

 > Hello,
 >
 > By default, the database is configured to handle 4 billion entries in
 > the file table, and
 > with 70million files per job, this limit will come quite fast.

Do you have a reference for this 4 billion limit?

I suspect you are referring to the data types used for the file.fileid 
column.  In PostgreSQL, this is an integer value.

4 bytes
-2147483648 to +2147483647

With 8 bytes we can get (commas added by me)
-9223372036854775808 to 9,223,372,036,854,775,807

See 
http://www.postgresql.org/docs/8.3/interactive/datatype-numeric.html#DATATYPE-INT

In MySQL, the limits are the same.

 >
 > I suggest you to apply the trunk/patches/testing/fileid64.patch patch
 > to your installation, and to upgrade the FileId field of your catalog
 > (see update_mysql_catalog shell).

Looking at that patch, I think other tables need to change as well:

   basefiles.fileid

And I keep thinking something else should change too.  This would be 
easier with foreign keys defined.  ;)

 > Your configuration seems to be very interresting, can you fill a
 > testimonialat http://www.bacula.org/en/?page=testimonial ? (it can be
 > anonymous)

Yes, I would encourage that too.

-- 
Dan Langille

BSDCan - The Technical BSD Conference : http://www.bsdcan.org/
PGCon  - The PostgreSQL Conference:     http://www.pgcon.org/

-------------------------------------------------------------------------
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/
_______________________________________________
Bacula-users mailing list
Bacula-users AT lists.sourceforge DOT net
https://lists.sourceforge.net/lists/listinfo/bacula-users

<Prev in Thread] Current Thread [Next in Thread>