Some additional thoughts on the patch:

Dan Langille wrote:
> ebollengier wrote:
>> T. Horsnell wrote:
>>> I will be backing up maybe 70million files in one job.
>>> Am I approaching any Bacula/catalog limit on the number of files?
>>> What is the maximum number of files which Bacula can handle,
>>> and are there any other limits which we should know about?
> 
>  > Hello,
>  >
>  > By default, the database is configured to handle 4 billion entries in
>  > the file table, and
>  > with 70million files per job, this limit will come quite fast.
> 
> Do you have a reference for this 4 billion limit?
> 
> I suspect you are referring to the data types used for the file.fileid 
> column.  In PostgreSQL, this is an integer value.
> 
> 4 bytes
> -2147483648 to +2147483647

I think it's more like 2 billion files.

> 
> With 8 bytes we can get (commas added by me)
> -9223372036854775808 to 9,223,372,036,854,775,807
> 
> See 
> http://www.postgresql.org/docs/8.3/interactive/datatype-numeric.html#DATATYPE-INT
> 
> In MySQL, the limits are the same.
> 
>  >
>  > I suggest you to apply the trunk/patches/testing/fileid64.patch patch
>  > to your installation, and to upgrade the FileId field of your catalog
>  > (see update_mysql_catalog shell).
> 
> Looking at that patch, I think other tables need to change as well:
> 
>    basefiles.fileid

This assumes we have more than 2 billion unique file names (including path).

It may be harder to reach 2 billion unique file names (without path). 
If we want do cater for that, we also have to change"

filename.filenameid
path.filenameid
unsavedfiles.filenameid

And possibly some data types within Bacula.


Re: http://www.bacula.org/en/developers/Catalog_Services.html

-- 
Dan Langille

BSDCan - The Technical BSD Conference : http://www.bsdcan.org/
PGCon  - The PostgreSQL Conference:     http://www.pgcon.org/

-------------------------------------------------------------------------
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/
_______________________________________________
Bacula-users mailing list
Bacula-users AT lists.sourceforge DOT net
https://lists.sourceforge.net/lists/listinfo/bacula-users