Dan Langille wrote:
> T. Horsnell wrote:
>> Jesper Krogh wrote:
>>> T. Horsnell wrote:
>>>> Jesper Krogh wrote:
>>>>> T. Horsnell wrote:
>>>>>
>>>>>> I will be backing up maybe 70million files in one job.
>>>>>> Am I approaching any Bacula/catalog limit on the number of files?
>>>>>> What is the maximum number of files which Bacula can handle,
>>>>>> and are there any other limits which we should know about?
>>>>> You might be heading for problems during restore. The restore process
>>>>> of building a virtual filesystem hierachy of the files cannot handle
>>>>> this many. I've got around 24 million files in one fileset. That 
>>>>> is not
>>>>> restorable using this method. It works fine if I just restore by 
>>>>> "jobid" or some of the restore methods that doesnt require the 
>>>>> virtual filesystem hierachy to be build up and worked on.
>>>>>
>>>>> Jesper
>>>> Ah. Thanks for this tip. I've already got around 39 million files 
>>>> backed up, so I'll see if I hit this problem - I'm running bacula 
>>>> 2.4.2.
>>> You can easily test it. Just start a restore. If you get to the point
>>> where it starts reading from the tapes, then you should be Ok, and you
>>> can just cancel the restore.
>>>
>> I just got to the restoration point OK with 39million files, so I 
>> guess if this was
>> a bug, then its been fixed. I'll try this periodically as the file 
>> count increases.
>
> How long did it take to do that?
>
to build the dir tree       :   7 mins
mark *                          :   1 min
complete the 'done' step:  13 mins

bacula-dir consumed 4Gbytes of my 8Gbyte box while it did this.
7Gbyte  mySQL catalog

Cheers,
Terry

-------------------------------------------------------------------------
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/
_______________________________________________
Bacula-users mailing list
Bacula-users AT lists.sourceforge DOT net
https://lists.sourceforge.net/lists/listinfo/bacula-users