Hello Uwe,
I believe this is clearly documented, but when you turn on accurate, the
FD receives a full list of all the files that are currently backed up --
this requires a *lot* of memory. 10-20 million files is already a lot,
but 60 million will probably run out of memory unless you have hundreds
of GB of memory.
Best regards,
Kern
On 05/24/2016 08:26 PM, Uwe Schuerkamp wrote:
> Hi folks,
>
> I'm trying to run an "accurate" incr backup on a server with about 60 million
> files (4TB total). After 50 minutes or so, the fd (7.0.4 compiled from
> source) on the client dies with an OOM error:
>
> May 24 19:45:11 deniXXXX kernel: [ 6016] 0 6016 2821721
> 2755296 5430 1620 0 bacula-fd
> May 24 19:45:11 deniolXXXX kernel: Out of memory: Kill process 6016
> (bacula-fd) score 583 or sacrifice child
> May 24 19:45:11 deniXXXX kernel: Killed process 6016 (bacula-fd)
> total-vm:11286884kB, anon-rss:11021184kB, file-rss:0kB
>
> I've now removed the "accurate" flag from the job and am currently
> trying to run another incr. backup, so I was wondering if this is a
> bug in bacula-fd or the expected behaviour on a such a large file
> system?
>
> Both director and client run 7.0.4 on CentOS7 64bit compiled from
> source.
>
> All the best & TIA,
>
> Uwe
>
------------------------------------------------------------------------------
Mobile security can be enabling, not merely restricting. Employees who
bring their own devices (BYOD) to work are irked by the imposition of MDM
restrictions. Mobile Device Manager Plus allows you to control only the
apps on BYO-devices by containerizing them, leaving personal data untouched!
https://ad.doubleclick.net/ddm/clk/304595813;131938128;j
_______________________________________________
Bacula-users mailing list
Bacula-users AT lists.sourceforge DOT net
https://lists.sourceforge.net/lists/listinfo/bacula-users
|