Bacula-users

Re: [Bacula-users] incr job dies with OOM error

2016-05-24 15:31:18
Subject: Re: [Bacula-users] incr job dies with OOM error
From: Kern Sibbald <kern AT sibbald DOT com>
To: Uwe Schuerkamp <uwe.schuerkamp AT nionex DOT net>, Bacula Users Mailing List <bacula-users AT lists.sourceforge DOT net>
Date: Tue, 24 May 2016 21:30:23 +0200
Hello Uwe,

I believe this is clearly documented, but when you turn on accurate, the 
FD receives a full list of all the files that are currently backed up -- 
this requires a *lot* of memory.  10-20 million files is already a lot, 
but 60 million will probably run out of memory unless you have hundreds 
of GB of memory.

Best regards,
Kern

On 05/24/2016 08:26 PM, Uwe Schuerkamp wrote:
> Hi folks,
>
> I'm trying to run an "accurate" incr backup on a server with about 60 million
> files (4TB total). After 50 minutes or so, the fd (7.0.4 compiled from
> source) on the client dies with an OOM error:
>
>   May 24 19:45:11 deniXXXX kernel: [ 6016]     0  6016  2821721
>   2755296    5430     1620             0 bacula-fd
>   May 24 19:45:11 deniolXXXX kernel: Out of memory: Kill process 6016
>   (bacula-fd) score 583 or sacrifice child
>   May 24 19:45:11 deniXXXX kernel: Killed process 6016 (bacula-fd)
>   total-vm:11286884kB, anon-rss:11021184kB, file-rss:0kB
>
> I've now removed the "accurate" flag from the job and am currently
> trying to run another incr. backup, so I was wondering if this is a
> bug in bacula-fd or the expected behaviour on a such a large file
> system?
>
> Both director and client run 7.0.4 on CentOS7 64bit compiled from
> source.
>
> All the best & TIA,
>
> Uwe
>


------------------------------------------------------------------------------
Mobile security can be enabling, not merely restricting. Employees who
bring their own devices (BYOD) to work are irked by the imposition of MDM
restrictions. Mobile Device Manager Plus allows you to control only the
apps on BYO-devices by containerizing them, leaving personal data untouched!
https://ad.doubleclick.net/ddm/clk/304595813;131938128;j
_______________________________________________
Bacula-users mailing list
Bacula-users AT lists.sourceforge DOT net
https://lists.sourceforge.net/lists/listinfo/bacula-users

<Prev in Thread] Current Thread [Next in Thread>