[BackupPC-users] BackupPC processes getting oom-killed

Hey folks,

I have a BackupPC server that has been in operation for almost
5 years. It's been running 3.1.0 for over two years, and over the
last few weeks, it's been exhibiting a problem whose symptoms are
best described by the following dmesg output:

  kernel: BackupPC_dump invoked oom-killer: gfp_mask=0x201da, order=0, oom_adj=0
  […]
  kernel: Out of memory: kill process 21786 (BackupPC_dump) score 42689 or a 
child
  kernel: Killed process 23932 (ssh)
  kernel BackupPC_dump invoked oom-killer: gfp_mask=0x201da, order=0, oom_adj=0
  […]
  kernel: [4950662.832124] Out of memory: kill process 21786 (BackupPC_dump) 
score 42154 or a child
  kernel: [4950662.832134] Killed process 21786 (BackupPC_dump)

The machine has had 2 Gb of RAM and 4 Gb of swap space since it was
born. The swap space is not being touched, meaning that the 2 Gb of
RAM seem to be enough (and have been for more than 4.5 years).

The backup storage resides on a dm-crypt LV, which in turn resides
on top of drbd with a local RAID10, as well as a RAID10 provided by
an identical machine sitting next to it on Gigabit.

I cannot identify a change to the machine, or a change in our
infrastructure, which could trigger these oom-kills.

I am led to believe that they are I/O-related, but so far, all
attempts at playing with /proc/sys/vm/dirty_{background_,}ratio
(both 10 at the moment) have not yielded a change.

Has anyone encountered and solved this? Or do you have an idea what
the root cause could be?

Thanks,

-- 
martin | http://madduck.net/ | http://two.sentenc.es/
 
"i sometimes think that god
 in creating man
 somewhat overestimated his ability."
                                                        -- oscar wilde
 
spamtraps: madduck.bogus AT madduck DOT net

digital_signature_gpg.asc
Description: Digital signature (see http://martin-krafft.net/gpg/sig-policy/999bbcc4/current)

------------------------------------------------------------------------------
Learn the latest--Visual Studio 2012, SharePoint 2013, SQL 2012, more!
Discover the easy way to master current and previous Microsoft technologies
and advance your career. Get an incredible 1,500+ hours of step-by-step
tutorial videos with LearnDevNow. Subscribe today and save!
http://pubads.g.doubleclick.net/gampad/clk?id=58041391&iu=/4140/ostg.clktrk

_______________________________________________
BackupPC-users mailing list
BackupPC-users AT lists.sourceforge DOT net
List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:    http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/