BackupPC-users

[BackupPC-users] Out of memory with rsync

2012-04-13 18:18:40
Subject: [BackupPC-users] Out of memory with rsync
From: Joerg Delker <jd AT onix DOT de>
To: BackupPC-users AT lists.sourceforge DOT net
Date: Sat, 14 Apr 2012 00:17:21 +0200
Hi!

Is there any known memory (leak) problem with BackupPC 3.2.1 and rsync 
backups?

I upgraded our Debian host with the latest wheezy backuppc package 
(3.2.1-2) and suddenly encounter "out of memory" problems with a 
particular share.

The problem occurs with a dump of a remote Linux system via rsync.
Watching the BackupPC_dump process via 'top' shows that it constantly 
grows in size until it consumes roughly 1.5G memory until it suddenly 
terminates. Despite the reported "Out of memory" error (see log below), 
the system is not reaching exhaustion - at least what I can see within 
top (host has 3GB RAM and swap is not growing over 10% (of 1GB)).

Invoking the dump manually with
BackupPC_dump -i -vv nfsserv
shows this (truncated) log:

[...]
CheckHostAlive: returning 0.088
incr backup started back to 2012-04-10 21:55:42 (backup #333) for 
directory /export/share
started incr dump, share=/export/share
Running: /usr/bin/ssh -q -x nfsserv sudo /usr/bin/rsync --server 
--sender --numeric-ids --perms --owner --group -D --links --hard-links 
--times --block-size=2048 --recursive --one-file-system 
--checksum-seed=32761 . /export/share/
Xfer PIDs are now 17175
xferPids 17175
Rsync command pid is 17175
Fetching remote protocol
Got remote protocol 30
Negotiated protocol version 28
Checksum caching enabled (checksumSeed = 32761)
Got checksumSeed 0x7ff9
Sent exclude: /tmp
Sent exclude: core
Got file (0 of 149): .
[...]
Got file (279738 of 279739): amavis/whitelist_sender
Got file list: 279739 entries
Child PID is 17184
Xfer PIDs are now 17175,17184
xferPids 17175,17184
Sending csums, cnt = 279739, phase = 0
Sending empty csums for .rsync-filter
Sending empty csums for amavis/whitelist_sender
[...]
Sending empty csums for src/kernel/linux-source-2.6.26/sound/ppc/beep.c
Out of memory!
Parent read EOF from child: fatal error!
Sending empty csums for src/kernel/linux-source-2.6.26/sound/ppc/built-in.o
Sending csums, cnt = 158990, phase = 1
Sending empty csums for src/kernel/linux-source-2.6.26/sound/ppc/burgundy.c
Done: 0 files, 0 bytes
Got fatal error during xfer (Child exited prematurely)
[...]
CheckHostAlive: returning 0.088
Backup aborted (Child exited prematurely)
dump failed: Child exited prematurely
link nfsserv


I've run out of ideas what to try to get this thing rolling again.
Any hints for debugging or fixing are very welcome.

Regards
Jörg

------------------------------------------------------------------------------
For Developers, A Lot Can Happen In A Second.
Boundary is the first to Know...and Tell You.
Monitor Your Applications in Ultra-Fine Resolution. Try it FREE!
http://p.sf.net/sfu/Boundary-d2dvs2
_______________________________________________
BackupPC-users mailing list
BackupPC-users AT lists.sourceforge DOT net
List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:    http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

<Prev in Thread] Current Thread [Next in Thread>
  • [BackupPC-users] Out of memory with rsync, Joerg Delker <=