BackupPC-users

[BackupPC-users] rsync out of memory

2014-11-20 15:10:11
Subject: [BackupPC-users] rsync out of memory
From: Christian Völker <chrischan AT knebb DOT de>
To: "General list for user discussion, questions and support" <backuppc-users AT lists.sourceforge DOT net>
Date: Thu, 20 Nov 2014 21:07:59 +0100
Hi,

I decided to implement BackupPC at a second location as it is really
reliable and nearly perfect! ;)

Unfortunately, I'm getting errors when backing up one host. My debugging
gave the following results:

bash-4.1$ ./BackupPC_dump -v -f pdc.evs-nb.de
cmdSystemOrEval: about to system /bin/ping -c 1 -w 3 abc.domain.de
[...]
full backup started for directory /
started full dump, share=/
Running: /usr/bin/ssh -q -x -l root abc.domain.de /usr/bin/rsync
--server --sender --numeric-ids --perms --owner --group -D --links
--hard-links --times --block-size=2048 --recursive -x -z -v
--no-inc-recursive -v --ignore-times . /
Xfer PIDs are now 9933
xferPids 9933
Got remote protocol 30
Negotiated protocol version 28
Remote[2]: [sender] expand file_list pointer array to 524288 bytes, did move
Remote[2]: [sender] expand file_list pointer array to 1048576 bytes, did
move
Xfer PIDs are now 9933,9934
xferPids 9933,9934
  create d 555       0/0        4096 .
>Out of memory!
Parent read EOF from child: fatal error!
Done: 0 files, 0 bytes
Got fatal error during xfer (Child exited prematurely)
[...]
CheckHostAlive: returning 0.156
Backup aborted (Child exited prematurely)
Not saving this as a partial backup since it has fewer files than the
prior one (got 0 and 0 files versus 0)
dump failed: Child exited prematurely

I started rsync manually with the same options as above and I monitored
the memory consumption on the sender. This time it succeeded:
total: matches=26625  hash_hits=2561895  false_alarms=35 data=5775632621

sent 2144313 bytes  received 3721731504 bytes  5878257.01 bytes/sec
total size is 5845056098  speedup is 1.57
[root@backup srv]#


rsync uses around 112M, which should not be too much. Especially as the
host hast still approx 1G of free memory.  "top" is saying:
 3620 root      20   0  112m 8036  952 R 69.5  0.2   3:17.46 rsync


As you can see, I already added the --no-inc-recursive (reduce memory
usage) and the -x (do not cross file systems) option to the rsync
command.  Still no go. Rsync continues telling me about out of memory. 
I can't believe there should be too much files in it as I store all
other data except the OS itself on different partitions.
/dev/mapper/vg1_pdc-root                      12G  5.5G  5.5G  50% /


Any other ideas how I can backup this server? I'm still wondering as
this server is not a very uncommon setup- just default OS.

Anyone having a clue?


Greetings

Christian






------------------------------------------------------------------------------
Download BIRT iHub F-Type - The Free Enterprise-Grade BIRT Server
from Actuate! Instantly Supercharge Your Business Reports and Dashboards
with Interactivity, Sharing, Native Excel Exports, App Integration & more
Get technology previously reserved for billion-dollar corporations, FREE
http://pubads.g.doubleclick.net/gampad/clk?id=157005751&iu=/4140/ostg.clktrk
_______________________________________________
BackupPC-users mailing list
BackupPC-users AT lists.sourceforge DOT net
List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:    http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

<Prev in Thread] Current Thread [Next in Thread>