BackupPC-users

[BackupPC-users] Some backups not working after upgrade to backuppc 4.0.0alpha3

2015-11-01 14:17:34
Subject: [BackupPC-users] Some backups not working after upgrade to backuppc 4.0.0alpha3
From: František Starý <frantisek AT stary DOT net>
To: backuppc-users AT lists.sourceforge DOT net
Date: Sun, 1 Nov 2015 19:56:30 +0100
Hello backuppc gurus.

I've upgraded backuppc from 3.3.0-1ubuntu1 to 4.0.0alpha3. Now I have 
the following issues with some of my backuped hosts since the update.
All my hosts are the same machine on the same network - just different 
folders with different backup settings.
Host "mail" that backups about 190GB of small files (maildirs) has never 
successfully backed up since the upgrade (14 days). The error is:

rsync error: error in rsync protocol data stream (code 12) at io.c(629) 
[generator=3.0.9.3]
rsync_bpc exited with fatal status 12 (3072) (rsync error: error in 
rsync protocol data stream (code 12) at io.c(629) [generator=3.0.9.3])
Xfer PIDs are now
Got fatal error during xfer (rsync error: error in rsync protocol data 
stream (code 12) at io.c(629) [generator=3.0.9.3])
Backup aborted (rsync error: error in rsync protocol data stream (code 
12) at io.c(629) [generator=3.0.9.3])
BackupFailCleanup: nFilesTotal = 2519, type = full, BackupCase = 6, 
inPlace = 1, lastBkupNum =
BackupFailCleanup: inPlace with some new files... no cleanup and marking 
partial
Running BackupPC_refCountUpdate -h mail -f on mail
xferPids 27057
Processing /var/lib/backuppc/pc/mail/1421
BackupPC_refCountUpdate: host mail got 0 errors
BackupPC_refCountPrint: total errors: 0
xferPids
Finished BackupPC_refCountUpdate (running time: 160 sec)

Logs of rsync daemon on client side says:
2015/11/01 14:36:53 [8943] connect from backup.domain.local (172.17.2.9)
2015/11/01 13:36:53 [8943] rsync on mail/ from [email protected] 
(172.17.2.9)
2015/11/01 13:36:53 [8943] building file list
2015/11/01 13:37:43 [8943] rsync: read error: Connection reset by peer (104)
2015/11/01 13:37:44 [8943] rsync error: error in socket IO (code 10) at 
io.c(802) [sender=3.1.0]

bpc_rsync log:
2015/11/01 14:37:43 [25618] chunk[1123] offset=2299904 len=2048 
sum1=7d8b9c9a
2015/11/01 14:37:43 [25618] rsync_bpc: connection unexpectedly closed 
(151 bytes received so far) [generator]
2015/11/01 14:37:43 [25618] [generator] _exit_cleanup(code=12, 
file=io.c, line=629): entered
2015/11/01 14:37:43 [25618] rsync error: error in rsync protocol data 
stream (code 12) at io.c(629) [generator=3.0.9.3]
2015/11/01 14:37:43 [25618] [generator] _exit_cleanup(code=12, 
file=io.c, line=629): about to call exit(12)

I've tried to change Xfer method from rsyncd to tar. The error was:

tarExtract: File 
some/file/1416466143.M905807P5061.server,S=18170,W=18501:2,Sc: old 
digest , new digest cf7f08106f86ee282324910f24f80e78
BackupPC_tarExtract exited with fail status 11
Tar exited with error 65280 () status
Xfer PIDs are now
Got fatal error during xfer (BackupPC_tarExtract exited with fail status 11)
Backup aborted (BackupPC_tarExtract exited with fail status 11)
BackupFailCleanup: nFilesTotal = 0, type = full, BackupCase = 6, inPlace 
= 1, lastBkupNum =
BackupFailCleanup: inPlace with no new files... no cleanup
Running BackupPC_refCountUpdate -h mail -f on mail
xferPids 30729
Processing /var/lib/backuppc/pc/mail/1421
BackupPC_refCountUpdate: host mail got 0 errors
BackupPC_refCountPrint: total errors: 0
xferPids
Finished BackupPC_refCountUpdate (running time: 125 sec)

Then I've tried to mount the mail folder locally on the backup server 
using nfs and do "local backup" using tar method. The same issue as the 
remote tar-method backup. If I run the "client command" from a command 
line, it works without problems:

backuppc@backup:~$ /usr/bin/ssh -q -x -n -l root localhost env LC_ALL=C 
/bin/tar -c -v -f - -C /mail/ --totals . >/dev/null 2>/tmp/tar-method.log
backuppc@backup:~$ echo $?
0
backuppc@backup:~$ tail -n 2 /tmp/tar-method.log
./vacation/vacation.log
Total bytes written: 187868180480 (175GiB, 4.1MiB/s)

So it seems to me there is no network or permission issue. It seems that 
some script that processes the input data stream on backuppc server site 
fails somehow during processing the incoming data from client.

Here is my host config (mail.pl):

$Conf{XferMethod} = 'rsyncd';
$Conf{ClientNameAlias} = '172.17.2.1';
$Conf{RsyncShareName} = ['mail'];
$Conf{BackupFilesExclude} = ['/lost+found'];
$Conf{RsyncdUserName} = 'mrkev';
$Conf{RsyncdPasswd} = 'xxx';

$Conf{RsyncArgs} = [
             '--super',
             '--recursive',
             '--p rotect-args',
             '--numeric-ids',
             '--perms',
             '--owner',
             '--group',
             '-D',
             '--times',
             '--links',
             '--hard-links',
             '--delete',
             '--partial',
             '--log-format=log: %o %i %B %8U,%8G %9l %f%L',
             '--stats',
             '--bwlimit=10240',
             '--block-size=2048',
             '-vvvv',
             '--log-file=/tmp/rsync.mail.log'
];

Do you have any idea how to fix this please?

Thank you.
With regards,
Frantisek.

------------------------------------------------------------------------------
_______________________________________________
BackupPC-users mailing list
BackupPC-users AT lists.sourceforge DOT net
List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:    http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

<Prev in Thread] Current Thread [Next in Thread>