BackupPC-users

[BackupPC-users] rsyncd resume of partial backup retransmits many files

2009-10-12 11:00:31
Subject: [BackupPC-users] rsyncd resume of partial backup retransmits many files
From: "Harald Amtmann" <[email protected]>
To: backuppc-users AT lists.sourceforge DOT net
Date: Mon, 12 Oct 2009 16:57:52 +0200
Hello,

I am trying to backup a machine over a low bandwidth connection. Server is 
debian linux running BackupPC 3.1.0, client is Windows XP SP2 with rsync 3.0.4 
(for more details see below). I am currently trying to run the initial full 
backup but it got interrupted twice already due to various reasons. When I 
retrigger the full backup, a lot of large files are retransmitted even though 
they have already been uploaded to the server and weren't even touched in the 
meantime. 

In the log excerpt below you can see the processing of a file that definitely 
has been uploaded already. I am not sure if rsync transmits the file completely 
again or if the blocksize is so very small that the blockhashes are almost as 
much data as the original file. Whatever it is, resuming takes waaaay too long.

Is it a problem to use rsyncd and pool compression in this scenario? Please 
help.

Regards,
Harald


Windows XP Client
-----------------

rsync  version 3.0.4  protocol version 30
Copyright (C) 1996-2008 by Andrew Tridgell, Wayne Davison, and others.
Web site: http://rsync.samba.org/
Capabilities:
    64-bit files, 64-bit inums, 32-bit timestamps, 64-bit long ints,
    socketpairs, hardlinks, symlinks, no IPv6, batchfiles, inplace,
    append, ACLs, no xattrs, iconv, symtimes

rsyncd.conf
-----------

[d]
    path = /cygdrive/d
    comment = Documents and Settings
    strict modes = false
    auth users = baggub
    secrets file = D:/Programme/develop/cygwin/etc/rsyncd.secrets
    hosts allow = 192.168.5.9
    read only = true
    list = false



Debian Linux Server Log
-----------------------


full backup started for directory docsnsettings
Connected to therapy:873, remote version 30
Negotiated protocol version 28
Got response: 96c536dccfe269b730e0053c0bfd0561
in mime: lsU23M/iabcw4AU8C/0FYQ
Auth: got challenge: lcPTIMTn7tfds46eQF+PFw, reply: baggub 
lsU23M/iabcw4AU8C/0FYQ
Connected to module docsnsettings
Sending args: --server --sender --numeric-ids --perms --owner --group -D 
--links --hard-links --times --block-size=2048 --recursive --ignore-times . .
Checksum seed is 1255314593
Got checksumSeed 0x4ad294a1
[..]
Got file (244 of 387): .kde/share/apps/amarok/collection.db
[..]
/var/lib/backuppc/pc/therapy/0/fdocsnsettings/f.kde/fshare/fapps/famarok/fcollection.db
 cache = , invalid = , phase = 0
Sending csums for .kde/share/apps/amarok/collection.db (size=6002688)
[..]
Starting file 191 (.kde/share/apps/amarok/collection.db), blkCnt=2931, 
blkSize=2048, remainder=2048
.kde/share/apps/amarok/collection.db: blk=, newData=4096, rxMatchBlk=0, 
rxMatchNext=0
.kde/share/apps/amarok/collection.db: blk=2099, newData=0, rxMatchBlk=0, 
rxMatchNext=0
.kde/share/apps/amarok/collection.db: blk=3, newData=0, rxMatchBlk=2099, 
rxMatchNext=2100
.kde/share/apps/amarok/collection.db: blk=, newData=7168, rxMatchBlk=3, 
rxMatchNext=4
.kde/share/apps/amarok/collection.db: blk=2097, newData=0, rxMatchBlk=, 
rxMatchNext=4
.kde/share/apps/amarok/collection.db: blk=2099, newData=0, rxMatchBlk=2097, 
rxMatchNext=2098
.kde/share/apps/amarok/collection.db: blk=, newData=23552, rxMatchBlk=2099, 
rxMatchNext=2100
[...]
rxMatchNext=2100
.kde/share/apps/amarok/collection.db: blk=, newData=30720, rxMatchBlk=, 
rxMatchNext=2100
.kde/share/apps/amarok/collection.db: blk=, newData=0, rxMatchBlk=, 
rxMatchNext=2100
.kde/share/apps/amarok/collection.db got digests 
79fcd46f9cecf0e252718c1c0959dd2c vs 79fcd46f9cecf0e252718c1c0959dd2c
  pool     700 4294967295/4294967295     6002688 
.kde/share/apps/amarok/collection.db
attribSet(dir=fdocsnsettings/.kde/share/apps/amarok, file=collection.db, 
size=6002688, placeholder=)

-- 
GRATIS für alle GMX-Mitglieder: Die maxdome Movie-FLAT!
Jetzt freischalten unter http://portal.gmx.net/de/go/maxdome01

------------------------------------------------------------------------------
Come build with us! The BlackBerry(R) Developer Conference in SF, CA
is the only developer event you need to attend this year. Jumpstart your
developing skills, take BlackBerry mobile applications to market and stay 
ahead of the curve. Join us from November 9 - 12, 2009. Register now!
http://p.sf.net/sfu/devconference
_______________________________________________
BackupPC-users mailing list
BackupPC-users AT lists.sourceforge DOT net
List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:    http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

<Prev in Thread] Current Thread [Next in Thread>