BackupPC-users

Re: [BackupPC-users] Uneffective rsync transfers?

2014-06-26 11:49:01
Subject: Re: [BackupPC-users] Uneffective rsync transfers?
From: Les Mikesell <lesmikesell AT gmail DOT com>
To: "General list for user discussion, questions and support" <backuppc-users AT lists.sourceforge DOT net>
Date: Thu, 26 Jun 2014 10:47:19 -0500
On Thu, Jun 26, 2014 at 7:40 AM, František Starý <frantisek AT stary DOT net> 
wrote:
>
> I've started experimenting with rsync xfer method and I've found that the
> rsync transfers always the changes against the last backup.

You don't need to experiment to find that - see $Conf{IncrLevels} in
the documentation.


> Second full backup (when 0 files changed):
> ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
> full backup started for directory /testdir/ (baseline backup #0)
> Running: /usr/bin/ssh -q -x -l root localhost /usr/bin/rsync --server
> --sender --numeric-ids --perms --owner --group -D --links --hard-links
> --times --block-size=2048 --recursive . /testdir/
> Xfer PIDs are now 27502
> Got remote protocol 30
> Negotiated protocol version 28
> Xfer PIDs are now 27502,27551
>   create d 755       0/0        4096 .
> Done: 0 files, 0 bytes
> Got fatal error during xfer (No files dumped for share /testdir/)
> Backup aborted (No files dumped for share /testdir/)
> Not saving this as a partial backup since it has fewer files than the prior
> one (got 0 and 0 files versus 0)
>
> Shouldn't be this considered as "non error" status? It means no files were
> changed.

That's optional,  See $Conf{BackupZeroFilesIsFatal}


> Second full backup (when 1 file added):
> ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
> full backup started for directory /testdir/ (baseline backup #0)
> Running: /usr/bin/ssh -q -x -l root localhost /usr/bin/rsync --server
> --sender --numeric-ids --perms --owner --group -D --links --hard-links
> --times --block-size=2048 --recursive . /testdir/
> Xfer PIDs are now 28931
> Got remote protocol 30
> Negotiated protocol version 28
> Xfer PIDs are now 28931,28980
>   create d 755       0/0        4096 .
>   create   644       0/0     1048576 testfile4
> Done: 1 files, 1048576 bytes.
>
> It seems to be okay. Only the new file was transferred. But when I look in
> the web gui at this full backup, I see only this file. The other files
> (testfile1,2,3) are not here. Shouldn't be the full backup really full
> (merged somehow with the previous full backup)?

Full backups should link unchanged files from the previous full into
the current tree.  Is your xfer log full of 'can't link' errors?


> Fourth full backup (when 0 files changed after the previous backup):
> ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
> full backup started for directory /testdir/ (baseline backup #2)
> Running: /usr/bin/ssh -q -x -l root localhost /usr/bin/rsync --server
> --sender --numeric-ids --perms --owner --group -D --links --hard-links
> --times --block-size=2048 --recursive . /testdir/
> Xfer PIDs are now 30426
> Got remote protocol 30
> Negotiated protocol version 28
> Xfer PIDs are now 30426,30474
>   create d 755       0/0        4096 .
>   create   644       0/0     1048576 testfile4
> Done: 1 files, 1048576 bytes
>
> And again. Only the files that are not present in the previous backup are
> present.
>
> Is this a normal behavior?

No, you have some problem with the filesystem.  Does it support hard links?

> Is there a way to configure backuppc to transfer
> only changed files and merge them with the previous backup? I want to backup
> 200GB of email files.

Yes, that is the way it is supposed to work.   If the files are mbox
format (many messages in one file) it can be rather slow to merge the
changes but it does work.  Maildir format works more efficiently.

-- 
   Les Mikesell
      lesmikesell AT gmail DOT com

------------------------------------------------------------------------------
Open source business process management suite built on Java and Eclipse
Turn processes into business applications with Bonita BPM Community Edition
Quickly connect people, data, and systems into organized workflows
Winner of BOSSIE, CODIE, OW2 and Gartner awards
http://p.sf.net/sfu/Bonitasoft
_______________________________________________
BackupPC-users mailing list
BackupPC-users AT lists.sourceforge DOT net
List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:    http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/