BackupPC-users

Re: [BackupPC-users] RsyncP and --whole-file

2013-09-28 08:32:30
Subject: Re: [BackupPC-users] RsyncP and --whole-file
From: Till Hofmann <hofmanntill AT gmail DOT com>
To: "General list for user discussion, questions and support" <backuppc-users AT lists.sourceforge DOT net>
Date: Sat, 28 Sep 2013 14:30:27 +0200
Doesn't rsync calculate checksums even if you set --whole-file? It doesn't calculate block checksums but it still calculates file checksums - and if they match it skips the file (which only happens if you set --checksum-seed because otherwise it uses the current time as checksum-seed)


On Sat, Sep 28, 2013 at 1:56 PM, Chris Adamson <chris.adamson AT mcri.edu DOT au> wrote:
Les,

The only difference I can see is that, as you point out, --one-file-system is purely handled by the sender and doesn't need to be "supported" as such by the receiver. I haven't as yet figured out how to get rsyncd to print out the final set of options it is using when backuppc establishes a connection to it so I don't know whether whole-file is being used directly. However, the full backups are CPU bound for both the rsync and BackupPC_dump processes and if I do a iftop to look at the traffic on the loopback network connection there is hardly anything being transferred over it. This suggests that only checksums are being transferred over the connection rather than the data itself. I will look into getting rsyncd to print out more verbose log files so that I can see if it is indeed using the delta xfer algorithm even though I specify --whole-file.

-----Original Message-----
From: Les Mikesell [mailto:lesmikesell AT gmail DOT com]
Sent: Thursday, 26 September 2013 2:01 PM
To: General list for user discussion, questions and support
Subject: Re: [BackupPC-users] RsyncP and --whole-file

On Tue, Sep 24, 2013 at 6:58 PM, Chris Adamson <chris.adamson AT mcri.edu DOT au> wrote:
> This is /usr/lib/perl5/File/RsyncP.pm
>
> 115     #
>  116     # Since the exclude arguments are no longer needed (they are
>  117     # passed via the socket, not the command-line args), update
>  118     # $rs->{rsyncOpts}
>  119     #
>  120     @{$rs->{rsyncArgs}} = @ARGV;
>  121
>  122     #
>  123     # Now process the rest of the arguments we care about
>  124     #
>  125     return if ( !$p->getoptions($rs->{rsyncOpts},
>  126             "block-size=i",
>  127             "devices|D",
>  128                     "from0|0",
>  129             "group|g",
>  130             "hard-links|H",
>  131             "ignore-times|I",
>  132             "links|l",
>  133             "numeric-ids",
>  134             "owner|o",
>  135             "perms|p",
>  136             "protocol=i",
>  137             "recursive|r",
>  138             "relative|R",
>  139             "timeout",
>  140             "verbose|v+",
>  141         ) );
>
> Note that whole-file is not included in the list of options that it looks for, so it is ignored by RsyncP. This is 0.68 but it is the same deal in 0.70.
>

I don't see --one-file-system in that list either, but I know it is honored because I use it everywhere.  This must be the list that is processed on the receiving side.  Wouldn't whole-file be passed to the sender and handled there?

--
   Les Mikesell
     lesmikesell AT gmail DOT com

------------------------------------------------------------------------------
October Webinars: Code for Performance
Free Intel webinars can help you accelerate application performance.
Explore tips for MPI, OpenMP, advanced profiling, and more. Get the most from the latest Intel processors and coprocessors. See abstracts and register > http://pubads.g.doubleclick.net/gampad/clk?id=60133471&iu=/4140/ostg.clktrk
_______________________________________________
BackupPC-users mailing list
BackupPC-users AT lists.sourceforge DOT net
List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:    http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

______________________________________________________________________
This email has been scanned by the Symantec Email Security.cloud service.
For more information please visit http://www.symanteccloud.com

If you have any question, please contact MCRI IT Helpdesk for further assistance.
______________________________________________________________________

______________________________________________________________________
This email has been scanned by the Symantec Email Security.cloud service.
For more information please visit http://www.symanteccloud.com
______________________________________________________________________

------------------------------------------------------------------------------
October Webinars: Code for Performance
Free Intel webinars can help you accelerate application performance.
Explore tips for MPI, OpenMP, advanced profiling, and more. Get the most from
the latest Intel processors and coprocessors. See abstracts and register >
http://pubads.g.doubleclick.net/gampad/clk?id=60133471&iu=/4140/ostg.clktrk
_______________________________________________
BackupPC-users mailing list
BackupPC-users AT lists.sourceforge DOT net
List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:    http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

------------------------------------------------------------------------------
October Webinars: Code for Performance
Free Intel webinars can help you accelerate application performance.
Explore tips for MPI, OpenMP, advanced profiling, and more. Get the most from 
the latest Intel processors and coprocessors. See abstracts and register >
http://pubads.g.doubleclick.net/gampad/clk?id=60133471&iu=/4140/ostg.clktrk
_______________________________________________
BackupPC-users mailing list
BackupPC-users AT lists.sourceforge DOT net
List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:    http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/