BackupPC-users

Re: [BackupPC-users] RsyncP and --whole-file

2013-09-24 19:59:17
Subject: Re: [BackupPC-users] RsyncP and --whole-file
From: Chris Adamson <chris.adamson AT mcri.edu DOT au>
To: "General list for user discussion, questions and support" <backuppc-users AT lists.sourceforge DOT net>
Date: Tue, 24 Sep 2013 23:58:08 +0000
This is /usr/lib/perl5/File/RsyncP.pm

115     #
 116     # Since the exclude arguments are no longer needed (they are
 117     # passed via the socket, not the command-line args), update
 118     # $rs->{rsyncOpts}
 119     #
 120     @{$rs->{rsyncArgs}} = @ARGV;
 121
 122     #
 123     # Now process the rest of the arguments we care about
 124     #
 125     return if ( !$p->getoptions($rs->{rsyncOpts},
 126             "block-size=i",
 127             "devices|D",
 128                     "from0|0",
 129             "group|g",
 130             "hard-links|H",
 131             "ignore-times|I",
 132             "links|l",
 133             "numeric-ids",
 134             "owner|o",
 135             "perms|p",
 136             "protocol=i",
 137             "recursive|r",
 138             "relative|R",
 139             "timeout",
 140             "verbose|v+",
 141         ) );

Note that whole-file is not included in the list of options that it looks for, 
so it is ignored by RsyncP. This is 0.68 but it is the same deal in 0.70.

-----Original Message-----
From: Les Mikesell [mailto:lesmikesell AT gmail DOT com] 
Sent: Wednesday, 25 September 2013 4:03 AM
To: General list for user discussion, questions and support
Subject: Re: [BackupPC-users] RsyncP and --whole-file

On Mon, Sep 23, 2013 at 8:51 PM, Chris Adamson <chris.adamson AT mcri.edu DOT 
au> wrote:
> I'm using backuppc to backup > 14TB of data on a local machine. I'm 
> using the rsyncd option since tar does not detect deleted files in 
> incrementals. I was trying to see if the -whole-file option in the 
> rsync options avoided the delta xfer algorithm that is not important 
> since it is not transferring over a network. I had a look in the 
> RsyncP code and it ignores the -whole-file option. Could this be 
> implemented in RsyncP since the backup rsync processes are very CPU bound and 
> this slows down backups, particularly full backups.

Where are you finding that in the RsyncP code?   I see it always does
whole-file when sending (restores) but don't see anything about not passing it 
to the other side for backups (but didn't look much beyond a grep for 
'whole'...).

-- 
   Les Mikesell
    lesmikesell AT gmail DOT com

------------------------------------------------------------------------------
October Webinars: Code for Performance
Free Intel webinars can help you accelerate application performance.
Explore tips for MPI, OpenMP, advanced profiling, and more. Get the most from 
the latest Intel processors and coprocessors. See abstracts and register > 
http://pubads.g.doubleclick.net/gampad/clk?id=60133471&iu=/4140/ostg.clktrk
_______________________________________________
BackupPC-users mailing list
BackupPC-users AT lists.sourceforge DOT net
List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:    http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

______________________________________________________________________
This email has been scanned by the Symantec Email Security.cloud service.
For more information please visit http://www.symanteccloud.com

If you have any question, please contact MCRI IT Helpdesk for further 
assistance.
______________________________________________________________________

______________________________________________________________________
This email has been scanned by the Symantec Email Security.cloud service.
For more information please visit http://www.symanteccloud.com
______________________________________________________________________

------------------------------------------------------------------------------
October Webinars: Code for Performance
Free Intel webinars can help you accelerate application performance.
Explore tips for MPI, OpenMP, advanced profiling, and more. Get the most from 
the latest Intel processors and coprocessors. See abstracts and register >
http://pubads.g.doubleclick.net/gampad/clk?id=60133471&iu=/4140/ostg.clktrk
_______________________________________________
BackupPC-users mailing list
BackupPC-users AT lists.sourceforge DOT net
List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:    http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/