BackupPC-users

Re: [BackupPC-users] Block-level rsync-like hashing dd?

2008-12-09 13:23:29
Subject: Re: [BackupPC-users] Block-level rsync-like hashing dd?
From: tmassey AT obscorp DOT com
To: "General list for user discussion, questions and support" <backuppc-users AT lists.sourceforge DOT net>
Date: Tue, 9 Dec 2008 13:07:58 -0500
Tino Schwarze <backuppc.lists AT tisc DOT de> wrote on 12/08/2008 12:49:27 PM:

> > In all of the myriad of "how do I replicate a server", someone one 
time 
> > suggested using a netcat/dd like command with block-level hashing to 
copy 
> > only changed blocks.  Since then, I have searched *extensively* for 
this, 
> > and I cannot find it.
> 
> I'd just rsync the raw devices. It's actually smilar to rsync'ing DVD
> images, just a bit larger. Never checked whether that's faster -
> probably depends on your network bandwidth and I/O speeds.

You can *do* that?!?  That is taking the everything-is-a-file metaphor to 
entirely new levels...

Of course, your point is valid:  if your between-systems bandwidth 
approaches your system-to-disk bandwidth, a straight-up dd would be no 
slower, and a whole lot less work.  Only if your between-systems bandwidth 
is significantly smaller does it make sense.

You are guaranteed to take at *least* as long as a dd no matter what:  the 
rsync transfer will have to read 100% of the source disk no matter what. 
AFAICT, that is unavoidable if you're working at the block layer.  You're 
just saving any time caused by the transfer between systems.

It's too bad that there isn't a concept of "incremental" with such a 
transfer.

Another intriguing idea is to use DRDB across the Internet.  That *does* 
give you the idea of "incremental", but it's a significant and constant 
impact on bandwidth, not just at times when you want to do the transfer. 
The idea of pairing rsync and LVM snapshots is interesting.

Tim Massey


------------------------------------------------------------------------------
SF.Net email is Sponsored by MIX09, March 18-20, 2009 in Las Vegas, Nevada.
The future of the web can't happen without you.  Join us at MIX09 to help
pave the way to the Next Web now. Learn more and register at
http://ad.doubleclick.net/clk;208669438;13503038;i?http://2009.visitmix.com/
_______________________________________________
BackupPC-users mailing list
BackupPC-users AT lists.sourceforge DOT net
List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:    http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

<Prev in Thread] Current Thread [Next in Thread>