dan wrote:
> i have tested the send and receive functionality of zfs on openbsd.  the 
> problem is that it sends the entire fileset, block by block.  this is 
> not going to work for remote replication within a reasonable timeframe.

You have to do that once, but I thought you could do one snapshot, send 
it for the initial snapshot copy, then subsequently do other snapshots 
and incremental sends to be received into the remote snapshot copy.  The 
question is, how efficient are those incremental sends when backuppc has 
   made a run that didn't add a lot of new data but made lots of new 
hardlinks?

> rsync is about the only option.  i know it does not scale well with file 
> count but it still does the best job of syncing up filesystems remotely. 
> 
> the best solution here is to get with the rsync team and see what can be 
> done about the memory usage.   maybe an option to write the file list to 
> a temp file or maybe compress the file list in memory.
> 
> I do remote rsyncs for a large fileset with millions of files.  It does 
> work, reliably even, though i have 4GB of ram available on both computers.

I haven't seen this work even locally with several hundred gigs in the 
archive filesystem.

> I have done massive amounts of testing and trial and error and have 
> found that this is the best setup for my needs, and purhaps many 
> people's needs

Did you measure the size of the zfs incremental send when done from a 
snapshot where a previous snapshot had already been sent?  So far I 
haven't been able to boot any opensolaris based system on the boxes 
where I'd like to test.  I might eventually try it with freebsd.

Maybe a zfs snapshot copied to a local external drive or sent to an 
external drive on another machine on the LAN, then carried offsite would 
work if the incremental send is not efficient.

-- 
   Les Mikesell
    lesmikesell AT gmail DOT com


-------------------------------------------------------------------------
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/
_______________________________________________
BackupPC-users mailing list
BackupPC-users AT lists.sourceforge DOT net
List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:    http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/