BackupPC-users

Re: [BackupPC-users] BackupPC Pool synchronization?

2013-03-04 11:41:37
Subject: Re: [BackupPC-users] BackupPC Pool synchronization?
From: Trey Dockendorf <treydock AT gmail DOT com>
To: "General list for user discussion, questions and support" <backuppc-users AT lists.sourceforge DOT net>
Date: Mon, 4 Mar 2013 10:39:58 -0600
On Mon, Mar 4, 2013 at 10:20 AM, Mark Campbell
<mcampbell AT emediatrade DOT com> wrote:
> Oh, and while I'm thinking of it, what are your thoughts on using ZFS' dedup 
> feature on a BackupPC pool?  I'm aware that a goodly amount of RAM would be 
> required for that feature.  But since BackupPC's dedup feature is file-based, 
> and ZFS' dedup feature is block-based, even more space could be saved; 
> particularly when you're backing up things like .pst files, where a large 
> majority of the file is the same, save a few bytes/KB/MB.  Such files are 
> flagged by BackupPC as different.
>
> Thanks,
>
> --Mark
>
>
> -----Original Message-----
> From: Lars Tobias Skjong-Børsting [mailto:lists AT snota DOT no]
> Sent: Saturday, March 02, 2013 2:28 PM
> To: backuppc-users AT lists.sourceforge DOT net
> Subject: Re: [BackupPC-users] BackupPC Pool synchronization?
>
> Hi Mark,
>
> On 3/1/13 10:37 PM, Mark Campbell wrote:
>
>> Question, taking your model here, and applying it to my situation, how
>> well would this work:
>>
>> BackupPC server, with a RAID1 zpool, with the third member being my
>> external fireproof drive.  Rather than the rotation you described,
>> just leave it as is as it does its daily routine.  Then, should the
>> day come where I need to grab the drive and go, plugging the drive
>> into a system with ZFSonLinux & BackupPC installed, could I mount this
>> drive by itself?
>
> Yes, this is no different, really. It would work very well. Just keep it in 
> sync, and all should be fine. You can just pull out any drive at will, 
> without causing any filesystem corruption. The fireproof drive can be 
> inserted in a different computer with ZFS support and you can run "zpool 
> import" and then you can mount the filesystem.
>
> You shouldn't use USB for your external drive, though. E-SATA, Firewire or 
> Thunnderbolt is fine.
>
>> I really like your idea of zfs send/receive for the remote copy. Do
>> you have any tips/pointers/docs on the best way to run it in this
>> scenario?
>
> I don't mean to say RTFM, but the top results of a Google search are as good 
> a starting point as any:
> https://www.google.com/search?q=zfs+send+receive+backup
>
> I think this article is quite good:
> http://cuddletech.com/blog/pivot/entry.php?id=984
>
> If you have any further questions, don't hesitate to ask. :)
>
> --
> Best regards,
> Lars Tobias
>
> ------------------------------------------------------------------------------
> Everyone hates slow websites. So do we.
> Make your web apps faster with AppDynamics Download AppDynamics Lite for free 
> today:
> http://p.sf.net/sfu/appdyn_d2d_feb
> _______________________________________________
> BackupPC-users mailing list
> BackupPC-users AT lists.sourceforge DOT net
> List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
> Wiki:    http://backuppc.wiki.sourceforge.net
> Project: http://backuppc.sourceforge.net/
>
> ------------------------------------------------------------------------------
> Everyone hates slow websites. So do we.
> Make your web apps faster with AppDynamics
> Download AppDynamics Lite for free today:
> http://p.sf.net/sfu/appdyn_d2d_feb
> _______________________________________________
> BackupPC-users mailing list
> BackupPC-users AT lists.sourceforge DOT net
> List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
> Wiki:    http://backuppc.wiki.sourceforge.net
> Project: http://backuppc.sourceforge.net/

Resilvering in ZFS is slightly different than standard RAID.  The main
difference is that ZFS is 'filesystem aware'.  ZFS only has to copy
the existing data, rather than the entire block device like in
traditional RAID. This means resilvering can be very fast compared to
traditional RAID.

Some useful docs on the subject:

http://www.cupfighter.net/index.php/2012/10/default-nexenta-zfs-settings-you-want-to-change/

http://info.nexenta.com/rs/nexenta/images/white_paper_nexentastor_zfs_initialization_and_resilvering.pdf

https://github.com/szaydel/Nexenta-Docs-Pub

As for Dedup, I have no experience in it's usage, but it seems that
deduplication has the potential to upset BackupPC as what BackupPC
does is already a form of dedup by hardlinking files to save space.  I
personally would not use it in this case.

Useful docs on dedup and when to use:

https://blogs.oracle.com/bonwick/entry/zfs_dedup

http://hub.opensolaris.org/bin/view/Community+Group+zfs/dedup

- Trey

------------------------------------------------------------------------------
Everyone hates slow websites. So do we.
Make your web apps faster with AppDynamics
Download AppDynamics Lite for free today:
http://p.sf.net/sfu/appdyn_d2d_feb
_______________________________________________
BackupPC-users mailing list
BackupPC-users AT lists.sourceforge DOT net
List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:    http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

<Prev in Thread] Current Thread [Next in Thread>