BackupPC-users

Re: [BackupPC-users] Block-level rsync-like hashing dd?

2011-04-10 13:56:34
Subject: Re: [BackupPC-users] Block-level rsync-like hashing dd?
From: "Jeffrey J. Kosowsky" <backuppc AT kosowsky DOT org>
To: "General list for user discussion, questions and support" <backuppc-users AT lists.sourceforge DOT net>
Date: Sun, 10 Apr 2011 13:54:04 -0400
Les Mikesell wrote at about 00:16:32 -0500 on Sunday, April 10, 2011:
 > On 4/9/11 10:39 PM, Jeffrey J. Kosowsky wrote:
 > > Les Mikesell wrote at about 11:31:28 -0500 on Saturday, April 9, 2011:
 > >   >  On 4/9/11 12:28 AM, Saturn2888 wrote:
 > >   >  >  :: mdadm ::
 > >   >  This is what I use, with a raid1 created with 3 members but one 
 > > missing.  I
 > >   >  periodically rotate disks into a hotswap sata bay, add it long enough 
 > > to
 > >   >  re-sync, and then fail and remove it to take offsite.  The sync
 > >   >  operation do
 > >
 > > I tried this just *once* and ended up losing 2 years of backups!
 > > Specifically, I had been running software RAID1 on 2 1TB disks for 2
 > > years without any problems. Then on Black Friday, I bought a new 1TB
 > > disk and had the brilliant idea of adding it temporarily to my RAID
 > > array to create a backup.  I mounted it via an external USB
 > > enclosure. Well, somehow it crashed during rebuilding, leaving the new
 > > 3rd disk unreadable and corrupting the pool on the original disk --
 > > specifically, a number of pool files and directories were deleted or
 > > became unreadable. Not sure how and/or why this happened, but the
 > > LESSON is that RAID is not perfect and it can corrupt everything. If I
 > > do this again in the future, I probably should at a minimum remove one
 > > of the internal drives to use as backup later on in case something
 > > happens. Alternatively, I probably would have been better just taking
 > > BackupPC offline and doing a 'dd' to the new disk
 > 
 > I've never heard of raid sync affecting the original disk(s).  I've
 > been doing it for years, first with a set of firewire external
 > drives (which also had USB but it was slower), then the sata bays.
 > There might be problems in adding more members than originally
 > created in the set, though.

I believe that there may be a hardware problem with the USB box I used
to mount the 3rd drive. It actually completed the sync initially (and
I unfortunately then left it connected for a few days). I imagine that
the hardware might have gone flakey during ongoing runs of BackupPC
perhaps leading to the partial corruption of the 2 original drives and the
total corruption of the filesystem on the 3rd drive. 

I also did increase the number of drives in the set from 2 to 3 but I
wouldn't have thought that that would be a problem.


>  In your situation I would have failed/removed one of the internal
> members with mdadm, then added the usb in its place.  With my
> rotation, I make it a point to never have all the disks in one place
> or connected at the same time, so even if something did wipe all
> three connected disks, I'd be able to recover back to the last swap
> from the offsite copy.

I agree that would be a safer approach. I was "lazy" and wanted to
avoid having to re-sync the disk I was removing after the new drive
synced. (I didn't want to use a 3 drive rotation since the original 2
drives are an exactly matched pair so I preferred to keep those as the basis).


------------------------------------------------------------------------------
Xperia(TM) PLAY
It's a major breakthrough. An authentic gaming
smartphone on the nation's most reliable network.
And it wants your games.
http://p.sf.net/sfu/verizon-sfdev
_______________________________________________
BackupPC-users mailing list
BackupPC-users AT lists.sourceforge DOT net
List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:    http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

<Prev in Thread] Current Thread [Next in Thread>