BackupPC-users

Re: [BackupPC-users] Bizarre form of cpool corruption.

2010-12-07 13:16:08
Subject: Re: [BackupPC-users] Bizarre form of cpool corruption.
From: Robin Lee Powell <rlpowell AT digitalkingdom DOT org>
To: "General list for user discussion, questions and support" <backuppc-users AT lists.sourceforge DOT net>
Date: Tue, 7 Dec 2010 10:14:17 -0800
On Tue, Dec 07, 2010 at 01:07:50PM -0500, Jeffrey J. Kosowsky wrote:
> 2. More importantly, there is no fast way

No, there really isn't.

> that I know of checking whether a pc entry with more than one link
> is in the pool. You first need to read in the 1st MB of each file,
> calculate the partial file md5sum, then see if it is present in
> the pool and then if there is a chain of files with the same
> partial md5sum, you need to compare the files individually. All
> the pieces to do that are in my various posted routines and code
> snippets, it's just not wrapped with one big for loop to go
> through the pc directory.

BackupPC_fixLinks is very close; I posted my changes seperately.  To
productionalize them they should be tied to an option flag, because
yeah, *SLOW*.  But I've apparently lost some hundreds of GiB this
way (because that's how big the tarPCCopy file was when I ran out of
space -_-), and I want it back.

> Still, blindly traversing the entire pc tree will generally be an
> order of magnitude slower or more than traversing the pool
> assuming that you have a lot of current and incrementals. If you
> are satisfied just going through the latest backup then it might
> be more manageable...

Unfortunately, no.  And yes, just doing this one customer is going
to take days.  Plural.

> In fact, it was for applications like this that I had suggested a
> while back adding the partial md5sum to the attrib file so that
> the reverse lookup can be done more cheaply 

That would, in fact, be fantastic.

> (the need for all of this will be obviated when Craig finishes the
> next version :P )

Oh?  How's that looking?

-Robin

-- 
http://singinst.org/ :  Our last, best hope for a fantastic future.
Lojban (http://www.lojban.org/): The language in which "this parrot
is dead" is "ti poi spitaki cu morsi", but "this sentence is false"
is "na nei".   My personal page: http://www.digitalkingdom.org/rlp/

------------------------------------------------------------------------------
What happens now with your Lotus Notes apps - do you make another costly 
upgrade, or settle for being marooned without product support? Time to move
off Lotus Notes and onto the cloud with Force.com, apps are easier to build,
use, and manage than apps on traditional platforms. Sign up for the Lotus 
Notes Migration Kit to learn more. http://p.sf.net/sfu/salesforce-d2d
_______________________________________________
BackupPC-users mailing list
BackupPC-users AT lists.sourceforge DOT net
List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:    http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/