BackupPC-users

Re: [BackupPC-users] Bizarre form of cpool corruption.

2010-12-06 16:01:27
Subject: Re: [BackupPC-users] Bizarre form of cpool corruption.
From: Robin Lee Powell <rlpowell AT digitalkingdom DOT org>
To: "General list for user discussion, questions and support" <backuppc-users AT lists.sourceforge DOT net>
Date: Mon, 6 Dec 2010 12:59:41 -0800
On Mon, Dec 06, 2010 at 03:48:04PM -0500, Jeffrey J. Kosowsky wrote:
> Robin Lee Powell wrote at about 10:37:52 -0800 on Monday, December 6, 2010:
>  > 
>  > So I'm writing a script to transfer a client from one host to
>  > another, using tarPCCopy, and I'm getting messages like this:
>  > 
>  >   Can't find 
> foo--tm50-e00145--tm50-s00339---shared/47/f%2f/fshared/ffoo/fpurchase_order_assets/fbatch_7813/f7105620_done.txt
>  in pool, will copy file
>  > 
>  > which is fascinating because the first column in ls -l is *3*. -_-
>  > 
>  > The tarPCCopy tar file therefore ends up becoming really large
>  > (hundreds of gibibytes) with files that already exist in the pool,
>  > presumably.
>  > 
>  > I've tried running md5sum on that file; can't find that in the pool.
>  > I've tried BackupPC_zcat | md5sum; can't find that in the pool.
> 
> Well the 'md5sum' used in pool naming is only a partial file md5sum.
> I wrote (and posted) a routine to calculate and optionally test for
> existence of the md5sum pool name corresponding to any pc tree
> file. I will attach a copy to the end of this post.
> 
>  > BackupPC_fixLinks, from the wiki, doesn't see the problem at all,
>  > which I'd *very* much like to fix.
> 
> First check to make sure there really is a problem with the pool...
> Then, we need to figure out whether there is a problem with tarcopy or
> with my program BackupPC_fixLinks etc.

Before I go off testing that, I just want to mention that you're my
hero.  :D  Next to the actual authors of BackupPC, of course.

I've made so much use of your scripts it's not even funny; BackupPC
is great but it breaks down when you're trying to juggle super-large
clients (I have *one BackupPC client* with 2.3TiB in the pool)
around between various BackupPC hosts, and other crazy large-scale
crap.  Your scripts have been invaluable.

-Robin

-- 
http://singinst.org/ :  Our last, best hope for a fantastic future.
Lojban (http://www.lojban.org/): The language in which "this parrot
is dead" is "ti poi spitaki cu morsi", but "this sentence is false"
is "na nei".   My personal page: http://www.digitalkingdom.org/rlp/

------------------------------------------------------------------------------
What happens now with your Lotus Notes apps - do you make another costly 
upgrade, or settle for being marooned without product support? Time to move
off Lotus Notes and onto the cloud with Force.com, apps are easier to build,
use, and manage than apps on traditional platforms. Sign up for the Lotus 
Notes Migration Kit to learn more. http://p.sf.net/sfu/salesforce-d2d
_______________________________________________
BackupPC-users mailing list
BackupPC-users AT lists.sourceforge DOT net
List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:    http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/