BackupPC-users

Re: [BackupPC-users] jLib.pm question

2010-12-06 15:45:18
Subject: Re: [BackupPC-users] jLib.pm question
From: Robin Lee Powell <rlpowell AT digitalkingdom DOT org>
To: "General list for user discussion, questions and support" <backuppc-users AT lists.sourceforge DOT net>
Date: Mon, 6 Dec 2010 12:43:38 -0800
On Mon, Dec 06, 2010 at 03:33:52PM -0500, Jeffrey J. Kosowsky wrote:
> Robin Lee Powell wrote at about 11:28:56 -0800 on Monday, December 6, 2010:
>  > 
>  > I've locally modified BackupPC_fixLinks to check files even if
>  > they have more than one link. 
>
> I'm not sure what you mean... the program should work with any
> number of links. If there is a missing use case, please explain so
> I can fix it.

I have files with 3+ links that, according to BackupPC_tarPCCopy,
aren't actually linked into the pool.  See my other post.

>  >I'm getting a lot of errors like this:
>  > 
>  >   Can't read size of 
> /backups/pc/foo--tm50-e00145--tm50-s00339---shared/47/f%2f/fshared/flogs/fapplication.log-20100830.gz
>  from attrib file so calculating manually
>  > 
>  > Would it be possible for jLib to fix that, so it doesn't happen
>  > again on subsequent runs? 
>  
> It's been a while since I wrote the program... but I think that
> not being able to read the size is a true error case and I would
> wonder why the attrib file is not including the filesize entry. As
> far as I recall, every file backed up should be listed in the
> attrib file and the size is one of the basic features that should
> always be recorded.

Yeah, these backups are broken somehow; see above.

> Are your attrib files corrupted?

I don't know?  What should they look like?

> Can you look at the attrib file and see what might be wrong and/or
> different about that file?

/me finds BackupPC_attribPrint :)

I'm afraid it looks like a bug in your code.  :(

Example:

  Can't read size of 
/backups/pc/customer--tm50-e00145--tm50-s00339---shared/47/f%2f/fshared/fbubblevision/freports/fproduct_sales/fproduct_sales_2010-04-05_2334.zip
 from attrib file so calculating manually

Attrib file:

  $ ls -l 
/backups/pc/customer--tm50-e00145--tm50-s00339---shared/47/f%2f/fshared/fbubblevision/freports/fproduct_sales/attrib
  -rw-r----- 12 backuppc backuppc 86 Oct 12 18:04 
/backups/pc/customer--tm50-e00145--tm50-s00339---shared/47/f%2f/fshared/fbubblevision/freports/fproduct_sales/attrib

Contents thereof:

  $ sudo -u backuppc BackupPC_attribPrint 
/backups/pc/customer--tm50-e00145--tm50-s00339---shared/47/f%2f/fshared/fbubblevision/freports/fproduct_sales/attrib
  $VAR1 = {
    'product_sales_2010-04-05_2333.zip' => {
      'uid' => 1000,
      'mtime' => 1270535656,
      'mode' => 33188,
      'size' => 3527103,
      'sizeDiv4GB' => 0,
      'type' => 0,
      'gid' => 415,
      'sizeMod4GB' => 3527103
    },
    'product_sales_2010-04-05_2330.zip' => {
      'uid' => 1000,
      'mtime' => 1270535436,
      'mode' => 33188,
      'size' => 3527103,
      'sizeDiv4GB' => 0,
      'type' => 0,
      'gid' => 415,
      'sizeMod4GB' => 3527103
    },
    'product_sales_2010-04-05_2325.zip' => {
      'uid' => 1000,
      'mtime' => 1270535162,
      'mode' => 33188,
      'size' => 3527103,
      'sizeDiv4GB' => 0,
      'type' => 0,
      'gid' => 415,
      'sizeMod4GB' => 3527103
    },
    'product_sales_2010-04-05_2334.zip' => {
      'uid' => 1000,
      'mtime' => 1270535712,
      'mode' => 33188,
      'size' => 3527103,
      'sizeDiv4GB' => 0,
      'type' => 0,
      'gid' => 415,
      'sizeMod4GB' => 3527103
    }
  };

As you can see, fproduct_sales_2010-04-05_2334.zip *does* have an
associated size.

As a random side comment, it's amazing how much interesting stuff
I'm finding.  :)  I wonder if our BackupPC install is now the
largest in the world; just under 25 TiB across 5 hosts and thousands
of clients.  I suspect I'm hitting so much stuff because no-one has
tried to productionalize it at this scale before.

-Robin

-- 
http://singinst.org/ :  Our last, best hope for a fantastic future.
Lojban (http://www.lojban.org/): The language in which "this parrot
is dead" is "ti poi spitaki cu morsi", but "this sentence is false"
is "na nei".   My personal page: http://www.digitalkingdom.org/rlp/

------------------------------------------------------------------------------
What happens now with your Lotus Notes apps - do you make another costly 
upgrade, or settle for being marooned without product support? Time to move
off Lotus Notes and onto the cloud with Force.com, apps are easier to build,
use, and manage than apps on traditional platforms. Sign up for the Lotus 
Notes Migration Kit to learn more. http://p.sf.net/sfu/salesforce-d2d
_______________________________________________
BackupPC-users mailing list
BackupPC-users AT lists.sourceforge DOT net
List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:    http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

<Prev in Thread] Current Thread [Next in Thread>