Amanda-Users

RE: Questions about bumpsize, frustration

2002-08-23 16:37:48
Subject: RE: Questions about bumpsize, frustration
From: Frank Smith <fsmith AT hoovers DOT com>
To: "Brashers, Bart -- MFG, Inc." <Bart.Brashers AT mfgenv DOT com>, "Amanda Users (E-mail)" <amanda-users AT amanda DOT org>
Date: Fri, 23 Aug 2002 15:15:59 -0500
It looks like you have it set up correctly.  Sendsize is just reporting
what tar returns, and the problem is that for some reason a tar of that
directory to /dev/null is 15GB no matter what level is used (although
your level 0 is about 10k bigger).
  Do the /var/amanda/gnutar-lists/beowulf_home_proj_bp-9725* files have
current dates?  The only thing I can think of is that those files can't
be updated for some reason so everything was last backed up more than
a dumpcycle ago.
  Maybe others on the list have more ideas?

Frank

--On Friday, August 23, 2002 13:11:04 -0600 "Brashers, Bart -- MFG, Inc." 
<Bart.Brashers AT mfgenv DOT com> wrote:


Thanks for your responses, here is a combined answer:

Is it possible that it needs an update to dump?

I use tar (GNU tar) 1.13.19, not dump.

Is this happening on all of your machines or just a few?

I'm running amanda on the head node of my cluster, so all the disks are
local.  I only back up 1 of my slave nodes (since the others are identical)
and then only parts (/var/log, /usr/spool/PBS, etc.).  The problem only
happens on this one machine (itself), but there's not much on any other
machine to back up.

What version of AMANDA?

Version is amanda-2.4.2p2.

Do you set record to yes in your dumptype?

Yes, I use "record yes".

What's the output of `amadmin <config> disklist beow /home/proj/bp-9725`?

line 49:
    host beowulf:
        interface default
    disk /home/proj/bp-9725:
        program "GNUTAR"
        exclude list "/usr/local/lib/amanda/exclude.gtar"
        priority 1
        dumpcycle 14
        maxdumps 1
        strategy STANDARD
        compress NONE
        auth BSD
        kencrypt NO
        holdingdisk YES
        record YES
        index YES
        skip-incr NO
        skip-full NO

What does the /tmp/amanda/sendsize.debug file on beow look like?

From last night's, 8/22:

-------------
calculating for amname '/home/proj/bp-9725', dirname '/home/proj/bp-9725'
sendsize: getting size via gnutar for /home/proj/bp-9725 level 0
sendsize: missing exclude list file "/usr/local/lib/amanda/exclude.gtar"
discarded
sendsize: spawning /usr/libexec/runtar in pipeline
sendsize: argument list: /bin/gtar --create --file /dev/null --directory
/home/proj/bp-9725 --one-file-system --listed
-incremental /var/amanda/gnutar-lists/beowulf_home_proj_bp-9725_0.new
--sparse --ignore-failed-read --totals .
Total bytes written: 15848878080 (15GB, 15GB/s)
.....
sendsize: getting size via gnutar for /home/proj/bp-9725 level 4
sendsize: missing exclude list file "/usr/local/lib/amanda/exclude.gtar"
discarded
sendsize: spawning /usr/libexec/runtar in pipeline
sendsize: argument list: /bin/gtar --create --file /dev/null --directory
/home/proj/bp-9725 --one-file-system --listed
-incremental /var/amanda/gnutar-lists/beowulf_home_proj_bp-9725_4.new
--sparse --ignore-failed-read --totals .
Total bytes written: 15848867840 (15GB, ?B/s)
.....
sendsize: getting size via gnutar for /home/proj/bp-9725 level 5
sendsize: missing exclude list file "/usr/local/lib/amanda/exclude.gtar"
discarded
sendsize: spawning /usr/libexec/runtar in pipeline
sendsize: argument list: /bin/gtar --create --file /dev/null --directory
/home/proj/bp-9725 --one-file-system --listed
-incremental /var/amanda/gnutar-lists/beowulf_home_proj_bp-9725_5.new
--sparse --ignore-failed-read --totals .
Total bytes written: 15848867840 (15GB, ?B/s)
-----------------

So yes, each of level 0, 4 and 5 return about the same size from sendsize.
There was about 680M changed last night, so maybe I should look at 8/20
instead.  It's just about the same story.  The oldest surviving
sendsize.debug is from 8/19.  Is there some place I can change a setting to
keep more of these temp files?  I can't find it in amanda.conf.

[root amanda/Daily]% \ls -1
/var/amanda/gnutar-lists/beowulf_home_proj_bp-9725*
/var/amanda/gnutar-lists/beowulf_home_proj_bp-9725_0
/var/amanda/gnutar-lists/beowulf_home_proj_bp-9725_1
/var/amanda/gnutar-lists/beowulf_home_proj_bp-9725_2
/var/amanda/gnutar-lists/beowulf_home_proj_bp-9725_3
/var/amanda/gnutar-lists/beowulf_home_proj_bp-9725_4

[root amanda/Daily]% head
/var/amanda/gnutar-lists/beowulf_home_proj_bp-9725_4
1029991548
2081 19611660 ./contemp.cpuf/post
2081 19611665 ./contemp.cpuf/vis/plots
2081 20004866 ./calpuff/calmet
2081 19988482 ./calpuff
2081 19529746 ./calpuff/bc.post
2081 19939332 ./calpuff/calmet/upa
2081 16367618 ./calpuff/dep.con
2081 19955715 ./calpuff/calmet/sfc
2081 20135938 ./contemp.cpuf
[root amanda/Daily]% head
/var/amanda/gnutar-lists/beowulf_home_proj_bp-9725_3
1029509897
2081 19611660 ./contemp.cpuf/post
2081 19611665 ./contemp.cpuf/vis/plots
2081 20004866 ./calpuff/calmet
2081 19988482 ./calpuff
2081 19529746 ./calpuff/bc.post
2081 19939332 ./calpuff/calmet/upa
2081 16367618 ./calpuff/dep.con
2081 19955715 ./calpuff/calmet/sfc
2081 20135938 ./contemp.cpuf
[root amanda/Daily]% head
/var/amanda/gnutar-lists/beowulf_home_proj_bp-9725_2
1029428874
2081 19611660 ./contemp.cpuf/post
2081 19611665 ./contemp.cpuf/vis/plots
2081 20004866 ./calpuff/calmet
2081 19988482 ./calpuff
2081 19529746 ./calpuff/bc.post
2081 19939332 ./calpuff/calmet/upa
2081 16367618 ./calpuff/dep.con
2081 19955715 ./calpuff/calmet/sfc
2081 20135938 ./contemp.cpuf
[root amanda/Daily]% head
/var/amanda/gnutar-lists/beowulf_home_proj_bp-9725_1
1029343540
2081 19611660 ./contemp.cpuf/post
2081 19611665 ./contemp.cpuf/vis/plots
2081 20004866 ./calpuff/calmet
2081 19988482 ./calpuff
2081 19529746 ./calpuff/bc.post
2081 19939332 ./calpuff/calmet/upa
2081 16367618 ./calpuff/dep.con
2081 19955715 ./calpuff/calmet/sfc
2081 20135938 ./contemp.cpuf

This just tells me amanda has always been confused, through all the levels
of backup.

Hopefully, something in the above sticks out like a sore thumb, and a
lightbulb will go off above someone's head.  I sure don't see why sendsize
is so wrong.

Bart
---
Bart Brashers                           MFG Inc.
Air Quality Meteorologist               19203 36th Ave W Suite 101
bart.brashers AT mfgenv DOT com            Lynnwood WA 98036-5707
http://www.mfgenv.com                   425.921.4000 Fax: 425.921.4040



--
Frank Smith                                                fsmith AT hoovers 
DOT com
Systems Administrator                                     Voice: 512-374-4673
Hoover's Online                                             Fax: 512-374-4501