Amanda-Users

Re: backup lasts forever on large fs (fwd)

2003-11-14 11:51:13
Subject: Re: backup lasts forever on large fs (fwd)
From: Paul Bijnens <paul.bijnens AT xplanation DOT com>
To: Zoltan Kato <kato AT inf.u-szeged DOT hu>
Date: Fri, 14 Nov 2003 17:49:38 +0100
Zoltan Kato wrote:

Still doesn't work. I've split the /home partition into several pieces as
recommended in an earlier message (my disklist entries are included at
the end). Since I havent' received the usual email report from amanda
(why??), I went to /tmp/amanda to see the logs. It looks like sendsize
is run with non-root privileges hence it cannot stat/read individual
home directories (quite normal as they are restricted to the owner). This
is what I found:

sendsize: debug 1 pid 5628 ruid 103 euid 103: start at Thu Nov 13 23:59:01
2003
...
sendsize[5630]: time 0.041: getting size via gnutar for /etc level 0
...
sendsize[5630]: estimate time for /etc level 0: 0.897
sendsize[5630]: estimate size for /etc level 0: 3650 KB

estimate for level 0 for /etc succeeded fine in less then a second.

...
sendsize[5630]: estimate time for /etc level 1: 0.050
sendsize[5630]: estimate size for /etc level 1: 120 KB

the same for level 1 even faster.

Next amanda tries /home_h0:

...
sendsize[5633]: time 1.051: calculating for amname '/home_h0', dirname
'/home', spindle -1
sendsize[5633]: time 1.051: getting size via gnutar for /home_h0 level 0

The runtar is the program that needs to be suid-root.  Verify this
please.  /home isn't an nfs-mount by accident?  On a normal nfs-mounted
directory, root on the cleint becomes "nobody" on the server.
You have to specify special mount options on the nfs-server to get
root==root.  See the "no_root_squash"  option in the exports file.


sendsize[5633]: time 1.139: spawning /usr/local/libexec/runtar in pipeline
sendsize[5633]: argument list: /opt/sfw/bin/gtar --create --file /dev/null
--directory /home --one-file-system --listed-incremental
/usr/local/var/amanda/gnutar-lists/rozi.cab.u-szeged.hu_home_h0_0.new
--sparse --ignore-failed-read --totals --files-from
/tmp/amanda/sendsize._home__h0.20031113235902.include

Try to execute the above command line interactively, as root.
Does that work?

sendsize[5633]: time 1.172: /opt/sfw/bin/gtar: Cannot stat ./h0: No such
file or directory
sendsize[5633]: time 1.172: /opt/sfw/bin/gtar: Cannot stat ./h000001: No
such file or directory
sendsize[5633]: time 1.173: /opt/sfw/bin/gtar: Cannot stat ./h000002: No
such file or directory
sendsize[5633]: time 1.174: /opt/sfw/bin/gtar: Cannot stat ./h030000: No
such file or directory
sendsize[5633]: time 1.174: /opt/sfw/bin/gtar: Cannot stat ./h039963: No
such file or directory
sendsize[5633]: time 1.175: /opt/sfw/bin/gtar: Cannot stat ./h039966: No
such file or directory

....... (similar messages repeated) .....

Do these directories/files actually exist?  Or are they shortlived,
and between the time amanda expanded the "./h[0]*" in the file
/tmp/amanda/sendsize._home__h0.20031113235902.include and the time
that gtar was started.   It's only a second (1.172 sec to be precise),
but these days computers can get really fast.

Also the message is "No such file or directory" instead of "Permission denied". Usually I believe those error messages in Unix.


...
My disklist:

rozi.cab.u-szeged.hu    /etc            root-tar
rozi.cab.u-szeged.hu    /home_h0        /home   { # h0*
        user-tar
        include "./h[0]*"
}
...
rozi.cab.u-szeged.hu    /home_rest      /home   { # the rest
        user-tar
        exclude "./h[0-9]*"
}


--
Paul Bijnens, Xplanation                            Tel  +32 16 397.511
Technologielaan 21 bus 2, B-3001 Leuven, BELGIUM    Fax  +32 16 397.512
http://www.xplanation.com/          email:  Paul.Bijnens AT xplanation DOT com
***********************************************************************
* I think I've got the hang of it now:  exit, ^D, ^C, ^\, ^Z, ^Q, F6, *
* quit,  ZZ, :q, :q!,  M-Z, ^X^C,  logoff, logout, close, bye,  /bye, *
* stop, end, F3, ~., ^]c, +++ ATH, disconnect, halt,  abort,  hangup, *
* PF4, F20, ^X^X, :D::D, KJOB, F14-f-e, F8-e,  kill -1 $$,  shutdown, *
* kill -9 1,  Alt-F4,  Ctrl-Alt-Del,  AltGr-NumLock,  Stop-A,  ...    *
* ...  "Are you sure?"  ...   YES   ...   Phew ...   I'm out          *
***********************************************************************