Amanda-Users

Re: backup lasts forever on large fs (fwd)

2003-11-14 13:16:47
Subject: Re: backup lasts forever on large fs (fwd)
From: Zoltan Kato <kato AT inf.u-szeged DOT hu>
To: amanda-users AT amanda DOT org
Date: Fri, 14 Nov 2003 19:15:07 +0100 (MET)
/home is not NFS mounted and the directories are not transient (they are
the actual home dirs of individual users). runtar is seduid root. I tryed
to run the gtar command from the log file manually as root, and found that
it ONLY works when I run it from /home:

root@rozi$ cd /home/
root@rozi$ /opt/sfw/bin/gtar --create --file /dev/null --directory /home
--one-file-system --listed-incremental
/usr/local/var/amanda/gnutar-lists/rozi.cab.u-szeged.hu_home_h0_0.new
--sparse --ignore-failed-read --totals --files-from
/tmp/amanda/sendsize._home__h0.20031113235902.include 2>&1|less


But then how is it possible that sendsize (or whatever other program) can
collect the filenames in
/tmp/amanda/sendsize._home__h0.20031113235902.include but gtar fails
unless started from /home (note that the --directory /home is present on
the command line which should cd to /home....). Any idea? How should I
specify the include/exclude directives in the disklist entries?

Regards,

Zoltan
__________________________________________________________________

http://www.inf.u-szeged.hu/~kato/  -- research in computer vision
http://www.cameradigita.com/       -- photography (online gallery)
__________________________________________________________________

On Fri, 14 Nov 2003, Paul Bijnens wrote:

> Zoltan Kato wrote:
>
> > Still doesn't work. I've split the /home partition into several pieces as
> > recommended in an earlier message (my disklist entries are included at
> > the end). Since I havent' received the usual email report from amanda
> > (why??), I went to /tmp/amanda to see the logs. It looks like sendsize
> > is run with non-root privileges hence it cannot stat/read individual
> > home directories (quite normal as they are restricted to the owner). This
> > is what I found:
> >
> > sendsize: debug 1 pid 5628 ruid 103 euid 103: start at Thu Nov 13 23:59:01
> > 2003
> ...
> > sendsize[5630]: time 0.041: getting size via gnutar for /etc level 0
> ...
> > sendsize[5630]: estimate time for /etc level 0: 0.897
> > sendsize[5630]: estimate size for /etc level 0: 3650 KB
>
> estimate for level 0 for /etc succeeded fine in less then a second.
>
> ...
> > sendsize[5630]: estimate time for /etc level 1: 0.050
> > sendsize[5630]: estimate size for /etc level 1: 120 KB
>
> the same for level 1 even faster.
>
> Next amanda tries /home_h0:
>
> ...
> > sendsize[5633]: time 1.051: calculating for amname '/home_h0', dirname
> > '/home', spindle -1
> > sendsize[5633]: time 1.051: getting size via gnutar for /home_h0 level 0
>
> The runtar is the program that needs to be suid-root.  Verify this
> please.  /home isn't an nfs-mount by accident?  On a normal nfs-mounted
> directory, root on the cleint becomes "nobody" on the server.
> You have to specify special mount options on the nfs-server to get
> root==root.  See the "no_root_squash"  option in the exports file.
>
>
> > sendsize[5633]: time 1.139: spawning /usr/local/libexec/runtar in pipeline
> > sendsize[5633]: argument list: /opt/sfw/bin/gtar --create --file /dev/null
> > --directory /home --one-file-system --listed-incremental
> > /usr/local/var/amanda/gnutar-lists/rozi.cab.u-szeged.hu_home_h0_0.new
> > --sparse --ignore-failed-read --totals --files-from
> > /tmp/amanda/sendsize._home__h0.20031113235902.include
>
> Try to execute the above command line interactively, as root.
> Does that work?
>
> > sendsize[5633]: time 1.172: /opt/sfw/bin/gtar: Cannot stat ./h0: No such
> > file or directory
> > sendsize[5633]: time 1.172: /opt/sfw/bin/gtar: Cannot stat ./h000001: No
> > such file or directory
> > sendsize[5633]: time 1.173: /opt/sfw/bin/gtar: Cannot stat ./h000002: No
> > such file or directory
> > sendsize[5633]: time 1.174: /opt/sfw/bin/gtar: Cannot stat ./h030000: No
> > such file or directory
> > sendsize[5633]: time 1.174: /opt/sfw/bin/gtar: Cannot stat ./h039963: No
> > such file or directory
> > sendsize[5633]: time 1.175: /opt/sfw/bin/gtar: Cannot stat ./h039966: No
> > such file or directory
> >
> > ....... (similar messages repeated) .....
>
> Do these directories/files actually exist?  Or are they shortlived,
> and between the time amanda expanded the "./h[0]*" in the file
> /tmp/amanda/sendsize._home__h0.20031113235902.include and the time
> that gtar was started.   It's only a second (1.172 sec to be precise),
> but these days computers can get really fast.
>
> Also the message is "No such file or directory" instead of "Permission
> denied".  Usually I believe those error messages in Unix.
>
>
> ...
> > My disklist:
> >
> > rozi.cab.u-szeged.hu    /etc            root-tar
> > rozi.cab.u-szeged.hu    /home_h0        /home   { # h0*
> >         user-tar
> >         include "./h[0]*"
> > }
> ...
> > rozi.cab.u-szeged.hu    /home_rest      /home   { # the rest
> >         user-tar
> >         exclude "./h[0-9]*"
> > }
>
>
> --
> Paul Bijnens, Xplanation                            Tel  +32 16 397.511
> Technologielaan 21 bus 2, B-3001 Leuven, BELGIUM    Fax  +32 16 397.512
> http://www.xplanation.com/          email:  Paul.Bijnens AT xplanation DOT com
> ***********************************************************************
> * I think I've got the hang of it now:  exit, ^D, ^C, ^\, ^Z, ^Q, F6, *
> * quit,  ZZ, :q, :q!,  M-Z, ^X^C,  logoff, logout, close, bye,  /bye, *
> * stop, end, F3, ~., ^]c, +++ ATH, disconnect, halt,  abort,  hangup, *
> * PF4, F20, ^X^X, :D::D, KJOB, F14-f-e, F8-e,  kill -1 $$,  shutdown, *
> * kill -9 1,  Alt-F4,  Ctrl-Alt-Del,  AltGr-NumLock,  Stop-A,  ...    *
> * ...  "Are you sure?"  ...   YES   ...   Phew ...   I'm out          *
> ***********************************************************************
>
>