Amanda-Users

Re: Problem with backup from 64bit Client

2005-09-19 08:23:33
Subject: Re: Problem with backup from 64bit Client
From: Matt Hyclak <hyclak AT math.ohiou DOT edu>
To: amanda-users AT amanda DOT org
Date: Mon, 19 Sep 2005 08:17:25 -0400
On Mon, Sep 19, 2005 at 01:58:58PM +0200, Sebastian Kösters enlightened us:
> Thanks!
> 
> Why do you think /var is my Problem?
> 
> And whats about /var/log/lastlog. Where do i have to exclude it?
> 
> Here is the right logfile:
> 
> sendsize.20050919010115.debug
> 
> sendsize: debug 1 pid 32207 ruid 33 euid 33: start at Mon Sep 19 01:01:15
> 2005
> sendsize: version 2.4.4p3
> sendsize[32209]: time 0.002: calculating for amname '/etc', dirname '/etc',
> spindle -1
> sendsize[32209]: time 0.002: getting size via gnutar for /etc level 0
> sendsize[32209]: time 0.003: spawning /usr/lib64/amanda/runtar in pipeline
> sendsize[32209]: argument list: /bin/tar --create --file /dev/null
> --directory /etc --one-file-system --listed-incremental
> /var/lib/amanda/gnutar-lists/check
> _etc_0.new --sparse --ignore-failed-read --totals .
> sendsize[32209]: time 0.023: Total bytes written: 6000640 (5.8MiB, ?/s)
> sendsize[32209]: time 0.024: .....
> sendsize[32209]: estimate time for /etc level 0: 0.020
> sendsize[32209]: estimate size for /etc level 0: 5860 KB
> sendsize[32209]: time 0.024: waiting for /bin/tar "/etc" child
> sendsize[32209]: time 0.024: after /bin/tar "/etc" wait
> sendsize[32209]: time 0.024: done with amname '/etc', dirname '/etc',
> spindle -1
> sendsize[32207]: time 0.024: waiting for any estimate child: 1 running
> sendsize[32207]: time 0.024: child 32209 terminated normally
> sendsize[32211]: time 0.024: calculating for amname '/daten', dirname
> '/daten', spindle -1
> sendsize[32211]: time 0.024: getting size via gnutar for /daten level 0
> sendsize[32211]: time 0.025: spawning /usr/lib64/amanda/runtar in pipeline
> sendsize[32211]: argument list: /bin/tar --create --file /dev/null
> --directory /daten --one-file-system --listed-incremental
> /var/lib/amanda/gnutar-lists/che
> ck_daten_0.new --sparse --ignore-failed-read --totals .
> sendsize[32211]: time 0.028: Total bytes written: 194560 (190KiB, ?/s)
> sendsize[32211]: time 0.028: .....
> sendsize[32211]: estimate time for /daten level 0: 0.003
> sendsize[32211]: estimate size for /daten level 0: 190 KB
> sendsize[32211]: time 0.028: waiting for /bin/tar "/daten" child
> sendsize[32211]: time 0.028: after /bin/tar "/daten" wait
> sendsize[32211]: time 0.028: done with amname '/daten', dirname '/daten',
> spindle -1
> sendsize[32207]: time 0.028: waiting for any estimate child: 1 running
> sendsize[32207]: time 0.028: child 32211 terminated normally
> sendsize[32213]: time 0.028: calculating for amname '/var', dirname '/var',
> spindle -1
> sendsize[32213]: time 0.028: getting size via gnutar for /var level 0
> sendsize[32213]: time 0.029: spawning /usr/lib64/amanda/runtar in pipeline
> sendsize[32213]: argument list: /bin/tar --create --file /dev/null
> --directory /var --one-file-system --listed-incremental
> /var/lib/amanda/gnutar-lists/check
> _var_0.new --sparse --ignore-failed-read --totals .
> sendsize[32207]: time 0.047: waiting for any estimate child: 1 running
> sendsize[32213]: time 0.364: /bin/tar: ./lib/mysql/mysql.sock: socket
> ignored
> sendsize[32213]: time 5476.121: /bin/tar: ./run/acpid.socket: socket ignored
> sendsize[32213]: time 5476.154: /bin/tar: ./run/dbus/system_bus_socket:
> socket ignored
> sendsize[32213]: time 5480.203: Total bytes written: 1077657600 (1.1GiB,
> 193KiB/s)
> sendsize[32213]: time 5480.203: .....
> sendsize[32213]: estimate time for /var level 0: 5480.174
> sendsize[32213]: estimate size for /var level 0: 1052400 KB
> sendsize[32213]: time 5480.203: waiting for /bin/tar "/var" child
> sendsize[32213]: time 5480.204: after /bin/tar "/var" wait
> sendsize[32213]: time 5480.300: done with amname '/var', dirname '/var',
> spindle -1
> sendsize[32207]: time 5480.300: child 32213 terminated normally
> sendsize[32221]: time 5480.300: calculating for amname '/opt', dirname
> '/opt', spindle -1
> sendsize[32221]: time 5480.301: getting size via gnutar for /opt level 0
> sendsize[32207]: time 5480.301: waiting for any estimate child: 1 running
> sendsize[32221]: time 5480.330: spawning /usr/lib64/amanda/runtar in
> pipeline
> sendsize[32221]: argument list: /bin/tar --create --file /dev/null
> --directory /opt --one-file-system --listed-incremental
> /var/lib/amanda/gnutar-lists/check
> _opt_0.new --sparse --ignore-failed-read --totals .
> sendsize[32221]: time 5481.001: Total bytes written: 13332480 (13MiB, ?/s)
> sendsize[32221]: time 5481.002: .....
> sendsize[32221]: estimate time for /opt level 0: 0.671
> sendsize[32221]: estimate size for /opt level 0: 13020 KB
> sendsize[32221]: time 5481.002: waiting for /bin/tar "/opt" child
> sendsize[32221]: time 5481.002: after /bin/tar "/opt" wait
> sendsize[32221]: time 5481.002: done with amname '/opt', dirname '/opt',
> spindle -1
> sendsize[32207]: time 5481.002: child 32221 terminated normally
> sendsize[32223]: time 5481.002: calculating for amname '/home', dirname
> '/home', spindle -1
> sendsize[32223]: time 5481.002: getting size via gnutar for /home level 0
> sendsize[32223]: time 5481.002: spawning /usr/lib64/amanda/runtar in
> pipeline
> sendsize[32223]: argument list: /bin/tar --create --file /dev/null
> --directory /home --one-file-system --listed-incremental
> /var/lib/amanda/gnutar-lists/chec
> k_home_0.new --sparse --ignore-failed-read --totals .
> sendsize[32207]: time 5481.005: waiting for any estimate child: 1 running
> sendsize[32223]: time 5481.211: Total bytes written: 296960 (290KiB, ?/s)
> sendsize[32223]: time 5481.211: .....
> sendsize[32223]: estimate time for /home level 0: 0.208
> sendsize[32223]: estimate size for /home level 0: 290 KB
> sendsize[32223]: time 5481.211: waiting for /bin/tar "/home" child
> sendsize[32223]: time 5481.211: after /bin/tar "/home" wait
> sendsize[32223]: time 5481.211: done with amname '/home', dirname '/home',
> spindle -1
> sendsize[32207]: time 5481.212: child 32223 terminated normally
> sendsize: time 5481.212: pid 32207 finish time Mon Sep 19 02:32:36 2005
> 
> for me everything seems to be ok?!
>

Check the etimeout parameter in your amanda.conf. IIRC the default is 300
seconds. Amanda multiplies that by the number of disklist entries (DLEs)
that you have per host, in your case 5, allowing for 1500 seconds for
estimates to finish. It might be 600, in which case it would be 3000
seconds, but regardless yours take almost 5500 seconds to complete. 

You should:

1. Figure out why /var takes so long to estimate. You can see what commands
   are being run, you might try running them by hand and seeing if you can
   pinpoint which subdirectories are taking so long. On RHEL 4, lastlog is a
   sparse file that happens to be 1.2TB (yes, TB) and so tar can take
   FOREVER on it. I don't think RHEL3 had the same problem, and judging from
   your kernel version, that's what you're using.

2. Increase etimeout in your amanda.conf to something more like 1200 seconds.

3. If you're interested, grab the latest SRPMs from my webpage and update to
   the latest release. http://www.math.ohiou.edu/~hyclak/casit/amanda

Matt   

-- 
Matt Hyclak
Department of Mathematics 
Department of Social Work
Ohio University
(740) 593-1263

<Prev in Thread] Current Thread [Next in Thread>