Amanda-Users

Re: Estimates taking a long time..

2006-05-26 14:01:01
Subject: Re: Estimates taking a long time..
From: Matt Ingram <mingram AT cbnco DOT com>
To: Paddy Sreenivasan <paddy AT zmanda DOT com>
Date: Fri, 26 May 2006 13:56:02 -0400
here's the send sizesize log. To me it appears that it is just taking that long to create the tar..... ???

thanks for your response :).

sendsize: debug 1 pid 3316 ruid 37 euid 37: start at Fri May 26 00:25:00 2006
sendsize: version 2.4.4
sendsize[3318]: time 0.299: calculating for amname '/home', dirname '/home', spindle -1
sendsize[3318]: time 0.299: getting size via gnutar for /home level 0
sendsize[3318]: time 0.300: spawning /usr/lib/amanda/runtar in pipeline
sendsize[3318]: argument list: /bin/tar --create --file /dev/null --directory /home --one-file-system --listed-incremental /var/lib/amanda/gnutar-lists/serverx_home_0.new --sparse --ignore-failed-read --totals .
sendsize[3316]: time 0.306: waiting for any estimate child
sendsize[3318]: time 17017.517: Total bytes written: 213846538240 (199GB, 12MB/s)
sendsize[3318]: time 17017.521: .....
sendsize[3318]: estimate time for /home level 0: 17017.221
sendsize[3318]: estimate size for /home level 0: 208834510 KB
sendsize[3318]: time 17017.522: waiting for /bin/tar "/home" child
sendsize[3318]: time 17017.819: after /bin/tar "/home" wait
sendsize[3318]: time 17017.831: getting size via gnutar for /home level 1
sendsize[3318]: time 17018.031: spawning /usr/lib/amanda/runtar in pipeline
sendsize[3318]: argument list: /bin/tar --create --file /dev/null --directory /home --one-file-system --listed-incremental /var/lib/amanda/gnutar-lists/serverx_home_1.new --sparse --ignore-failed-read --totals . sendsize[3318]: time 18856.318: Total bytes written: 29571840000 (27GB, 15MB/s)
sendsize[3318]: time 18856.334: .....
sendsize[3318]: estimate time for /home level 1: 1838.302
sendsize[3318]: estimate size for /home level 1: 28878750 KB
sendsize[3318]: time 18856.334: waiting for /bin/tar "/home" child
sendsize[3318]: time 18857.224: after /bin/tar "/home" wait
sendsize[3318]: time 18857.240: done with amname '/home', dirname '/home', spindle -1
sendsize[3316]: time 18857.241: child 3318 terminated normally
sendsize[4471]: time 18857.241: calculating for amname '/etc', dirname '/etc', spindle -1
sendsize[4471]: time 18857.241: getting size via gnutar for /etc level 0
sendsize[3316]: time 18857.241: waiting for any estimate child
sendsize[4471]: time 18857.285: spawning /usr/lib/amanda/runtar in pipeline
sendsize[4471]: argument list: /bin/tar --create --file /dev/null --directory /etc --one-file-system --listed-incremental /var/lib/amanda/gnutar-lists/fileserverx_etc_0.new --sparse --ignore-failed-read --totals --exclude-from /tmp/amanda/sendsize._etc.20060526053918.exclude .
sendsize[4471]: time 18859.249: Total bytes written: 42844160 (41MB, 21MB/s)
sendsize[4471]: time 18859.250: .....
sendsize[4471]: estimate time for /etc level 0: 1.965
sendsize[4471]: estimate size for /etc level 0: 41840 KB
sendsize[4471]: time 18859.250: waiting for /bin/tar "/etc" child
sendsize[4471]: time 18859.250: after /bin/tar "/etc" wait
sendsize[4471]: time 18859.251: getting size via gnutar for /etc level 1
sendsize[4471]: time 18859.270: spawning /usr/lib/amanda/runtar in pipeline
sendsize[4471]: argument list: /bin/tar --create --file /dev/null --directory /etc --one-file-system --listed-incremental /var/lib/amanda/gnutar-lists/fileserverx_etc_1.new --sparse --ignore-failed-read --totals --exclude-from /tmp/amanda/sendsize._etc.20060526053920.exclude . sendsize[4471]: time 18860.056: Total bytes written: 2027520 (1.9MB, 3.3MB/s)
sendsize[4471]: time 18860.057: .....
sendsize[4471]: estimate time for /etc level 1: 0.787
sendsize[4471]: estimate size for /etc level 1: 1980 KB
sendsize[4471]: time 18860.057: waiting for /bin/tar "/etc" child
sendsize[4471]: time 18860.058: after /bin/tar "/etc" wait
sendsize[4471]: time 18860.058: done with amname '/etc', dirname '/etc', spindle -1
sendsize[3316]: time 18860.058: child 4471 terminated normally
sendsize: time 18860.058: pid 3316 finish time Fri May 26 05:39:20 2006

Paddy Sreenivasan wrote:
On 5/26/06, Matt Ingram <mingram AT cbnco DOT com> wrote:
One of our amanda clients takes an incredibly long time to do estimates
(17000seconds on a level 0, which is about 210GB), and causes the server
to return a estimate timeout error.  Seems to be mainly when it tries to
do a level 0 backup.  the server that takes this amount of time is
accessed through a firewall.

Check the /tmp/amanda/sendsize* logs for any reasons why it is taking too long.
You can try running the tar (I'm assuming that you are using tar not
dump) command
manually.


Is that a typical amount of time, or is something taking WAY too long?
Should I just increase the etimeout in amanda.conf to facilitate the
17000 seconds ?

You could also change "estimate" value to "calcsize" or "server" for
faster estimates (estimates will be less accurate).

See http://wiki.zmanda.com/index.php/Amdump:_results_missing#Timeout_during_estimate.3F
for more information.

Thanks,
Paddy


running amanda-2.4.4-41
tar-1.13.25-97
on SuSE

--
Matt Ingram
Intermediate Unix Administrator, IS
Canadian Bank Note Company, Limited
\m/







--
Matt Ingram
Intermediate Unix Administrator, IS
Canadian Bank Note Company, Limited
\m/

Attachment: smime.p7s
Description: S/MIME Cryptographic Signature

<Prev in Thread] Current Thread [Next in Thread>