Amanda-Users

estimate timeout

2005-10-10 03:41:55
Subject: estimate timeout
From: Shai Ayal <shaia AT biocontrol.co DOT il>
To: amanda-users AT amanda DOT org
Date: Mon, 10 Oct 2005 09:20:55 +0200
Hi all,

I have searched the archives but none of the emails with similar subjects helped me.

I have a FC2 amanda 2.4.4 server with 2 linux clients. The server is using vtapes for daily backups. It all ran very nicely for many months until we ran out of disk space in the server. After a few days of bad backups due to full disk, we installed an additional disk, moved some of the virtual tapes to it using symlinks, flushed the old backups etc... and sat back to enjoy amanda at work.

However:

While one client is being backed up perfectly well, the other keeps getting estimates timeout. On this client, everything seem ok except for showing 2 amandad processes during estimates, one of them defunct -- I attach the 2 amandad debug reports.

On the server I have set an etimeout of 300 which should be enough, but even bumping this to 7200 did not help.

I have no firewall on client and server

tar version is tar (GNU tar) 1.13.25 o the client

This is really frustrating since this setup used to work !

Thanks in advance
Shai

amandad: debug 1 pid 25071 ruid 33 euid 33: start at Mon Oct 10 08:38:58 2005
amandad: version 2.4.4p2
amandad: build: VERSION="Amanda-2.4.4p2"
amandad:        BUILT_DATE="Mon Mar 22 12:27:54 EST 2004"
amandad:        BUILT_MACH="Linux bugs.devel.redhat.com 2.4.21-9.ELsmp #1 SMP 
Thu Jan 8 17:08:56 EST 2004 i686 i686 i386 GNU/Linux"
amandad:        CC="i386-redhat-linux-gcc"
amandad:        CONFIGURE_COMMAND="'./configure' '--host=i386-redhat-linux' 
'--build=i386-redhat-linux' '--target=i386-redhat-linux-gnu' 
'--program-prefix=' '--prefix=/usr' '--exec-prefix=/usr' '--bindir=/usr/bin' 
'--sbindir=/usr/sbin' '--sysconfdir=/etc' '--datadir=/usr/share' 
'--includedir=/usr/include' '--libdir=/usr/lib' '--libexecdir=/usr/lib/amanda' 
'--localstatedir=/var/lib' '--sharedstatedir=/usr/com' 
'--mandir=/usr/share/man' '--infodir=/usr/share/info' '--enable-shared' 
'--with-index-server=localhost' 
'--with-gnutar-listdir=/var/lib/amanda/gnutar-lists' 
'--with-smbclient=/usr/bin/smbclient' '--with-amandahosts' '--with-user=amanda' 
'--with-group=disk' '--with-tmpdir=/var/log/amanda' '--with-gnutar=/bin/tar'"
amandad: paths: bindir="/usr/bin" sbindir="/usr/sbin"
amandad:        libexecdir="/usr/lib/amanda" mandir="/usr/share/man"
amandad:        AMANDA_TMPDIR="/var/log/amanda"
amandad:        AMANDA_DBGDIR="/var/log/amanda" CONFIG_DIR="/etc/amanda"
amandad:        DEV_PREFIX="/dev/" RDEV_PREFIX="/dev/r"
amandad:        DUMP="/sbin/dump" RESTORE="/sbin/restore" VDUMP=UNDEF
amandad:        VRESTORE=UNDEF XFSDUMP=UNDEF XFSRESTORE=UNDEF VXDUMP=UNDEF
amandad:        VXRESTORE=UNDEF SAMBA_CLIENT="/usr/bin/smbclient"
amandad:        GNUTAR="/bin/tar" COMPRESS_PATH="/usr/bin/gzip"
amandad:        UNCOMPRESS_PATH="/usr/bin/gzip" LPRCMD="/usr/bin/lpr"
amandad:        MAILER="/usr/bin/Mail"
amandad:        listed_incr_dir="/var/lib/amanda/gnutar-lists"
amandad: defs:  DEFAULT_SERVER="localhost" DEFAULT_CONFIG="DailySet1"
amandad:        DEFAULT_TAPE_SERVER="localhost"
amandad:        DEFAULT_TAPE_DEVICE="/dev/null" HAVE_MMAP HAVE_SYSVSHM
amandad:        LOCKING=POSIX_FCNTL SETPGRP_VOID DEBUG_CODE
amandad:        AMANDA_DEBUG_DAYS=4 BSD_SECURITY USE_AMANDAHOSTS
amandad:        CLIENT_LOGIN="amanda" FORCE_USERID HAVE_GZIP
amandad:        COMPRESS_SUFFIX=".gz" COMPRESS_FAST_OPT="--fast"
amandad:        COMPRESS_BEST_OPT="--best" UNCOMPRESS_OPT="-dc"
amandad: time 0.000: got packet:
--------
Amanda 2.4 REQ HANDLE 000-00443709 SEQ 1128926338
SECURITY USER amanda
SERVICE noop
OPTIONS features=fffffeff9ffe0f;
--------

amandad: time 0.000: sending ack:
----
Amanda 2.4 ACK HANDLE 000-00443709 SEQ 1128926338
----

amandad: time 0.000: bsd security: remote host betacentauri.bioc user amanda 
local user amanda
amandad: time 0.015: amandahosts security check passed
amandad: time 0.015: running service "noop"
amandad: time 0.015: sending REP packet:
----
Amanda 2.4 REP HANDLE 000-00443709 SEQ 1128926338
OPTIONS features=fffffeff9ffe0f;
----

amandad: time 0.015: got packet:
----
Amanda 2.4 ACK HANDLE 000-00443709 SEQ 1128926338
----

amandad: time 0.016: pid 25071 finish time Mon Oct 10 08:38:58 2005
amandad: debug 1 pid 25072 ruid 33 euid 33: start at Mon Oct 10 08:38:58 2005
amandad: version 2.4.4p2
amandad: build: VERSION="Amanda-2.4.4p2"
amandad:        BUILT_DATE="Mon Mar 22 12:27:54 EST 2004"
amandad:        BUILT_MACH="Linux bugs.devel.redhat.com 2.4.21-9.ELsmp #1 SMP 
Thu Jan 8 17:08:56 EST 2004 i686 i686 i386 GNU/Linux"
amandad:        CC="i386-redhat-linux-gcc"
amandad:        CONFIGURE_COMMAND="'./configure' '--host=i386-redhat-linux' 
'--build=i386-redhat-linux' '--target=i386-redhat-linux-gnu' 
'--program-prefix=' '--prefix=/usr' '--exec-prefix=/usr' '--bindir=/usr/bin' 
'--sbindir=/usr/sbin' '--sysconfdir=/etc' '--datadir=/usr/share' 
'--includedir=/usr/include' '--libdir=/usr/lib' '--libexecdir=/usr/lib/amanda' 
'--localstatedir=/var/lib' '--sharedstatedir=/usr/com' 
'--mandir=/usr/share/man' '--infodir=/usr/share/info' '--enable-shared' 
'--with-index-server=localhost' 
'--with-gnutar-listdir=/var/lib/amanda/gnutar-lists' 
'--with-smbclient=/usr/bin/smbclient' '--with-amandahosts' '--with-user=amanda' 
'--with-group=disk' '--with-tmpdir=/var/log/amanda' '--with-gnutar=/bin/tar'"
amandad: paths: bindir="/usr/bin" sbindir="/usr/sbin"
amandad:        libexecdir="/usr/lib/amanda" mandir="/usr/share/man"
amandad:        AMANDA_TMPDIR="/var/log/amanda"
amandad:        AMANDA_DBGDIR="/var/log/amanda" CONFIG_DIR="/etc/amanda"
amandad:        DEV_PREFIX="/dev/" RDEV_PREFIX="/dev/r"
amandad:        DUMP="/sbin/dump" RESTORE="/sbin/restore" VDUMP=UNDEF
amandad:        VRESTORE=UNDEF XFSDUMP=UNDEF XFSRESTORE=UNDEF VXDUMP=UNDEF
amandad:        VXRESTORE=UNDEF SAMBA_CLIENT="/usr/bin/smbclient"
amandad:        GNUTAR="/bin/tar" COMPRESS_PATH="/usr/bin/gzip"
amandad:        UNCOMPRESS_PATH="/usr/bin/gzip" LPRCMD="/usr/bin/lpr"
amandad:        MAILER="/usr/bin/Mail"
amandad:        listed_incr_dir="/var/lib/amanda/gnutar-lists"
amandad: defs:  DEFAULT_SERVER="localhost" DEFAULT_CONFIG="DailySet1"
amandad:        DEFAULT_TAPE_SERVER="localhost"
amandad:        DEFAULT_TAPE_DEVICE="/dev/null" HAVE_MMAP HAVE_SYSVSHM
amandad:        LOCKING=POSIX_FCNTL SETPGRP_VOID DEBUG_CODE
amandad:        AMANDA_DEBUG_DAYS=4 BSD_SECURITY USE_AMANDAHOSTS
amandad:        CLIENT_LOGIN="amanda" FORCE_USERID HAVE_GZIP
amandad:        COMPRESS_SUFFIX=".gz" COMPRESS_FAST_OPT="--fast"
amandad:        COMPRESS_BEST_OPT="--best" UNCOMPRESS_OPT="-dc"
amandad: time 0.000: got packet:
--------
Amanda 2.4 REQ HANDLE 000-40783709 SEQ 1128926341
SECURITY USER amanda
SERVICE sendsize
OPTIONS features=fffffeff9ffe0f;maxdumps=1;hostname=alphacentauri;
GNUTAR /boot 0 1970:1:1:0:0:0 -1 OPTIONS 
|;bsd-auth;compress-fast;index;exclude-list=/usr/lib/amanda/exclude.gtar;
GNUTAR /boot 1 2005:9:21:3:6:48 -1 OPTIONS 
|;bsd-auth;compress-fast;index;exclude-list=/usr/lib/amanda/exclude.gtar;
GNUTAR /etc 0 1970:1:1:0:0:0 -1 OPTIONS 
|;bsd-auth;compress-fast;index;exclude-list=/usr/lib/amanda/exclude.gtar;
GNUTAR /etc 1 2005:9:21:3:8:24 -1 OPTIONS 
|;bsd-auth;compress-fast;index;exclude-list=/usr/lib/amanda/exclude.gtar;
GNUTAR /Data/SNM/AnimalStudies/ATE_data/logs 0 1970:1:1:0:0:0 -1 OPTIONS 
|;bsd-auth;compress-fast;index;exclude-list=/usr/lib/amanda/exclude.gtar;
GNUTAR /Data/SNM/AnimalStudies/ATE_data/logs 1 2005:9:21:3:8:14 -1 OPTIONS 
|;bsd-auth;compress-fast;index;exclude-list=/usr/lib/amanda/exclude.gtar;
GNUTAR /Data/SNM/AnimalStudies/Rambam 0 1970:1:1:0:0:0 -1 OPTIONS 
|;bsd-auth;compress-fast;index;exclude-list=/usr/lib/amanda/exclude.gtar;
GNUTAR /Data/SNM/AnimalStudies/Rambam 4 2005:9:21:19:8:51 -1 OPTIONS 
|;bsd-auth;compress-fast;index;exclude-list=/usr/lib/amanda/exclude.gtar;
GNUTAR /Data/SNM/AnimalStudies/Detroit 0 1970:1:1:0:0:0 -1 OPTIONS 
|;bsd-auth;compress-fast;index;exclude-list=/usr/lib/amanda/exclude.gtar;
GNUTAR /Data/SNM/AnimalStudies/Detroit 2 2005:9:15:19:15:17 -1 OPTIONS 
|;bsd-auth;compress-fast;index;exclude-list=/usr/lib/amanda/exclude.gtar;
GNUTAR /Data/SNM/AnimalStudies/Cleveland 0 1970:1:1:0:0:0 -1 OPTIONS 
|;bsd-auth;compress-fast;index;exclude-list=/usr/lib/amanda/exclude.gtar;
GNUTAR /Data/SNM/AnimalStudies/Cleveland 1 2005:9:21:3:9:42 -1 OPTIONS 
|;bsd-auth;compress-fast;index;exclude-list=/usr/lib/amanda/exclude.gtar;
GNUTAR /Data/SNM/ClinicalStudies 0 1970:1:1:0:0:0 -1 OPTIONS 
|;bsd-auth;compress-fast;index;exclude-list=/usr/lib/amanda/exclude.gtar;
GNUTAR /Data/SNM/ClinicalStudies 2 2005:9:21:19:8:36 -1 OPTIONS 
|;bsd-auth;compress-fast;index;exclude-list=/usr/lib/amanda/exclude.gtar;
GNUTAR /Shares 0 1970:1:1:0:0:0 -1 OPTIONS 
|;bsd-auth;compress-fast;index;exclude-list=/usr/lib/amanda/exclude.gtar;
GNUTAR /Shares 3 2005:9:21:19:9:59 -1 OPTIONS 
|;bsd-auth;compress-fast;index;exclude-list=/usr/lib/amanda/exclude.gtar;
GNUTAR /home 0 1970:1:1:0:0:0 -1 OPTIONS 
|;bsd-auth;compress-fast;index;exclude-list=/usr/lib/amanda/exclude.gtar;
--------

amandad: time 0.025: sending ack:
----
Amanda 2.4 ACK HANDLE 000-40783709 SEQ 1128926341
----

amandad: time 0.025: bsd security: remote host betacentauri.bioc user amanda 
local user amanda
amandad: time 0.025: amandahosts security check passed
amandad: time 0.025: running service "/usr/lib/amanda/sendsize"
amandad: time 349.398: sending REP packet:
----
Amanda 2.4 REP HANDLE 000-40783709 SEQ 1128926341
OPTIONS features=fffffeff9ffe0f;
/home 0 SIZE 75817360
/Shares 0 SIZE 14244820
/Shares 3 SIZE 187210
/Data/SNM/ClinicalStudies 0 SIZE 7826940
/Data/SNM/ClinicalStudies 2 SIZE 16260
/Data/SNM/AnimalStudies/Cleveland 0 SIZE 4809310
/Data/SNM/AnimalStudies/Cleveland 1 SIZE 205590
/Data/SNM/AnimalStudies/Detroit 0 SIZE 59581540
/Data/SNM/AnimalStudies/Detroit 2 SIZE 661630
/Data/SNM/AnimalStudies/Rambam 0 SIZE 29069290
/Data/SNM/AnimalStudies/Rambam 4 SIZE 1336040
/Data/SNM/AnimalStudies/ATE_data/logs 0 SIZE 67350
/Data/SNM/AnimalStudies/ATE_data/logs 1 SIZE 1900
/etc 0 SIZE 80300
/etc 1 SIZE 1690
/boot 0 SIZE 3790
/boot 1 SIZE 10
----

amandad: time 359.415: dgram_recv: timeout after 10 seconds
amandad: time 359.415: waiting for ack: timeout, retrying
amandad: time 369.413: dgram_recv: timeout after 10 seconds
amandad: time 369.413: waiting for ack: timeout, retrying
amandad: time 379.412: dgram_recv: timeout after 10 seconds
amandad: time 379.412: waiting for ack: timeout, retrying
amandad: time 389.410: dgram_recv: timeout after 10 seconds
amandad: time 389.410: waiting for ack: timeout, retrying
amandad: time 399.409: dgram_recv: timeout after 10 seconds
amandad: time 399.409: waiting for ack: timeout, giving up!
amandad: time 399.409: pid 25072 finish time Mon Oct 10 08:45:37 2005
<Prev in Thread] Current Thread [Next in Thread>