Amanda-Users

estimate timeouts

2002-12-03 12:48:54
Subject: estimate timeouts
From: Matthew Boeckman <matthewb AT saepio DOT com>
To: amanda-users AT amanda DOT org
Date: Tue, 03 Dec 2002 10:57:19 -0600
After resolving my earlier problems, I've uncovered a new one. Amanda is timeing out, apparently while waiting for estimates on one of my hosts. I think I can fix this by bumping the timeout value, but thought I would open the situation up to the list to see if anyone has a better idea.

The setup:
1 ultra5 amanda server/client with 100+GB Filesystem and 1 SpectraLogic tape changer (15 tapes)
5 x86 linux amanda clients, < 10GB filesystems

nocomp dump on 2 partitions on the ultra
nocomp tar on 4 directories (bkup1, 2, 3, 4) on the 100+GB filesystem
comp-high on 5 linux boxes.
dumpcycle 1 week, 6 runspercycle.

the behavior: If I remove all but 1 of the bkup partitions from disklist, amanda runs fine, whenever I try to run with bkup1-4 in the disklist, I get:
 ultra      /webhome/bkup4 lev 0 FAILED [Request to ultra timed out.]
for all partitions.

I have attached the output of amadmin info on this host for reference. I have also attached the sendsize.debug from my most recent run. I'm perplexed, as it kind of appears from these two that amanda was trying to do both lvl 0's and lvl 1's of some of the partitions!

I guess I'm wondering if bumping the timeouts will help, or if I am at a point where I need to run two seperate cycles (say bkup1 & 2 3 days a week and bkup 3 & 4 the other 3 days). I don't really want to do this, as it will eat tapes much quicker. Alternatively, I wonder if anyone has a better idea for getting this going?!

any thoughts are appreciated!

--
Matthew Boeckman                        (816) 777-2160
Manager - Systems Integration           Saepio Technologies
Current info for ultra /webhome/bkup4:
  Stats: dump rates (kps), Full:  2466.0, 2651.0,  -1.0
                    Incremental:  2023.0,  80.0,  93.0
          compressed size, Full: -100.0%,-100.0%,-100.0%
                    Incremental: -100.0%,-100.0%,-100.0%
  Dumps: lev datestmp  tape             file   origK   compK secs
          0  20021202  DailySet101         1 41717130 41717152 16911

Current info for ultra /webhome/bkup3:
  Stats: dump rates (kps), Full:  2459.0, 2277.0, 2242.0
                    Incremental:   42.0,  58.0,  27.0
          compressed size, Full: -100.0%,-100.0%,-100.0%
                    Incremental: -100.0%,-100.0%,-100.0%
  Dumps: lev datestmp  tape             file   origK   compK secs
          0  20021201  DailySet115         1 25350240 25350272 10309

Current info for ultra /webhome/bkup2:
  Stats: dump rates (kps), Full:  2288.0, 1956.0, 2095.0
                    Incremental:  319.0,  30.0,  27.0
          compressed size, Full: -100.0%,-100.0%,-100.0%
                    Incremental: -100.0%,-100.0%,-100.0%
  Dumps: lev datestmp  tape             file   origK   compK secs
          0  20021122  DailySet102        41 28200940 28200960 12324
          1  20021123  DailySet103        37  374840  374848 1042
          2  20021126  DailySet106        11  298010  298016  932

Current info for ultra /webhome/bkup1:
  Stats: dump rates (kps), Full:  2297.0, 2134.0, 2173.0
                    Incremental:   36.0,  69.0,  67.0
          compressed size, Full: -100.0%,-100.0%,-100.0%
                    Incremental: -100.0%,-100.0%,-100.0%
  Dumps: lev datestmp  tape             file   origK   compK secs
          0  20021202  DailySet104         1 27927610 27927616 12158

Current info for ultra /dev/dsk/c0t0d0s1:
  Stats: dump rates (kps), Full:  1064.0, 1137.0, 1141.0
                    Incremental:   11.0,  22.0,   3.0
          compressed size, Full: -100.0%,-100.0%,-100.0%
                    Incremental: -100.0%,-100.0%,-100.0%
  Dumps: lev datestmp  tape             file   origK   compK secs
          0  20021126  DailySet106        40 1470463 1470496 1381

Current info for ultra /dev/dsk/c0t0d0s0:
  Stats: dump rates (kps), Full:  380.0, 617.0, 638.0
                    Incremental:    6.0,   9.0,   6.0
          compressed size, Full: -100.0%,-100.0%,-100.0%
                    Incremental: -100.0%,-100.0%,-100.0%
  Dumps: lev datestmp  tape             file   origK   compK secs
          0  20021126  DailySet106        21  115519  115552  304
sendsize: debug 1 pid 1796 ruid 602 euid 602 start time Tue Dec  3 01:00:07 2002
/usr/local/amanda/libexec/sendsize: version 2.4.2
calculating for amname '/dev/dsk/c0t0d0s0', dirname '/'
sendsize: getting size via dump for /dev/dsk/c0t0d0s0 level 0
sendsize: running "/usr/sbin/ufsdump 0Ssf 1048576 - /dev/rdsk/c0t0d0s0"
running /usr/local/amanda/libexec/killpgrp
118303744
.....
asking killpgrp to terminate
sendsize: getting size via dump for /dev/dsk/c0t0d0s0 level 1
sendsize: running "/usr/sbin/ufsdump 1Ssf 1048576 - /dev/rdsk/c0t0d0s0"
running /usr/local/amanda/libexec/killpgrp
237568
.....
asking killpgrp to terminate
calculating for amname '/dev/dsk/c0t0d0s1', dirname '/usr'
sendsize: getting size via dump for /dev/dsk/c0t0d0s1 level 0
sendsize: running "/usr/sbin/ufsdump 0Ssf 1048576 - /dev/rdsk/c0t0d0s1"
running /usr/local/amanda/libexec/killpgrp
1519860736
.....
asking killpgrp to terminate
sendsize: getting size via dump for /dev/dsk/c0t0d0s1 level 1
sendsize: running "/usr/sbin/ufsdump 1Ssf 1048576 - /dev/rdsk/c0t0d0s1"
running /usr/local/amanda/libexec/killpgrp
16833536
.....
asking killpgrp to terminate
calculating for amname '/webhome/bkup1', dirname '/webhome/bkup1'
sendsize: getting size via gnutar for /webhome/bkup1 level 0
sendsize: running "/usr/local/amanda/libexec/runtar --create --directory 
/webhome/bkup1 --listed-incremental 
/usr/local/amanda/var/amanda/gnutar-lists/ultra_webhome_bkup1_0.new --sparse 
--one-file-system --ignore-failed-read --totals --file /dev/null 
--exclude-from/home/amanda/bkup1"
sendsize: spawning "/usr/local/amanda/libexec/runtar" in pipeline
sendsize: argument list: "/usr/local/bin/tar" "--create" "--directory" 
"/webhome/bkup1" "--listed-incremental" 
"/usr/local/amanda/var/amanda/gnutar-lists/ultra_webhome_bkup1_0.new" 
"--sparse" "--one-file-system" "--ignore-failed-read" "--totals" "--file" 
"/dev/null" "--exclude-from" "/home/amanda/bkup1" "."
Total bytes written: 28598138880
.....
sendsize: getting size via gnutar for /webhome/bkup1 level 1
sendsize: running "/usr/local/amanda/libexec/runtar --create --directory 
/webhome/bkup1 --listed-incremental 
/usr/local/amanda/var/amanda/gnutar-lists/ultra_webhome_bkup1_1.new --sparse 
--one-file-system --ignore-failed-read --totals --file /dev/null 
--exclude-from/home/amanda/bkup1"
sendsize: spawning "/usr/local/amanda/libexec/runtar" in pipeline
sendsize: argument list: "/usr/local/bin/tar" "--create" "--directory" 
"/webhome/bkup1" "--listed-incremental" 
"/usr/local/amanda/var/amanda/gnutar-lists/ultra_webhome_bkup1_1.new" 
"--sparse" "--one-file-system" "--ignore-failed-read" "--totals" "--file" 
"/dev/null" "--exclude-from" "/home/amanda/bkup1" "."
Total bytes written: 5713920
.....
calculating for amname '/webhome/bkup2', dirname '/webhome/bkup2'
sendsize: getting size via gnutar for /webhome/bkup2 level 0
sendsize: running "/usr/local/amanda/libexec/runtar --create --directory 
/webhome/bkup2 --listed-incremental 
/usr/local/amanda/var/amanda/gnutar-lists/ultra_webhome_bkup2_0.new --sparse 
--one-file-system --ignore-failed-read --totals --file /dev/null 
--exclude-from/home/amanda/bkup2"
sendsize: spawning "/usr/local/amanda/libexec/runtar" in pipeline
sendsize: argument list: "/usr/local/bin/tar" "--create" "--directory" 
"/webhome/bkup2" "--listed-incremental" 
"/usr/local/amanda/var/amanda/gnutar-lists/ultra_webhome_bkup2_0.new" 
"--sparse" "--one-file-system" "--ignore-failed-read" "--totals" "--file" 
"/dev/null" "--exclude-from" "/home/amanda/bkup2" "."
Total bytes written: 27480176640
.....
sendsize: getting size via gnutar for /webhome/bkup2 level 2
sendsize: running "/usr/local/amanda/libexec/runtar --create --directory 
/webhome/bkup2 --listed-incremental 
/usr/local/amanda/var/amanda/gnutar-lists/ultra_webhome_bkup2_2.new --sparse 
--one-file-system --ignore-failed-read --totals --file /dev/null 
--exclude-from/home/amanda/bkup2"
sendsize: spawning "/usr/local/amanda/libexec/runtar" in pipeline
sendsize: argument list: "/usr/local/bin/tar" "--create" "--directory" 
"/webhome/bkup2" "--listed-incremental" 
"/usr/local/amanda/var/amanda/gnutar-lists/ultra_webhome_bkup2_2.new" 
"--sparse" "--one-file-system" "--ignore-failed-read" "--totals" "--file" 
"/dev/null" "--exclude-from" "/home/amanda/bkup2" "."
/usr/local/bin/tar: Cannot add file 
./demo/agilis/preview-files/To1275mC9860590820050463At.gif: No such file or 
directory
Total bytes written: 1167851520
.....
sendsize: getting size via gnutar for /webhome/bkup2 level 3
sendsize: running "/usr/local/amanda/libexec/runtar --create --directory 
/webhome/bkup2 --listed-incremental 
/usr/local/amanda/var/amanda/gnutar-lists/ultra_webhome_bkup2_3.new --sparse 
--one-file-system --ignore-failed-read --totals --file /dev/null 
--exclude-from/home/amanda/bkup2"
sendsize: spawning "/usr/local/amanda/libexec/runtar" in pipeline
sendsize: argument list: "/usr/local/bin/tar" "--create" "--directory" 
"/webhome/bkup2" "--listed-incremental" 
"/usr/local/amanda/var/amanda/gnutar-lists/ultra_webhome_bkup2_3.new" 
"--sparse" "--one-file-system" "--ignore-failed-read" "--totals" "--file" 
"/dev/null" "--exclude-from" "/home/amanda/bkup2" "."
Total bytes written: 889169920
.....
calculating for amname '/webhome/bkup3', dirname '/webhome/bkup3'
sendsize: getting size via gnutar for /webhome/bkup3 level 0
sendsize: running "/usr/local/amanda/libexec/runtar --create --directory 
/webhome/bkup3 --listed-incremental 
/usr/local/amanda/var/amanda/gnutar-lists/ultra_webhome_bkup3_0.new --sparse 
--one-file-system --ignore-failed-read --totals --file /dev/null 
--exclude-from/home/amanda/bkup3"
sendsize: spawning "/usr/local/amanda/libexec/runtar" in pipeline
sendsize: argument list: "/usr/local/bin/tar" "--create" "--directory" 
"/webhome/bkup3" "--listed-incremental" 
"/usr/local/amanda/var/amanda/gnutar-lists/ultra_webhome_bkup3_0.new" 
"--sparse" "--one-file-system" "--ignore-failed-read" "--totals" "--file" 
"/dev/null" "--exclude-from" "/home/amanda/bkup3" "."
Total bytes written: 25961359360
.....
sendsize: getting size via gnutar for /webhome/bkup3 level 1
sendsize: running "/usr/local/amanda/libexec/runtar --create --directory 
/webhome/bkup3 --listed-incremental 
/usr/local/amanda/var/amanda/gnutar-lists/ultra_webhome_bkup3_1.new --sparse 
--one-file-system --ignore-failed-read --totals --file /dev/null 
--exclude-from/home/amanda/bkup3"
sendsize: spawning "/usr/local/amanda/libexec/runtar" in pipeline
sendsize: argument list: "/usr/local/bin/tar" "--create" "--directory" 
"/webhome/bkup3" "--listed-incremental" 
"/usr/local/amanda/var/amanda/gnutar-lists/ultra_webhome_bkup3_1.new" 
"--sparse" "--one-file-system" "--ignore-failed-read" "--totals" "--file" 
"/dev/null" "--exclude-from" "/home/amanda/bkup3" "."
Total bytes written: 26992640
.....
calculating for amname '/webhome/bkup4', dirname '/webhome/bkup4'
sendsize: getting size via gnutar for /webhome/bkup4 level 0
sendsize: running "/usr/local/amanda/libexec/runtar --create --directory 
/webhome/bkup4 --listed-incremental 
/usr/local/amanda/var/amanda/gnutar-lists/ultra_webhome_bkup4_0.new --sparse 
--one-file-system --ignore-failed-read --totals --file /dev/null 
--exclude-from/home/amanda/bkup4"
sendsize: spawning "/usr/local/amanda/libexec/runtar" in pipeline
sendsize: argument list: "/usr/local/bin/tar" "--create" "--directory" 
"/webhome/bkup4" "--listed-incremental" 
"/usr/local/amanda/var/amanda/gnutar-lists/ultra_webhome_bkup4_0.new" 
"--sparse" "--one-file-system" "--ignore-failed-read" "--totals" "--file" 
"/dev/null" "--exclude-from" "/home/amanda/bkup4" "."
Total bytes written: 42721320960
.....
sendsize: getting size via gnutar for /webhome/bkup4 level 1
sendsize: running "/usr/local/amanda/libexec/runtar --create --directory 
/webhome/bkup4 --listed-incremental 
/usr/local/amanda/var/amanda/gnutar-lists/ultra_webhome_bkup4_1.new --sparse 
--one-file-system --ignore-failed-read --totals --file /dev/null 
--exclude-from/home/amanda/bkup4"
sendsize: spawning "/usr/local/amanda/libexec/runtar" in pipeline
sendsize: argument list: "/usr/local/bin/tar" "--create" "--directory" 
"/webhome/bkup4" "--listed-incremental" 
"/usr/local/amanda/var/amanda/gnutar-lists/ultra_webhome_bkup4_1.new" 
"--sparse" "--one-file-system" "--ignore-failed-read" "--totals" "--file" 
"/dev/null" "--exclude-from" "/home/amanda/bkup4" "."
Total bytes written: 32604160
.....
sendsize: pid 1796 finish time Tue Dec  3 02:19:31 2002
<Prev in Thread] Current Thread [Next in Thread>