Amanda-Users

Re: backup lasts forever on large fs

2003-11-11 15:42:09
Subject: Re: backup lasts forever on large fs
From: Frank Smith <fsmith AT hoovers DOT com>
To: Zoltan Kato <kato AT inf.u-szeged DOT hu>
Date: Tue, 11 Nov 2003 14:40:45 -0600
--On Tuesday, November 11, 2003 20:50:58 +0100 Zoltan Kato <kato AT 
inf.u-szeged DOT hu> wrote:

> Looks like the estimate has timed out after a 1/2 hour. I do not know why
> estimation takes so long. What is more interesting: after amdump has
> finished there is still a gtar process running:

Estimates can take quite a while on large filsystems with lots of small
files.  You can try increasing etimeout in your amanda.conf, the default
was too short for several of my filesystems.  Since etimeout tells your
backup server how long to wait before giving up on the estimate, the
client doesn't know that the server quit waiting so it continues on.
   If you let it run you can check the debug logs on the client (usually
in /tmp/amanda unless you configured it differently) and see how long
the estimate ran and increase your etimeout accordingly.

Frank

> 
> load averages:  0.91,  0.90,  0.90
> 20:48:53
> 58 processes:  55 sleeping, 1 zombie, 2 on cpu
> CPU states:     % idle,     % user,     % kernel,     % iowait,     % swap
> Memory: 2048M real, 1495M free, 104M swap in use, 5474M swap free
> 
>    PID USERNAME THR PRI NICE  SIZE   RES STATE    TIME    CPU COMMAND
>  24118 root       1  20    0   49M   49M cpu/1   89:38 45.23% gtar
> 
> 
> 
> Here are the results of the test run:
> 
> amanda@rozi$ amstatus cab
> Using /var/amanda/cab/amdump.1 from Tue Nov 11 18:51:59 CET 2003
> 
> lena2.cab.u-szeged.hu:/etc              1      550k finished (19:37:04)
> lena2.cab.u-szeged.hu:/root/ldap_backup 1     1380k finished (19:37:19)
> rozi.cab.u-szeged.hu:/etc               0 planner: [Estimate timeout from
> rozi.c
> ab.u-szeged.hu]
> rozi.cab.u-szeged.hu:/home              0 planner: [Estimate timeout from
> rozi.c
> ab.u-szeged.hu]
> 
> SUMMARY          part      real  estimated
>                            size       size
> partition       :   4
> estimated       :   2                 1930k
> flush           :   0         0k
> failed          :   2                    0k           (  0.00%)
> wait for dumping:   0                    0k           (  0.00%)
> dumping to tape :   0                    0k           (  0.00%)
> dumping         :   0         0k         0k (  0.00%) (  0.00%)
> dumped          :   2      1930k      1930k (100.00%) (100.00%)
> wait for writing:   0         0k         0k (  0.00%) (  0.00%)
> wait to flush   :   0         0k         0k (100.00%) (  0.00%)
> writing to tape :   0         0k         0k (  0.00%) (  0.00%)
> failed to tape  :   0         0k         0k (  0.00%) (  0.00%)
> taped           :   2      1930k      1930k (100.00%) (100.00%)
> 4 dumpers idle  : not-idle
> taper idle
> network free kps:    101000
> holding space   :  18864378k (100.00%)
>  dumper0 busy   :  0:00:00  (  2.52%)
>    taper busy   :  0:00:06  ( 36.07%)
>  0 dumpers busy :  0:00:17  ( 95.97%)          start-wait:  0:00:14  (
> 80.88%)
>                                                  not-idle:  0:00:03  (
> 19.12%)
>  1 dumper busy  :  0:00:00  (  4.03%)
> amanda@rozi$
> 
> 
> 
> And amreport says:
> 
> 
> ---------- Forwarded message ----------
> Date: Tue, 11 Nov 2003 19:37:27 +0100 (MET)
> From: amanda AT rozi.cab.u-szeged DOT hu
> 
> These dumps were to tape cab03.
> The next tape Amanda expects to use is: cab04.
> 
> FAILURE AND STRANGE DUMP SUMMARY:
>   rozi.cab.u /home lev 0 FAILED [Estimate timeout from rozi.cab.u-szeged.hu]
>   rozi.cab.u /etc lev 0 FAILED [Estimate timeout from rozi.cab.u-szeged.hu]
> 
> 
> STATISTICS:
>                           Total       Full      Daily
>                         --------   --------   --------
> Estimate Time (hrs:min)    0:45
> Run Time (hrs:min)         0:45
> Dump Time (hrs:min)        0:00       0:00       0:00
> Output Size (meg)           1.9        0.0        1.9
> Original Size (meg)         1.9        0.0        1.9
> Avg Compressed Size (%)     --         --         --    (level:#disks ...)
> Filesystems Dumped            2          0          2   (1:2)
> Avg Dump Rate (k/s)      5316.8        --      5316.8
> 
> Tape Time (hrs:min)        0:00       0:00       0:00
> Tape Size (meg)             1.9        0.0        1.9
> Tape Used (%)               0.0        0.0        0.0   (level:#disks ...)
> Filesystems Taped             2          0          2   (1:2)
> Avg Tp Write Rate (k/s)   288.2        --       288.2
> 
> USAGE BY TAPE:
>   Label       Time      Size      %    Nb
>   cab03       0:00       1.9    0.0     2
> 
> 
> NOTES:
>   planner: Adding new disk rozi.cab.u-szeged.hu:/home.
>   taper: tape cab03 kb 2048 fm 2 [OK]
> 
> 
> DUMP SUMMARY:
>                                      DUMPER STATS            TAPER STATS
> HOSTNAME     DISK        L ORIG-KB OUT-KB COMP% MMM:SS  KB/s MMM:SS  KB/s
> -------------------------- --------------------------------- ------------
> lena2.cab.u- /etc        1     550    550   --    0:005662.6   0:03 164.2
> lena2.cab.u- -dap_backup 1    1380   1380   --    0:005177.7   0:03 412.2
> rozi.cab.u-s /etc        0 FAILED ---------------------------------------
> rozi.cab.u-s /home       0 FAILED ---------------------------------------
> 
> (brought to you by Amanda version 2.4.4p1)



-- 
Frank Smith                                      fsmith AT hoovers DOT com
Systems Administrator                           Voice: 512-374-4673
Hoover's Online                                   Fax: 512-374-4501