Amanda-Users

Re:

2007-10-26 12:47:15
Subject: Re:
From: Paul Bijnens <Paul.Bijnens AT xplanation DOT com>
To: "Krahn, Anderson" <AKrahn AT gs1us DOT org>
Date: Fri, 26 Oct 2007 10:26:04 +0200
On 2007-10-25 21:49, Krahn, Anderson wrote:
Here is the amstatus of our amdump.

What performance problems can be seen from the output below?

I have not yet finished my coffee, but I cannot see any problem!


For ex.

12 dumpers busy : 0:02:30 ( 1.83%) client-constrained: 0:02:30 ( 99.99%)

13 dumpers busy : 0:04:03 ( 2.95%) client-constrained: 0:04:03 (100.00%)

14 dumpers busy : 0:00:06 ( 0.08%) client-constrained: 0:00:06 (100.00%)

What improvements can be made to not have these client-constrained messages?


"client-constrained" means that Amanda could not start additional
dumpers because all the clients had already work to do.
You can allow Amanda to start more than one backup at the same
time on one client, if you specify spindle numbers on the DLE's
for that client (so that amanda can avoid starting a backup
on DLE's sharing a disk), and then also set "maxdump 2" or more
on the dumptype for that host (or all dumptypes)

But you'll have to keep an eye on the load of those clients
to be sure that you're not making it worse by doing too many
things at once, resulting in a slower backup.

But overall, your performance seems reasonably good:
you have 8 to 11 dumpers busy, during 80% of the time.
Not bad at all :-)

Also not that of the 76 Gbyte Amanda has to backup,
42 Gbyte is divided over 2 DLE's that are still busy.
Doing things even more in parallel will not shorten
the amount of time for the large ones.
If you're concerned about the total clocktime that
the backups are taking, add ' dumporder "TTTTTT" '
(as much T's has you have dumpers) so that Amanda
starts the longest taking backups first.  Or maybe
split up the large DLE's into smaller, so that
Amanda can spread the large full backups over the
complete dumpcycle.

If you believe (some of) the clients have plenty of
idle resources, then go a ahead and tell Amanda not to
worry to start more dumps on those clients at the same
time by settings maxdumps on that dumptype and adding
splindle numbers to the DLE's in the disklist file.




/opt/amanda/server/sbin/amstatus --config Full  | more

Using /var/log/debug/Full/amdump from Thu Oct 25 12:13:00 CDT 2007

qaapp05-bkup.1sync.org:/home       1       151k finished (12:24:25)

qaapp05-bkup.1sync.org:/opt 1 5757455k dumping 2704928k ( 46.98%) (12:23:24)

qaapp70-bkup.1sync.org:/           1      9805k finished (12:29:08)

qaapp70-bkup.1sync.org:/home       1        28k finished (12:23:36)

qadb01-bkup.1sync.org:/u02         1         1k finished (12:24:29)

qadb01-bkup.1sync.org:/u03         1         1k finished (12:23:58)

qadb01-bkup.1sync.org:/u04 1 21417710k dumping 1515328k ( 7.08%) (12:23:24)

qadb06-bkup.1sync.org:/home        1         5k finished (12:24:42)

qadb06-bkup.1sync.org:/opt 0 4764470k dumping 3788192k ( 79.51%) (12:23:59)

qadb06-bkup.1sync.org:/var         1      1078k finished (12:23:45)

qadb11-bkup.1sync.org:/            1      3236k finished (12:26:54)

qadb11-bkup.1sync.org:/home        1        22k finished (12:23:54)

qadb11-bkup.1sync.org:/opt 0 3797655k dumping 2590176k ( 68.20%) (12:24:01)

qadb70-bkup.1sync.org:/            1      3505k finished (12:27:37)

qadb70-bkup.1sync.org:/U 0 21387400k dumping 1621856k ( 7.58%) (12:23:24)

qadb70-bkup.1sync.org:/home        1        12k finished (12:24:03)

qadb70-bkup.1sync.org:/opt 1 7417055k dumping 850336k ( 11.46%) (12:23:40)

qadb70-bkup.1sync.org:/var         1      4910k finished (12:26:31)

SUMMARY          part      real  estimated

                           size       size

partition       :  56

estimated       :  56             76330503k

flush           :   0         0k

failed          :   0                    0k           (  0.00%)

wait for dumping:   0                    0k           (  0.00%)

dumping to tape :   0                    0k           (  0.00%)

dumping         :   6  13070816k  64541745k ( 20.25%) ( 17.12%)

dumped          :  50   5497439k  11788758k ( 46.63%) (  7.20%)

wait for writing:   0         0k         0k (  0.00%) (  0.00%)

wait to flush   :   0         0k         0k (100.00%) (  0.00%)

writing to tape :   0         0k         0k (  0.00%) (  0.00%)

failed to tape  :   0         0k         0k (  0.00%) (  0.00%)

taped           :  50   5497439k  11788758k ( 46.63%) (  7.20%)

  tape 1        :  50   5497439k  11788758k (  1.39%) EGV007

14 dumpers idle : no-dumpers

taper writing, tapeq: 0

network free kps:   3696868

holding space   : 436734564k ( 86.77%)

chunker0 busy   :  0:09:58  (  7.25%)

chunker1 busy   :  0:03:50  (  2.79%)

chunker4 busy   :  0:05:41  (  4.14%)

chunker6 busy   :  1:26:33  ( 62.88%)

chunker7 busy   :  2:04:38  ( 90.54%)

chunker8 busy   :  0:00:29  (  0.36%)

chunker9 busy   :  0:12:16  (  8.92%)

chunker10 busy   :  0:05:15  (  3.82%)

chunker11 busy   :  0:05:21  (  3.89%)

chunker12 busy   :  0:00:21  (  0.25%)

chunker14 busy   :  2:05:05  ( 90.87%)

chunker15 busy   :  0:09:29  (  6.90%)

chunker16 busy   :  0:04:07  (  2.99%)

chunker17 busy   :  0:05:18  (  3.86%)

chunker18 busy   :  1:32:47  ( 67.42%)

chunker19 busy   :  0:32:07  ( 23.34%)

 dumper0 busy   :  0:09:57  (  7.24%)

 dumper1 busy   :  0:03:49  (  2.78%)

 dumper2 busy   :  2:07:14  ( 92.44%)

 dumper3 busy   :  2:07:14  ( 92.44%)

 dumper4 busy   :  0:05:41  (  4.14%)

 dumper5 busy   :  2:07:14  ( 92.44%)

 dumper6 busy   :  1:26:32  ( 62.88%)

 dumper7 busy   :  2:04:38  ( 90.54%)

 dumper8 busy   :  2:07:09  ( 92.38%)

 dumper9 busy   :  0:12:16  (  8.92%)

dumper10 busy   :  0:05:15  (  3.82%)

dumper11 busy   :  0:05:21  (  3.89%)

dumper12 busy   :  2:06:59  ( 92.25%)

dumper13 busy   :  2:06:59  ( 92.25%)

dumper14 busy   :  2:05:05  ( 90.87%)

dumper15 busy   :  0:09:29  (  6.90%)

dumper16 busy   :  0:04:07  (  2.99%)

dumper17 busy   :  0:05:18  (  3.86%)

dumper18 busy   :  1:32:47  ( 67.42%)

dumper19 busy   :  0:32:07  ( 23.34%)

   taper busy   :  0:06:18  (  4.58%)

0 dumpers busy : 0:10:22 ( 7.54%) not-idle: 0:10:22 (100.00%)

 1 dumper busy  :  0:00:00  (  0.00%)

 2 dumpers busy :  0:00:00  (  0.00%)

 3 dumpers busy :  0:00:00  (  0.00%)

 4 dumpers busy :  0:00:00  (  0.00%)

 5 dumpers busy :  0:00:00  (  0.00%)

6 dumpers busy : 0:01:53 ( 1.38%) no-dumpers: 0:01:53 (100.00%)

7 dumpers busy : 0:00:42 ( 0.52%) no-dumpers: 0:00:42 (100.00%)

8 dumpers busy : 0:31:39 ( 22.99%) no-dumpers: 0:31:33 ( 99.70%)

start-wait: 0:00:05 ( 0.30%)

9 dumpers busy : 0:06:29 ( 4.71%) no-dumpers: 0:06:28 ( 99.73%)

start-wait: 0:00:01 ( 0.27%)

10 dumpers busy : 0:48:53 ( 35.52%) no-dumpers: 0:48:41 ( 99.61%)

client-constrained: 0:00:06 ( 0.23%)

start-wait: 0:00:04 ( 0.16%)

11 dumpers busy : 0:25:31 ( 18.54%) client-constrained: 0:20:08 ( 78.90%)

no-dumpers: 0:04:09 ( 16.29%)

start-wait: 0:01:13 ( 4.81%)

12 dumpers busy : 0:02:30 ( 1.83%) client-constrained: 0:02:30 ( 99.99%)

13 dumpers busy : 0:04:03 ( 2.95%) client-constrained: 0:04:03 (100.00%)

14 dumpers busy : 0:00:06 ( 0.08%) client-constrained: 0:00:06 (100.00%)

15 dumpers busy : 0:00:13 ( 0.16%) client-constrained: 0:00:13 (100.00%)

16 dumpers busy : 0:00:06 ( 0.07%) client-constrained: 0:00:06 (100.00%)

17 dumpers busy : 0:00:27 ( 0.33%) client-constrained: 0:00:27 (100.00%)

18 dumpers busy : 0:00:34 ( 0.42%) client-constrained: 0:00:24 ( 71.04%)

start-wait: 0:00:10 ( 28.96%)

19 dumpers busy : 0:01:01 ( 0.74%) no-dumpers: 0:00:40 ( 66.98%)

client-constrained: 0:00:10 ( 17.91%)

start-wait: 0:00:09 ( 15.11%)

20 dumpers busy : 0:02:55 ( 2.12%) client-constrained: 0:01:50 ( 63.00%)

start-wait: 0:00:43 ( 24.81%)

no-dumpers: 0:00:21 ( 12.19%)




--
Paul Bijnens, xplanation Technology Services        Tel  +32 16 397.511
Technologielaan 21 bus 2, B-3001 Leuven, BELGIUM    Fax  +32 16 397.512
http://www.xplanation.com/          email:  Paul.Bijnens AT xplanation DOT com
***********************************************************************
* I think I've got the hang of it now:  exit, ^D, ^C, ^\, ^Z, ^Q, ^^, *
* F6, quit, ZZ, :q, :q!, M-Z, ^X^C, logoff, logout, close, bye, /bye, *
* stop, end, F3, ~., ^]c, +++ ATH, disconnect, halt,  abort,  hangup, *
* PF4, F20, ^X^X, :D::D, KJOB, F14-f-e, F8-e,  kill -1 $$,  shutdown, *
* init 0, kill -9 1, Alt-F4, Ctrl-Alt-Del, AltGr-NumLock, Stop-A, ... *
* ...  "Are you sure?"  ...   YES   ...   Phew ...   I'm out          *
***********************************************************************


<Prev in Thread] Current Thread [Next in Thread>