Amanda-Users

Re: amanda: running forever..update

2003-06-17 09:21:43
Subject: Re: amanda: running forever..update
From: Paul Bijnens <paul.bijnens AT xplanation DOT com>
To: Michael Packer <pac AT stingrayboats DOT com>
Date: Tue, 17 Jun 2003 15:19:05 +0200
Michael Packer wrote:
The changes took it from 8+ hours to 4:45.... still would like to get it
down a bit more... I still have a problem with compsec (made a typo) so
I reformatted it by hand.

The backup itself is now done in 2:35.  The rest of the time is done
by taping the chunks.
You are in the pathological case where:
1. dumping to tape is bad, because your system cannot keep the tape
   streaming while reading the disk.
2. you have essentially one large disk, and parallelising the dumping
   and the taping is only possible for different disks.


would it be beneficial to break /sda5 down into different disks
(I was looking at the sample disklist and saw you can do things like
/sda5/x /sda5/x2 /sda5/x3 ... etc).   Currently it's creating 56 500mb
chunks

Yes, it make reason 2 disappear.  Taper can start writing to tape
one "disk" while dumping the others.


is it better not to create these chunks?

If you mean seperate disklistentries (DLE's) instead of one
large DLE? (Chunking has a special meaning in the context of
a holdingdisk: it's is used to avoid the 2GByte filesize limit
on some OS's).
I think so, yes.  You get at least some work done in
parallel in your pathological case.



STATISTICS:
                          Total       Full      Daily
                        --------   --------   --------
Estimate Time (hrs:min)    0:15
Run Time (hrs:min)         4:45
Dump Time (hrs:min)        2:23       2:23       0:00
Output Size (meg)       28778.4    28778.4        0.0
Original Size (meg)     28778.4    28778.4        0.0
Avg Compressed Size (%) -- -- -- Filesystems Dumped 7 7 0 Avg Dump Rate (k/s) 3439.2 3439.2 --
Tape Time (hrs:min)        2:15       2:15       0:00
Tape Size (meg)         28778.5    28778.5        0.0
Tape Used (%)              72.1       72.1        0.0
Filesystems Taped             7          7          0
Avg Tp Write Rate (k/s) 3634.1 3634.1 --
USAGE BY TAPE:
  Label             Time      Size      %    Nb
  DailySet102       2:15   28778.5   72.1     7

DUMP SUMMARY:
DUMPER STATS TAPER STATS HOSTNAME DISK L ORIG-KB OUT-KB COMP% MMM:SS KB/s MMM:SS KB/s
----------------- ------------ ------------
localhost  sda2 0   878130   878144   --    4:29   3264.2   6:17 2327.0
localhost  sda3 0     3830     3840   --    0:01   3818.4   0:04  927.2
localhost  sda5 0 28012880 28012896   --  132:42   3518.4 125:34 3718.2

As you can see here, your dumpspeed 3518 KB/s is now optimal.
And your tape speed 3718 KBs is too.
You can now only gain more speed with parallel writing and dumping.

localhost  sda7 0   385760   385760   --    2:25   2657.5   2:22 2713.1
localhost  sda8 0   185380   185408   --    0:21   8983.4   0:46 4073.1
localhost  sda9 0     2010     2016   --    0:01   2720.4   0:03  685.2
localhost  sdb1 0     1140     1152   --    2:50      6.7   0:03  395.6

(brought to you by Amanda version 2.4.4)



--
Paul Bijnens, Xplanation                            Tel  +32 16 397.511
Technologielaan 21 bus 2, B-3001 Leuven, BELGIUM    Fax  +32 16 397.512
http://www.xplanation.com/          email:  Paul.Bijnens AT xplanation DOT com
***********************************************************************
* I think I've got the hang of it now:  exit, ^D, ^C, ^\, ^Z, ^Q, F6, *
* quit,  ZZ, :q, :q!,  M-Z, ^X^C,  logoff, logout, close, bye,  /bye, *
* stop, end, F3, ~., ^]c, +++ ATH, disconnect, halt,  abort,  hangup, *
* PF4, F20, ^X^X, :D::D, KJOB, F14-f-e, F8-e,  kill -1 $$,  shutdown, *
* kill -9 1,  Alt-F4,  Ctrl-Alt-Del,  AltGr-NumLock,  Stop-A,  ...    *
* ...  "Are you sure?"  ...   YES   ...   Phew ...   I'm out          *
***********************************************************************



<Prev in Thread] Current Thread [Next in Thread>