Amanda-Users

Re: Unusual dump times?

2003-09-16 08:40:18
Subject: Re: Unusual dump times?
From: Paul Bijnens <paul.bijnens AT xplanation DOT com>
To: Jack Baty <jbaty AT fusionary DOT com>, AMANDA Users <amanda-users AT amanda DOT org>
Date: Tue, 16 Sep 2003 14:36:37 +0200
Jack Baty wrote:

With everything finally working, I'm wondering if my dump times are excessive or to be expected. I plan to gradually include more machines totalling about 20GB. If all the hosts take as long as marvin (below), things could end up taking more than 12 hours to run. Wondering if I should just stop using compression.

Just verifying - you are using "compression fast", I presume.
The speed difference between best and fast is quiet large.
What CPU has marvin?  Are there other heavy programs running?

If you add more machines, they will all be done in parallel, assuming
your holdingdisk is large enough, so the wall clock time will not
increase accordingly.

Your estimate time is also quiet long.  This is a symptom when using
tar on a filesystem with many small files.  I once migrated such
a filesystem from Solaris UFS to Linux ReiserFS and my estimate time
went down from almost 3 hours to about 20 minutes.  (OK, I admint,
the cpu was a little bit faster too.)

                          Total       Full      Daily
                        --------   --------   --------
Estimate Time (hrs:min)    1:09
Run Time (hrs:min)         4:48
Dump Time (hrs:min)        3:08       2:58       0:10
Output Size (meg)        4220.4     4210.2       10.2
Original Size (meg)      6915.5     6844.9       70.6
Avg Compressed Size (%)    61.0       61.5       11.4   (level:#disks
Filesystems Dumped            5          1          4   (1:3 2:1)
Avg Dump Rate (k/s)       382.8      404.1       16.8

Tape Time (hrs:min)        0:32       0:32       0:00
Tape Size (meg)          4220.4     4210.2       10.2
Tape Used (%)              34.3       34.3        0.1   (level:#disks
Filesystems Taped             5          1          4   (1:3 2:1)
Avg Tp Write Rate (k/s)  2264.2     2275.2      755.3


DUMP SUMMARY:
                                     DUMPER STATS            TAPER STATS
HOSTNAME     DISK        L ORIG-KB OUT-KB COMP% MMM:SS  KB/s MMM:SS  KB/s
-------------------------- --------------------------------- ------------
marvin.fusio /usr        0 70091804311267  61.5 177:48 404.1  31:352275.2

Many of my machines get only 300KB/sec (well, they are old, but they
don't have large disks either). Some of my faster machines get up to 1400KB/sec on full backups with compression fast on a switched 100MB network.

Tip: see "columnspec" in the amanda.conf file for how to put a space
     between your columns.

scooby.fusio /usr        1   55450   5443   9.8   8:49  10.3   0:11 515.1
stewie       -e/projects 1     200    200   --    0:02  96.7   0:009069.9
stewie       -e/software 1    2290   2290   --    0:06 379.9   0:013149.8
stewie       hda2        2   14380   2535  17.6   1:26  29.6   0:03 996.3

--
Paul Bijnens, Xplanation                            Tel  +32 16 397.511
Technologielaan 21 bus 2, B-3001 Leuven, BELGIUM    Fax  +32 16 397.512
http://www.xplanation.com/          email:  Paul.Bijnens AT xplanation DOT com
***********************************************************************
* I think I've got the hang of it now:  exit, ^D, ^C, ^\, ^Z, ^Q, F6, *
* quit,  ZZ, :q, :q!,  M-Z, ^X^C,  logoff, logout, close, bye,  /bye, *
* stop, end, F3, ~., ^]c, +++ ATH, disconnect, halt,  abort,  hangup, *
* PF4, F20, ^X^X, :D::D, KJOB, F14-f-e, F8-e,  kill -1 $$,  shutdown, *
* kill -9 1,  Alt-F4,  Ctrl-Alt-Del,  AltGr-NumLock,  Stop-A,  ...    *
* ...  "Are you sure?"  ...   YES   ...   Phew ...   I'm out          *
***********************************************************************



<Prev in Thread] Current Thread [Next in Thread>