Amanda-Users

Re: Can't seem to disable software compression.

2008-04-30 08:56:02
Subject: Re: Can't seem to disable software compression.
From: Paul Bijnens <Paul.Bijnens AT xplanation DOT com>
To: Edi Šuc <e AT ed0 DOT net>, amanda List <amanda-users AT amanda DOT org>
Date: Wed, 30 Apr 2008 14:50:26 +0200
On 2008-04-30 13:45, Edi Šuc wrote:
Hi.

It seems that I can't disable software compression in amanda. I tried everything that could in my opinion have an impact on compression. But no luck. The problem is that i have a relatively slow machine and it takes forever to complete the backup. If I check the processes i see this:

19021 ?        S      0:00          \_ /bin/sh /usr/sbin/amdump AAA1
19031 ?        S      0:00              \_ /usr/lib/amanda/driver AAA1
19032 ?        S      0:01                  \_ taper AAA1
19037 ?        S      0:01                  |   \_ taper AAA1
19033 ?        S      0:08                  \_ dumper0 AAA1
19034 ?        S      5:31                  \_ dumper1 AAA1
19074 ?        S      0:08                  |   \_ /bin/gzip --best
19035 ?        S      0:00                  \_ dumper2 AAA1
19036 ?        S      0:00                  \_ dumper3 AAA1
19066 ?        S      8:59                  \_ chunker1 AAA1

I suppose that there shouldn't be a "gzip --best" if I disable the compression. I also tried to use the directive "compress fast" in the "define dumptype" section, but no luck. "gzip --best" is still there (it should at least change to "gzip --fast").

The index (list of filenames in the backup) is ALWAYS compressed using
"gzip --best", and I bet that disabling the index (or not compressing it)
will not speed up the process.

The bottleneck you have is probably something else.
client-disks?  network?

I can only say that usually the power for the amanda server is not
that important (except for those modern tapedrives, that expect
to be provided with a continued 80 Mbyte/sec or more, which
simple IDE drives cannot provide).

I had for a long time an Amanda server having 128 Mbyte RAM, 300 Mhz
Celeron, 80 Gbyte IDE holdingdisk and AIT-1 tapes (35 Gbyte native).
It was serving 120+ DLE's from about 30 hosts.  In that time the
bottleneck was on the clients (disk-IO + software compression).

And for my home config I have a similar old computer 500 MHz, 192Mbyte RAM
but with twice software raid-1 250GB disks for vtapes + one 60 Gbyte
for root filesystem, software and holdingdisk.  And still the bottleneck
is the client and the network (wireless is not that fast; and powerline
is not fast either).


To locate bottlenecks, use the commands amstatus and amplot  (especially
the last one, is very enlighting!).

In your config I see:

 netusage  600 Kbps

I would eliminate it, as well as the limits on each interface you specified.


--
Paul Bijnens, xplanation Technology Services        Tel  +32 16 397.511
Technologielaan 21 bus 2, B-3001 Leuven, BELGIUM    Fax  +32 16 397.512
http://www.xplanation.com/          email:  Paul.Bijnens AT xplanation DOT com
***********************************************************************
* I think I've got the hang of it now:  exit, ^D, ^C, ^\, ^Z, ^Q, ^^, *
* F6, quit, ZZ, :q, :q!, M-Z, ^X^C, logoff, logout, close, bye, /bye, *
* stop, end, F3, ~., ^]c, +++ ATH, disconnect, halt,  abort,  hangup, *
* PF4, F20, ^X^X, :D::D, KJOB, F14-f-e, F8-e,  kill -1 $$,  shutdown, *
* init 0, kill -9 1, Alt-F4, Ctrl-Alt-Del, AltGr-NumLock, Stop-A, ... *
* ...  "Are you sure?"  ...   YES   ...   Phew ...   I'm out          *
***********************************************************************

<Prev in Thread] Current Thread [Next in Thread>