Amanda-Users

Re: amdump performance problem

2007-03-07 12:53:17
Subject: Re: amdump performance problem
From: Kenneth Berry <kberry AT microbeef DOT com>
To: Joshua Baker-LePain <jlb17 AT duke DOT edu>
Date: Wed, 07 Mar 2007 11:45:26 -0600
Thank you for the tip on columnspec, I was about to create another post
on that problem.


The computer mbthome is both the amanda server and client, it is a Dell
PE2650 dual Xeon processor, 2GB Ram. Tape unit is LTO3 on a dedicated
SCSI controller.  Internal HDD's are four SCSI ultra320 10K configured
as hardware RAID5.  On top of this 100GB RAID5 disk is LVM Volume00
allocated as shown below.  One additional internal SCSI ultra320 10K
drive of 300GB capacity is allocated to LVM Volume02 and usage can be
seen below.  All the internal HDD share a common percraid controller.  I
have an external RAID5 set of drives on an third SCSI controller which
LVM Volume01 resides.  It should not be a factor currently it is unused.
Over the past weekend I migrated all the /home data from the external
set of drives to the single large internal drive, thinking the external
drives were the problem.  But this reorganization made not difference.

Please note that the same performance problems exist on other client box
see mbtdb01 info on the original message post.  I can provide mbtdb01
specs if you need them.


The OS on mbthome is Fedora Core 2, here is some additional info:

[root@mbthome root]# uname -a
Linux mbthome.microbeef.com 2.6.6-1.435smp #1 SMP Mon Jun 14 09:31:56
EDT 2004 i686 i686 i386 GNU/Linux
------------------------------------------------------

[root@mbthome root]# df
Filesystem           1K-blocks      Used Available Use% Mounted on
/dev/mapper/Volume00-root
                       1007896    209976    746720  22% /
/dev/mapper/Volume01-amanda
                     206424760     32828 195906172   1% /amanda3
/dev/mapper/Volume00-amanda2
                      96612084     32832  91671632   1% /amanda2
/dev/sdd1            141003764  36925740  96915448  28% /amanda
/dev/sda2               101105     13183     82701  14% /boot
none                   1037992         0   1037992   0% /dev/shm
/dev/mapper/Volume02-tempHome
                     103212320  85076700  12892740  87% /home
/dev/mapper/Volume02-tempPublic
                      77409288  46926132  26550996  64% /home/public
/dev/mapper/Volume02-tempAuskImages
                      51606140  32695696  16289004
67% /home/public/AuskImages
/dev/mapper/Volume00-usr
                       3120456   1888628   1073316  64% /usr
/dev/mapper/Volume00-var
                       1007896    661348    295348  70% /var
------------------------------------------------

amanda.conf info

<SNIP>
dumpuser "amanda"       # the user to run dumps under

inparallel 10           # maximum dumpers that will run in parallel
dumporder "SSSSSsssss"
netusage  1000000 Kbps  # maximum net bandwidth for Amanda, in KB per
sec

dumpcycle 0 days        # the number of days in the normal dump cycle
runspercycle 1 days     # the number of amdump runs in dumpcycle days
tapecycle 23 tapes      # the number of tapes in rotation

<SNIP>

holdingdisk hd1 {
    comment "main holding disk"
    directory "/amanda2"        # where the holding disk is
    }
holdingdisk hd2 {
    directory "/amanda"
    use -50 Mb
    }
#holdingdisk hd3 {
#    directory "/amanda3"
#    use -50 Mb
#    }

<SNIP>

Thanks,

Kenneth

On Wed, 2007-03-07 at 12:02 -0500, Joshua Baker-LePain wrote:
> On Wed, 7 Mar 2007 at 9:58am, Kenneth Berry wrote
> 
> > I have been working on a performance problem for about a month and I am
> > out of ideas.  I hope someone can help me.  What is happening is that
> > backups of large DLE that start very early seem to dump at a very slow
> > rate.  Where as dumps of DLE on the same host, physical drive, etc. that
> > start hours latter dump at an expected rate.  The amstatus snapshot
> > below was taken at 9:30:00.  The backups start at midnight and notice
> > that the dump rate for mbthome:/home/public is about 830K/sec.  But DLE
> > mbthome:/home_a_i which has been running for 21 mins. is at a dump rate
> > of about 9500K/sec.
> 
> What is the hardware and OS setup on this client?  Please be very 
> detailed.  What about the server?
> 
> *snip*
> > -------------------------- ---------------------------------
> > ------------
> > mbtas00      /           0 2177990 816539  37.5   8:121659.0
> > 1:0313057.1
> *snip*
> 
> *Please* look into the columnspec parameter in your amanda.conf to make 
> that line readable.  It'd make things a lot easier.
> 
-- 
Kenneth Berry
Systems Engineer / System Administrator
Micro Beef Technologies
P.O. Box 9262
Amarillo, Texas 79105
806-372-2369
kberry AT microbeef DOT com

The information contained in or attached to this e-mail message is
intended only for the confidential use of the named individual(s) above.
If you are not the named recipient of this message you are hereby
notified that you have received this document and its attachments in
error and that review, dissemination, or copying of this message is
prohibited.  If you have received this message in error, please notify
Micro Beef Technologies immediately.  Thank you.


<Prev in Thread] Current Thread [Next in Thread>