Amanda-Users

Re: tar dumps, performance

2007-08-08 12:54:21
Subject: Re: tar dumps, performance
From: Brian Cuttler <brian AT wadsworth DOT org>
To: amanda-users AT amanda DOT org, Chris Knight <knight AT wadsworth DOT org>, gene.heskett AT verizon DOT net, dustin AT zmanda DOT com, jon AT jgcomp DOT com
Date: Wed, 8 Aug 2007 11:09:34 -0400
Jon, Gene, Dustin,

Actually I don't know that we need indexing on this box, Its a
Lotus Notes server, so any file that it touched by its owner or
receiving email will be backed up in its entirety, and some of
these files are big.

It would be nice if I understood things better though as we have
more traditional use systems that have ever larger drives and we
have been forced to move towards TAR dumps over (os specific) dump.

Somehow I don't see my manager ok'ing reenable of the index function
to perform a scientific test.

We are backing up about 320 Gig, to an LTO1 drive with HW compression.
Work area totals about 230 gig, in 4 pieces.

We had had issues with work area and added disk, we had issues with
tape spanning and that is why we subdivided the two large DLEs.

Holding area, number of CPU, etc all held constant between Monday
night's dumps (typical of run times for the last two weeks, when we
switched to TAR for the second large DLE) and Tuesday, when we 
disabled indexing and run time was dramatically shorter.

Current disklist... we where wondering if the wildcard excludes and any
effect on performance, vs the drive that was already setup in a way that
allowed reasonable divsion of data.

DLE /maildb2 moved from ufsdump to TAR several months ago, /maildb
which is not nicely divisable was divided two weeks ago (than you Jon
for help with wildcards).

The LTO drive is 100Gig native, we are using HW compression and seem
to be getting about 30% out of it, as evidenced by the recent breakpoint
in the /maildb backups, they just became too large for the tape.

We used to run SW compression, but disabled that a _long_ time ago
as the Sun E250 just didn't have the horsepower.

All partitions are local.

# Notes server backup
wcnotes /             nocomp-root 
#wcnotes /maildb              nocomp-user
wcnotes /export       nocomp-user
wcnotes /usr1         nocomp-user

wcnotes  /maildb2/one {
        user-tar
        }

wcnotes  /maildb2/two {
        user-tar
        }

wcnotes   /maildb2/three {
        user-tar
        }

wcnotes   /maildb2/four {
        user-tar
        }

wcnotes   /maildb2/five {
        user-tar
        }

wcnotes   maildbAD  /maildb/mail {
        user-tar
        exclude "[e-z]*"
}

wcnotes   maildbEK  /maildb/mail {
        user-tar
        exclude "[a-dl-z]*"
        }

wcnotes maildbLQ  /maildb/mail {
        user-tar
        exclude "[a-kr-z]*" 
        }

wcnotes maildbRZ  /maildb/mail {
        user-tar
        exclude "[a-s]*" 
        }

> df -h
Filesystem             size   used  avail capacity  Mounted on
/dev/md/dsk/d10        7.4G   4.0G   3.4G    54%    /
/proc                    0K     0K     0K     0%    /proc
mnttab                   0K     0K     0K     0%    /etc/mnttab
fd                       0K     0K     0K     0%    /dev/fd
swap                   811M    32K   811M     1%    /var/run
/dev/dsk/c0t10d0s0      33G    34M    33G     1%    /amanda3
/dev/dsk/c1t6d0s0       67G    64M    67G     1%    /amanda2
/dev/dsk/c0t11d0s0      67G    64M    67G     1%    /amanda4
swap                   1.7G   974M   811M    55%    /tmp
/dev/dsk/c5t3d0s0       41G    14G    27G    34%    /export
/dev/md/dsk/d30         17G   3.8G    13G    24%    /usr1
/dev/dsk/c5t3d0s6      379G   136G   240G    37%    /maildb
/dev/dsk/c5t3d0s7      379G   204G   172G    55%    /maildb2
/dev/dsk/c1t4d0s0       67G    64M    67G     1%    /amanda/work


---
   Brian R Cuttler                 brian.cuttler AT wadsworth DOT org
   Computer Systems Support        (v) 518 486-1697
   Wadsworth Center                (f) 518 473-6384
   NYS Department of Health        Help Desk 518 473-0773



IMPORTANT NOTICE: This e-mail and any attachments may contain
confidential or sensitive information which is, or may be, legally
privileged or otherwise protected by law from further disclosure.  It
is intended only for the addressee.  If you received this in error or
from someone who was not authorized to send it to you, please do not
distribute, copy or use it or any attachments.  Please notify the
sender immediately by reply e-mail and delete this from your
system. Thank you for your cooperation.



<Prev in Thread] Current Thread [Next in Thread>