Re: tar dumps, performance
2007-08-08 12:59:01
Jon,
On Wed, Aug 08, 2007 at 11:24:03AM -0400, Jon LaBadie wrote:
> On Wed, Aug 08, 2007 at 11:09:34AM -0400, Brian Cuttler wrote:
> >
> > Somehow I don't see my manager ok'ing reenable of the index function
> > to perform a scientific test.
> >
>
> Indexing is not an all or none situation, it is a dumptype parameter.
> It can be turned on and off in the dumptype, so you can select which
> DLE are indexed and which are not. This would allow testing on just
> 2 or 3 DLE while leaving the bulk not indexed.
True, actually I did disable it at the dumptype level, believe its
disabled for dump and the template I used defaulted to on for tar.
I would create a new one and moved only a couple of DLEs to the new
indexing tar type...
There was also a very significant difference in the I/O rate to tape
between the two days, noticed this also during amflush on the same
system (we hadn't refreshed the tapes in the jukebox), seems the tape
I/O rate is dependent on system load, surprisingly so since that is
also not a high CPU utilizer, if I'm understanding correctly that is
really just a DD from work area to the drive.
Actually dump times are significantly less also, I didn't realize how
much until I looked at two reports side by side.
Indexing, Tees, runs a second tar, catches and compressed the output...
Normal, daytime system load is around 2 or less, with dumps running
yesterday morning we had a load average of about 54... difficult to
believe that its all amanda related. I'd really like to find something
else to point at but indexing was the only change, amanda is wonderful
and I'd rather the issue was something other than indexing.
It would be interesting to see the load average at, like 0200, but I
don't have that, could write a short cron job...
With indexing enabled on tar DLEs
HOSTNAME DISK L ORIG-KB OUT-KB COMP% MMM:SS KB/s MMM:SS KB/s
------------------------ --------------------------------------- -------------
wcnotes / 0 4229216 4229216 -- 30:48 2288.2 9:41 7283.3
wcnotes /export 0 14293728 14293728 -- 54:26 4376.9 35:08 6779.7
wcnotes /maildb2/five 1 74023168 74023200 -- 865:10 1426.0 130:47 9432.8
wcnotes /maildb2/four 1 12517340 12517344 -- 125:41 1659.8 29:21 7107.7
wcnotes /maildb2/one 2 52722740 52722752 -- 619:43 1417.9 129:47 6770.6
wcnotes /maildb2/three0 31335250 31335264 -- 364:03 1434.5 91:12 5726.1
wcnotes /maildb2/two 1 41511640 41511640 -- 271:26 2548.9 N/A N/A
wcnotes /usr1 0 4016416 4016416 -- 22:59 2912.1 9:44 6875.8
wcnotes maildbAD 1 41072940 41072940 -- 562:28 1217.0 N/A N/A
wcnotes maildbEK 1 39382460 39382460 -- 489:28 1341.0 FAILED -----
wcnotes maildbLQ 1 25791010 25791040 -- 291:56 1472.5 79:23 5414.5
wcnotes maildbRZ 1 8378270 8378272 -- 80:26 1736.0 22:10 6297.9
With tar DLE indexing disabled
HOSTNAME DISK L ORIG-KB OUT-KB COMP% MMM:SS KB/s MMM:SS KB/s
------------------------ --------------------------------------- -------------
wcnotes / 1 5056 5056 -- 2:39 31.7 0:02 2299.7
wcnotes /export 1 8671456 8671456 -- 33:28 4317.9 17:54 8076.6
wcnotes /maildb2/five 1 74361664 74361664 -- 270:26 4582.8 67:05 18476.5
wcnotes /maildb2/four 1 12588910 12588928 -- 49:08 4269.9 29:42 7064.8
wcnotes /maildb2/one 2 52752768 52752800 -- 203:38 4317.6 47:56 18339.5
wcnotes /maildb2/three 1 28393970 28393984 -- 109:27 4323.8 56:52 8321.6
wcnotes /maildb2/two 1 41614980 41615008 -- 94:59 7302.3 36:23 19066.2
wcnotes /usr1 1 672 672 -- 0:37 18.1 0:02 297.7
wcnotes maildbAD 0 41121580 41121600 -- 110:18 6213.5 34:10 20058.1
wcnotes maildbEK 2 35397968 35397984 -- 130:10 4532.1 46:54 12579.6
wcnotes maildbLQ 1 25834530 25834560 -- 98:02 4392.3 55:32 7753.2
wcnotes maildbRZ 0 8391840 8391840 -- 29:31 4737.8 19:04 7334.4
---
Brian R Cuttler brian.cuttler AT wadsworth DOT org
Computer Systems Support (v) 518 486-1697
Wadsworth Center (f) 518 473-6384
NYS Department of Health Help Desk 518 473-0773
IMPORTANT NOTICE: This e-mail and any attachments may contain
confidential or sensitive information which is, or may be, legally
privileged or otherwise protected by law from further disclosure. It
is intended only for the addressee. If you received this in error or
from someone who was not authorized to send it to you, please do not
distribute, copy or use it or any attachments. Please notify the
sender immediately by reply e-mail and delete this from your
system. Thank you for your cooperation.
|
<Prev in Thread] |
Current Thread |
[Next in Thread>
|
- tar dumps, performance, Brian Cuttler
- Re: tar dumps, performance, Dustin J. Mitchell
- Re: tar dumps, performance, Jon LaBadie
- Re: tar dumps, performance, Brian Cuttler
- Message not available
- Re: tar dumps, performance,
Brian Cuttler <=
- Re: tar dumps, performance, Aaron J. Grier
- Re: tar dumps, performance, Brian Cuttler
- Re: tar dumps, performance, Aaron J. Grier
- Re: tar dumps, performance, Dustin J. Mitchell
- Re: tar dumps, performance, Brian Cuttler
|
|
|