Jon,

On Wed, Aug 08, 2007 at 11:24:03AM -0400, Jon LaBadie wrote:
> On Wed, Aug 08, 2007 at 11:09:34AM -0400, Brian Cuttler wrote:
> > 
> > Somehow I don't see my manager ok'ing reenable of the index function
> > to perform a scientific test.
> > 
> 
> Indexing is not an all or none situation, it is a dumptype parameter.
> It can be turned on and off in the dumptype, so you can select which
> DLE are indexed and which are not.  This would allow testing on just
> 2 or 3 DLE while leaving the bulk not indexed.

True, actually I did disable it at the dumptype level, believe its
disabled for dump and the template I used defaulted to on for tar.

I would create a new one and moved only a couple of DLEs to the new
indexing tar type...

There was also a very significant difference in the I/O rate to tape
between the two days, noticed this also during amflush on the same
system (we hadn't refreshed the tapes in the jukebox), seems the tape
I/O rate is dependent on system load, surprisingly so since that is
also not a high CPU utilizer, if I'm understanding correctly that is
really just a DD from work area to the drive.

Actually dump times are significantly less also, I didn't realize how
much until I looked at two reports side by side.

Indexing, Tees, runs a second tar, catches and compressed the output...

Normal, daytime system load is around 2 or less, with dumps running
yesterday morning we had a load average of about 54... difficult to
believe that its all amanda related. I'd really like to find something
else to point at but indexing was the only change, amanda is wonderful
and I'd rather the issue was something other than indexing.

It would be interesting to see the load average at, like 0200, but I
don't have that, could write a short cron job...

With indexing enabled on tar DLEs

HOSTNAME DISK           L   ORIG-KB    OUT-KB COMP% MMM:SS   KB/s MMM:SS   KB/s 
------------------------ --------------------------------------- -------------  
wcnotes /             0  4229216   4229216  --   30:48 2288.2   9:41 7283.3  
wcnotes /export       0 14293728  14293728  --   54:26 4376.9  35:08 6779.7  
wcnotes /maildb2/five 1 74023168  74023200  --  865:10 1426.0 130:47 9432.8  
wcnotes /maildb2/four 1 12517340  12517344  --  125:41 1659.8  29:21 7107.7  
wcnotes /maildb2/one  2 52722740  52722752  --  619:43 1417.9 129:47 6770.6  
wcnotes /maildb2/three0 31335250  31335264  --  364:03 1434.5  91:12 5726.1  
wcnotes /maildb2/two  1 41511640  41511640  --  271:26 2548.9   N/A    N/A   
wcnotes /usr1         0  4016416   4016416  --   22:59 2912.1   9:44 6875.8  
wcnotes maildbAD      1 41072940  41072940  --  562:28 1217.0   N/A    N/A   
wcnotes maildbEK      1 39382460  39382460  --  489:28 1341.0  FAILED  ----- 
wcnotes maildbLQ      1 25791010  25791040  --  291:56 1472.5  79:23 5414.5  
wcnotes maildbRZ      1  8378270   8378272  --   80:26 1736.0  22:10 6297.9 

With tar DLE indexing disabled


HOSTNAME DISK           L   ORIG-KB    OUT-KB COMP% MMM:SS   KB/s MMM:SS   KB/s 
------------------------ --------------------------------------- -------------  
wcnotes /              1     5056      5056  --    2:39   31.7   0:02 2299.7  
wcnotes /export        1  8671456   8671456  --   33:28 4317.9  17:54 8076.6  
wcnotes /maildb2/five  1 74361664  74361664  --  270:26 4582.8  67:05 18476.5 
wcnotes /maildb2/four  1 12588910  12588928  --   49:08 4269.9  29:42 7064.8  
wcnotes /maildb2/one   2 52752768  52752800  --  203:38 4317.6  47:56 18339.5 
wcnotes /maildb2/three 1 28393970  28393984  --  109:27 4323.8  56:52 8321.6  
wcnotes /maildb2/two   1 41614980  41615008  --   94:59 7302.3  36:23 19066.2 
wcnotes /usr1          1      672       672  --    0:37   18.1   0:02  297.7  
wcnotes maildbAD       0 41121580  41121600  --  110:18 6213.5  34:10 20058.1 
wcnotes maildbEK       2 35397968  35397984  --  130:10 4532.1  46:54 12579.6 
wcnotes maildbLQ       1 25834530  25834560  --   98:02 4392.3  55:32 7753.2  
wcnotes maildbRZ       0  8391840   8391840  --   29:31 4737.8  19:04 7334.4  

---
   Brian R Cuttler                 brian.cuttler AT wadsworth DOT org
   Computer Systems Support        (v) 518 486-1697
   Wadsworth Center                (f) 518 473-6384
   NYS Department of Health        Help Desk 518 473-0773



IMPORTANT NOTICE: This e-mail and any attachments may contain
confidential or sensitive information which is, or may be, legally
privileged or otherwise protected by law from further disclosure.  It
is intended only for the addressee.  If you received this in error or
from someone who was not authorized to send it to you, please do not
distribute, copy or use it or any attachments.  Please notify the
sender immediately by reply e-mail and delete this from your
system. Thank you for your cooperation.