ADSM-L

Re: Performance

1999-07-23 13:44:44
Subject: Re: Performance
From: arhoads <arhoads AT PACBELL DOT NET>
Date: Fri, 23 Jul 1999 10:44:44 -0700
Nathan,

You've got the right server: how are your database, logs and storage
pools laid out?  All on SSA?  On how many drives each?  Mirrored at ADSM
level (db & logs)?  What's the network like between that client and the
server?  Have you tried multiple restore sessions up to one per
subdirectory?

Steffan

Nathan King wrote:
>
> Richard,
>
> I agree whole heartedly with your comments. However I think ADSM
> Developement is well aware of the performance degradation caused by small
> files.
> As noted in the ADSM NT Server readme.
>
>     Next to system hardware, the number and size of client files has a
>     big impact on ADSM performance.  The performance when tranferring
>     small files is lower than when transferring large files.
>
>     For example, using a 133MHZ pentium, FAT file system, local ADSM
>     client with no compression, and named pipes to a disk storage pool
>     throughput has been measured at:
>
>                                      File Size
>     Throughput          1KB      10KB    100KB     10MB
>     KB/Sec                57       445     1280     1625
>     GB/hr               0.20      1.53     4.39     5.58
>
> Ok so this is a pentium 133 but with it being a local client you can rule
> out the network as an issue.
> Named pipes is the fastest way to backup locally on NT.
>
> So even if I took the hardware and made it five times faster and supposing
> that by some magic that 5times faster hardware=5times faster adsm
> performance, my 16gb restore of small 1-2kb files would still have taken
> 16hours!!
>
> Unacceptable!
>
> Nathan
>
> > To:   ADSM-L AT VM.MARIST DOT EDU
> > Subject:      Re: Performance
> >
> > ...
> > >However when it comes to restoring servers which are 90% small files then
> > we
> > >may aswell be on a 4Mb Token Ring. We once
> > >had the grand oppurtunity to restore the drive of an SMS Server which was
> > >made up of about 16Gb worth of 2Kb log files.
> > >This took 27hrs.
> > ...
> > > when it comes to small files Adsm just plain sucks!
> > ...
> > >Any thoughts?
> >
> > Nathan - You clearly had a very frustrating, unsatisfactory restoral
> >          experience.  But realize that it's not helping the many customers
> > on
> > the mailing list to just receive a splat without any details as to how the
> > restoral was performed...like network configuration, network load at the
> > time,
> > server system load, what else the ADSM server was doing, server
> > configuration,
> > server options, database cache hit ratio, client load, disk configuration,
> > file system topology, ADSM client options, restoral command, results from
> > testing various combinations in your configuration, etc.
> >
> > The great value in our mailing list is in discovering optimal techniques,
> > and
> > then sharing them, to the betterment of all.  Realize that it's plain
> > frustrating for the people on the list to see complaints rather than the
> > results from measured analysis.  And it does not point to solid evidence
> > that
> > IBM can react to in bettering the product - which will help everyone.
> >
> > Sure - there's a lot of frustration out in the customer base.  But I as a
> > customer feel that I have a responsibility both as a customer and a
> > professional in the data processing field to do some research, to prod the
> > system, change variables, and find out where the problems are.  We can
> > shower
> > IBM with raw complaints and they can tell us about KLOC numbers, but
> > working
> > together with specifics will really solve problems.  Yes, sometimes it's
> > necessary to shake up vendors to get them to be responsive to the
> > realities we
> > face, but the rest of the time customers and vendor need to dig in and get
> > to
> > the bottom of what's really wrong.  Hey, we're not here as a personal
> > pursuit:
> > we're in company and institutional positions as employees expected to
> > effectively deal with problems for the better operation of the
> > organization so
> > that we can all make more money!
> >
> > Naturally, not all customer sites have the resources to pursue things to
> > the
> > depth that better-equipped sites can, and hence depend upon the results
> > that
> > others find.  The mailing list is a dissemination and discussion point for
> > what ails us and what we can do for each other as well as solicit the
> > vendor,
> > IBM, to improve conditions beyond the pointed problems we need to bring to
> > the
> > Support Center.  IBM, in turn, needs to be responsive to the discontent
> > evidenced in the customer base, which is the List's great value to them;
> > and
> > they need to feed back on optimal techniques, which they often do very
> > well in
> > the famous Redbooks [please encourage them].  From management feedback to
> > the
> > List, it is very evident that IBM is listening; but what they particularly
> > want to hear is substantive feedback to allow them to respond as
> > substantively.  This is what we need to do.
> >
> > So channel that energy in ways that will help the general case.
> >
> >     Richard Sims, BU
<Prev in Thread] Current Thread [Next in Thread>