ADSM-L

Re: Number of files per hour??

1996-08-12 17:57:45
Subject: Re: Number of files per hour??
From: Dwight Cook <decook AT AMOCO DOT COM>
Date: Mon, 12 Aug 1996 16:57:45 -0500
     We are, in about 7 to 10 days, going to fire up a test adsm server...
     an IBM 59H rs/6000 with 2 fddi cards and a drawer of 4.5 SSA disk for
     a backup/archive pool (total @70GB) to see just how much we can hammer
     into adsm... we believe we have seen slow downs in our adsm
     environments possibly due to DB contention... on the test machine we
     have built a 4GB db striped across 4 disks and a 1 GB log striped
     across 4 different disks (DB & log are on SSA's also, a different
     drawer from the pools)  Sorry we don't have a mail server to test but
     we are going to use a general user image server so there will be tons
     of little files... actually I might see about getting some data from a
     mail server, that could be good... This test is mainly for Novell
     client testing... we are going to run a schedule that starts a
     script/clist/bat/whatever it is in novell to kick off multiple dsmc's
     to perform backups... basically 3 one for system, one for
     applications, and one for user data on the server.... the novell
     environments we are backing up have 60GB usable space (120GB physical)
     so wish me luck and I can post results....

     IF ANYONE still would like to offer up ideas on some novell client
     parm settings I will be willing to plug them in...  I don't pretend to
     be a novell expert, or even slightly good... heck, last time I went to
     build a novell server 4.1 didn't run out of the box (had to wait on
     upgrade) anyway...
     later
          Dwight



______________________________ Reply Separator _________________________________
Subject: Re: Number of files per hour??
Author:  ADSM-L at unix,sh/dd.RFC-822=ADSM-L\@VM\.MARIST\.EDU
Date:    8/12/96 1:47 PM


Michael,

We are considering the same thing, but on a larger scale - probably 1 million
files per day.  We have found that our current performance bottleneck is with
ADSM's ability to update its database.  The smaller the objects you are
moving, the more of a problem this becomes.  I would love to see some good
performance studies showing the best way to enhance DB update performance.
I simply have not had the time to work on this here.  I know that IBM used
to do some of this type of performance work from the Washington Systems
Center.  I don't know if they still do this or not.

Frankly, I'm not sure that ADSM is up to doing this.  We might be able to
back up our mail servers, but in doing so I suspect we would eat up (or more)
the capacity of our ADSM server.

..Paul
--
On Mon, 12 Aug 1996 10:41:09 -0400 Michael Ryan said:
On Mon, 12 Aug 1996 10:41:09 -0400 Michael Ryan said:
>     I have several mail systems, each having approx. 4 million files. On
>     an average day approximately 10-20% of the files change, so I am
>     looking at incrementals that will backup approx. 400,000 - 800,000
>     files each day. The files are small, around 1k-2k on average, and my
>     initial tests indicate that I can get approx 20,000 files per hour.
>     The testing was done between a "HP-UX A.09.04 E 9000/847" and a IBM
>     ES9000. The testing does not appear to be touching the network, nor is
>     it taxing the mainframe or HP box. I would like to be able to backup
>     each of system within a 6-8 hour window.
>
>     Does any one have a similar situation, and if so how have you tuned
>     the system to move this many files?
>
>     Does any one have any firm numbers on the quatity of files that can be
>     backed up in a 1 hour period?
>
>     Any suggestions????????
>
>
>
>     ****Please not that the numbers above are very rough and only a result
>     of some prelimiary testing.
>
>
>     Thanks in advance.
>     Michael Ryan
<Prev in Thread] Current Thread [Next in Thread>