ADSM-L

Slow retrieves from large directories

1999-04-19 14:05:41
Subject: Slow retrieves from large directories
From: Steven Bridge <ccaasub AT UCL.AC DOT UK>
Date: Mon, 19 Apr 1999 19:05:41 +0100
I have two similar problems both I believe relating to restoring
or retrieving from directories that on the backup have large numbers
of entries.

Server is AIX 4.3 , ADSM Version 3, Release 1, Level 2.0

Client Version 3, Release 1, Level 0.3 also on same server using
TCP/IP as commmethod.

For about 3 months ( as an interim measure while our older backup software
is phased out ), we have been archiving files that have resided in
one of 4 directories with full path names like :

/nfs/backup-server/stage1/local

The final component of the file is always unique and we archive about
1000 files a day.
Once archived, the files are deleted from the original directory.
The difficulty we face is that the actual retrieve of one of these
files takes between 35 and 55 mins regardless of size. The time
appears to be taken searching the database. There are several passes
with the text ' ANS1899I ***** Examined    21,000 files *****'
and similar up to 111,000 files.
The command I am using is simply
'retrieve /nfs/backup-server/stage2/local/E:rs6-svr-21c.ac.uk:__nfs__abc:x:y:z'
or similar at the dsmc command prompt.

Is there anything I can do to speed this up ? As I am giving an explicit name,
why should take so long to find ?

The similar problem I have is from a separate AIX 4.3 client which has
an incremental backup of a mail-spool directory containing about
25,000 files performed every day. When I attempt to use the dsm gui
interface to restore from this directory, I click on the directory to
expand to show all files ( having also requested that it shows inactive
files as well ) and it goes away for a few hours. It displays :
'Loading /nfs/fs-x/mail-spool/mail (488615)' , the number increasing
over time, presumably while it builds an internal table of some kind.
Eventually after it has reached about half a million, I get a warning
message that memory is running low and do I wish to abort, which I do.
I know the name but I may not know what versions are available.
Even searching for an explicit name between certain dates has this effect.

Is there any way I can a file back from this directory - or is this
effectively a write only backup ?

Any suggestions gratefully received.

+----------------------------------------------------------------------+
 Steven Bridge     Systems Group, Information Systems, EISD
                          University College London
 email: s.bridge AT ucl.ac DOT uk                   tel: +44 171-504 2794
<Prev in Thread] Current Thread [Next in Thread>