ADSM-L

Re: System out of Memory error resoreing 170,000 files

2004-07-22 11:10:35
Subject: Re: System out of Memory error resoreing 170,000 files
From: David McClelland <David.McClelland AT REUTERS DOT COM>
To: ADSM-L AT VM.MARIST DOT EDU
Date: Thu, 22 Jul 2004 16:08:42 +0100
Matt,

Exactly what command are you using to perform this restore - and is it a
subdirectory in a filesystem with lots of other directories? Are you
witnessing any substantial 'thinking time' before the server sends any
data to the client?

Rgds,

David McClelland
Reuters Ltd, London


-----Original Message-----
From: ADSM: Dist Stor Manager [mailto:ADSM-L AT VM.MARIST DOT EDU] On Behalf Of
Warren, Matthew (Retail)
Sent: 22 July 2004 15:53
To: ADSM-L AT VM.MARIST DOT EDU
Subject: Re: System out of Memory error resoreing 170,000 files


In addition,

I have found that if I let the restore fail after 97,500ish files, so
that any subsequent restores fail qwith the out of memory error, if I
delete a single restored file from the directory, that lets me restore
an extra file into the directory...

Are there any known limits to the number of files that TSM can restore
into a single directory? I wouldn't have thought so...

Are there any odd o/s limits in AIX 4.3.3.0 regarding the number of
files allowed in a directory? Inodes? ??

??

Matt.





-----Original Message-----
From: Warren, Matthew (Retail) 
Sent: Thursday, July 22, 2004 3:40 PM
To: 'ADSM: Dist Stor Manager'
Subject: System out of Memory error resoreing 170,000 files


 Hallo,

TSM client 5.1.6 on AIX 4.3.3.0

Server version 5.2.2.3 on AIX 5.2.0.0


When doing a restore of 170,000 + files, the client stops around about
file number 97,500 (+/- 10 files each time it fails) complaining with;

ANS1030E System ran out of memery.

Now, if I try and restore the next file in the sequence, or any files
after the failure point, I get ANS1030E.

BUT, if I delete all of the currently restored files, I can then start
restoring from the original failed file onwards.

IE;

First restore gets to 97,500(approx, different each time) files. Second
restore cannot restore any more files into the directory Stop / start
the client Third restore cannot restore files into the directory Stop
client Rm - r /directory/* Start client Can now begin restoring files
either from the beginning or from the point the restore initially
failed.


Now, roots ulimit is unlimited and the box has 4GB RAM. We have tried
the restore on 3 different boxes with 1GB / 2GB and 4GB ram
respectivley, same AIX and client levels, and each box behaves the same
way. We have also tried a downlevel client but see the same behaviour.




...this makes me think the client is doing something with the directory
before each and every file is restored, and that 'something' generates
the ANS1030E memory error.


Anyone have any ideas? I have searched IBM and ADSM.org and cant find
anything usefull....  Next step will be to go to IBM support...



Thanks,

Matt.



___________________________ Disclaimer Notice __________________________
This message and any attachments are confidential and should only be
read by those to whom they are addressed. If you are not the intended
recipient, please contact us, delete the message from your computer and
destroy any copies. Any distribution or copying without our prior
permission is prohibited.

Internet communications are not always secure and therefore Powergen
Retail Limited does not accept legal responsibility for this message.
The recipient is responsible for verifying its authenticity before
acting on the contents. Any views or opinions presented are solely those
of the author and do not necessarily represent those of Powergen Retail
Limited. 

Registered addresses:

Powergen Retail Limited, Westwood Way, Westwood Business Park, Coventry,
CV4 8LG. Registered in England and Wales No: 3407430

Telephone +44 (0) 2476 42 4000
Fax +44 (0) 2476 42 5432


--------------------------------------------------------------- -
        Visit our Internet site at http://www.reuters.com

Get closer to the financial markets with Reuters Messaging - for more
information and to register, visit http://www.reuters.com/messaging

Any views expressed in this message are those of  the  individual
sender,  except  where  the sender specifically states them to be
the views of Reuters Ltd.