NDMP Backup intermittent failures due to media loading issues

[suhasbhide]

Hi Team...

I have TSM 5.5 with SL3000 tape library via Solaris 10 machine (connectivity thru fibre). I have many a times seen some errors during NDMP backups as shown below....


12/12/2010 17:53:57 ANR8942E Could not move volume I00***L4 from slot-element 1004 to slot-element 2151. (SESSION: 8800, PROCESS: 36)
12/12/2010 17:53:57 ANR8381E NAS volume I00***L4 could not be mounted in drive STL1-DRV000 (rst3a). (SESSION: 8800, PROCESS: 36)
12/12/2010 17:54:01 ANR8312E Volume I00***L4 could not be located in library STL1. (SESSION: 8800, PROCESS: 36)
12/12/2010 17:54:01 ANR8381E NAS volume I00294L4 could not be mounted in drive STL1-DRV001 (rst5a). (SESSION: 8800, PROCESS: 36)
12/12/2010 17:54:01 ANR1402W Mount request denied for volume I00***L4 - volume unavailable. (SESSION: 8800, PROCESS: 36)
12/12/2010 17:54:01 ANR1410W Access mode for volume I00***L4 now set to "unavailable". (SESSION: 8800, PROCESS: 36)

The corresponding errors on solaris (/var/adm/messages) are...


Dec 12 17:53:56 sg1p-dpsarch01a lb: [ID 742233 kern.warning] WARNING: lb@0,0: scsi_cmd=a5,errno=201,cc=306,sense=70 0 5 0 0 0 0 c 0 0 0 0 3a 0 0 c0 0 b 0 0
Dec 12 18:05:30 sg1p-dpsarch01a lb: [ID 742233 kern.warning] WARNING: lb@0,0: scsi_cmd=a5,errno=201,cc=306,sense=70 0 5 0 0 0 0 c 0 0 0 0 3a 0 0 c0 0 b 0 0

What I can see happening is that the media does not get dismounted from drive and hence when tivoli wants to load the same media for next filesystem backup in NDMP, the tape library reports that the media is not available in the specific slot and is marked as unavailable by tivoli.

I have raised cases to IBM and Oracle and both have come back saying it's not their problem and both are not able to give me any clue for the other party to check upon.

Hence, my question to all of you, have anyone of you have any solution or atleast further way of troubleshooting this ? I have already done the audit on tape library followed by the same on TSM,

If anyone needs any further logs, pls. let me know. I will be able to send to them directly.

Thanks.....Suhas Bhide

 

[rallingham]

Well there are a couple of things. The message in the middle says: 12/12/2010 17:54:01 ANR8312E Volume I00***L4 could not be located in library STL1
That sort of means the tape is not in the library. If it is, then from the library GUI run an INVENTORY. If there is not activity on TSM then run an Audit of the library. If the tape drives etc. are busy the Audit of the library may hang. If the tape is not in the library check it in.