Drive/Path keep going offline

[chafik]

Hello,

Im new to TSM/TS3200. I have a strange problem the drive and path keep going offline.

I mounted the drives and updated the paths and checked with the commands:
- q drive
- q path
Everything seems OK and Online.

But when I launch a manual backup for one of the servers, after few minutes the drives goes Offline.

I tried to check the logs and on the web but nothing help.

Thank you very much for any idea that can help

Regards

 

[marclant]

What are the errors you got in the activity log when the drives went off line? There can be several reasons, so the specific errors is what you need to look at.

Once you see the ANR####E number that caused it to go offline (usually right before the message saying the drive is going offline), you can lookup that error using: HELP ANR####. You can also Google the error(s).

 

[chafik]

Thank you for your reply, I passed the last two day checking logs and ANR but with no luck, all the answers were to mount and update the path and its what I did few time but the problem come back:

this is a few lines of the logs:

ANR8300E I/O error on library LIB_0 (OP=8401C054, CC=-1,
KEY=FF, ASC=FF, ASCQ=FF, SENSE= **NONE**, Description=An
undetermined error has occurred). Refer to the IBM
Tivoli Storage Manager documentation on I/O error code
descriptions. (SESSION: 198916)
07/11/2016 10:00:05 ANR8471E Server no longer polling drive DRIVE_3 in
library LIB_0 - path mt0.0.0.7 will be marked off-line.
(SESSION: 198916)
07/11/2016 10:00:05 ANR8873E The path from source <NODE> to
destination DRIVE_3 (mt0.0.0.7) is taken offline.
(SESSION: 198916)
07/11/2016 10:00:05 ANR9024E There are no drives available.(SESSION: 198917)
07/11/2016 10:00:05 ANR0535W Transaction failed for session 198917 for node
NODE (WinNT) - insufficient mount points
available to satisfy the request. (SESSION: 198917)
07/11/2016 10:00:06 ANR9024E There are no drives available.(SESSION: 198917)
07/11/2016 10:00:06 ANR0535W Transaction failed for session 198917 for node
NODE (WinNT) - insufficient mount points
available to satisfy the request. (SESSION: 198917)

Thank you

 

[marclant]

ANR8300E I/O error on library LIB_0 (OP=8401C054, CC=-1,
KEY=FF, ASC=FF, ASCQ=FF, SENSE= **NONE**, Description=An
undetermined error has occurred). Refer to the IBM
Tivoli Storage Manager documentation on I/O error code
descriptions. (SESSION: 198916)

That error message is the trigger.

Resolving SCSI device problems
Tape drives and libraries might report information back to IBM® Tivoli® Storage Manager about the error encountered. This information is reported in one or more of the messages.

If messages ANR8300, ANR8301, ANR8302, ANR8303, ANR8943, or ANR98944 are issued, the data that Tivoli Storage Manager reports from these devices might help to determine the steps needed to resolve the problem. Generally, when the Tivoli Storage Manager server reports device sense data using these messages, the problem is typically with the device, the connection to the device, or some other related issue outside of Tivoli Storage Manager.

Using the information reported in Tivoli Storage Manager message ANR8300, ANR8301, ANR8302, ANR8303, ANR8943, or ANR8944, refer to the Tivoli Storage Manager Messages manual. This appendix documents information about standard errors that might be reported by any SCSI device. You can also use this information with documentation provided by the vendor for the hardware to help determine the cause and resolution for the problem.

source: https://www.ibm.com/support/knowledgecenter/SSGSG7_7.1.0/com.ibm.itsm.tshoot.doc/r_pdg_stg_scsi.html

So as the above says, you'd typically lookup the Key, ASC, ASCQ and Sense in the Messages Manual, however yours all show FF instead of one of the standard values. The Key, ASC, ASCQ and Sense all come from the hardware, so since the library did not report back standard errors that can be looked up, I'd suggest you check the library console for errors and if you don't find anything useful, open a hardware ticket for the library.

Also make sure you have current device drivers for the library and tape drives, as well as HBAs because HW support will likely ask you to do that. Current firmware will likely be asked too.

 

[chafik]

Hello,

I added this part of logs:

************* The time when the drives goes innaccessible*****************

tsm: CH06FLEUTIVOLI>q drive

Library Name Drive Name Device Type On-Line
------------ ------------ ----------- -------------------
LIB_0 DRIVE_1 LTO Unavailable Since 07/12/2016 12:06:59
LIB_0 DRIVE_2 LTO Unavailable Since 07/12/2016 12:02:29
LIB_0 DRIVE_3 LTO Unavailable Since 07/12/2016 12:05:54
LIB_0 DRIVE_4 LTO Unavailable Since 07/12/2016 12:09:09

***********************************************************************

************** The logs at the same time*********************************

ANR8300E I/O error on library LIB_0 (OP=8401C054, CC=210,
KEY=FF, ASC=FF, ASCQ=FF, SENSE= **NONE**,
Description=The device was reset due to device power-up,
SCSI bus reset, or manual tape load/eject). Refer to the
IBM Tivoli Storage Manager documentation on I/O error
code descriptions. (SESSION: 202245)
07/12/2016 12:06:59 ANR8848W Drive DRIVE_1 of library LIB_0 is inaccessible;
server has begun polling drive. (SESSION: 202245)

***********************************************************************

Hope this help

Thank you

 

[marclant]

Not much more details from that error. What I said in my previous post still applies.

 

[chafik]

Hello,

Thank you very much for the informations, I think you are right about it.

I talked to the Tivoli operator (in charge of moving tape), he mentioned to me that he did the tape rotation for a week (moving tape to the vault/insering others)

Plus getting the logs from the TS3200, takes longer, its been an hour since I started the the logs download.

Thank you

 

[chafik]

Hello,

Thank you Marclant for your Help, you cleared a lot off things for me.

I fixed the issue:
- Stop the Tivoli server
- Restart the library TS3100
- Start the Tivoli Server

The drives were mounted, I had just to update the paths.

Thank you