TSM Windows Server Reboot Caused LTO Library disconnect.

[PowerConvoy]

We were having slow TSM performance and the database backup was taking a lot longer than usual. I rebooted the TSM server and the library just to be safe and now the TSM server performance is back to normal.

The problem I am now experiencing is our LTO6 library cannot be reached. We have one TS3310 tape library that has one changer, 6 LTO4 drives, and 4 LTO6 drives. We have these separated into two logical libraries. LTO4 is the Copy Pool and LT6 is the Tape Pool. We can still reach the LTO4 library just fine but get a serial number mismatch error on the LTO6 library.

These are the errors from the activity log about the LTO6 library:

tsm: TSM01>q act begindate=12/17/2018 search=serial

Date/Time Message
-------------------- ----------------------------------------------------------
12/18/2018 06:17:34 ANR8962E Unable to find path to match the serial number
defined for library LTO6LIB. (SESSION: 1842, PROCESS: 6)
12/18/2018 06:32:39 ANR8962E Unable to find path to match the serial number
defined for library LTO6LIB. (SESSION: 1842, PROCESS: 6)

Both libraries and all drives showed online when using Q PATH and Q DRIVE. I tried to update the LTO6 library but always got an error that it was in use. I researched online and found that this tends to happen sometimes after a reboot and that I may need to delete the paths, drives and library for the LTO6 side and recreate. When I try to do that I get this error when trying to recreate the drive path:

Date/Time Message
-------------------- ----------------------------------------------------------
12/19/2018 13:22:06 ANR8972E DEFINE PATH: Unable to find the element number
for drive LTO6LIB0 in library LTO6LIB. (SESSION: 2415)
12/19/2018 13:26:03 ANR8972E DEFINE PATH: Unable to find the element number
for drive LTO6LIB0 in library LTO6LIB. (SESSION: 2626)


I am not sure what I am doing wrong. My confusion about the library setup is since we have one changer both LTO libraries point to \\.\Changer0 I did see that after the reboot TSM thought that the LTO6 library changer had changed itself to \\.\Changer1 and the serial numbers are different. Since we only have one changer shouldn't the serial numbers be the same for both?

Library LTOLIB (type SCSI):
refCount=0, online=0, updateCount=0
basicCfgBuilt=1, libInfoBuild=0, definingPathToLibrary=0
addLibPath=0, borrowedDrives=0
passthru=0
library extension at 00000000048074B0
Serial Number: (000001324292_LLB)
WWN: *EMPTY*
SCSI library scanInProgress=0, relabelScratch=0
autochanger list:
dev=\\.\Changer0, busy=0, online=0

Library LTO6LIB (type SCSI):
refCount=0, online=1, updateCount=0
basicCfgBuilt=1, libInfoBuild=1, definingPathToLibrary=0
addLibPath=0, borrowedDrives=0
passthru=0
library extension at 00000000048072D0
Serial Number: (000001324292_LLA)
WWN: *EMPTY*
SCSI library scanInProgress=0, relabelScratch=0
autochanger list:
dev=Changer0, busy=0, online=1

I only see one changer serial number when using the IBM Tape Diagnostic Tool.

IBM Tape Diagnostic Tool Standard Edition - Device List

Host Bus ID LUN Model Serial Ucode Changer [#]
+----+----+----+----+----+--------------+------------+------+------------+-+
| 0 | 2 | 0 | 0 | 0 | ULT3580-TD4 | 1310291094 | C7QH | 1324292_LLB| |
| 1 | 2 | 0 | 1 | 0 | ULT3580-TD4 | 9311245362 | C7QH | 1324292_LLB| |
| 2 | 2 | 0 | 1 | 1 | 3576-MTL | 1324292_LLB| 660G | | |
| 3 | 2 | 0 | 2 | 0 | ULT3580-TD4 | 1310291143 | C7QH | 1324292_LLB| |
| 4 | 2 | 0 | 3 | 0 | ULT3580-TD6 | 10WT041611 | E6R6 | | |
| 5 | 2 | 0 | 4 | 0 | ULT3580-TD6 | 10WT033952 | E6R6 | | |
| 6 | 4 | 0 | 0 | 0 | ULT3580-TD4 | 1310085855 | C7QH | 1324292_LLB| |
| 7 | 4 | 0 | 1 | 0 | ULT3580-TD4 | 1310291145 | C7QH | 1324292_LLB| |
| 8 | 4 | 0 | 2 | 0 | ULT3580-TD4 | 1310291107 | C7QH | 1324292_LLB| |
| 9 | 4 | 0 | 3 | 0 | ULT3580-TD6 | 10WT041462 | E6R6 | | |
| 10 | 4 | 0 | 4 | 0 | ULT3580-TD6 | 10WT033803 | E6R6 | | |
| 11 | | | | | | | | | |
+----+----+----+----+----+--------------+------------+------+------------+-+

Any help you could provide would be greatly appreciated. I have exhasted my knowledge and google fu on this and still have an inaccessible library.

 

[RecoveryOne]

So I have a TS3310 split between a CommVault and a TSM server. CommVault is Windows, and TSM is AIX and I can state with reasonable confidence that you are seeing the control paths for Logical LIB_A and LIB_B.
Your serial number for the changers will be different as you must designate a drive to be the control path from the TS3310 GUI per logical library.

Have you tried update library <lib name> libt=scsi ser=autodetect ?
**EDIT:
If the update works, afterwards you may need to run an audit library libr=<lib name> checkl=barcode refreshstate=yes
The refreshstate updates your tsm servers information about the library.

 

[PowerConvoy]

Of course after I make this post I get it figured out. Got some phone help from an engineer that knows the library and the control path for the LTO6 library somehow got removed. Once I set the control path back up I was able to redefine the library and drives. I am back up and running!

 

[RecoveryOne]

Cool. Glad you are back online.