ADSM-L

Re: [ADSM-L] Tapes appear not present in library, but are physically in the library ????

2008-06-06 13:09:25
Subject: Re: [ADSM-L] Tapes appear not present in library, but are physically in the library ????
From: Joni Moyer <joni.moyer AT HIGHMARK DOT COM>
To: ADSM-L AT VM.MARIST DOT EDU
Date: Fri, 6 Jun 2008 13:07:36 -0400
Hi Chel!

I sent the info. to support AT greshamstorage DOT com, but I'm not sure where to
find the EDT diagnostics log.  You should have all of the other info.
requested.  Thanks so much!

********************************
Joni Moyer
Highmark
Storage Systems, Storage Mngt Analyst III
Phone Number: (717)302-9966
Fax: (717) 302-9826
joni.moyer AT highmark DOT com
********************************



"Support - US" <support AT GRESHAMSTORAGE DOT COM>
Sent by: "ADSM: Dist Stor Manager" <ADSM-L AT VM.MARIST DOT EDU>
06/06/2008 12:54 PM
Please respond to
"ADSM: Dist Stor Manager" <ADSM-L AT VM.MARIST DOT EDU>


To
ADSM-L AT VM.MARIST DOT EDU
cc

Subject
Re: Tapes appear not present in library, but are physically in the library
????






Joni,
   Are you using any sort of volume access control on ACSLS?
Since you haven't attempted to remove the volumes from the
library, the next most common cause would be that access
to the volumes has been denied to EDT by ACSLS.  It's also
possible that there's something else going on, but I would need
to see the elm.conf file, EDT diagnostic log and TSM activity
log for today to determine what errors EDT is getting back from
ACSLS when we request the volume.

   If you wish you can email the files to us at support AT
greshamstorage DOT com, and I'll take a look at them.

Best Regards,
'Chel

Michel Huber
Gresham EDT Level 3 Support

________________________________

From: ADSM: Dist Stor Manager on behalf of Joni Moyer
Sent: Fri 6/6/2008 11:51 AM
To: ADSM-L AT VM.MARIST DOT EDU
Subject: Re: [ADSM-L] Tapes appear not present in library, but are
physically in the library ????



Hi Gerald,

The tapes are in slots within the library and are not currently in drives.
 We ran an ACSLS audit to clean up any discrepancies.  I've also found
some more interesting information.  It looks like at 2:02 AM this tape
dismounted from the drive.  Then at 2:30AM a request came in to mount the
same tape and from the ACSLS logs it shows that it mounted T03735 in drive
0,2,1,7 and dismounted it not even a minute later, but TSM reported the
ANR8313E message that it was not present in the library.  I then had our
operators eject the tape and re-enter it just in case there were still any
issues.  At this point I don't really know where the problem lies.  I
would assume it's not the library as it did mount the tape when requested.
 I think I'm going to open a ticket with IBM to see what they say as I do
not see any definitive answers within the logs.

If anyone can think of anything just let me know.  Thanks!

Date/Time             Message
--------------------
----------------------------------------------------------
06/05/08 00:00:39     ANR8337I LTO volume T03735 mounted in drive SL8500

                       (/dev/rmt18). (SESSION: 504916, PROCESS: 18281)
06/05/08 00:00:56     ANR1340I Scratch volume T03735 is now defined in
storage
                       pool COPY_ORACLE. (SESSION: 504916, PROCESS: 18281)

06/05/08 00:00:59     ANR0513I Process 18281 opened output volume T03735.

                       (SESSION: 504916, PROCESS: 18281)
06/05/08 02:00:04     ANR0514I Session 504916 closed volume T03735.
(SESSION:
                       504916)
06/05/08 02:01:04     ANR8325I Dismounting volume T03735 - 1 minute mount

                       retention expired.
06/05/08 02:01:10     ANR8336I Verifying label of LTO volume T03735 in
drive
                       SL8500 (/dev/rmt18). (SESSION: 504916, PROCESS:
18281)
06/05/08 02:02:13     ANR8468I LTO volume T03735 dismounted from drive
SL8500
                       (/dev/rmt18) in library SL8500. (SESSION: 504916,

                       PROCESS: 18281)
06/05/08 02:31:15     ANR8313E Volume T03735 is not present in library
SL8500.
                       (SESSION: 506649, PROCESS: 18290)
06/05/08 02:31:15     ANR1402W Mount request denied for volume T03735 -
volume
                       unavailable. (SESSION: 506649, PROCESS: 18290)
06/05/08 02:31:15     ANR1410W Access mode for volume T03735 now set to
                       "unavailable". (SESSION: 506649, PROCESS: 18290)
06/06/08 08:30:58     ANR2017I Administrator LIDZR8V issued command: QUERY

                       VOLUME t03735 f=d  (SESSION: 558899)
06/06/08 08:31:17     ANR2017I Administrator LIDZR8V issued command: QUERY

                       ACTLOG begind=06/05/2008 begint=02:00 search=t03735

                       (SESSION: 558908)
06/06/08 12:10:29     ANR2017I Administrator LIDZR8V issued command:
UPDATE
                       VOLUME t03735 acc=readw  (SESSION: 560504)
06/06/08 12:10:29     ANR2207I Volume T03735 updated. (SESSION: 560504)
06/06/08 12:20:31     ANR2017I Administrator LIDZR8V issued command: QUERY

                       VOLUME t03735 f=d  (SESSION: 560576)


2008-06-05 00:00:37 MOUNT
T03735 Home 0,2,47,19,0 Drive 0,2,1,1 Client Host Id 157.154.47.18
2008-06-05 02:02:13 DISMOUNT
T03735 Home 0,2,47,19,0 Drive 0,2,1,1 Client Host Id 157.154.47.18

2008-06-05 02:30:42 MOUNT
T03735 Home 0,2,47,19,0 Drive 0,2,1,7 Client Host Id 157.154.47.18
2008-06-05 02:02:13 DISMOUNT
T03735 Home 0,2,47,19,0 Drive 0,2,1,1 Client Host Id 157.154.47.18
2008-06-05 02:30:42 MOUNT
T03735 Home 0,2,47,19,0 Drive 0,2,1,7 Client Host Id 157.154.47.18

2008-06-05 02:31:15 DISMOUNT
T03735 Home 0,2,47,19,0 Drive 0,2,1,7 Client Host Id 157.154.47.18
2008-06-06 10:21:26 EJECT
T03735 Home 0,2,47,19,0 Cap 0,1,0 Client Host Id Local

2008-06-06 10:31:08 ENTER
T03735 Home 0,2,47,1,1 Cap 0,1,0 Client Host Id Local

********************************
Joni Moyer
Highmark
Storage Systems, Storage Mngt Analyst III
Phone Number: (717)302-9966
Fax: (717) 302-9826
joni.moyer AT highmark DOT com
********************************



"Gerald Michalak" <gmichala AT US.IBM DOT COM>
Sent by: "ADSM: Dist Stor Manager" <ADSM-L AT VM.MARIST DOT EDU>
06/06/2008 12:35 PM
Please respond to
"ADSM: Dist Stor Manager" <ADSM-L AT VM.MARIST DOT EDU>


To
ADSM-L AT VM.MARIST DOT EDU
cc

Subject
Re: Tapes appear not present in library, but are physically in the library
????






The first thing I would check is that the tapes are not still in the
drives
via ACSLS command 'q dr all' and 'q vol <vol>'.

The 'q vol' will give you the status and location of the volume.

When you say you ran an audit, was it an ACSLS audit or a TSM audit?

We've had problems where the drive never actually ejected the tape.



Gerald Michalak
Certified TSM V5 Administrator





             Joni Moyer
             <joni.moyer@HIGHM
             ARK.COM>                                                   To
             Sent by: "ADSM:           ADSM-L AT VM.MARIST DOT EDU
             Dist Stor                                                  cc
             Manager"
             <[email protected]                                     Subject
             .EDU>                     Re: [ADSM-L] Tapes appear not
                                       present in library, but are
                                       physically in the library ????
             06/06/2008 09:49
             AM


             Please respond to
             "ADSM: Dist Stor
                 Manager"
             <[email protected]
                   .EDU>






Hi Anil,

No, there were no checkouts being done against this tape or any of the
others that I have seen experience this error.  I have narrowed it down to
6 tape drives within the library, most of which are happening on 3.  As
you see below the tape is mounted/dismounted ok and then several hrs.
later it is requested to be mounted again and it says it's not present in
the library when in fact it is.  I have been looking at 25 tapes for this
past week which have experienced this issue and it is all the same.  The
tape is physically in the library (I have checked through ACSLS which is
the software that controls the SUN SL8500) and we also did an audit of the
library at the beginning of the week to resolve this issue, but that
doesn't appear to have helped.  I'm having the vendor of the tape drives
check out the 6 drives to see if it is a hardware issue with the drives or
a robot in the library or something...  but I can't pinpoint what is
causing this issue yet.

Thanks!

********************************
Joni Moyer
Highmark
Storage Systems, Storage Mngt Analyst III
Phone Number: (717)302-9966
Fax: (717) 302-9826
joni.moyer AT highmark DOT com
********************************



"Anil Maurya" <Anil.Maurya AT SANOFI-AVENTIS DOT COM>
Sent by: "ADSM: Dist Stor Manager" <ADSM-L AT VM.MARIST DOT EDU>
06/06/2008 10:41 AM
Please respond to
"ADSM: Dist Stor Manager" <ADSM-L AT VM.MARIST DOT EDU>


To
ADSM-L AT VM.MARIST DOT EDU
cc

Subject
Re: Tapes appear not present in library, but are physically in the library
????






Looks like someting happened between 06/05/08 01:25:26 and 06/05/08
05:26:07. Did you checkout using option remove=no ?

Good luck


-----Original Message-----
From: ADSM: Dist Stor Manager [mailto:ADSM-L AT VM.MARIST DOT EDU] On Behalf Of
Joni Moyer
Sent: Friday, June 06, 2008 8:40 AM
To: ADSM-L AT VM.MARIST DOT EDU
Subject: [ADSM-L] Tapes appear not present in library, but are
physically in the library ????

Hi Everyone,

I have a TSM server 5.3.5.2 on AIX 5.3 with an external library which is
a SUN SL8500 and Gresham EDT manages the drive requests.  I have come
across an issue where the tape is physically in the library, but TSM
says that it is not present.  Any ideas/suggestions on what can be done?
Thanks in advance!

Date/Time             Message
--------------------
----------------------------------------------------------
06/05/08 01:01:33     ANR8337I LTO volume T04269 mounted in drive SL8500

                       (/dev/rmt5). (SESSION: 505692, PROCESS: 18285)
06/05/08 01:01:33     ANR0513I Process 18285 opened output volume
T04269.

                       (SESSION: 505692, PROCESS: 18285)
06/05/08 01:23:36     ANR0514I Session 505692 closed volume T04269.
(SESSION:
                       505692)
06/05/08 01:24:36     ANR8325I Dismounting volume T04269 - 1 minute
mount

                       retention expired.
06/05/08 01:24:41     ANR8336I Verifying label of LTO volume T04269 in
drive
                       SL8500 (/dev/rmt5). (SESSION: 505692, PROCESS:
18285)
06/05/08 01:25:26     ANR8468I LTO volume T04269 dismounted from drive
SL8500
                       (/dev/rmt5) in library SL8500. (SESSION: 505692,
PROCESS:
                       18285)
06/05/08 05:26:07     ANR8313E Volume T04269 is not present in library
SL8500.
                       (SESSION: 507496, PROCESS: 18312)
06/05/08 05:26:07     ANR1402W Mount request denied for volume T04269 -
volume
                       unavailable. (SESSION: 507496, PROCESS: 18312)
06/05/08 05:26:07     ANR1410W Access mode for volume T04269 now set to
                       "unavailable". (SESSION: 507496, PROCESS: 18312)
06/06/08 08:35:27     ANR2017I Administrator LIDZR8V issued command:
QUERY

                       VOLUME t04269 f=d  (SESSION: 558950)




ACSSA> display volume t04269
2008-06-06 08:36:04              Display Volume
 Vol_id  Acs  Lsm  Panel  Row  Column  Pool   Status    Media     Type
 T04269  0    1    17     3    0       100    home      LTO-200G  data
********************************
Joni Moyer
Highmark
Storage Systems, Storage Mngt Analyst III Phone Number: (717)302-9966
Fax: (717) 302-9826
joni.moyer AT highmark DOT com
********************************