storage media inaccessible

[warineeh]

AIX 5.2.0.0.09
TSM Version 5, Release 2, Level 2.5

For this backup, It use 2 drive via LAN Free. Everyday I check in 2 tape.
example SAPXX1, SAPXX2

I have SAP backup broblem via TSM. The SAP backup log was showed
BKI5008E: Tivoli Storage Manager Error:
ANS1312E (RC12) Server media mount not possible
BR280I Time stamp 2007-10-09 02.29.31
#END /oracle/PRD/sapdata10/clud_35/clud.data35
#END /oracle/PRD/sapdata11/clud_22/clud.data22
#END /oracle/PRD/sapdata11/clud_23/clud.data23
BR317I 'Alter tablespace PSAPCLUD end backup' successful
BR280I Time stamp 2007-10-09 02.29.32
BKI5008E: Tivoli Storage Manager Error:
ANS1312E (RC12) Server media mount not possible

then, I checked TSM log. It show below this before it was terminated
10/09/07 02:19:16 ANR0408I Session 10379 started for server SAPPRD_SA (AIX-
RS/6000) (Tcp/Ip) for library sharing. (SESSION: 10379)
10/09/07 02:19:16 ANR0408I Session 10380 started for server SAPPRD_SA (AIX-
RS/6000) (Tcp/Ip) for library sharing. (SESSION: 10380)
10/09/07 02:19:16 ANR0409I Session 10379 ended for server SAPPRD_SA (AIX-RS
/6000). (SESSION: 10379)
10/09/07 02:19:16 ANR0408I Session 10381 started for server SAPPRD_SA (AIX-
RS/6000) (Tcp/Ip) for library sharing. (SESSION: 10379)
10/09/07 02:19:34 ANR0409I Session 10381 ended for server SAPPRD_SA (AIX-RS
/6000). (SESSION: 10379)
10/09/07 02:19:34 ANR8336I Verifying label of LTO volume SAP131 in drive DR
.LTO5_G2 (/dev/rmt4). (SESSION: 10377)
10/09/07 02:20:04 ANR8468I LTO volume SAP131 dismounted from drive DR.LTO5_
G2 (/dev/rmt4) in library LB.3583_G2. (SESSION: 10377)
10/09/07 02:20:08 ANR9790W Request to mount volume *SCRATCH* for library cl
ient SAPPRD_SA failed. (SESSION: 10380)
10/09/07 02:20:08 ANR0409I Session 10380 ended for server SAPPRD_SA (AIX-RS
/6000). (SESSION: 10380)
10/09/07 02:20:12 ANR0525W Transaction failed for session 10370 for node SA
PPRD (TDP R3 AIX) - storage media inaccessible. (SESSION:
10370)
10/09/07 02:20:12 ANR0514I Session 10370 closed volume SAP131. (SESSION: 10
370)
10/09/07 02:20:15 ANR0408I Session 10382 started for server SAPPRD_SA (AIX-
RS/6000) (Tcp/Ip) for library sharing. (SESSION: 10382)
10/09/07 02:20:41 ANR0408I Session 10383 started for server SAPPRD_SA (AIX-
RS/6000) (Tcp/Ip) for library sharing. (SESSION: 10383)
10/09/07 02:20:41 ANR0514I Session 10018 closed volume SAP132. (SESSION: 10
018)
10/09/07 02:20:41 ANR0408I Session 10384 started for server SAPPRD_SA (AIX-
RS/6000) (Tcp/Ip) for library sharing. (SESSION: 10384)
10/09/07 02:20:41 ANR0409I Session 10383 ended for server SAPPRD_SA (AIX-RS
/6000). (SESSION: 10383)
10/09/07 02:20:41 ANR0409I Session 10384 ended for server SAPPRD_SA (AIX-RS
/6000). (SESSION: 10384)
10/09/07 02:20:41 ANR0403I Session 10017 ended for node SAPPRD (TDP R3 AIX).
(SESSION: 10017)
10/09/07 02:20:42 ANR0403I Session 10018 ended for node SAPPRD (TDP R3 AIX).
(SESSION: 10018)
10/09/07 02:20:43 ANR8337I LTO volume SAP131 mounted in drive DR.LTO5_G2 (/
dev/rmt4). (SESSION: 10382)
10/09/07 02:20:43 ANR0409I Session 10382 ended for server SAPPRD_SA (AIX-RS
/6000). (SESSION: 10382)
10/09/07 02:20:43 ANR0511I Session 10370 opened output volume SAP131. (SESS
ION: 10370)
10/09/07 02:21:10 ANR0406I Session 10385 started for node SAPPRD (TDP R3 AI
X) (Tcp/Ip ahor3002(61426)). (SESSION: 10385)
10/09/07 02:21:12 ANR0408I Session 10386 started for server SAPPRD_SA (AIX-
RS/6000) (Tcp/Ip) for storage agent. (SESSION: 10386)
10/09/07 02:21:12 ANR0415I Session 10386 proxied by SAPPRD_SA started for n
ode SAPPRD. (SESSION: 10386)
10/09/07 02:21:14 ANR0408I Session 10387 started for server SAPPRD_SA (AIX-
RS/6000) (Tcp/Ip) for library sharing. (SESSION: 10387)
10/09/07 02:21:14 ANR0408I Session 10388 started for server SAPPRD_SA (AIX-
RS/6000) (Tcp/Ip) for library sharing. (SESSION: 10388)
10/09/07 02:21:14 ANR0409I Session 10387 ended for server SAPPRD_SA (AIX-RS
/6000). (SESSION: 10387)
10/09/07 02:21:16 ANR0409I Session 10388 ended for server SAPPRD_SA (AIX-RS
/6000). (SESSION: 10388)
10/09/07 02:21:16 ANR0511I Session 10386 opened output volume SAP132. (SESS
ION: 10386)
10/09/07 02:21:38 ANR0408I Session 10389 started for server SAPPRD_SA (AIX-
RS/6000) (Tcp/Ip) for library sharing. (SESSION: 10389)
10/09/07 02:21:38 ANR0409I Session 10389 ended for server SAPPRD_SA (AIX-RS
/6000). (SESSION: 10389)
10/09/07 02:23:44 ANR0408I Session 10390 started for server SAPPRD_SA (AIX-
RS/6000) (Tcp/Ip) for library sharing. (SESSION: 10390)
10/09/07 02:23:45 ANR0409I Session 10390 ended for server SAPPRD_SA (AIX-RS
/6000). (SESSION: 10390)
10/09/07 02:23:45 ANR0408I Session 10392 started for server SAPPRD_SA (AIX-
RS/6000) (Tcp/Ip) for library sharing. (SESSION: 10392)
10/09/07 02:23:45 ANR0408I Session 10391 started for server SAPPRD_SA (AIX-
RS/6000) (Tcp/Ip) for library sharing. (SESSION: 10390)
10/09/07 02:24:02 ANR0409I Session 10391 ended for server SAPPRD_SA (AIX-RS
/6000). (SESSION: 10390)
10/09/07 02:24:02 ANR8336I Verifying label of LTO volume SAP131 in drive DR
.LTO5_G2 (/dev/rmt4). (SESSION: 10382)
10/09/07 02:24:33 ANR8468I LTO volume SAP131 dismounted from drive DR.LTO5_
G2 (/dev/rmt4) in library LB.3583_G2. (SESSION: 10382)
10/09/07 02:24:38 ANR9790W Request to mount volume *SCRATCH* for library cl
ient SAPPRD_SA failed. (SESSION: 10392)
10/09/07 02:24:38 ANR0409I Session 10392 ended for server SAPPRD_SA (AIX-RS
/6000). (SESSION: 10392)
10/09/07 02:24:41 ANR0525W Transaction failed for session 10370 for node SA
PPRD (TDP R3 AIX) - storage media inaccessible. (SESSION:
10370)
10/09/07 02:24:41 ANR0514I Session 10370 closed volume SAP131. (SESSION: 10
370)


Why the log show "PPRD (TDP R3 AIX) - storage media inaccessible"
I rebackup again It s OK.
What was this problem occured from?
Please help me to recommand this case ka.

Thank you

 

[rchoudarapu]

Recently we have seen this (ANS1312E (RC12) Server media mount not possible) when we lost access to our tape library...

 

[ttrinh7975]

Check your library and devices path...of course, check your physical connections...

 

[warineeh]

BKI0053I: Time: 10/10/07 01:17:56 Object: 1 of 190 done: /oracle/PRD/sapdata22/prdbtab2_17/prdbtab2.data17 with
BKI0023I: Time: 10/10/07 01:17:56 Done: 89.000 GB (5.7 %) of 1566.736 GB. Estimated end time: 10/10/07 06:01:01
BKI0053I: Time: 10/10/07 01:17:56 Object: 5 of 190 done: /oracle/PRD/sapdata18/prdbtab2_1/prdbtab2.data1 with:
BKI0400I: TDP is waiting for BRBACKUP.
BKI0400I: TDP is waiting for BRBACKUP.
BKI0400I: TDP is waiting for BRBACKUP.
BKI0400I: TDP is waiting for BRBACKUP.


It show TDP is waiting for long time. I check drive and path. They re OK.
It try on backup new session while the old session showed "TDP is waiting for BRBACKUP" I can backup from new session but the old session still waiting... How could i check any more? This case occure 3 time for this week. Please help me to recommand ka

Thank you ka

 

[Harry_Redl]

Hi,

monitor the storage agent during the operation using "dsmadmc -console -optfile=<opt_file_poniting_to_STAgent>"
user and password are the same as on the parent TSM server
IMHO you will find the error there
Had similar error when during Oracle backup and it was in wrong pathing between STAgent and library .... this approach revealed the exact error
Does anyone know, if STAgent's actlog can be viewed other way? As STAgent does not have DB to store messages in .... IMHO this is the only way - online.

Hope it helps

Harry

 

[warineeh]

Dear All

If I try to backup it again, the backup is complete.
I must schedule the backup via SAP(Allonline) every night in order not to load perfermance in all day. But I could not backup it completely for 4 days. The SAP backup error log was showed

BKI0023I: Time: 10/11/07 05:26:15 Done: 1561.736 GB (99.6 %) of 1567.713 GB. Estimated end time: 10/11/0
BKI0053I: Time: 10/11/07 05:26:15 Object: 190 of 190 done: /oracle/PRD/sapdata12/user1d_2/user1d.data2 w
BR280I Time stamp 2007-10-11 05.26.15
#END /oracle/PRD/sapdata12/user1d_2/user1d.data2
BR317I 'Alter tablespace PSAPUSER1D end backup' successful
BR280I Time stamp 2007-10-11 05.26.16
BR280I Time stamp 2007-10-11 05.26.16
#FILE..... /oracle/PRD/sapdata12/user1d_2/user1d.data2
#SAVED.... PRD___A0F7M7JE10

While the action log was shown on TSM.
10/11/07 05:11:37 ANR8468I LTO volume SAP151 dismounted from drive DR.LTO5_
G2 (/dev/rmt4) in library LB.3583_G2. (SESSION: 3194)
10/11/07 05:11:41 ANR9790W Request to mount volume *SCRATCH* for library cl
ient SAPPRD_SA failed. (SESSION: 3257)
10/11/07 05:11:42 ANR0409I Session 3257 ended for server SAPPRD_SA (AIX-RS/
6000). (SESSION: 3257)
10/11/07 05:11:42 ANR0525W Transaction failed for session 3223 for node SAP
PRD (TDP R3 AIX) - storage media inaccessible. (SESSION:
3223)
10/11/07 05:11:42 ANR0514I Session 3223 closed volume SAP151. (SESSION: 322
3)
10/11/07 05:11:45 ANR0408I Session 3258 started for server SAPPRD_SA (AIX-R
S/6000) (Tcp/Ip) for library sharing. (SESSION: 325
10/11/07 05:12:14 ANR8337I LTO volume SAP151 mounted in drive DR.LTO5_G2 (/
dev/rmt4). (SESSION: 325
10/11/07 05:12:14 ANR0409I Session 3258 ended for server SAPPRD_SA (AIX-RS/
6000). (SESSION: 325
10/11/07 05:12:14 ANR0511I Session 3223 opened output volume SAP151. (SESSI
ON: 3223)
10/11/07 05:12:43 ANR0408I Session 3259 started for server SAPPRD_SA (AIX-R
S/6000) (Tcp/Ip) for library sharing. (SESSION: 3259)
10/11/07 05:12:44 ANR0409I Session 3259 ended for server SAPPRD_SA (AIX-RS/
6000). (SESSION: 3259)
10/11/07 05:14:42 ANR0408I Session 3260 started for server SAPPRD_SA (AIX-R
S/6000) (Tcp/Ip) for library sharing. (SESSION: 3260)
10/11/07 05:14:43 ANR0409I Session 3260 ended for server SAPPRD_SA (AIX-RS/
6000). (SESSION: 3260)
10/11/07 05:14:43 ANR0408I Session 3261 started for server SAPPRD_SA (AIX-R
S/6000) (Tcp/Ip) for library sharing. (SESSION: 3261)
10/11/07 05:14:43 ANR0408I Session 3262 started for server SAPPRD_SA (AIX-R
S/6000) (Tcp/Ip) for library sharing. (SESSION: 3260)
10/11/07 05:15:01 ANR0409I Session 3262 ended for server SAPPRD_SA (AIX-RS/
6000). (SESSION: 3260)
10/11/07 05:15:01 ANR8336I Verifying label of LTO volume SAP151 in drive DR
.LTO5_G2 (/dev/rmt4). (SESSION: 325
10/11/07 05:15:31 ANR8468I LTO volume SAP151 dismounted from drive DR.LTO5_
G2 (/dev/rmt4) in library LB.3583_G2. (SESSION: 325
10/11/07 05:15:36 ANR9790W Request to mount volume *SCRATCH* for library cl
ient SAPPRD_SA failed. (SESSION: 3261)
10/11/07 05:15:36 ANR0409I Session 3261 ended for server SAPPRD_SA (AIX-RS/
6000). (SESSION: 3261)
10/11/07 05:15:39 ANR0525W Transaction failed for session 3223 for node SAP
PRD (TDP R3 AIX) - storage media inaccessible. (SESSION:
3223)
10/11/07 05:15:39 ANR0514I Session 3223 closed volume SAP151. (SESSION: 322
3)
10/11/07 05:15:49 ANR0408I Session 3263 started for server SAPPRD_SA (AIX-R
S/6000) (Tcp/Ip) for library sharing. (SESSION: 3263)
10/11/07 05:15:49 ANR0409I Session 3263 ended for server SAPPRD_SA (AIX-RS/
6000). (SESSION: 3263)
10/11/07 05:15:50 ANR0403I Session 3222 ended for node SAPPRD (TDP R3 AIX).
(SESSION: 3222)
10/11/07 05:15:50 ANR0403I Session 3223 ended for node SAPPRD (TDP R3 AIX).
(SESSION: 3223)

I use "dsmc s /home/ -subdir", The result is work. But The old backup could not backup. It still is waited at 99.6% for 4 hours!!!! I check session, it show

Sess Comm. Sess Wait Bytes Bytes Sess Platform Client Name
Number Meth State Time Sent Recvd Type
od
------ ------ ------ ------ ------- ------- ----- -------- --------------------
285 Tcp/Ip IdleW 9 S 261.8 K 117.0 K Serv AIX-RS/ SAPPRD_SA
er 6000
3,536 HTTP Run 0 S 0 0 Admin WebBrow ADMIN
ser

How could I check it???
(Yesterday I kill backup process and I Backup it again. It is OK. I don't have to kill everytimes.)

Thank you so much

 

[sunny19]

Dear All

If I try to backup it again, the backup is complete.
I must schedule the backup via SAP(Allonline) every night in order not to load perfermance in all day. But I could not backup it completely for 4 days. The SAP backup error log was showed

BKI0023I: Time: 10/11/07 05:26:15 Done: 1561.736 GB (99.6 %) of 1567.713 GB. Estimated end time: 10/11/0
BKI0053I: Time: 10/11/07 05:26:15 Object: 190 of 190 done: /oracle/PRD/sapdata12/user1d_2/user1d.data2 w
BR280I Time stamp 2007-10-11 05.26.15
#END /oracle/PRD/sapdata12/user1d_2/user1d.data2
BR317I 'Alter tablespace PSAPUSER1D end backup' successful
BR280I Time stamp 2007-10-11 05.26.16
BR280I Time stamp 2007-10-11 05.26.16
#FILE..... /oracle/PRD/sapdata12/user1d_2/user1d.data2
#SAVED.... PRD___A0F7M7JE10

While the action log was shown on TSM.
10/11/07 05:11:37 ANR8468I LTO volume SAP151 dismounted from drive DR.LTO5_
G2 (/dev/rmt4) in library LB.3583_G2. (SESSION: 3194)
10/11/07 05:11:41 ANR9790W Request to mount volume *SCRATCH* for library cl
ient SAPPRD_SA failed. (SESSION: 3257)
10/11/07 05:11:42 ANR0409I Session 3257 ended for server SAPPRD_SA (AIX-RS/
6000). (SESSION: 3257)
10/11/07 05:11:42 ANR0525W Transaction failed for session 3223 for node SAP
PRD (TDP R3 AIX) - storage media inaccessible. (SESSION:
3223)
10/11/07 05:11:42 ANR0514I Session 3223 closed volume SAP151. (SESSION: 322
3)
10/11/07 05:11:45 ANR0408I Session 3258 started for server SAPPRD_SA (AIX-R
S/6000) (Tcp/Ip) for library sharing. (SESSION: 325
10/11/07 05:12:14 ANR8337I LTO volume SAP151 mounted in drive DR.LTO5_G2 (/
dev/rmt4). (SESSION: 325
10/11/07 05:12:14 ANR0409I Session 3258 ended for server SAPPRD_SA (AIX-RS/
6000). (SESSION: 325
10/11/07 05:12:14 ANR0511I Session 3223 opened output volume SAP151. (SESSI
ON: 3223)
10/11/07 05:12:43 ANR0408I Session 3259 started for server SAPPRD_SA (AIX-R
S/6000) (Tcp/Ip) for library sharing. (SESSION: 3259)
10/11/07 05:12:44 ANR0409I Session 3259 ended for server SAPPRD_SA (AIX-RS/
6000). (SESSION: 3259)
10/11/07 05:14:42 ANR0408I Session 3260 started for server SAPPRD_SA (AIX-R
S/6000) (Tcp/Ip) for library sharing. (SESSION: 3260)
10/11/07 05:14:43 ANR0409I Session 3260 ended for server SAPPRD_SA (AIX-RS/
6000). (SESSION: 3260)
10/11/07 05:14:43 ANR0408I Session 3261 started for server SAPPRD_SA (AIX-R
S/6000) (Tcp/Ip) for library sharing. (SESSION: 3261)
10/11/07 05:14:43 ANR0408I Session 3262 started for server SAPPRD_SA (AIX-R
S/6000) (Tcp/Ip) for library sharing. (SESSION: 3260)
10/11/07 05:15:01 ANR0409I Session 3262 ended for server SAPPRD_SA (AIX-RS/
6000). (SESSION: 3260)
10/11/07 05:15:01 ANR8336I Verifying label of LTO volume SAP151 in drive DR
.LTO5_G2 (/dev/rmt4). (SESSION: 325
10/11/07 05:15:31 ANR8468I LTO volume SAP151 dismounted from drive DR.LTO5_
G2 (/dev/rmt4) in library LB.3583_G2. (SESSION: 325
10/11/07 05:15:36 ANR9790W Request to mount volume *SCRATCH* for library cl
ient SAPPRD_SA failed. (SESSION: 3261)
10/11/07 05:15:36 ANR0409I Session 3261 ended for server SAPPRD_SA (AIX-RS/
6000). (SESSION: 3261)
10/11/07 05:15:39 ANR0525W Transaction failed for session 3223 for node SAP
PRD (TDP R3 AIX) - storage media inaccessible. (SESSION:
3223)
10/11/07 05:15:39 ANR0514I Session 3223 closed volume SAP151. (SESSION: 322
3)
10/11/07 05:15:49 ANR0408I Session 3263 started for server SAPPRD_SA (AIX-R
S/6000) (Tcp/Ip) for library sharing. (SESSION: 3263)
10/11/07 05:15:49 ANR0409I Session 3263 ended for server SAPPRD_SA (AIX-RS/
6000). (SESSION: 3263)
10/11/07 05:15:50 ANR0403I Session 3222 ended for node SAPPRD (TDP R3 AIX).
(SESSION: 3222)
10/11/07 05:15:50 ANR0403I Session 3223 ended for node SAPPRD (TDP R3 AIX).
(SESSION: 3223)

I use "dsmc s /home/ -subdir", The result is work. But The old backup could not backup. It still is waited at 99.6% for 4 hours!!!! I check session, it show

Sess Comm. Sess Wait Bytes Bytes Sess Platform Client Name
Number Meth State Time Sent Recvd Type
od
------ ------ ------ ------ ------- ------- ----- -------- --------------------
285 Tcp/Ip IdleW 9 S 261.8 K 117.0 K Serv AIX-RS/ SAPPRD_SA
er 6000
3,536 HTTP Run 0 S 0 0 Admin WebBrow ADMIN
ser

How could I check it???
(Yesterday I kill backup process and I Backup it again. It is OK. I don't have to kill everytimes.)

Thank you so much

We had this issue with one of our storage agents,The problem was with the tape devices attached to a LAN-Free adapter,They were all in Defined state.They had to run cfgmgr and the devices were back available.