Hi All,
I am having issue with TDP SAP backup.
We are having daily,weekly full and log backup for this server . But we are facind issue with only weekly full backup.Backup is starting, but it failing after some time.IBM said it network issue and closed.But we are not havind any issue with network.
Total size of DB is around 8 TB.
Please assist on this one.
Error.log
09/16/12 23:53:45 sessSendVerb: Error sending Verb, rc: -50
09/16/12 23:53:45 sessSendVerb: Error sending Verb, rc: -50
09/16/12 23:53:45 ANS1017E Session rejected: TCP/IP connection failure
09/23/12 17:40:06 sessSendVerb: Error sending Verb, rc: -50
09/23/12 17:40:06 sessSendVerb: Error sending Verb, rc: -50
09/23/12 17:40:06 ANS1017E Session rejected: TCP/IP connection failure
09/30/12 22:51:36 ANS1329S Server out of data storage space
09/30/12 22:51:49 ANS1329S Server out of data storage space
10/08/12 14:39:00 sessSendVerb: Error sending Verb, rc: -50
10/08/12 14:39:00 sessSendVerb: Error sending Verb, rc: -50
10/08/12 14:39:00 ANS1017E Session rejected: TCP/IP connection failure
10/15/12 01:46:45 sessSendVerb: Error sending Verb, rc: -50
10/15/12 01:46:45 sessSendVerb: Error sending Verb, rc: -50
10/15/12 01:46:45 ANS1017E Session rejected: TCP/IP connection failure
Backom log:
BKI8806I: Data Protection for SAP(R) - BackOM 6.1.0.2 (367T) Apr 24 2009
BKI2027I: Using TSM-API version 5.5.1.13 (compiled with 5.3.0.0).
BKI8652I: DB2 version 'SQL09055' with 64 bits detected.
BKI8511I: The command is: -c b_db -a FBP -B 14 -S 4 -P 8 -e /db2/FBP/dbs/initFBP_WEEKLY.utl -O
BKI8637I: Full online backup of 'FBP' started ...
BKI8643I: Using vendor library at '/usr/tivoli/tsm/tdp_r3/db264/libtdpdb264.a' ...
BKI8654I: Using an autonomic buffer size with 14 buffers ...
BKI8641I: Using 4 session(s) ...
BKI8642I: Using a degree of parallelism of 8 ...
SQL2062N An error occurred while accessing media "VENDOR". Reason code:
"18".
BKI8548I: Elapsed time: 21 h 15 min 54 sec
BKI8634E: Backup command failed due to an error.
BKI8512I: Return code is: 605
#####################
db2diag.log:
2012-10-15-01.45.10.839861+060 E753020648A546 LEVEL: Warning
PID : 15335632 TID : 178248 PROC : db2sysc 0
INSTANCE: db2fbp NODE : 000 DB : FBP
APPHDL : 0-13591 APPID: 10.144.69.238.47149.12101422450
AUTHID : SAPFBP
EDUID : 178248 EDUNAME: db2agent (FBP) 0
FUNCTION: DB2 UDB, data management, sqldIndexCreate, probe:1
MESSAGE : ADM5541W Rebuilding index with IID "2" in object with ID "1058" and
table space ID "19" on table "SAPFBP ./BI0/ABBP_SC40".
2012-10-15-01.45.10.888015+060 E753021195A520 LEVEL: Warning
PID : 15335632 TID : 178248 PROC : db2sysc 0
INSTANCE: db2fbp NODE : 000 DB : FBP
APPHDL : 0-13591 APPID: 10.144.69.238.47149.12101422450
AUTHID : SAPFBP
EDUID : 178248 EDUNAME: db2agent (FBP) 0
FUNCTION: DB2 UDB, data management, sqldEndIndexCreate, probe:1
MESSAGE : ADM5542W Index rebuild of index(es) on table "SAPFBP
./BI0/ABBP_SC40" completed successfully.
2012-10-15-01.46.45.991244+060 I753021716A754 LEVEL: Error
PID : 15335632 TID : 173629 PROC : db2sysc 0
INSTANCE: db2fbp NODE : 000
EDUID : 173629 EDUNAME: db2med.156189.3 (FBP) 0
FUNCTION: DB2 UDB, database utilities, sqluMapVend2MediaRCWithLog, probe:646
DATA #1 : String, 142 bytes
Vendor error: rc = 18 returned from function sqluvput.
Return_code structure from vendor library /usr/tivoli/tsm/tdp_r3/db264/libtdpdb264.a:
DATA #2 : Hexdump, 48 bytes
0x070000090AE07110 : 0000 0012 5453 4D45 5250 3A20 7772 6974 ....TSMERP: writ
0x070000090AE07120 : 652D 3E45 5843 2100 0000 0000 0000 0000 e->EXC!.........
0x070000090AE07130 : 0000 0000 0000 0000 0000 0000 0000 0000 ................
2012-10-15-01.46.46.639814+060 E753022471A376 LEVEL: Error
PID : 15335632 TID : 173629 PROC : db2sysc 0
INSTANCE: db2fbp NODE : 000
EDUID : 173629 EDUNAME: db2med.156189.3 (FBP) 0
FUNCTION: DB2 UDB, database utilities, sqluMCWriteToDevice, probe:901
MESSAGE : Media controller -- problem during writing to vendor device
2012-10-15-01.46.46.640067+060 E753022848A399 LEVEL: Error
PID : 15335632 TID : 173629 PROC : db2sysc 0
INSTANCE: db2fbp NODE : 000
EDUID : 173629 EDUNAME: db2med.156189.3 (FBP) 0
FUNCTION: DB2 UDB, database utilities, sqluMCWriteToDevice, probe:901
MESSAGE : SQL2062N An error occurred while accessing media "". Reason code:
"".
2012-10-15-01.46.46.640276+060 E753023248A342 LEVEL: Error
PID : 15335632 TID : 173629 PROC : db2sysc 0
INSTANCE: db2fbp NODE : 000
EDUID : 173629 EDUNAME: db2med.156189.3 (FBP) 0
FUNCTION: DB2 UDB, database utilities, sqluMCWriteToDevice, probe:901
DATA #1 : String, 9 bytes
VENDOR.18
2012-10-15-01.46.46.640478+060 E753023591A556 LEVEL: Severe
PID : 15335632 TID : 156189 PROC : db2sysc 0
INSTANCE: db2fbp NODE : 000 DB : FBP
APPHDL : 0-14192 APPID: *LOCAL.db2fbp.121014033159
AUTHID : DB2FBP
EDUID : 156189 EDUNAME: db2agent (FBP) 0
FUNCTION: DB2 UDB, database utilities, sqlubMWResponse, probe:873
DATA #1 : Sqlcode, PD_TYPE_SQLCODE, 4 bytes
-2062
DATA #2 : Hexdump, 14 bytes
0x0700001802403678 : FFFF F7F2 5645 4E44 4F52 FF31 3800 ....VENDOR.18.
2012-10-15-01.46.46.640678+060 E753024148A920 LEVEL: Severe
PID : 15335632 TID : 156189 PROC : db2sysc 0
INSTANCE: db2fbp NODE : 000 DB : FBP
APPHDL : 0-14192 APPID: *LOCAL.db2fbp.121014033159
AUTHID : DB2FBP
EDUID : 156189 EDUNAME: db2agent (FBP) 0
FUNCTION: DB2 UDB, database utilities, sqlubMWResponse, probe:873
MESSAGE : SQL2062N An error occurred while accessing media "". Reason code:
"".
DATA #1 : SQLCA, PD_DB2_TYPE_SQLCA, 136 bytes
sqlcaid : SQLCA sqlcabc: 136 sqlcode: -2062 sqlerrml: 9
sqlerrmc: VENDOR 18
sqlerrp : sqlubMWR
sqlerrd : (1) 0x00000000 (2) 0x00000000 (3) 0x00000000
(4) 0x00000000 (5) 0x00000000 (6) 0x00000000
sqlwarn : (1) (2) (3) (4) (5) (6)
(7) (8) (9) (10) (11)
sqlstate:
2012-10-15-01.46.46.640893+060 E753025069A499 LEVEL: Error
PID : 15335632 TID : 156189 PROC : db2sysc 0
INSTANCE: db2fbp NODE : 000 DB : FBP
APPHDL : 0-14192 APPID: *LOCAL.db2fbp.121014033159
AUTHID : DB2FBP
EDUID : 156189 EDUNAME: db2agent (FBP) 0
FUNCTION: DB2 UDB, database utilities, sqlubMWResponse, probe:875
MESSAGE : SQL2062N An error occurred while accessing media "VENDOR". Reason
code: "18".
Note:
everytime time of backup failed i can see following message in activity log before session failed.
But is not cancelling online full backup,session failed for log backup.
dose it impact the weely full backup.
15/10/12 01:46:45 ANR2998W The server log is 81 percent full. The server has
cancelled the oldest transaction in the log. (SESSION:
86600)
15/10/12 01:46:45 ANR0524W Transaction failed for session 72156 for node
FBP_SAP_WEEKLY (TDP R3 AIX) - data transfer interrupted.
(SESSION: 72156)
15/10/12 01:46:45 ANR2997W The server log is 81 percent full. The server
will delay transactions by 3 milliseconds. (SESSION:
86600)
15/10/12 01:46:46 ANR0514I Session 72156 closed volume DP3258. (SESSION:
72156)
15/10/12 01:46:46 ANR0483W Session 72156 for node FBP_SAP_WEEKLY (TDP R3
AIX) terminated - forced by administrator. (SESSION:
72156)
.
.
.
15/10/12 01:47:03 ANR0403I Session 72158 ended for node FBP_SAP_WEEKLY (TDP
R3 AIX). (SESSION: 72158)
15/10/12 01:47:03 ANR0403I Session 72152 ended for node FBP_SAP_WEEKLY (TDP
R3 AIX). (SESSION: 72152)
15/10/12 01:47:03 ANR0403I Session 87874 ended for node FBP_SAP_WEEKLY (TDP
R3 AIX). (SESSION: 87874)
15/10/12 01:47:03 ANR0403I Session 87875 ended for node FBP_SAP_WEEKLY (TDP
R3 AIX). (SESSION: 87875)
(these are weekly full backup sessions)
I am having issue with TDP SAP backup.
We are having daily,weekly full and log backup for this server . But we are facind issue with only weekly full backup.Backup is starting, but it failing after some time.IBM said it network issue and closed.But we are not havind any issue with network.
Total size of DB is around 8 TB.
Please assist on this one.
Error.log
09/16/12 23:53:45 sessSendVerb: Error sending Verb, rc: -50
09/16/12 23:53:45 sessSendVerb: Error sending Verb, rc: -50
09/16/12 23:53:45 ANS1017E Session rejected: TCP/IP connection failure
09/23/12 17:40:06 sessSendVerb: Error sending Verb, rc: -50
09/23/12 17:40:06 sessSendVerb: Error sending Verb, rc: -50
09/23/12 17:40:06 ANS1017E Session rejected: TCP/IP connection failure
09/30/12 22:51:36 ANS1329S Server out of data storage space
09/30/12 22:51:49 ANS1329S Server out of data storage space
10/08/12 14:39:00 sessSendVerb: Error sending Verb, rc: -50
10/08/12 14:39:00 sessSendVerb: Error sending Verb, rc: -50
10/08/12 14:39:00 ANS1017E Session rejected: TCP/IP connection failure
10/15/12 01:46:45 sessSendVerb: Error sending Verb, rc: -50
10/15/12 01:46:45 sessSendVerb: Error sending Verb, rc: -50
10/15/12 01:46:45 ANS1017E Session rejected: TCP/IP connection failure
Backom log:
BKI8806I: Data Protection for SAP(R) - BackOM 6.1.0.2 (367T) Apr 24 2009
BKI2027I: Using TSM-API version 5.5.1.13 (compiled with 5.3.0.0).
BKI8652I: DB2 version 'SQL09055' with 64 bits detected.
BKI8511I: The command is: -c b_db -a FBP -B 14 -S 4 -P 8 -e /db2/FBP/dbs/initFBP_WEEKLY.utl -O
BKI8637I: Full online backup of 'FBP' started ...
BKI8643I: Using vendor library at '/usr/tivoli/tsm/tdp_r3/db264/libtdpdb264.a' ...
BKI8654I: Using an autonomic buffer size with 14 buffers ...
BKI8641I: Using 4 session(s) ...
BKI8642I: Using a degree of parallelism of 8 ...
SQL2062N An error occurred while accessing media "VENDOR". Reason code:
"18".
BKI8548I: Elapsed time: 21 h 15 min 54 sec
BKI8634E: Backup command failed due to an error.
BKI8512I: Return code is: 605
#####################
db2diag.log:
2012-10-15-01.45.10.839861+060 E753020648A546 LEVEL: Warning
PID : 15335632 TID : 178248 PROC : db2sysc 0
INSTANCE: db2fbp NODE : 000 DB : FBP
APPHDL : 0-13591 APPID: 10.144.69.238.47149.12101422450
AUTHID : SAPFBP
EDUID : 178248 EDUNAME: db2agent (FBP) 0
FUNCTION: DB2 UDB, data management, sqldIndexCreate, probe:1
MESSAGE : ADM5541W Rebuilding index with IID "2" in object with ID "1058" and
table space ID "19" on table "SAPFBP ./BI0/ABBP_SC40".
2012-10-15-01.45.10.888015+060 E753021195A520 LEVEL: Warning
PID : 15335632 TID : 178248 PROC : db2sysc 0
INSTANCE: db2fbp NODE : 000 DB : FBP
APPHDL : 0-13591 APPID: 10.144.69.238.47149.12101422450
AUTHID : SAPFBP
EDUID : 178248 EDUNAME: db2agent (FBP) 0
FUNCTION: DB2 UDB, data management, sqldEndIndexCreate, probe:1
MESSAGE : ADM5542W Index rebuild of index(es) on table "SAPFBP
./BI0/ABBP_SC40" completed successfully.
2012-10-15-01.46.45.991244+060 I753021716A754 LEVEL: Error
PID : 15335632 TID : 173629 PROC : db2sysc 0
INSTANCE: db2fbp NODE : 000
EDUID : 173629 EDUNAME: db2med.156189.3 (FBP) 0
FUNCTION: DB2 UDB, database utilities, sqluMapVend2MediaRCWithLog, probe:646
DATA #1 : String, 142 bytes
Vendor error: rc = 18 returned from function sqluvput.
Return_code structure from vendor library /usr/tivoli/tsm/tdp_r3/db264/libtdpdb264.a:
DATA #2 : Hexdump, 48 bytes
0x070000090AE07110 : 0000 0012 5453 4D45 5250 3A20 7772 6974 ....TSMERP: writ
0x070000090AE07120 : 652D 3E45 5843 2100 0000 0000 0000 0000 e->EXC!.........
0x070000090AE07130 : 0000 0000 0000 0000 0000 0000 0000 0000 ................
2012-10-15-01.46.46.639814+060 E753022471A376 LEVEL: Error
PID : 15335632 TID : 173629 PROC : db2sysc 0
INSTANCE: db2fbp NODE : 000
EDUID : 173629 EDUNAME: db2med.156189.3 (FBP) 0
FUNCTION: DB2 UDB, database utilities, sqluMCWriteToDevice, probe:901
MESSAGE : Media controller -- problem during writing to vendor device
2012-10-15-01.46.46.640067+060 E753022848A399 LEVEL: Error
PID : 15335632 TID : 173629 PROC : db2sysc 0
INSTANCE: db2fbp NODE : 000
EDUID : 173629 EDUNAME: db2med.156189.3 (FBP) 0
FUNCTION: DB2 UDB, database utilities, sqluMCWriteToDevice, probe:901
MESSAGE : SQL2062N An error occurred while accessing media "". Reason code:
"".
2012-10-15-01.46.46.640276+060 E753023248A342 LEVEL: Error
PID : 15335632 TID : 173629 PROC : db2sysc 0
INSTANCE: db2fbp NODE : 000
EDUID : 173629 EDUNAME: db2med.156189.3 (FBP) 0
FUNCTION: DB2 UDB, database utilities, sqluMCWriteToDevice, probe:901
DATA #1 : String, 9 bytes
VENDOR.18
2012-10-15-01.46.46.640478+060 E753023591A556 LEVEL: Severe
PID : 15335632 TID : 156189 PROC : db2sysc 0
INSTANCE: db2fbp NODE : 000 DB : FBP
APPHDL : 0-14192 APPID: *LOCAL.db2fbp.121014033159
AUTHID : DB2FBP
EDUID : 156189 EDUNAME: db2agent (FBP) 0
FUNCTION: DB2 UDB, database utilities, sqlubMWResponse, probe:873
DATA #1 : Sqlcode, PD_TYPE_SQLCODE, 4 bytes
-2062
DATA #2 : Hexdump, 14 bytes
0x0700001802403678 : FFFF F7F2 5645 4E44 4F52 FF31 3800 ....VENDOR.18.
2012-10-15-01.46.46.640678+060 E753024148A920 LEVEL: Severe
PID : 15335632 TID : 156189 PROC : db2sysc 0
INSTANCE: db2fbp NODE : 000 DB : FBP
APPHDL : 0-14192 APPID: *LOCAL.db2fbp.121014033159
AUTHID : DB2FBP
EDUID : 156189 EDUNAME: db2agent (FBP) 0
FUNCTION: DB2 UDB, database utilities, sqlubMWResponse, probe:873
MESSAGE : SQL2062N An error occurred while accessing media "". Reason code:
"".
DATA #1 : SQLCA, PD_DB2_TYPE_SQLCA, 136 bytes
sqlcaid : SQLCA sqlcabc: 136 sqlcode: -2062 sqlerrml: 9
sqlerrmc: VENDOR 18
sqlerrp : sqlubMWR
sqlerrd : (1) 0x00000000 (2) 0x00000000 (3) 0x00000000
(4) 0x00000000 (5) 0x00000000 (6) 0x00000000
sqlwarn : (1) (2) (3) (4) (5) (6)
(7) (8) (9) (10) (11)
sqlstate:
2012-10-15-01.46.46.640893+060 E753025069A499 LEVEL: Error
PID : 15335632 TID : 156189 PROC : db2sysc 0
INSTANCE: db2fbp NODE : 000 DB : FBP
APPHDL : 0-14192 APPID: *LOCAL.db2fbp.121014033159
AUTHID : DB2FBP
EDUID : 156189 EDUNAME: db2agent (FBP) 0
FUNCTION: DB2 UDB, database utilities, sqlubMWResponse, probe:875
MESSAGE : SQL2062N An error occurred while accessing media "VENDOR". Reason
code: "18".
Note:
everytime time of backup failed i can see following message in activity log before session failed.
But is not cancelling online full backup,session failed for log backup.
dose it impact the weely full backup.
15/10/12 01:46:45 ANR2998W The server log is 81 percent full. The server has
cancelled the oldest transaction in the log. (SESSION:
86600)
15/10/12 01:46:45 ANR0524W Transaction failed for session 72156 for node
FBP_SAP_WEEKLY (TDP R3 AIX) - data transfer interrupted.
(SESSION: 72156)
15/10/12 01:46:45 ANR2997W The server log is 81 percent full. The server
will delay transactions by 3 milliseconds. (SESSION:
86600)
15/10/12 01:46:46 ANR0514I Session 72156 closed volume DP3258. (SESSION:
72156)
15/10/12 01:46:46 ANR0483W Session 72156 for node FBP_SAP_WEEKLY (TDP R3
AIX) terminated - forced by administrator. (SESSION:
72156)
.
.
.
15/10/12 01:47:03 ANR0403I Session 72158 ended for node FBP_SAP_WEEKLY (TDP
R3 AIX). (SESSION: 72158)
15/10/12 01:47:03 ANR0403I Session 72152 ended for node FBP_SAP_WEEKLY (TDP
R3 AIX). (SESSION: 72152)
15/10/12 01:47:03 ANR0403I Session 87874 ended for node FBP_SAP_WEEKLY (TDP
R3 AIX). (SESSION: 87874)
15/10/12 01:47:03 ANR0403I Session 87875 ended for node FBP_SAP_WEEKLY (TDP
R3 AIX). (SESSION: 87875)
(these are weekly full backup sessions)