ORACLE TDP ERROR and its failing TCPIP connections failure-ANS1017E (RC-50)

[medasanikk]

Hi guys

I am getting below error, and failing with tcp/ip connection, here one moe thing incremental going fine. Full backup level 0 backup is failing.



Please help me.



Rman log error:



RMAN-00571: ===========================================================

RMAN-00569: =============== ERROR MESSAGE STACK FOLLOWS ===============

RMAN-00571: ===========================================================

RMAN-03015: error occurred in stored script full_backup

RMAN-03007: retryable error occurred during execution of command: backup

RMAN-07004: unhandled exception during command execution on channel tape6

RMAN-10035: exception raised in RPC: ORA-19502: write error on file "dbf_t832033377_s18397_p1", blockno 42200513 (blocksize=1024)

ORA-27030: skgfwrt: sbtwrite2 returned error

ORA-19511: ANS1017E (RC-50) Session rejected: TCP/IP connection failure

RMAN-10031: ORA-19624 occurred during call to DBMS_BACKUP_RESTORE.BACKUPPIECECREATE



Recovery Manager complete.





TSM side errors -TDP

=========================

21.11.2013 09:09:27 ANS1102E Excessive number of command line arguments passed to the program.

21.11.2013 09:09:27 ANS1133W An expression might contain a wildcard not enclosed in quotes.





21.11.2013 09:08:14 sessSendVerb: Error sending Verb, rc: -50

21.11.2013 09:08:21 ANS4994S TDP Oracle HP ANU0599 ANU2602E The object /ccl1_oracledb//dbf_t832033377_s18397_p1 was not found on the TSM Server

21.11.2013 09:19:32 sessSendVerb: Error sending Verb, rc: -50

21.11.2013 09:19:32 sessSendVerb: Error sending Verb, rc: -50

21.11.2013 09:19:33 ANS4994S TDP Oracle HP ANU0599 ANU2602E The object /ccl1_oracledb//dbf_t832033643_s18398_p1 was not found on the TSM Server

21.11.2013 09:31:38 sessSendVerb: Error sending Verb, rc: -50

21.11.2013 09:31:38 sessSendVerb: Error sending Verb, rc: -50

config_files:

OS:HPUX
TDPAgent 5.2.1
TSM CLIENT: 5.2.5.0
TSM server :5.5
OS level is HP-UX
its same tdpo.opt file . file out put as follows:
path:/opt/tivoli/tsm/client/oracle/bin
root@hp15:/opt/tivoli/tsm/client/oracle/bin -: cat tdpo.opt
DSMI_LOG /var/tsm
DSMI_ORC_CONFIG /opt/tivoli/tsm/client/oracle/bin/dsm.opt
TDPO_FS ccl1_oracledb
TDPO_NODE HP15ORACLE
TDPO_OWNER oracle
TDPO_PSWDPATH /opt/tivoli/tsm/client/oracle/bin
TDPO_DATE_FMT 2


dsm.sys
=========================
SErvername server_a
COMMmethod TCPip
TCPPort 1500
TCPServeraddress node.domain.company.COM

*//ADSM_LOCAL_SERVER_STANZA
Servername localSrv
COMMMETHOD TCPIP
TCPPort 1500
TCPServeraddress 172.19.18.19
PASSWORDACCESS GENERATE
SCHEDMODE POLLING
SCHEDLOGNAME /var/tsm/dsmsched.log
SCHEDLOGRETENTION 14 D
QUERYSCHEDPERIOD 12
LARGECOMMBUFFERS yes
ERRORLOGRETENTION 35 D
ERRORLOGNAME /var/tsm/dsmerror.log
NODENAME hp15_new
*//INCLEXCL /var/tsm/inclexcl.list
TXNBYTELIMIT 25600
COMPRESSION OFF
*//END_ADSM_LOCAL_SERVER_STANZA

*//ADSM_ORACLE_SERVER_STANZA
Servername OracleSrv
COMMMETHOD TCPIP
TCPPort 1500
TCPServeraddress 10.179.41.205
PASSWORDACCESS PROMPT
SCHEDMODE POLLING
SCHEDLOGNAME /var/tsm/dsisched.log
SCHEDLOGRETENTION 14 D
QUERYSCHEDPERIOD 12
ERRORLOGRETENTION 35 D
ERRORLOGNAME /var/tsm/dsierror.log
NODENAME HP15ORACLE
TXNBYTELIMIT 25600
COMPRESSION OFF
*//END_ADSM_ORACLE_SERVER_STANZA


DSM.opt file

Servername OracleSrv
*traceflags service
*tracefile /Mnt/apitrace.log

DATEFORMAT 4
QUIET


===========

API folder dsm.sys details- guess these are not required.
path:root@hp15:/opt/tivoli/tsm/client/api/bin

SErvername server_a
COMMmethod TCPip
TCPPort 1500
TCPServeraddress node.domain.company.COM

*//ADSM_LOCAL_SERVER_STANZA
Servername localSrv
COMMMETHOD TCPIP
TCPPort 1500
TCPServeraddress 172.19.18.19
PASSWORDACCESS PROMPT
SCHEDMODE POLLING
SCHEDLOGNAME /var/tsm/dsmsched.log
SCHEDLOGRETENTION 14 D
QUERYSCHEDPERIOD 12
LARGECOMMBUFFERS yes
ERRORLOGRETENTION 35 D
ERRORLOGNAME /var/tsm/dsmerror.log
NODENAME hp15_new
TXNBYTELIMIT 25600
COMPRESSION OFF
*//END_ADSM_LOCAL_SERVER_STANZA

*//ADSM_ORACLE_SERVER_STANZA
Servername OracleSrv
COMMMETHOD TCPIP
TCPPort 1500
TCPServeraddress 10.179.41.205
PASSWORDACCESS PROMPT
SCHEDMODE POLLING
SCHEDLOGNAME /var/tsm/dsisched.log
SCHEDLOGRETENTION 14 D
QUERYSCHEDPERIOD 12
ERRORLOGRETENTION 35 D
ERRORLOGNAME /var/tsm/dsierror.log
NODENAME hp15neworacle
TXNBYTELIMIT 25600
COMPRESSION OFF
*//END_ADSM_ORACLE_SERVER_STANZA

*//ADSM_LOCAL_SERVER_STANZA
Servername localSrv
COMMMETHOD TCPIP
TCPPort 1500
TCPServeraddress 172.19.18.19
PASSWORDACCESS PROMPT
SCHEDMODE POLLING
SCHEDLOGNAME /var/tsm/dsmsched.log
SCHEDLOGRETENTION 14 D
QUERYSCHEDPERIOD 12
LARGECOMMBUFFERS yes
ERRORLOGRETENTION 35 D
ERRORLOGNAME /var/tsm/dsmerror.log
NODENAME HP15-BKM
TXNBYTELIMIT 25600
COMPRESSION OFF
*//END_ADSM_LOCAL_SERVER_STANZA

*//ADSM_ORACLE_SERVER_STANZA
Servername OracleSrv
COMMMETHOD TCPIP
TCPPort 1500
TCPServeraddress 172.19.18.19
PASSWORDACCESS PROMPT
SCHEDMODE POLLING
SCHEDLOGNAME /var/tsm/dsisched.log
SCHEDLOGRETENTION 14 D
QUERYSCHEDPERIOD 12
ERRORLOGRETENTION 35 D
ERRORLOGNAME /var/tsm/dsierror.log
NODENAME HP15-ORACLEM
TXNBYTELIMIT 25600
COMPRESSION OFF
*//END_ADSM_ORACLE_SERVER_STANZA


Steps I have done

1) tdpo showenvi - its connected and outputs showned all the environmentvariables

2) TDPO password - I changes the password and its successfull

3TDPOsync syndb- here I got SQL pLUS error not able to perform.

4) checked the ping server to client and client to server and its able to ping.

5) Dupicate IP check done with network team

6) Recently there is no changes either tsm config's nor Oracle rmanscript.


After these many steps no success

can you please help me the steps to resolve this problem

Regards
medasanikk

 

[gimlet]

Can you give a little more detail on the failed tdposync syncdb step? Can you tnsping the target and catalog databases?

 

[medasanikk]

Hi

I attached the error for reference.

I will ask oracledb team to run tnsping to check connectivy evidence.

Is there any checks that I can do towords resolution?

Please advise.

 

[gimlet]

The error looks pretty self-explanatory...sqlplus is not in your path. Are you running this as your oracle user? If so, have you sourced the instance environment file?

 

[medasanikk]

Hii Gimlet

Thanks for your refrence

I have run this for oracle user only. but I didn't sourced the environment file.

Can you please help how I can do that..

I am uploading the yesterday rman log for refrence give any idea to resolve, this is the error :

RMAN-00571: ===========================================================
RMAN-00569: =============== ERROR MESSAGE STACK FOLLOWS ===============
RMAN-00571: ===========================================================
RMAN-03015: error occurred in stored script full_backup
RMAN-03007: retryable error occurred during execution of command: backup
RMAN-07004: unhandled exception during command execution on channel tape2
RMAN-10035: exception raised in RPC: ORA-19502: write error on file "dbf_t832356029_s18456_p1", blockno 37515521 (blocksize=1024)
ORA-27030: skgfwrt: sbtwrite2 returned error
ORA-19511: ANS1017E (RC-50) Session rejected: TCP/IP connection failure
RMAN-10031: ORA-19624 occurred during call to DBMS_BACKUP_RESTORE.BACKUPPIECECREATE
Recovery Manager complete.

============

Cheers
medasanikk

 

[medasanikk]

Hi guys

Anybody got same problem in your environments, is this resolved? contacted IBM older version tdp out of support

Hence issue ongoing.

Looking forward to know any clue to resolve this issue.