ANS1329S (RC29) Server out of data storage space

unixandtsm

ADSM.ORG Member
Joined
Feb 9, 2011
Messages
307
Reaction score
0
Points
0
Hi all,

RMAN backup failed with error "ANS1329S (RC29) Server out of data storage space"
Below is more info on error
Code:
input archive log thread=1 sequence=5193 recid=4690 stamp=785829879
channel ORA_SBT_TAPE_2: starting piece 1 at 13-JUN-2012 06:04:42
RMAN-03009: failure of backup command on ORA_SBT_TAPE_1 channel at 06/13/2012 06:06:57
ORA-19502: write error on file "dtnddjvp_1_1", blockno 8705 (blocksize=512)
ORA-27030: skgfwrt: sbtwrite2 returned error
ORA-19511: Error received from media manager layer, error text:
   ANS1329S (RC29)   Server out of data storage space
channel ORA_SBT_TAPE_1 disabled, job failed on it will be run on another channel
RMAN-03009: failure of backup command on ORA_SBT_TAPE_2 channel at 06/13/2012 06:09:02
ORA-19502: write error on file "dunddjvp_1_1", blockno 8193 (blocksize=512)
ORA-27030: skgfwrt: sbtwrite2 returned error
ORA-19511: Error received from media manager layer, error text:
   ANS1329S (RC29)   Server out of data storage space
channel ORA_SBT_TAPE_2 disabled, job failed on it will be run on another channel
RMAN-00571: ===========================================================
RMAN-00569: =============== ERROR MESSAGE STACK FOLLOWS ===============
RMAN-00571: ===========================================================

RMAN-03009: failure of backup command on ORA_SBT_TAPE_1 channel at 06/13/2012 06:06:57
ORA-19502: write error on file "dtnddjvp_1_1", blockno 8705 (blocksize=512)
ORA-27030: skgfwrt: sbtwrite2 returned error
ORA-19511: Error received from media manager layer, error text:
   ANS1329S (RC29)   Server out of data storage space

Below is the stgpool info from TSM server.
Code:
q stg

Storage         Device          Estimated       Pct       Pct     High     Low     Next Stora-
Pool Name       Class Name       Capacity      Util      Migr      Mig     Mig     ge Pool
                                                                   Pct     Pct
-----------     ----------     ----------     -----     -----     ----     ---     -----------
ARCH            3590H-C          12,396 G      22.3      23.5       90      70
ARCHIVEPOOL     DISK                 11 G       0.0       0.0        0       0     ARCH
BACKUPPOOL      DISK                101 G       0.1       0.0        0       0     BKUPJA
BKUP            3590H-C         171,245 G       1.6       2.0       70      60
BKUPJA          3592H-C         615,816 G      25.3      63.2       90      70
COPYOFF         3590H-C          75,010 G      20.2
COPYOFFJA       3592H-C         572,593 G      15.8
COPYON          3590H-C         101,957 G      14.9
COPYONJA        3592H-C         551,640 G      25.0
SPACEMGPOOL     DISK                 11 G       0.0       0.0        0       0
TAPEPOOL-O-     3590H-C         273,796 G       3.7       4.0       90      70
 RACLE

i think the stgpool for these RMAN backups is TAPEPOOL-ORACLE (is there any way to confirm this ? ) so more info on it
Code:
q stg TAPEPOOL-ORACLE f=d

               Storage Pool Name: TAPEPOOL-ORACLE
               Storage Pool Type: Primary
               Device Class Name: 3590H-C
              Estimated Capacity: 273,796 G
              Space Trigger Util:
                        Pct Util: 3.7
                        Pct Migr: 4.0
                     Pct Logical: 100.0
                    High Mig Pct: 90
                     Low Mig Pct: 70
                 Migration Delay: 0
              Migration Continue: Yes
             Migration Processes: 1
           Reclamation Processes: 1
               Next Storage Pool:
            Reclaim Storage Pool:
          Maximum Size Threshold: No Limit
                          Access: Read/Write
                     Description: Tape Pool For Oracle Backups
               Overflow Location:
           Cache Migrated Files?:
                      Collocate?: No
           Reclamation Threshold: 60
       Offsite Reclamation Limit:
 Maximum Scratch Volumes Allowed: 2,000
  Number of Scratch Volumes Used: 81
   Delay Period for Volume Reuse: 0 Day(s)
          Migration in Progress?: No
            Amount Migrated (MB): 0.00
Elapsed Migration Time (seconds): 0
        Reclamation in Progress?: No
  Last Update by (administrator): ADMIN
           Last Update Date/Time: 08/16/06   19:00:15
        Storage Pool Data Format: Native
            Copy Storage Pool(s):
             Active Data Pool(s):
         Continue Copy on Error?: Yes
                        CRC Data: No
                Reclamation Type: Threshold
     Overwrite Data when Deleted:

Above i can see that device class name is 3590 and there are no 3590 scratch tapes available. But 3590 scratch tapes are not available from a month now and till today the backups were running fine. NOt sure what is the issue.
Please help me on this and thanks in advance!
 
Hi Ed,

I have no 3590 tapes available to load them into library. But i do have 3592 tapes avialable.
Is there any way to tell it to go to 3592 tapes ?
If so will it change anything in future when it comes to restores etc ?
 
Hi Ed,

I have no 3590 tapes available to load them into library. But i do have 3592 tapes avialable.
Is there any way to tell it to go to 3592 tapes ?
If so will it change anything in future when it comes to restores etc ?

3590 and 3592 are not the same tapes and not interchangable. These tape formats WILL NOT work with each other's tape drive.

What kind of tape drives do you have? If you have 3592 drives, define a new devclass such that the 3592 tapes will go to the 3592 drives
 
I have both a mix of 3590 and 3592 tape drives.
do i need to define a new 3592 device class ? or updating the device class of stgpool "TAPEPOOL-ORACLE" from 3590 to 3592 is good enough ?
and how can i make sure that this oracle RMAN backup data is going to "TAPEPOOL-ORACLE" stgpool only ?
Thank you!

Code:
q stg

Storage         Device          Estimated       Pct       Pct     High     Low     Next Stora-
Pool Name       Class Name       Capacity      Util      Migr      Mig     Mig     ge Pool
                                                                   Pct     Pct
-----------     ----------     ----------     -----     -----     ----     ---     -----------
ARCH            3590H-C          12,396 G      22.3      23.5       90      70
ARCHIVEPOOL     DISK                 11 G       0.0       0.0        0       0     ARCH
BACKUPPOOL      DISK                101 G       0.0       0.0        0       0     BKUPJA
BKUP            3590H-C         171,245 G       1.6       2.0       70      60
BKUPJA          3592H-C         615,816 G      25.3      63.2       90      70
COPYOFF         3590H-C          75,010 G      20.2
COPYOFFJA       3592H-C         572,593 G      15.9
COPYON          3590H-C         101,957 G      14.9
COPYONJA        3592H-C         551,640 G      25.0
SPACEMGPOOL     DISK                 11 G       0.0       0.0        0       0
TAPEPOOL-O-     3590H-C         273,796 G       3.7       4.0       90      70
 RACLE

Currently the device class for this stgpool is 3590 below
Code:
q stg TAPEPOOL-ORACLE

Storage         Device          Estimated       Pct       Pct     High     Low     Next Stora-
Pool Name       Class Name       Capacity      Util      Migr      Mig     Mig     ge Pool
                                                                   Pct     Pct
-----------     ----------     ----------     -----     -----     ----     ---     -----------
TAPEPOOL-O-     3590H-C         273,796 G       3.7       4.0       90      70
 RACLE
 
If you have already a defined devclass for 3592, then you need to update devclass for tapepool-oracle. Then your next problem is how to move the data that is in the 3590 tapes.

Once you update the devclass to point to the 3592 tapes, you won't be able to retrieve any data on the 3590 tapes.
 
Hi Ed,

Just want to make sure, could you tell me from following if there is already a 3592 devclass ?
Code:
q stg

Storage         Device          Estimated       Pct       Pct     High     Low     Next Stora-
Pool Name       Class Name       Capacity      Util      Migr      Mig     Mig     ge Pool
                                                                   Pct     Pct
-----------     ----------     ----------     -----     -----     ----     ---     -----------
ARCH            3590H-C          12,396 G      22.3      23.5       90      70
ARCHIVEPOOL     DISK                 11 G       0.0       0.0        0       0     ARCH
BACKUPPOOL      DISK                101 G       0.0       0.0        0       0     BKUPJA
BKUP            3590H-C         171,245 G       1.6       2.0       70      60
BKUPJA          3592H-C         615,816 G      25.3      63.2       90      70
COPYOFF         3590H-C          75,010 G      20.2
COPYOFFJA       3592H-C         572,593 G      15.9
COPYON          3590H-C         101,957 G      14.9
COPYONJA        3592H-C         551,640 G      25.0
SPACEMGPOOL     DISK                 11 G       0.0       0.0        0       0
TAPEPOOL-O-     3590H-C         273,796 G       3.7       4.0       90      70
 RACLE

and also this is IBM 3494 tape library and i thought of using "update stg" command to update the devclass of "TAPEPOOL-ORACLE" but in help section i could not find the devclass parameter (?)...should i be using "update stg" command or something else ?

Thanks in advance!
 
There isn't any devclass parameter in 'update stgpool'. If you want to point to the 3592, you need to define a new stgpool; or delete the old and re-point it to the 3592 (but don't do this!! You will loose the ability to get all of the data stored on the 3590 tapes).

All the ones showing 3592H-C are using (I presume) 3592 tapes.
 
Hi Ed,

Yes, the once showing 3592H-C are using 3592 tapes.
As you suggested i don't want to delete the stgpool.
Could you suggest me how to define and point the RMAN backups to new 3592 stgpool ?
Thank you!
 
When you repoint the Domain to which Oracle is in to a new storage pool (with the new devclass for 3592), RMAN backups moves automatically to this.
 
Hi Ed,

Defined a new storage pool with device class of 3592 tapes (scratch tapes of type 3592 are available)
But still ending up with same error (ANS1329S (RC29) Server out of data storage space)

when i queried the actlog i found following entries on this. Looks like the "scratch mount is failing"
Code:
06/19/12   06:21:02      ANR0406I Session 7965 started for node EMREP_3957041236   
                          (TDPO Linux86-64)    (SESSION: 7965)                                          
                      
06/19/12   06:21:04      ANR8945W Scratch volume mount failed . (SESSION: 7965)    
06/19/12   06:21:04      ANR1405W Scratch volume mount request denied - no scratch 
                          volume available. (SESSION: 7965)                        
06/19/12   06:21:06      ANR0522W Transaction failed for session 7965 for node     
                          EMREP_3957041236 (TDPO Linux86-64) - no space available  
                          in storage pool [B]TAPEPOOL-ORACLE [/B]and all successor pools. 
                          (SESSION: 7965)
Above it is referring to old storage pool (TAPEPOOL-ORACLE ) but not the new pool i defined (TAPEPOOL-ORACLE2).
As there are no scratch tapes available in old pool, the backup failure is likely but not sure why it is still pointing to old stg pool ?

Below are the steps followed for defining stgpool and updating copygroup of the node etc.

Code:
q node emrep_3957041236

Node Name                     Platform     Policy Domain      Days Since     Days Since     Locked?
                                           Name               Last Acce-       Password     
                                                                      ss            Set     
-------------------------     --------     --------------     ----------     ----------     -------
EMREP_3957041236              TDPOLinux86-64            <domainname>             <1             55       No   
                                                                                        
                                                                                               


1. def stg TAPEPOOL-ORACLE2 3592H-C  maxscr=2000
2. upd copyg <domainname> <policy set> <classname>  STANDARD dest=TAPEPOOL-ORACLE2


q copyg <domainname> <policy set> <classname> NORMAL STANDARD f=d       

                 Policy Domain Name: <domainname>
                    Policy Set Name: <policyName>
                    Mgmt Class Name: NORMAL
                    Copy Group Name: STANDARD
                    Copy Group Type: Backup
               Versions Data Exists: 1
              Versions Data Deleted: 0
              Retain Extra Versions: 0
                Retain Only Version: 0
                          Copy Mode: Modified
                 Copy Serialization: Shared Static
                     Copy Frequency: 0
                   Copy Destination: TAPEPOOL-ORACLE2
Table of Contents (TOC) Destination: 
     Last Update by (administrator): ADMIN
              Last Update Date/Time: 06/14/12   12:21:32
                   Managing profile: 
                    Changes Pending: Yes

Thanks in advance!
 
Do i need to activate policyset after updating the copy group ?
 
Back
Top