how to empty returning DR tapes

umur

umur

ADSM.ORG Senior Member
Joined
Sep 17, 2007
Messages
333
Reaction score
3
Points
0
Location
Istanbul
Hello,

I was wondering about the retention rules on copy storage pools. Do they follow the retention rule of the primary storage pool they are copied from? Or is there a rule on DRM preferences? This may be a simple question, however I was unable to find an answer...

Right now, I am using delete volume to clear tapes returning from disaster recovery site... As you are guessing, this is tiring manual labor and it always has the risk of me deleting a wrong tape, so I would like to apply a best practice on this subject to let these tapes become scratch without an intervention by an admin or operator.

Currently, the primary storage pools archives are kept for 45 days, and backups are kept like this:
Versions Data Exists: No Limit
Versions Data Deleted: 4
Retain Extra Versions: 60
Retain Only Version: No Limit
And I copy primary pools using "backup stg" command. I am currently working on TSM 5.4.3.0 but I am willing to upgrade to 5.5.x if that provides a solution.

Regards,
Umur
 
I use LTO4 tapes of 1.6 - 2TB capacity returning to my library around 80% utilisation, I would rather not occupy drives reclaiming them (if that is what you meant?)

I've taken a superficial look at DRM, but I couldn't really find an answer to this problem...
 
Unfortunately, I don't have that many tapes so I can wait them to be emptied. At the moment, I need to bring them back after 7-10 days and clear them so I can use them as scratch. Tapes are brought back to main site and kept in a locked cabinet until they are checked back into the library, before which I have to delete them manually...
 
umur said:
I use LTO4 tapes of 1.6 - 2TB capacity returning to my library around 80% utilisation, I would rather not occupy drives reclaiming them (if that is what you meant?)

I've taken a superficial look at DRM, but I couldn't really find an answer to this problem...
Click to expand...
Tapes coming back into your library/LTO should be 0% and you cannot check volumes/tapes that are full into your library as scratch (unless you remove the data and/or volume from your storage pool). You should explore and enable DRM, as DRM automatically do the stuff that you've been doing manually.

Reclamation will take up your drives to consolidate data, but this is part of the maintenance window of TSM. Why are you not wanting to occupy the drives?


Mike
 
In order for the tapes to become fully expired, I would have to wait 60 days. I send about 8 tapes to DR site daily, so a full rotation requires about 480 tapes dedicated to DRM process. I, unfortunately, do not have that many tapes, which is why I had to remove the data manually.

This is also the same reason I don't want to occupy drives with Disaster Recovery tapes' reclamation: I need them for backup processes.
 
I like your idea. I plan to have all the tapes inserted into the library as soon as they are back from DR center, and let reclamation treshold handle all itself. Would that work well?


Here is the output of:

Code: 
SELECT VOLUME_NAME, PCT_UTILIZED FROM VOLUMES WHERE STGPOOL_NAME like '%DR-POOL-LTO4%' order by PCT_UTILIZED



VOLUME_NAME            PCT_UTILIZED
------------------     ------------
A03012L3                        0.5
E00259L4                        1.4
E00030L4                        1.5
E00355L4                        1.9
E00338L4                        3.1
E00277L4                        3.6
E00270L4                        4.5
E00370L4                        4.8
735ABRL4                        6.2
E00273L4                        6.2
E00275L4                        6.2
E00391L4                        6.2
E00435L4                        6.2
312ABRL4                        7.5
E00230L4                        7.5
E00335L4                        8.6
E00417L4                       10.1
E00316L4                       10.8
E00401L4                       10.9
E00319L4                       11.4
740ABRL4                       12.3
E00437L4                       12.3
E00358L4                       13.5
E00382L4                       14.6
E00292L4                       15.8
E00472L4                       15.9
E00071L4                       16.4
E00222L4                       16.5
E00314L4                       16.5
E00237L4                       16.8
E00299L4                       18.0
A03036L3                       19.3
E00399L4                       20.6
727ABRL4                       24.4
A01228L3                       25.8
E00462L4                       25.8
319ABRL4                       26.5
E00411L4                       27.0
E00307L4                       27.4
A01206L3                       28.2
301ABRL4                       28.4
E00281L4                       28.5
307ABRL4                       28.6
E00354L4                       28.6
E00413L4                       28.7
E00280L4                       29.5
315ABRL4                       29.9
E00037L4                       31.0
732ABRL4                       32.2
E00231L4                       33.2
E00346L4                       33.5
E00028L4                       34.4
E00422L4                       37.0
E00255L4                       37.8
E00341L4                       38.1
E00321L4                       38.3
E00436L4                       38.4
E00328L4                       42.9
E00397L4                       43.1
E00067L4                       43.4
E00368L4                       47.5
E00431L4                       47.6
E00461L4                       48.1
JG9108L3                       48.6
E00077L4                       49.6
E00376L4                       51.4
309ABRL4                       52.5
E00247L4                       55.8
E00279L4                       61.8
E00439L4                       62.3
302ABRL4                       64.7
E00284L4                       66.2
E00389L4                       66.4
E00347L4                       67.5
E00260L4                       71.3
E00432L4                       72.4
A01189L3                       73.1
E00360L4                       76.6
E00340L4                       79.3
E00339L4                       80.9
E00315L4                       81.7
E00227L4                       85.7
E00229L4                       85.7
E00029L4                       87.8
E00027L4                       88.7
E00420L4                       91.3
306ABRL4                       92.4
E00387L4                       99.0
E00351L4                       99.1
E00317L4                       99.4
E00466L4                       99.5
E00398L4                       99.8
314ABRL4                       99.9
316ABRL4                       99.9
310ABRL4                      100.0
E00225L4                      100.0
E00254L4                      100.0
E00282L4                      100.0
E00306L4                      100.0
E00362L4                      100.0
E00386L4                      100.0
 
Last edited:
umur said:
In order for the tapes to become fully expired, I would have to wait 60 days. I send about 8 tapes to DR site daily, so a full rotation requires about 480 tapes dedicated to DRM process. I, unfortunately, do not have that many tapes, which is why I had to remove the data manually.

This is also the same reason I don't want to occupy drives with Disaster Recovery tapes' reclamation: I need them for backup processes.
Click to expand...

Are those 8 tapes fully utilized? If you're deleting data manually then you're not actually keeping (your policy) data for 60 days, so adjust your policy for less than 60.

You should backup your data onto a disk storage pool first then copy to your copy storage pool or are you not using a disk pool at all?

Try the below and see how your copy storage pool is utilize.
Code: 
tsm> select volume_name,stgpool_name,pct_utilized,pct_reclaim,status from volumes where stgpool_name='{your_copy_storagepool_name}' order by 3 asc
 
And another question that popped in my mind: When I delete the data on copypool manually, the same data is backed over and over, right?

Let's say I back up node A today with 60 days retention, and the tape comes back after 10 days, and I delete it, when I run copy storagepool, the same data from 10 days ago is copied once again, isn't it?
 
Those servers sent to DR are mostly big SAP servers, ranging from 200GB to 1.6TB; I think using a diskpool with these would not be a good idea.

Here is the output of:

Code: 
select volume_name,pct_utilized,pct_reclaim,status from volumes where stgpool_name like '%DR-POOL-LTO4%' order by 3 asc
Code: 
[B]Operation Results[/B]          

VOLUME_NAME            PCT_UTILIZED     PCT_RECLAIM     STATUS            
------------------     ------------     -----------     ------------------
310ABRL4                      100.0             0.0     FILLING           
314ABRL4                       99.9             0.0     FILLING           
316ABRL4                       99.9             0.0     FILLING           
E00225L4                      100.0             0.0     FILLING           
E00254L4                      100.0             0.0     FULL              
E00282L4                      100.0             0.0     FILLING           
E00306L4                      100.0             0.0     FILLING           
E00362L4                      100.0             0.0     FILLING           
E00386L4                      100.0             0.0     FILLING           
E00398L4                       99.8             0.1     FULL              
E00466L4                       99.5             0.4     FULL              
E00317L4                       99.4             0.5     FULL              
E00351L4                       99.1             0.8     FULL              
E00387L4                       99.0             0.9     FULL              
306ABRL4                       91.9             8.0     FILLING           
E00420L4                       91.3             8.6     FILLING           
E00027L4                       88.7            11.2     FULL              
E00029L4                       87.8            12.1     FILLING           
E00227L4                       85.7            14.2     FILLING           
E00229L4                       85.7            14.2     FILLING           
E00315L4                       81.7            18.2     FILLING           
E00339L4                       80.9            19.0     FILLING           
E00340L4                       79.3            20.6     FILLING           
E00360L4                       76.6            23.3     FILLING           
A01189L3                       73.1            26.8     FILLING           
E00432L4                       72.4            27.5     FILLING           
E00260L4                       71.3            28.6     FILLING           
E00347L4                       67.5            32.4     FULL              
E00389L4                       66.4            33.5     FILLING           
E00284L4                       66.2            33.7     FULL              
302ABRL4                       64.7            35.2     FILLING           
E00439L4                       62.3            37.6     FILLING           
E00279L4                       61.8            38.1     FILLING           
E00247L4                       55.8            44.1     FULL              
309ABRL4                       52.5            47.4     FILLING           
E00376L4                       51.4            48.5     FILLING           
E00077L4                       49.6            50.3     FILLING           
JG9108L3                       48.6            51.3     FILLING           
E00461L4                       48.1            51.8     FILLING           
E00431L4                       47.6            52.3     FILLING           
E00368L4                       47.5            52.4     FILLING           
E00067L4                       43.4            56.5     FILLING           
E00397L4                       43.1            56.8     FILLING           
E00328L4                       42.9            57.0     FILLING           
E00436L4                       38.4            61.5     FILLING           
E00321L4                       38.3            61.6     FILLING           
E00341L4                       38.1            61.8     FILLING           
E00255L4                       37.8            62.1     FILLING           
E00422L4                       37.0            62.9     FILLING           
E00028L4                       34.4            65.5     FILLING           
E00346L4                       33.5            66.4     FILLING           
E00231L4                       33.2            66.7     FILLING           
732ABRL4                       32.2            67.7     FILLING           
E00037L4                       31.0            68.9     FILLING           
315ABRL4                       29.9            70.0     FILLING           
E00280L4                       29.5            70.4     FILLING           
E00413L4                       28.7            71.2     FILLING           
307ABRL4                       28.6            71.3     FILLING           
E00354L4                       28.6            71.3     FILLING           
E00281L4                       28.5            71.4     FILLING           
301ABRL4                       28.4            71.5     FILLING           
A01206L3                       28.2            71.7     FILLING           
E00307L4                       27.4            72.5     FILLING           
E00411L4                       27.0            72.9     FILLING           
319ABRL4                       26.5            73.4     FILLING           
A01228L3                       25.8            74.1     FILLING           
E00462L4                       25.8            74.1     FILLING           
727ABRL4                       24.4            75.5     FILLING           
E00399L4                       20.6            79.3     FILLING           
A03036L3                       19.3            80.6     FULL              
E00299L4                       18.0            81.9     FILLING           
E00237L4                       16.8            83.1     FILLING           
E00222L4                       16.5            83.4     FILLING           
E00314L4                       16.5            83.4     FILLING           
E00071L4                       16.4            83.5     FILLING           
E00472L4                       15.9            84.0     FILLING           
E00292L4                       15.8            84.1     FILLING           
E00382L4                       14.6            85.3     FILLING           
E00358L4                       13.5            86.4     FILLING           
740ABRL4                       12.3            87.6     FILLING           
E00437L4                       12.3            87.6     FILLING           
E00319L4                       11.4            88.5     FILLING           
E00401L4                       10.9            89.0     FILLING           
E00316L4                       10.8            89.1     FILLING           
E00417L4                       10.1            89.8     FILLING           
E00335L4                        8.6            91.3     FILLING           
312ABRL4                        7.5            92.4     FILLING           
E00230L4                        7.5            92.4     FILLING           
735ABRL4                        6.2            93.7     FILLING           
E00273L4                        6.2            93.7     FILLING           
E00275L4                        6.2            93.7     FILLING           
E00391L4                        6.2            93.7     FILLING           
E00435L4                        6.2            93.7     FILLING           
E00370L4                        4.8            95.1     FILLING           
E00270L4                        4.5            95.4     FILLING           
E00277L4                        3.6            96.3     FILLING           
E00338L4                        3.1            96.8     FILLING           
E00355L4                        1.9            98.0     FILLING           
E00030L4                        1.5            98.4     FILLING           
E00259L4                        1.4            98.5     FILLING           
A03012L3                        0.5            99.4     FILLING
 
You should run reclamation manually:

first, this should reclaim all those volumes that contain (utilized) less than 10% of data
Code: 
tsm> update stg <your_copy_pool_name> reclaim=90
second, once the above done, do
Code: 
tsm> update stg <your_copy_pool_name> reclaim=80
third, and so on and on until you can setup a daily job to reclaim=52

anyhow, I just went through this exercise myself :) you could do
Code: 
tsm> update stg <your_copy_pool_name> reclaim=52
...but this will take a long time and TSM not necessarily reclaim the volumes with 10% or less usage first. Hence, the gradual step.


Mike
 
umur said:
And another question that popped in my mind: When I delete the data on copypool manually, the same data is backed over and over, right?

Let's say I back up node A today with 60 days retention, and the tape comes back after 10 days, and I delete it, when I run copy storagepool, the same data from 10 days ago is copied once again, isn't it?
Click to expand...

Your copy storage pool should be the same as your active storage pool, but since you're deleting it manually, etc. I'm not certain what's going on, mikeymac (or others) might have a better handle on this.


Mike
 
Just like was previously mentioned, The DRM procedure works perfectly. I generally run the "Reclaim stg copypool" while my daily backups are going on. Otherwise, my tape drives are just sitting idle. This whole procedure can scripted very easily. I have cron jobs that "call" the tapes back when they reach "Vault Retrieve" stutus. If you use Iron Mountain, talk to your rep to the FTP access configured. Essentially you can ftp a text file to Iron Mountain with the volume number of the tapes you want returned.
 
You must log in or register to reply here.

Data Privacy Impact Assessment

Compliance Assurance in Every Byte: Discover the Impact of Our DPIA Services.

Sponsor ADSM.ORG

If you are reading this, so are your potential customer. Advertise at ADSM.ORG right now.

Navigation Menu

Forums
   IBM TSM
   EMC Backup and Recovery
   Symantec NetBackup  
   SAN  
   NAS
   Platforms / OS
Mailing List Archives
   ADSM-L
User Groups

NordVPN 3 Months FREE

Help Support ADSM.ORG and Get NordVPN with 64% Off and 3 Months FREE.

NordVPN with 64% off + 3 months FREE

Forum statistics

Threads
31,971
Messages
135,441
Members
21,949
Latest member
tsheli
Back
Top