Need to reclaim space

[cozcol]

Hi,

Can anyone tell me the best way to reclaim unused space from my volume pool, I am trying to change the reclaim thresholds on my storage pools, or migrate the data from 1 tape to another but get an end of tape. I do have files which are spread across tapes and this is causing some end of tape issues.

Maybe move data?

002ABWL4 LTOPOOL01 TS3100 1.6 T 25.1 Filling
003ABWL4 OFFSITE TS3100 1.6 T 25.2 Filling
004ABWL4 OFFSITE TS3100 823.9 G 96.7 Full
005ABWL4 LTOPOOL01 TS3100 819.8 G 100.0 Full
006ABWL4 LTOPOOL01 TS3100 819.7 G 54.5 Full
007ABWL4 LTOPOOL01 TS3100 818.8 G 78.1 Full
008ABWL4 OFFSITE TS3100 828.9 G 30.5 Full
009ABWL4 OFFSITE TS3100 829.0 G 50.0 Full
010ABWL4 OFFSITE TS3100 410.6 G 64.6 Full
012ABWL4 OFFSITE TS3100 1.6 T 25.0 Filling
013ABWL4 LTOPOOL01 TS3100 412.2 G 99.9 Full
014ABWL4 OFFSITE TS3100 413.6 G 100.0 Full
015ABWL4 LTOPOOL01 TS3100 425.3 G 99.9 Full
020ABWL4 LTOPOOL01 TS3100 823.0 G 99.6 Full
090ABWL4 OFFSITE TS3100 820.8 G 62.0 Full
091ABWL4 LTOPOOL01 TS3100 828.6 G 31.4 Full
092ABWL4 LTOPOOL01 TS3100 822.6 G 59.7 Full
093ABWL4 LTOPOOL01 TS3100 821.4 G 96.4 Full
094ABWL4 LTOPOOL01 TS3100 818.1 G 59.0 Full
100ABWL4 LTOPOOL01 TS3100 819.0 G 96.5 Full
101ABWL4 LTOPOOL01 TS3100 421.1 G 95.9 Full
102ABWL4 OFFSITE TS3100 412.3 G 62.0 Full

I think the major problem I have with this TSM setup is I have to fulfill 1 years retention of data on tapes and am running low on space to do this. So need to perform some sort of space reclamation managment.

 

[quinstear]

to see what your reclamation thresholds are set to run 'q stg f=d'

You can chamge the automatic reclamation threshold for a storage pool with
'update stg <stgpool> reclaim=70' The '70' being the percentage of space available on a volume for reclamation.

To run a manual reclamation 'reclaim stg <stgpool> thre=70 dur=120'

To see how much you can reclaim run
select count(*) from volumes where stgpool_name='STGPOOL_NAME' and upper(status)='FULL' and pct_utilized <70

 

[quinstear]

On the last post the 'pct_utilized' in the select statment is round the wrong way. It should be '30'. if you are working on the assumption that you are looking to reclaim anything that has only 30% of valid data on the volume

 

[BBB]

Actually the calculation should really use the pct_reclaim field, not pct_utilized - often they are simply the inverse of each other but not always.

 

[cozcol]

Thanks all for the replies.

I have updated my stgpool from 75 to 70 for reclaimation, have run the query to check but it shows me 0


tsm: TSM_PROD01>select count(*) from volumes where stgpool_name='ltopool01' and upper(status)='FULL' and pct_reclaim <30

Unnamed[1]
-----------
0
tsm: TSM_PROD01>

Will adjust the reclaim accordingly and rerun the check.

 

[BBB]

Things in quotes are case sensitive - put your stgpool name in ALL-CAPS.

 

[cozcol]

thanks BBB, I am now getting some results


tsm: TSM_PROD01>select count(*) from volumes where stgpool_name='LTOPOOL01' and upper(status )='FULL' and pct_reclaim <30
Unnamed[1]
-----------
8
tsm: TSM_PROD01>


1,081 Space Reclamation Volume 008ABWL4 (storage pool OFFSITE), Moved
Files: 0, Moved Bytes: 0, Unreadable Files: 0,
Unreadable Bytes: 0. Current Physical File
(bytes): 3,944,530,118 Current input volume:
008ABWL4. Waiting for mount of output volume
003ABWL4 (574 seconds).

but I don't think it can use 003ABWL4 as this tape is full as far as I can see.

Maybe move data command is my only hope.

 

[BBB]

It won't try to write to a tape that is full, what makes you think it is full? It is not full until q vol shows the volume as "FULL" status. Post "q vol 003ABWl4".

100% utilised is not full, it just means it is 100% of the estimated capacity, which you can set to any silly number.

 

[quinstear]

BBB, Thanks for the tip on the select statement calculation field

 

[juancarlosludena]

one more

Hi.

With the next script, you can see in any moment the number of tapes that have space reclaimation at exact percet.

"select stgpool_name, count(volume_name) as VOLUMENES from volumes -
where status='FULL' and pct_reclaim >=$1 group by stgpool_name"

the parameter is the of space reclamation avalilable in the tapes.

example:

********************************
tsm: TSM>run q_recla 60

STGPOOL_NAME VOLUMENES
------------------ -----------
BACKUP_POOL 22
ARCHIVEL_POOL 18
********************************

 

[cozcol]

Thanks juancarlosludena, I have defined that as a script and runs perfectly.

Here are my results for the volume

tsm: TSM_PROD01>q vol 003ABWl4
Volume Name Storage Device Estimated Pct Volume
Pool Name Class Name Capacity Util Status
------------------------ ----------- ---------- --------- ----- --------
003ABWL4 OFFSITE TS3100 1.6 T 25.2 Filling


But this tape is only a 400gb, estimated capacity of mystorage pool is set to 1600gb, so 25% seems to match up with the actual capacity of the tape.

tsm: TSM_PROD01>q vol 003ABWl4 f=d
Volume Name: 003ABWL4
Storage Pool Name: OFFSITE
Device Class Name: TS3100
Estimated Capacity: 1.6 T
Scaled Capacity Applied:
Pct Util: 25.2
Volume Status: Filling
Access: Read/Write
Pct. Reclaimable Space: 0.0
Scratch Volume?: Yes
In Error State?: No
Number of Writable Sides: 1
Number of Times Mounted: 229
Write Pass Number: 1
Approx. Date Last Written: 03/05/2009 08:04:25
Approx. Date Last Read: 03/03/2009 15:47:23
Date Became Pending:
Number of Write Errors: 0
Number of Read Errors: 0
Volume Location:
Volume is MVS Lanfree Capable : No
Last Update by (administrator): ADMIN
Last Update Date/Time: 03/05/2009 09:27:54
Begin Reclaim Period:
End Reclaim Period:
Drive Encryption Key Manager:

Space reclamation seems to run but doesn't move any files across?
1,085 Space Reclamation Offsite Volume(s) (storage pool LTOPOOL01), Moved
Files: 0, Moved Bytes: 0, Unreadable Files: 0,
Unreadable Bytes: 0. Current Physical File
(bytes): 7,585,944,964 Current input volume:
094ABWL4. Waiting for mount of scratch volume
(23 seconds).
tsm: TSM_PROD01>q proc
ANR0944E QUERY PROCESS: No active processes found.
ANS8001I Return code 11.

 

[BBB]

The vol is not full until tsm says it is. TSM has not hit the end of that tape yet, although you may be correct it will happen very soon. But it hasn't happened yet.

The "q proc" output you posted showed it was waiting for a scratch volume to mount and it had only been waiting for 23 seconds - most libraries/drives can't do it that fast, so check what it has been doing since then including q proc output.

 

[quinstear]

Have you got sufficient scratch volumes in the library. Run the following command

dsmadmc -id=admin -password=**** 'q libv ' | grep -i scratch | wc -l

 

[cozcol]

thanks all for you assistance on this, but there is no scratch left in the library.

Activity logs report failure for my reclamation due to no scratch.

So I seem to be running out of volume/space, not sure what I can do other than load more scratch tapes to alleviate the problem.

03/11/2009 16:42:34 ANR1405W Scratch volume mount request denied - no scratch
volume available. (PROCESS: 1161)
03/11/2009 16:42:35 ANR1405W Scratch volume mount request denied - no scratch
volume available. (PROCESS: 1161)
03/11/2009 16:42:35 ANR1086E Space reclamation is ended for volume 092ABWL4.
There is insufficient space in storage pool. (PROCESS:
1161)

03/11/2009 16:51:25 ANR1405W Scratch volume mount request denied - no scratch
volume available. (PROCESS: 1162)
03/11/2009 16:51:25 ANR1086E Space reclamation is ended for volume 005ABWL4.
There is insufficient space in storage pool. (PROCESS:
1162)
03/11/2009 16:51:25 ANR1163W Offsite volume 008ABWL4 still contains files
which could not be moved. (PROCESS: 1162)
03/11/2009 16:51:25 ANR1163W Offsite volume 009ABWL4 still contains files
which could not be moved. (PROCESS: 1162)
03/11/2009 16:51:25 ANR0985I Process 1162 for SPACE RECLAMATION running in the
BACKGROUND completed with completion state FAILURE at

 

[juancarlosludena]

Hi.

Can toy check the parameter "Maximum Scratch Volumes Allowed: " in the storage pool of tape 092ABWL4.

If the parameter "Maximum Scratch Volumes Allowed: " has been reached yoy must increase.

Or in other case, is more simple, you haven't scratch tapes and almost need one scratch tape for the reclamation process.

 

[quinstear]

I agree with Juancarlos, you need to sort out the scratch issue first.

 

[cozcol]

thanks guys,

my max_scratch is set to

Reclamation Threshold: 40
Offsite Reclamation Limit:
Maximum Scratch Volumes Allowed: 99,999
Number of Scratch Volumes Used: 12

I will try and aquire a scratch tape although we are running low on these.