Move data from container storage pool

D

dkastens

ADSM.ORG Member
Joined
Apr 10, 2018
Messages
26
Reaction score
0
Points
0
Hi,

I have defined a container storage pool in our s3 cloud for HSM migrated files. It uses a local directory for deduplication. The connection to the cloud doesn't work anymore, but theres are about 1,5 TB of data in the local directory (TSM has created 403 containers, meanwhile). Now I want to get rid of the cloud container pool and move the data to a directory container pool. But this doesn't seem to work. I also tried to migrate the data to the next storage pool (on tape), but this fails with the error " ANR3391E MIGRATE STGPOOL: The operation is not allowed for cloud storage pools. "
How can I move the data from the cloud pool directory to another storage pool?
And what happens, if I update the managment class with a new destination pool for migration (update mgmtclass hsm standard hsmclass migdest=newpool)? Will the already migrated data in the cloudpool still be available?

Thanks,
Dirk
 
dkastens said:
How can I move the data from the cloud pool directory to another storage pool?
Click to expand...
Try with a tiering rule: Defining a tiering rule - IBM Documentation

Normally used from directory container to cloud container, but it should work the other way too.


dkastens said:
And what happens, if I update the managment class with a new destination pool for migration (update mgmtclass hsm standard hsmclass migdest=newpool)? Will the already migrated data in the cloudpool still be available?
Click to expand...
Yes, the management class only determines where the data lands during migration. When doing a retrieve, the server obtains the file location from the DB and retrieves it from the volume or container it resides on.
 
Thanks for your reply. Unfortunately, the tiering rule doesn't work. After its start, the rule identified 3000+ files, but in the end, the rule skipped the files end ends with a failure. How do I find out what's wrong?

ANR0208I Tiering process 2393 identified a total of 3 043 files and 1 752 GB bytes to move from storage pool CLOUDPOOL to storage pool ARCHIVES. (PROCESS: 2393, JOB: 2375)
...
ANR3838I Tiering process 2393 for storage rule TIERCLOUDPOOL is completed. Data was tiered from storage pool CLOUDPOOL to tape storage pool ARCHIVES. Tiered Files: 0, Tiered Bytes: 0 bytes, Skipped Files: 895, Skipped Bytes: 8 008 042 101, Total Bytes Transferred: 0 bytes, Elapsed time: 0 Days, 0 Hours, 4 Minutes.(PROCESS: 2393, JOB: 2375)
ANR0985I Process 2393 for TIER STORAGE POOL (SUMMARY) running in the BACKGROUND completed with completion state FAILURE at 20:10:48. (PROCESS: 2393, JOB: 2375)

Dirk
 
Can you show us the rule?
q stgrule TIERCLOUDPOOL f=d
 
Also check the actlog:
query actlog search="PROCESS: 2393" begindate=(date you ran test)
 
Code: 
TSM2G> q stgrule TIERCLOUDPOOL f=d

   Storage Rule Name: TIERCLOUDPOOL
 Target Storage Pool: ARCHIVES
  Target Server Name:
         Action Type: TierByAge
              Active: Yes
        Storage Type: LTO
   Maximum Processes: 8
          Start Time: 20:00:00
     Delay (in days): 0
            Duration: No Limit
         Description:
          Audit Type:
         Audit Level:
           Node Name:
     Filespace names:
           Name Type:
           Code Type:
      Percent Unused:
  Last Exe Date/Time: 13.06.23 20:10:02
    Maximum Sessions:
   Extent Validation:
     Transfer Method:
Source Storage Pools: CLOUDPOOL
 
Code: 
Date/Time                Message
--------------------     ----------------------------------------------------------
13.06.2023 20:10:02      ANR2875I Processing of the TIERCLOUDPOOL storage rule has
                          started. (PROCESS: 2803, JOB: 2393)
13.06.2023 20:10:02      ANR0134I Tiering process 2803 for storage rule
                          TIERCLOUDPOOL started from storage pool CLOUDPOOL to
                          tape storage pool ARCHIVES.  (PROCESS: 2803, JOB: 2393)
13.06.2023 20:10:02      ANR0135I Tiering process 2803 from storage pool CLOUDPOOL
                          started searching for eligible file spaces. (PROCESS:
                          2803, JOB: 2393)
13.06.2023 20:10:03      ANR0139I Tiering process 2803 identified 243 files for
                          node V...Z, file space / to tier from storage pool
                          CLOUDPOOL to storage pool ARCHIVES.  (PROCESS: 2803,
                          JOB: 2393)
13.06.2023 20:10:03      ANR0984I Process 2804 for Tier Storage Pool (Worker)
                          started in the BACKGROUND at 20:10:03. (PROCESS: 2804,
                          JOB: 2393)
13.06.2023 20:10:03      ANR0513I Process 2804 opened output volume 200183M8.
                          (PROCESS: 2804, JOB: 2393)
13.06.2023 20:10:05      ANR0984I Process 2805 for Tier Storage Pool (Worker)
                          started in the BACKGROUND at 20:10:05. (PROCESS: 2805,
                          JOB: 2393)
13.06.2023 20:10:05      ANR0984I Process 2806 for Tier Storage Pool (Worker)
                          started in the BACKGROUND at 20:10:05. (PROCESS: 2806,
                          JOB: 2393)
13.06.2023 20:10:05      ANR0984I Process 2807 for Tier Storage Pool (Worker)
                          started in the BACKGROUND at 20:10:05. (PROCESS: 2807,
                          JOB: 2393)
13.06.2023 20:10:05      ANR0984I Process 2808 for Tier Storage Pool (Worker)
                          started in the BACKGROUND at 20:10:05. (PROCESS: 2808,
                          JOB: 2393)
13.06.2023 20:10:05      ANR0984I Process 2809 for Tier Storage Pool (Worker)
                          started in the BACKGROUND at 20:10:05. (PROCESS: 2809,
                          JOB: 2393)
13.06.2023 20:10:05      ANR0984I Process 2810 for Tier Storage Pool (Worker)
                          started in the BACKGROUND at 20:10:05. (PROCESS: 2810,
                          JOB: 2393)
13.06.2023 20:10:05      ANR0984I Process 2811 for Tier Storage Pool (Worker)
                          started in the BACKGROUND at 20:10:05. (PROCESS: 2811,
                          JOB: 2393)
13.06.2023 20:10:05      ANR0513I Process 2805 opened output volume 200069M8.
                          (PROCESS: 2805, JOB: 2393)
13.06.2023 20:10:05      ANR0139I Tiering process 2803 identified 3 043 files for
                          node V...Y, file space /ibm/gpfs0 to tier from
                          storage pool CLOUDPOOL to storage pool ARCHIVES.
                          (PROCESS: 2803, JOB: 2393)
13.06.2023 20:10:09      ANR0208I Tiering process 2803 identified a total of 3 286
                          files and 1 752 GB bytes to move from storage pool
                          CLOUDPOOL to storage pool ARCHIVES.  (PROCESS: 2803,
                          JOB: 2393)
13.06.2023 20:10:09      ANR3837I Storage pool Tier process 2807 for storage pool
                          CLOUDPOOL has completed. (PROCESS: 2807, JOB: 2393)
13.06.2023 20:10:09      ANR0985I Process 2807 for Tier Storage Pool (Worker)
                          running in the BACKGROUND completed with completion
                          state SUCCESS at 20:10:09. (PROCESS: 2807, JOB: 2393)
13.06.2023 20:10:09      ANR3837I Storage pool Tier process 2806 for storage pool
                          CLOUDPOOL has completed. (PROCESS: 2806, JOB: 2393)
13.06.2023 20:10:09      ANR0985I Process 2806 for Tier Storage Pool (Worker)
                          running in the BACKGROUND completed with completion
                          state SUCCESS at 20:10:09. (PROCESS: 2806, JOB: 2393)
13.06.2023 20:10:09      ANR3837I Storage pool Tier process 2811 for storage pool
                          CLOUDPOOL has completed. (PROCESS: 2811, JOB: 2393)
13.06.2023 20:10:09      ANR3837I Storage pool Tier process 2810 for storage pool
                          CLOUDPOOL has completed. (PROCESS: 2810, JOB: 2393)
13.06.2023 20:10:09      ANR0985I Process 2811 for Tier Storage Pool (Worker)
                          running in the BACKGROUND completed with completion
                          state SUCCESS at 20:10:09. (PROCESS: 2811, JOB: 2393)
13.06.2023 20:10:09      ANR3837I Storage pool Tier process 2808 for storage pool
                          CLOUDPOOL has completed. (PROCESS: 2808, JOB: 2393)
13.06.2023 20:10:09      ANR0985I Process 2810 for Tier Storage Pool (Worker)
                          running in the BACKGROUND completed with completion
                          state SUCCESS at 20:10:09. (PROCESS: 2810, JOB: 2393)
13.06.2023 20:10:09      ANR3837I Storage pool Tier process 2809 for storage pool
                          CLOUDPOOL has completed. (PROCESS: 2809, JOB: 2393)
13.06.2023 20:10:09      ANR0985I Process 2808 for Tier Storage Pool (Worker)
                          running in the BACKGROUND completed with completion
                          state SUCCESS at 20:10:09. (PROCESS: 2808, JOB: 2393)
13.06.2023 20:10:09      ANR0985I Process 2809 for Tier Storage Pool (Worker)
                          running in the BACKGROUND completed with completion
                          state SUCCESS at 20:10:09. (PROCESS: 2809, JOB: 2393)
13.06.2023 20:11:55      ANR0515I Process 2804 closed volume 200183M8. (PROCESS:
                          2804, JOB: 2393)
13.06.2023 20:11:55      ANR3837I Storage pool Tier process 2804 for storage pool
                          CLOUDPOOL has completed. (PROCESS: 2804, JOB: 2393)
13.06.2023 20:11:55      ANR0985I Process 2804 for Tier Storage Pool (Worker)
                          running in the BACKGROUND completed with completion
                          state FAILURE at 20:11:55. (PROCESS: 2804, JOB: 2393)
13.06.2023 20:11:55      ANR1893E Process 2804 for Tier Storage Pool (Worker)
                          completed with a completion state of FAILURE. (PROCESS:
                          2804, JOB: 2393)
13.06.2023 20:13:45      ANR0515I Process 2805 closed volume 200069M8. (PROCESS:
                          2805, JOB: 2393)
13.06.2023 20:13:45      ANR3837I Storage pool Tier process 2805 for storage pool
                          CLOUDPOOL has completed. (PROCESS: 2805, JOB: 2393)
13.06.2023 20:13:45      ANR0985I Process 2805 for Tier Storage Pool (Worker)
                          running in the BACKGROUND completed with completion
                          state FAILURE at 20:13:45. (PROCESS: 2805, JOB: 2393)
13.06.2023 20:13:45      ANR1893E Process 2805 for Tier Storage Pool (Worker)
                          completed with a completion state of FAILURE. (PROCESS:
                          2805, JOB: 2393)
13.06.2023 20:13:49      ANR3838I Tiering process 2803 for storage rule
                          TIERCLOUDPOOL is completed. Data was tiered from storage
                          pool CLOUDPOOL to tape storage pool ARCHIVES. Tiered
                          Files: 0, Tiered Bytes: 0 bytes, Skipped Files: 1 138,
                          Skipped Bytes: 8 203 866 994, Total Bytes Transferred: 0
                          bytes, Elapsed time: 0 Days, 0 Hours, 4 Minutes.
                          (PROCESS: 2803, JOB: 2393)
13.06.2023 20:13:49      ANR0985I Process 2803 for TIER STORAGE POOL (SUMMARY)
                          running in the BACKGROUND completed with completion
                          state FAILURE at 20:13:49. (PROCESS: 2803, JOB: 2393)
13.06.2023 20:13:49      ANR1893E Process 2803 for TIER STORAGE POOL (SUMMARY)
                          completed with a completion state of FAILURE. (PROCESS:
                          2803, JOB: 2393)
13.06.2023 20:13:49      ANR4179I Job 2393 failed. (PROCESS: 2803, JOB: 2393)
14.06.2023 08:32:44      ANR2017I Administrator TSMGURU issued command: QUERY
                          ACTLOG search='JOB: 2393' begintime=now-13  (SESSION:
                          526090)
14.06.2023 08:33:49      ANR2017I Administrator TSMGURU issued command: QUERY
                          ACTLOG search='JOB: 2393' begintime=now-13  (SESSION:
                          526135)
 
Hi,

You need to have a copy pool before data can be tierd out.

Managing copy and tiering storage rules

You can use copy storage rules to create a second copy of your data on tape storage. Then, use tiering rules to move data in a directory-container storage pool on disk to cloud or tape storage.
www.ibm.com

Where it states:

You can use copy storage rules to create a second copy of your data ontape storage. Then, use tiering rules to move data in a directory-container storage pool on disk to cloud or tape storage.
 
Hi,
unfortunately, copypools can not be created for cloud storage pools:

Code: 
TSM2G> update stgpool cloudpool copystgpools=archive_copy highmig=90 lowmig=0 access=readwrite cache=no
ANR3797E The server did not process the UPDATE STGPOOL because the COPYSTGPOOLS parameter is not valid for the CLOUD type of storage.

Dirk
 
Hi,

You have to create a stgrule (copy) for this task. Can you provide q stg f=d for the stg in question?

DEFINE STGRULE (Define a storage rule for copying data)

Use this command to define a storage rule for one or more storage pools. The storage rule schedules operations to copy data from a source container storage pool to a copy sequential-access storage pool. The target storage pool must be on tape. You can define one or more storage rules for a...
www.ibm.com
 
You must log in or register to reply here.

Data Privacy Impact Assessment

Compliance Assurance in Every Byte: Discover the Impact of Our DPIA Services.

Sponsor ADSM.ORG

If you are reading this, so are your potential customer. Advertise at ADSM.ORG right now.

Navigation Menu

Forums
   IBM TSM
   EMC Backup and Recovery
   Symantec NetBackup  
   SAN  
   NAS
   Platforms / OS
Mailing List Archives
   ADSM-L
User Groups

NordVPN 3 Months FREE

Help Support ADSM.ORG and Get NordVPN with 64% Off and 3 Months FREE.

NordVPN with 64% off + 3 months FREE

Forum statistics

Threads
31,967
Messages
135,413
Members
21,945
Latest member
ari
Back
Top