ANS1329S Server out of data storage space

shree21

Active Newcomer
Joined
Sep 20, 2011
Messages
16
Reaction score
0
Points
0
PREDATAR Control23

Hi All,

Thanks for your time.

My backups on client have been failing from 2 days.
I tried to delete old volume history and ran expire inventory but no luck.
Can you please let me know what best can be done.

* why are the tape saying full even though i can view not all of them are 90% full.

# q node o/p

A00000L4 TAPEPOOL LTO4_CLASS 1.6 T 94.1 Filling
A00001L4 TAPEPOOL LTO4_CLASS 2.1 T 95.1 Full
A00002L4 TAPEPOOL LTO4_CLASS 2.3 T 96.9 Full
A00005L4 TAPEPOOL LTO4_CLASS 2.5 T 97.0 Full
A00006L4 TAPEPOOL LTO4_CLASS 2.4 T 99.3 Full
A00007L4 TAPEPOOL LTO4_CLASS 1.7 T 54.2 Full
A00008L4 TAPEPOOL LTO4_CLASS 1.9 T 80.5 Full
A00009L4 TAPEPOOL LTO4_CLASS 1.9 T 71.5 Full
A00010L4 TAPEPOOL LTO4_CLASS 1.8 T 63.2 Full
A00012L4 TAPEPOOL LTO4_CLASS 1.6 T 40.8 Full
A00013L4 TAPEPOOL LTO4_CLASS 1.6 T 44.7 Full
A00014L4 TAPEPOOL LTO4_CLASS 1.9 T 72.1 Full
A00015L4 TAPEPOOL LTO4_CLASS 1.7 T 52.6 Full
A00016L4 TAPEPOOL LTO4_CLASS 1.8 T 72.3 Full
A00017L4 TAPEPOOL LTO4_CLASS 2.1 T 89.9 Full
A00018L4 TAPEPOOL LTO4_CLASS 1.6 T 44.0 Full
A00019L4 TAPEPOOL LTO4_CLASS 1.5 T 69.6 Full


# q stgpool o/p

ARCHIVEPOOL DISK 100.0 M 0.0 0.0 90 70
DISKPOOL DISK 204 G 94.1 94.1 90 70 TAPEPOOL
SPACEMGPOOL DISK 0.0 M 0.0 0.0 90 70
TAPEPOOL LTO4_CLASS 1,873,853 G 1.3 1.7 90 7


# q stgpool tapepool f=d

Storage Pool Name: TAPEPOOL
Storage Pool Type: Primary
Device Class Name: LTO4_CLASS
Estimated Capacity: 1,873,853 G
Space Trigger Util:
Pct Util: 1.3
Pct Migr: 1.7
Pct Logical: 99.9
High Mig Pct: 90
Low Mig Pct: 70
Migration Delay: 0
Migration Continue: Yes
Migration Processes: 1
Reclamation Processes: 1
Next Storage Pool:
Reclaim Storage Pool:
Maximum Size Threshold: No Limit
Access: Read/Write
Description: Tape Stg Pool
Overflow Location:
Cache Migrated Files?:
Collocate?: No
Reclamation Threshold: 60
Offsite Reclamation Limit:
Maximum Scratch Volumes Allowed: 999
Number of Scratch Volumes Used: 17
Delay Period for Volume Reuse: 0 Day(s)
Migration in Progress?: No
Amount Migrated (MB): 0.00
Elapsed Migration Time (seconds): 0
Reclamation in Progress?: No
Last Update by (administrator): ADMIN
Last Update Date/Time: 01/14/11 14:35:50
Storage Pool Data Format: Native
Copy Storage Pool(s):
Active Data Pool(s):
Continue Copy on Error?: Yes
CRC Data: No
Reclamation Type: Threshold
Overwrite Data when Deleted:
Deduplicate Data?: No
Processes For Identifying Duplicates:
Duplicate Data Not Stored:
Auto-copy Mode: Client
Contains Data Deduplicated by Client?: No

Thanks,
Sree
 
PREDATAR Control23

did you try running reclamation on your tapepool?
 
PREDATAR Control23

yes i did
---------------------------------------------------------------------------------------------------------------
reclaim stgpool TAPEPOOL duration=60
ANR2110I RECLAIM STGPOOL started as process 232.
ANR4930I Reclamation process 232 started for primary storage pool TAPEPOOL manually, threshold=30, duration=60.
ANS8003I Process number 232 started.
---------------------------------------------------------------------------------------------------------------
q actlog o/p

ANR1086E Space reclamation is ended for volume A00012L4.
There is insufficient space in storage pool. (SESSION:
216024, PROCESS: 232)
11/08/11 16:24:22 ANR0985I Process 232 for SPACE RECLAMATION running in the
BACKGROUND completed with completion state FAILURE at
16:24:22. (SESSION: 216024, PROCESS: 232)
11/08/11 16:24:22 ANR4936I Reclamation of storage pool TAPEPOOL has ended.
Files reclaimed: 0, Bytes reclaimed: 0, Files
reconstructed: 0, Unreadable files: 0. (SESSION: 216024)

---------------------------------------------------------------------------------------------------------------------------
Please guide further
 
PREDATAR Control23

Did try no luck..
-----------------------------------------------------------------------
reclaim stgpool TAPEPOOL threshold=60 duration=60
ANR2111W RECLAIM STGPOOL: There is no data to process for TAPEPOOL.
ANS8001I Return code 11.
-----------------------------------------------------------------------
11/08/11 16:41:41 ANR2017I Administrator ADMIN issued command: RECLAIM
STGPOOL TAPEPOOL threshold=60 duration=60 (SESSION:
216024)
11/08/11 16:41:41 ANR2111W RECLAIM STGPOOL: There is no data to process for
TAPEPOOL. (SESSION: 216024)

-------------------------------------------------------------------------------------
 
PREDATAR Control23

try 90, because 60 is your default (see reclamation threshold from q stg tapepool).
 
PREDATAR Control23

Thank you for looking into it

>q drive

Library Name Drive Name Device Type On-Line
------------ ------------ ----------- -------------------
TS3310 DRIVE1 LTO Yes
TS3310 DRIVE2 LTO Yes
TS3310 DRIVE3 LTO Yes
TS3310 DRIVE4 LTO Yes

>q path

Source Name Source Type Destination Destination On-Line
Name Type
----------- ----------- ----------- ----------- -------
LGBMGMT SERVER TS3310 LIBRARY Yes
LGBMGMT SERVER DRIVE1 DRIVE Yes
LGBMGMT SERVER DRIVE2 DRIVE Yes
LGBMGMT SERVER DRIVE3 DRIVE Yes
LGBMGMT SERVER DRIVE4 DRIVE Yes

>q devcl LTO4_CLASS

Device Device Storage Device Format Est/Max Mount
Class Access Pool Type Capacity Limit
Name Strategy Count (MB)
--------- ---------- ------- --------- ------ -------- ------
LTO4_CLA- Sequential 1 LTO DRIVE DRIVES
SS
 
PREDATAR Control23

When do you do a diskpool migration to tapepool. I see your diskpool is at 94.1%.
 
PREDATAR Control23

Correct me if am wrong.

Diskpool has nextstorage pool as Tape pool, does it mean that overflow data will be written to Tapepool.
Once i make space for daily backup i will be working on removing old entries and reclamation of space.
 
PREDATAR Control23

it means that any data over your high migration % will cause a migration to tape to start, but that does not empty out your diskpool like a scheduled migration would do. I'm thinking that your diskpool does not have enough space for some clients to backup to because its not completely migrated. Do a q sched * type=admin to see if you have a migration start and stop scheduled. If you do then do a q sched schedname f=d. At 2pm everyday I start a migration to tape and after 2 hours I do a stop migration. Usually 1 hour is enough to send my diskpool to tape.
 
PREDATAR Control23

>q sched * type=admin f=d

Schedule Name: DEL_VOLH_DBB
Description:
Command: del volh type=dbb tod=-2
Priority: 5
Start Date/Time: 01/15/11 09:59:00
Duration: 1 Hour(s)
Schedule Style: Classic
Period: 1 Day(s)
Day of Week: Any
Month:
Day of Month:
Week of Month:
Expiration:
Active?: Yes
Last Update by (administrator): ADMIN
Last Update Date/Time: 01/14/11 13:16:23
Managing profile:

Schedule Name: MAINTENANCE
Description:
Command: run MAINTENANCE_PLAN
Priority: 5
Start Date/Time: 01/15/11 08:00:00
Duration: 4 Hour(s)
Schedule Style: Enhanced
Period:
Day of Week: Sun,Mon,Tue,Wed,Thu,Fri,Sat
Month: Any
Day of Month: Any
Week of Month: Any
Expiration:
Active?: Yes
Last Update by (administrator): ADMIN
Last Update Date/Time: 01/14/11 11:57:40
Managing profile:

one of the schedule

Policy Domain Name: AIX
Schedule Name: AIX_FILE_BACKUP
Description: AIX filesystem backup
Action: Incremental
Subaction:
Options:
Objects:
Priority: 5
Start Date/Time: 01/22/11 00:58:00
Duration: 1 Hour(s)
Schedule Style: Classic
Period: 1 Day(s)
Day of Week: Any
Month:
Day of Month:
Week of Month:
Expiration:
Last Update by (administrator): ADMIN
Last Update Date/Time: 01/22/11 01:01:20
Managing profile:

I see the report says admistrative schedules are successfull. pls guide
 
PREDATAR Control23

Thank you for the replay.

I dont have any scratch tapes left, and i was not able to move data because of the same reason.
Whats the best way to do space reclamation ( have tried couple of them which failed though), i dont think i can wait on data expiration on tape...did run expire inventory and not even a single file was cleared.

Pls guide.
 
PREDATAR Control23

I dont have any scratch tapes available.
We might probably dont have a COPY or OFFsite storage Pool

ARCHIVEPOOL DISK 100.0 M 0.0 0.0 90 70
DISKPOOL DISK 204 G 94.0 94.0 90 70 TAPEPOOL
SPACEMGPOOL DISK 0.0 M 0.0 0.0 90 70
TAPEPOOL LTO4_CLASS 1,873,853G 1.3 1.7 90 7

Pls guide
 
PREDATAR Control23

Hi Mikeymac

q vol stgp=TAPEPOOL

Volume Name Storage Device Estimated Pct Volume
Pool Name Class Name Capacity Util Status
------------------------ ----------- ---------- --------- ----- --------
A00000L4 TAPEPOOL LTO4_CLASS 1.6 T 93.9 Filling
A00001L4 TAPEPOOL LTO4_CLASS 2.1 T 94.8 Full
A00002L4 TAPEPOOL LTO4_CLASS 2.3 T 96.7 Full
A00005L4 TAPEPOOL LTO4_CLASS 2.5 T 97.0 Full
A00006L4 TAPEPOOL LTO4_CLASS 2.4 T 99.3 Full
A00007L4 TAPEPOOL LTO4_CLASS 1.7 T 54.2 Full
A00008L4 TAPEPOOL LTO4_CLASS 1.9 T 80.5 Full
A00009L4 TAPEPOOL LTO4_CLASS 1.9 T 71.5 Full
A00010L4 TAPEPOOL LTO4_CLASS 1.8 T 63.2 Full
A00012L4 TAPEPOOL LTO4_CLASS 1.6 T 40.8 Full
A00013L4 TAPEPOOL LTO4_CLASS 1.6 T 44.7 Full
A00014L4 TAPEPOOL LTO4_CLASS 1.9 T 72.0 Full
A00015L4 TAPEPOOL LTO4_CLASS 1.7 T 52.6 Full
A00016L4 TAPEPOOL LTO4_CLASS 1.8 T 65.0 Full
A00017L4 TAPEPOOL LTO4_CLASS 2.1 T 89.8 Full
A00018L4 TAPEPOOL LTO4_CLASS 1.6 T 44.0 Full
A00019L4 TAPEPOOL LTO4_CLASS 1.5 T 61.1 Full
SELECT COUNT(*) FROM LIBVOLUMES WHERE STATUS='Scratch'

Unnamed[1]
------------
0
q libv

Library Name Volume Name Status Owner Last Use Home Device
Element Type
------------ ----------- ---------------- ---------- --------- ------- ------
TS3310 A00000L4 Private LGBMGMT Data 4,132 LTO
TS3310 A00001L4 Private LGBMGMT Data 4,133 LTO
TS3310 A00002L4 Private LGBMGMT Data 4,134 LTO
TS3310 A00005L4 Private LGBMGMT Data 4,137 LTO
TS3310 A00006L4 Private LGBMGMT Data 4,138 LTO
TS3310 A00007L4 Private LGBMGMT Data 4,131 LTO
TS3310 A00008L4 Private LGBMGMT Data 4,130 LTO
TS3310 A00009L4 Private LGBMGMT Data 4,129 LTO
TS3310 A00010L4 Private LGBMGMT Data 4,143 LTO
TS3310 A00011L4 Private LGBMGMT DbBackup 4,144 LTO
TS3310 A00012L4 Private LGBMGMT Data 4,145 LTO
TS3310 A00013L4 Private LGBMGMT Data 4,146 LTO
TS3310 A00014L4 Private LGBMGMT Data 4,136 LTO
TS3310 A00015L4 Private LGBMGMT Data 4,142 LTO
TS3310 A00016L4 Private LGBMGMT Data 4,141 LTO
TS3310 A00017L4 Private LGBMGMT Data 4,140 LTO
TS3310 A00018L4 Private LGBMGMT Data 4,139 LTO
TS3310 A00019L4 Private LGBMGMT Data 4,135 LTO



Probably i can delete some of the data from now.
If so what will be the safe way to pick up the old data and delete it.
 
Top