"ANS1311E Server out of data storage space" ?

chandru0078

ADSM.ORG Member
Joined
Apr 14, 2008
Messages
58
Reaction score
0
Points
0
Hi Gurus

I have 2 Linux client reporting "ANS1311E Server out of data storage space"what could the problem ?

I have few client backup to this diskpool2 before migrate to Lt0pool1.Dont knoq why this particular node falied 12 with above error AND ONLY DURING WEEKLY OR MONHTLY backup.my maxscratch is 100 for stgpool ltopool1 and used just 31 only mostly is full.

q stg ltopool1 f=d

Storage Pool Name: LTOPOOL1
Storage Pool Type: Primary
Device Class Name: LTOCLASS1
Estimated Capacity: 123,663 G
Space Trigger Util:
Pct Util: 27.4
Pct Migr: 36.1
Pct Logical: 99.9
High Mig Pct: 90
Low Mig Pct: 70
Migration Delay: 0
Migration Continue: Yes
Migration Processes: 1
Reclamation Processes: 1
Next Storage Pool:
Reclaim Storage Pool:
Maximum Size Threshold: No Limit
Access: Read/Write
Description:
Overflow Location:
Cache Migrated Files?:
Collocate?: No
Reclamation Threshold: 100
Offsite Reclamation Limit:
Maximum Scratch Volumes Allowed: 100
Number of Scratch Volumes Used: 31
Delay Period for Volume Reuse: 0 Day(s)
Migration in Progress?: No



Storage Pool Name: DISKPOOL3
Storage Pool Type: Primary
Device Class Name: DISK
Estimated Capacity: 15 G
Space Trigger Util: 54.0
Pct Util: 54.0
Pct Migr: 54.0
Pct Logical: 100.0
High Mig Pct: 90
Low Mig Pct: 70
Migration Delay: 0
Migration Continue: Yes
Migration Processes: 1
Reclamation Processes:
Next Storage Pool: LTOPOOL1
Reclaim Storage Pool:
Maximum Size Threshold: No Limit
Access: Read/Write
Description:
Overflow Location:
Cache Migrated Files?: No
Collocate?:
Reclamation Threshold:


Volume Name Storage Device Estimated Pct Volume
Pool Name Class Name Capacity Util Status
------------------------ ----------- ---------- --------- ----- --------

A00012L3 LTOPOOL1 LTOCLASS1 951.9 G 53.1 Full

A00071L3 LTOPOOL1 LTOCLASS1 932.2 G 56.3 Full
A00075L3 LTOPOOL1 LTOCLASS1 1.3 T 92.1 Full
A00083L3 LTOPOOL1 LTOCLASS1 1.3 T 47.2 Full
A00114L3 LTOPOOL1 LTOCLASS1 1.4 T 51.3 Full
A00202L3 LTOPOOL1 LTOCLASS1 762.9 G 2.9 Filling
A00203L3 LTOPOOL1 LTOCLASS1 762.9 G 76.8 Filling
B00005L3 LTOPOOL1 LTOCLASS1 1.2 T 65.9 Full
B00017L3 LTOPOOL1 LTOCLASS1 1.2 T 54.6 Full
B00022L3 LTOPOOL1 LTOCLASS1 1.3 T 85.8 Full
B00023L3 LTOPOOL1 LTOCLASS1 762.9 G 13.0 Filling
B00027L3 LTOPOOL1 LTOCLASS1 887.2 G 91.5 Full
B00030L3 LTOPOOL1 LTOCLASS1 1.0 T 77.6 Full



1st node

06/07/2009 22:17:21 Directory--> 4,096 /var/yp/binding [Sent]
06/07/2009 22:17:21 Normal File--> 185 /var/yp/nicknames [Sent]
06/07/2009 22:17:22 ANS1803E Archive processing of '/var/*' finished with failures.

06/07/2009 22:17:22 Archive processing of '/home/*' finished without failure.

06/07/2009 22:17:22 --- SCHEDULEREC STATUS BEGIN
06/07/2009 22:17:22 Total number of objects inspected: 6,803
06/07/2009 22:17:22 Total number of objects archived: 6,778
06/07/2009 22:17:22 Total number of objects updated: 0
06/07/2009 22:17:22 Total number of objects rebound: 0
06/07/2009 22:17:22 Total number of objects deleted: 0
06/07/2009 22:17:22 Total number of objects expired: 0
06/07/2009 22:17:22 Total number of objects failed: 23
06/07/2009 22:17:22 Total number of bytes transferred: 90.12 GB
06/07/2009 22:17:22 Data transfer time: 11,367.96 sec
06/07/2009 22:17:22 Network data transfer rate: 8,312.81 KB/sec
06/07/2009 22:17:22 Aggregate data transfer rate: 4,994.20 KB/sec
06/07/2009 22:17:22 Objects compressed by: 49%
06/07/2009 22:17:22 Elapsed processing time: 05:15:21
06/07/2009 22:17:22 --- SCHEDULEREC STATUS END
06/07/2009 22:17:22 ANS1311E Server out of data storage space

06/07/2009 22:17:22 --- SCHEDULEREC OBJECT END MONTHLY_ARCHIVE_A001SIEM 06/07/2009 17:00:00
06/07/2009 22:17:22 ANS1512E Scheduled event 'MONTHLY_ARCHIVE_A001SIEM' failed. Return code = 12.
06/07/2009 22:17:22 Sending results for scheduled event 'MONTHLY_ARCHIVE_A001SIEM'.
06/07/2009 22:17:24 Results sent to server for scheduled event 'MONTHLY_ARCHIVE_A001SIEM'.

second node logs
06/07/2009 19:16:19 Normal File--> 0 /var/log/samba/smbd.log [Sent]
06/07/2009 19:16:28 Normal File--> 159,611,665 /var/log/tsom/tsom_eam2_messages_2009-02-10_1201.log.tar.gz ** Unsucces
sful **
06/07/2009 19:16:28 ANS1114I Waiting for mount of offline media.
06/07/2009 19:25:31 Retry # 1 Normal File--> 159,611,665 /var/log/tsom/tsom_eam2_messages_2009-02-10_1201.log.tar.gz [
Sent]
06/07/2009 19:27:11 Normal File--> 196,746,868 /var/log/tsom/tsom_eam2_messages_2009-03-21_1201.log.tar.gz [Sent]
06/07/2009 19:31:14 Normal File--> 119,034,405 /var/log/tsom/tsom_eam2_messages_2008-12-26_1200.log.tar.gz ** Unsucces
sful **
06/07/2009 19:31:14 ANS1114I Waiting for mount of offline media.
06/07/2009 19:32:34 Retry # 1 Normal File--> 119,034,405 /var/log/tsom/tsom_eam2_messages_2008-12-26_1200.log.tar.gz [
Sent]
06/07/2009 19:33:31 Normal File--> 151,448,680 /var/log/tsom/tsom_eam2_messages_2009-02-03_1200.log.tar.gz [Sent]
06/07/2009 19:34:17 Normal File--> 156,258,519 /var/log/tsom/tsom_eam2_messages_2009-05-13_0000.log.tar.gz [Sent]
06/07/2009 19:34:59 Normal File--> 125,076,253 /var/log/tsom/tsom_eam2_messages_2009-03-22_1201.log.tar.gz ** Unsucces
sful **
06/07/2009 19:34:59 ANS1228E Sending of object '/var/log/tsom/tsom_eam2_messages_2009-03-22_1201.log.tar.gz' failed
06/07/2009 19:34:59 ANS1311E Server out of data storage space

06/07/2009 19:35:09 Normal File--> 173,841,027 /var/log/tsom/tsom_eam2_messages_2009-03-26_1201.log.tar.gz ** Unsucces
sful **
06/07/2009 19:35:09 ANS1114I Waiting for mount of offline media.
06/07/2009 19:36:28 Retry # 1 Normal File--> 173,841,027 /var/log/tsom/tsom_eam2_messages_2009-03-26_1201.log.tar.gz [
Sent]
06/07/2009 19:36:44 Normal File--> 127,687,499 /var/log/tsom/tsom_eam2_messages_2008-12-06_1200.log.tar.gz ** Unsucces
sful **
06/07/2009 19:36:44 ANS1228E Sending of object '/var/log/tsom/tsom_eam2_messages_2008-12-06_1200.log.tar.gz' failed
06/07/2009 19:36:44 ANS1311E Server out of data storage space

06/07/2009 19:36:58 ANS1228E Sending of object '/var/log/tsom/tsom_eam2_messages_2009-01-31_1201.log.tar.gz' failed
06/07/2009 19:36:58 ANS1311E Server out of data storage space

06/07/2009 19:37:18 Normal File--> 105,258,169 /var/log/tsom/tsom_eam2_messages_2008-11-03_1201.log.tar.gz ** Unsucces
sful **
06/07/2009 19:37:18 ANS1228E Sending of object '/var/log/tsom/tsom_eam2_messages_2008-11-03_1201.log.tar.gz' failed
06/07/2009 19:37:18 ANS1311E Server out of data storage space

06/07/2009 19:37:26 Normal File--> 148,840,747 /var/log/tsom/tsom_eam2_messages_2008-12-11_1201.log.tar.gz ** Unsucces
sful **
06/07/2009 19:37:26 ANS1114I Waiting for mount of offline media.
06/07/2009 19:38:01 Retry # 1 Normal File--> 148,840,747 /var/log/tsom/tsom_eam2_messages_2008-12-11_1201.log.tar.gz [
Sent]

06/07/2009 21:38:05 Normal File--> 381 /home/chandra/.kde/Autostart/.directory [Sent]
06/07/2009 21:38:06 Archive processing of '/home/*' finished without failure.

06/07/2009 21:38:06 --- SCHEDULEREC STATUS BEGIN
06/07/2009 21:38:06 Total number of objects inspected: 2,607
06/07/2009 21:38:06 Total number of objects archived: 2,590
06/07/2009 21:38:06 Total number of objects updated: 0
06/07/2009 21:38:06 Total number of objects rebound: 0
06/07/2009 21:38:06 Total number of objects deleted: 0
06/07/2009 21:38:06 Total number of objects expired: 0
06/07/2009 21:38:06 Total number of objects failed: 15
06/07/2009 21:38:06 Total number of bytes transferred: 78.06 GB
06/07/2009 21:38:06 Data transfer time: 6,556.20 sec
06/07/2009 21:38:06 Network data transfer rate: 12,485.55 KB/sec
06/07/2009 21:38:06 Aggregate data transfer rate: 6,313.95 KB/sec
06/07/2009 21:38:06 Objects compressed by: 52%
06/07/2009 21:38:06 Elapsed processing time: 03:36:04
06/07/2009 21:38:06 --- SCHEDULEREC STATUS END
06/07/2009 21:38:06 ANS1311E Server out of data storage space

06/07/2009 21:38:06 --- SCHEDULEREC OBJECT END MONTHLY_ARCHIVE_A002SIEM 06/07/2009 18:00:00
06/07/2009 21:38:06 ANS1512E Scheduled event 'MONTHLY_ARCHIVE_A002SIEM' failed. Return code = 12.
06/07/2009 21:38:06 Sending results for scheduled event 'MONTHLY_ARCHIVE_A002SIEM'.
06/07/2009 21:38:09 Results sent to server for scheduled event 'MONTHLY_ARCHIVE_A002SIEM'.
 
Its prob not your storage pools, its related to client compression probably.

Check COMPRESSALWAYS
 
HI gurus

thanks for the feedback. BBB Where to check COMPRESSALWAYS setting on the client dsm.sys ?
Hi toxy13
previously when hit this problem my diskpool3 size was 5GB only.so thinking of this same disk size causing problem i increase to 15GB by adding another 10GB.Today i have added another 5GB to make it 20GB.

SErvername TSM-SVR
COMMMethod TCPip
TCPPort 1500
TCPServeraddress 10.200.XXX.XX
PasswordA Generate
NodeName XXXXXX
Exclude /var/log/all.log
Errorlogname /opt/tivoli/tsm/client/ba/bin/dailydsmerror.log
Schedlogname /opt/tivoli/tsm/client/ba/bin/dailydsmsched.log
Errorlogretention 7 D
Commrestartduration 60
Commrestartinterval 30
Compression yes


SErvername TSM-SVR
COMMMethod TCPip
TCPPort 1500
TCPServeraddress 10.200.XXX.XX
PasswordA Generate
NodeName XXXXXXXX
include /***/ weekly_mc
Exclude /var/log/all.log
Errorlogname /opt/tivoli/tsm/client/ba/bin/weeklydsmerror.log
Schedlogname /opt/tivoli/tsm/client/ba/bin/weeklydsmsched.log
Errorlogretention 7 D
Commrestartduration 60
Commrestartinterval 30
Compression yes

SErvername TSM-SVR
COMMMethod TCPip
TCPPort 1500
TCPServeraddress 10.200.XXX.XX
NodeName XXXXXX
Errorlogname /opt/tivoli/tsm/client/ba/bin/cbmrdsmerror.log
Schedlogname /opt/tivoli/tsm/client/ba/bin/cbmrdsmsched.log
Errorlogretention 7 D
Commrestartduration 60
Commrestartinterval 30
Compression yes
 
If compressalways is not in your dsm.opt or client optionset, it will be the default setting which is YES.

This can cause your error in certain circumstances, involving backup data growing while being compressed.

Try adding an exclude.compression /.../*.gz to your dsm.opt to stop compressing the gzip'd files.

Obviously the error can also mean your stgpools have filled up / don't have enough scratch etc. But because you seem to be getting the errors mostly on .gz files I figure its related to client compression, compressalways=yes(default).

Do you have caching enabled on your disk stgpool? I suspect you do?
 
Hi BBB

Thank you.I will try out with your suggestion.Anyway the cache you refering is not trun on i guess ? correct me if im wrong and there is scratch vol avaiable in our library.



Storage Pool Name: DISKPOOL3
Storage Pool Type: Primary
Device Class Name: DISK
Estimated Capacity: 20 G
Space Trigger Util: 74.6
Pct Util: 74.6
Pct Migr: 74.6
Pct Logical: 100.0
High Mig Pct: 90
Low Mig Pct: 70
Migration Delay: 0
Migration Continue: Yes
Migration Processes: 1
Reclamation Processes:
Next Storage Pool: LTOPOOL1
Reclaim Storage Pool:
Maximum Size Threshold: No Limit
Access: Read/Write
Description:
Overflow Location:
Cache Migrated Files?: No
Collocate?:
Reclamation Threshold:
Offsite Reclamation Limit:
Maximum Scratch Volumes Allowed:
Number of Scratch Volumes Used:
Delay Period for Volume Reuse:
Migration in Progress?: No
Amount Migrated (MB): 6,583.61
Elapsed Migration Time (seconds): 2,411
Reclamation in Progress?:
Last Update by (administrator): ADMIN
Last Update Date/Time: 09/16/2008 12:45:12
Storage Pool Data Format: Native
Copy Storage Pool(s):
Active Data Pool(s):
Continue Copy on Error?: Yes
CRC Data: No
Reclamation Type:
Overwrite Data when Deleted:
 
Back
Top