TB ingest on a single TSM instance and database size

[lyle.fast]

We have hit a limitation for our hardware with TSM Client side deduplication on 6.3.4.200. The TSM Server is AIX 6.1 on a 64GB hardware LPAR on IBM Power 7 720B with a 2TB SSD database. A large TSM for VE environment and AIX Clients with 4.5 TB Incremental backup has filled our TSM DB, +90% of CPU and memory. A lot of consolidation of other entities is planned and we expect a 100% increase in size every 6 months for 2 years. We currently use EMC VNX block storage for both local and offsite deduplicated storage pools. We are actively investigating deduplication appliances and I am trying to gauge how large a TSM server running 6.3 can grow before a new instance is necessary.

Only on your largest TSM instance, please provide the following information?
A. How many TB do largest TSM shops ingest on a typical daily backup per TSM server?
B. What is your primary library or file device class storage?
C. What is your server?, #CPU's?, MemoryGB?
D. During backups Average CPU usage in %:, memory usage in %:
E. What is you reclaim threshold during reclamation?
F. How many TB in your primary pool?
G. What percentage of backup is client side deduplicated?
H. What percentage of backup is server deduplicated?

Example answer:
A. 4.5 TB daily incremental, 13 TB Peak with new ingest.
B. Qty 4 EMC VNX nearline SAS 8GB FC sequential device class local, Qty 4 EMC VNX offsite
C. IBM Power 7 P720 8202-E4B, 4 3GHz total 16 cores, 64GB
D. CPU 95%, Memory 90%
E. Reclamation Threshold: 33
F. TB within PRIMARY storage pools: ~100TB no dedup 40TB dedup, 140 TB total
G. 28% client side deduplicated.
H. 0% server side deduplicated.

 

[irrision]

Answers inline below and attached screenshot.

We have hit a limitation for our hardware with TSM Client side deduplication on 6.3.4.200. The TSM Server is AIX 6.1 on a 64GB hardware LPAR on IBM Power 7 720B with a 2TB SSD database. A large TSM for VE environment and AIX Clients with 4.5 TB Incremental backup has filled our TSM DB, +90% of CPU and memory. A lot of consolidation of other entities is planned and we expect a 100% increase in size every 6 months for 2 years. We currently use EMC VNX block storage for both local and offsite deduplicated storage pools. We are actively investigating deduplication appliances and I am trying to gauge how large a TSM server running 6.3 can grow before a new instance is necessary.

Only on your largest TSM instance, please provide the following information?
A. How many TB do largest TSM shops ingest on a typical daily backup per TSM server? 10-14TB
B. What is your primary library or file device class storage? TS3584 on 6 x LTO3
C. What is your server?, #CPU's?, MemoryGB? P5 550 2 CPUs 16GB memory on AIX 5.3
D. During backups Average CPU usage in %:, memory usage in %: 50-70% <90%
E. What is you reclaim threshold during reclamation? See attachment
F. How many TB in your primary pool? See attachment
G. What percentage of backup is client side deduplicated? 0%
H. What percentage of backup is server deduplicated? 0%




Example answer:
A. 4.5 TB daily incremental, 13 TB Peak with new ingest.
B. Qty 4 EMC VNX nearline SAS 8GB FC sequential device class local, Qty 4 EMC VNX offsite
C. IBM Power 7 P720 8202-E4B, 4 3GHz total 16 cores, 64GB
D. CPU 95%, Memory 90%
E. Reclamation Threshold: 33
F. TB within PRIMARY storage pools: ~100TB no dedup 40TB dedup, 140 TB total
G. 28% client side deduplicated.
H. 0% server side deduplicated.