Results 1 to 8 of 8
  1. #1
    Member
    Join Date
    Jan 2009
    Posts
    150
    Thanks
    0
    Thanked 0 Times in 0 Posts

    Default TSM Data Deduplication

    Hi,

    does anyone heard of this, if so which version are they come with this feature.

  2. #2
    Member sandeepkontham's Avatar
    Join Date
    Mar 2009
    Location
    Hyderabad,India
    Posts
    284
    Thanks
    0
    Thanked 1 Time in 1 Post

    Default

    data deduplication feature is there from TSM 6 version
    *Everybody loves TSM (if understood )
    Sandeep

  3. #3
    Senior Member DanGiles's Avatar
    Join Date
    Oct 2002
    Location
    Toronto, Ont. Canada
    Posts
    545
    Thanks
    0
    Thanked 0 Times in 0 Posts

    Default

    If you are going to consider this, take a look at some of the webcasts and redbooks. In my opinion, it still has a lot to be desired: it is not "inline", or real-time, and eats up a lot of system resources. First, define your requirements, then evaluate it against separate appliances, such as datadomain.

    Joining a Tivoli User Comminutity (TUC) will give you lots of resources: http://www.tivoli-ug.org
    Daniel R. Giles
    Sileg Consulting Inc.
    416.402.9744 dan.giles@sileg.com
    http://www.linkedin.com/in/sileg

  4. #4
    Member
    Join Date
    Jul 2007
    Location
    France
    Posts
    43
    Thanks
    0
    Thanked 2 Times in 2 Posts

    Default

    I tested it a bit, and I was very disappointed : the dedup ratio was around 2. A datadomain in similar cases dedups with a ratio of at least 4 ou 5.

    In addition, Datadomain compresses with gzip or lzip the deduplicated data, going regularly to ratios around 10 for a file server.

    And TSM is still unable to perform compression at the pool level. So you can achieve nearly as good ratio by just activating compression on the client.

    I really wonder why IBM bothered to develop a deduplication algorithm just to do not better than a good old Gzip

  5. #5
    Member
    Join Date
    May 2006
    Posts
    196
    Thanks
    3
    Thanked 6 Times in 5 Posts

    Default

    I read that TSM 6.2 will support client side deduplication.That may make this more interesting. I am really on the fence with inline vs post-process deduplication. I can't get the sort of performance some of my customers demand with inline deduplication.

  6. #6
    Member
    Join Date
    Oct 2004
    Posts
    198
    Thanks
    0
    Thanked 0 Times in 0 Posts

    Unhappy

    I just read the pdf on DD, is this true ? you cannot DD on a DISK stg ?

    Planning for deduplication
    Careful planning for deduplication can increase the efficiency of the setup process.
    Before setting up storage pools for deduplication:
    v Determine which client nodes have data that you want to deduplicate.
    v Decide whether you want to define a new storage pool exclusively for
    deduplication or update an existing storage pool. The storage pool must be a
    sequential-access disk (FILE) pool. Deduplication occurs at the storage pool
    level, and all data within a storage pool, except encrypted data, is deduplicated

  7. #7
    Senior Member DanGiles's Avatar
    Join Date
    Oct 2002
    Location
    Toronto, Ont. Canada
    Posts
    545
    Thanks
    0
    Thanked 0 Times in 0 Posts

    Default

    Not on a DISK device class, but a FILE device class, which is disk.

    I've been working on a couple of projects with TSM deduplication. First off, it's post-processing, which I'm not a fan of. Second, it eats up a lot of resources; both disk and CPU. You will have to run your own tests to see if it's worth it or not.

    For instance, on a smaller site, I ended up having to compress the backup data at the client site, reducing the data by over 75%. The added space savings from dedup is not worth the overhead, so I turned dedup off. At another installation I have loads of resources and dedup is running fine.

    One caveat: the identification processes only FLAGS the deduplication blocks; you don't actually save any space until you run reclamation.
    Daniel R. Giles
    Sileg Consulting Inc.
    416.402.9744 dan.giles@sileg.com
    http://www.linkedin.com/in/sileg

  8. #8
    Member
    Join Date
    Jul 2007
    Location
    France
    Posts
    43
    Thanks
    0
    Thanked 2 Times in 2 Posts

    Default

    Quote Originally Posted by tsmuser10 View Post
    I just read the pdf on DD, is this true ? you cannot DD on a DISK stg ?
    Yes, it's true because DD is very bad at managing direct access files. But you just have to use a FILE stg which works very well.

Similar Threads

  1. Data Deduplication in your environment for over 6 months
    By Frunkster in forum Tape / Media Library
    Replies: 4
    Last Post: 03-27-2009, 02:39 PM
  2. Dilligent deduplication
    By denisl in forum Tape / Media Library
    Replies: 2
    Last Post: 07-30-2008, 10:32 PM
  3. Deduplication ratios
    By denisl in forum Tape / Media Library
    Replies: 0
    Last Post: 05-13-2008, 09:14 PM
  4. TSM & Data Deduplication
    By influx in forum Others
    Replies: 3
    Last Post: 03-12-2008, 05:24 PM
  5. VTL and Data Deduplication
    By rowl in forum VTL - Virtual Tape Library
    Replies: 0
    Last Post: 06-28-2007, 04:38 PM

Tags for this Thread

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •