Veritas-bu

Re: [Veritas-bu] NBU7 / De-Dupe?

2010-04-06 12:03:13
Subject: Re: [Veritas-bu] NBU7 / De-Dupe?
From: "Chapman, Scott" <Scott.Chapman AT icbc DOT com>
To: "David Stanaway" <david AT stanaway DOT net>, <veritas-bu AT mailman.eng.auburn DOT edu>
Date: Tue, 6 Apr 2010 09:02:55 -0700

Has anybody tried client side de-dup with something other than a puredisk pool?  (puredisk or netbackup 7 disk pool)  It is my understanding (which could be incorrect;-) that you can’t use netbackup 7 client side de-dup with any other type of disk pool.  ie  you can’t use data domain on the backend when using client side dedup.

 

Thanks!

 

Scott Chapman

Senior Technical Specialist

Storage and Database Administration

ICBC - Victoria

Ph:  250.414.7650  Cell:  250.213.9295

From: veritas-bu-bounces AT mailman.eng.auburn DOT edu [mailto:veritas-bu-bounces AT mailman.eng.auburn DOT edu] On Behalf Of David Stanaway
Sent: Friday, April 02, 2010 6:29 AM
To: veritas-bu AT mailman.eng.auburn DOT edu
Subject: Re: [Veritas-bu] NBU7 / De-Dupe?

 


These number aren't that hot compared to DataDomain from my use of it.

We are seeing 86TB of backup images occupying 4.4TB of phys disk.

On 4/1/2010 12:07 PM, Jon Bousselot wrote:

I set it up in a small test environment, and started backing up three clients into a deduplication pool exclusively.  2 windows and 1 linux system

The first pass wasn't that impressive, maybe a 5% to 10% de-dup ratio and it took a bit longer than just streaming that same data to tape or disk. 

The second pass had a 90% deduplication ratio, mostly because just 1 week had passed since the first full backup and not every file changed.  

After three weeks, I had about 300GB of data deduplicated down into about 90GB of disk space.  The kbytes total reported from the catalog said 300G, and df -k said 90G.

 

The data content of the three systems is typical for a user workstation.  Email, photos, miscellaneous files.  De-dup let me put many versions of those same files into a backup without actually having many copies of that file spinning on disk.  

 

And then the disk holding the de-duplicated data developed a bunch of bad sectors and I lost it all.  Once I rebuild it, I'll check out the DR process for protecting your de-dup database and files.

 

I also want to test client side de-duplication to see if that helps stream data compared to media server de-duplication alone.  The media/master server is a quad core with 8g ram, and the clients are a desktop and a laptop.  After seeing it run and observing the space savings it generates, I think it is a very creative way to solve some (not all) problems.  It is definitely not a "set it and forget it" technology.  You still need to monitor its utilization similar to how you would monitor basic disk or tape usage.

 

-Jon

 


From: Justin Piszcz <jpiszcz AT lucidpixels DOT com>
To: veritas-bu AT mailman.eng.auburn DOT edu
Sent: Thu, April 1, 2010 3:27:36 AM
Subject: [Veritas-bu] NBU7 / De-Dupe?

Hi,

Is anyone using de-dupe?

What kind of savings are you seeing?

Justin.
_______________________________________________
Veritas-bu maillist  -  Veritas-bu AT mailman.eng.auburn DOT edu
http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu

 
 
_______________________________________________
Veritas-bu maillist  -  Veritas-bu AT mailman.eng.auburn DOT edu
http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
  

 


This email and any attachments are intended only for the named recipient and may contain confidential and/or privileged material. Any unauthorized copying, dissemination or other use by a person other than the named recipient of this communication is prohibited. If you received this in error or are not named as a recipient, please notify the sender and destroy all copies of this email immediately.

2010 Olympic and Paralympic Logo | ICBC Logo

_______________________________________________
Veritas-bu maillist  -  Veritas-bu AT mailman.eng.auburn DOT edu
http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu