Veritas-bu

Re: [Veritas-bu] NBU7 / De-Dupe?

2010-04-06 12:14:54
Subject: Re: [Veritas-bu] NBU7 / De-Dupe?
From: Justin Piszcz <jpiszcz AT lucidpixels DOT com>
To: scott.george AT parker DOT com
Date: Tue, 6 Apr 2010 12:14:49 -0400 (EDT)
Hi Scott,

I followed the NetBackup 7 De Dupe guide it explains how to create the 
puredisk storage unit / disk pool etc.

Justin.

On Tue, 6 Apr 2010, scott.george AT parker DOT com wrote:

> I have been working on this as well, trying to get media server dedup
> working.  I am caught in a type of chicken/egg loop.  I can't create a
> PureDisk storage unit, because I don't have a disk pool, but when I go to
> create a disk pool, I don't have any volumes available.  Just exactly what
> volume is it looking for?  Googling around, it would appear that my media
> server doing the dedup would need to be PDOS.  The documentation says that
> RHEL 5 is a supported OS for media server dedup.  What gives?
>
> BTW to Justin, there is no way to dedup to tape.  None, nada, never.
>
>
>
>
>
> From:
> Justin Piszcz <jpiszcz AT lucidpixels DOT com>
> To:
> "Chapman, Scott" <Scott.Chapman AT icbc DOT com>
> Cc:
> veritas-bu AT mailman.eng.auburn DOT edu
> Date:
> 04/06/2010 12:03 PM
> Subject:
> Re: [Veritas-bu] NBU7 / De-Dupe?
> Sent by:
> veritas-bu-bounces AT mailman.eng.auburn DOT edu
>
>
>
> I believe you are correct, I asked if it was possible to do it with tape
> (crazy!) idea but no response yet =)  It looks like its limited to
> Puredisk/NBU7 disk tool.
>
> On Tue, 6 Apr 2010, Chapman, Scott wrote:
>
>> Has anybody tried client side de-dup with something other than a
>> puredisk pool?  (puredisk or netbackup 7 disk pool)  It is my
>> understanding (which could be incorrect;-) that you can't use netbackup
>> 7 client side de-dup with any other type of disk pool.  ie  you can't
>> use data domain on the backend when using client side dedup.
>>
>>
>>
>> Thanks!
>>
>>
>>
>> Scott Chapman
>>
>> Senior Technical Specialist
>>
>> Storage and Database Administration
>>
>> ICBC - Victoria
>>
>> Ph:  250.414.7650  Cell:  250.213.9295
>>
>> From: veritas-bu-bounces AT mailman.eng.auburn DOT edu
>> [mailto:veritas-bu-bounces AT mailman.eng.auburn DOT edu] On Behalf Of David
>> Stanaway
>> Sent: Friday, April 02, 2010 6:29 AM
>> To: veritas-bu AT mailman.eng.auburn DOT edu
>> Subject: Re: [Veritas-bu] NBU7 / De-Dupe?
>>
>>
>>
>>
>> These number aren't that hot compared to DataDomain from my use of it.
>>
>> We are seeing 86TB of backup images occupying 4.4TB of phys disk.
>>
>> On 4/1/2010 12:07 PM, Jon Bousselot wrote:
>>
>> I set it up in a small test environment, and started backing up three
>> clients into a deduplication pool exclusively.  2 windows and 1 linux
>> system
>>
>> The first pass wasn't that impressive, maybe a 5% to 10% de-dup ratio
>> and it took a bit longer than just streaming that same data to tape or
>> disk.
>>
>> The second pass had a 90% deduplication ratio, mostly because just 1
>> week had passed since the first full backup and not every file changed.
>>
>>
>> After three weeks, I had about 300GB of data deduplicated down into
>> about 90GB of disk space.  The kbytes total reported from the catalog
>> said 300G, and df -k said 90G.
>>
>>
>>
>> The data content of the three systems is typical for a user workstation.
>> Email, photos, miscellaneous files.  De-dup let me put many versions of
>> those same files into a backup without actually having many copies of
>> that file spinning on disk.
>>
>>
>>
>> And then the disk holding the de-duplicated data developed a bunch of
>> bad sectors and I lost it all.  Once I rebuild it, I'll check out the DR
>> process for protecting your de-dup database and files.
>>
>>
>>
>> I also want to test client side de-duplication to see if that helps
>> stream data compared to media server de-duplication alone.  The
>> media/master server is a quad core with 8g ram, and the clients are a
>> desktop and a laptop.  After seeing it run and observing the space
>> savings it generates, I think it is a very creative way to solve some
>> (not all) problems.  It is definitely not a "set it and forget it"
>> technology.  You still need to monitor its utilization similar to how
>> you would monitor basic disk or tape usage.
>>
>>
>>
>> -Jon
>>
>>
>>
>> ________________________________
>>
>> From: Justin Piszcz <jpiszcz AT lucidpixels DOT com>
>> <mailto:jpiszcz AT lucidpixels DOT com>
>> To: veritas-bu AT mailman.eng.auburn DOT edu
>> Sent: Thu, April 1, 2010 3:27:36 AM
>> Subject: [Veritas-bu] NBU7 / De-Dupe?
>>
>> Hi,
>>
>> Is anyone using de-dupe?
>>
>> What kind of savings are you seeing?
>>
>> Justin.
>> _______________________________________________
>> Veritas-bu maillist  -  Veritas-bu AT mailman.eng.auburn DOT edu
>> http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
>>
>>
>>
>> _______________________________________________
>> Veritas-bu maillist  -  Veritas-bu AT mailman.eng.auburn DOT edu
>> http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
>>
>>
>>
>>
>>
>>
>> ------------------------------------------------------------
>> This email and any attachments are intended only for the named
>> recipient and may contain confidential and/or privileged material.
>> Any unauthorized copying, dissemination or other use by a person
>> other than the named recipient of this communication is prohibited.
>> If you received this in error or are not named as a recipient,
>> please notify the sender and destroy all copies of this email
>> immediately.
>>
> _______________________________________________
> Veritas-bu maillist  -  Veritas-bu AT mailman.eng.auburn DOT edu
> http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
>
>
>
> PLEASE NOTE: The preceding information may be confidential or
> privileged. It only should be used or disseminated for the purpose
> of conducting business with Parker. If you are not an intended
> recipient, please notify the sender by replying to this message and
> then delete the information from your system. Thank you for your
> cooperation.
_______________________________________________
Veritas-bu maillist  -  Veritas-bu AT mailman.eng.auburn DOT edu
http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu

<Prev in Thread] Current Thread [Next in Thread>