Veritas-bu

Re: [Veritas-bu] how to copy backups from data domain totapew/netbackup 6.5

2009-03-09 16:00:55
Subject: Re: [Veritas-bu] how to copy backups from data domain totapew/netbackup 6.5
From: "Donaldson, Mark" <Mark.Donaldson AT staples DOT com>
To: "Hickman, Tony" <Tony.Hickman AT sbmoffshore DOT com>, "Jeff Lightner" <jlightner AT water DOT com>, <veritas-bu AT mailman.eng.auburn DOT edu>
Date: Mon, 9 Mar 2009 13:42:29 -0600
If you've got a DSU, then I'd suggest starting with bpimmedia, then. 
 
It'll show you what images are on the device.
 
For example...:
 
bpimmedia -disk -disk_stu <DISK_STU_NAME> -d <start_date_range> -e <end_date_range> | awk '$1=="IMAGE" {print $4}' | tee /tmp/file_of_bpids
 
This'll give you a list of image id's on the DD storage unit for the date range specified.  "bpimmedia" has lots of options for selecting images if you don't want to do it with a simple date range.  The "awk" on the end just snips out the backup image id.
 
Put this list of ID's in a file, copy the file to a safe name, too, then feed the results into bpduplicate with the '-Bidfile' option. 
 
bpduplicate -dstunit <TAPE_STU> -Bidfile /tmp/file_of_bpids -dp <DSTPOOL> -cn 1 -L /tmp/dup.logfile -set_primary 1
 
Note: bpduplicate expects to duplicate to a tape on that same media server unless you use the -altreadhost option.
 
This'll duplicate those disk images to a tape, now you have to go back and expire the on-disk images or you won't gain your disk space back.  This is why you made a copy of the list of image ID's, the original list is deleted by bpduplicate (I dunno why - it's always done this, though). 
 
for id in `cat /tmp/file_of_bpids.copy`
do
  num_copies=` bpimagelist -backupid $bpid 2>/dev/null \
               awk 'BEGIN{num=0}{if($1=="IMAGE"){num=$21}}END{print num}'`
  if [ $num_copies -gt 1 ]
  then
    echo "Expire: $id"
    bpexpdate -recalculate -backupid $id -d 0 -copy 1 -force
  fi
done
 
So the snipped above reads the backup id's one by one and then checks if the you've got at least two copies of it.  If you do, then it deletes the first copy.
 
Note - I'm making an assumption above that you have only one copy of the data backed up and that one copy is on your disk STU.  It's possible with other arrangements but easier to make this assumption first.  It think it's accurate to what you said earlier.
 
Hope this helps.
-M


From: Hickman, Tony [mailto:Tony.Hickman AT sbmoffshore DOT com]
Sent: Monday, March 09, 2009 1:16 PM
To: Jeff Lightner; Donaldson, Mark; veritas-bu AT mailman.eng.auburn DOT edu
Subject: RE: [Veritas-bu] how to copy backups from data domain totapew/netbackup 6.5

Thanks for the many replies, and my apologies for taking awhile to respond.  I just got off of a very long support call with Data Domain and I mentioned the tape backups to the tech I was working with.  The Data Domain device is setup as a disk storage unit.  It has VTL capabilities but the VTL has not been setup yet. The tech recommended that we setup VTL but wanted me to check with our assigned systems engineer before proceeding.  We have one Win 2003 server as our master server, and we have a Quantum Scalar i500 that holds our tapes.  Before the Data Domain everything was going to tape.  I am not certain just yet if the VTL setup is required to copy to the tapes or not, or if I can just script something out and go?
 
It is becoming increasingly critical for me to find a way to get the backups off of the Data Domain and get them to tape.  Currently our retention periods are set at 3 months for all backups.  Our corporate policy states we must take the quarterly fulls to tape and archive them offsite.  The problem is that we have yet to grab our 4th quarter tape backups for 2008 and we are getting closer to running out of time.  Also the Data Domain is nearing it's maximum capacity.  So the plan is to get the 08 4th quarter fulls off to tape and then drop our retention periods down to 1 month from 3 month to help free up space.
 
I will do some research here shortly about the bpduplicate command and see what I can come up with.  I'm not that great at scripting but I can normally find my way around.  I hope the extra information helps.  If anyone else has more advise please chime in.  I appreciate all the quick responses. 
 
Thanks,
 
Tony H.
 


From: Jeff Lightner [mailto:jlightner AT water DOT com]
Sent: Monday, March 09, 2009 1:39 PM
To: Donaldson, Mark; Hickman, Tony; veritas-bu AT mailman.eng.auburn DOT edu
Subject: RE: [Veritas-bu] how to copy backups from data domain totapew/netbackup 6.5

It would have to be a DSU since it is a disk based de-duplication device.   Here we use GigE connections to it but Fibre is available (for a price).

 

In our environment we DO have Vaulting so we regularly vault from the DSU to tape for those items that require offsite storage.

 

One alternative to that (which we don’t use) is to get a second Data Domain and put it at an offsite location then use Data Domain’s ability to copy images directly to the offsite unit from the onsite unit.

 


From: Donaldson, Mark [mailto:Mark.Donaldson AT Staples DOT com]
Sent: Monday, March 09, 2009 2:31 PM
To: Jeff Lightner; Hickman, Tony; veritas-bu AT mailman.eng.auburn DOT edu
Subject: RE: [Veritas-bu] how to copy backups from data domain totapew/netbackup 6.5

 

Is the data domain a DSU for netbackup?

 

When you say you're backing up to it, can you give more details?

 

-M

 


From: veritas-bu-bounces AT mailman.eng.auburn DOT edu [mailto:veritas-bu-bounces AT mailman.eng.auburn DOT edu] On Behalf Of Jeff Lightner
Sent: Monday, March 09, 2009 10:51 AM
To: Hickman, Tony; veritas-bu AT mailman.eng.auburn DOT edu
Subject: Re: [Veritas-bu] how to copy backups from data domain totapew/netbackup 6.5

You can use the bpduplicate command to copy one backup image to another.   The source image can be Data Domain and the target can be tape.  If you know scripting it should be fairly easy to create a script that calls this command.   Type “man bpduplicate” for more details on the command.  Look at the storage unit options for setting source and destination.


From: veritas-bu-bounces AT mailman.eng.auburn DOT edu [mailto:veritas-bu-bounces AT mailman.eng.auburn DOT edu] On Behalf Of Hickman, Tony
Sent: Monday, March 09, 2009 10:27 AM
To: veritas-bu AT mailman.eng.auburn DOT edu
Subject: [Veritas-bu] how to copy backups from data domain to tapew/netbackup 6.5

Hi,

This is the first time for me using this mailing list.  This list was recommended to me by someone and here I am. 

Here is my current dilemma:

We went to using a Data Domain device along with NetBackup 6.5 in late December.  We do not have the Vault add-on for NetBackup.  Currently all of our backups are going to the Data Domain.  Our corporate policy requires us to make quarterly full backups to tape.  I am trying to figure out how I can copy backups off of the Data Domain to a tape library.  I was told that this can be done with the help of some scripts but, I have not been able to find any information on how to do this or where to even begin though my research attemps.  I am hoping someone on this mailing list has experience with this process, or is willing to point me in the right direction.  Please reply if you can help and many thanks!

B/R,

Tony H.


Recipients in 'Cc...' of this e-mail may not read it immediately and shall not be held accountable for not acting on enclosed information. This message and any attachments are solely for the intended recipient and may contain confidential or privileged information. If you are not the intended recipient, any disclosure, copying, use, or distribution of the information included in this message and any attachments is prohibited. If you have received this communication in error, please notify us by reply e-mail and immediately and permanently delete this message and any attachments. Thank you.

 

Please consider our environment before printing this e-mail or attachments.

----------------------------------
CONFIDENTIALITY NOTICE: This e-mail may contain privileged or confidential information and is for the sole use of the intended recipient(s). If you are not the intended recipient, any disclosure, copying, distribution, or use of the contents of this information is prohibited and may be unlawful. If you have received this electronic transmission in error, please reply immediately to the sender that you have received the message in error, and delete it. Thank you.
----------------------------------

_______________________________________________
Veritas-bu maillist  -  Veritas-bu AT mailman.eng.auburn DOT edu
http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu