One thing you might want to consider for the future..if you have
your quarterly backups in a separate schedule, set up multiple copies of that
schedule (in line tape copy). From that you can write your disk copy and
tape copy for your quarterlies at the same time and set the retention for a
longer retention on the tape copy. This would save you from having to
script it if you aren’t great at scripting and don’t have vault.
From:
veritas-bu-bounces AT mailman.eng.auburn DOT edu
[mailto:veritas-bu-bounces AT mailman.eng.auburn DOT edu] On Behalf Of Donaldson,
Mark
Sent: Monday, March 09, 2009 3:42 PM
To: Hickman, Tony; Jeff Lightner; veritas-bu AT mailman.eng.auburn DOT edu
Subject: Re: [Veritas-bu] how to copy backups from data domain
totapew/netbackup 6.5
If you've got a DSU, then I'd suggest starting with bpimmedia,
then.
It'll show you what images are on the device.
For example...:
bpimmedia -disk -disk_stu <DISK_STU_NAME> -d
<start_date_range> -e <end_date_range> | awk '$1=="IMAGE"
{print $4}' | tee /tmp/file_of_bpids
This'll give you a list of image id's on the DD storage unit for
the date range specified. "bpimmedia" has lots of options for
selecting images if you don't want to do it with a simple date range. The
"awk" on the end just snips out the backup image id.
Put this list of ID's in a file, copy
the file to a safe name, too, then feed the results into
bpduplicate with the '-Bidfile' option.
bpduplicate -dstunit <TAPE_STU> -Bidfile /tmp/file_of_bpids
-dp <DSTPOOL> -cn 1 -L /tmp/dup.logfile -set_primary 1
Note: bpduplicate expects to duplicate to a tape on that same media
server unless you use the -altreadhost option.
This'll duplicate those disk images to a tape, now you have to go
back and expire the on-disk images or you won't gain your disk space back.
This is why you made a copy of the list of image ID's, the original list is
deleted by bpduplicate (I dunno why - it's always done this, though).
for id in `cat /tmp/file_of_bpids.copy`
do
num_copies=` bpimagelist -backupid $bpid 2>/dev/null \
awk 'BEGIN{num=0}{if($1=="IMAGE"){num=$21}}END{print num}'`
if [ $num_copies -gt 1 ]
then
echo "Expire: $id"
bpexpdate -recalculate -backupid $id -d 0 -copy
1 -force
fi
done
So the snipped above reads the backup id's one by one and then
checks if the you've got at least two copies of it. If you do, then it
deletes the first copy.
Note - I'm making an assumption above that you have only one copy
of the data backed up and that one copy is on your disk STU. It's
possible with other arrangements but easier to make this assumption
first. It think it's accurate to what you said earlier.
Hope this helps.
-M
From: Hickman, Tony
[mailto:Tony.Hickman AT sbmoffshore DOT com]
Sent: Monday, March 09, 2009 1:16 PM
To: Jeff Lightner; Donaldson, Mark; veritas-bu AT mailman.eng.auburn DOT edu
Subject: RE: [Veritas-bu] how to copy backups from data domain
totapew/netbackup 6.5
Thanks for the many replies, and my apologies for taking awhile to
respond. I just got off of a very long support call with Data Domain and
I mentioned the tape backups to the tech I was working with. The Data
Domain device is setup as a disk storage unit. It has VTL capabilities
but the VTL has not been setup yet. The tech recommended that we setup VTL
but wanted me to check with our assigned systems engineer before
proceeding. We have one Win 2003 server as our master server, and we
have a Quantum Scalar i500 that holds our tapes. Before the Data Domain
everything was going to tape. I am not certain just yet if the VTL setup
is required to copy to the tapes or not, or if I can just script something out
and go?
It is becoming increasingly critical for me to find a way to get
the backups off of the Data Domain and get them to tape. Currently our
retention periods are set at 3 months for all backups. Our corporate
policy states we must take the quarterly fulls to tape and archive them
offsite. The problem is that we have yet to grab our 4th quarter tape
backups for 2008 and we are getting closer to running out of time.
Also the Data Domain is nearing it's maximum capacity. So the plan is to
get the 08 4th quarter fulls off to tape and then drop our retention periods
down to 1 month from 3 month to help free up space.
I will do some research here shortly about the bpduplicate command
and see what I can come up with. I'm not that great at scripting but I
can normally find my way around. I hope the extra information
helps. If anyone else has more advise please chime in. I appreciate
all the quick responses.
Tony H.
From: Jeff Lightner [mailto:jlightner AT water DOT com]
Sent: Monday, March 09, 2009 1:39 PM
To: Donaldson, Mark; Hickman, Tony; veritas-bu AT mailman.eng.auburn DOT edu
Subject: RE: [Veritas-bu] how to copy backups from data domain
totapew/netbackup 6.5
It would have to be a DSU since it is a disk based de-duplication
device. Here we use GigE connections to it but Fibre is available
(for a price).
In our environment we DO have Vaulting so we regularly vault from
the DSU to tape for those items that require offsite storage.
One alternative to that (which we don’t use) is to get a
second Data Domain and put it at an offsite location then use Data
Domain’s ability to copy images directly to the offsite unit from the
onsite unit.
From: Donaldson, Mark
[mailto:Mark.Donaldson AT Staples DOT com]
Sent: Monday, March 09, 2009 2:31 PM
To: Jeff Lightner; Hickman, Tony; veritas-bu AT mailman.eng.auburn DOT edu
Subject: RE: [Veritas-bu] how to copy backups from data domain
totapew/netbackup 6.5
Is the data domain a DSU for netbackup?
When you say you're backing up to it, can you give more details?
-M
From: veritas-bu-bounces AT mailman.eng.auburn DOT edu
[mailto:veritas-bu-bounces AT mailman.eng.auburn DOT edu] On Behalf Of Jeff
Lightner
Sent: Monday, March 09, 2009 10:51 AM
To: Hickman, Tony; veritas-bu AT mailman.eng.auburn DOT edu
Subject: Re: [Veritas-bu] how to copy backups from data domain
totapew/netbackup 6.5
You can use the bpduplicate command to copy one backup image to
another. The source image can be Data Domain and the target can be
tape. If you know scripting it should be fairly easy to create a script
that calls this command. Type “man bpduplicate” for
more details on the command. Look at the storage unit options for setting
source and destination.
From:
veritas-bu-bounces AT mailman.eng.auburn DOT edu
[mailto:veritas-bu-bounces AT mailman.eng.auburn DOT edu] On Behalf Of Hickman,
Tony
Sent: Monday, March 09, 2009 10:27 AM
To: veritas-bu AT mailman.eng.auburn DOT edu
Subject: [Veritas-bu] how to copy backups from data domain to
tapew/netbackup 6.5
This
is the first time for me using this mailing list. This list was
recommended to me by someone and here I am.
Here
is my current dilemma:
We
went to using a Data Domain device along with NetBackup 6.5 in late
December. We do not have the Vault add-on for NetBackup. Currently
all of our backups are going to the Data Domain. Our corporate policy
requires us to make quarterly full backups to tape. I am trying to
figure out how I can copy backups off of the Data Domain to a tape
library. I was told that this can be done with the help of some scripts but,
I have not been able to find any information on how to do this or where to even
begin though my research attemps. I am hoping someone on this mailing
list has experience with this process, or is willing to point me in the right
direction. Please reply if you can help and many thanks!
Tony H.
Recipients in 'Cc...' of this e-mail may not read it immediately and shall not
be held accountable for not acting on enclosed information. This message and
any attachments are solely for the intended recipient and may contain
confidential or privileged information. If you are not the intended recipient,
any disclosure, copying, use, or distribution of the information included in
this message and any attachments is prohibited. If you have received this
communication in error, please notify us by reply e-mail and immediately and
permanently delete this message and any attachments. Thank you.
Please consider our environment before printing this e-mail or
attachments.
----------------------------------
CONFIDENTIALITY NOTICE: This e-mail may contain privileged or confidential
information and is for the sole use of the intended recipient(s). If you are
not the intended recipient, any disclosure, copying, distribution, or use of
the contents of this information is prohibited and may be unlawful. If you have
received this electronic transmission in error, please reply immediately to the
sender that you have received the message in error, and delete it. Thank you.
----------------------------------