Veritas-bu

Re: [Veritas-bu] bulk import of images

2008-06-12 20:56:42
Subject: Re: [Veritas-bu] bulk import of images
From: "Martin, Jonathan" <JMARTI05 AT intersil DOT com>
To: "Esson, Paul" <Paul.Esson AT Redstor DOT com>, <veritas-bu AT mailman.eng.auburn DOT edu>
Date: Thu, 12 Jun 2008 20:41:55 -0400

I scripted the import of several hundred SDLT Media running a simple script.  I output the entries of the Phase I import to a text file called <mediaID>.txt and  wrote a perl script to read that in and create an excel file with the media id, date of the backup and what server was backed up.  I then used a pivot chart to combine what servers had backups available for what days / months / years.  As and when someone makes a request I run a phase II import only on the images required, then restore the data. 

 

My suggestions are as follows:

1) Watch the tape drives; I had the occasional media get “stuck.”  I think, due to bad media.  The issue would cause the whole process to hang.

2) I had a huge library with over 300 slots and a media server dedicated to this effort.  I’m sure a smaller library would have been a major pain.

3) Write a script or look for phase I logs that are very small – these are usually errors (in my case anyway)

 

I can send you my scripts but they are just simple for loops, looking at a list of media that I loaded.  On SDLT (110GB / 220GB Compressed) the Phase I’s took a little better than an hour per (we multiplexed 4x /sigh) and the phase IIs take 4-8 hours depending.  I’m sure LTOs would take longer, so good luck!

 

-Jonathan

 


From: veritas-bu-bounces AT mailman.eng.auburn DOT edu [mailto:veritas-bu-bounces AT mailman.eng.auburn DOT edu] On Behalf Of Esson, Paul
Sent: Thursday, June 12, 2008 8:22 PM
To: veritas-bu AT mailman.eng.auburn DOT edu
Subject: [Veritas-bu] bulk import of images

 

Folks,

 

Anybody out there successfully automated a large volume import of tape media into NetBackup?  I am curious as to how you controlled the processing, given the potential conflict in using available tapes drives for example and how you validated the success of the phases of the import.  We have several hundred tapes to process (800+). I am also looking for indications as to how long a phase 1 and phase 2 import will take on LTO-1 media with close to 2:1 compression (190+ GB).  We have multiplexed media and 2 GB fragment sizes which I imagine will slow things down too.

 

Regards,

 

Paul Esson
Redstor Limited

Direct:               +44 (0) 1224 595381
Mobile:          +44 (0) 7766 906514
E-Mail:          paul.esson AT redstor DOT com
Web:            www.redstor.com

REDSTOR LIMITED
Torridon House
73-75 Regent Quay
Aberdeen
UK
AB11 5AR

Disclaimer:
The information included in this e-mail is of a confidential nature and is intended only for the addressee.  If you are not the intended addressee, any disclosure, copying or distribution by you is prohibited and may be unlawful.  Disclosure to any party other than the addressee, whether inadvertent or otherwise is not intended to waive privilege or confidentiality.

 

_______________________________________________
Veritas-bu maillist  -  Veritas-bu AT mailman.eng.auburn DOT edu
http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
<Prev in Thread] Current Thread [Next in Thread>