Veritas-bu

[Veritas-bu] Considering moving to NetBackup

2003-01-27 14:03:17
Subject: [Veritas-bu] Considering moving to NetBackup
From: jkennedy AT qualcomm DOT com (Kennedy, Jeffrey)
Date: Mon, 27 Jan 2003 11:03:17 -0800
This is a multi-part message in MIME format.

------_=_NextPart_001_01C2C636.C05BB704
Content-Type: text/plain;
        charset="us-ascii"
Content-Transfer-Encoding: quoted-printable

Or using a disk stu as a staging area works wonders on that since you
can MPX the clients all you want to fill up the network pipe but it
makes difference on duplication since the disk is random access anyway.
Makes for drive speed duplications.  DLT7k drives were consistently at
9MB/sec and SDLT was consistently at 22MB/sec.

=20

~JK

=20

-----Original Message-----
From: Donaldson, Mark [mailto:Mark.Donaldson AT experianems DOT com]=20
Sent: Monday, January 27, 2003 10:59 AM
To: 'Brian Chase'; Kennedy, Jeffrey
Cc: Deb; Zink, Melanie; veritas-bu AT mailman.eng.auburn DOT edu
Subject: RE: [Veritas-bu] Considering moving to NetBackup

=20

I had significant problems in image duplication from multiplexed tapes.
The problem shows up when you're trying to duplicate a single image from
a larger set of images.  NB has to sort that image from the other
information that's not to be duplicated.

So for every 10 MByte read, I wrote a single MByte.  It was very
inefficient and took forever.  I eventually broke my backups into two
sets, those that get duplicated and those that don't.  The ones that get
duplicated are demux'd so at dup time I write everything I read.  I can
duplicate very quickly now.

If you duplicate from mux'd images & you're doing the whole set, you
should probably look at the "-mpx" flag on bpduplicate.

-M=20

      -mpx      Specifies that when duplicating multiplexed backups,=20
                NetBackup will create multiplexed backups on the
destination=20
                media. This reduces the time to duplicate multiplexed=20
                backups.=20

                Multiplexed duplication is not supported for:=20

                - Non-multiplexed backups=20
                - Backups from disk type storage units=20
                - Backups to disk type storage units=20
                - Auspex-FastBackup, FlashBackup, or NDMP backups=20

                If backups in the above categories are encountered
during=20
                duplication, NetBackup duplicates them first and uses
non-=20
                multiplexed duplication. Then, the multiplexed backups
are=20
                duplicated by using multiplexed duplication.=20

                If all the backups in a multiplexed group are not=20
                duplicated, the duplicated multiplexed group will have a

                different layout of fragments. (A multiplexed group is a
set=20
                of backups that were multiplexed together during a
single=20
                multiplexing session.)=20

                If this option is not specified, all backups are
duplicated=20
                using non-multiplexed duplication.=20

                For more information on multiplexing, see your NetBackup

                system administrator's guide.=20

-----Original Message-----=20
From: Brian Chase [mailto:vaxzilla AT jarai DOT org]=20
Sent: Monday, January 27, 2003 11:39 AM=20
To: Kennedy, Jeffrey=20
Cc: Deb; Zink, Melanie; veritas-bu AT mailman.eng.auburn DOT edu=20
Subject: RE: [Veritas-bu] Considering moving to NetBackup=20

=20

On Mon, 27 Jan 2003, Kennedy, Jeffrey wrote:=20

> Slow as in sloooooooowwwww.  When I tried vaulting from tape to tape=20
> with original backups using a 6 MPX, I was seeing kb/sec transfer
rate.=20
> No matter what I did, or Veritas tech support had me try, I got a=20
> maximum transfer rate of 700kb/sec.  Not really feasible in today's
data=20
> center.=20
>=20
> But that could have just been me.  Tech support seemed stumped.=20

When using MPX, you're splitting the stream across multiple drives.=20
Did you have multiple drives available (and occupied) by the MPX'ed=20
tapes that were being copied to the non-MPX offsite?=20

I'd imagine that if you had, say, only one drive available on the=20
"read" end of that copy, the library would be spending an awful lot of=20
time changing between tapes, seeking, and rewinding.  That scenerio=20
could certainly explain seeing such low throughput.=20

-brian.=20

_______________________________________________=20
Veritas-bu maillist  -  Veritas-bu AT mailman.eng.auburn DOT edu=20
http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu=20


------_=_NextPart_001_01C2C636.C05BB704
Content-Type: text/html;
        charset="us-ascii"
Content-Transfer-Encoding: quoted-printable

<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 3.2//EN">
<html>

<head>
<META HTTP-EQUIV=3D"Content-Type" CONTENT=3D"text/html; =
charset=3Dus-ascii">


<meta name=3DGenerator content=3D"Microsoft Word 10 (filtered)">
<title>RE: [Veritas-bu] Considering moving to NetBackup</title>

<style>
<!--
 /* Font Definitions */
 @font-face
        {font-family:Tahoma;
        panose-1:2 11 6 4 3 5 4 4 2 4;}
 /* Style Definitions */
 p.MsoNormal, li.MsoNormal, div.MsoNormal
        {margin:0in;
        margin-bottom:.0001pt;
        font-size:12.0pt;
        font-family:"Times New Roman";}
a:link, span.MsoHyperlink
        {color:blue;
        text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
        {color:blue;
        text-decoration:underline;}
p
        {margin-right:0in;
        margin-left:0in;
        font-size:12.0pt;
        font-family:"Times New Roman";}
span.EmailStyle18
        {font-family:Arial;
        color:navy;}
@page Section1
        {size:8.5in 11.0in;
        margin:1.0in 1.25in 1.0in 1.25in;}
div.Section1
        {page:Section1;}
-->
</style>

</head>

<body lang=3DEN-US link=3Dblue vlink=3Dblue>

<div class=3DSection1>

<p class=3DMsoNormal><font size=3D2 color=3Dnavy face=3DArial><span =
style=3D'font-size:
10.0pt;font-family:Arial;color:navy'>Or using a disk stu as a staging =
area
works wonders on that since you can MPX the clients all you want to fill =
up the
network pipe but it makes difference on duplication since the disk is =
random
access anyway.&nbsp; Makes for drive speed duplications.&nbsp; DLT7k =
drives were consistently
at 9MB/sec and SDLT was consistently at 22MB/sec.</span></font></p>

<p class=3DMsoNormal><font size=3D2 color=3Dnavy face=3DArial><span =
style=3D'font-size:
10.0pt;font-family:Arial;color:navy'>&nbsp;</span></font></p>

<p class=3DMsoNormal><font size=3D2 color=3Dnavy face=3DArial><span =
style=3D'font-size:
10.0pt;font-family:Arial;color:navy'>~JK</span></font></p>

<p class=3DMsoNormal><font size=3D2 color=3Dnavy face=3DArial><span =
style=3D'font-size:
10.0pt;font-family:Arial;color:navy'>&nbsp;</span></font></p>

<div style=3D'border:none;border-left:solid blue 1.5pt;padding:0in 0in =
0in 4.0pt'>

<p class=3DMsoNormal><font size=3D2 face=3DTahoma><span =
style=3D'font-size:10.0pt;
font-family:Tahoma'>-----Original Message-----<br>
<b><span style=3D'font-weight:bold'>From:</span></b> Donaldson, Mark =
[mailto:Mark.Donaldson AT experianems DOT com]
<br>
<b><span style=3D'font-weight:bold'>Sent:</span></b> Monday, January 27, =
2003
10:59 AM<br>
<b><span style=3D'font-weight:bold'>To:</span></b> 'Brian Chase'; =
Kennedy,
Jeffrey<br>
<b><span style=3D'font-weight:bold'>Cc:</span></b> Deb; Zink, Melanie;
veritas-bu AT mailman.eng.auburn DOT edu<br>
<b><span style=3D'font-weight:bold'>Subject:</span></b> RE: [Veritas-bu]
Considering moving to NetBackup</span></font></p>

<p class=3DMsoNormal><font size=3D3 face=3D"Times New Roman"><span =
style=3D'font-size:
12.0pt'>&nbsp;</span></font></p>

<p><font size=3D2 face=3D"Times New Roman"><span =
style=3D'font-size:10.0pt'>I had
significant problems in image duplication from multiplexed tapes.&nbsp; =
The
problem shows up when you're trying to duplicate a single image from a =
larger
set of images.&nbsp; NB has to sort that image from the other =
information
that's not to be duplicated.</span></font></p>

<p><font size=3D2 face=3D"Times New Roman"><span =
style=3D'font-size:10.0pt'>So for
every 10 MByte read, I wrote a single MByte.&nbsp; It was very =
inefficient and
took forever.&nbsp; I eventually broke my backups into two sets, those =
that get
duplicated and those that don't.&nbsp; The ones that get duplicated are =
demux'd
so at dup time I write everything I read.&nbsp; I can duplicate very =
quickly
now.</span></font></p>

<p><font size=3D2 face=3D"Times New Roman"><span =
style=3D'font-size:10.0pt'>If you
duplicate from mux'd images &amp; you're doing the whole set, you should
probably look at the &quot;-mpx&quot; flag on =
bpduplicate.</span></font></p>

<p><font size=3D2 face=3D"Times New Roman"><span =
style=3D'font-size:10.0pt'>-M</span></font>
</p>

<p><font size=3D2 face=3D"Times New Roman"><span =
style=3D'font-size:10.0pt'>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
-mpx&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Specifies that when duplicating =
multiplexed
backups,</span></font> <br>
<font size=3D2><span =
style=3D'font-size:10.0pt'>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbs=
p;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
NetBackup will create multiplexed backups on the =
destination</span></font> <br>
<font size=3D2><span =
style=3D'font-size:10.0pt'>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbs=
p;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
media. This reduces the time to duplicate multiplexed</span></font> <br>
<font size=3D2><span =
style=3D'font-size:10.0pt'>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbs=
p;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
backups.</span></font> </p>

<p><font size=3D2 face=3D"Times New Roman"><span =
style=3D'font-size:10.0pt'>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbs=
p;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
Multiplexed duplication is not supported for:</span></font> </p>

<p><font size=3D2 face=3D"Times New Roman"><span =
style=3D'font-size:10.0pt'>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbs=
p;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
- Non-multiplexed backups</span></font> <br>
<font size=3D2><span =
style=3D'font-size:10.0pt'>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbs=
p;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
- Backups from disk type storage units</span></font> <br>
<font size=3D2><span =
style=3D'font-size:10.0pt'>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbs=
p;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
- Backups to disk type storage units</span></font> <br>
<font size=3D2><span =
style=3D'font-size:10.0pt'>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbs=
p;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
- Auspex-FastBackup, FlashBackup, or NDMP backups</span></font> </p>

<p><font size=3D2 face=3D"Times New Roman"><span =
style=3D'font-size:10.0pt'>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbs=
p;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
If backups in the above categories are encountered during</span></font> =
<br>
<font size=3D2><span =
style=3D'font-size:10.0pt'>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbs=
p;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
duplication, NetBackup duplicates them first and uses non-</span></font> =
<br>
<font size=3D2><span =
style=3D'font-size:10.0pt'>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbs=
p;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
multiplexed duplication. Then, the multiplexed backups are</span></font> =
<br>
<font size=3D2><span =
style=3D'font-size:10.0pt'>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbs=
p;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
duplicated by using multiplexed duplication.</span></font> </p>

<p><font size=3D2 face=3D"Times New Roman"><span =
style=3D'font-size:10.0pt'>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbs=
p;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
If all the backups in a multiplexed group are not</span></font> <br>
<font size=3D2><span =
style=3D'font-size:10.0pt'>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbs=
p;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
duplicated, the duplicated multiplexed group will have a</span></font> =
<br>
<font size=3D2><span =
style=3D'font-size:10.0pt'>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbs=
p;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
different layout of fragments. (A multiplexed group is a =
set</span></font> <br>
<font size=3D2><span =
style=3D'font-size:10.0pt'>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbs=
p;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
of backups that were multiplexed together during a single</span></font> =
<br>
<font size=3D2><span =
style=3D'font-size:10.0pt'>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbs=
p;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
multiplexing session.)</span></font> </p>

<p><font size=3D2 face=3D"Times New Roman"><span =
style=3D'font-size:10.0pt'>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbs=
p;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
If this option is not specified, all backups are =
duplicated</span></font> <br>
<font size=3D2><span =
style=3D'font-size:10.0pt'>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbs=
p;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
using non-multiplexed duplication.</span></font> </p>

<p><font size=3D2 face=3D"Times New Roman"><span =
style=3D'font-size:10.0pt'>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbs=
p;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
For more information on multiplexing, see your NetBackup</span></font> =
<br>
<font size=3D2><span =
style=3D'font-size:10.0pt'>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbs=
p;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
system administrator's guide.</span></font> </p>

<p><font size=3D2 face=3D"Times New Roman"><span =
style=3D'font-size:10.0pt'>-----Original
Message-----</span></font> <br>
<font size=3D2><span style=3D'font-size:10.0pt'>From: Brian Chase [<a
href=3D"mailto:vaxzilla AT jarai DOT org">mailto:vaxzilla AT jarai DOT 
org</a>]</span><=
/font> <br>
<font size=3D2><span style=3D'font-size:10.0pt'>Sent: Monday, January =
27, 2003
11:39 AM</span></font> <br>
<font size=3D2><span style=3D'font-size:10.0pt'>To: Kennedy, =
Jeffrey</span></font> <br>
<font size=3D2><span style=3D'font-size:10.0pt'>Cc: Deb; Zink, Melanie; =
veritas-bu AT mailman.eng.auburn DOT edu</span></font>
<br>
<font size=3D2><span style=3D'font-size:10.0pt'>Subject: RE: =
[Veritas-bu]
Considering moving to NetBackup</span></font> </p>

<p class=3DMsoNormal><font size=3D3 face=3D"Times New Roman"><span =
style=3D'font-size:
12.0pt'>&nbsp;</span></font></p>

<p><font size=3D2 face=3D"Times New Roman"><span =
style=3D'font-size:10.0pt'>On Mon,
27 Jan 2003, Kennedy, Jeffrey wrote:</span></font> </p>

<p><font size=3D2 face=3D"Times New Roman"><span =
style=3D'font-size:10.0pt'>&gt; Slow
as in sloooooooowwwww.&nbsp; When I tried vaulting from tape to =
tape</span></font>
<br>
<font size=3D2><span style=3D'font-size:10.0pt'>&gt; with original =
backups using a
6 MPX, I was seeing kb/sec transfer rate.</span></font> <br>
<font size=3D2><span style=3D'font-size:10.0pt'>&gt; No matter what I =
did, or
Veritas tech support had me try, I got a</span></font> <br>
<font size=3D2><span style=3D'font-size:10.0pt'>&gt; maximum transfer =
rate of
700kb/sec.&nbsp; Not really feasible in today's data</span></font> <br>
<font size=3D2><span style=3D'font-size:10.0pt'>&gt; =
center.</span></font> <br>
<font size=3D2><span style=3D'font-size:10.0pt'>&gt;</span></font> <br>
<font size=3D2><span style=3D'font-size:10.0pt'>&gt; But that could have =
just been
me.&nbsp; Tech support seemed stumped.</span></font> </p>

<p><font size=3D2 face=3D"Times New Roman"><span =
style=3D'font-size:10.0pt'>When
using MPX, you're splitting the stream across multiple =
drives.</span></font> <br>
<font size=3D2><span style=3D'font-size:10.0pt'>Did you have multiple =
drives
available (and occupied) by the MPX'ed</span></font> <br>
<font size=3D2><span style=3D'font-size:10.0pt'>tapes that were being =
copied to the
non-MPX offsite?</span></font> </p>

<p><font size=3D2 face=3D"Times New Roman"><span =
style=3D'font-size:10.0pt'>I'd
imagine that if you had, say, only one drive available on =
the</span></font> <br>
<font size=3D2><span style=3D'font-size:10.0pt'>&quot;read&quot; end of =
that copy,
the library would be spending an awful lot of</span></font> <br>
<font size=3D2><span style=3D'font-size:10.0pt'>time changing between =
tapes,
seeking, and rewinding.&nbsp; That scenerio</span></font> <br>
<font size=3D2><span style=3D'font-size:10.0pt'>could certainly explain =
seeing such
low throughput.</span></font> </p>

<p><font size=3D2 face=3D"Times New Roman"><span =
style=3D'font-size:10.0pt'>-brian.</span></font>
</p>

<p><font size=3D2 face=3D"Times New Roman"><span =
style=3D'font-size:10.0pt'>______________________________________________=
_</span></font>
<br>
<font size=3D2><span style=3D'font-size:10.0pt'>Veritas-bu =
maillist&nbsp; -&nbsp;
Veritas-bu AT mailman.eng.auburn DOT edu</span></font> <br>
<font size=3D2><span style=3D'font-size:10.0pt'><a
href=3D"http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu"; =
target=3D"_blank">http://mailman.eng.auburn.edu/mailman/listinfo/veritas-=
bu</a></span></font>
</p>

</div>

</div>

</body>

</html>
=00
------_=_NextPart_001_01C2C636.C05BB704--