Veritas-bu

[Veritas-bu] Considering moving to NetBackup

2003-01-27 13:58:33
Subject: [Veritas-bu] Considering moving to NetBackup
From: Mark.Donaldson AT experianems DOT com (Donaldson, Mark)
Date: Mon, 27 Jan 2003 11:58:33 -0700
This message is in MIME format. Since your mail reader does not understand
this format, some or all of this message may not be legible.

------_=_NextPart_001_01C2C636.16B8D220
Content-Type: text/plain

I had significant problems in image duplication from multiplexed tapes.  The
problem shows up when you're trying to duplicate a single image from a
larger set of images.  NB has to sort that image from the other information
that's not to be duplicated.

So for every 10 MByte read, I wrote a single MByte.  It was very inefficient
and took forever.  I eventually broke my backups into two sets, those that
get duplicated and those that don't.  The ones that get duplicated are
demux'd so at dup time I write everything I read.  I can duplicate very
quickly now.

If you duplicate from mux'd images & you're doing the whole set, you should
probably look at the "-mpx" flag on bpduplicate.

-M

      -mpx      Specifies that when duplicating multiplexed backups,
                NetBackup will create multiplexed backups on the destination
                media. This reduces the time to duplicate multiplexed
                backups.

                Multiplexed duplication is not supported for:

                - Non-multiplexed backups
                - Backups from disk type storage units
                - Backups to disk type storage units
                - Auspex-FastBackup, FlashBackup, or NDMP backups

                If backups in the above categories are encountered during
                duplication, NetBackup duplicates them first and uses non-
                multiplexed duplication. Then, the multiplexed backups are
                duplicated by using multiplexed duplication.

                If all the backups in a multiplexed group are not
                duplicated, the duplicated multiplexed group will have a
                different layout of fragments. (A multiplexed group is a set
                of backups that were multiplexed together during a single
                multiplexing session.)

                If this option is not specified, all backups are duplicated
                using non-multiplexed duplication.

                For more information on multiplexing, see your NetBackup
                system administrator's guide.

-----Original Message-----
From: Brian Chase [mailto:vaxzilla AT jarai DOT org]
Sent: Monday, January 27, 2003 11:39 AM
To: Kennedy, Jeffrey
Cc: Deb; Zink, Melanie; veritas-bu AT mailman.eng.auburn DOT edu
Subject: RE: [Veritas-bu] Considering moving to NetBackup


On Mon, 27 Jan 2003, Kennedy, Jeffrey wrote:

> Slow as in sloooooooowwwww.  When I tried vaulting from tape to tape
> with original backups using a 6 MPX, I was seeing kb/sec transfer rate.
> No matter what I did, or Veritas tech support had me try, I got a
> maximum transfer rate of 700kb/sec.  Not really feasible in today's data
> center.
>
> But that could have just been me.  Tech support seemed stumped.

When using MPX, you're splitting the stream across multiple drives.
Did you have multiple drives available (and occupied) by the MPX'ed
tapes that were being copied to the non-MPX offsite?

I'd imagine that if you had, say, only one drive available on the
"read" end of that copy, the library would be spending an awful lot of
time changing between tapes, seeking, and rewinding.  That scenerio
could certainly explain seeing such low throughput.

-brian.

_______________________________________________
Veritas-bu maillist  -  Veritas-bu AT mailman.eng.auburn DOT edu
http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu

------_=_NextPart_001_01C2C636.16B8D220
Content-Type: text/html
Content-Transfer-Encoding: quoted-printable

<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 3.2//EN">
<HTML>
<HEAD>
<META HTTP-EQUIV=3D"Content-Type" CONTENT=3D"text/html; =
charset=3DUS-ASCII">
<META NAME=3D"Generator" CONTENT=3D"MS Exchange Server version =
5.5.2653.12">
<TITLE>RE: [Veritas-bu] Considering moving to NetBackup</TITLE>
</HEAD>
<BODY>

<P><FONT SIZE=3D2>I had significant problems in image duplication from =
multiplexed tapes.&nbsp; The problem shows up when you're trying to =
duplicate a single image from a larger set of images.&nbsp; NB has to =
sort that image from the other information that's not to be =
duplicated.</FONT></P>

<P><FONT SIZE=3D2>So for every 10 MByte read, I wrote a single =
MByte.&nbsp; It was very inefficient and took forever.&nbsp; I =
eventually broke my backups into two sets, those that get duplicated =
and those that don't.&nbsp; The ones that get duplicated are demux'd so =
at dup time I write everything I read.&nbsp; I can duplicate very =
quickly now.</FONT></P>

<P><FONT SIZE=3D2>If you duplicate from mux'd images &amp; you're doing =
the whole set, you should probably look at the &quot;-mpx&quot; flag on =
bpduplicate.</FONT></P>

<P><FONT SIZE=3D2>-M</FONT>
</P>

<P><FONT SIZE=3D2>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; =
-mpx&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Specifies that when duplicating =
multiplexed backups,</FONT>
<BR><FONT =
SIZE=3D2>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nb=
sp;&nbsp;&nbsp;&nbsp;&nbsp; NetBackup will create multiplexed backups =
on the destination</FONT>
<BR><FONT =
SIZE=3D2>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nb=
sp;&nbsp;&nbsp;&nbsp;&nbsp; media. This reduces the time to duplicate =
multiplexed</FONT>
<BR><FONT =
SIZE=3D2>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nb=
sp;&nbsp;&nbsp;&nbsp;&nbsp; backups.</FONT>
</P>

<P><FONT =
SIZE=3D2>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nb=
sp;&nbsp;&nbsp;&nbsp;&nbsp; Multiplexed duplication is not supported =
for:</FONT>
</P>

<P><FONT =
SIZE=3D2>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nb=
sp;&nbsp;&nbsp;&nbsp;&nbsp; - Non-multiplexed backups</FONT>
<BR><FONT =
SIZE=3D2>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nb=
sp;&nbsp;&nbsp;&nbsp;&nbsp; - Backups from disk type storage =
units</FONT>
<BR><FONT =
SIZE=3D2>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nb=
sp;&nbsp;&nbsp;&nbsp;&nbsp; - Backups to disk type storage units</FONT>
<BR><FONT =
SIZE=3D2>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nb=
sp;&nbsp;&nbsp;&nbsp;&nbsp; - Auspex-FastBackup, FlashBackup, or NDMP =
backups</FONT>
</P>

<P><FONT =
SIZE=3D2>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nb=
sp;&nbsp;&nbsp;&nbsp;&nbsp; If backups in the above categories are =
encountered during</FONT>
<BR><FONT =
SIZE=3D2>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nb=
sp;&nbsp;&nbsp;&nbsp;&nbsp; duplication, NetBackup duplicates them =
first and uses non-</FONT>
<BR><FONT =
SIZE=3D2>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nb=
sp;&nbsp;&nbsp;&nbsp;&nbsp; multiplexed duplication. Then, the =
multiplexed backups are</FONT>
<BR><FONT =
SIZE=3D2>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nb=
sp;&nbsp;&nbsp;&nbsp;&nbsp; duplicated by using multiplexed =
duplication.</FONT>
</P>

<P><FONT =
SIZE=3D2>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nb=
sp;&nbsp;&nbsp;&nbsp;&nbsp; If all the backups in a multiplexed group =
are not</FONT>
<BR><FONT =
SIZE=3D2>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nb=
sp;&nbsp;&nbsp;&nbsp;&nbsp; duplicated, the duplicated multiplexed =
group will have a</FONT>
<BR><FONT =
SIZE=3D2>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nb=
sp;&nbsp;&nbsp;&nbsp;&nbsp; different layout of fragments. (A =
multiplexed group is a set</FONT>
<BR><FONT =
SIZE=3D2>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nb=
sp;&nbsp;&nbsp;&nbsp;&nbsp; of backups that were multiplexed together =
during a single</FONT>
<BR><FONT =
SIZE=3D2>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nb=
sp;&nbsp;&nbsp;&nbsp;&nbsp; multiplexing session.)</FONT>
</P>

<P><FONT =
SIZE=3D2>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nb=
sp;&nbsp;&nbsp;&nbsp;&nbsp; If this option is not specified, all =
backups are duplicated</FONT>
<BR><FONT =
SIZE=3D2>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nb=
sp;&nbsp;&nbsp;&nbsp;&nbsp; using non-multiplexed duplication.</FONT>
</P>

<P><FONT =
SIZE=3D2>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nb=
sp;&nbsp;&nbsp;&nbsp;&nbsp; For more information on multiplexing, see =
your NetBackup</FONT>
<BR><FONT =
SIZE=3D2>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nb=
sp;&nbsp;&nbsp;&nbsp;&nbsp; system administrator's guide.</FONT>
</P>

<P><FONT SIZE=3D2>-----Original Message-----</FONT>
<BR><FONT SIZE=3D2>From: Brian Chase [<A =
HREF=3D"mailto:vaxzilla AT jarai DOT org">mailto:vaxzilla AT jarai DOT 
org</A>]</FONT>=

<BR><FONT SIZE=3D2>Sent: Monday, January 27, 2003 11:39 AM</FONT>
<BR><FONT SIZE=3D2>To: Kennedy, Jeffrey</FONT>
<BR><FONT SIZE=3D2>Cc: Deb; Zink, Melanie; =
veritas-bu AT mailman.eng.auburn DOT edu</FONT>
<BR><FONT SIZE=3D2>Subject: RE: [Veritas-bu] Considering moving to =
NetBackup</FONT>
</P>
<BR>

<P><FONT SIZE=3D2>On Mon, 27 Jan 2003, Kennedy, Jeffrey wrote:</FONT>
</P>

<P><FONT SIZE=3D2>&gt; Slow as in sloooooooowwwww.&nbsp; When I tried =
vaulting from tape to tape</FONT>
<BR><FONT SIZE=3D2>&gt; with original backups using a 6 MPX, I was =
seeing kb/sec transfer rate.</FONT>
<BR><FONT SIZE=3D2>&gt; No matter what I did, or Veritas tech support =
had me try, I got a</FONT>
<BR><FONT SIZE=3D2>&gt; maximum transfer rate of 700kb/sec.&nbsp; Not =
really feasible in today's data</FONT>
<BR><FONT SIZE=3D2>&gt; center.</FONT>
<BR><FONT SIZE=3D2>&gt;</FONT>
<BR><FONT SIZE=3D2>&gt; But that could have just been me.&nbsp; Tech =
support seemed stumped.</FONT>
</P>

<P><FONT SIZE=3D2>When using MPX, you're splitting the stream across =
multiple drives.</FONT>
<BR><FONT SIZE=3D2>Did you have multiple drives available (and =
occupied) by the MPX'ed</FONT>
<BR><FONT SIZE=3D2>tapes that were being copied to the non-MPX =
offsite?</FONT>
</P>

<P><FONT SIZE=3D2>I'd imagine that if you had, say, only one drive =
available on the</FONT>
<BR><FONT SIZE=3D2>&quot;read&quot; end of that copy, the library would =
be spending an awful lot of</FONT>
<BR><FONT SIZE=3D2>time changing between tapes, seeking, and =
rewinding.&nbsp; That scenerio</FONT>
<BR><FONT SIZE=3D2>could certainly explain seeing such low =
throughput.</FONT>
</P>

<P><FONT SIZE=3D2>-brian.</FONT>
</P>

<P><FONT =
SIZE=3D2>_______________________________________________</FONT>
<BR><FONT SIZE=3D2>Veritas-bu maillist&nbsp; -&nbsp; =
Veritas-bu AT mailman.eng.auburn DOT edu</FONT>
<BR><FONT SIZE=3D2><A =
HREF=3D"http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu"; =
TARGET=3D"_blank">http://mailman.eng.auburn.edu/mailman/listinfo/veritas=
-bu</A></FONT>
</P>

</BODY>
</HTML>
------_=_NextPart_001_01C2C636.16B8D220--