Veritas-bu

[Veritas-bu] 2 tape drives issue

2003-03-13 13:03:54
Subject: [Veritas-bu] 2 tape drives issue
From: Mark.Donaldson AT experianems DOT com (Donaldson, Mark)
Date: Thu, 13 Mar 2003 11:03:54 -0700
This message is in MIME format. Since your mail reader does not understand
this format, some or all of this message may not be legible.

------_=_NextPart_001_01C2E98A.E8D902D0
Content-Type: text/plain;
        charset="iso-8859-1"

Drive compression, in Unix, is controlled by the major & minor numbers
associated with the device files.  These major & minor numbers, are
therefore referenced by the filename. 

For solaris, look for the /dev/ entry for your drives ending in "cbn", ie:
/dev/rmt/0cbn.  The "c" in "cbn" stands for "compressed".  If you use that
name in your storage unit setup (tpconfig -l), you should get compression at
the drive.

Yes, I'd definitely increase the 32K to at least 128 & maybe 256K.  Don't
screw with the number of buffers unless you're not getting sufficient
throughput - both changes can increase memory usage so tweak them up slowly.
The LTO drive wants big blocks of data for better throughput & compression.
Feeding it 32K teaspoonfuls will starve it.

Using both drives will speed backup times but you have to plan for it in
policy creation, storage units, pre- & post-schedule jobs, etc.  I backup
nearly 350G of oracle data nightly (direct scsi, no network) using four
streams to two DLT drives (7-8 MB/sec max).  It takes about 6.5 hours.  I
use a NUMBER_DATA_BUFFERS of 64 and SIZE_DATA_BUFFERS & NET_BUFFER_SIZE of
262144 (256K).

HTH - Mark

-----Original Message-----
From: Feroz F. Basir [mailto:dbase77 AT yahoo DOT com]
Sent: Thursday, March 13, 2003 10:27 AM
To: Donaldson, Mark; veritas-bu AT mailman.eng.auburn DOT edu
Subject: RE: [Veritas-bu] 2 tape drives issue


Hi,

Thank you for replying. How do I go about turn on the
LTO drive compression, as these drives are attach to
L25 tape library at the back. Any command I can use? I
also going to uncheck the netbackup compression see
how it goes tonite. Regarding the buffer setting, I'm
using the default which I think 32K. Do you think this
buffer setting cause the extra time? I attached the
tape library to our SUN box and ONLY backup data from
the SUN. No network backup or so ever. I'm very
suprise about the time that I have here.

What negative impact can I get if I use bigger buffer
size? And if I use both drives at the same how's the
writing work? Does it write at the same time or one
after another?

I'll let you know the outcome tomorrow morning.

Thank you.

regards,
feroz

 --- "Donaldson, Mark"
<Mark.Donaldson AT experianems DOT com> wrote: > Don't use
the Netbackup client compression.  It's
> software based and causes
> a high client load, slowing the backups.  Your LTO
> drive is capable of
> hardware compression, use that.
> 
> LTO is good for about 15 MB/sec native, perhaps
> 25-30MB streaming rates if
> you can get the data to it fast enough & the data is
> decently compressible.
> So 74G at 15 MB/sec is only 84 minutes so you're
> really underperforming. 
> 
> Check your buffer sizes.  For my LTO drives, I'm
> using 256K buffers & it
> makes a big performance difference.  Check this
> whitepaper for a description
> buffer sizes & counts.  Make sure to set the buffers
> for both client & media
> server. 
> http://seer.support.veritas.com/docs/183702.htm  If
> your system is
> Windows, check out this instead:
> http://seer.support.veritas.com/docs/244652.htm
> 
> Also consider the path from client to media server. 
> If it's standard
> ethernet, it's only capable of about 10MB/sec, and
> your drive will be
> underutilized.  Consider Gigabit ethernet if
> possible.
> 
> That should be enough to start with - post back any
> results you get.
> -M
> 
> -----Original Message-----
> From: Feroz F. Basir [mailto:dbase77 AT yahoo DOT com]
> Sent: Thursday, March 13, 2003 9:54 AM
> To: Donaldson, Mark;
> veritas-bu AT mailman.eng.auburn DOT edu
> Subject: RE: [Veritas-bu] 2 tape drives issue
> 
> 
> Hi,
> 
> LTO drive.
> 
> regards,
> feroz
> 
>  --- "Donaldson, Mark"
> <Mark.Donaldson AT experianems DOT com> wrote: > What kind
> of
> drive (DLT, LTO, etc.) in the L25?
> > -M
> > 
> > -----Original Message-----
> > From: Feroz F. Basir [mailto:dbase77 AT yahoo DOT com]
> > Sent: Thursday, March 13, 2003 4:15 AM
> > To: veritas-bu AT mailman.eng.auburn DOT edu
> > Subject: RE: [Veritas-bu] 2 tape drives issue
> > 
> > 
> > Hi,
> > 
> > Thank you to all who replied to my problem. I got
> it
> > to work to use both tape drives at the same time
> > using
> > 2 different policies. 
> > 
> > Backup took about 5 hrs to finish for 74 GB data
> on
> > 1
> > tape. I wonder myself if I can improve the time
> > here.
> > I only backup oracle data files. Plus select to
> > compress. Is this normal behaviour. I'm using NB
> 4.5
> > business server on SUN storedge L25 tape library
> > with
> > 2 drives.
> > 
> > Thank you again.
> > 
> > regards,
> > feroz
> > 
> > __________________________________________________
> > Do You Yahoo!?
> > Everything you'll ever need on one web page
> > from News and Sport to Email and Music Charts
> > http://uk.my.yahoo.com
> > _______________________________________________
> > Veritas-bu maillist  - 
> > Veritas-bu AT mailman.eng.auburn DOT edu
> >
>
http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
> >  
> 
> __________________________________________________
> Do You Yahoo!?
> Everything you'll ever need on one web page
> from News and Sport to Email and Music Charts
> http://uk.my.yahoo.com
>  

__________________________________________________
Do You Yahoo!?
Everything you'll ever need on one web page
from News and Sport to Email and Music Charts
http://uk.my.yahoo.com

------_=_NextPart_001_01C2E98A.E8D902D0
Content-Type: text/html;
        charset="iso-8859-1"
Content-Transfer-Encoding: quoted-printable

<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 3.2//EN">
<HTML>
<HEAD>
<META HTTP-EQUIV=3D"Content-Type" CONTENT=3D"text/html; =
charset=3Diso-8859-1">
<META NAME=3D"Generator" CONTENT=3D"MS Exchange Server version =
5.5.2653.12">
<TITLE>RE: [Veritas-bu] 2 tape drives issue</TITLE>
</HEAD>
<BODY>

<P><FONT SIZE=3D2>Drive compression, in Unix, is controlled by the =
major &amp; minor numbers associated with the device files.&nbsp; These =
major &amp; minor numbers, are therefore referenced by the filename. =
</FONT></P>

<P><FONT SIZE=3D2>For solaris, look for the /dev/ entry for your drives =
ending in &quot;cbn&quot;, ie: /dev/rmt/0cbn.&nbsp; The &quot;c&quot; =
in &quot;cbn&quot; stands for &quot;compressed&quot;.&nbsp; If you use =
that name in your storage unit setup (tpconfig -l), you should get =
compression at the drive.</FONT></P>

<P><FONT SIZE=3D2>Yes, I'd definitely increase the 32K to at least 128 =
&amp; maybe 256K.&nbsp; Don't screw with the number of buffers unless =
you're not getting sufficient throughput - both changes can increase =
memory usage so tweak them up slowly.&nbsp; The LTO drive wants big =
blocks of data for better throughput &amp; compression.&nbsp; Feeding =
it 32K teaspoonfuls will starve it.</FONT></P>

<P><FONT SIZE=3D2>Using both drives will speed backup times but you =
have to plan for it in policy creation, storage units, pre- &amp; =
post-schedule jobs, etc.&nbsp; I backup nearly 350G of oracle data =
nightly (direct scsi, no network) using four streams to two DLT drives =
(7-8 MB/sec max).&nbsp; It takes about 6.5 hours.&nbsp; I use a =
NUMBER_DATA_BUFFERS of 64 and SIZE_DATA_BUFFERS &amp; NET_BUFFER_SIZE =
of 262144 (256K).</FONT></P>

<P><FONT SIZE=3D2>HTH - Mark</FONT>
</P>

<P><FONT SIZE=3D2>-----Original Message-----</FONT>
<BR><FONT SIZE=3D2>From: Feroz F. Basir [<A =
HREF=3D"mailto:dbase77 AT yahoo DOT com">mailto:dbase77 AT yahoo DOT 
com</A>]</FONT>
<BR><FONT SIZE=3D2>Sent: Thursday, March 13, 2003 10:27 AM</FONT>
<BR><FONT SIZE=3D2>To: Donaldson, Mark; =
veritas-bu AT mailman.eng.auburn DOT edu</FONT>
<BR><FONT SIZE=3D2>Subject: RE: [Veritas-bu] 2 tape drives issue</FONT>
</P>
<BR>

<P><FONT SIZE=3D2>Hi,</FONT>
</P>

<P><FONT SIZE=3D2>Thank you for replying. How do I go about turn on =
the</FONT>
<BR><FONT SIZE=3D2>LTO drive compression, as these drives are attach =
to</FONT>
<BR><FONT SIZE=3D2>L25 tape library at the back. Any command I can use? =
I</FONT>
<BR><FONT SIZE=3D2>also going to uncheck the netbackup compression =
see</FONT>
<BR><FONT SIZE=3D2>how it goes tonite. Regarding the buffer setting, =
I'm</FONT>
<BR><FONT SIZE=3D2>using the default which I think 32K. Do you think =
this</FONT>
<BR><FONT SIZE=3D2>buffer setting cause the extra time? I attached =
the</FONT>
<BR><FONT SIZE=3D2>tape library to our SUN box and ONLY backup data =
from</FONT>
<BR><FONT SIZE=3D2>the SUN. No network backup or so ever. I'm =
very</FONT>
<BR><FONT SIZE=3D2>suprise about the time that I have here.</FONT>
</P>

<P><FONT SIZE=3D2>What negative impact can I get if I use bigger =
buffer</FONT>
<BR><FONT SIZE=3D2>size? And if I use both drives at the same how's =
the</FONT>
<BR><FONT SIZE=3D2>writing work? Does it write at the same time or =
one</FONT>
<BR><FONT SIZE=3D2>after another?</FONT>
</P>

<P><FONT SIZE=3D2>I'll let you know the outcome tomorrow =
morning.</FONT>
</P>

<P><FONT SIZE=3D2>Thank you.</FONT>
</P>

<P><FONT SIZE=3D2>regards,</FONT>
<BR><FONT SIZE=3D2>feroz</FONT>
</P>

<P><FONT SIZE=3D2>&nbsp;--- &quot;Donaldson, Mark&quot;</FONT>
<BR><FONT SIZE=3D2>&lt;Mark.Donaldson AT experianems DOT com&gt; wrote: &gt; =
Don't use</FONT>
<BR><FONT SIZE=3D2>the Netbackup client compression.&nbsp; It's</FONT>
<BR><FONT SIZE=3D2>&gt; software based and causes</FONT>
<BR><FONT SIZE=3D2>&gt; a high client load, slowing the backups.&nbsp; =
Your LTO</FONT>
<BR><FONT SIZE=3D2>&gt; drive is capable of</FONT>
<BR><FONT SIZE=3D2>&gt; hardware compression, use that.</FONT>
<BR><FONT SIZE=3D2>&gt; </FONT>
<BR><FONT SIZE=3D2>&gt; LTO is good for about 15 MB/sec native, =
perhaps</FONT>
<BR><FONT SIZE=3D2>&gt; 25-30MB streaming rates if</FONT>
<BR><FONT SIZE=3D2>&gt; you can get the data to it fast enough &amp; =
the data is</FONT>
<BR><FONT SIZE=3D2>&gt; decently compressible.</FONT>
<BR><FONT SIZE=3D2>&gt; So 74G at 15 MB/sec is only 84 minutes so =
you're</FONT>
<BR><FONT SIZE=3D2>&gt; really underperforming. </FONT>
<BR><FONT SIZE=3D2>&gt; </FONT>
<BR><FONT SIZE=3D2>&gt; Check your buffer sizes.&nbsp; For my LTO =
drives, I'm</FONT>
<BR><FONT SIZE=3D2>&gt; using 256K buffers &amp; it</FONT>
<BR><FONT SIZE=3D2>&gt; makes a big performance difference.&nbsp; Check =
this</FONT>
<BR><FONT SIZE=3D2>&gt; whitepaper for a description</FONT>
<BR><FONT SIZE=3D2>&gt; buffer sizes &amp; counts.&nbsp; Make sure to =
set the buffers</FONT>
<BR><FONT SIZE=3D2>&gt; for both client &amp; media</FONT>
<BR><FONT SIZE=3D2>&gt; server. </FONT>
<BR><FONT SIZE=3D2>&gt; <A =
HREF=3D"http://seer.support.veritas.com/docs/183702.htm"; =
TARGET=3D"_blank">http://seer.support.veritas.com/docs/183702.htm</A>&nb=
sp; If</FONT>
<BR><FONT SIZE=3D2>&gt; your system is</FONT>
<BR><FONT SIZE=3D2>&gt; Windows, check out this instead:</FONT>
<BR><FONT SIZE=3D2>&gt; <A =
HREF=3D"http://seer.support.veritas.com/docs/244652.htm"; =
TARGET=3D"_blank">http://seer.support.veritas.com/docs/244652.htm</A></F=
ONT>
<BR><FONT SIZE=3D2>&gt; </FONT>
<BR><FONT SIZE=3D2>&gt; Also consider the path from client to media =
server. </FONT>
<BR><FONT SIZE=3D2>&gt; If it's standard</FONT>
<BR><FONT SIZE=3D2>&gt; ethernet, it's only capable of about 10MB/sec, =
and</FONT>
<BR><FONT SIZE=3D2>&gt; your drive will be</FONT>
<BR><FONT SIZE=3D2>&gt; underutilized.&nbsp; Consider Gigabit ethernet =
if</FONT>
<BR><FONT SIZE=3D2>&gt; possible.</FONT>
<BR><FONT SIZE=3D2>&gt; </FONT>
<BR><FONT SIZE=3D2>&gt; That should be enough to start with - post back =
any</FONT>
<BR><FONT SIZE=3D2>&gt; results you get.</FONT>
<BR><FONT SIZE=3D2>&gt; -M</FONT>
<BR><FONT SIZE=3D2>&gt; </FONT>
<BR><FONT SIZE=3D2>&gt; -----Original Message-----</FONT>
<BR><FONT SIZE=3D2>&gt; From: Feroz F. Basir [<A =
HREF=3D"mailto:dbase77 AT yahoo DOT com">mailto:dbase77 AT yahoo DOT 
com</A>]</FONT>
<BR><FONT SIZE=3D2>&gt; Sent: Thursday, March 13, 2003 9:54 AM</FONT>
<BR><FONT SIZE=3D2>&gt; To: Donaldson, Mark;</FONT>
<BR><FONT SIZE=3D2>&gt; veritas-bu AT mailman.eng.auburn DOT edu</FONT>
<BR><FONT SIZE=3D2>&gt; Subject: RE: [Veritas-bu] 2 tape drives =
issue</FONT>
<BR><FONT SIZE=3D2>&gt; </FONT>
<BR><FONT SIZE=3D2>&gt; </FONT>
<BR><FONT SIZE=3D2>&gt; Hi,</FONT>
<BR><FONT SIZE=3D2>&gt; </FONT>
<BR><FONT SIZE=3D2>&gt; LTO drive.</FONT>
<BR><FONT SIZE=3D2>&gt; </FONT>
<BR><FONT SIZE=3D2>&gt; regards,</FONT>
<BR><FONT SIZE=3D2>&gt; feroz</FONT>
<BR><FONT SIZE=3D2>&gt; </FONT>
<BR><FONT SIZE=3D2>&gt;&nbsp; --- &quot;Donaldson, Mark&quot;</FONT>
<BR><FONT SIZE=3D2>&gt; &lt;Mark.Donaldson AT experianems DOT com&gt; wrote: =
&gt; What kind</FONT>
<BR><FONT SIZE=3D2>&gt; of</FONT>
<BR><FONT SIZE=3D2>&gt; drive (DLT, LTO, etc.) in the L25?</FONT>
<BR><FONT SIZE=3D2>&gt; &gt; -M</FONT>
<BR><FONT SIZE=3D2>&gt; &gt; </FONT>
<BR><FONT SIZE=3D2>&gt; &gt; -----Original Message-----</FONT>
<BR><FONT SIZE=3D2>&gt; &gt; From: Feroz F. Basir [<A =
HREF=3D"mailto:dbase77 AT yahoo DOT com">mailto:dbase77 AT yahoo DOT 
com</A>]</FONT>
<BR><FONT SIZE=3D2>&gt; &gt; Sent: Thursday, March 13, 2003 4:15 =
AM</FONT>
<BR><FONT SIZE=3D2>&gt; &gt; To: =
veritas-bu AT mailman.eng.auburn DOT edu</FONT>
<BR><FONT SIZE=3D2>&gt; &gt; Subject: RE: [Veritas-bu] 2 tape drives =
issue</FONT>
<BR><FONT SIZE=3D2>&gt; &gt; </FONT>
<BR><FONT SIZE=3D2>&gt; &gt; </FONT>
<BR><FONT SIZE=3D2>&gt; &gt; Hi,</FONT>
<BR><FONT SIZE=3D2>&gt; &gt; </FONT>
<BR><FONT SIZE=3D2>&gt; &gt; Thank you to all who replied to my =
problem. I got</FONT>
<BR><FONT SIZE=3D2>&gt; it</FONT>
<BR><FONT SIZE=3D2>&gt; &gt; to work to use both tape drives at the =
same time</FONT>
<BR><FONT SIZE=3D2>&gt; &gt; using</FONT>
<BR><FONT SIZE=3D2>&gt; &gt; 2 different policies. </FONT>
<BR><FONT SIZE=3D2>&gt; &gt; </FONT>
<BR><FONT SIZE=3D2>&gt; &gt; Backup took about 5 hrs to finish for 74 =
GB data</FONT>
<BR><FONT SIZE=3D2>&gt; on</FONT>
<BR><FONT SIZE=3D2>&gt; &gt; 1</FONT>
<BR><FONT SIZE=3D2>&gt; &gt; tape. I wonder myself if I can improve the =
time</FONT>
<BR><FONT SIZE=3D2>&gt; &gt; here.</FONT>
<BR><FONT SIZE=3D2>&gt; &gt; I only backup oracle data files. Plus =
select to</FONT>
<BR><FONT SIZE=3D2>&gt; &gt; compress. Is this normal behaviour. I'm =
using NB</FONT>
<BR><FONT SIZE=3D2>&gt; 4.5</FONT>
<BR><FONT SIZE=3D2>&gt; &gt; business server on SUN storedge L25 tape =
library</FONT>
<BR><FONT SIZE=3D2>&gt; &gt; with</FONT>
<BR><FONT SIZE=3D2>&gt; &gt; 2 drives.</FONT>
<BR><FONT SIZE=3D2>&gt; &gt; </FONT>
<BR><FONT SIZE=3D2>&gt; &gt; Thank you again.</FONT>
<BR><FONT SIZE=3D2>&gt; &gt; </FONT>
<BR><FONT SIZE=3D2>&gt; &gt; regards,</FONT>
<BR><FONT SIZE=3D2>&gt; &gt; feroz</FONT>
<BR><FONT SIZE=3D2>&gt; &gt; </FONT>
<BR><FONT SIZE=3D2>&gt; &gt; =
__________________________________________________</FONT>
<BR><FONT SIZE=3D2>&gt; &gt; Do You Yahoo!?</FONT>
<BR><FONT SIZE=3D2>&gt; &gt; Everything you'll ever need on one web =
page</FONT>
<BR><FONT SIZE=3D2>&gt; &gt; from News and Sport to Email and Music =
Charts</FONT>
<BR><FONT SIZE=3D2>&gt; &gt; <A HREF=3D"http://uk.my.yahoo.com"; =
TARGET=3D"_blank">http://uk.my.yahoo.com</A></FONT>
<BR><FONT SIZE=3D2>&gt; &gt; =
_______________________________________________</FONT>
<BR><FONT SIZE=3D2>&gt; &gt; Veritas-bu maillist&nbsp; - </FONT>
<BR><FONT SIZE=3D2>&gt; &gt; Veritas-bu AT mailman.eng.auburn DOT edu</FONT>
<BR><FONT SIZE=3D2>&gt; &gt;</FONT>
<BR><FONT SIZE=3D2>&gt;</FONT>
<BR><FONT SIZE=3D2><A =
HREF=3D"http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu"; =
TARGET=3D"_blank">http://mailman.eng.auburn.edu/mailman/listinfo/veritas=
-bu</A></FONT>
<BR><FONT SIZE=3D2>&gt; &gt;&nbsp; </FONT>
<BR><FONT SIZE=3D2>&gt; </FONT>
<BR><FONT SIZE=3D2>&gt; =
__________________________________________________</FONT>
<BR><FONT SIZE=3D2>&gt; Do You Yahoo!?</FONT>
<BR><FONT SIZE=3D2>&gt; Everything you'll ever need on one web =
page</FONT>
<BR><FONT SIZE=3D2>&gt; from News and Sport to Email and Music =
Charts</FONT>
<BR><FONT SIZE=3D2>&gt; <A HREF=3D"http://uk.my.yahoo.com"; =
TARGET=3D"_blank">http://uk.my.yahoo.com</A></FONT>
<BR><FONT SIZE=3D2>&gt;&nbsp; </FONT>
</P>

<P><FONT =
SIZE=3D2>__________________________________________________</FONT>
<BR><FONT SIZE=3D2>Do You Yahoo!?</FONT>
<BR><FONT SIZE=3D2>Everything you'll ever need on one web page</FONT>
<BR><FONT SIZE=3D2>from News and Sport to Email and Music Charts</FONT>
<BR><FONT SIZE=3D2><A HREF=3D"http://uk.my.yahoo.com"; =
TARGET=3D"_blank">http://uk.my.yahoo.com</A></FONT>
</P>

</BODY>
</HTML>
------_=_NextPart_001_01C2E98A.E8D902D0--