Veritas-bu

[Veritas-bu] Inline tape copy slow

2006-01-03 08:15:16
Subject: [Veritas-bu] Inline tape copy slow
From: pkeating AT bank-banque-canada DOT ca (Paul Keating)
Date: Tue, 3 Jan 2006 08:15:16 -0500
This is a multi-part message in MIME format.

------_=_NextPart_001_01C61067.BCCD459E
Content-Type: text/plain;
        charset="us-ascii"
Content-Transfer-Encoding: quoted-printable

=20

        -----Original Message-----
        From: Fernandes, Eustace [mailto:EFernandes AT talisman-energy DOT com]

        Sent: December 30, 2005 3:49 PM
        To: Paul Keating; veritas-bu AT mailman.eng.auburn DOT edu
        Subject: RE: [Veritas-bu] Inline tape copy slow
=09
=09
        thanks for your reply.
        30mb/sec that is double the speed I get for a normal backup to a
single tape
        what version of Netbackup are you running?
        what speed are you getting for a normal backup, non-ITC? is it
approx 30mb/sec?
        =20
=09
        I'm running NBU 5.4 MP4
        Solaris 8 on a Sunfire V880 w/4 CPU and 8Gig RAM
        dual FC HBAs and dual copper Gig E, but that should make no
difference.
        I just have the drives zoned half to each HBA, and the NICs are
not trunked, so there's max 1Gig theorhetical throughput to any one job.
        =20
        I'm not sure what the throughput of the SDLT320 is, but 30MB/s
is the native write speed for the LTO2 drives....I can push the same
speed regardless of ITC or single tape.
        =20
        Did you tweak buffers or anything in /etc/system, etc.. to get
this to work?=20
        =20
        added the following in /etc/system:
        set shmsys:shminfo_shmmax=3D335554432
        set shmsys:shminfo_shmmin=3D1
        set shmsys:shminfo_shmmni=3D100
        set shmsys:shminfo_shmseg=3D10
        set semsys:seminfo_semmnu=3D600
        set semsys:seminfo_semmns=3D300
        =20
        My settings:
        NET_BUFFER_SZ  =3D 26214     ->  65563
        NUMBER_DATA_BUFFERS =3D 32  -> 16=20
        SIZE_DATA_BUFFERS =3D 65536      -> 262144
        =20
        don't know if these are related but I'll mention them just in
case ./db/config   shm and ENABLE_SCSI_RESERVE=20
        =20
        Shouldn't matter..................=20
        =20
        I am consistently getting 8 mb/sec on ITC independent of what
pair of drives are used, but 16mb/sec for duplication and normal
backup(single tape)
        Any ideas? .. could it be the LTO drives Vs SDLT320?=20
        =20
        If you can write 16MB/s to one drive, I don't know why you
couldn't write the same to 2 drives simultaneously, unless your media
server is underpowered, or you've got wierd SAN issues.
        Nothing comes to mind.....in testing I did, way back, I had to
write to something like 4 or drives simultaneously before I saw any real
performance degradation.
        =20
        Paul


------_=_NextPart_001_01C61067.BCCD459E
Content-Type: text/html;
        charset="us-ascii"
Content-Transfer-Encoding: quoted-printable

<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.0 Transitional//EN">
<HTML><HEAD><TITLE>Message</TITLE>
<META http-equiv=3DContent-Type content=3D"text/html; =
charset=3Dus-ascii">
<META content=3D"MSHTML 6.00.2800.1170" name=3DGENERATOR></HEAD>
<BODY>
<DIV><SPAN class=3D760160413-03012006></SPAN><SPAN =
class=3D760160413-03012006><FONT=20
face=3DArial color=3D#800000 size=3D2></FONT></SPAN>&nbsp;</DIV>
<BLOCKQUOTE dir=3Dltr=20
style=3D"PADDING-LEFT: 5px; MARGIN-LEFT: 5px; BORDER-LEFT: #800000 2px =
solid; MARGIN-RIGHT: 0px">
  <DIV></DIV>
  <DIV class=3DOutlookMessageHeader lang=3Den-us dir=3Dltr =
align=3Dleft><FONT=20
  face=3DTahoma size=3D2>-----Original Message-----<BR><B>From:</B> =
Fernandes,=20
  Eustace [mailto:EFernandes AT talisman-energy DOT com] <BR><B>Sent:</B> =
December 30,=20
  2005 3:49 PM<BR><B>To:</B> Paul Keating;=20
  veritas-bu AT mailman.eng.auburn DOT edu<BR><B>Subject:</B> RE: [Veritas-bu] =
Inline=20
  tape copy slow<BR><BR></FONT></DIV>
  <DIV dir=3Dltr align=3Dleft><SPAN class=3D476431520-30122005><FONT =
face=3DArial=20
  color=3D#0000ff size=3D2>thanks for your reply.</FONT></SPAN></DIV>
  <DIV dir=3Dltr align=3Dleft><SPAN class=3D476431520-30122005><FONT =
face=3DArial=20
  color=3D#0000ff size=3D2>30mb/sec that is double the speed I get for a =
normal=20
  backup to a single tape</FONT></SPAN></DIV>
  <DIV dir=3Dltr align=3Dleft><SPAN class=3D476431520-30122005><FONT =
face=3DArial=20
  color=3D#0000ff size=3D2>what version of Netbackup are you=20
  running?</FONT></SPAN></DIV>
  <DIV dir=3Dltr align=3Dleft><SPAN class=3D476431520-30122005><FONT =
face=3DArial=20
  color=3D#0000ff size=3D2>what speed are you getting for a normal =
backup, non-ITC?=20
  is it approx 30mb/sec?</FONT></SPAN></DIV>
  <DIV dir=3Dltr align=3Dleft><SPAN class=3D476431520-30122005><FONT =
face=3DArial=20
  color=3D#0000ff size=3D2></FONT></SPAN><SPAN =
class=3D476431520-30122005><FONT=20
  face=3DArial color=3D#0000ff size=3D2></FONT></SPAN>&nbsp;</DIV>
  <DIV dir=3Dltr align=3Dleft><SPAN class=3D476431520-30122005><FONT =
face=3DArial=20
  color=3D#0000ff size=3D2>
  <DIV><SPAN class=3D760160413-03012006><FONT face=3DArial =
color=3D#800000 size=3D2>I'm=20
  running NBU 5.4 MP4</FONT></SPAN></DIV>
  <DIV><SPAN class=3D760160413-03012006><FONT face=3DArial =
color=3D#800000=20
  size=3D2>Solaris 8 on a Sunfire V880 w/4 CPU and 8Gig =
RAM</FONT></SPAN></DIV>
  <DIV><SPAN class=3D760160413-03012006><FONT face=3DArial =
color=3D#800000 size=3D2>dual=20
  FC HBAs and dual copper Gig E, but that should make no=20
  difference.</FONT></SPAN></DIV>
  <DIV><SPAN class=3D760160413-03012006><FONT face=3DArial =
color=3D#800000 size=3D2>I=20
  just have the drives zoned half to each HBA, and the NICs are not =
trunked, so=20
  there's max 1Gig theorhetical&nbsp;throughput to any one=20
  job.</FONT></SPAN></DIV>
  <DIV><SPAN class=3D760160413-03012006><FONT face=3DArial =
color=3D#800000=20
  size=3D2></FONT></SPAN>&nbsp;</DIV>
  <DIV><SPAN class=3D760160413-03012006><FONT face=3DArial =
color=3D#800000 size=3D2>I'm=20
  not sure what the throughput of the SDLT320 is, but 30MB/s is the =
native write=20
  speed for the LTO2 drives....I can push the same speed regardless of =
ITC or=20
  single tape.</FONT></SPAN></DIV></FONT></SPAN></DIV>
  <DIV dir=3Dltr align=3Dleft><SPAN class=3D476431520-30122005><FONT =
face=3DArial=20
  color=3D#0000ff size=3D2></FONT></SPAN>&nbsp;</DIV>
  <DIV dir=3Dltr align=3Dleft><SPAN class=3D476431520-30122005><FONT=20
  color=3D#0000ff><FONT face=3DArial><FONT size=3D2>Did you =
tweak&nbsp;buffers or=20
  anything in /etc/system, etc.. to get this to work?<SPAN=20
  class=3D760160413-03012006><FONT=20
  color=3D#800000>&nbsp;</FONT></SPAN></FONT></FONT></FONT></SPAN></DIV>
  <DIV dir=3Dltr align=3Dleft><SPAN =
class=3D476431520-30122005><FONT><FONT=20
  face=3DArial><FONT size=3D2><SPAN=20
  =
class=3D760160413-03012006></SPAN></FONT></FONT></FONT></SPAN>&nbsp;</DIV=
>
  <DIV dir=3Dltr align=3Dleft><SPAN =
class=3D476431520-30122005><FONT><FONT=20
  face=3DArial><FONT color=3D#800000 size=3D2><SPAN =
class=3D760160413-03012006>added the=20
  following in /etc/system:</SPAN></FONT></FONT></FONT></SPAN></DIV>
  <DIV dir=3Dltr align=3Dleft><SPAN class=3D476431520-30122005><FONT=20
  color=3D#0000ff><FONT face=3DArial><FONT size=3D2><SPAN=20
  class=3D760160413-03012006><FONT color=3D#800000>set=20
  shmsys:shminfo_shmmax=3D335554432<BR>set =
shmsys:shminfo_shmmin=3D1<BR>set=20
  shmsys:shminfo_shmmni=3D100<BR>set shmsys:shminfo_shmseg=3D10<BR>set=20
  semsys:seminfo_semmnu=3D600<BR>set=20
  =
semsys:seminfo_semmns=3D300</FONT><BR></SPAN></FONT></FONT></FONT></SPAN>=
<SPAN=20
  class=3D476431520-30122005><FONT color=3D#0000ff><FONT =
face=3DArial><FONT=20
  size=3D2><SPAN=20
  =
class=3D760160413-03012006>&nbsp;</SPAN></FONT></FONT></FONT></SPAN></DIV=
>
  <DIV dir=3Dltr align=3Dleft><SPAN class=3D476431520-30122005><FONT=20
  color=3D#0000ff><FONT face=3DArial><FONT color=3D#800000 =
size=3D2><SPAN=20
  class=3D760160413-03012006>My =
settings:</SPAN></FONT></FONT></FONT></SPAN></DIV>
  <DIV dir=3Dltr align=3Dleft><SPAN class=3D476431520-30122005><FONT=20
  color=3D#0000ff><FONT face=3DArial><FONT size=3D2>NET_BUFFER_SZ&nbsp; =
=3D 26214<SPAN=20
  class=3D760160413-03012006><FONT=20
  color=3D#800000>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;-&gt;=20
  &nbsp;65563</FONT></SPAN></FONT></FONT></FONT></SPAN></DIV>
  <DIV dir=3Dltr align=3Dleft><SPAN class=3D476431520-30122005><FONT=20
  color=3D#0000ff><FONT face=3DArial><FONT size=3D2>NUMBER_DATA_BUFFERS =
=3D 32<SPAN=20
  class=3D760160413-03012006><FONT color=3D#800000>&nbsp; -&gt;=20
  16&nbsp;</FONT></SPAN></FONT></FONT></FONT></SPAN></DIV>
  <DIV dir=3Dltr align=3Dleft><SPAN class=3D476431520-30122005><FONT=20
  color=3D#0000ff><FONT face=3DArial><FONT size=3D2>SIZE_DATA_BUFFERS =
=3D 65536<SPAN=20
  class=3D760160413-03012006><FONT=20
  color=3D#800000>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;-&gt;=20
  262144</FONT></SPAN></FONT></FONT></FONT></SPAN></DIV>
  <DIV dir=3Dltr align=3Dleft><SPAN class=3D476431520-30122005><FONT=20
  color=3D#0000ff><FONT face=3DArial><FONT color=3D#800000 =
size=3D2><SPAN=20
  =
class=3D760160413-03012006></SPAN></FONT></FONT></FONT></SPAN>&nbsp;</DIV=
>
  <DIV dir=3Dltr align=3Dleft><SPAN class=3D476431520-30122005><FONT=20
  color=3D#0000ff><FONT face=3DArial><FONT size=3D2>don't know if these =
are related=20
  but I'll mention them just in case ./db/config&nbsp;&nbsp; shm and=20
  ENABLE_SCSI_RESERVE<SPAN class=3D760160413-03012006><FONT=20
  color=3D#800000>&nbsp;</FONT></SPAN></FONT></FONT></FONT></SPAN></DIV>
  <DIV dir=3Dltr align=3Dleft><SPAN class=3D476431520-30122005><FONT=20
  color=3D#0000ff><FONT face=3DArial><FONT size=3D2><SPAN=20
  =
class=3D760160413-03012006></SPAN></FONT></FONT></FONT></SPAN>&nbsp;</DIV=
>
  <DIV dir=3Dltr align=3Dleft><SPAN class=3D476431520-30122005><FONT=20
  color=3D#0000ff><FONT face=3DArial><FONT size=3D2><SPAN=20
  class=3D760160413-03012006><FONT color=3D#800000>Shouldn't=20
  =
matter..................</FONT>&nbsp;</SPAN></FONT></FONT></FONT></SPAN><=
/DIV>
  <DIV dir=3Dltr align=3Dleft><SPAN class=3D476431520-30122005><FONT =
face=3DArial=20
  color=3D#0000ff size=3D2></FONT></SPAN>&nbsp;</DIV>
  <DIV dir=3Dltr align=3Dleft><SPAN class=3D476431520-30122005><FONT =
face=3DArial=20
  color=3D#0000ff size=3D2>I am consistently getting 8 mb/sec on ITC =
independent of=20
  what pair of drives are used, but 16mb/sec for duplication and normal=20
  backup(single tape)</FONT></SPAN></DIV>
  <DIV dir=3Dltr align=3Dleft><SPAN class=3D476431520-30122005><FONT=20
  color=3D#0000ff><FONT face=3DArial><FONT size=3D2>Any ideas? .. could =
it be the LTO=20
  drives Vs SDLT320?<SPAN class=3D760160413-03012006><FONT=20
  color=3D#800000>&nbsp;</FONT></SPAN></FONT></FONT></FONT></SPAN></DIV>
  <DIV dir=3Dltr align=3Dleft><SPAN =
class=3D476431520-30122005><FONT><FONT=20
  face=3DArial><FONT size=3D2><SPAN=20
  =
class=3D760160413-03012006></SPAN></FONT></FONT></FONT></SPAN>&nbsp;</DIV=
>
  <DIV dir=3Dltr align=3Dleft><SPAN =
class=3D476431520-30122005><FONT><FONT=20
  face=3DArial><FONT color=3D#800000 size=3D2><SPAN =
class=3D760160413-03012006>If you=20
  can write 16MB/s to one drive, I don't know why you couldn't write the =
same to=20
  2 drives simultaneously, unless your media server is underpowered, or =
you've=20
  got wierd SAN issues.</SPAN></FONT></FONT></FONT></SPAN></DIV>
  <DIV dir=3Dltr align=3Dleft><SPAN =
class=3D476431520-30122005><FONT><FONT=20
  face=3DArial><FONT color=3D#800000 size=3D2><SPAN =
class=3D760160413-03012006>Nothing=20
  comes to mind.....in testing I did, way back, I had to write to =
something like=20
  4 or drives simultaneously before I saw any real performance=20
  degradation.</SPAN></FONT></FONT></FONT></SPAN></DIV>
  <DIV dir=3Dltr align=3Dleft><SPAN =
class=3D476431520-30122005><FONT><FONT=20
  face=3DArial><FONT color=3D#800000 size=3D2><SPAN=20
  =
class=3D760160413-03012006></SPAN></FONT></FONT></FONT></SPAN>&nbsp;</DIV=
>
  <DIV dir=3Dltr align=3Dleft><SPAN =
class=3D476431520-30122005><FONT><FONT=20
  face=3DArial><FONT color=3D#800000 size=3D2><SPAN=20
  =
class=3D760160413-03012006>Paul</SPAN></FONT></FONT></FONT></SPAN></DIV><=
/BLOCKQUOTE></BODY></HTML>
=00
------_=_NextPart_001_01C61067.BCCD459E--

<Prev in Thread] Current Thread [Next in Thread>
  • [Veritas-bu] Inline tape copy slow, Paul Keating <=