Veritas-bu

[Veritas-bu] slow backups

2002-11-07 15:32:15
Subject: [Veritas-bu] slow backups
From: cfarmer AT veritas DOT com (Skip Farmer)
Date: Thu, 7 Nov 2002 15:32:15 -0500
This message is in MIME format. Since your mail reader does not understand
this format, some or all of this message may not be legible.

------_=_NextPart_001_01C2869C.1804D90A
Content-Type: text/plain;
        charset="iso-8859-1"

It is also possible that something is impacting the SAN performance.
Generally when it is that slow there is either a network or SAN issue that
is causing interruptions.
 
I would create a bptm log on the media server that is seeing the slow
performance and see if it gives any further info. You may see SAN interrupts
that are causing the job to pause and then recover from the error and
continue to try to right.
You may also want to see if you can isolate the problem to the Windows or
Tru64 systems by zoning the SAN and then trying the jobs.
 
Skip
-----Original Message-----
From: kawumin AT mtn.co DOT ug [mailto:kawumin AT mtn.co DOT ug]
Sent: Thursday, November 07, 2002 8:31 AM
To: kathy AT mitre DOT org; veritas-bu AT mailman.eng.auburn DOT edu
Subject: RE: [Veritas-bu] slow backups


Hi
Thank for your reply. However, a few things to note.
The tapes are supposed to backup at 11mb/s but instead, when we have all
drives backing up the speed drops to 500kb/s, which is very low. Please
advice.
Thanks, Nelson.
 
-----Original Message-----
From: Kathy Riddlemoser [mailto:kathy AT mitre DOT org] 
Sent: Thursday, November 07, 2002 4:10 PM
To: Nelson Kawumi; veritas-bu AT mailman.eng.auburn DOT edu
Subject: Re: [Veritas-bu] slow backups
 
This is what I understand from your note.  You have 1 Master server (Win2k)
and 5 Media servers (4 Win2k + 1 Unix) and according to your note they all
use the same SDLT unit which contains 12 drives and the SDLT is attached to
a SAN.  You're seeing 11mb/sec written to tape. 
I'm not sure why you are complaining.  I've got an LTO that I use to back up
1.4TB of data off a Compaq SAN utilizing only one LTO drive (the data is all
under one mount point) and it takes 68 hours which turns out to be about 17
GB an hour and 5 mb/sec.  I'd love to see 11 mb/sec. 
I currently have a ticket open with Veritas to assist me with trying to gain
better performance.  Here is my layout: 
1) Master / Media server = Ultra2 running Solaris 2.7w/1G mem and w/Qualstar
6460 4 DLT drives backing up unix, linux and windows clients.  No big deal
under this situation.  I'm very happy with speed and time (upgrading to Sun
220R, Solaris 2.7, 2G mem and 2 450 CPUs) 
2) Media server = Dell 1650, 2G mem, 2 450 CPU's (heck of a lot more than
the Master's got above)  with an Overland Neo series LTO (2 drives & 30
slots).  This is also a Netbackup Professional NBUP server.  It's storage is
2 TB on a Compaq SAN with direct fiber connection to this box and I'm only
writing 17 GB an hour.  However, it starts out at 40 Gig and then drops. 
Some of the things I'm doing...... 
1) updating drivers (if needed) on library and its drives 
2) updating firmware (if needed) on library and its drives 
3) I do have all the latest NBU v3.4.1 patches, but am double checking 
3) turn off anti-virus software that might run during backup 
4) turn off NBUPclient connections to the server over the weekend and see if
backup improves (NBUP clients backup to SAN and then I backup the data to
tape). 
5) identify any other services that may be running that can be stopped
during backup window. 
Now, if you can be more specific to what media server, what type of data
you're backing up that will help.  Are you backing up data straight from the
client to tape?  If so, what kind of network connection do you have.   Might
want to lock your network switch and server down to 100mb/full duplex.   You
may be transporting at 10 versus 100 and even at half duplex. 
Are you backing up a ton of very small files.  This in it self is a major
problem.  Alot of small files take longer to back up than large ones.  I
don't think I resolved things for you,but may be have given you some other
avenues to venture down. 
Regards, 
Kathy 
  
kawumin AT mtn.co DOT ug wrote: 
Hi
I have a windows 2000 advanced server master server, 4 windows 2000 advanced
server media servers and 2 tru64 UNIX media servers. I 'm using Veritas
Netbackup Datacenter v3.4.1 with patches; 
For Microsoft Windows (all version) the latest patch is -
NB_341_4.winnt.intel_250246.exe 
For TRU64 the latest patch is- NB_34_3.clients_246589.tar (this patch
provides fixes for both UNIX server and clients) 
The master and media servers are connected to the Compaq SL9326 library
with, 12 SDLT drives, through a Compaq SAN switch, 10Km single fiber link to
the Compaq Modular Data router (MDR) and scsi cables from the MDR. 
I have a problem the backups take so long when running, the speeds drop per
stream to 500kb/sec. which is very low. Yet the speed for a native backup
(which we use) for and SDLT tape drive is 11mb/sec. please help!! 
Thanks, Nelson.

------_=_NextPart_001_01C2869C.1804D90A
Content-Type: text/html;
        charset="iso-8859-1"
Content-Transfer-Encoding: quoted-printable

<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.0 Transitional//EN">
<HTML xmlns=3D"http://www.w3.org/TR/REC-html40"; xmlns:o =3D=20
"urn:schemas-microsoft-com:office:office" xmlns:w =3D=20
"urn:schemas-microsoft-com:office:word"><HEAD>
<META HTTP-EQUIV=3D"Content-Type" CONTENT=3D"text/html; =
charset=3Diso-8859-1">


<META content=3DWord.Document name=3DProgId>
<META content=3D"MSHTML 5.50.4919.2200" name=3DGENERATOR>
<META content=3D"Microsoft Word 10" name=3DOriginator><LINK=20
href=3D"cid:[email protected]" rel=3DFile-List><!--[if gte =
mso 9]><xml>
 <o:OfficeDocumentSettings>
  <o:DoNotRelyOnCSS/>
 </o:OfficeDocumentSettings>
</xml><![endif]--><!--[if gte mso 9]><xml>
 <w:WordDocument>
  <w:SpellingState>Clean</w:SpellingState>
  <w:GrammarState>Clean</w:GrammarState>
  <w:DocumentKind>DocumentEmail</w:DocumentKind>
  <w:EnvelopeVis/>
  <w:BrowserLevel>MicrosoftInternetExplorer4</w:BrowserLevel>
 </w:WordDocument>
</xml><![endif]-->
<STYLE>@font-face {
        font-family: Tahoma;
}
@page Section1 {size: 8.5in 11.0in; margin: 1.0in 1.25in 1.0in 1.25in; =
mso-header-margin: .5in; mso-footer-margin: .5in; mso-paper-source: 0; =
}
P.MsoNormal {
        FONT-SIZE: 12pt; MARGIN: 0in 0in 0pt; FONT-FAMILY: "Times New Roman"; =
mso-style-parent: ""; mso-pagination: widow-orphan; =
mso-fareast-font-family: "Times New Roman"
}
LI.MsoNormal {
        FONT-SIZE: 12pt; MARGIN: 0in 0in 0pt; FONT-FAMILY: "Times New Roman"; =
mso-style-parent: ""; mso-pagination: widow-orphan; =
mso-fareast-font-family: "Times New Roman"
}
DIV.MsoNormal {
        FONT-SIZE: 12pt; MARGIN: 0in 0in 0pt; FONT-FAMILY: "Times New Roman"; =
mso-style-parent: ""; mso-pagination: widow-orphan; =
mso-fareast-font-family: "Times New Roman"
}
A:link {
        COLOR: blue; TEXT-DECORATION: underline; text-underline: single
}
SPAN.MsoHyperlink {
        COLOR: blue; TEXT-DECORATION: underline; text-underline: single
}
A:visited {
        COLOR: purple; TEXT-DECORATION: underline; text-underline: single
}
SPAN.MsoHyperlinkFollowed {
        COLOR: purple; TEXT-DECORATION: underline; text-underline: single
}
P {
        FONT-SIZE: 12pt; MARGIN-LEFT: 0in; MARGIN-RIGHT: 0in; FONT-FAMILY: =
"Times New Roman"; mso-pagination: widow-orphan; =
mso-fareast-font-family: "Times New Roman"; mso-margin-top-alt: auto; =
mso-margin-bottom-alt: auto
}
SPAN.EmailStyle18 {
        COLOR: windowtext; FONT-FAMILY: Arial; mso-style-type: personal; =
mso-style-noshow: yes; mso-ansi-font-size: 10.0pt; mso-bidi-font-size: =
10.0pt; mso-ascii-font-family: Arial; mso-hansi-font-family: Arial; =
mso-bidi-font-family: Arial
}
SPAN.EmailStyle19 {
        COLOR: navy; FONT-FAMILY: Arial; mso-style-type: personal-reply; =
mso-style-noshow: yes; mso-ansi-font-size: 10.0pt; mso-bidi-font-size: =
10.0pt; mso-ascii-font-family: Arial; mso-hansi-font-family: Arial; =
mso-bidi-font-family: Arial
}
SPAN.SpellE {
        mso-style-name: ""; mso-spl-e: yes
}
SPAN.GramE {
        mso-style-name: ""; mso-gram-e: yes
}
DIV.Section1 {
        page: Section1
}
</STYLE>
<!--[if gte mso 10]>
<style>
 /* Style Definitions */=20
 table.MsoNormalTable
        {mso-style-name:"Table Normal";
        mso-tstyle-rowband-size:0;
        mso-tstyle-colband-size:0;
        mso-style-noshow:yes;
        mso-style-parent:"";
        mso-padding-alt:0in 5.4pt 0in 5.4pt;
        mso-para-margin:0in;
        mso-para-margin-bottom:.0001pt;
        mso-pagination:widow-orphan;
        font-size:10.0pt;
        font-family:"Times New Roman";}
</style>
<![endif]--></HEAD>
<BODY lang=3DEN-US style=3D"tab-interval: .5in" vLink=3Dpurple =
link=3Dblue>
<DIV><SPAN class=3D706123220-07112002><FONT face=3DArial =
color=3D#0000ff size=3D2>It is=20
also possible that something is impacting the SAN performance. =
Generally when it=20
is that slow there is either a network or SAN issue that is causing=20
interruptions.</FONT></SPAN></DIV>
<DIV><SPAN class=3D706123220-07112002><FONT face=3DArial =
color=3D#0000ff=20
size=3D2></FONT></SPAN>&nbsp;</DIV>
<DIV><SPAN class=3D706123220-07112002><FONT face=3DArial =
color=3D#0000ff size=3D2>I=20
would create a bptm log on the media server that is seeing the slow =
performance=20
and see if it gives any further info. You may see SAN interrupts that =
are=20
causing the job to pause and then recover from the error and continue =
to try to=20
right.</FONT></SPAN></DIV>
<DIV><SPAN class=3D706123220-07112002><FONT face=3DArial =
color=3D#0000ff size=3D2>You=20
may also want to see if you can isolate the problem to the Windows or =
Tru64=20
systems by zoning the SAN and then trying the jobs.</FONT></SPAN></DIV>
<DIV><SPAN class=3D706123220-07112002><FONT face=3DArial =
color=3D#0000ff=20
size=3D2></FONT></SPAN>&nbsp;</DIV>
<DIV><SPAN class=3D706123220-07112002><FONT face=3DArial =
color=3D#0000ff=20
size=3D2>Skip</FONT></SPAN></DIV>
<BLOCKQUOTE dir=3Dltr style=3D"MARGIN-RIGHT: 0px">
  <DIV class=3DOutlookMessageHeader dir=3Dltr align=3Dleft><FONT =
face=3DTahoma=20
  size=3D2>-----Original Message-----<BR><B>From:</B> kawumin AT mtn.co DOT ug =

  [mailto:kawumin AT mtn.co DOT ug]<BR><B>Sent:</B> Thursday, November 07, =
2002 8:31=20
  AM<BR><B>To:</B> kathy AT mitre DOT org;=20
  veritas-bu AT mailman.eng.auburn DOT edu<BR><B>Subject:</B> RE: [Veritas-bu] =
slow=20
  backups<BR><BR></FONT></DIV>
  <DIV class=3DSection1>
  <P class=3DMsoNormal><FONT face=3DArial color=3Dnavy size=3D2><SPAN=20
  style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: =
Arial">Hi<o:p></o:p></SPAN></FONT></P>
  <P class=3DMsoNormal><FONT face=3DArial color=3Dnavy size=3D2><SPAN=20
  style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: Arial">Thank for =
your reply.=20
  However, a few things to note.<o:p></o:p></SPAN></FONT></P>
  <P class=3DMsoNormal><FONT face=3DArial color=3Dnavy size=3D2><SPAN=20
  style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: Arial">The tapes =
are=20
  supposed to backup at 11mb/s but instead, when we have all drives =
backing up=20
  the speed drops to 500kb/s, which is very low. Please=20
  advice.<o:p></o:p></SPAN></FONT></P>
  <P class=3DMsoNormal><FONT face=3DArial color=3Dnavy size=3D2><SPAN=20
  style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: Arial">Thanks,=20
  Nelson.<o:p></o:p></SPAN></FONT></P>
  <P class=3DMsoNormal><FONT face=3DArial color=3Dnavy size=3D2><SPAN=20
  style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: =
Arial"><o:p>&nbsp;</o:p></SPAN></FONT></P>
  <P class=3DMsoNormal style=3D"MARGIN-LEFT: 0.5in"><FONT face=3DTahoma =
size=3D2><SPAN=20
  style=3D"FONT-SIZE: 10pt; FONT-FAMILY: Tahoma">-----Original=20
  Message-----<BR><B><SPAN style=3D"FONT-WEIGHT: bold">From:</SPAN></B> =
Kathy=20
  Riddlemoser [mailto:kathy AT mitre DOT org] <BR><B><SPAN=20
  style=3D"FONT-WEIGHT: bold">Sent:</SPAN></B> Thursday, November 07, =
2002 4:10=20
  PM<BR><B><SPAN style=3D"FONT-WEIGHT: bold">To:</SPAN></B> Nelson =
Kawumi;=20
  veritas-bu AT mailman.eng.auburn DOT edu<BR><B><SPAN=20
  style=3D"FONT-WEIGHT: bold">Subject:</SPAN></B> Re: [Veritas-bu] slow =

  backups</SPAN></FONT></P>
  <P class=3DMsoNormal style=3D"MARGIN-LEFT: 0.5in"><FONT face=3D"Times =
New Roman"=20
  size=3D3><SPAN style=3D"FONT-SIZE: =
12pt"><o:p>&nbsp;</o:p></SPAN></FONT></P>
  <P class=3DMsoNormal style=3D"MARGIN-LEFT: 0.5in"><FONT face=3D"Times =
New Roman"=20
  size=3D3><SPAN style=3D"FONT-SIZE: 12pt">This is what I understand =
from your=20
  note.&nbsp; You have 1 Master server (Win2k) and 5 Media servers (4 =
Win2k + 1=20
  Unix) and according to your note they all use the same SDLT unit =
which=20
  contains 12 drives and the SDLT is attached to a SAN.&nbsp; You're =
seeing=20
  11mb/sec written to tape. <o:p></o:p></SPAN></FONT></P>
  <P style=3D"MARGIN-LEFT: 0.5in"><FONT face=3D"Times New Roman" =
size=3D3><SPAN=20
  style=3D"FONT-SIZE: 12pt">I'm not sure why you are complaining.&nbsp; =
I've got=20
  an LTO that I use to back up 1.4TB of data off a Compaq SAN utilizing =
only one=20
  LTO drive (the data is all under one mount point) and it takes 68 =
hours which=20
  turns out to be about 17 GB an hour and 5 mb/sec.&nbsp; I'd love to =
see 11=20
  mb/sec. <o:p></o:p></SPAN></FONT></P>
  <P style=3D"MARGIN-LEFT: 0.5in"><FONT face=3D"Times New Roman" =
size=3D3><SPAN=20
  style=3D"FONT-SIZE: 12pt">I currently have a ticket open with Veritas =
to assist=20
  me with trying to gain better performance.&nbsp; Here is my layout: =
<BR>1)=20
  Master / Media server =3D Ultra2 running Solaris 2.7w/1G mem and =
w/Qualstar 6460=20
  4 DLT drives backing up unix, linux and windows clients.&nbsp; No big =
deal=20
  under this situation.&nbsp; I'm very happy with speed and time =
(upgrading to=20
  Sun 220R, Solaris 2.7, 2G mem and 2 450 CPUs) <BR>2) Media server =3D =
Dell 1650,=20
  2G mem, 2 450 CPU's (heck of a lot more than the Master's got =
above)&nbsp;=20
  with an Overland Neo series LTO (2 drives &amp; 30 slots).&nbsp; This =
is also=20
  a Netbackup Professional NBUP server.&nbsp; It's storage is 2 TB on a =
Compaq=20
  SAN with direct fiber connection to this box and I'm only writing 17 =
GB an=20
  hour.&nbsp; However, it starts out at 40 Gig and then drops.=20
  <o:p></o:p></SPAN></FONT></P>
  <P style=3D"MARGIN-LEFT: 0.5in"><FONT face=3D"Times New Roman" =
size=3D3><SPAN=20
  style=3D"FONT-SIZE: 12pt">Some of the things I'm doing...... <BR>1) =
updating=20
  drivers (if needed) on library and its drives <BR>2) updating =
firmware (if=20
  needed) on library and its drives <BR>3) I do have all the latest NBU =
v3.4.1=20
  patches, but am double checking <BR>3) turn off anti-virus software =
that might=20
  run during backup <BR>4) turn off NBUPclient connections to the =
server over=20
  the weekend and see if backup improves (NBUP clients backup to SAN =
and then I=20
  backup the data to tape). <BR>5) identify any other services that may =
be=20
  running that can be stopped during backup window.=20
<o:p></o:p></SPAN></FONT></P>
  <P style=3D"MARGIN-LEFT: 0.5in"><FONT face=3D"Times New Roman" =
size=3D3><SPAN=20
  style=3D"FONT-SIZE: 12pt">Now, if you can be more specific to what =
media server,=20
  what type of data you're backing up that will help.&nbsp; Are you =
backing up=20
  data straight from the client to tape?&nbsp; If so, what kind of =
network=20
  connection do you have.&nbsp;&nbsp; Might want to lock your network =
switch and=20
  server down to 100mb/full duplex.&nbsp;&nbsp; You may be transporting =
at 10=20
  versus 100 and even at half duplex. <o:p></o:p></SPAN></FONT></P>
  <P style=3D"MARGIN-LEFT: 0.5in"><FONT face=3D"Times New Roman" =
size=3D3><SPAN=20
  style=3D"FONT-SIZE: 12pt">Are you backing up a ton of very small =
files.&nbsp;=20
  This in it self is a major problem.&nbsp; Alot of small files take =
longer to=20
  back up than large ones.&nbsp; I don't think I resolved things for =
you,but may=20
  be have given you some other avenues to venture down.=20
  <o:p></o:p></SPAN></FONT></P>
  <P style=3D"MARGIN-LEFT: 0.5in"><FONT face=3D"Times New Roman" =
size=3D3><SPAN=20
  style=3D"FONT-SIZE: 12pt">Regards, <BR>Kathy <BR>&nbsp;=20
  <o:p></o:p></SPAN></FONT></P>
  <P style=3D"MARGIN-LEFT: 0.5in"><FONT face=3D"Times New Roman" =
size=3D3><SPAN=20
  style=3D"FONT-SIZE: 12pt">kawumin AT mtn.co DOT ug wrote: =
<o:p></o:p></SPAN></FONT></P>
  <BLOCKQUOTE style=3D"MARGIN-TOP: 5pt; MARGIN-BOTTOM: 5pt" =
TYPE=3D"CITE"><!--[if gte mso 9]><xml>
 <u1:OfficeDocumentSettings>
  <u1:DoNotRelyOnCSS/>
 </u1:OfficeDocumentSettings>
</xml><![endif]--><!--[if gte mso 9]><xml>
 <u2:WordDocument>
  <u2:SpellingState>Clean</u2:SpellingState>
  <u2:GrammarState>Clean</u2:GrammarState>
  <u2:DocumentKind>DocumentEmail</u2:DocumentKind>
  <u2:EnvelopeVis/>
  <u2:Compatibility>
   <u2:BreakWrappedTables/>
   <u2:SnapToGridInCell/>
   <u2:WrapTextWithPunct/>
   <u2:UseAsianBreakRules/>
  </u2:Compatibility>
  <u2:BrowserLevel>MicrosoftInternetExplorer4</u2:BrowserLevel>
 </u2:WordDocument>
</xml><![endif]-->
    <DIV>
    <P class=3DMsoNormal style=3D"MARGIN-LEFT: 0.5in"><FONT =
face=3D"Times New Roman"=20
    size=3D3><SPAN=20
    style=3D"FONT-SIZE: =
12pt">Hi<U3:P></U3:P><o:p></o:p></SPAN></FONT></P></DIV>
    <P class=3DMsoNormal style=3D"MARGIN-LEFT: 0.5in"><FONT =
face=3D"Times New Roman"=20
    size=3D3><SPAN style=3D"FONT-SIZE: 12pt">I have a windows 2000 =
advanced server=20
    master server, 4 windows 2000 advanced server media servers and 2 =
tru64 UNIX=20
    media servers. I 'm using Veritas Netbackup Datacenter v3.4.1 with=20
    patches;<U3:P></U3:P> <o:p></o:p></SPAN></FONT></P>
    <P class=3DMsoNormal=20
    style=3D"MARGIN-LEFT: 0.5in; mso-layout-grid-align: none"><FONT=20
    face=3D"Courier New" size=3D2><SPAN=20
    style=3D"FONT-SIZE: 10pt; FONT-FAMILY: 'Courier New'">For Microsoft =
Windows=20
    (all version) the latest patch is -=20
    NB_341_4.winnt.intel_250246.exe<U3:P></U3:P></SPAN></FONT> =
<o:p></o:p></P>
    <P class=3DMsoNormal style=3D"MARGIN-LEFT: 0.5in"><FONT =
face=3D"Courier New"=20
    size=3D2><SPAN=20
    style=3D"FONT-SIZE: 10pt; FONT-FAMILY: 'Courier =
New'"><U3:P></U3:P>For TRU64=20
    the latest patch&nbsp;is- NB_34_3.clients_246589.tar (this patch =
provides=20
    fixes for both UNIX server and clients)<U3:P></U3:P></SPAN></FONT>=20
    <o:p></o:p></P>
    <P class=3DMsoNormal style=3D"MARGIN-LEFT: 0.5in"><FONT =
face=3D"Courier New"=20
    size=3D2><SPAN style=3D"FONT-SIZE: 10pt; FONT-FAMILY: 'Courier =
New'">The master=20
    and media servers are connected to the Compaq SL9326 library with, =
12 SDLT=20
    drives, through a Compaq SAN switch, 10Km single fiber link to the =
Compaq=20
    Modular Data router (MDR) and&nbsp;scsi cables from the=20
    MDR.<U3:P></U3:P></SPAN></FONT> <o:p></o:p></P>
    <P class=3DMsoNormal style=3D"MARGIN-LEFT: 0.5in"><FONT =
face=3D"Courier New"=20
    size=3D2><SPAN style=3D"FONT-SIZE: 10pt; FONT-FAMILY: 'Courier =
New'">I have a=20
    problem the backups take so long when running, the speeds drop per =
stream to=20
    500kb/sec. which is very low. Yet the speed for a native backup =
(which we=20
    use) for and SDLT tape drive is 11mb/sec. please=20
    help!!<U3:P></U3:P></SPAN></FONT> <o:p></o:p></P>
    <P class=3DMsoNormal style=3D"MARGIN-LEFT: 0.5in"><FONT =
face=3D"Courier New"=20
    size=3D2><SPAN style=3D"FONT-SIZE: 10pt; FONT-FAMILY: 'Courier =
New'">Thanks,=20
    =
Nelson.</SPAN></FONT><U3:P></U3:P><o:p></o:p></P></BLOCKQUOTE></DIV></BL=
OCKQUOTE></BODY></HTML>

------_=_NextPart_001_01C2869C.1804D90A--

<Prev in Thread] Current Thread [Next in Thread>