Veritas-bu

[Veritas-bu] slow backups

2002-11-07 09:15:14
Subject: [Veritas-bu] slow backups
From: bbriscoe AT visteon DOT com (Briscoe, Brian (B.))
Date: Thu, 7 Nov 2002 09:15:14 -0500
This message is in MIME format. Since your mail reader does not understand
this format, some or all of this message may not be legible.

------_=_NextPart_001_01C28668.177183D2
Content-Type: text/plain;
        charset="iso-8859-1"

We run Netshield on our NT 4 Servers (NB3.4.1 clients), and were told by a
German colleague that he was advised by Veritas to disable the Netshield
service while the backups were running (dont know why though). 
 
So we've got bpstart_notify and bpend notify scripts stopping and starting
the service.
 
Unfortunately I havent got any info on what happened to the throughput, this
was implemented quite a while ago.
 
Regards,

Brian Briscoe
European OA Support
Visteon Technical Centre, 28/803,
Dunton, England,
Tel  (8738)6214 Ext 01268 406214
Fax (8738)4367 Ext 01268 404367
Email: bbriscoe AT visteon DOT com

 -----Original Message-----
From: Quarantine [mailto:Quarantine AT GSCCCA DOT ORG]
Sent: 07 November 2002 13:23
To: 'kathy AT mitre DOT org'; kawumin AT mtn.co DOT ug; veritas-bu AT 
mailman.eng.auburn DOT edu
Subject: RE: [Veritas-bu] slow backups



Good suggestions.  For clarification, though, the requester is seeing speeds
drop to 500 kb/sec and saying the native speed is 11 mb/s.
 
With respect to suggestion 3, does anybody worry about turning off virus
protection during backups?  Among other things, I have about 50 million
files with an average size of 50K on various RAID 5 LUNs.  I see respectable
backup times, but would like to speed them up.  I've considered stopping
virus protection, but I just can't bring myself to do it.  Comments?
 
Thanks,
Matt
 
-----Original Message-----
From: Kathy Riddlemoser [mailto:kathy AT mitre DOT org] 
Sent: Thursday, November 07, 2002 8:10 AM
To: kawumin AT mtn.co DOT ug; veritas-bu AT mailman.eng.auburn DOT edu
Subject: Re: [Veritas-bu] slow backups


This is what I understand from your note.  You have 1 Master server (Win2k)
and 5 Media servers (4 Win2k + 1 Unix) and according to your note they all
use the same SDLT unit which contains 12 drives and the SDLT is attached to
a SAN.  You're seeing 11mb/sec written to tape. 

I'm not sure why you are complaining.  I've got an LTO that I use to back up
1.4TB of data off a Compaq SAN utilizing only one LTO drive (the data is all
under one mount point) and it takes 68 hours which turns out to be about 17
GB an hour and 5 mb/sec.  I'd love to see 11 mb/sec. 


I currently have a ticket open with Veritas to assist me with trying to gain
better performance.  Here is my layout: 
1) Master / Media server = Ultra2 running Solaris 2.7w/1G mem and w/Qualstar
6460 4 DLT drives backing up unix, linux and windows clients.  No big deal
under this situation.  I'm very happy with speed and time (upgrading to Sun
220R, Solaris 2.7, 2G mem and 2 450 CPUs) 
2) Media server = Dell 1650, 2G mem, 2 450 CPU's (heck of a lot more than
the Master's got above)  with an Overland Neo series LTO (2 drives & 30
slots).  This is also a Netbackup Professional NBUP server.  It's storage is
2 TB on a Compaq SAN with direct fiber connection to this box and I'm only
writing 17 GB an hour.  However, it starts out at 40 Gig and then drops. 


Some of the things I'm doing...... 
1) updating drivers (if needed) on library and its drives 
2) updating firmware (if needed) on library and its drives 
3) I do have all the latest NBU v3.4.1 patches, but am double checking 
3) turn off anti-virus software that might run during backup 
4) turn off NBUPclient connections to the server over the weekend and see if
backup improves (NBUP clients backup to SAN and then I backup the data to
tape). 
5) identify any other services that may be running that can be stopped
during backup window. 


Now, if you can be more specific to what media server, what type of data
you're backing up that will help.  Are you backing up data straight from the
client to tape?  If so, what kind of network connection do you have.   Might
want to lock your network switch and server down to 100mb/full duplex.   You
may be transporting at 10 versus 100 and even at half duplex. 


Are you backing up a ton of very small files.  This in it self is a major
problem.  Alot of small files take longer to back up than large ones.  I
don't think I resolved things for you,but may be have given you some other
avenues to venture down. 


Regards, 
Kathy 
  


kawumin AT mtn.co DOT ug wrote: 


Hi

I have a windows 2000 advanced server master server, 4 windows 2000 advanced
server media servers and 2 tru64 UNIX media servers. I 'm using Veritas
Netbackup Datacenter v3.4.1 with patches; 


For Microsoft Windows (all version) the latest patch is -
NB_341_4.winnt.intel_250246.exe 



For TRU64 the latest patch is- NB_34_3.clients_246589.tar (this patch
provides fixes for both UNIX server and clients) 


The master and media servers are connected to the Compaq SL9326 library
with, 12 SDLT drives, through a Compaq SAN switch, 10Km single fiber link to
the Compaq Modular Data router (MDR) and scsi cables from the MDR. 


I have a problem the backups take so long when running, the speeds drop per
stream to 500kb/sec. which is very low. Yet the speed for a native backup
(which we use) for and SDLT tape drive is 11mb/sec. please help!! 


Thanks, Nelson.


------_=_NextPart_001_01C28668.177183D2
Content-Type: text/html;
        charset="iso-8859-1"

<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.0 Transitional//EN">
<HTML><HEAD>
<META HTTP-EQUIV="Content-Type" CONTENT="text/html; charset=iso-8859-1">
<TITLE>Message</TITLE>

<META content="MSHTML 6.00.2719.2200" name=GENERATOR></HEAD>
<BODY lang=EN-US style="tab-interval: .5in" vLink=#800080 link=#0000ff>
<DIV><SPAN class=795495613-07112002><FONT face=Arial color=#0000ff size=2>We 
run 
Netshield on our NT 4 Servers (NB3.4.1 clients), and were told by a German 
colleague that he was advised by Veritas to disable the Netshield service while 
the backups were running (dont know why though). </FONT></SPAN></DIV>
<DIV><SPAN class=795495613-07112002><FONT face=Arial color=#0000ff 
size=2></FONT></SPAN>&nbsp;</DIV>
<DIV><SPAN class=795495613-07112002><FONT face=Arial color=#0000ff size=2>So 
we've got bpstart_notify and bpend notify scripts stopping and starting the 
service.</FONT></SPAN></DIV>
<DIV><SPAN class=795495613-07112002><FONT face=Arial color=#0000ff 
size=2></FONT></SPAN>&nbsp;</DIV>
<DIV><FONT face=Tahoma><FONT size=2><SPAN class=795495613-07112002><FONT 
face=Arial color=#0000ff>Unfortunately I havent got any info on what happened 
to 
the throughput, this was implemented quite a while 
ago.</FONT></SPAN></FONT></FONT></DIV>
<DIV><FONT face=Tahoma><FONT size=2><SPAN class=795495613-07112002><FONT 
size=2></FONT></SPAN></FONT></FONT>&nbsp;</DIV>
<DIV><FONT face=Tahoma><FONT size=2><SPAN class=795495613-07112002><FONT 
size=2>Regards,<BR><BR>Brian Briscoe<BR>European OA Support<BR>Visteon 
Technical 
Centre, 28/803,<BR>Dunton, England,<BR>Tel&nbsp; (8738)6214 Ext 01268 
406214<BR>Fax (8738)4367 Ext 01268 404367<BR>Email: 
bbriscoe AT visteon DOT com<BR></FONT></SPAN></FONT></FONT></DIV>
<DIV><FONT face=Tahoma><FONT size=2><SPAN 
class=795495613-07112002>&nbsp;</SPAN>-----Original 
Message-----<BR><B>From:</B> 
Quarantine [mailto:Quarantine AT GSCCCA DOT ORG]<BR><B>Sent:</B> 07 November 
2002 
13:23<BR><B>To:</B> 'kathy AT mitre DOT org'; kawumin AT mtn.co DOT ug; 
veritas-bu AT mailman.eng.auburn DOT edu<BR><B>Subject:</B> RE: [Veritas-bu] 
slow 
backups<BR><BR></DIV></FONT></FONT>
<BLOCKQUOTE dir=ltr 
style="PADDING-LEFT: 5px; MARGIN-LEFT: 5px; BORDER-LEFT: #0000ff 2px solid; 
MARGIN-RIGHT: 0px">
  <DIV>
  <DIV><SPAN class=992341613-07112002><FONT face=Arial><FONT 
color=#0000ff><FONT 
  size=2><SPAN class=136131713-07112002>Good suggestions.&nbsp; For 
  clarification, though,&nbsp;</SPAN><SPAN class=136131713-07112002>the 
  requester is </SPAN>seeing<SPAN class=136131713-07112002> speeds drop to 
  </SPAN>500<SPAN class=136131713-07112002> </SPAN>kb/sec and saying 
  the&nbsp;native speed<SPAN class=136131713-07112002> </SPAN>is 11<SPAN 
  class=136131713-07112002> </SPAN>mb/s.</FONT></FONT></FONT></SPAN></DIV>
  <DIV><SPAN class=992341613-07112002><FONT face=Arial color=#0000ff 
  size=2></FONT></SPAN>&nbsp;</DIV>
  <DIV><SPAN class=992341613-07112002><FONT face=Arial color=#0000ff 
  size=2><SPAN class=136131713-07112002>With respect to suggestion 3, does 
  anybody worry about turning off virus protection during backups?&nbsp; Among 
  other things, I have about 50 million files with an average size of 50K on 
  various RAID 5 LUNs.&nbsp; I see respectable backup times, but would like to 
  speed them up.&nbsp; I've considered stopping virus protection, but I just 
  can't bring myself to do it.&nbsp; Comments?</SPAN></FONT></SPAN></DIV>
  <DIV><SPAN class=992341613-07112002><FONT face=Arial color=#0000ff 
  size=2></FONT></SPAN>&nbsp;</DIV>
  <DIV><SPAN class=992341613-07112002><SPAN class=136131713-07112002><FONT 
  face=Arial color=#0000ff size=2>Thanks,</FONT></SPAN></SPAN></DIV>
  <DIV><SPAN class=992341613-07112002><FONT face=Arial color=#0000ff 
  size=2>Matt</FONT></SPAN></DIV>
  <DIV><SPAN class=992341613-07112002><FONT face=Arial color=#0000ff 
  size=2></FONT></SPAN>&nbsp;</DIV></DIV>
  <DIV></DIV>
  <DIV class=OutlookMessageHeader lang=en-us dir=ltr align=left><FONT 
  face=Tahoma size=2>-----Original Message-----<BR><B>From:</B> Kathy 
  Riddlemoser [mailto:kathy AT mitre DOT org] <BR><B>Sent:</B> Thursday, 
November 07, 
  2002 8:10 AM<BR><B>To:</B> kawumin AT mtn.co DOT ug; 
  veritas-bu AT mailman.eng.auburn DOT edu<BR><B>Subject:</B> Re: [Veritas-bu] 
slow 
  backups<BR><BR></FONT></DIV>This is what I understand from your note.&nbsp; 
  You have 1 Master server (Win2k) and 5 Media servers (4 Win2k + 1 Unix) and 
  according to your note they all use the same SDLT unit which contains 12 
  drives and the SDLT is attached to a SAN.&nbsp; You're seeing 11mb/sec 
written 
  to tape. 
  <P>I'm not sure why you are complaining.&nbsp; I've got an LTO that I use to 
  back up 1.4TB of data off a Compaq SAN utilizing only one LTO drive (the data 
  is all under one mount point) and it takes 68 hours which turns out to be 
  about 17 GB an hour and 5 mb/sec.&nbsp; I'd love to see 11 mb/sec. 
  <P>I currently have a ticket open with Veritas to assist me with trying to 
  gain better performance.&nbsp; Here is my layout: <BR>1) Master / Media 
server 
  = Ultra2 running Solaris 2.7w/1G mem and w/Qualstar 6460 4 DLT drives backing 
  up unix, linux and windows clients.&nbsp; No big deal under this 
  situation.&nbsp; I'm very happy with speed and time (upgrading to Sun 220R, 
  Solaris 2.7, 2G mem and 2 450 CPUs) <BR>2) Media server = Dell 1650, 2G mem, 
2 
  450 CPU's (heck of a lot more than the Master's got above)&nbsp; with an 
  Overland Neo series LTO (2 drives &amp; 30 slots).&nbsp; This is also a 
  Netbackup Professional NBUP server.&nbsp; It's storage is 2 TB on a Compaq 
SAN 
  with direct fiber connection to this box and I'm only writing 17 GB an 
  hour.&nbsp; However, it starts out at 40 Gig and then drops. 
  <P>Some of the things I'm doing...... <BR>1) updating drivers (if needed) on 
  library and its drives <BR>2) updating firmware (if needed) on library and 
its 
  drives <BR>3) I do have all the latest NBU v3.4.1 patches, but am double 
  checking <BR>3) turn off anti-virus software that might run during backup 
  <BR>4) turn off NBUPclient connections to the server over the weekend and see 
  if backup improves (NBUP clients backup to SAN and then I backup the data to 
  tape). <BR>5) identify any other services that may be running that can be 
  stopped during backup window. 
  <P>Now, if you can be more specific to what media server, what type of data 
  you're backing up that will help.&nbsp; Are you backing up data straight from 
  the client to tape?&nbsp; If so, what kind of network connection do you 
  have.&nbsp;&nbsp; Might want to lock your network switch and server down to 
  100mb/full duplex.&nbsp;&nbsp; You may be transporting at 10 versus 100 and 
  even at half duplex. 
  <P>Are you backing up a ton of very small files.&nbsp; This in it self is a 
  major problem.&nbsp; Alot of small files take longer to back up than large 
  ones.&nbsp; I don't think I resolved things for you,but may be have given you 
  some other avenues to venture down. 
  <P>Regards, <BR>Kathy <BR>&nbsp; 
  <P>kawumin AT mtn.co DOT ug wrote: 
  <BLOCKQUOTE TYPE="CITE"><LINK href="cid:[email protected]" 
    rel=File-List><!--[if gte mso 9]><xml>
 <o:OfficeDocumentSettings>
  <o:DoNotRelyOnCSS/>
 </o:OfficeDocumentSettings>
</xml><![endif]--><!--[if gte mso 9]><xml>
 <w:WordDocument>
  <w:SpellingState>Clean</w:SpellingState>
  <w:GrammarState>Clean</w:GrammarState>
  <w:DocumentKind>DocumentEmail</w:DocumentKind>
  <w:EnvelopeVis/>
  <w:Compatibility>
   <w:BreakWrappedTables/>
   <w:SnapToGridInCell/>
   <w:WrapTextWithPunct/>
   <w:UseAsianBreakRules/>
  </w:Compatibility>
  <w:BrowserLevel>MicrosoftInternetExplorer4</w:BrowserLevel>
 </w:WordDocument>
</xml><![endif]-->
    <STYLE>@page Section1 {size: 8.5in 11.0in; margin: 1.0in 1.25in 1.0in 
1.25in; mso-header-margin: .5in; mso-footer-margin: .5in; mso-paper-source: 0; }
P.MsoNormal {
        FONT-SIZE: 12pt; MARGIN: 0in 0in 0pt; FONT-FAMILY: "Times New Roman"; 
mso-style-parent: ""; mso-pagination: widow-orphan; mso-fareast-font-family: 
"Times New Roman"
}
LI.MsoNormal {
        FONT-SIZE: 12pt; MARGIN: 0in 0in 0pt; FONT-FAMILY: "Times New Roman"; 
mso-style-parent: ""; mso-pagination: widow-orphan; mso-fareast-font-family: 
"Times New Roman"
}
DIV.MsoNormal {
        FONT-SIZE: 12pt; MARGIN: 0in 0in 0pt; FONT-FAMILY: "Times New Roman"; 
mso-style-parent: ""; mso-pagination: widow-orphan; mso-fareast-font-family: 
"Times New Roman"
}
A:link {
        COLOR: blue; TEXT-DECORATION: underline; text-underline: single
}
SPAN.MsoHyperlink {
        COLOR: blue; TEXT-DECORATION: underline; text-underline: single
}
A:visited {
        COLOR: purple; TEXT-DECORATION: underline; text-underline: single
}
SPAN.MsoHyperlinkFollowed {
        COLOR: purple; TEXT-DECORATION: underline; text-underline: single
}
SPAN.EmailStyle17 {
        COLOR: windowtext; FONT-FAMILY: Arial; mso-style-type: 
personal-compose; mso-style-noshow: yes; mso-ansi-font-size: 10.0pt; 
mso-bidi-font-size: 10.0pt; mso-ascii-font-family: Arial; 
mso-hansi-font-family: Arial; mso-bidi-font-family: Arial
}
SPAN.SpellE {
        mso-style-name: ""; mso-spl-e: yes
}
SPAN.GramE {
        mso-style-name: ""; mso-gram-e: yes
}
DIV.Section1 {
        page: Section1
}
</STYLE>
<!--[if gte mso 10]>
<style>
 /* Style Definitions */ 
 table.MsoNormalTable
        {mso-style-name:"Table Normal";
        mso-tstyle-rowband-size:0;
        mso-tstyle-colband-size:0;
        mso-style-noshow:yes;
        mso-style-parent:"";
        mso-padding-alt:0in 5.4pt 0in 5.4pt;
        mso-para-margin:0in;
        mso-para-margin-bottom:.0001pt;
        mso-pagination:widow-orphan;
        font-size:10.0pt;
        font-family:"Times New Roman";}
</style>
<![endif]-->
    <DIV class=Section1>
    <DIV class=MsoNormal><SPAN style="FONT-SIZE: 12pt"><FONT 
    face="Times New Roman"><FONT 
size=+0>Hi</FONT></FONT><O:P></O:P></SPAN></DIV>
    <P class=MsoNormal><SPAN style="FONT-SIZE: 12pt"><FONT 
    face="Times New Roman"><FONT size=+0>I have a windows 2000 advanced server 
    master server, 4 windows 2000 advanced server media servers and 2 tru64 
UNIX 
    media servers. I 'm using Veritas Netbackup Datacenter v3.4.1 with 
    patches;</FONT></FONT><O:P></O:P></SPAN> 
    <P class=MsoNormal style="mso-layout-grid-align: none"><SPAN 
    style="FONT-SIZE: 10pt; FONT-FAMILY: 'Courier New'"><FONT 
    face="Courier New"><FONT size=-1>For Microsoft Windows (all version) the 
    latest patch is - 
    NB_341_4.winnt.intel_250246.exe</FONT></FONT><O:P></O:P></SPAN> 
    <P class=MsoNormal style="mso-layout-grid-align: none"><SPAN 
    style="FONT-SIZE: 10pt; FONT-FAMILY: 'Courier New'"><O:P></O:P></SPAN>
    <P class=MsoNormal><SPAN 
    style="FONT-SIZE: 10pt; FONT-FAMILY: 'Courier New'"><FONT 
    face="Courier New"><FONT size=-1>For TRU64 the latest patch&nbsp;<SPAN 
    class=GramE>is<SPAN style="mso-spacerun: yes"></SPAN>-</SPAN> 
    NB_34_3.clients_246589.tar (this patch provides fixes for both UNIX server 
    and clients)</FONT></FONT><O:P></O:P></SPAN> 
    <P class=MsoNormal><SPAN 
    style="FONT-SIZE: 10pt; FONT-FAMILY: 'Courier New'"><FONT 
    face="Courier New"><FONT size=-1>The master and media servers are connected 
    to the Compaq SL9326 library with, 12 SDLT drives, through a Compaq SAN 
    switch, 10Km single fiber link to the Compaq Modular Data router (MDR) 
    and&nbsp;<SPAN class=GramE>scsi</SPAN> cables from the 
    MDR.</FONT></FONT><O:P></O:P></SPAN> 
    <P class=MsoNormal><SPAN 
    style="FONT-SIZE: 10pt; FONT-FAMILY: 'Courier New'"><FONT 
    face="Courier New"><FONT size=-1>I have a problem the backups take so long 
    when running, the speeds drop per stream to 500kb/sec. which is very low. 
    Yet the speed for a native backup (which we use) for and SDLT tape drive is 
    11mb/sec. please help!!</FONT></FONT><O:P></O:P></SPAN> 
    <P class=MsoNormal><SPAN 
    style="FONT-SIZE: 10pt; FONT-FAMILY: 'Courier New'"><FONT 
    face="Courier New"><FONT size=-1>Thanks, 
    
Nelson.</FONT></FONT></SPAN><O:P></O:P></P></DIV></BLOCKQUOTE></BLOCKQUOTE></BODY></HTML>

------_=_NextPart_001_01C28668.177183D2--

<Prev in Thread] Current Thread [Next in Thread>