Veritas-bu

[Veritas-bu] SUMMARY: Backup Performance Issues

2002-07-11 12:41:46
Subject: [Veritas-bu] SUMMARY: Backup Performance Issues
From: RRichardson AT activision DOT com (Richardson, Robert)
Date: Thu, 11 Jul 2002 09:41:46 -0700
This message is in MIME format. Since your mail reader does not understand
this format, some or all of this message may not be legible.

------_=_NextPart_001_01C228F9.D8D439B0
Content-Type: text/plain;
        charset="iso-8859-1"

Folks,
I would like to thank everyone that responded to my email about
my backup performance issues.  I would like to especially thank 
Mark Donaldson, who pointed to the information that resolved
my issue ( http://seer.support.veritas.com/docs/183702.htm ).

Original Problem: 
It was taking 38 hours to backup the 168 Gigs, 
168243872 Kbytes at 1222.017 Kbytes/sec 
There were a lot of 1 Gig files, and quite a few of them took 
awhile to be backed up. Some even took a few hours to 
be backed up.

Resolution:
1. Added the following parameters to backup client:
echo "65536" > /usr/openv/netbackup/NET_BUFFER_SZ

2. Added the following parameters to master/media backup server:
echo "65536" > /usr/openv/netbackup/NET_BUFFER_SZ
echo "262144" > /usr/openv/netbackup/db/config/SIZE_DATA_BUFFERS
echo "16" > /usr/openv/netbackup/db/config/NUMBER_DATA_BUFFERS

Results:
It took 2 hours and 23 minutes to backup 128 Gigs of data.
128544256 Kbytes at 15136.059 Kbytes/sec

During the backup an "iostat -xn 2" showed the following on the tape drive:
         extended device statistics
r/s  w/s  kr/s  kw/s   wait actv wsvc_t asvc_t %w %b device
0.0 63.1 0.0 16144.1 0.0 1.0 0.1 15.7 0 99 rmt/6
0.0 65.5 0.0 16768.5 0.0 0.8 0.1 12.7 0 83 rmt/6
0.0 52.5 0.0 13439.0 0.0 1.0 0.1 18.9 0 99 rmt/6
0.0 57.0 0.0 14592.2 0.0 1.0 0.1 17.4 0 99 rmt/6
0.0 55.0 0.0 14077.8 0.0 1.0 0.1 18.0 0 99 rmt/6
0.0 59.5 0.0 15230.9 0.0 1.0 0.1 16.6 0 99 rmt/6
The future:
I going to look into tweeking the parameters even higher with the
following:
echo "132096" > /usr/openv/netbackup/NET_BUFFER_SZ
echo "262144" > /usr/openv/netbackup/db/config/SIZE_DATA_BUFFERS
echo "2048" > /usr/openv/netbackup/db/config/NUMBER_DATA_BUFFERS

Hopefully these parameters will give me even better throughput.


Robert Richardson
Activision Studios
310.255.2247


------_=_NextPart_001_01C228F9.D8D439B0
Content-Type: text/html;
        charset="iso-8859-1"
Content-Transfer-Encoding: quoted-printable

<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 3.2//EN">
<HTML>
<HEAD>
<META HTTP-EQUIV=3D"Content-Type" CONTENT=3D"text/html; =
charset=3Diso-8859-1">
<META NAME=3D"Generator" CONTENT=3D"MS Exchange Server version =
5.5.2654.45">
<TITLE>SUMMARY: Backup Performance Issues</TITLE>
</HEAD>
<BODY>

<P><FONT SIZE=3D2 FACE=3D"Arial">Folks,</FONT>
<BR><FONT SIZE=3D2 FACE=3D"Arial">I would like to thank everyone that =
responded to my email about</FONT>
<BR><FONT SIZE=3D2 FACE=3D"Arial">my backup performance issues.&nbsp; I =
would like to especially thank </FONT>
<BR><FONT SIZE=3D2 FACE=3D"Arial">Mark Donaldson, who pointed to the =
information that resolved</FONT>
<BR><FONT SIZE=3D2 FACE=3D"Arial">my issue (<U></U></FONT><U></U><U> =
<FONT COLOR=3D"#0000FF" FACE=3D"Times New Roman"><A =
HREF=3D"http://seer.support.veritas.com/docs/183702.htm"; =
TARGET=3D"_blank">http://seer.support.veritas.com/docs/183702.htm</A></F=
ONT></U><FONT FACE=3D"Times New Roman"> ).</FONT>
</P>

<P><FONT SIZE=3D2 FACE=3D"Arial">Original Problem:</FONT><FONT =
FACE=3D"Times New Roman"><BR>
</FONT><FONT SIZE=3D2 FACE=3D"Arial">It was taking 38 hours to backup =
the 168 Gigs,</FONT><FONT FACE=3D"Times New Roman"><BR>
</FONT><FONT SIZE=3D2 FACE=3D"Arial">168243872 Kbytes at 1222.017 =
Kbytes/sec</FONT><FONT FACE=3D"Times New Roman"><BR>
</FONT><FONT SIZE=3D2 FACE=3D"Arial">There were a lot of 1 Gig files, =
and quite a few of them took</FONT><FONT FACE=3D"Times New Roman"><BR>
</FONT><FONT SIZE=3D2 FACE=3D"Arial">awhile to be backed up. Some even =
took a few hours to</FONT><FONT FACE=3D"Times New Roman"><BR>
</FONT><FONT SIZE=3D2 FACE=3D"Arial">be backed up.</FONT>
</P>

<P><FONT SIZE=3D2 FACE=3D"Arial">Resolution:</FONT>
<BR><FONT SIZE=3D2 FACE=3D"Arial">1. Added the following parameters to =
backup client:</FONT>
<BR><FONT SIZE=3D2 FACE=3D"Arial">echo &quot;65536&quot; &gt; =
/usr/openv/netbackup/NET_BUFFER_SZ</FONT>
</P>

<P><FONT SIZE=3D2 FACE=3D"Arial">2. Added the following parameters to =
master/media backup server:</FONT>
<BR><FONT SIZE=3D2 FACE=3D"Arial">echo &quot;65536&quot; &gt; =
/usr/openv/netbackup/NET_BUFFER_SZ</FONT>
<BR><FONT SIZE=3D2 FACE=3D"Arial">echo &quot;262144&quot; &gt; =
/usr/openv/netbackup/db/config/SIZE_DATA_BUFFERS</FONT>
<BR><FONT SIZE=3D2 FACE=3D"Arial">echo &quot;16&quot; &gt; =
/usr/openv/netbackup/db/config/NUMBER_DATA_BUFFERS</FONT>
</P>

<P><FONT SIZE=3D2 FACE=3D"Arial">Results:</FONT>
<BR><FONT SIZE=3D2 FACE=3D"Arial">It took 2 hours and 23 minutes to =
backup 128 Gigs of data.</FONT>
<BR><FONT SIZE=3D2 FACE=3D"Arial">128544256 Kbytes at 15136.059 =
Kbytes/sec</FONT>
</P>

<P><FONT SIZE=3D2 FACE=3D"Arial">During the backup an =
&quot;</FONT><FONT COLOR=3D"#0000FF" SIZE=3D2 FACE=3D"Arial">iostat -xn =
2</FONT><FONT SIZE=3D2 FACE=3D"Arial">&quot; showed the following on =
the tape drive:<BR>
</FONT><FONT FACE=3D"Times New =
Roman">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</FONT> <FONT =
SIZE=3D2 FACE=3D"Arial">extended device statistics<BR>
r/s&nbsp; w/s&nbsp; kr/s&nbsp; kw/s&nbsp;&nbsp; wait actv wsvc_t asvc_t =
%w %b device</FONT><BR>
<FONT SIZE=3D2 FACE=3D"Arial">0.0 63.1 0.0 16144.1 0.0 1.0 0.1 15.7 0 =
99 rmt/6<BR>
0.0 65.5 0.0 16768.5 0.0 0.8 0.1 12.7 0 83 rmt/6<BR>
0.0 52.5 0.0 13439.0 0.0 1.0 0.1 18.9 0 99 rmt/6<BR>
0.0 57.0 0.0 14592.2 0.0 1.0 0.1 17.4 0 99 rmt/6<BR>
0.0 55.0 0.0 14077.8 0.0 1.0 0.1 18.0 0 99 rmt/6<BR>
0.0 59.5 0.0 15230.9 0.0 1.0 0.1 16.6 0 99 rmt/6</FONT>
<BR><FONT SIZE=3D2 FACE=3D"Arial">The future:<BR>
I going to look into tweeking the parameters even higher with the<BR>
following:<BR>
</FONT><FONT SIZE=3D2 FACE=3D"Arial">echo &quot;132096&quot; &gt; =
/usr/openv/netbackup/NET_BUFFER_SZ<BR>
echo &quot;262144&quot; &gt; =
/usr/openv/netbackup/db/config/SIZE_DATA_BUFFERS<BR>
echo &quot;2048&quot; &gt; =
/usr/openv/netbackup/db/config/NUMBER_DATA_BUFFERS</FONT>
</P>

<P><FONT SIZE=3D2 FACE=3D"Arial">Hopefully these parameters will give =
me even better throughput.</FONT>
</P>
<BR>

<P><FONT SIZE=3D2 FACE=3D"Arial">Robert Richardson</FONT>
<BR><FONT SIZE=3D2 FACE=3D"Arial">Activision Studios</FONT>
<BR><FONT SIZE=3D2 FACE=3D"Arial">310.255.2247</FONT>
</P>

</BODY>
</HTML>
------_=_NextPart_001_01C228F9.D8D439B0--

<Prev in Thread] Current Thread [Next in Thread>