Veritas-bu

[Veritas-bu] running out of memory on Solaris 8 master servers

2005-12-22 13:30:27
Subject: [Veritas-bu] running out of memory on Solaris 8 master servers
From: cheryl.king AT intrado DOT com (King, Cheryl)
Date: Thu, 22 Dec 2005 11:30:27 -0700
This is a multi-part message in MIME format.

------_=_NextPart_001_01C60725.C8527896
Content-Type: text/plain;
        charset="us-ascii"
Content-Transfer-Encoding: quoted-printable

NUMBER_DATA_BUFFERS

16

SIZE_DATA_BUFFERS

262144

=20

________________________________

From: Mark.Donaldson AT cexp DOT com [mailto:Mark.Donaldson AT cexp DOT com]=20
Sent: Thursday, December 22, 2005 10:10 AM
To: King, Cheryl; veritas-bu AT mailman.eng.auburn DOT edu
Subject: RE: [Veritas-bu] running out of memory on Solaris 8 master
servers

=20

I got too enthusiastic bumping up my buffer counts & sizes once and ran
my 8G system out of RAM.  You might want to check these settings for
sane values.

=20

(These ones in ../netbackup/db/config:

NUMBER_DATA_BUFFERS
NUMBER_DATA_BUFFERS_DISK
NUMBER_DATA_BUFFERS_RESTORE
SIZE_DATA_BUFFERS
SIZE_DATA_BUFFERS_DISK)

=20

-M

        -----Original Message-----
        From: veritas-bu-admin AT mailman.eng.auburn DOT edu
[mailto:veritas-bu-admin AT mailman.eng.auburn DOT edu]On Behalf Of King,
Cheryl
        Sent: Wednesday, December 21, 2005 8:52 AM
        To: veritas-bu AT mailman.eng.auburn DOT edu
        Subject: [Veritas-bu] running out of memory on Solaris 8 master
servers

        I have two Solaris 8 master servers running NetBackup 5.1 MP3S2.
They keep running out of memory after a few months.  I'm wondering if
anyone else has this problem and if they fixed it.  It started some time
after going to v5.1 I think.  Maintenance hasn't fixed it. =20

        The only theory I can come up with is that we run bpduplicate
scripts all day, after the backup window, to send tapes offsite for DR.
We're still using SDLT drives and have a lot of problems with stuck
tapes (twice a week maybe).  This causes us to cancel the duplicate
scripts (from WIN admin console)  to be able to open the robot and get
the tapes out.  Occasionally we have to get the vendor in to remove a
tape that won't come out manually.  Maybe NBU doesn't clean up memory
when we cancel these jobs.  I don't know, it's just a guess really.

        Any ideas on what's causing it or how I could find out what's
causing it?  When it runs out of memory it's always during regular
backups.  Since I haven't seen any discussion about this on this list
I'm assuming regular scheduled backups isn't the cause.

        The only way to get back swap space is to boot the server.

        Cheryl King

        System Administrator II

        AIS - OpenView System and Servers Certified

        Intrado Inc.

        1601 Dry Creek Drive

        Longmont, CO 80503

        direct: 720.864.5162

        mobile: 720.840.4786

        page:  303-207-4648

        fax: 720.494.6600

        email: cheryl.king AT intrado DOT com

        Intrado Inc.

        www.intrado.com <file:///\\www.intrado.com> =20

        ATTENTION:

        The information contained in this electronic message and any
attachments to this message are intended for the exclusive use of the
addressee(s) and may contain confidential or privileged information. If
you are not the intended recipient, please notify Intrado Inc.
immediately at 720.494.5800 and destroy all copies of this message and
any attachments.

        =20


------_=_NextPart_001_01C60725.C8527896
Content-Type: text/html;
        charset="us-ascii"
Content-Transfer-Encoding: quoted-printable

<html xmlns:v=3D"urn:schemas-microsoft-com:vml" =
xmlns:o=3D"urn:schemas-microsoft-com:office:office" =
xmlns:w=3D"urn:schemas-microsoft-com:office:word" =
xmlns:st1=3D"urn:schemas-microsoft-com:office:smarttags" =
xmlns=3D"http://www.w3.org/TR/REC-html40";>

<head>
<META HTTP-EQUIV=3D"Content-Type" CONTENT=3D"text/html; =
charset=3Dus-ascii">
<meta name=3DGenerator content=3D"Microsoft Word 11 (filtered medium)">
<!--[if !mso]>
<style>
v\:* {behavior:url(#default#VML);}
o\:* {behavior:url(#default#VML);}
w\:* {behavior:url(#default#VML);}
.shape {behavior:url(#default#VML);}
</style>
<![endif]-->
<title>running out of memory on Solaris 8 master servers</title>
<o:SmartTagType =
namespaceuri=3D"urn:schemas-microsoft-com:office:smarttags"
 name=3D"PostalCode"/>
<o:SmartTagType =
namespaceuri=3D"urn:schemas-microsoft-com:office:smarttags"
 name=3D"State"/>
<o:SmartTagType =
namespaceuri=3D"urn:schemas-microsoft-com:office:smarttags"
 name=3D"Street"/>
<o:SmartTagType =
namespaceuri=3D"urn:schemas-microsoft-com:office:smarttags"
 name=3D"address"/>
<o:SmartTagType =
namespaceuri=3D"urn:schemas-microsoft-com:office:smarttags"
 name=3D"City"/>
<o:SmartTagType =
namespaceuri=3D"urn:schemas-microsoft-com:office:smarttags"
 name=3D"place"/>
<!--[if !mso]>
<style>
st1\:*{behavior:url(#default#ieooui) }
</style>
<![endif]-->
<style>
<!--
 /* Font Definitions */
 @font-face
        {font-family:Tahoma;
        panose-1:2 11 6 4 3 5 4 4 2 4;}
@font-face
        {font-family:"Arial Narrow";
        panose-1:2 11 5 6 2 2 2 3 2 4;}
 /* Style Definitions */
 p.MsoNormal, li.MsoNormal, div.MsoNormal
        {margin:0in;
        margin-bottom:.0001pt;
        font-size:12.0pt;
        font-family:"Times New Roman";}
a:link, span.MsoHyperlink
        {color:blue;
        text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
        {color:blue;
        text-decoration:underline;}
p
        {mso-margin-top-alt:auto;
        margin-right:0in;
        mso-margin-bottom-alt:auto;
        margin-left:0in;
        font-size:12.0pt;
        font-family:"Times New Roman";}
span.EmailStyle18
        {mso-style-type:personal-reply;
        font-family:Arial;
        color:navy;}
@page Section1
        {size:8.5in 11.0in;
        margin:1.0in 1.25in 1.0in 1.25in;}
div.Section1
        {page:Section1;}
-->
</style>
<!--[if gte mso 9]><xml>
 <o:shapedefaults v:ext=3D"edit" spidmax=3D"1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
 <o:shapelayout v:ext=3D"edit">
  <o:idmap v:ext=3D"edit" data=3D"1" />
 </o:shapelayout></xml><![endif]-->
</head>

<body lang=3DEN-US link=3Dblue vlink=3Dblue>

<div class=3DSection1>

<p class=3DMsoNormal><font size=3D2 color=3Dnavy face=3DArial><span =
style=3D'font-size:
10.0pt;font-family:Arial;color:navy'>NUMBER_DATA_BUFFERS<o:p></o:p></span=
></font></p>

<p class=3DMsoNormal><font size=3D2 color=3Dnavy face=3DArial><span =
style=3D'font-size:
10.0pt;font-family:Arial;color:navy'>16<o:p></o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 color=3Dnavy face=3DArial><span =
style=3D'font-size:
10.0pt;font-family:Arial;color:navy'>SIZE_DATA_BUFFERS<o:p></o:p></span><=
/font></p>

<p class=3DMsoNormal><font size=3D2 color=3Dnavy face=3DArial><span =
style=3D'font-size:
10.0pt;font-family:Arial;color:navy'>262144<o:p></o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 color=3Dnavy face=3DArial><span =
style=3D'font-size:
10.0pt;font-family:Arial;color:navy'><o:p>&nbsp;</o:p></span></font></p>

<div>

<div class=3DMsoNormal align=3Dcenter style=3D'text-align:center'><font =
size=3D3
face=3D"Times New Roman"><span style=3D'font-size:12.0pt'>

<hr size=3D2 width=3D"100%" align=3Dcenter tabindex=3D-1>

</span></font></div>

<p class=3DMsoNormal><b><font size=3D2 face=3DTahoma><span =
style=3D'font-size:10.0pt;
font-family:Tahoma;font-weight:bold'>From:</span></font></b><font =
size=3D2
face=3DTahoma><span style=3D'font-size:10.0pt;font-family:Tahoma'>
Mark.Donaldson AT cexp DOT com [mailto:Mark.Donaldson AT cexp DOT com] <br>
<b><span style=3D'font-weight:bold'>Sent:</span></b> Thursday, December =
22, 2005
10:10 AM<br>
<b><span style=3D'font-weight:bold'>To:</span></b> King, Cheryl;
veritas-bu AT mailman.eng.auburn DOT edu<br>
<b><span style=3D'font-weight:bold'>Subject:</span></b> RE: [Veritas-bu] =
running
out of memory on Solaris 8 master servers</span></font><o:p></o:p></p>

</div>

<p class=3DMsoNormal><font size=3D3 face=3D"Times New Roman"><span =
style=3D'font-size:
12.0pt'><o:p>&nbsp;</o:p></span></font></p>

<div>

<p class=3DMsoNormal><font size=3D2 color=3Dblue face=3DArial><span =
style=3D'font-size:
10.0pt;font-family:Arial;color:blue'>I got too enthusiastic bumping up =
my
buffer counts &amp; sizes once and ran my 8G system out of RAM.&nbsp; =
You might
want to check these settings for sane =
values.</span></font><o:p></o:p></p>

</div>

<div>

<p class=3DMsoNormal><font size=3D3 face=3D"Times New Roman"><span =
style=3D'font-size:
12.0pt'>&nbsp;<o:p></o:p></span></font></p>

</div>

<div>

<p class=3DMsoNormal><font size=3D2 color=3Dblue face=3DArial><span =
style=3D'font-size:
10.0pt;font-family:Arial;color:blue'>(These ones in =
../netbackup/db/config:</span></font><o:p></o:p></p>

</div>

<div>

<p class=3DMsoNormal><font size=3D2 color=3Dblue face=3DArial><span =
style=3D'font-size:
10.0pt;font-family:Arial;color:blue'>NUMBER_DATA_BUFFERS<br>
NUMBER_DATA_BUFFERS_DISK<br>
NUMBER_DATA_BUFFERS_RESTORE<br>
SIZE_DATA_BUFFERS<br>
SIZE_DATA_BUFFERS_DISK)</span></font><o:p></o:p></p>

</div>

<div>

<p class=3DMsoNormal><font size=3D3 face=3D"Times New Roman"><span =
style=3D'font-size:
12.0pt'>&nbsp;<o:p></o:p></span></font></p>

</div>

<div>

<p class=3DMsoNormal><font size=3D2 color=3Dblue face=3DArial><span =
style=3D'font-size:
10.0pt;font-family:Arial;color:blue'>-M</span></font><o:p></o:p></p>

</div>

<blockquote =
style=3D'margin-top:5.0pt;margin-right:0in;margin-bottom:5.0pt'>

<p class=3DMsoNormal style=3D'margin-bottom:12.0pt'><font size=3D2 =
face=3DTahoma><span
style=3D'font-size:10.0pt;font-family:Tahoma'>-----Original =
Message-----<br>
<b><span style=3D'font-weight:bold'>From:</span></b>
veritas-bu-admin AT mailman.eng.auburn DOT edu
[mailto:veritas-bu-admin AT mailman.eng.auburn DOT edu]<b><span =
style=3D'font-weight:
bold'>On Behalf Of </span></b>King, Cheryl<br>
<b><span style=3D'font-weight:bold'>Sent:</span></b> Wednesday, December =
21, 2005
8:52 AM<br>
<b><span style=3D'font-weight:bold'>To:</span></b>
veritas-bu AT mailman.eng.auburn DOT edu<br>
<b><span style=3D'font-weight:bold'>Subject:</span></b> [Veritas-bu] =
running out
of memory on Solaris 8 master servers</span></font><o:p></o:p></p>

<p><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;font-family:Arial'><!-- Converted from =
text/rtf format -->I
have two Solaris 8 master servers running NetBackup 5.1 MP3S2.&nbsp; =
They keep
running out of memory after a few months.&nbsp; I'm wondering if anyone =
else
has this problem and if they fixed it.&nbsp; It started some time after =
going
to v5.1 I think.&nbsp; Maintenance hasn't fixed it.&nbsp;</span></font> =
<o:p></o:p></p>

<p><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;font-family:Arial'>The
only theory I can</span></font> <font size=3D2 face=3DArial><span =
style=3D'font-size:
10.0pt;font-family:Arial'>come up with is that we run bpduplicate =
scripts</span></font>
<font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;font-family:Arial'>all
day, after the backup window, to send tapes offsite for DR.&nbsp; =
We're</span></font>
<font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;font-family:Arial'>still
using SDLT drives and have a lot of problems with stuck tapes (twice a =
week
maybe).&nbsp; This causes us to cancel the duplicate scripts (from =
WIN</span></font>
<font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;font-family:Arial'>admin
console)</span></font>&nbsp;<font size=3D2 face=3DArial><span =
style=3D'font-size:
10.0pt;font-family:Arial'> to be able to open the robot and get the =
tapes
out.&nbsp; Occasionally we have to get the vendor in to remove a tape =
that
won't come out manually.&nbsp; Maybe NBU doesn't clean up memory when we =
cancel
these jobs.&nbsp; I don't know, it's just a guess =
really.</span></font><o:p></o:p></p>

<p><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;font-family:Arial'>Any
ideas on what's causing it or how I could find out what's causing =
it?&nbsp;
When it runs out of memory it's always during regular backups.&nbsp; =
Since I
haven't seen any discussion about this on this list I'm assuming regular
scheduled backups isn't the cause.</span></font><o:p></o:p></p>

<p><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;font-family:Arial'>The
only way to get back swap space is to boot the =
server.</span></font><o:p></o:p></p>

<p><a name=3D""><b><font size=3D3 color=3Dred face=3D"Arial =
Narrow"><span
style=3D'font-size:12.0pt;font-family:"Arial =
Narrow";color:red;font-weight:bold'>Cheryl
King</span></font></b></a><o:p></o:p></p>

<p><b><font size=3D1 color=3Dgray face=3D"Arial Narrow"><span =
style=3D'font-size:7.5pt;
font-family:"Arial Narrow";color:gray;font-weight:bold'>System =
Administrator II</span></font></b><o:p></o:p></p>

<p><b><font size=3D1 face=3D"Arial Narrow"><span =
style=3D'font-size:7.5pt;font-family:
"Arial Narrow";font-weight:bold'>AIS - OpenView System and Servers =
Certified</span></font></b><o:p></o:p></p>

<p><b><font size=3D3 color=3Dred face=3D"Arial Narrow"><span =
style=3D'font-size:12.0pt;
font-family:"Arial Narrow";color:red;font-weight:bold'>Intrado =
Inc.</span></font></b><o:p></o:p></p>

<p><st1:Street w:st=3D"on"><st1:address w:st=3D"on"><font size=3D1 =
color=3Dgray
  face=3D"Arial Narrow"><span =
style=3D'font-size:7.5pt;font-family:"Arial Narrow";
  color:gray'>1601 Dry Creek =
Drive</span></font></st1:address></st1:Street><o:p></o:p></p>

<p><st1:place w:st=3D"on"><st1:City w:st=3D"on"><font size=3D1 =
color=3Dgray
  face=3D"Arial Narrow"><span =
style=3D'font-size:7.5pt;font-family:"Arial Narrow";
  color:gray'>Longmont</span></font></st1:City><font size=3D1 =
color=3Dgray
 face=3D"Arial Narrow"><span style=3D'font-size:7.5pt;font-family:"Arial =
Narrow";
 color:gray'>, <st1:State w:st=3D"on">CO</st1:State> <st1:PostalCode =
w:st=3D"on">80503</st1:PostalCode></span></font></st1:place><o:p></o:p></=
p>

<p><i><font size=3D1 color=3Dgray face=3D"Arial Narrow"><span =
style=3D'font-size:7.5pt;
font-family:"Arial Narrow";color:gray;font-style:italic'>direct: =
720.864.5162</span></font></i><o:p></o:p></p>

<p><i><font size=3D1 color=3Dgray face=3D"Arial Narrow"><span =
style=3D'font-size:7.5pt;
font-family:"Arial Narrow";color:gray;font-style:italic'>mobile: =
720.840.4786</span></font></i><o:p></o:p></p>

<p><i><font size=3D1 color=3Dgray face=3D"Arial Narrow"><span =
style=3D'font-size:7.5pt;
font-family:"Arial Narrow";color:gray;font-style:italic'>page:&nbsp;
303-207-4648</span></font></i><o:p></o:p></p>

<p><i><font size=3D1 color=3Dgray face=3D"Arial Narrow"><span =
style=3D'font-size:7.5pt;
font-family:"Arial Narrow";color:gray;font-style:italic'>fax: =
720.494.6600</span></font></i><o:p></o:p></p>

<p><i><font size=3D1 color=3Dgray face=3D"Arial Narrow"><span =
style=3D'font-size:7.5pt;
font-family:"Arial Narrow";color:gray;font-style:italic'>email:
cheryl.king AT intrado DOT com</span></font></i><o:p></o:p></p>

<p><b><font size=3D3 color=3Dred face=3D"Arial Narrow"><span =
style=3D'font-size:12.0pt;
font-family:"Arial Narrow";color:red;font-weight:bold'>Intrado =
Inc.</span></font></b><o:p></o:p></p>

<p><font size=3D3 face=3D"Times New Roman"><span =
style=3D'font-size:12.0pt'><a
href=3D"file:///\\www.intrado.com"><b><font size=3D1 face=3D"Arial =
Narrow"><span
style=3D'font-size:7.5pt;font-family:"Arial =
Narrow";font-weight:bold'>www.intrado.com</span></font></b></a></span></f=
ont><b><u><font
size=3D1 color=3Dblue face=3D"Arial Narrow"><span =
style=3D'font-size:7.5pt;font-family:
"Arial Narrow";color:blue;font-weight:bold'> =
</span></font></u></b><o:p></o:p></p>

<p><b><font size=3D1 face=3D"Times New Roman"><span =
style=3D'font-size:7.5pt;
font-weight:bold'>ATTENTION:</span></font></b><o:p></o:p></p>

<p><font size=3D1 face=3DArial><span =
style=3D'font-size:7.5pt;font-family:Arial'>The
information contained in this electronic message and any attachments to =
this
message are intended for the exclusive use of the addressee(s) and may =
contain
confidential or privileged information. If you are not the intended =
recipient,
please notify Intrado Inc. immediately at 720.494.5800 and destroy all =
copies
of this message and any attachments.</span></font><o:p></o:p></p>

<p class=3DMsoNormal><font size=3D3 face=3D"Times New Roman"><span =
style=3D'font-size:
12.0pt'><o:p>&nbsp;</o:p></span></font></p>

</blockquote>

</div>

</body>

</html>

------_=_NextPart_001_01C60725.C8527896--