Veritas-bu

[Veritas-bu] running out of memory on Solaris 8 master server s

2005-12-22 12:10:09
Subject: [Veritas-bu] running out of memory on Solaris 8 master server s
From: Mark.Donaldson AT cexp DOT com (Mark.Donaldson AT cexp DOT com)
Date: Thu, 22 Dec 2005 10:10:09 -0700
This message is in MIME format. Since your mail reader does not understand
this format, some or all of this message may not be legible.

------_=_NextPart_001_01C6071A.517D6CFB
Content-Type: text/plain;
        charset="iso-8859-1"

I got too enthusiastic bumping up my buffer counts & sizes once and ran my
8G system out of RAM.  You might want to check these settings for sane
values.
 
(These ones in ../netbackup/db/config:
NUMBER_DATA_BUFFERS
NUMBER_DATA_BUFFERS_DISK
NUMBER_DATA_BUFFERS_RESTORE
SIZE_DATA_BUFFERS
SIZE_DATA_BUFFERS_DISK)
 
-M

-----Original Message-----
From: veritas-bu-admin AT mailman.eng.auburn DOT edu
[mailto:veritas-bu-admin AT mailman.eng.auburn DOT edu]On Behalf Of King, Cheryl
Sent: Wednesday, December 21, 2005 8:52 AM
To: veritas-bu AT mailman.eng.auburn DOT edu
Subject: [Veritas-bu] running out of memory on Solaris 8 master servers



I have two Solaris 8 master servers running NetBackup 5.1 MP3S2.  They keep
running out of memory after a few months.  I'm wondering if anyone else has
this problem and if they fixed it.  It started some time after going to v5.1
I think.  Maintenance hasn't fixed it.  

The only theory I can come up with is that we run bpduplicate scripts all
day, after the backup window, to send tapes offsite for DR.  We're still
using SDLT drives and have a lot of problems with stuck tapes (twice a week
maybe).  This causes us to cancel the duplicate scripts (from WIN admin
console)  to be able to open the robot and get the tapes out.  Occasionally
we have to get the vendor in to remove a tape that won't come out manually.
Maybe NBU doesn't clean up memory when we cancel these jobs.  I don't know,
it's just a guess really.

Any ideas on what's causing it or how I could find out what's causing it?
When it runs out of memory it's always during regular backups.  Since I
haven't seen any discussion about this on this list I'm assuming regular
scheduled backups isn't the cause.

The only way to get back swap space is to boot the server.

Cheryl King

System Administrator II

AIS - OpenView System and Servers Certified

Intrado Inc.

1601 Dry Creek Drive

Longmont, CO 80503

direct: 720.864.5162

mobile: 720.840.4786

page:  303-207-4648

fax: 720.494.6600

email: cheryl.king AT intrado DOT com

Intrado Inc.

 <file://www.intrado.com> www.intrado.com 

ATTENTION:

The information contained in this electronic message and any attachments to
this message are intended for the exclusive use of the addressee(s) and may
contain confidential or privileged information. If you are not the intended
recipient, please notify Intrado Inc. immediately at 720.494.5800 and
destroy all copies of this message and any attachments.





------_=_NextPart_001_01C6071A.517D6CFB
Content-Type: text/html;
        charset="iso-8859-1"
Content-Transfer-Encoding: quoted-printable

<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.0 Transitional//EN">
<HTML><HEAD>
<META HTTP-EQUIV=3D"Content-Type" CONTENT=3D"text/html; =
charset=3Diso-8859-1">
<TITLE>running out of memory on Solaris 8 master servers</TITLE>

<META content=3D"MSHTML 6.00.2800.1515" name=3DGENERATOR></HEAD>
<BODY>
<DIV><SPAN class=3D392240817-22122005><FONT face=3DArial =
color=3D#0000ff size=3D2>I got=20
too enthusiastic bumping up my buffer counts &amp; sizes once and ran =
my 8G=20
system out of RAM.&nbsp; You might want to check these settings for =
sane=20
values.</FONT></SPAN></DIV>
<DIV><SPAN class=3D392240817-22122005><FONT face=3DArial =
color=3D#0000ff=20
size=3D2></FONT></SPAN>&nbsp;</DIV>
<DIV><SPAN class=3D392240817-22122005><FONT face=3DArial =
color=3D#0000ff size=3D2>(These=20
ones in ../netbackup/db/config:</FONT></SPAN></DIV>
<DIV><SPAN class=3D392240817-22122005><FONT face=3DArial =
color=3D#0000ff=20
size=3D2>NUMBER_DATA_BUFFERS<BR>NUMBER_DATA_BUFFERS_DISK<BR>NUMBER_DATA_=
BUFFERS_RESTORE<BR>SIZE_DATA_BUFFERS<BR>SIZE_DATA_BUFFERS_DISK)</FONT></=
SPAN></DIV>
<DIV><SPAN class=3D392240817-22122005><FONT face=3DArial =
color=3D#0000ff=20
size=3D2></FONT></SPAN>&nbsp;</DIV>
<DIV><SPAN class=3D392240817-22122005><FONT face=3DArial =
color=3D#0000ff=20
size=3D2>-M</FONT></SPAN></DIV>
<BLOCKQUOTE dir=3Dltr style=3D"MARGIN-RIGHT: 0px">
  <DIV class=3DOutlookMessageHeader dir=3Dltr align=3Dleft><FONT =
face=3DTahoma=20
  size=3D2>-----Original Message-----<BR><B>From:</B>=20
  veritas-bu-admin AT mailman.eng.auburn DOT edu=20
  [mailto:veritas-bu-admin AT mailman.eng.auburn DOT edu]<B>On Behalf Of =
</B>King,=20
  Cheryl<BR><B>Sent:</B> Wednesday, December 21, 2005 8:52 =
AM<BR><B>To:</B>=20
  veritas-bu AT mailman.eng.auburn DOT edu<BR><B>Subject:</B> [Veritas-bu] =
running out=20
  of memory on Solaris 8 master servers<BR><BR></FONT></DIV><!-- =
Converted from text/rtf format -->
  <P align=3Dleft><SPAN lang=3Den-us><FONT face=3DArial size=3D2>I have =
two Solaris 8=20
  master servers running NetBackup 5.1 M</FONT></SPAN><SPAN=20
  lang=3Den-us></SPAN><SPAN lang=3Den-us><FONT face=3DArial =
size=3D2>P3S2.&nbsp; They=20
  keep running out of memory after a few months.</FONT></SPAN><SPAN=20
  lang=3Den-us></SPAN><SPAN lang=3Den-us><FONT face=3DArial =
size=3D2>&nbsp;=20
  I</FONT></SPAN><SPAN lang=3Den-us></SPAN><SPAN lang=3Den-us><FONT =
face=3DArial=20
  size=3D2>'</FONT></SPAN><SPAN lang=3Den-us></SPAN><SPAN =
lang=3Den-us><FONT=20
  face=3DArial size=3D2>m wondering if anyone else has this problem and =
if they=20
  fixed it.&nbsp; It started some time after going to v5.1 I =
think.&nbsp;=20
  Maintenance hasn</FONT></SPAN><SPAN lang=3Den-us></SPAN><SPAN =
lang=3Den-us><FONT=20
  face=3DArial size=3D2>'</FONT></SPAN><SPAN lang=3Den-us></SPAN><SPAN=20
  lang=3Den-us><FONT face=3DArial size=3D2>t fixed =
it.</FONT></SPAN><SPAN=20
  lang=3Den-us></SPAN><SPAN lang=3Den-us><FONT face=3DArial=20
  size=3D2>&nbsp;</FONT></SPAN><SPAN lang=3Den-us></SPAN><SPAN =
lang=3Den-us>=20
  </SPAN></P>
  <P align=3Dleft><SPAN lang=3Den-us><FONT face=3DArial size=3D2>The =
only=20
  th</FONT></SPAN><SPAN lang=3Den-us></SPAN><SPAN lang=3Den-us><FONT =
face=3DArial=20
  size=3D2>eory</FONT></SPAN><SPAN lang=3Den-us></SPAN><SPAN =
lang=3Den-us><FONT=20
  face=3DArial size=3D2> I can</FONT></SPAN><SPAN =
lang=3Den-us></SPAN><SPAN=20
  lang=3Den-us> <FONT face=3DArial size=3D2>come up =
with</FONT></SPAN><SPAN=20
  lang=3Den-us></SPAN><SPAN lang=3Den-us><FONT face=3DArial size=3D2> =
is that we run=20
  bpduplicate scripts</FONT></SPAN><SPAN lang=3Den-us></SPAN><SPAN =
lang=3Den-us>=20
  <FONT face=3DArial size=3D2>all day, after the backup =
window</FONT></SPAN><SPAN=20
  lang=3Den-us></SPAN><SPAN lang=3Den-us><FONT face=3DArial=20
  size=3D2>,</FONT></SPAN><SPAN lang=3Den-us></SPAN><SPAN =
lang=3Den-us><FONT=20
  face=3DArial size=3D2> to send tapes offsite for DR.&nbsp; =
We</FONT></SPAN><SPAN=20
  lang=3Den-us></SPAN><SPAN lang=3Den-us><FONT face=3DArial=20
  size=3D2>'</FONT></SPAN><SPAN lang=3Den-us></SPAN><SPAN =
lang=3Den-us><FONT=20
  face=3DArial size=3D2>re</FONT></SPAN><SPAN lang=3Den-us></SPAN><SPAN =
lang=3Den-us>=20
  <FONT face=3DArial size=3D2>still using SDLT drives and have a lot of =
problems=20
  with stuck tapes</FONT></SPAN><SPAN lang=3Den-us></SPAN><SPAN =
lang=3Den-us><FONT=20
  face=3DArial size=3D2> (twice a wee</FONT></SPAN><SPAN =
lang=3Den-us></SPAN><SPAN=20
  lang=3Den-us><FONT face=3DArial size=3D2>k</FONT></SPAN><SPAN=20
  lang=3Den-us></SPAN><SPAN lang=3Den-us><FONT face=3DArial size=3D2>=20
  maybe)</FONT></SPAN><SPAN lang=3Den-us></SPAN><SPAN =
lang=3Den-us><FONT face=3DArial=20
  size=3D2>.&nbsp; This caus</FONT></SPAN><SPAN =
lang=3Den-us></SPAN><SPAN=20
  lang=3Den-us><FONT face=3DArial size=3D2>es</FONT></SPAN><SPAN=20
  lang=3Den-us></SPAN><SPAN lang=3Den-us><FONT face=3DArial size=3D2> =
us to cancel the=20
  duplicate scripts</FONT></SPAN><SPAN lang=3Den-us></SPAN><SPAN =
lang=3Den-us><FONT=20
  face=3DArial size=3D2> (from</FONT></SPAN><SPAN =
lang=3Den-us></SPAN><SPAN=20
  lang=3Den-us><FONT face=3DArial size=3D2> WIN</FONT></SPAN><SPAN=20
  lang=3Den-us></SPAN><SPAN lang=3Den-us> <FONT face=3DArial =
size=3D2>admin=20
  console)</FONT></SPAN><SPAN lang=3Den-us></SPAN><SPAN =
lang=3Den-us>&nbsp;<FONT=20
  face=3DArial size=3D2> to be able to open the robot and get the tapes =
out.&nbsp;=20
  Oc</FONT></SPAN><SPAN lang=3Den-us></SPAN><SPAN lang=3Den-us><FONT =
face=3DArial=20
  size=3D2>c</FONT></SPAN><SPAN lang=3Den-us></SPAN><SPAN =
lang=3Den-us><FONT=20
  face=3DArial size=3D2>asionally we have to get the vendor in to =
remove a tape that=20
  won</FONT></SPAN><SPAN lang=3Den-us></SPAN><SPAN lang=3Den-us><FONT =
face=3DArial=20
  size=3D2>'</FONT></SPAN><SPAN lang=3Den-us></SPAN><SPAN =
lang=3Den-us><FONT=20
  face=3DArial size=3D2>t come out manually.</FONT></SPAN><SPAN=20
  lang=3Den-us></SPAN><SPAN lang=3Den-us><FONT face=3DArial =
size=3D2>&nbsp; Maybe NBU=20
  doesn</FONT></SPAN><SPAN lang=3Den-us></SPAN><SPAN lang=3Den-us><FONT =
face=3DArial=20
  size=3D2>'</FONT></SPAN><SPAN lang=3Den-us></SPAN><SPAN =
lang=3Den-us><FONT=20
  face=3DArial size=3D2>t clean up memory when we cancel these =
jobs.&nbsp; I=20
  don</FONT></SPAN><SPAN lang=3Den-us></SPAN><SPAN lang=3Den-us><FONT =
face=3DArial=20
  size=3D2>'</FONT></SPAN><SPAN lang=3Den-us></SPAN><SPAN =
lang=3Den-us><FONT=20
  face=3DArial size=3D2>t know, it</FONT></SPAN><SPAN =
lang=3Den-us></SPAN><SPAN=20
  lang=3Den-us><FONT face=3DArial size=3D2>'</FONT></SPAN><SPAN=20
  lang=3Den-us></SPAN><SPAN lang=3Den-us><FONT face=3DArial size=3D2>s =
just a guess=20
  really.</FONT></SPAN><SPAN lang=3Den-us></SPAN><SPAN =
lang=3Den-us></SPAN></P>
  <P align=3Dleft><SPAN lang=3Den-us><FONT face=3DArial size=3D2>Any=20
  ideas</FONT></SPAN><SPAN lang=3Den-us></SPAN><SPAN lang=3Den-us><FONT =
face=3DArial=20
  size=3D2> on what</FONT></SPAN><SPAN lang=3Den-us></SPAN><SPAN =
lang=3Den-us><FONT=20
  face=3DArial size=3D2>'</FONT></SPAN><SPAN lang=3Den-us></SPAN><SPAN=20
  lang=3Den-us><FONT face=3DArial size=3D2>s causing it or how I could =
find out=20
  what</FONT></SPAN><SPAN lang=3Den-us></SPAN><SPAN lang=3Den-us><FONT =
face=3DArial=20
  size=3D2>'</FONT></SPAN><SPAN lang=3Den-us></SPAN><SPAN =
lang=3Den-us><FONT=20
  face=3DArial size=3D2>s causing it</FONT></SPAN><SPAN =
lang=3Den-us></SPAN><SPAN=20
  lang=3Den-us><FONT face=3DArial size=3D2>?</FONT></SPAN><SPAN=20
  lang=3Den-us></SPAN><SPAN lang=3Den-us><FONT face=3DArial =
size=3D2>&nbsp; When it runs=20
  out of memory it</FONT></SPAN><SPAN lang=3Den-us></SPAN><SPAN =
lang=3Den-us><FONT=20
  face=3DArial size=3D2>'</FONT></SPAN><SPAN lang=3Den-us></SPAN><SPAN=20
  lang=3Den-us><FONT face=3DArial size=3D2>s always during regular =
backups.&nbsp;=20
  Since I haven</FONT></SPAN><SPAN lang=3Den-us></SPAN><SPAN =
lang=3Den-us><FONT=20
  face=3DArial size=3D2>'</FONT></SPAN><SPAN lang=3Den-us></SPAN><SPAN=20
  lang=3Den-us><FONT face=3DArial size=3D2>t seen any discussion about=20
  this</FONT></SPAN><SPAN lang=3Den-us></SPAN><SPAN lang=3Den-us><FONT =
face=3DArial=20
  size=3D2> on this list I</FONT></SPAN><SPAN lang=3Den-us></SPAN><SPAN =

  lang=3Den-us><FONT face=3DArial size=3D2>'</FONT></SPAN><SPAN=20
  lang=3Den-us></SPAN><SPAN lang=3Den-us><FONT face=3DArial size=3D2>m =
assuming regular=20
  scheduled backups isn</FONT></SPAN><SPAN lang=3Den-us></SPAN><SPAN=20
  lang=3Den-us><FONT face=3DArial size=3D2>'</FONT></SPAN><SPAN=20
  lang=3Den-us></SPAN><SPAN lang=3Den-us><FONT face=3DArial size=3D2>t =
the=20
  cause.</FONT></SPAN></P>
  <P align=3Dleft><SPAN lang=3Den-us><FONT face=3DArial size=3D2>The =
only way to get=20
  back swap space is to boot the server.</FONT></SPAN><SPAN=20
  lang=3Den-us></SPAN><SPAN lang=3Den-us></SPAN></P>
  <P align=3Dleft><B><SPAN lang=3Den-us></SPAN></B><A =
name=3D""><B><SPAN=20
  lang=3Den-us><FONT face=3D"Arial Narrow" color=3D#ff0000>Cheryl=20
  King</FONT></SPAN></B></A></P>
  <P align=3Dleft><B><SPAN lang=3Den-us><FONT face=3D"Arial Narrow" =
color=3D#808080=20
  size=3D1>System Administrator II</FONT></SPAN></B></P>
  <P align=3Dleft><B><SPAN lang=3Den-us><FONT face=3D"Arial Narrow" =
size=3D1>AIS -=20
  OpenView System and Servers Certified</FONT></SPAN></B></P>
  <P align=3Dleft><B><SPAN lang=3Den-us><FONT face=3D"Arial Narrow"=20
  color=3D#ff0000>Intrado Inc.</FONT></SPAN></B></P>
  <P align=3Dleft><SPAN lang=3Den-us><FONT face=3D"Arial Narrow" =
color=3D#808080=20
  size=3D1>1601 Dry Creek Drive</FONT></SPAN></P>
  <P align=3Dleft><SPAN lang=3Den-us><FONT face=3D"Arial Narrow" =
color=3D#808080=20
  size=3D1>Longmont, CO 80503</FONT></SPAN></P>
  <P align=3Dleft><I><SPAN lang=3Den-us><FONT face=3D"Arial Narrow" =
color=3D#808080=20
  size=3D1>direct: 720.864.5162</FONT></SPAN></I></P>
  <P align=3Dleft><I><SPAN lang=3Den-us><FONT face=3D"Arial Narrow" =
color=3D#808080=20
  size=3D1>mobile: 720.840.4786</FONT></SPAN></I></P>
  <P align=3Dleft><I><SPAN lang=3Den-us><FONT face=3D"Arial Narrow" =
color=3D#808080=20
  size=3D1>page:&nbsp; 303-207-4648</FONT></SPAN></I></P>
  <P align=3Dleft><I><SPAN lang=3Den-us><FONT face=3D"Arial Narrow" =
color=3D#808080=20
  size=3D1>fax: 720.494.6600</FONT></SPAN></I></P>
  <P align=3Dleft><I><SPAN lang=3Den-us><FONT face=3D"Arial Narrow" =
color=3D#808080=20
  size=3D1>email: cheryl.king AT intrado DOT com</FONT></SPAN></I><SPAN=20
  lang=3Den-us></SPAN><SPAN lang=3Den-us></SPAN><SPAN =
lang=3Den-us></SPAN></P>
  <P align=3Dleft><B><SPAN lang=3Den-us><FONT face=3D"Arial Narrow"=20
  color=3D#ff0000>Intrado Inc.</FONT></SPAN></B></P>
  <P align=3Dleft><SPAN lang=3Den-us></SPAN><A =
href=3D"file://www.intrado.com"><SPAN=20
  lang=3Den-us><B></B></SPAN><SPAN =
lang=3Den-us><B><U></U></B></SPAN><B><U><SPAN=20
  lang=3Den-us><FONT face=3D"Arial Narrow" color=3D#0000ff=20
  size=3D1>www.intrado.com</FONT></SPAN></U></B><SPAN =
lang=3Den-us></SPAN></A><SPAN=20
  lang=3Den-us><B></B></SPAN><SPAN =
lang=3Den-us><B><U></U></B></SPAN><B><U><SPAN=20
  lang=3Den-us><FONT face=3D"Arial Narrow" color=3D#0000ff size=3D1>=20
  </FONT></SPAN></U></B></P>
  <P align=3Dleft><B><SPAN lang=3Den-us><FONT=20
size=3D1>ATTENTION:</FONT></SPAN></B></P>
  <P align=3Dleft><SPAN lang=3Den-us><FONT face=3DArial size=3D1>The =
information=20
  contained in this electronic message and any attachments to this =
message are=20
  intended for the exclusive use of the addressee(s) and may contain=20
  confidential or privileged information. If you are not the intended =
recipient,=20
  please notify Intrado Inc. immediately at 720.494.5800 and destroy =
all copies=20
  of this message and any attachments.</FONT></SPAN></P><BR>
  <P align=3Dleft><SPAN =
lang=3Den-us></SPAN></P></BLOCKQUOTE></BODY></HTML>

------_=_NextPart_001_01C6071A.517D6CFB--

<Prev in Thread] Current Thread [Next in Thread>
  • [Veritas-bu] running out of memory on Solaris 8 master server s, Mark.Donaldson AT cexp DOT com <=