|
[Veritas-bu] slow rman backup performance: "bpsched is busy"
2003-11-14 21:17:53
This is a multi-part message in MIME format.
------=_NextPart_000_0047_01C3AADB.9EF9DA00
Content-Type: text/plain;
charset="us-ascii"
Content-Transfer-Encoding: 7bit
The RMAN backup slowness issue was traced to a parameter that the RMAN
script uses (format) when generating the backup piece name. The
settings caused NetBackup to scan all backup images on nbs-prod back to
1995. The production system took much longer than development to run
the backup because the retention policies for prod were much longer than
development. The problem was corrected by adding a "%t" option to the
end of the format string. Without this parameter, there will be
performance degradation as the NetBackup catalog grows in size.
The backup time on Thursday was reduced from last week's 13 hours down
to a normal 3.5 hours after the change was put in place.
-----Original Message-----
From: veritas-bu-admin AT mailman.eng.auburn DOT edu
[mailto:veritas-bu-admin AT mailman.eng.auburn DOT edu] On Behalf Of Charles L.
Harris
Sent: Friday, November 07, 2003 1:59 PM
To: veritas-bu AT mailman.eng.auburn DOT edu
Subject: [Veritas-bu] slow rman backup performance: "bpsched is busy"
We are running RMAN user directed backups and backing up oracle. The
client is an E10K running solaris 2.8. The netbackup master server is
running solaris 2.8. I am seeing the following error:
11:12:51.348 [4683] <2> log_client_queued: empty-main bpsched is busy
This is during an RMAN test scenario when no other backups are running.
Any ideas as to why bpsched is busy with no other clients being backed
up? Rman backups for the dev instance of oracle backup just fine from
another client. We just hit the bottleneck when the prod instance is
backed up on the production oracle server. The kernel parameters for
the master server are tuned to NetBackup recommendations.
Thanks,
Charles Harris
Jet Propulsion Laboratory
California Institute of Technology
Work: (818)393-5297
Email: charles.l.harris AT jpl.nasa DOT gov
------=_NextPart_000_0047_01C3AADB.9EF9DA00
Content-Type: text/html;
charset="us-ascii"
Content-Transfer-Encoding: quoted-printable
<html>
<head>
<META HTTP-EQUIV=3D"Content-Type" CONTENT=3D"text/html; =
charset=3Dus-ascii">
<meta name=3DGenerator content=3D"Microsoft Word 10 (filtered)">
<style>
<!--
/* Font Definitions */
@font-face
{font-family:Tahoma;
panose-1:2 11 6 4 3 5 4 4 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman";}
a:link, span.MsoHyperlink
{color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{color:purple;
text-decoration:underline;}
span.emailstyle17
{font-family:Arial;
color:windowtext;}
span.EmailStyle18
{font-family:Arial;
color:navy;}
@page Section1
{size:8.5in 11.0in;
margin:1.0in 1.25in 1.0in 1.25in;}
div.Section1
{page:Section1;}
-->
</style>
</head>
<body lang=3DEN-US link=3Dblue vlink=3Dpurple>
<div class=3DSection1>
<p class=3DMsoNormal><font size=3D2 color=3Dnavy face=3DArial><span =
style=3D'font-size:
10.0pt;font-family:Arial;color:navy'>The RMAN backup slowness issue was =
traced
to a parameter that the RMAN script uses (format) when generating the =
backup
piece name. The settings caused NetBackup to scan all backup =
images on nbs-prod
back to 1995. The production system took much longer than =
development to
run the backup because the retention policies for prod were much longer =
than
development. The problem was corrected by adding a
“%t” option to the end of the format string. Without =
this
parameter, there will be performance degradation as the NetBackup =
catalog grows
in size.</span></font></p>
<p class=3DMsoNormal><font size=3D2 color=3Dnavy face=3DArial><span =
style=3D'font-size:
10.0pt;font-family:Arial;color:navy'> </span></font></p>
<p class=3DMsoNormal><font size=3D2 color=3Dnavy face=3DArial><span =
style=3D'font-size:
10.0pt;font-family:Arial;color:navy'>The backup time on Thursday was =
reduced
from last week’s 13 hours down to a normal 3.5 hours after the =
change was
put in place.</span></font></p>
<p class=3DMsoNormal><font size=3D2 color=3Dnavy face=3DArial><span =
style=3D'font-size:
10.0pt;font-family:Arial;color:navy'> </span></font></p>
<p class=3DMsoNormal><font size=3D2 color=3Dnavy face=3DArial><span =
style=3D'font-size:
10.0pt;font-family:Arial;color:navy'> </span></font></p>
<p class=3DMsoNormal style=3D'margin-left:.5in'><font size=3D2 =
face=3DTahoma><span
style=3D'font-size:10.0pt;font-family:Tahoma'>-----Original =
Message-----<br>
<b><span style=3D'font-weight:bold'>From:</span></b>
veritas-bu-admin AT mailman.eng.auburn DOT edu =
[mailto:veritas-bu-admin AT mailman.eng.auburn DOT edu]
<b><span style=3D'font-weight:bold'>On Behalf Of </span></b>Charles L. =
Harris<br>
<b><span style=3D'font-weight:bold'>Sent:</span></b> </span></font><font =
size=3D2 face=3DTahoma><span =
style=3D'font-size:10.0pt;font-family:Tahoma'>Friday,
November 07, 2003</span></font><font size=3D2 face=3DTahoma><span
style=3D'font-size:10.0pt;font-family:Tahoma'> </span></font><font
size=3D2 face=3DTahoma><span =
style=3D'font-size:10.0pt;font-family:Tahoma'>1:59 PM</span></font><font
size=3D2 face=3DTahoma><span =
style=3D'font-size:10.0pt;font-family:Tahoma'><br>
<b><span style=3D'font-weight:bold'>To:</span></b>
veritas-bu AT mailman.eng.auburn DOT edu<br>
<b><span style=3D'font-weight:bold'>Subject:</span></b> [Veritas-bu] =
slow rman
backup performance: "bpsched is busy"</span></font></p>
<p class=3DMsoNormal style=3D'margin-left:.5in'><font size=3D3 =
face=3D"Times New Roman"><span
style=3D'font-size:12.0pt'> </span></font></p>
<p class=3DMsoNormal style=3D'margin-left:.5in'><font size=3D2 =
face=3DArial><span
style=3D'font-size:10.0pt;font-family:Arial'>We are running RMAN user =
directed
backups and backing up oracle. The client is an E10K running =
solaris
2.8. The netbackup master server is running solaris =
2.8. I am
seeing the following error:</span></font></p>
<p class=3DMsoNormal style=3D'margin-left:.5in'><font size=3D2 =
face=3DArial><span
style=3D'font-size:10.0pt;font-family:Arial'> </span></font></p>
<p class=3DMsoNormal style=3D'margin-left:.5in'><font size=3D2 =
face=3DArial><span
style=3D'font-size:10.0pt;font-family:Arial'>11:12:51.348 [4683] =
<2>
log_client_queued: empty-main bpsched is busy</span></font></p>
<p class=3DMsoNormal style=3D'margin-left:.5in'><font size=3D2 =
face=3DArial><span
style=3D'font-size:10.0pt;font-family:Arial'> </span></font></p>
<p class=3DMsoNormal style=3D'margin-left:.5in'><font size=3D2 =
face=3DArial><span
style=3D'font-size:10.0pt;font-family:Arial'> </span></font></p>
<p class=3DMsoNormal style=3D'margin-left:.5in'><font size=3D2 =
face=3DArial><span
style=3D'font-size:10.0pt;font-family:Arial'>This is during an RMAN test =
scenario
when no other backups are running. Any ideas as to why bpsched is =
busy
with no other clients being backed up? Rman backups for the dev =
instance
of oracle backup just fine from another client. We just hit the
bottleneck when the prod instance is backed up on the production oracle
server. The kernel parameters for the master server are tuned to =
NetBackup
recommendations.</span></font></p>
<p class=3DMsoNormal style=3D'margin-left:.5in'><font size=3D2 =
face=3DArial><span
style=3D'font-size:10.0pt;font-family:Arial'> </span></font></p>
<p class=3DMsoNormal style=3D'margin-left:.5in'><font size=3D2 =
face=3DArial><span
style=3D'font-size:10.0pt;font-family:Arial'>Thanks,</span></font></p>
<p class=3DMsoNormal style=3D'margin-left:.5in'><font size=3D2 =
face=3DArial><span
style=3D'font-size:10.0pt;font-family:Arial'>Charles =
Harris</span></font></p>
<p class=3DMsoNormal style=3D'margin-left:.5in'><font size=3D2 =
face=3DArial><span
style=3D'font-size:10.0pt;font-family:Arial'>Jet Propulsion =
Laboratory</span></font></p>
<p class=3DMsoNormal style=3D'margin-left:.5in'><font size=3D2 =
face=3DArial><span
style=3D'font-size:10.0pt;font-family:Arial'>California Institute of =
Technology</span></font></p>
<p class=3DMsoNormal style=3D'margin-left:.5in'><font size=3D2 =
face=3DArial><span
style=3D'font-size:10.0pt;font-family:Arial'>Work: =
(818)393-5297</span></font></p>
<p class=3DMsoNormal style=3D'margin-left:.5in'><font size=3D2 =
face=3DArial><span
style=3D'font-size:10.0pt;font-family:Arial'>Email: =
charles.l.harris AT jpl.nasa DOT gov</span></font></p>
</div>
</body>
</html>
------=_NextPart_000_0047_01C3AADB.9EF9DA00--
|
|
|
