This message is in MIME format. Since your mail reader does not understand
this format, some or all of this message may not be legible.
------_=_NextPart_001_01C507A7.ED62FB84
Content-Type: text/plain;
charset="iso-8859-1"
We already have the CLEAN_IN_BACKGROUND link. We already compress our
images. We have few, if any, "infinity" retentions.
It appears we're doing everything "right." Nearly all of our retentions are
two weeks or two months, but there are thousands and not enough time in the
day to inventory them all.
I am unable to find documentation on the "bpimage" command, particularly
with respect to this "-cleanup" flag. Without official documentation as to
what the below command does, from Veritas, I cannot run it to see if it will
help.
-----Original Message-----
From: Dan Otto [mailto:Dan.Otto AT veritas DOT com]
Sent: Tuesday, January 25, 2005 4:51 PM
To: Kirsch, Mathew (Matt)
Subject: RE: [Veritas-bu] Non-destructive ways to reduce the size of the
Netbackup database ?
Before you start adding disk space, make sure the clean up is running thus
removing expired images-
Add this touch file-
# touch /usr/openv/netbackup/bin/CLEAN_IN_BACKGROUND
Run this in cron or manually and it should free any disk space taken up by
expired images.
# /usr/openv/netbackup/bin/admincmd/bpimage -cleanup -allclients
If you use retention periods of infinity, then look into catalog archiving
available in 4.5 FP3.
How NetBackup Database Cleanup happens.
The database clean up process is kicked off after every "scheduled run of
backups".
Definition of "scheduled run of backups" is the following:
1. The bpsched process is the process that "kicks off" backups.
2. Every 10 minutes (default value) bpsched wakes up and says "Is there
anything for me to do?"
3. If there is a backup scheduled, then bpsched creates a "work list". This
bpsched process is considered the "main bpsched"
4. When a work list is created, backups start happening. Main bpsched spawns
new bpsched processes to handle each job
in the work list
5. After 10 minutes, another bpsched process wakes up and says, are there
more backups for me to do?
6. If yes, that new bpsched process appends the found backup jobs to the
main bpsched process and then "goes away"
7. After another 10 minutes, another bpsched process wakes up and says "are
there more backups to do?"
8. If yes, # 6 happens again.
9. If no, the new bpsched goes away. When the main bpsched process finishes,
it then says "since I have no more backups
to run, it is time to clean the NetBackup database and it does so. The
status of this shows up in the All Log Entries
report.
Basically, by default, the cleanup process won't run if you have backups
running. If you extrapolate the above
and see that bpsched is constantly busy doing backups, then you see that it
has no free time to do the database
clean up. Thus, the clean up doesn't happen.
If there is nothing you can do about how busy you keep the bpsched process
(you must to your backups as scheduled), then
you can get the BM_0database clean up to run during your live backups.
# touch /usr/openv/netbackup/bin/CLEAN_IN_BACKGROUND
# /usr/openv/netbackup/bin/admincmd/bpimage -cleanup -allclients
That should tell the bpimage process to go ahead and clean up the database
even though NetBackup backups are still running
-----Original Message-----
From: veritas-bu-admin AT mailman.eng.auburn DOT edu
[mailto:veritas-bu-admin AT mailman.eng.auburn DOT edu] On Behalf Of Kirsch,
Mathew
(Matt)
Sent: Tuesday, January 25, 2005 11:41 AM
To: 'veritas-bu AT mailman.eng.auburn DOT edu'
Subject: [Veritas-bu] Non-destructive ways to reduce the size of the
Netbackup database ?
The volume on which we store our Netbackup database is edging closer and
closer to being completely full each week. Regular Netbackup database
backups helps some, but it's always a little bigger every day.
At the rate it's going, we're going to run critically short on space in the
next few weeks. We can expand the volume, but would rather not, because then
it's going to exceed the capacity of 1 tape.
Potentially what kinds of stuff can I clean up? Are there any settings I can
change, like on the retention of indexes or something?
<http://www.paetec.com/eSignature/shim.gif>
<http://www.paetec.com/eSignature/shim.gif>
<http://www.paetec.com/eSignature/shim.gif>
<http://www.paetec.com/eSignature/shim.gif>
<http://www.paetec.com/>
<http://www.paetec.com/eSignature/shim.gif>
<http://www.paetec.com/eSignature/My_PAETEC_signature_r3_c1.gif>
<http://www.paetec.com/eSignature/shim.gif>
<http://www.paetec.com/eSignature/shim.gif>
------_=_NextPart_001_01C507A7.ED62FB84
Content-Type: text/html;
charset="iso-8859-1"
<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.0 Transitional//EN">
<HTML><HEAD>
<META HTTP-EQUIV="Content-Type" CONTENT="text/html; charset=iso-8859-1">
<META content="MSHTML 6.00.2800.1476" name=GENERATOR>
<STYLE>@font-face {
font-family: Courier;
}
@font-face {
font-family: Tahoma;
}
@page Section1 {size: 8.5in 11.0in; margin: 1.0in 1.25in 1.0in 1.25in; }
P.MsoNormal {
FONT-SIZE: 12pt; MARGIN: 0in 0in 0pt; FONT-FAMILY: "Times New Roman"
}
LI.MsoNormal {
FONT-SIZE: 12pt; MARGIN: 0in 0in 0pt; FONT-FAMILY: "Times New Roman"
}
DIV.MsoNormal {
FONT-SIZE: 12pt; MARGIN: 0in 0in 0pt; FONT-FAMILY: "Times New Roman"
}
A:link {
COLOR: blue; TEXT-DECORATION: underline
}
SPAN.MsoHyperlink {
COLOR: blue; TEXT-DECORATION: underline
}
A:visited {
COLOR: blue; TEXT-DECORATION: underline
}
SPAN.MsoHyperlinkFollowed {
COLOR: blue; TEXT-DECORATION: underline
}
SPAN.EmailStyle17 {
COLOR: navy; FONT-FAMILY: Arial
}
DIV.Section1 {
page: Section1
}
</STYLE>
</HEAD>
<BODY lang=EN-US vLink=blue link=blue>
<DIV><FONT face=Arial color=#0000ff size=2>
<DIV><FONT face=Arial color=#0000ff size=2><SPAN class=513564014-31012005>We
already have the CLEAN_IN_BACKGROUND link. We already compress our images. We
have few, if any, "infinity" retentions.</SPAN></FONT></DIV>
<DIV><FONT face=Arial color=#0000ff size=2><SPAN
class=513564014-31012005></SPAN></FONT> </DIV>
<DIV><FONT face=Arial color=#0000ff size=2><SPAN class=513564014-31012005>It
appears we're doing everything "right." Nearly all of our retentions are two
weeks or two months, but there are thousands and not enough time in the day to
inventory them all.</SPAN></FONT></DIV>
<DIV><FONT face=Arial color=#0000ff size=2><SPAN
class=513564014-31012005></SPAN></FONT> </DIV>
<DIV><FONT face=Arial color=#0000ff size=2><SPAN class=513564014-31012005>I am
unable to find documentation on the "bpimage" command, particularly with
respect
to this "-cleanup" flag. Without official documentation as to what the below
command does, from Veritas, I cannot run it to see if it will
help.</SPAN></FONT></DIV></FONT></DIV>
<BLOCKQUOTE dir=ltr style="MARGIN-RIGHT: 0px">
<DIV class=OutlookMessageHeader dir=ltr align=left><FONT face=Tahoma
size=2>-----Original Message-----<BR><B>From:</B> Dan Otto
[mailto:Dan.Otto AT veritas DOT com]<BR><B>Sent:</B> Tuesday, January 25,
2005 4:51
PM<BR><B>To:</B> Kirsch, Mathew (Matt)<BR><B>Subject:</B> RE: [Veritas-bu]
Non-destructive ways to reduce the size of the Netbackup database
?<BR><BR></FONT></DIV>
<DIV class=Section1>
<P class=MsoNormal><FONT face=Courier size=2><SPAN
style="FONT-SIZE: 10pt; FONT-FAMILY: Courier">Before you start adding disk
space, make sure the clean up is running thus removing expired
images-</SPAN></FONT></P>
<P class=MsoNormal><FONT face=Courier size=2><SPAN
style="FONT-SIZE: 10pt; FONT-FAMILY: Courier">Add this touch
file-</SPAN></FONT></P>
<P class=MsoNormal><FONT face=Courier size=2><SPAN
style="FONT-SIZE: 10pt; FONT-FAMILY: Courier"># touch
/usr/openv/netbackup/bin/<B><SPAN
style="FONT-WEIGHT: bold">CLEAN_IN_BACKGROUND</SPAN></B></SPAN></FONT></P>
<P class=MsoNormal><FONT face=Courier size=2><SPAN
style="FONT-SIZE: 10pt; FONT-FAMILY: Courier">Run this in cron or manually
and
it should free any disk space taken up by expired images.<BR>#
/usr/openv/netbackup/bin/admincmd/<B><SPAN style="FONT-WEIGHT: bold">bpimage
-cleanup -allclients</SPAN></B><BR><BR></SPAN></FONT></P>
<P class=MsoNormal><FONT face=Courier size=2><SPAN
style="FONT-SIZE: 10pt; FONT-FAMILY: Courier">If you use retention periods of
infinity, then look into catalog archiving available in 4.5 FP3.
</SPAN></FONT></P>
<P class=MsoNormal><FONT face=Courier size=2><SPAN
style="FONT-SIZE: 10pt; FONT-FAMILY: Courier"></SPAN></FONT> </P>
<P class=MsoNormal><FONT face=Courier size=2><SPAN
style="FONT-SIZE: 10pt; FONT-FAMILY: Courier">How NetBackup Database Cleanup
happens.<BR>The database clean up process is kicked off after every
"scheduled
run of backups". <BR>Definition of "scheduled run of backups" is the
following:<BR>1. The bpsched process is the process that "kicks off"
backups.<BR>2. Every 10 minutes (default value) bpsched wakes up and says "Is
there anything for me to do?"<BR>3. If there is a backup scheduled, then
bpsched creates a "work list". This bpsched process is considered the "main
bpsched" <BR>4. When a work list is created, backups start happening. Main
bpsched spawns new bpsched processes to handle each job <BR>in the work
list<BR></SPAN></FONT><FONT face=Courier size=2><SPAN
style="FONT-SIZE: 10pt; FONT-FAMILY: Courier">5. After 10</SPAN></FONT><FONT
face=Courier size=2><SPAN style="FONT-SIZE: 10pt; FONT-FAMILY: Courier">
minutes, another bpsched process wakes up and says, are there more backups
for
me to do?<BR>6. If yes, that new bpsched process appends the found backup
jobs
to the main bpsched process and then "goes away"<BR>7. After another 10
minutes, another bpsched process wakes up and says "are there more backups to
do?"<BR>8. If yes, # 6 happens again.<BR>9. If no, the new bpsched goes away.
When the main bpsched process finishes, it then says "since I have no more
backups<BR>to run, it is time to clean the NetBackup database and it does so.
The status of this shows up in the All Log Entries<BR>report.<BR>Basically,
by
default, the cleanup process won't run if you have backups running. If you
extrapolate the above <BR>and see that bpsched is constantly busy doing
backups, then you see that it has no free time to do the database <BR>clean
up. Thus, the clean up doesn't happen.<BR>If there is nothing you can do
about
how busy you keep the bpsched process (you must to your backups as
scheduled),
then<BR>you can get the <A name=0></A>database clean up to run during your
live backups.<BR># touch /usr/openv/netbackup/bin/CLEAN_IN_BACKGROUND<BR>#
/usr/openv/netbackup/bin/admincmd/bpimage -cleanup -allclients<BR>That should
tell the bpimage process to go ahead and clean up the database even though
NetBackup backups are still running</SPAN></FONT></P>
<P class=MsoNormal><FONT face=Arial color=navy size=2><SPAN
style="FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY:
Arial"></SPAN></FONT> </P>
<P class=MsoNormal style="MARGIN-LEFT: 0.5in"><FONT face=Tahoma size=2><SPAN
style="FONT-SIZE: 10pt; FONT-FAMILY: Tahoma">-----Original
Message-----<BR><B><SPAN style="FONT-WEIGHT: bold">From:</SPAN></B>
veritas-bu-admin AT mailman.eng.auburn DOT edu
[mailto:veritas-bu-admin AT mailman.eng.auburn DOT edu] <B><SPAN
style="FONT-WEIGHT: bold">On Behalf Of </SPAN></B>Kirsch, Mathew
(Matt)<BR><B><SPAN style="FONT-WEIGHT: bold">Sent:</SPAN></B>
</SPAN></FONT><FONT face=Tahoma size=2><SPAN
style="FONT-SIZE: 10pt; FONT-FAMILY: Tahoma">Tuesday, January 25,
2005</SPAN></FONT><FONT face=Tahoma size=2><SPAN
style="FONT-SIZE: 10pt; FONT-FAMILY: Tahoma"> </SPAN></FONT><FONT face=Tahoma
size=2><SPAN style="FONT-SIZE: 10pt; FONT-FAMILY: Tahoma">11:41
AM</SPAN></FONT><FONT face=Tahoma size=2><SPAN
style="FONT-SIZE: 10pt; FONT-FAMILY: Tahoma"><BR><B><SPAN
style="FONT-WEIGHT: bold">To:</SPAN></B>
'veritas-bu AT mailman.eng.auburn DOT edu'<BR><B><SPAN
style="FONT-WEIGHT: bold">Subject:</SPAN></B> [Veritas-bu] Non-destructive
ways to reduce the size of the Netbackup database ?</SPAN></FONT></P>
<P class=MsoNormal style="MARGIN-LEFT: 0.5in"><FONT face="Times New Roman"
size=3><SPAN style="FONT-SIZE: 12pt"></SPAN></FONT> </P>
<DIV>
<P class=MsoNormal style="MARGIN-LEFT: 0.5in"><FONT face=Arial size=2><SPAN
style="FONT-SIZE: 10pt; FONT-FAMILY: Arial">The volume on which we store
our Netbackup database is edging closer and closer to being completely full
each week. Regular Netbackup database backups helps some, but it's always a
little bigger every day. </SPAN></FONT></P></DIV>
<DIV>
<P class=MsoNormal style="MARGIN-LEFT: 0.5in"><FONT face="Times New Roman"
size=3><SPAN style="FONT-SIZE: 12pt"></SPAN></FONT> </P></DIV>
<DIV>
<P class=MsoNormal style="MARGIN-LEFT: 0.5in"><FONT face=Arial size=2><SPAN
style="FONT-SIZE: 10pt; FONT-FAMILY: Arial">At the rate it's going, we're
going to run critically short on space in the next few weeks. We can
expand the volume, but would rather not, because then it's going to exceed
the
capacity of 1 tape.</SPAN></FONT></P></DIV>
<DIV>
<P class=MsoNormal style="MARGIN-LEFT: 0.5in"><FONT face="Times New Roman"
size=3><SPAN style="FONT-SIZE: 12pt"></SPAN></FONT> </P></DIV>
<DIV>
<P class=MsoNormal style="MARGIN-LEFT: 0.5in"><FONT face=Arial size=2><SPAN
style="FONT-SIZE: 10pt; FONT-FAMILY: Arial">Potentially what kinds of stuff
can I clean up? Are there any settings I can change, like on the retention of
indexes or something?</SPAN></FONT></P></DIV>
<P class=MsoNormal style="MARGIN-LEFT: 0.5in"><FONT face="Times New Roman"
size=3><SPAN style="FONT-SIZE: 12pt"></SPAN></FONT> </P><!--The
following section is an HTML table which reassembles the sliced image in a
browser.--><!--Copy the table section including the opening and closing table
tags, and paste the data where--><!--you want the reassembled image to appear
in the destination document. --><!-------------------------- BEGIN COPYING THE
TABLE HERE ----------------------------><!-- Image with table -->
<TABLE class=MsoNormalTable style="MARGIN-LEFT: 0.5in; WIDTH: 357pt"
cellSpacing=0 cellPadding=0 width=476 border=0>
<TBODY>
<TR><!-- Shim row, height 1. -->
<TD
style="PADDING-RIGHT: 0in; PADDING-LEFT: 0in; PADDING-BOTTOM: 0in;
PADDING-TOP: 0in">
<P class=MsoNormal><FONT face="Times New Roman" size=3><SPAN
style="FONT-SIZE: 12pt"></SPAN></FONT> </P></TD>
<TD
style="PADDING-RIGHT: 0in; PADDING-LEFT: 0in; PADDING-BOTTOM: 0in;
PADDING-TOP: 0in">
<P class=MsoNormal><FONT face="Times New Roman" size=3><SPAN
style="FONT-SIZE: 12pt"><IMG height=1
src="http://www.paetec.com/eSignature/shim.gif"; width=17 border=0
NOSEND="1"></SPAN></FONT></P></TD>
<TD
style="PADDING-RIGHT: 0in; PADDING-LEFT: 0in; PADDING-BOTTOM: 0in;
PADDING-TOP: 0in">
<P class=MsoNormal><FONT face="Times New Roman" size=3><SPAN
style="FONT-SIZE: 12pt"><IMG height=1
src="http://www.paetec.com/eSignature/shim.gif"; width=66 border=0
NOSEND="1"></SPAN></FONT></P></TD>
<TD
style="PADDING-RIGHT: 0in; PADDING-LEFT: 0in; PADDING-BOTTOM: 0in;
PADDING-TOP: 0in">
<P class=MsoNormal><FONT face="Times New Roman" size=3><SPAN
style="FONT-SIZE: 12pt"><IMG height=1
src="http://www.paetec.com/eSignature/shim.gif"; width=1 border=0
NOSEND="1"></SPAN></FONT></P></TD></TR>
<TR><!-- row 1 -->
<TD
style="PADDING-RIGHT: 0in; PADDING-LEFT: 0in; PADDING-BOTTOM: 0in;
PADDING-TOP: 0in">
<P class=MsoNormal><FONT face="Times New Roman" size=3><SPAN
style="FONT-SIZE: 12pt"></SPAN></FONT> </P></TD>
<TD
style="PADDING-RIGHT: 0in; PADDING-LEFT: 0in; PADDING-BOTTOM: 0in;
PADDING-TOP: 0in"
rowSpan=3>
<P class=MsoNormal><FONT face="Times New Roman" size=3><SPAN
style="FONT-SIZE: 12pt"></SPAN></FONT> </P></TD>
<TD
style="PADDING-RIGHT: 0in; PADDING-LEFT: 0in; PADDING-BOTTOM: 0in;
PADDING-TOP: 0in"
rowSpan=3><FONT face="Times New Roman" size=3><!-- Start Contact
Information --></FONT>
<P class=MsoNormal><FONT face="Times New Roman" size=3><SPAN
style="FONT-SIZE: 12pt"></SPAN></FONT> </P></TD>
<TD
style="PADDING-RIGHT: 0in; PADDING-LEFT: 0in; PADDING-BOTTOM: 0in;
PADDING-TOP: 0in">
<P class=MsoNormal><FONT face="Times New Roman" size=3><SPAN
style="FONT-SIZE: 12pt"><IMG height=12
src="http://www.paetec.com/eSignature/shim.gif"; width=1 border=0
NOSEND="1"></SPAN></FONT></P></TD></TR>
<TR><!-- row 2 -->
<TD
style="PADDING-RIGHT: 0in; PADDING-LEFT: 0in; PADDING-BOTTOM: 0in;
PADDING-TOP: 0in">
<P class=MsoNormal><FONT face="Times New Roman" size=3><SPAN
style="FONT-SIZE: 12pt"><A
href="http://www.paetec.com/";></A></SPAN></FONT></P></TD>
<TD
style="PADDING-RIGHT: 0in; PADDING-LEFT: 0in; PADDING-BOTTOM: 0in;
PADDING-TOP: 0in">
<P class=MsoNormal><FONT face="Times New Roman" size=3><SPAN
style="FONT-SIZE: 12pt"><IMG height=66
src="http://www.paetec.com/eSignature/shim.gif"; width=1 border=0
NOSEND="1"></SPAN></FONT></P></TD></TR>
<TR><!-- row 3 -->
<TD
style="PADDING-RIGHT: 0in; PADDING-LEFT: 0in; PADDING-BOTTOM: 0in;
PADDING-TOP: 0in">
<P class=MsoNormal><FONT face="Times New Roman" size=3><SPAN
style="FONT-SIZE: 12pt"><IMG height=12
src="http://www.paetec.com/eSignature/My_PAETEC_signature_r3_c1.gif";
width=155 border=0 name=My_PAETEC_signature_r3_c1
NOSEND="1"></SPAN></FONT></P></TD>
<TD
style="PADDING-RIGHT: 0in; PADDING-LEFT: 0in; PADDING-BOTTOM: 0in;
PADDING-TOP: 0in">
<P class=MsoNormal><FONT face="Times New Roman" size=3><SPAN
style="FONT-SIZE: 12pt"><IMG height=12
src="http://www.paetec.com/eSignature/shim.gif"; width=1 border=0
NOSEND="1"></SPAN></FONT></P></TD></TR></TBODY></TABLE>
<P class=MsoNormal style="MARGIN-LEFT: 0.5in"><FONT face="Times New Roman"
size=3><SPAN style="FONT-SIZE: 12pt"><IMG height=1
src="http://www.paetec.com/eSignature/shim.gif"; width=66 border=0
NOSEND="1"></SPAN></FONT></P><!--------------------------- STOP COPYING THE
TABLE HERE --------------------------->
<DIV>
<P class=MsoNormal style="MARGIN-LEFT: 0.5in"><FONT face="Times New Roman"
size=3><SPAN
style="FONT-SIZE:
12pt"></SPAN></FONT> </P></DIV></DIV></BLOCKQUOTE></BODY></HTML>
------_=_NextPart_001_01C507A7.ED62FB84--
|
![http://www.paetec.com/eSignature/shim.gif"](http://www.paetec.com/eSignature/shim.gif"){kind=link}
![http://www.paetec.com/eSignature/My_PAETEC_signature_r3_c1.gif"](http://www.paetec.com/eSignature/My_PAETEC_signature_r3_c1.gif"){kind=link}