Veritas-bu

[Veritas-bu] Recommended number for NUM_DATA_BUFFERS?

2005-10-12 13:36:03
Subject: [Veritas-bu] Recommended number for NUM_DATA_BUFFERS?
From: Mark.Donaldson AT cexp DOT com (Mark.Donaldson AT cexp DOT com)
Date: Wed, 12 Oct 2005 11:36:03 -0600
This message is in MIME format. Since your mail reader does not understand
this format, some or all of this message may not be legible.

------_=_NextPart_000_01C5CF52.D3B130C0
Content-Type: text/plain;
        charset="iso-8859-1"

The all-powerful document on tuning:

http://seer.support.veritas.com/docs/183702.htm

It tells you how to scan your bptm logs to see if your buffer settings are
adequate.


Attached is my script that parses the bptm logs to add up some of the wait
time numbers.  

It's not friendly.

Usage: policy_perf <policy_name> <logfile>

If you leave off the logfile, it defaults to today's logfile.  The policy
name is required.

-M


-----Original Message-----
From: veritas-bu-admin AT mailman.eng.auburn DOT edu
[mailto:veritas-bu-admin AT mailman.eng.auburn DOT edu]On Behalf Of Piszcz, 
Justin
Sent: Wednesday, October 12, 2005 11:23 AM
To: veritas-bu AT mailman.eng.auburn DOT edu
Subject: [Veritas-bu] Recommended number for NUM_DATA_BUFFERS?


On a box with 14GB of ram, mine is set to 32.
 
Would increasing this number to say 256 increase performance?
 
Justin.


------_=_NextPart_000_01C5CF52.D3B130C0
Content-Type: application/octet-stream;
        name="policy_perf"
Content-Transfer-Encoding: quoted-printable
Content-Disposition: attachment;
        filename="policy_perf"

#!/bin/ksh=0A=
=0A=
policy=3D$1=0A=
=0A=
today=3D`date +%m%d%y`=0A=
if [ -n "$2" ]=0A=
then =0A=
  LOGFILE=3D/usr/openv/netbackup/logs/bptm/`basename $2`=0A=
else=0A=
  LOGFILE=3D/usr/openv/netbackup/logs/bptm/log.$today=0A=
fi=0A=
=0A=
TMPFILEf=3D/tmp/`basename $0`.tmp.f=0A=
TMPFILEw=3D/tmp/`basename $0`.tmp.w=0A=
=0A=
[ -f $TMPFILEf ] && rm -f $TMPFILEf=0A=
[ -f $TMPFILEw ] && rm -f $TMPFILEw=0A=
=0A=
echo "## Gathering data.\c"=0A=
for item in `grep  "START BACKUP.*-cl $policy" $LOGFILE | awk '{print =
$2}' | sort -u | tr -dc "[0-9]\012" `=0A=
do=0A=
  echo ".\c"=0A=
  awk '$0~/\['$item'\]/ && $0~/fill_buffer.*waited.*empty/ {print =
$13+$16}' $LOGFILE >> $TMPFILEf=0A=
  awk '$0~/\['$item'\]/ && $0~/write_backup.*waited.*full/ {print =
$9+$12}' $LOGFILE  >> $TMPFILEw=0A=
done=0A=
echo "Done."=0A=
=0A=
echo "## Write to buffer waiting on available buffer:"=0A=
awk '{if (NR=3D=3D1){min=3D$1;max=3D$1;sum=3D$1;count=3D1} else =0A=
                {if($1<min){min=3D$1}=0A=
                 if($1>max){max=3D$1}=0A=
                 sum=3Dsum+$1 ; count++}} =0A=
      END {if (count>0){print "Min:", min," Avg:",int(sum/count+.5)," =
Max:",max, "with",count,"samples" } else {print "No Data Found."}}' =
$TMPFILEf=0A=
[ -f $TMPFILEf ] && rm -f $TMPFILEf=0A=
=0A=
echo "\n## Write to tape waiting on full buffer:"=0A=
awk '{if (NR=3D=3D1){min=3D$1;max=3D$1;sum=3D$1;count=3D1} else =0A=
                {if($1<min){min=3D$1}=0A=
                 if($1>max){max=3D$1}=0A=
                 sum=3Dsum+$1 ; count++}} =0A=
      END {if (count>0){print "Min:", min," Avg:",int(sum/count+.5)," =
Max:",max, "with",count,"samples"} else {print "No Data Found."}}' =
$TMPFILEw=0A=
[ -f $TMPFILEw ] && rm -f $TMPFILEw=0A=
=0A=
exit=0A=

------_=_NextPart_000_01C5CF52.D3B130C0--