Veritas-bu

[Veritas-bu] rman backups are slow

2006-03-22 07:02:45
Subject: [Veritas-bu] rman backups are slow
From: andrew.x.smith AT jpmchase DOT com (andrew.x.smith AT jpmchase DOT com)
Date: Wed, 22 Mar 2006 12:02:45 +0000
This is a multipart message in MIME format.
--=_alternative 00422DAA80257139_=
Content-Type: text/plain; charset="us-ascii"

As I've mentioned before, it is quite likely you will never achieve the 
same performance using RMAN API as you do backing up a filesystem (which 
is where the advanced client RMAN proxy backup comes in). However you 
could try using more and more channels until the you no longer see any 
performance increase.........






"Atif Munir" <atif76 AT gmail DOT com>
22/03/2006 11:56

 
        To:     "andrew.x.smith AT jpmchase DOT com" <andrew.x.smith AT 
jpmchase DOT com>
        cc:     veritas-bu AT mailman.eng.auburn DOT edu
        Subject:        Re: [Veritas-bu] rman backups are slow


Thanks for your reply.I have increased the channels and now the speed is 
70MB/sec but still it is not good enough.

As for FS backups i can achieve 100MB/sec.

For test backup i have turn the optimization on but for production i will 
keep it off and we are using crosscheck option to sync the catalog.

Regards,
atif

On 3/22/06, andrew.x.smith AT jpmchase DOT com <andrew.x.smith AT jpmchase DOT 
com > wrote:

Ok so your script is limiting your parallisms to 2, you could try adding 
more streams by adding in additional allocated channel commands. To run 
four streams you would do: 


ALLOCATE CHANNEL ch01 TYPE 'SBT_TAPE';
ALLOCATE CHANNEL ch02 TYPE 'SBT_TAPE'; 
ALLOCATE CHANNEL ch03 TYPE 'SBT_TAPE';
ALLOCATE CHANNEL ch04 TYPE 'SBT_TAPE'; 


Also FYI CONFIGURE BACKUP OPTIMIZATION ON; can cause data loss on your backups 
if you don't fully understand the 
implications of this. 

Use caution when enabling backup optimization if you use a media manager 
with its own internal expiration policy. Run CROSSCHECK periodically to 
synchronize the RMAN repository with the media manager. 
Otherwise, RMAN may skip backups due to optimization without recognizing 
that the media manager has discarded backups stored on tape.



But I really would recommend getting a good DBA to help you out with all 
of this.... 




"Atif Munir" < atif76 AT gmail DOT com> 
Sent by: veritas-bu-admin AT mailman.eng.auburn DOT edu 
22/03/2006 10:54 
        
        To:        "andrew.x.smith AT jpmchase DOT com" < andrew.x.smith AT 
jpmchase DOT com> 
        cc:        veritas-bu AT mailman.eng.auburn DOT edu 
        Subject:        Re: [Veritas-bu] rman backups are slow



RUN {
ALLOCATE CHANNEL ch01 TYPE 'SBT_TAPE';
ALLOCATE CHANNEL ch02 TYPE 'SBT_TAPE';
SEND 'NB_ORA_SERV=server-backup,NB_ORA_CLIENT=server';
BACKUP
   $BACKUP_TYPE
   FILESPERSET 20
   # recommended format
   FORMAT 'bk_%s_%p_%t'
   DATABASE;
   sql 'alter system archive log current';
RELEASE CHANNEL ch01;
RELEASE CHANNEL ch02;
# backup all archive logs
ALLOCATE CHANNEL ch01 TYPE 'SBT_TAPE';
ALLOCATE CHANNEL ch02 TYPE 'SBT_TAPE';
SEND 'NB_ORA_SERV=server-backup,NB_ORA_CLIENT=server';
BACKUP
  filesperset 20
  FORMAT 'al_%s_%p_%t'
  ARCHIVELOG ALL DELETE INPUT;
RELEASE CHANNEL ch01;
RELEASE CHANNEL ch02;
#
# Note: During the process of backing up the database, RMAN also backs up 
the
# control file.  This version of the control file does not contain the
# information about the current backup because "nocatalog" has been 
specified.
# To include the information about the current backup, the control file 
should
# be backed up as the last step of the RMAN section.  This step would not 
be
# necessary if we were using a recovery catalog.
#
ALLOCATE CHANNEL ch00 TYPE 'SBT_TAPE';
SEND 'NB_ORA_SERV=server-backup,NB_ORA_CLIENT=server';
BACKUP
   # recommended format
   FORMAT 'cntrl_%s_%p_%t'
   CURRENT CONTROLFILE;
RELEASE CHANNEL ch00;
}
EOF


On 3/22/06, andrew.x.smith AT jpmchase DOT com < andrew.x.smith AT jpmchase DOT 
com > wrote: 

This is moving into the realms of RMAN performance tuning so you may get 
better advise from an Oracle board on this. 
Your default settings look ok to me, you could try testing with different 
values for CONFIGURE DEVICE TYPE 'SBT_TAPE' PARALLELISM 4; to see which gives 
the best performance. Also all of the settings you 
provided can be overwritten by the RMAN script, can you post this too? 

 


"Atif Munir" < atif76 AT gmail DOT com> 
Sent by: veritas-bu-admin AT mailman.eng.auburn DOT edu 
22/03/2006 06:44 
        
       To:        veritas-bu AT mailman.eng.auburn DOT edu 
       cc:         
       Subject:        [Veritas-bu] rman backups are slow




I am unable to get more than 50MB/sec for rman backups. Although 
filesystem backups are running 100MB/sec.

Is there any conf changes required in the rman. I have rman setting like 
this.
=========================================================
RMAN> show all;

RMAN configuration parameters are:
CONFIGURE RETENTION POLICY TO REDUNDANCY 1; # default
CONFIGURE BACKUP OPTIMIZATION ON;
CONFIGURE DEFAULT DEVICE TYPE TO DISK; # default
CONFIGURE CONTROLFILE AUTOBACKUP ON;
CONFIGURE CONTROLFILE AUTOBACKUP FORMAT FOR DEVICE TYPE DISK TO '%F'; # 
default
CONFIGURE CONTROLFILE AUTOBACKUP FORMAT FOR DEVICE TYPE SBT_TAPE TO
'%F'; # default
CONFIGURE DEVICE TYPE DISK PARALLELISM 4;
CONFIGURE DEVICE TYPE 'SBT_TAPE' PARALLELISM 4;
CONFIGURE DATAFILE BACKUP COPIES FOR DEVICE TYPE DISK TO 1; # default
CONFIGURE DATAFILE BACKUP COPIES FOR DEVICE TYPE SBT_TAPE TO 1; # default
CONFIGURE ARCHIVELOG BACKUP COPIES FOR DEVICE TYPE DISK TO 1; # default
CONFIGURE ARCHIVELOG BACKUP COPIES FOR DEVICE TYPE SBT_TAPE TO 1; # 
default
CONFIGURE CHANNEL DEVICE TYPE 'SBT_TAPE' PARMS  "BLKSIZE=1048576";
CONFIGURE MAXSETSIZE TO UNLIMITED; # default
CONFIGURE SNAPSHOT CONTROLFILE NAME TO
'/oracle/product/9.2.0.4/dbs/snapcf_ebizprod.f'; # default

===================================================

_______________________________________________
Veritas-bu maillist  -  Veritas-bu AT mailman.eng.auburn DOT edu 
http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu 







--=_alternative 00422DAA80257139_=
Content-Type: text/html; charset="us-ascii"


<br><font size=2 face="sans-serif">As I've mentioned before, it is quite likely 
you will never achieve the same performance using RMAN API as you do backing up 
a filesystem (which is where the advanced client RMAN proxy backup comes in). 
However you could try using more and more channels until the you no longer see 
any performance increase.........</font>
<br>
<br>
<br>
<br>
<br>
<table width=100%>
<tr valign=top>
<td>
<td><font size=1 face="sans-serif"><b>&quot;Atif Munir&quot; &lt;atif76 AT 
gmail DOT com&gt;</b></font>
<p><font size=1 face="sans-serif">22/03/2006 11:56</font>
<br>
<td><font size=1 face="Arial">&nbsp; &nbsp; &nbsp; &nbsp; </font>
<br><font size=1 face="sans-serif">&nbsp; &nbsp; &nbsp; &nbsp; To: &nbsp; 
&nbsp; &nbsp; &nbsp;&quot;andrew.x.smith AT jpmchase DOT com&quot; 
&lt;andrew.x.smith AT jpmchase DOT com&gt;</font>
<br><font size=1 face="sans-serif">&nbsp; &nbsp; &nbsp; &nbsp; cc: &nbsp; 
&nbsp; &nbsp; &nbsp;veritas-bu AT mailman.eng.auburn DOT edu</font>
<br><font size=1 face="sans-serif">&nbsp; &nbsp; &nbsp; &nbsp; Subject: &nbsp; 
&nbsp; &nbsp; &nbsp;Re: [Veritas-bu] rman backups are slow</font></table>
<br>
<br>
<br><font size=3 face="Times New Roman">Thanks for your reply.I have increased 
the channels and now the speed is 70MB/sec but still it is not good enough.<br>
<br>
As for FS backups i can achieve 100MB/sec.<br>
<br>
For test backup i have turn the optimization on but for production i will keep 
it off and we are using crosscheck option to sync the catalog.<br>
<br>
Regards,<br>
atif<br>
</font>
<br><font size=3 face="Times New Roman">On 3/22/06, </font><a 
href=mailto:andrew.x.smith AT jpmchase DOT com><font size=3 color=blue 
face="Times New Roman"><b><u>andrew.x.smith AT jpmchase DOT 
com</u></b></font></a><font size=3 face="Times New Roman"> &lt;</font><a 
href=mailto:andrew.x.smith AT jpmchase DOT com><font size=3 color=blue 
face="Times New Roman"><u>andrew.x.smith AT jpmchase DOT com 
</u></font></a><font size=3 face="Times New Roman">&gt; wrote:</font>
<br><font size=2 face="sans-serif"><br>
Ok so your script is limiting your parallisms to 2, you could try adding more 
streams by adding in additional allocated channel commands. To run four streams 
you would do:</font><font size=3 face="Times New Roman"> </font>
<br><font size=3 face="Times New Roman"><br>
<br>
ALLOCATE CHANNEL ch01 TYPE 'SBT_TAPE';<br>
ALLOCATE CHANNEL ch02 TYPE 'SBT_TAPE'; </font>
<br><font size=3 face="Times New Roman">ALLOCATE CHANNEL ch03 TYPE 
'SBT_TAPE';<br>
ALLOCATE CHANNEL ch04 TYPE 'SBT_TAPE'; <br>
<br>
<br>
Also FYI </font><font size=2 face="Courier New">CONFIGURE BACKUP OPTIMIZATION 
ON;</font><font size=3 face="Times New Roman"> can cause data loss on your 
backups if you don't fully understand the implications of this. <br>
</font>
<table align=center>
<tr>
<td><font size=3 face="Times New Roman">Use caution when enabling backup 
optimization if you use a media manager with its own internal expiration 
policy. Run </font><font size=3 face="Courier New">CROSSCHECK</font><font 
size=3 face="Times New Roman"> periodically to synchronize the RMAN repository 
with the media manager. Otherwise, RMAN may skip backups due to optimization 
without recognizing that the media manager has discarded backups stored on 
tape.</font></table>
<br><font size=3 face="Times New Roman"><br>
<br>
<br>
But I really would recommend getting a good DBA to help you out with all of 
this.... <br>
<br>
<br>
</font>
<table width=100%>
<tr valign=top>
<td width=2%>
<td width=38%><font size=1 face="sans-serif"><b>&quot;Atif Munir&quot; 
&lt;</b></font><a href=mailto:atif76 AT gmail DOT com target=_blank><font 
size=1 color=blue face="sans-serif"><b><u> atif76 AT gmail DOT 
com</u></b></font></a><font size=1 face="sans-serif"><b>&gt;</b></font><font 
size=3 face="Times New Roman"> </font><font size=1 face="sans-serif"><br>
Sent by: </font><a href="mailto:veritas-bu-admin AT mailman.eng.auburn DOT edu" 
target=_blank><font size=1 color=blue face="sans-serif"><u>veritas-bu-admin AT 
mailman.eng.auburn DOT edu</u></font></a><font size=3 face="Times New Roman"> 
</font>
<p><font size=1 face="sans-serif">22/03/2006 10:54</font><font size=3 
face="Times New Roman"> </font>
<td width=59%><font size=1 face="Arial">&nbsp; &nbsp; &nbsp; &nbsp; 
</font><font size=1 face="sans-serif"><br>
 &nbsp; &nbsp; &nbsp; &nbsp;To: &nbsp; &nbsp; &nbsp; &nbsp;&quot;</font><a 
href=mailto:andrew.x.smith AT jpmchase DOT com target=_blank><font size=1 
color=blue face="sans-serif"><u>andrew.x.smith AT jpmchase DOT 
com</u></font></a><font size=1 face="sans-serif">&quot; &lt; </font><a 
href=mailto:andrew.x.smith AT jpmchase DOT com target=_blank><font size=1 
color=blue face="sans-serif"><u>andrew.x.smith AT jpmchase DOT 
com</u></font></a><font size=1 face="sans-serif">&gt;</font><font size=3 
face="Times New Roman"> </font><font size=1 face="sans-serif"><br>
 &nbsp; &nbsp; &nbsp; &nbsp;cc: &nbsp; &nbsp; &nbsp; &nbsp;</font><a 
href="mailto:veritas-bu AT mailman.eng.auburn DOT edu" target=_blank><font 
size=1 color=blue face="sans-serif"><u>veritas-bu AT mailman.eng.auburn DOT 
edu</u></font></a><font size=3 face="Times New Roman"> </font><font size=1 
face="sans-serif"><br>
 &nbsp; &nbsp; &nbsp; &nbsp;Subject: &nbsp; &nbsp; &nbsp; &nbsp;Re: 
[Veritas-bu] rman backups are slow</font></table>
<br><font size=3 face="Times New Roman"><br>
<br>
<br>
RUN {<br>
ALLOCATE CHANNEL ch01 TYPE 'SBT_TAPE';<br>
ALLOCATE CHANNEL ch02 TYPE 'SBT_TAPE';<br>
SEND 'NB_ORA_SERV=server-backup,NB_ORA_CLIENT=server';<br>
BACKUP<br>
 &nbsp; $BACKUP_TYPE<br>
 &nbsp; FILESPERSET 20<br>
 &nbsp; # recommended format<br>
 &nbsp; FORMAT 'bk_%s_%p_%t'<br>
 &nbsp; DATABASE;<br>
 &nbsp; sql 'alter system archive log current';<br>
RELEASE CHANNEL ch01;<br>
RELEASE CHANNEL ch02;<br>
# backup all archive logs<br>
ALLOCATE CHANNEL ch01 TYPE 'SBT_TAPE';<br>
ALLOCATE CHANNEL ch02 TYPE 'SBT_TAPE';<br>
SEND 'NB_ORA_SERV=server-backup,NB_ORA_CLIENT=server';<br>
BACKUP<br>
 &nbsp;filesperset 20<br>
 &nbsp;FORMAT 'al_%s_%p_%t'<br>
 &nbsp;ARCHIVELOG ALL DELETE INPUT;<br>
RELEASE CHANNEL ch01;<br>
RELEASE CHANNEL ch02;<br>
#<br>
# Note: During the process of backing up the database, RMAN also backs up 
the<br>
# control file. &nbsp;This version of the control file does not contain the<br>
# information about the current backup because &quot;nocatalog&quot; has been 
specified.<br>
# To include the information about the current backup, the control file 
should<br>
# be backed up as the last step of the RMAN section. &nbsp;This step would not 
be<br>
# necessary if we were using a recovery catalog.<br>
#<br>
ALLOCATE CHANNEL ch00 TYPE 'SBT_TAPE';<br>
SEND 'NB_ORA_SERV=server-backup,NB_ORA_CLIENT=server';<br>
BACKUP<br>
 &nbsp; # recommended format<br>
 &nbsp; FORMAT 'cntrl_%s_%p_%t'<br>
 &nbsp; CURRENT CONTROLFILE;<br>
RELEASE CHANNEL ch00;<br>
}<br>
EOF<br>
<br>
<br>
On 3/22/06, </font><a href=mailto:andrew.x.smith AT jpmchase DOT com 
target=_blank><font size=3 color=blue face="Times New 
Roman"><b><u>andrew.x.smith AT jpmchase DOT com</u></b></font></a><font size=3 
face="Times New Roman"> &lt;</font><a href=mailto:andrew.x.smith AT jpmchase 
DOT com target=_blank><font size=3 color=blue face="Times New Roman"><u> 
andrew.x.smith AT jpmchase DOT com </u></font></a><font size=3 face="Times New 
Roman">&gt; wrote: </font><font size=2 face="sans-serif"><br>
<br>
This is moving into the realms of RMAN performance tuning so you may get better 
advise from an Oracle board on this.</font><font size=3 face="Times New Roman"> 
</font><font size=2 face="sans-serif"><br>
Your default settings look ok to me, you could try testing with different 
values for </font><font size=2 face="Courier New">CONFIGURE DEVICE TYPE 
'SBT_TAPE' PARALLELISM 4;</font><font size=2 face="sans-serif"> to see which 
gives the best performance. Also all of the settings you provided can be 
overwritten by the RMAN script, can you post this too?</font><font size=3 
face="Times New Roman"> </font><font size=2 face="sans-serif"><br>
</font><font size=3 face="Times New Roman"><br>
 <br>
</font>
<table width=100%>
<tr valign=top>
<td width=2%>
<td width=48%><font size=1 face="sans-serif"><b>&quot;Atif Munir&quot; 
&lt;</b></font><a href=mailto:atif76 AT gmail DOT com target=_blank><font 
size=1 color=blue face="sans-serif"><u> <b>atif76 AT gmail DOT 
com</u></b></font></a><font size=1 face="sans-serif"><b>&gt;</b></font><font 
size=3 face="Times New Roman"> </font><font size=1 face="sans-serif"><br>
Sent by: </font><a href="mailto:veritas-bu-admin AT mailman.eng.auburn DOT edu" 
target=_blank><font size=1 color=blue face="sans-serif"><u>veritas-bu-admin AT 
mailman.eng.auburn DOT edu </u></font></a>
<p><font size=1 face="sans-serif">22/03/2006 06:44</font><font size=3 
face="Times New Roman"> </font>
<td width=48%><font size=1 face="Arial">&nbsp; &nbsp; &nbsp; &nbsp; 
</font><font size=1 face="sans-serif"><br>
 &nbsp; &nbsp; &nbsp; To: &nbsp; &nbsp; &nbsp; &nbsp;</font><a 
href="mailto:veritas-bu AT mailman.eng.auburn DOT edu" target=_blank><font 
size=1 color=blue face="sans-serif"><u>veritas-bu AT mailman.eng.auburn DOT edu 
</u></font></a><font size=1 face="sans-serif"><br>
 &nbsp; &nbsp; &nbsp; cc: &nbsp; &nbsp; &nbsp; &nbsp;</font><font size=3 
face="Times New Roman"> </font><font size=1 face="sans-serif"><br>
 &nbsp; &nbsp; &nbsp; Subject: &nbsp; &nbsp; &nbsp; &nbsp;[Veritas-bu] rman 
backups are slow</font></table>
<br><font size=3 face="Times New Roman"><br>
<br>
<br>
</font><font size=2 face="Courier New"><br>
I am unable to get more than 50MB/sec for rman backups. Although <br>
filesystem backups are running 100MB/sec.<br>
<br>
Is there any conf changes required in the rman. I have rman setting like 
this.<br>
=========================================================<br>
RMAN&gt; show all;<br>
<br>
RMAN configuration parameters are:<br>
CONFIGURE RETENTION POLICY TO REDUNDANCY 1; # default<br>
CONFIGURE BACKUP OPTIMIZATION ON;<br>
CONFIGURE DEFAULT DEVICE TYPE TO DISK; # default<br>
CONFIGURE CONTROLFILE AUTOBACKUP ON;<br>
CONFIGURE CONTROLFILE AUTOBACKUP FORMAT FOR DEVICE TYPE DISK TO '%F'; # 
default<br>
CONFIGURE CONTROLFILE AUTOBACKUP FORMAT FOR DEVICE TYPE SBT_TAPE TO<br>
'%F'; # default<br>
CONFIGURE DEVICE TYPE DISK PARALLELISM 4;<br>
CONFIGURE DEVICE TYPE 'SBT_TAPE' PARALLELISM 4;<br>
CONFIGURE DATAFILE BACKUP COPIES FOR DEVICE TYPE DISK TO 1; # default<br>
CONFIGURE DATAFILE BACKUP COPIES FOR DEVICE TYPE SBT_TAPE TO 1; # default<br>
CONFIGURE ARCHIVELOG BACKUP COPIES FOR DEVICE TYPE DISK TO 1; # default<br>
CONFIGURE ARCHIVELOG BACKUP COPIES FOR DEVICE TYPE SBT_TAPE TO 1; # default<br>
CONFIGURE CHANNEL DEVICE TYPE 'SBT_TAPE' PARMS 
&nbsp;&quot;BLKSIZE=1048576&quot;;<br>
CONFIGURE MAXSETSIZE TO UNLIMITED; # default<br>
CONFIGURE SNAPSHOT CONTROLFILE NAME TO<br>
'/oracle/product/9.2.0.4/dbs/snapcf_ebizprod.f'; # default<br>
<br>
===================================================</font><font size=3 
face="Times New Roman"><br>
</font><font size=2 face="Courier New"><br>
_______________________________________________<br>
Veritas-bu maillist &nbsp;- &nbsp;</font><a href="mailto:Veritas-bu AT 
mailman.eng.auburn DOT edu" target=_blank><font size=2 color=blue face="Courier 
New"><u>Veritas-bu AT mailman.eng.auburn DOT edu </u></font></a><font size=3 
color=blue face="Times New Roman"><u><br>
</u></font><a href="http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu"; 
target=_blank><font size=2 color=blue face="Courier 
New"><u>http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu 
</u></font></a><font size=3 face="Times New Roman"><br>
<br>
<br>
<br>
</font>
<br>
<br>
<br>
--=_alternative 00422DAA80257139_=--

<Prev in Thread] Current Thread [Next in Thread>