Veritas-bu

[Veritas-bu] backing up LARGE oracle databases (looking for suggestions)

2005-01-27 17:59:29
Subject: [Veritas-bu] backing up LARGE oracle databases (looking for suggestions)
From: MDobbertien AT tribune DOT com (Dobbertien, Matthew)
Date: Thu, 27 Jan 2005 16:59:29 -0600
This is a multi-part message in MIME format.

------_=_NextPart_001_01C504C3.DB810784
Content-Type: text/plain;
        charset="us-ascii"
Content-Transfer-Encoding: quoted-printable

I don't necessarily have any good suggestions, but we have a similar
issue and are hoping to find some resolution.  We currently have a 600
GB database that is expected to grow to over 2 TB in the near future.
We are trying to plan for the additional capacity and make the users
aware of timeframes for backups.  Currently we are backing up over Gb
Ethernet, which seems to max out at about 60-70 MB/s, even in vendor
(Sun) tests.  This is barely enough to maximize throughput on 1 LTO2
drive, taking into account compression.  We are currently writing to 2
LTO2 drives with an L700e library (8 total LTO2 drives, soon to be 10).
We also have a large VTL (about 50 TB), which is not yet installed,
which will serve as the primary location for backups. =20

=20

Right now, the chokepoint is the GigE connections.  I'd like to be able
to use snapshots to backup the data directly to tape, but there doesn't
seem to be a good way to manage the snaphshot process using Netbackup
with Clariion arrays.  We also considered making the servers SAN media
servers, but since these applications reside on a Sun15k, the cost is
prohibitive, and the extra complexity of having to involve the system
owners for backup maintenance is not desired. =20

=20

Any comments on expected backup speed, methods of improving backup speed
for large backups (I understand that the world record is 2 TB an hour,
but I don't think that we can achieve that in our environment) and any
other information would be helpful.  If you could convince the database
owners to use RMAN, that would help as well, but I'm not going to
address that now.

=20

Matthew Dobbertien
Sr. Systems Analyst
Chicago Tribune



  _____ =20

From: veritas-bu-admin AT mailman.eng.auburn DOT edu
[mailto:veritas-bu-admin AT mailman.eng.auburn DOT edu] On Behalf Of Rob Haig
Sent: Thursday, January 27, 2005 10:14 AM
To: veritas-bu AT mailman.eng.auburn DOT edu
Subject: [Veritas-bu] backing up LARGE oracle databases (looking for
suggestions)

=20

So I'm trying to wrap my head around this problem.  I'm backing up a 4TB
oracle database with 4 LTO2 drives, connected to the server via 1GB
Ethernet.  That's not that bad of a problem.  RMAN, lvl0 backups twice a
week, plus daily lvl1 backups plus archive logs.  However, when you
throw into the mix that I have 20 of these servers (4TB is the average
DB size, they very from about 200G to 7TB) to back up, it gets more
interesting.  I'll be able to spend money eventually, but not right now.
My eventual plan is a few fully populated SL500 libraries with 4 drives
each.  In the final plan, I'd like to have 8 drives each library and
about 150TB of SAN in between the DB servers and tape drives with
serverless backup from the SAN to tape.  Or, a big honkin' virtual tape
library full of disks that can do serverless backup and has several SAN
connections. =20

=20

But right now, I'm limited to 2, maybe 3, 2-drive LTO2 changers with
enough slots to back up about 8TB of data each before I have to shuffle
out full tapes.  I've been pounding my head on this problem for a few
days now and every time I think I have it sorted out so it's not that
bad, I remember that I have 20 of these databases.

=20

Anyone have any suggestions?

=20

--=20

Rob


------_=_NextPart_001_01C504C3.DB810784
Content-Type: text/html;
        charset="us-ascii"
Content-Transfer-Encoding: quoted-printable

<html xmlns:v=3D"urn:schemas-microsoft-com:vml" =
xmlns:o=3D"urn:schemas-microsoft-com:office:office" =
xmlns:w=3D"urn:schemas-microsoft-com:office:word" =
xmlns:st1=3D"urn:schemas-microsoft-com:office:smarttags" =
xmlns=3D"http://www.w3.org/TR/REC-html40";>

<head>
<meta http-equiv=3DContent-Type content=3D"text/html; =
charset=3Dus-ascii">
<meta name=3DGenerator content=3D"Microsoft Word 11 (filtered medium)">
<!--[if !mso]>
<style>
v\:* {behavior:url(#default#VML);}
o\:* {behavior:url(#default#VML);}
w\:* {behavior:url(#default#VML);}
.shape {behavior:url(#default#VML);}
</style>
<![endif]--><o:SmartTagType
 namespaceuri=3D"urn:schemas-microsoft-com:office:smarttags" =
name=3D"City"
 downloadurl=3D"http://www.5iamas-microsoft-com:office:smarttags"/>
<o:SmartTagType =
namespaceuri=3D"urn:schemas-microsoft-com:office:smarttags"
 name=3D"place" downloadurl=3D"http://www.5iantlavalamp.com/"/>
<!--[if !mso]>
<style>
st1\:*{behavior:url(#default#ieooui) }
</style>
<![endif]-->
<style>
<!--
 /* Font Definitions */
 @font-face
        {font-family:Tahoma;
        panose-1:2 11 6 4 3 5 4 4 2 4;}
 /* Style Definitions */
 p.MsoNormal, li.MsoNormal, div.MsoNormal
        {margin:0in;
        margin-bottom:.0001pt;
        font-size:12.0pt;
        font-family:"Times New Roman";}
a:link, span.MsoHyperlink
        {color:blue;
        text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
        {color:purple;
        text-decoration:underline;}
span.emailstyle17
        {font-family:Arial;
        color:windowtext;}
span.EmailStyle18
        {mso-style-type:personal-reply;
        font-family:Arial;
        color:navy;}
@page Section1
        {size:8.5in 11.0in;
        margin:1.0in 1.25in 1.0in 1.25in;}
div.Section1
        {page:Section1;}
-->
</style>

</head>

<body lang=3DEN-US link=3Dblue vlink=3Dpurple>

<div class=3DSection1>

<p class=3DMsoNormal><font size=3D2 color=3Dnavy face=3DArial><span =
style=3D'font-size:
10.0pt;font-family:Arial;color:navy'>I don&#8217;t necessarily have any =
good
suggestions, but we have a similar issue and are hoping to find some
resolution.&nbsp; We currently have a 600 GB database that is expected =
to grow
to over 2 TB in the near future.&nbsp; We are trying to plan for the =
additional
capacity and make the users aware of timeframes for backups.&nbsp; =
Currently we
are backing up over Gb Ethernet, which seems to max out at about 60-70 =
MB/s,
even in vendor (Sun) tests.&nbsp; This is barely enough to maximize =
throughput on
1 LTO2 drive, taking into account compression.&nbsp; We are currently =
writing
to 2 LTO2 drives with an L700e library (8 total LTO2 drives, soon to be
10).&nbsp; We also have a large VTL (about 50 TB), which is not yet =
installed, which
will serve as the primary location for backups.&nbsp; =
<o:p></o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 color=3Dnavy face=3DArial><span =
style=3D'font-size:
10.0pt;font-family:Arial;color:navy'><o:p>&nbsp;</o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 color=3Dnavy face=3DArial><span =
style=3D'font-size:
10.0pt;font-family:Arial;color:navy'>Right now, the chokepoint is the =
GigE
connections.&nbsp; I&#8217;d like to be able to use snapshots to backup =
the
data directly to tape, but there doesn&#8217;t seem to be a good way to =
manage
the snaphshot process using Netbackup with Clariion arrays.&nbsp; We =
also
considered making the servers SAN media servers, but since these =
applications
reside on a Sun15k, the cost is prohibitive, and the extra complexity of =
having
to involve the system owners for backup maintenance is not =
desired.&nbsp; <o:p></o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 color=3Dnavy face=3DArial><span =
style=3D'font-size:
10.0pt;font-family:Arial;color:navy'><o:p>&nbsp;</o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 color=3Dnavy face=3DArial><span =
style=3D'font-size:
10.0pt;font-family:Arial;color:navy'>Any comments on expected backup =
speed,
methods of improving backup speed for large backups (I understand that =
the
world record is 2 TB an hour, but I don&#8217;t think that we can =
achieve that
in our environment) and any other information would be helpful.&nbsp; If =
you
could convince the database owners to use RMAN, that would help as well, =
but I&#8217;m
not going to address that now.<o:p></o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 color=3Dnavy face=3DArial><span =
style=3D'font-size:
10.0pt;font-family:Arial;color:navy'><o:p>&nbsp;</o:p></span></font></p>

<div>

<p class=3DMsoNormal><font size=3D2 color=3Dnavy face=3DArial><span =
style=3D'font-size:
10.0pt;font-family:Arial;color:navy'>Matthew Dobbertien<br>
Sr. Systems Analyst<br>
<st1:City w:st=3D"on"><st1:place =
w:st=3D"on">Chicago</st1:place></st1:City> Tribune<br>
<br>
</span></font><o:p></o:p></p>

</div>

<div>

<div class=3DMsoNormal align=3Dcenter style=3D'text-align:center'><font =
size=3D3
face=3D"Times New Roman"><span style=3D'font-size:12.0pt'>

<hr size=3D2 width=3D"100%" align=3Dcenter tabindex=3D-1>

</span></font></div>

<p class=3DMsoNormal><b><font size=3D2 face=3DTahoma><span =
style=3D'font-size:10.0pt;
font-family:Tahoma;font-weight:bold'>From:</span></font></b><font =
size=3D2
face=3DTahoma><span style=3D'font-size:10.0pt;font-family:Tahoma'>
veritas-bu-admin AT mailman.eng.auburn DOT edu
[mailto:veritas-bu-admin AT mailman.eng.auburn DOT edu] <b><span =
style=3D'font-weight:
bold'>On Behalf Of </span></b>Rob Haig<br>
<b><span style=3D'font-weight:bold'>Sent:</span></b> Thursday, January =
27, 2005
10:14 AM<br>
<b><span style=3D'font-weight:bold'>To:</span></b> =
veritas-bu AT mailman.eng.auburn DOT edu<br>
<b><span style=3D'font-weight:bold'>Subject:</span></b> [Veritas-bu] =
backing up
LARGE oracle databases (looking for =
suggestions)</span></font><o:p></o:p></p>

</div>

<p class=3DMsoNormal><font size=3D3 face=3D"Times New Roman"><span =
style=3D'font-size:
12.0pt'><o:p>&nbsp;</o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>So I&#8217;m trying to wrap my head around this
problem.&nbsp; I&#8217;m backing up a 4TB oracle database with 4 LTO2 =
drives,
connected to the server via 1GB Ethernet.&nbsp; That&#8217;s not that =
bad of a
problem.&nbsp; RMAN, lvl0 backups twice a week, plus daily lvl1 backups =
plus
archive logs.&nbsp; However, when you throw into the mix that I have 20 =
of
these servers (4TB is the average DB size, they very from about 200G to =
7TB) to
back up, it gets more interesting.&nbsp; I&#8217;ll be able to spend =
money
eventually, but not right now.&nbsp; My eventual plan is a few fully =
populated
SL500 libraries with 4 drives each.&nbsp; In the final plan, I&#8217;d =
like to
have 8 drives each library and about 150TB of SAN in between the DB =
servers and
tape drives with serverless backup from the SAN to tape. &nbsp;Or, a big
honkin&#8217; virtual tape library full of disks that can do serverless =
backup
and has several SAN connections.&nbsp; </span></font><o:p></o:p></p>

<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>&nbsp;</span></font><o:p></o:p></p>

<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>But right now, I&#8217;m limited to 2, maybe 3, =
2-drive LTO2
changers with enough slots to back up about 8TB of data each before I =
have to
shuffle out full tapes.&nbsp; I&#8217;ve been pounding my head on this =
problem
for a few days now and every time I think I have it sorted out so =
it&#8217;s not
that bad, I remember that I have 20 of these =
databases.</span></font><o:p></o:p></p>

<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>&nbsp;</span></font><o:p></o:p></p>

<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>Anyone have any =
suggestions?</span></font><o:p></o:p></p>

<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>&nbsp;</span></font><o:p></o:p></p>

<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>-- </span></font><o:p></o:p></p>

<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>Rob</span></font><o:p></o:p></p>

</div>

</body>

</html>

------_=_NextPart_001_01C504C3.DB810784--