Veritas-bu

[Veritas-bu] Remote Backup

2005-01-05 04:44:03
Subject: [Veritas-bu] Remote Backup
From: richard_hellier AT hotmail DOT com (Richard Hellier)
Date: Wed, 5 Jan 2005 09:44:03 -0000
This is a multi-part message in MIME format.

------=_NextPart_000_002F_01C4F30B.17A22A70
Content-Type: text/plain;
        charset="us-ascii"
Content-Transfer-Encoding: 7bit

David,

            Solution we use for remote sites is the (freeware) "rsync"
software to mirror the remote systems to dedicated partitions on a central
fileserver.  These partitions (along

With all the "local" ones) are backed up using NetBackup in the usual way.
Pipes to other sites vary (some are 2 Mbit/s leased lines, some use fast-ish
MPLS links). Adding a new site means creating a new partition to hold its
data, doing the initial "fill" (either over the WAN or by sending tapes) and
then just letting each days's "deltas" trickle in courtesy of rsync which is
smart enough to see "inside" files  and send only the changed *parts* of the
files. For example, a CSV file that's had another couple of rows added to it
would be regarded by N/B as a changed file (reasonably enough) and backed up
in its entirety by an incremental. Rsync, however, can just transmit the new
material (and add it to the mirrored copy).  The same thing happens for
files that have changed "in the middle", too.

 

Benefits:

 

1.      Restores (at least of "yesterday's" data) are fast since the files
in question can be copied back from the mirrored versions (i.e. no tapes are
involved).
2.      Don't need tape libraries + media servers etc at remote sites
3.      Don't need staff at remote sites (or have to ask favours of
non-admin staff)
4.      Achieve economies of scale by just having a large tape library at
the central location
5.      Only one off-site tape handler to deal with (big plus where
different countries / languages are involved, as in this case)
6.      Simpler overall "bookkeeping"
7.      Fewer N/B licences needed

 

Caveats:

1.      rsync does run on Windows but does not back up permissions / ACLs so
files can't be restored "faithfully" without some hand work.
2.      "Large" restores over the WAN will take time (but the "vanload of
tapes" is an option, too :-) )
3.      Care needs to be taken on the mirror partitions to ensure sufficient
room at all times (Veritas Volume Manager with its "resize on demand" helps
here)

 

OK - not a panacea, of course, but works for us!

 

Cheers,

 

Richard.

 

 

  _____  

From: veritas-bu-admin AT mailman.eng.auburn DOT edu
[mailto:veritas-bu-admin AT mailman.eng.auburn DOT edu] On Behalf Of David Chapa
Sent: 04 January 2005 16:22
To: veritas-bu AT mailman.eng.auburn DOT edu
Subject: [Veritas-bu] Remote Backup

 

How are most of you doing remote backup today?

 

Do you extend your SAN with a DWDM solution?  If so, what's the best product
out there for that?

 

Are you backing up across your WAN?  If so, how large of a pipe do you have?

 

OR 

 

Do you just have media servers in the remote sites and have a small staff
their taking care of the backup?

 

I know Mark Donaldson asked a similar question a while back, but I'm still
wrestling with the "best" solution.

 

Thanks

David A. Chapa | ADIC | 720.272.8452 cell |  <http://www.adic.com>
http://www.adic.com 
Sr. Technical Advisor 

Pathlight VX - http://www.adic.com/gopathlightvx

 

 

 


------=_NextPart_000_002F_01C4F30B.17A22A70
Content-Type: text/html;
        charset="us-ascii"
Content-Transfer-Encoding: quoted-printable

<html xmlns:v=3D"urn:schemas-microsoft-com:vml" =
xmlns:o=3D"urn:schemas-microsoft-com:office:office" =
xmlns:w=3D"urn:schemas-microsoft-com:office:word" =
xmlns=3D"http://www.w3.org/TR/REC-html40";>

<head>
<meta http-equiv=3DContent-Type content=3D"text/html; =
charset=3Dus-ascii">
<meta name=3DGenerator content=3D"Microsoft Word 11 (filtered medium)">
<!--[if !mso]>
<style>
v\:* {behavior:url(#default#VML);}
o\:* {behavior:url(#default#VML);}
w\:* {behavior:url(#default#VML);}
shape {behavior:url(#default#VML);}
</style>
<![endif]-->
<style>
<!--
 /* Font Definitions */
 @font-face
        {font-family:Wingdings;
        panose-1:5 0 0 0 0 0 0 0 0 0;}
@font-face
        {font-family:"MS Mincho";
        panose-1:2 2 6 9 4 2 5 8 3 4;}
@font-face
        {font-family:Tahoma;
        panose-1:2 11 6 4 3 5 4 4 2 4;}
@font-face
        {font-family:"Arial Black";
        panose-1:2 11 10 4 2 1 2 2 2 4;}
@font-face
        {font-family:"\@MS Mincho";}
 /* Style Definitions */
 p.MsoNormal, li.MsoNormal, div.MsoNormal
        {margin:0cm;
        margin-bottom:.0001pt;
        font-size:12.0pt;
        font-family:"Times New Roman";}
a:link, span.MsoHyperlink
        {color:blue;
        text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
        {color:purple;
        text-decoration:underline;}
p
        {mso-margin-top-alt:auto;
        margin-right:0cm;
        mso-margin-bottom-alt:auto;
        margin-left:0cm;
        font-size:12.0pt;
        font-family:"Times New Roman";}
span.NormalWebCharChar
        {font-family:"MS Mincho";}
span.StyleNormalWebLatinArialComplexArial75ptChar
        {font-family:Arial;}
p.StyleNormalWebLatinArialComplexArial75pt, =
li.StyleNormalWebLatinArialComplexArial75pt, =
div.StyleNormalWebLatinArialComplexArial75pt
        {mso-margin-top-alt:auto;
        margin-right:0cm;
        mso-margin-bottom-alt:auto;
        margin-left:0cm;
        font-size:7.5pt;
        font-family:Arial;}
p.StyleNormalWebLatinArialComplexArial75ptCxSpFirst, =
li.StyleNormalWebLatinArialComplexArial75ptCxSpFirst, =
div.StyleNormalWebLatinArialComplexArial75ptCxSpFirst
        {mso-style-type:export-only;
        mso-margin-top-alt:auto;
        margin-right:0cm;
        mso-margin-bottom-alt:auto;
        margin-left:0cm;
        font-size:7.5pt;
        font-family:Arial;}
p.StyleNormalWebLatinArialComplexArial75ptCxSpMiddle, =
li.StyleNormalWebLatinArialComplexArial75ptCxSpMiddle, =
div.StyleNormalWebLatinArialComplexArial75ptCxSpMiddle
        {mso-style-type:export-only;
        mso-margin-top-alt:auto;
        margin-right:0cm;
        mso-margin-bottom-alt:auto;
        margin-left:0cm;
        font-size:7.5pt;
        font-family:Arial;}
p.StyleNormalWebLatinArialComplexArial75ptCxSpLast, =
li.StyleNormalWebLatinArialComplexArial75ptCxSpLast, =
div.StyleNormalWebLatinArialComplexArial75ptCxSpLast
        {mso-style-type:export-only;
        mso-margin-top-alt:auto;
        margin-right:0cm;
        mso-margin-bottom-alt:auto;
        margin-left:0cm;
        font-size:7.5pt;
        font-family:Arial;}
span.EmailStyle21
        {mso-style-type:personal;
        font-family:Arial;
        color:windowtext;}
span.EmailStyle22
        {mso-style-type:personal-reply;
        font-family:Arial;
        color:navy;}
@page Section1
        {size:612.0pt 792.0pt;
        margin:72.0pt 90.0pt 72.0pt 90.0pt;}
div.Section1
        {page:Section1;}
 /* List Definitions */
 @list l0
        {mso-list-id:1383602795;
        mso-list-type:hybrid;
        mso-list-template-ids:1302900256 67698703 67698713 67698715 67698703 =
67698713 67698715 67698703 67698713 67698715;}
@list l0:level1
        {mso-level-tab-stop:36.0pt;
        mso-level-number-position:left;
        text-indent:-18.0pt;}
@list l1
        {mso-list-id:1529639900;
        mso-list-type:hybrid;
        mso-list-template-ids:69481640 67698703 67698713 67698715 67698703 =
67698713 67698715 67698703 67698713 67698715;}
@list l1:level1
        {mso-level-tab-stop:36.0pt;
        mso-level-number-position:left;
        text-indent:-18.0pt;}
ol
        {margin-bottom:0cm;}
ul
        {margin-bottom:0cm;}
-->
</style>

</head>

<body lang=3DEN-US link=3Dblue vlink=3Dpurple>

<div class=3DSection1>

<p class=3DMsoNormal><font size=3D2 color=3Dnavy face=3DArial><span =
style=3D'font-size:
10.0pt;font-family:Arial;color:navy'>David,<o:p></o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 color=3Dnavy face=3DArial><span =
style=3D'font-size:
10.0pt;font-family:Arial;color:navy'>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;=
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Solution
we use for remote sites is the (freeware) &#8220;rsync&#8221; software =
to
mirror the remote systems to dedicated partitions on a central
fileserver.&nbsp; These partitions (along<o:p></o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 color=3Dnavy face=3DArial><span =
style=3D'font-size:
10.0pt;font-family:Arial;color:navy'>With all the &#8220;local&#8221; =
ones) are
backed up using NetBackup in the usual way.&nbsp; Pipes to other sites =
vary
(some are 2 Mbit/s leased lines, some use fast-ish MPLS links). Adding a =
new
site means creating a new partition to hold its data, doing the initial =
&#8220;fill&#8221;
(either over the WAN or by sending tapes) and then just letting each =
days&#8217;s
&#8220;deltas&#8221; trickle in courtesy of rsync which is smart enough =
to see &#8220;inside&#8221;
files&nbsp; and send only the changed *<b><span =
style=3D'font-weight:bold'>parts</span></b>*
of the files. For example, a CSV file that&#8217;s had another couple of =
rows
added to it would be regarded by N/B as a changed file (reasonably =
enough) and
backed up in its entirety by an incremental. Rsync, however, can just =
transmit
the new material (and add it to the mirrored copy).&nbsp; The same thing
happens for files that have changed &#8220;in the middle&#8221;, =
too.<o:p></o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 color=3Dnavy face=3DArial><span =
style=3D'font-size:
10.0pt;font-family:Arial;color:navy'><o:p>&nbsp;</o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 color=3Dnavy face=3DArial><span =
style=3D'font-size:
10.0pt;font-family:Arial;color:navy'>Benefits:<o:p></o:p></span></font></=
p>

<p class=3DMsoNormal><font size=3D2 color=3Dnavy face=3DArial><span =
style=3D'font-size:
10.0pt;font-family:Arial;color:navy'><o:p>&nbsp;</o:p></span></font></p>

<ol style=3D'margin-top:0cm' start=3D1 type=3D1>
 <li class=3DMsoNormal style=3D'color:navy;mso-list:l0 level1 =
lfo1'><font size=3D2
     color=3Dnavy face=3DArial><span =
style=3D'font-size:10.0pt;font-family:Arial'>Restores
     (at least of &#8220;yesterday&#8217;s&#8221; data) are fast since =
the
     files in question can be copied back from the mirrored versions =
(i.e. no
     tapes are involved).<o:p></o:p></span></font></li>
 <li class=3DMsoNormal style=3D'color:navy;mso-list:l0 level1 =
lfo1'><font size=3D2
     color=3Dnavy face=3DArial><span =
style=3D'font-size:10.0pt;font-family:Arial'>Don&#8217;t
     need tape libraries + media servers etc at remote =
sites<o:p></o:p></span></font></li>
 <li class=3DMsoNormal style=3D'color:navy;mso-list:l0 level1 =
lfo1'><font size=3D2
     color=3Dnavy face=3DArial><span =
style=3D'font-size:10.0pt;font-family:Arial'>Don&#8217;t
     need staff at remote sites (or have to ask favours of non-admin =
staff)<o:p></o:p></span></font></li>
 <li class=3DMsoNormal style=3D'color:navy;mso-list:l0 level1 =
lfo1'><font size=3D2
     color=3Dnavy face=3DArial><span =
style=3D'font-size:10.0pt;font-family:Arial'>Achieve
     economies of scale by just having a large tape library at the =
central
     location<o:p></o:p></span></font></li>
 <li class=3DMsoNormal style=3D'color:navy;mso-list:l0 level1 =
lfo1'><font size=3D2
     color=3Dnavy face=3DArial><span =
style=3D'font-size:10.0pt;font-family:Arial'>Only
     one off-site tape handler to deal with (big plus where different =
countries
     / languages are involved, as in this =
case)<o:p></o:p></span></font></li>
 <li class=3DMsoNormal style=3D'color:navy;mso-list:l0 level1 =
lfo1'><font size=3D2
     color=3Dnavy face=3DArial><span =
style=3D'font-size:10.0pt;font-family:Arial'>Simpler
     overall &#8220;bookkeeping&#8221;<o:p></o:p></span></font></li>
 <li class=3DMsoNormal style=3D'color:navy;mso-list:l0 level1 =
lfo1'><font size=3D2
     color=3Dnavy face=3DArial><span =
style=3D'font-size:10.0pt;font-family:Arial'>Fewer
     N/B licences needed<o:p></o:p></span></font></li>
</ol>

<p class=3DMsoNormal><font size=3D2 color=3Dnavy face=3DArial><span =
style=3D'font-size:
10.0pt;font-family:Arial;color:navy'><o:p>&nbsp;</o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 color=3Dnavy face=3DArial><span =
style=3D'font-size:
10.0pt;font-family:Arial;color:navy'>Caveats:<o:p></o:p></span></font></p=
>

<ol style=3D'margin-top:0cm' start=3D1 type=3D1>
 <li class=3DMsoNormal style=3D'color:navy;mso-list:l1 level1 =
lfo2'><font size=3D2
     color=3Dnavy face=3DArial><span =
style=3D'font-size:10.0pt;font-family:Arial'>rsync
     does run on Windows but does not back up permissions / ACLs so =
files can&#8217;t
     be restored &#8220;faithfully&#8221; without some hand =
work.<o:p></o:p></span></font></li>
 <li class=3DMsoNormal style=3D'color:navy;mso-list:l1 level1 =
lfo2'><font size=3D2
     color=3Dnavy face=3DArial><span =
style=3D'font-size:10.0pt;font-family:Arial'>&#8220;Large&#8221;
     restores over the WAN will take time (but the &#8220;vanload of =
tapes&#8221;
     is an option, too </span></font><font size=3D2 =
face=3DWingdings><span
     =
style=3D'font-size:10.0pt;font-family:Wingdings'>J</span></font><font
     size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;font-family:Arial'> =
)<o:p></o:p></span></font></li>
 <li class=3DMsoNormal style=3D'color:navy;mso-list:l1 level1 =
lfo2'><font size=3D2
     color=3Dnavy face=3DArial><span =
style=3D'font-size:10.0pt;font-family:Arial'>Care
     needs to be taken on the mirror partitions to ensure sufficient =
room at
     all times (Veritas Volume Manager with its &#8220;resize on =
demand&#8221;
     helps here)<o:p></o:p></span></font></li>
</ol>

<p class=3DMsoNormal><font size=3D2 color=3Dnavy face=3DArial><span =
style=3D'font-size:
10.0pt;font-family:Arial;color:navy'><o:p>&nbsp;</o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 color=3Dnavy face=3DArial><span =
style=3D'font-size:
10.0pt;font-family:Arial;color:navy'>OK &#8211; not a panacea, of =
course, but
works for us!<o:p></o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 color=3Dnavy face=3DArial><span =
style=3D'font-size:
10.0pt;font-family:Arial;color:navy'><o:p>&nbsp;</o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 color=3Dnavy face=3DArial><span =
style=3D'font-size:
10.0pt;font-family:Arial;color:navy'>Cheers,<o:p></o:p></span></font></p>=


<p class=3DMsoNormal><font size=3D2 color=3Dnavy face=3DArial><span =
style=3D'font-size:
10.0pt;font-family:Arial;color:navy'><o:p>&nbsp;</o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 color=3Dnavy face=3DArial><span =
style=3D'font-size:
10.0pt;font-family:Arial;color:navy'>Richard.<o:p></o:p></span></font></p=
>

<p class=3DMsoNormal><font size=3D2 color=3Dnavy face=3DArial><span =
style=3D'font-size:
10.0pt;font-family:Arial;color:navy'><o:p>&nbsp;</o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 color=3Dnavy face=3DArial><span =
style=3D'font-size:
10.0pt;font-family:Arial;color:navy'><o:p>&nbsp;</o:p></span></font></p>

<div>

<div class=3DMsoNormal align=3Dcenter style=3D'text-align:center'><font =
size=3D3
face=3D"Times New Roman"><span style=3D'font-size:12.0pt'>

<hr size=3D2 width=3D"100%" align=3Dcenter tabindex=3D-1>

</span></font></div>

<p class=3DMsoNormal><b><font size=3D2 face=3DTahoma><span =
style=3D'font-size:10.0pt;
font-family:Tahoma;font-weight:bold'>From:</span></font></b><font =
size=3D2
face=3DTahoma><span style=3D'font-size:10.0pt;font-family:Tahoma'>
veritas-bu-admin AT mailman.eng.auburn DOT edu
[mailto:veritas-bu-admin AT mailman.eng.auburn DOT edu] <b><span =
style=3D'font-weight:
bold'>On Behalf Of </span></b>David Chapa<br>
<b><span style=3D'font-weight:bold'>Sent:</span></b> 04 January 2005 =
16:22<br>
<b><span style=3D'font-weight:bold'>To:</span></b>
veritas-bu AT mailman.eng.auburn DOT edu<br>
<b><span style=3D'font-weight:bold'>Subject:</span></b> [Veritas-bu] =
Remote
Backup</span></font><o:p></o:p></p>

</div>

<p class=3DMsoNormal><font size=3D3 face=3D"Times New Roman"><span =
style=3D'font-size:
12.0pt'><o:p>&nbsp;</o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>How are most of you doing remote backup =
today?<o:p></o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'><o:p>&nbsp;</o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>Do you extend your SAN with a DWDM solution?&nbsp; If =
so,
what&#8217;s the best product out there for =
that?<o:p></o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'><o:p>&nbsp;</o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>Are you backing up across your WAN?&nbsp; If so, how =
large
of a pipe do you have?<o:p></o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'><o:p>&nbsp;</o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>OR <o:p></o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'><o:p>&nbsp;</o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>Do you just have media servers in the remote sites =
and have
a small staff their taking care of the =
backup?<o:p></o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'><o:p>&nbsp;</o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>I know Mark Donaldson asked a similar question a =
while back,
but I&#8217;m still wrestling with the &#8220;best&#8221; =
solution.<o:p></o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'><o:p>&nbsp;</o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>Thanks<o:p></o:p></span></font></p>

<p><font size=3D1 face=3D"Arial Black"><span =
style=3D'font-size:7.5pt;font-family:
"Arial Black"'>David A. Chapa</span></font><span
class=3DStyleNormalWebLatinArialComplexArial75ptChar><font size=3D1 =
face=3DArial><span
style=3D'font-size:7.5pt'> | </span></font></span><font size=3D1 =
color=3Dred
face=3D"Arial Black"><span style=3D'font-size:7.5pt;font-family:"Arial =
Black";
color:red'>ADIC</span></font><span
class=3DStyleNormalWebLatinArialComplexArial75ptChar><font size=3D1 =
face=3DArial><span
style=3D'font-size:7.5pt'> | 720.272.8452 cell | =
</span></font></span><font
face=3DArial><span style=3D'font-family:Arial'><a =
href=3D"http://www.adic.com";><font
size=3D1><span =
style=3D'font-size:7.5pt'>http://www.adic.com</span></font></a></span></f=
ont><font
size=3D1><span style=3D'font-size:7.5pt'> <br>
</span></font><span =
class=3DStyleNormalWebLatinArialComplexArial75ptChar><font
size=3D1 face=3DArial><span style=3D'font-size:7.5pt'>Sr. Technical =
Advisor</span></font></span><font
size=3D1><span style=3D'font-size:7.5pt'> <o:p></o:p></span></font></p>

<p><font size=3D1 color=3Dred face=3D"Arial Black"><span =
style=3D'font-size:7.5pt;
font-family:"Arial Black";color:red'>Pathlight VX &#8211;
http://www.adic.com/gopathlightvx<o:p></o:p></span></font></p>

<p><font size=3D1 face=3D"Times New Roman"><span =
style=3D'font-size:7.5pt'><o:p>&nbsp;</o:p></span></font></p>

<p class=3DMsoNormal><font size=3D3 face=3D"Times New Roman"><span =
style=3D'font-size:
12.0pt'><o:p>&nbsp;</o:p></span></font></p>

<p class=3DMsoNormal><font size=3D3 face=3D"Times New Roman"><span =
style=3D'font-size:
12.0pt'><o:p>&nbsp;</o:p></span></font></p>

</div>

</body>

</html>

------=_NextPart_000_002F_01C4F30B.17A22A70--

<Prev in Thread] Current Thread [Next in Thread>