Veritas-bu

[Veritas-bu] NT 2000 backup of 1 million files one directory

2003-03-27 11:59:02
Subject: [Veritas-bu] NT 2000 backup of 1 million files one directory
From: Fabbro.Andrew AT cnf DOT com (Fabbro, Andrew P)
Date: Thu, 27 Mar 2003 08:59:02 -0800
This message is in MIME format. Since your mail reader does not understand
this format, some or all of this message may not be legible.

------_=_NextPart_001_01C2F482.2B3B58A1
Content-Type: text/plain

Poor choice...well, to get a "little" technical: all backup choices are poor
choices for backing up millions of files in one directory.  The OS is the
bottleneck.  It'll be even worse restoring it.
 
Options:
 
(1) Try using wildcards to break the directory up into lots of streams.
It's in the SAG.
 
(2) Raw volume backups don't work very well on NT because the filesystem has
to be completely quiesced and NT doesn't do that very well, but if you have
enterprise storage and can snapshot, that's another option.
 
(3) Wait for Flash Backup to be available on NT (I think it's only on
Solaris and HP-UX, but should be on NT in a quarter or two).
 

-----Original Message-----
From: Sandler, Mike [mailto:MSandler AT destinyhealth DOT com] 
Sent: Thursday, March 27, 2003 7:18 AM
To: 'Register, Joe'; 'Veritas-bu AT mailman.eng.auburn DOT edu'
Subject: RE: [Veritas-bu] NT 2000 backup of 1 million files one directory


Sorry I can't get too technical here but;
 
Veritas is a poor choice for this type of backup requirement.  This is
because it first creates the index's for all the files before actually
beginning the copy to tape.  The result is an extremely long duration for
the backup (chances are the window of opportunity is too short to run this
job which can take easily take 8 or more hours.  We have stopped using
Veritas because of this very problem.  Veritas knows of this issue and there
is no current work around.

-----Original Message-----
From: Register, Joe [mailto:jregister AT citistreetonline DOT com]
Sent: Thursday, March 27, 2003 9:54 AM
To: 'Veritas-bu AT mailman.eng.auburn DOT edu'
Subject: [Veritas-bu] NT 2000 backup of 1 million files one directory



Can anyone give advise of backing up a 2000 directory with over 1 million
files in it. We have a program (a well written one, you can tell) that
creates HTML files and all must go in one directory on a 2k server. My
master is a 2k 4.5 NBU DataCenter, the files are on a 2k 4.5 NBU client. The
backup runs fine with this folder exempt. When it's included it fails.
Thanks.

Joe Register 
System Integration/Engineering 
JRegister AT CitiStreetonline DOT com 
(904) 791-2120 



*********************************************** 

Confidentiality Note: This E-mail is intended only for the person or entity
to which it is addressed and may contain information that is privileged,
confidential or otherwise protected from disclosure. Dissemination,
distribution or copying of this E-mail or the information herein by anyone
other than the intended recipient, or an employee or agent responsible for
delivering the message to the intended recipient, is prohibited. If you have
received this E-mail in error, please call the Mgr. of Information
Technology at 301.222.0330 and destroy the original message and all copies. 




------_=_NextPart_001_01C2F482.2B3B58A1
Content-Type: text/html

<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.0 Transitional//EN">
<HTML><HEAD>
<META HTTP-EQUIV="Content-Type" CONTENT="text/html; charset=us-ascii">
<TITLE>Message</TITLE>

<META content="MSHTML 6.00.2800.1126" name=GENERATOR></HEAD>
<BODY>
<DIV><SPAN class=273025416-27032003><FONT face=Arial color=#0000ff size=2>Poor 
choice...well, to get a "little" technical: all backup choices are poor choices 
for backing up millions of files in one directory.&nbsp; The OS is the 
bottleneck.&nbsp; It'll be even worse restoring it.</FONT></SPAN></DIV>
<DIV><SPAN class=273025416-27032003><FONT face=Arial color=#0000ff 
size=2></FONT></SPAN>&nbsp;</DIV>
<DIV><SPAN class=273025416-27032003><FONT face=Arial color=#0000ff 
size=2>Options:</FONT></SPAN></DIV>
<DIV><SPAN class=273025416-27032003><FONT face=Arial color=#0000ff 
size=2></FONT></SPAN>&nbsp;</DIV>
<DIV><SPAN class=273025416-27032003><FONT face=Arial color=#0000ff size=2>(1) 
Try using wildcards to break the directory up into lots of streams.&nbsp; It's 
in the SAG.</FONT></SPAN></DIV>
<DIV><SPAN class=273025416-27032003></SPAN><SPAN 
class=273025416-27032003></SPAN><SPAN class=273025416-27032003><FONT face=Arial 
color=#0000ff size=2></FONT></SPAN>&nbsp;</DIV>
<DIV><SPAN class=273025416-27032003><FONT face=Arial color=#0000ff size=2>(2) 
Raw volume backups don't work very well on NT because the filesystem has to be 
completely quiesced and NT doesn't do that very well, but if you have 
enterprise 
storage and can snapshot, that's another option.</FONT></SPAN></DIV>
<DIV><SPAN class=273025416-27032003><FONT face=Arial color=#0000ff 
size=2></FONT></SPAN>&nbsp;</DIV>
<DIV><SPAN class=273025416-27032003><FONT face=Arial color=#0000ff size=2>(3) 
Wait for Flash Backup to be available on NT (I think it's only on Solaris and 
HP-UX, but should be on NT in a quarter or two).</FONT></SPAN></DIV>
<DIV><SPAN class=273025416-27032003></SPAN><SPAN class=273025416-27032003><FONT 
face=Arial color=#0000ff size=2></FONT></SPAN>&nbsp;</DIV>
<BLOCKQUOTE style="MARGIN-RIGHT: 0px">
  <DIV></DIV>
  <DIV class=OutlookMessageHeader lang=en-us dir=ltr align=left><FONT 
  face=Tahoma size=2>-----Original Message-----<BR><B>From:</B> Sandler, Mike 
  [mailto:MSandler AT destinyhealth DOT com] <BR><B>Sent:</B> Thursday, March 
27, 2003 
  7:18 AM<BR><B>To:</B> 'Register, Joe'; 
  'Veritas-bu AT mailman.eng.auburn DOT edu'<BR><B>Subject:</B> RE: 
[Veritas-bu] NT 
  2000 backup of 1 million files one directory<BR><BR></FONT></DIV>
  <DIV><SPAN class=656051715-27032003><FONT face=Arial color=#0000ff 
  size=2>Sorry I can't get too technical here but;</FONT></SPAN></DIV>
  <DIV><SPAN class=656051715-27032003><FONT face=Arial color=#0000ff 
  size=2></FONT></SPAN>&nbsp;</DIV>
  <DIV><SPAN class=656051715-27032003><FONT face=Arial color=#0000ff 
  size=2>Veritas is a poor choice for this type of backup requirement.&nbsp; 
  This is because it first creates the index's for all the files before 
actually 
  beginning the copy to tape.&nbsp; The result is an extremely long duration 
for 
  the backup (chances are the window of opportunity is too short to run this 
job 
  which can take easily take 8 or more hours.&nbsp; We have stopped using 
  Veritas because of this very problem.&nbsp; Veritas knows of this issue and 
  there is no current work around.</FONT></SPAN></DIV>
  <BLOCKQUOTE dir=ltr style="MARGIN-RIGHT: 0px">
    <DIV class=OutlookMessageHeader dir=ltr align=left><FONT face=Tahoma 
    size=2>-----Original Message-----<BR><B>From:</B> Register, Joe 
    [mailto:jregister AT citistreetonline DOT com]<BR><B>Sent:</B> Thursday, 
March 27, 
    2003 9:54 AM<BR><B>To:</B> 
    'Veritas-bu AT mailman.eng.auburn DOT edu'<BR><B>Subject:</B> [Veritas-bu] 
NT 2000 
    backup of 1 million files one directory<BR><BR></FONT></DIV>
    <P><FONT size=2>Can anyone give advise of backing up a 2000 directory with 
    over 1 million files in it. We have a program (a well written one, you can 
    tell) that creates HTML files and all must go in one directory on a 2k 
    server. My master is a 2k 4.5 NBU DataCenter, the files are on a 2k 4.5 NBU 
    client. The backup runs fine with this folder exempt. When it's included it 
    fails. Thanks.</FONT></P>
    <P><FONT size=2>Joe Register</FONT> <BR><FONT size=2>System 
    Integration/Engineering</FONT> <BR><FONT 
    size=2>JRegister AT CitiStreetonline DOT com</FONT> <BR><FONT size=2>(904) 
    791-2120</FONT> </P></BLOCKQUOTE><BR><BR>
  <P><B><FONT face=Arial size=2>*********************************************** 
  </FONT></B></P>
  <P><B><FONT face=Arial size=2>Confidentiality Note: This E-mail is intended 
  only for the person or entity to which it is addressed and may contain 
  information that is privileged, confidential or otherwise protected from 
  disclosure. Dissemination, distribution or copying of this E-mail or the 
  information herein by anyone other than the intended recipient, or an 
employee 
  or agent responsible for delivering the message to the intended recipient, is 
  prohibited. If you have received this E-mail in error, please call the Mgr. 
of 
  Information Technology at 301.222.0330 and destroy the original message and 
  all copies. </FONT></B></P><BR><BR></BLOCKQUOTE></BODY></HTML>

------_=_NextPart_001_01C2F482.2B3B58A1--