Networker

Re: [Networker] Windows 2000 not resetting the archive bit!!

2003-01-22 10:17:43
Subject: Re: [Networker] Windows 2000 not resetting the archive bit!!
From: Robert Maiello <robert.maiello AT MEDEC DOT COM>
To: NETWORKER AT LISTMAIL.TEMPLE DOT EDU
Date: Wed, 22 Jan 2003 10:17:54 -0500
Thanks Chuck and Koen,

Legato did get back to me about their "logic".  Quoted here it is:
--------
"Yes, if Networker finds a file with its archive bit turned on
yet, last modifed date did not change since the last backup
it will back it up at an incremental (incr,level1...level9) level
yet, it will not turn the archive bit off.

This works as designed as I said before. I have investigated
the issue more and found that there were good reasons
for this functionality:

- When files from some other systems are transferred to Windows NT, the archive
  bit is turned on, yet the last modified date is not changed. If the
   backup date is later than the last modified date, those files
  would not be backed up. That is why the files with
  archive bit on are backed up even if they are not  modified.

- The reason Networker does not turn off the archive bit is if a low
  level back up follows a higher level incremental backup that turned
  off the archive bit, the file will not be backed up in the lower level
back up.
  Networker must ensure that all files which are supposed to be backed
  up at any level, be backed up even if this means more backup
  time or tapes until the next full backup.

  For example, if there is a level 5
  backup (suppose the files have an older modified date than that level 5
  yet, they are introduced to Win NT from another system, after level 5 date)
  and if incr backup turns the bit off, the next level 5 backup will not
  back up those files, thus defeating the purpose of incremental level backups.

- The reason the full backup turns the archive bit off, is that no incremental
  level (incr, level 1... level 9) can go beyond the full level. When an
  incremental backup (incr, 1 or 2 ... 9) is done, it will always be compared
  to the last full backup.

This way Networker ensures that all files at all levels, regardless of their
origin (from any other platform) on Windows are backed up
as the backup level requires.

As I stated earlier, you can turn off archive bit behaviour by setting
NSR_AVOID_ARCHIVE=yes. This way the flexibility is provided to the
customer if the possibilities above are not a concern for the customer.
Yet, by default (NSR_AVOID_ARCHIVE=no) Networker must cover
the possibilities like those above."
-------

I must say I still don't agree with this logic.In effect
the incremental (or any other level besides a full) is meaningless to files
of this type..the whole backup level system is broken or bypassed...all to
catch files that missed a higer level backup (5) but made a lower level (0).
..from another machine.

In effect,  setting the archive bit on an already backed up file guarantees
that file will be backed up each and every night (until a full backup
is done...in our case, all month long). These files, in effect, become
differential backups (all files since the full backup) despite a different
level being specified...

Both NT backup (backup exec) and ArcServe clear the archive bit on
incrementals.   Anyone know how Veritas Netbackup handles this?

Robert Maiello
Thomson Healthcare


On Tue, 21 Jan 2003 19:16:07 -0500, Chuck Davis <networker AT DMSS.ARMY DOT 
MIL> wrote:

>I went around on this one for a while myself.  I finally threw in the towel
>and decided to set the NSR_AVOID_ARCHIVE parameter on the client.  The huge
>incrementals stopped.  I have been doing this for about 1 year now with no
>problem.  This makes sense to me.  Their logic does not.
>
>This is using NT client 6.0.1, HP-UX server 6.1.2.
>
>YMMV.
>
>Chuck Davis
>Army Medical Surveillance Activity
>Walter Reed Army Medical Center
>Washington DC
>
>On Tue, 21 Jan 2003 09:52:01 -0500, Robert Maiello
><robert.maiello AT MEDEC DOT COM> wrote:
>
>>We've been getting giant incrementals on a Windows 2000 6.1.2 client;
>server
>>in Solaris 8, 6.1.2.
>>
>>Apparently some large permission changes were being made. The archive bit
>of
>>the files were changed by this.   The weekday incremental backups then back
>>up these files but does not reset/clear the archive bit.  Each day then the
>>same data gets backed up.   Only a full backup will clear these archive
>bits.
>>
>>I received the reply below from Legato...the infamous "working as
>designed".
>>I was wondering if anyone else backing up W2K is having this problem and
>>how you dealed with?  Did it always behave this way?
>>
>>I must say, for the life me, I don't understand Legato's logic.  The
>>definition of an incremental backup is everthing that's changed since the
>>last incremental...not backup the files forever as their archive bit is set
>>(regardless of how it was set).
>>
>>I'm concerned also, that if we ignore the arhive bit then we'll miss files
>in
>>our backups?   Again, how is everyone handling this Networker "design".
>>
>>---
>>During incremental backups Networker
>>does not turn the archive bit off, if it is already on.
>>This is normal behaviour as designed. Please see below.
>>Therefore, we should make sure that the archive
>>bit was not turned on by somebody else or another
>>program, before the backup. If that is the case
>>then it is different from the expected behaviour.
>>
>>You may have to consider to set the environment variable
>>to yes.
>>
>>Here is the behaviour as designed:
>>
>>Handling archive bits depends on the value of the environment variable:
>>NSR_AVOID_ARCHIVE:
>>
>>1) NSR_AVOID_ARCHIVE=no *or* not present (default)
>>This is the new default behavior of scheduled backups on NT by
>>using the Archive file attribute as another factor in determining
>>if a file needs to be backed up incrementally in addition to the
>>Last Written, Creation time of a file. The Archive file attribute
>>is turned off based on the criteria listed below after a schedule
>>backup.
>>
>>   A) full scheduled backups
>>       archive-bit(Attribute file attribute) turned off if on
>>
>>   B) Last Written time *or* Creation time >= last scheduled backup time
>>       file is backed up, archive-bit turned off if on
>>
>>   C) Last Written time *and* Creation time < last scheduled backup time
>>        a) archive-bit is on
>>            file is backed up, archive-bit will not get turned off until
>>            the file is "captured" by a later future scheduled backup
>>            (typically case A above, but possibly case B)
>>        b) archive-bit is off
>>            file is not backed up
>>
>>2) NSR_AVOID_ARCHIVE=yes (any value other than case insensitive "no")
>>    This is the older behavior of scheduled backup without using the
>>    archive bit, except for older filesystem which used archive-bit as in
>(1).
>>
>>     A) full scheduled backups
>>
>>     B) Last Written time *or* Creation time >= last scheduled backup time
>>          file is backed up
>>
>>     C) Last Written time *and* Creation time < last scheduled backup time
>>          file is not backed up
>>
>>By specifying NSR_AVOID_ARCHIVE environment variable, one can turn
>>off the new default archive-bit backup behavior. After changing this
>>environment variable, the NetWorker/NT client must be rebooted to get the
>>proper effect.
>>
>>
>>Robert Maiello
>>Thomson Healthcare
>>
>>--
>>Note: To sign off this list, send a "signoff networker" command via email
>>to listserv AT listmail.temple DOT edu or visit the list's Web site at
>>http://listmail.temple.edu/archives/networker.html where you can
>>also view and post messages to the list.
>>=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=
>
>--
>Note: To sign off this list, send a "signoff networker" command via email
>to listserv AT listmail.temple DOT edu or visit the list's Web site at
>http://listmail.temple.edu/archives/networker.html where you can
>also view and post messages to the list.
>=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=

--
Note: To sign off this list, send a "signoff networker" command via email
to listserv AT listmail.temple DOT edu or visit the list's Web site at
http://listmail.temple.edu/archives/networker.html where you can
also view and post messages to the list.
=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=