Veritas-bu

[Veritas-bu] Overnight scheduling quirk

2002-09-24 13:43:20
Subject: [Veritas-bu] Overnight scheduling quirk
From: Mark.Donaldson AT experianems DOT com (Donaldson, Mark)
Date: Tue, 24 Sep 2002 11:43:20 -0600
This message is in MIME format. Since your mail reader does not understand
this format, some or all of this message may not be legible.

------_=_NextPart_001_01C263F1.DF6EBD80
Content-Type: text/plain

(This is a repost snipped to meet mail list size requirements)

(Apologies for HTML - it makes the tables below look right, though.) 

It doesn't seem this simple, that a subsequent backup cycle is based on
completion time of the previous cycle.  Here's a listing from a client I
have:


Job_Type         Job_ID  State   Status  Class   Client  K_Bytes
Files    Started         Elapsed        
Backup   216873
<http://backup00.lodo.in.exactis.com/cgi-bin/job_detail?jobid=216873>   Done
OK       System_Demux    dev1.devel.exactis.com  189169  448     09/23/2002
18:25:20         00:44:48       
Backup   216668
<http://backup00.lodo.in.exactis.com/cgi-bin/job_detail?jobid=216668>   Done
OK       System_Demux    dev1.devel.exactis.com  1069898         308
09/22/2002 18:08:20      00:47:37       
Backup   216449
<http://backup00.lodo.in.exactis.com/cgi-bin/job_detail?jobid=216449>   Done
OK       System_Demux    dev1.devel.exactis.com  135433  123     09/21/2002
18:08:20         00:45:28       
Backup   216238
<http://backup00.lodo.in.exactis.com/cgi-bin/job_detail?jobid=216238>   Done
OK       System_Demux    dev1.devel.exactis.com  371317  404     09/20/2002
18:02:00         00:46:15       
Backup   216036
<http://backup00.lodo.in.exactis.com/cgi-bin/job_detail?jobid=216036>   Done
OK       System_Demux    dev1.devel.exactis.com  197634  735     09/19/2002
18:19:50         00:42:11       
Backup   215815
<http://backup00.lodo.in.exactis.com/cgi-bin/job_detail?jobid=215815>   Done
OK       System_Demux    dev1.devel.exactis.com  44068576        905803
09/18/2002 18:08:20      04:46:26       
Backup   215597
<http://backup00.lodo.in.exactis.com/cgi-bin/job_detail?jobid=215597>   Done
OK       System_Demux    dev1.devel.exactis.com  205265  900     09/17/2002
18:05:00         00:45:14       


This is a standard weekly full & nightly incremental.  The incrementals (the
short ones) are occuring pretty much neatly after the 18:00 start time for
the schedule despite the elapsed time.  The schedule is set for a one day
frequency.  If NB was adding time to the completion time, the incrementals
would slowly work their way around the clock.

Here's another one - set on a one-hour incremental frequency (oracle
archived redo logs - same column headings as above):

If you look at job 216823, at 22 minutes long, the next job starts 1:05
later, not 1:22. On the other hand, job 216815 ran 18 minutes and the next
job ran 1:15 later.  
 
Backup   216830
<http://backup00.lodo.in.exactis.com/cgi-bin/job_detail?jobid=216830>   Done
OK       Oracle_Redo     db01.lodo.in.exactis.com        32      0
09/23/2002 13:18:10      00:00:11       
Backup   216823
<http://backup00.lodo.in.exactis.com/cgi-bin/job_detail?jobid=216823>   Done
OK       Oracle_Redo     db01.lodo.in.exactis.com        2867232         7
09/23/2002 12:13:00      00:22:43       
Backup   216815
<http://backup00.lodo.in.exactis.com/cgi-bin/job_detail?jobid=216815>   Done
OK       Oracle_Redo     db01.lodo.in.exactis.com        2457632         6
09/23/2002 10:58:00      00:18:15       
 
On yet a third hand, job 216778 ran only a minute but the next job was
scheduled at 1:10 later ( I'm thinking the schedule wake-up-frequency is the
cause here).  These all backup to a disk STU, by the way, so tape delays
should not really be part of the equation.  
 
Backup   216781
<http://backup00.lodo.in.exactis.com/cgi-bin/job_detail?jobid=216781>   Done
OK       Oracle_Redo     db01.lodo.in.exactis.com        409600  1
09/23/2002 05:08:20      00:01:10       
Backup   216778
<http://backup00.lodo.in.exactis.com/cgi-bin/job_detail?jobid=216778>   Done
OK       Oracle_Redo     db01.lodo.in.exactis.com        409632  1
09/23/2002 03:58:20      00:01:09       
 
In general, the next cycle seems to be scheduled from the previous
schedule's start time, not the completion time, with variations due to the
scheduler wake-up frequncy.  
 
-Mark

-----Original Message-----
From: W. Curtis Preston [ mailto:curtis.lists AT backupcentral DOT com
<mailto:curtis.lists AT backupcentral DOT com> ]
Sent: Tuesday, September 24, 2002 10:52 AM

This is a very common FAQ, and we should put it in the FAQ.

NetBackup checks the interval against the amount of time since the
COMPLETION time of the last backup.  Therefore, a backup (with a 24 hour
frequency) that doesn't finish until 5 AM will not start until 24 hours
after 5 AM, if the window is open.

------_=_NextPart_001_01C263F1.DF6EBD80
Content-Type: text/html

<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.0 Transitional//EN">
<HTML><HEAD>
<META HTTP-EQUIV="Content-Type" CONTENT="text/html; charset=US-ASCII">
<TITLE></TITLE>

<META content="MSHTML 5.50.4919.2200" name=GENERATOR></HEAD>
<BODY>
<P><FONT size=2><SPAN class=453013017-24092002><EM>(This is a repost snipped to 
meet mail list size requirements)</EM></SPAN></FONT></P>
<P><FONT size=2><SPAN class=453013017-24092002></SPAN>(Apologies for HTML - it 
makes the tables below look right, though.)<SPAN 
class=453013017-24092002>&nbsp;</SPAN></FONT></P>
<P><FONT size=2>It doesn't seem this simple, that a subsequent backup cycle is 
based on completion time of the previous cycle.&nbsp; Here's a listing from a 
client I have:<BR></P>
<TABLE align=center bgColor=white border=1>
  <TBODY>
  <TR>
    <TD><B>Job_Type</B></TD>
    <TD><B>Job_ID</B></TD>
    <TD><B>State</B></TD>
    <TD><B>Status</B></TD>
    <TD><B>Class</B></TD>
    <TD><B>Client</B></TD>
    <TD><B>K_Bytes</B></TD>
    <TD><B>Files</B></TD>
    <TD><B>Started</B></TD>
    <TD><B>Elapsed</B></TD></TR>
  <TR>
    <TD noWrap>Backup</TD>
    <TD noWrap><FONT color=black><A 
      
href="http://backup00.lodo.in.exactis.com/cgi-bin/job_detail?jobid=216873";>216873</A>
 
      </FONT></TD>
    <TD noWrap><FONT color=black>Done</FONT></TD>
    <TD noWrap><FONT color=black>OK</FONT></TD>
    <TD noWrap><FONT color=black>System_Demux</FONT></TD>
    <TD noWrap align=right><FONT color=black>dev1.devel.exactis.com</FONT></TD>
    <TD noWrap align=right><FONT color=black>189169</FONT></TD>
    <TD noWrap align=right><FONT color=black>448</FONT></TD>
    <TD noWrap><FONT color=black>09/23/2002 18:25:20</FONT></TD>
    <TD noWrap><FONT color=black>00:44:48</FONT></TD></TR>
  <TR>
    <TD noWrap><FONT color=black>Backup</FONT></TD>
    <TD noWrap><FONT color=black><A 
      
href="http://backup00.lodo.in.exactis.com/cgi-bin/job_detail?jobid=216668";>216668</A>
 
      </FONT></TD>
    <TD noWrap><FONT color=black>Done</FONT></TD>
    <TD noWrap><FONT color=black>OK</FONT></TD>
    <TD noWrap><FONT color=black>System_Demux</FONT></TD>
    <TD noWrap align=right><FONT color=black>dev1.devel.exactis.com</FONT></TD>
    <TD noWrap align=right><FONT color=black>1069898</FONT></TD>
    <TD noWrap align=right><FONT color=black>308</FONT></TD>
    <TD noWrap><FONT color=black>09/22/2002 18:08:20</FONT></TD>
    <TD noWrap><FONT color=black>00:47:37</FONT></TD></TR>
  <TR>
    <TD noWrap><FONT color=black>Backup</FONT></TD>
    <TD noWrap><FONT color=black><A 
      
href="http://backup00.lodo.in.exactis.com/cgi-bin/job_detail?jobid=216449";>216449</A>
 
      </FONT></TD>
    <TD noWrap><FONT color=black>Done</FONT></TD>
    <TD noWrap><FONT color=black>OK</FONT></TD>
    <TD noWrap><FONT color=black>System_Demux</FONT></TD>
    <TD noWrap align=right><FONT color=black>dev1.devel.exactis.com</FONT></TD>
    <TD noWrap align=right><FONT color=black>135433</FONT></TD>
    <TD noWrap align=right><FONT color=black>123</FONT></TD>
    <TD noWrap><FONT color=black>09/21/2002 18:08:20</FONT></TD>
    <TD noWrap><FONT color=black>00:45:28</FONT></TD></TR>
  <TR>
    <TD noWrap><FONT color=black>Backup</FONT></TD>
    <TD noWrap><FONT color=black><A 
      
href="http://backup00.lodo.in.exactis.com/cgi-bin/job_detail?jobid=216238";>216238</A>
 
      </FONT></TD>
    <TD noWrap><FONT color=black>Done</FONT></TD>
    <TD noWrap><FONT color=black>OK</FONT></TD>
    <TD noWrap><FONT color=black>System_Demux</FONT></TD>
    <TD noWrap align=right><FONT color=black>dev1.devel.exactis.com</FONT></TD>
    <TD noWrap align=right><FONT color=black>371317</FONT></TD>
    <TD noWrap align=right><FONT color=black>404</FONT></TD>
    <TD noWrap><FONT color=black>09/20/2002 18:02:00</FONT></TD>
    <TD noWrap><FONT color=black>00:46:15</FONT></TD></TR>
  <TR>
    <TD noWrap><FONT color=black>Backup</FONT></TD>
    <TD noWrap><FONT color=black><A 
      
href="http://backup00.lodo.in.exactis.com/cgi-bin/job_detail?jobid=216036";>216036</A>
 
      </FONT></TD>
    <TD noWrap><FONT color=black>Done</FONT></TD>
    <TD noWrap><FONT color=black>OK</FONT></TD>
    <TD noWrap><FONT color=black>System_Demux</FONT></TD>
    <TD noWrap align=right><FONT color=black>dev1.devel.exactis.com</FONT></TD>
    <TD noWrap align=right><FONT color=black>197634</FONT></TD>
    <TD noWrap align=right><FONT color=black>735</FONT></TD>
    <TD noWrap><FONT color=black>09/19/2002 18:19:50</FONT></TD>
    <TD noWrap><FONT color=black>00:42:11</FONT></TD></TR>
  <TR>
    <TD noWrap><FONT color=black>Backup</FONT></TD>
    <TD noWrap><FONT color=black><A 
      
href="http://backup00.lodo.in.exactis.com/cgi-bin/job_detail?jobid=215815";>215815</A>
 
      </FONT></TD>
    <TD noWrap><FONT color=black>Done</FONT></TD>
    <TD noWrap><FONT color=black>OK</FONT></TD>
    <TD noWrap><FONT color=black>System_Demux</FONT></TD>
    <TD noWrap align=right><FONT color=black>dev1.devel.exactis.com</FONT></TD>
    <TD noWrap align=right><FONT color=black>44068576</FONT></TD>
    <TD noWrap align=right><FONT color=black>905803</FONT></TD>
    <TD noWrap><FONT color=black>09/18/2002 18:08:20</FONT></TD>
    <TD noWrap><FONT color=black>04:46:26</FONT></TD></TR>
  <TR>
    <TD noWrap><FONT color=black>Backup</FONT></TD>
    <TD noWrap><FONT color=black><A 
      
href="http://backup00.lodo.in.exactis.com/cgi-bin/job_detail?jobid=215597";>215597</A>
 
      </FONT></TD>
    <TD noWrap>Done</TD>
    <TD noWrap>OK</TD>
    <TD noWrap>System_Demux</TD>
    <TD noWrap align=right>dev1.devel.exactis.com</TD>
    <TD noWrap align=right>205265</TD>
    <TD noWrap align=right>900</TD>
    <TD noWrap>09/17/2002 18:05:00</TD>
    <TD noWrap>00:45:14</TD></TR></TBODY></TABLE>
<P><BR>This is a standard weekly full &amp; nightly incremental.&nbsp; The 
incrementals (the short ones) are occuring pretty much neatly after the 18:00 
start time for the schedule despite the elapsed time.&nbsp; The schedule is set 
for a one day frequency.&nbsp; If NB was adding time to the completion time, 
the 
incrementals would slowly work their way around the clock.</P>
<P>Here's another one - set on a one-hour incremental frequency (oracle 
archived 
redo logs - same column headings as above):</P>
<DIV><FONT face=Arial>If you look at job 216823, at 22 minutes long, the next 
job starts 1:05 later, not 1:22. On the other hand, job 216815 ran 18 minutes 
and the next job ran 1:15 later.&nbsp; </FONT></DIV>
<DIV><FONT face=Arial></FONT>&nbsp;</DIV>
<DIV><FONT face=Arial>
<TABLE align=center bgColor=white border=1>
  <TBODY>
  <TR>
    <TD noWrap><FONT color=black>Backup</FONT></TD>
    <TD noWrap><FONT color=black><A 
      
href="http://backup00.lodo.in.exactis.com/cgi-bin/job_detail?jobid=216830";>216830</A>
 
      </FONT></TD>
    <TD noWrap><FONT color=black>Done</FONT></TD>
    <TD noWrap><FONT color=black>OK</FONT></TD>
    <TD noWrap><FONT color=black>Oracle_Redo</FONT></TD>
    <TD noWrap align=right><FONT 
color=black>db01.lodo.in.exactis.com</FONT></TD>
    <TD noWrap align=right><FONT color=black>32</FONT></TD>
    <TD noWrap align=right><FONT color=black>0</FONT></TD>
    <TD noWrap><FONT color=black>09/23/2002 13:18:10</FONT></TD>
    <TD noWrap><FONT color=black>00:00:11</FONT></TD></TR>
  <TR>
    <TD noWrap><FONT color=black>Backup</FONT></TD>
    <TD noWrap><FONT color=black><A 
      
href="http://backup00.lodo.in.exactis.com/cgi-bin/job_detail?jobid=216823";>216823</A>
 
      </FONT></TD>
    <TD noWrap><FONT color=black>Done</FONT></TD>
    <TD noWrap><FONT color=black>OK</FONT></TD>
    <TD noWrap><FONT color=black>Oracle_Redo</FONT></TD>
    <TD noWrap align=right><FONT 
color=black>db01.lodo.in.exactis.com</FONT></TD>
    <TD noWrap align=right><FONT color=black>2867232</FONT></TD>
    <TD noWrap align=right><FONT color=black>7</FONT></TD>
    <TD noWrap><FONT color=black>09/23/2002 12:13:00</FONT></TD>
    <TD noWrap><FONT color=black>00:22:43</FONT></TD></TR>
  <TR>
    <TD noWrap><FONT color=black>Backup</FONT></TD>
    <TD noWrap><FONT color=black><A 
      
href="http://backup00.lodo.in.exactis.com/cgi-bin/job_detail?jobid=216815";>216815</A>
 
      </FONT></TD>
    <TD noWrap><FONT color=black>Done</FONT></TD>
    <TD noWrap><FONT color=black>OK</FONT></TD>
    <TD noWrap><FONT color=black>Oracle_Redo</FONT></TD>
    <TD noWrap align=right><FONT 
color=black>db01.lodo.in.exactis.com</FONT></TD>
    <TD noWrap align=right><FONT color=black>2457632</FONT></TD>
    <TD noWrap align=right><FONT color=black>6</FONT></TD>
    <TD noWrap><FONT color=black>09/23/2002 10:58:00</FONT></TD>
    <TD noWrap><FONT 
color=black>00:18:15</FONT></TD></TR></TBODY></TABLE></FONT></DIV>
<DIV><FONT face=Arial></FONT>&nbsp;</DIV>
<DIV><FONT face=Arial>On yet a third hand, job 216778 ran only a minute but the 
next job was scheduled at 1:10 later ( I'm thinking the schedule 
wake-up-frequency is the cause here).&nbsp; These all backup to a disk STU, 
by&nbsp;the way, so tape delays should not really be part of the 
equation.&nbsp; 
</FONT></DIV>
<DIV><FONT face=Arial></FONT>&nbsp;</DIV>
<DIV><FONT face=Arial>
<TABLE align=center bgColor=white border=1>
  <TBODY>
  <TR>
    <TD noWrap><FONT color=black>Backup</FONT></TD>
    <TD noWrap><FONT color=black><A 
      
href="http://backup00.lodo.in.exactis.com/cgi-bin/job_detail?jobid=216781";>216781</A>
 
      </FONT></TD>
    <TD noWrap><FONT color=black>Done</FONT></TD>
    <TD noWrap><FONT color=black>OK</FONT></TD>
    <TD noWrap><FONT color=black>Oracle_Redo</FONT></TD>
    <TD noWrap align=right><FONT 
color=black>db01.lodo.in.exactis.com</FONT></TD>
    <TD noWrap align=right><FONT color=black>409600</FONT></TD>
    <TD noWrap align=right><FONT color=black>1</FONT></TD>
    <TD noWrap><FONT color=black>09/23/2002 05:08:20</FONT></TD>
    <TD noWrap><FONT color=black>00:01:10</FONT></TD></TR>
  <TR>
    <TD noWrap><FONT color=black>Backup</FONT></TD>
    <TD noWrap><FONT color=black><A 
      
href="http://backup00.lodo.in.exactis.com/cgi-bin/job_detail?jobid=216778";>216778</A>
 
      </FONT></TD>
    <TD noWrap><FONT color=black>Done</FONT></TD>
    <TD noWrap><FONT color=black>OK</FONT></TD>
    <TD noWrap><FONT color=black>Oracle_Redo</FONT></TD>
    <TD noWrap align=right><FONT 
color=black>db01.lodo.in.exactis.com</FONT></TD>
    <TD noWrap align=right><FONT color=black>409632</FONT></TD>
    <TD noWrap align=right><FONT color=black>1</FONT></TD>
    <TD noWrap><FONT color=black>09/23/2002 03:58:20</FONT></TD>
    <TD noWrap><FONT 
color=black>00:01:09</FONT></TD></TR></TBODY></TABLE></FONT></DIV>
<DIV><FONT face=Arial></FONT>&nbsp;</DIV>
<DIV><FONT face=Arial>In general, the next cycle seems to be scheduled from the 
previous schedule's start time, not the completion time, with variations due to 
the scheduler wake-up frequncy.&nbsp; </FONT></DIV>
<DIV><FONT face=Arial></FONT>&nbsp;</DIV>
<DIV><FONT face=Arial>-Mark</FONT><BR><BR>-----Original Message-----<BR>From: 
W. 
Curtis Preston [<A 
href="mailto:curtis.lists AT backupcentral DOT com">mailto:curtis.lists AT 
backupcentral DOT com</A>]<BR>Sent: 
Tuesday, September 24, 2002 10:52 AM<BR><BR>This is a very common FAQ, and we 
should put it in the FAQ.<BR><BR>NetBackup checks the interval against the 
amount of time since the<BR>COMPLETION time of the last backup.&nbsp; 
Therefore, 
a backup (with a 24 hour<BR>frequency) that doesn't finish until 5 AM will not 
start until 24 hours<BR>after 5 AM, if the window is 
open.</DIV></FONT></BODY></HTML>

------_=_NextPart_001_01C263F1.DF6EBD80--