Veritas-bu

[Veritas-bu] Quirky Activity Monitor output

2003-11-05 11:17:15
Subject: [Veritas-bu] Quirky Activity Monitor output
From: Mark.Donaldson AT experianems DOT com (Donaldson, Mark)
Date: Wed, 5 Nov 2003 09:17:15 -0700
This message is in MIME format. Since your mail reader does not understand
this format, some or all of this message may not be legible.

------_=_NextPart_001_01C3A3B8.471738C0
Content-Type: text/plain

*note* converted to ascii to reduce post size*

Hi Nick,

It's the filelist differences and differing multistreaming differences.

Your multiple job IDs is coming from a filelist of "ALL_LOCAL_DRIVES" which,
with mulitstreaming on, will make a new individual backup job for each
mounted filesystem.  

The other job is using a distinct filelist that, along with the fact that
multistreaming off, will create a single job, backking up the filesystems in
sequence to a single NB image.

I notice that you also have "Client Compress" on.  Unless you have a very
slow network, turning this on is often a mistake.  I can slow backups and
drive CPU usage on the client very high.  If you have hardware compression
on your tape drives (very likely), then you're also re-compressing
pre-compressed data - this can actually increase tape usage (a bit).

What to do?  It's only if you consider this a problem.  Turn off multistream
on simsqld will do it.  You could change the filelist to a distinct list
like simsnsw and that'll also give you a dependable job list.  The problem
with specific filelists is that if the filesystems change in any way, some
other admin adds a new filesystem or something like that, then the changes
may not be picked up by you.  

I had this happen recently with a system that I'm not the direct admin of, I
only back it up.  Two new filesystems were added that weren't in my
filelist.  I've since moved to using a series of wild-cards that catch some
of their changes.

HTH - Mark

-----Original Message-----
From: Nick Lefebvre [mailto:nick AT solnet.com DOT au]
Sent: Tuesday, November 04, 2003 10:38 PM
To: 'Donaldson, Mark'; veritas-bu-admin AT mailman.eng.auburn DOT edu
Subject: RE: [Veritas-bu] Quirky Activity Monitor output


Hi Mark

this server IS exhibiting multiple job IDs.

bash-2.05# ./bpcllist default -U
------------------------------------------------------------

Class Name:        default

  Class Type:          Standard
  Active:              yes
  Client Compress:     yes
  Follow NFS Mounts:   no
  Cross Mount Points:  no
  Collect TIR info:    no
  Block Incremental:   no
  Mult. Data Streams:  yes
  Client Encrypt:      no
  Class Priority:      0
  Max Jobs/Class:      Unlimited
  Disaster Recovery:   0
  Residence:           (specific storage unit not required)
  Volume Pool:         NetBackup
  Keyword:             (none specified)

  HW/OS/Client:  Solaris       Solaris8      simsqld

  Include:  ALL_LOCAL_DRIVES

 <snip> 

This server is NOT exhibiting multiple job IDs

bash-2.05# /usr/openv/netbackup/bin/admincmd/bpcllist default -U
------------------------------------------------------------

Class Name:        default

  Class Type:          Standard
  Active:              yes
  Client Compress:     yes
  Follow NFS Mounts:   no
  Cross Mount Points:  no
  Collect TIR info:    no
  Block Incremental:   no
  Mult. Data Streams:  no
  Client Encrypt:      no
  Class Priority:      0
  Max Jobs/Class:      Unlimited
  Disaster Recovery:   0
  Residence:           (specific storage unit not required)
  Volume Pool:         NetBackup
  Keyword:             (none specified)

  HW/OS/Client:  Solaris       Solaris8      simsnsw

  Include:  /
            /data

   <snip>

Thanks for your help,

Nick

-----Original Message-----
From: Donaldson, Mark [mailto:Mark.Donaldson AT experianems DOT com] 
Sent: Wednesday, 5 November 2003 4:12 PM
To: 'Nick Lefebvre'; veritas-bu AT mailman.eng.auburn DOT edu
Subject: RE: [Veritas-bu] Quirky Activity Monitor output


Can you post the listing for the classes, one for the class that does split
into multiple jobs and one for the one that doesn't split?

bpcllist <classname> -U

-M
-----Original Message-----
From: Nick Lefebvre [mailto:nick AT solnet.com DOT au]
Sent: Tuesday, November 04, 2003 8:11 PM
To: 'Donaldson, Mark'; veritas-bu AT mailman.eng.auburn DOT edu
Subject: RE: [Veritas-bu] Quirky Activity Monitor output
Hi Mark,

Thanks for getting back to me.

Multi-stream has been enabled but we are not using wild cards for the file
listing of the class. However all sites have been configured this way but
some don't exhibit this type of behaviour.

Should there be something else that we should be looking for?

I have seen this sort of behaviour before on internet examples but as I said
I need to know whether this is normal Netbackup behaviour.

Cheers,

Nick

-----Original Message-----
From: veritas-bu-admin AT mailman.eng.auburn DOT edu
[mailto:veritas-bu-admin AT mailman.eng.auburn DOT edu] On Behalf Of Donaldson,
Mark
Sent: Wednesday, 5 November 2003 1:15 PM
To: 'Nick Lefebvre'; veritas-bu AT mailman.eng.auburn DOT edu
Subject: RE: [Veritas-bu] Quirky Activity Monitor output

I suspect the ones that are splitting jobs are multistreamed (check main GUI
page, "allow multiple streams" checkbox") and that you're using wildcards.

In the absence of "NEW_STREAM" directives in filelist, wild-cards in the
filelist will split into individual jobs if multi-stream is enabled.

-M


-----Original Message-----
From: Nick Lefebvre [mailto:nick AT solnet.com DOT au]
Sent: Tuesday, November 04, 2003 6:41 PM
To: veritas-bu AT mailman.eng.auburn DOT edu
Subject: [Veritas-bu] Quirky Activity Monitor output
Hi there,

I just have set up 5 separate offices to use NetBackup Business Server 3.4.

Each is running their own business server on Solaris.

All are just backing up one client.

All are configured to run a full backup on a Tuesday at 22:30.

All are configured to run differential-incremental backups under one policy
on Monday, Wednesday, Thursday, Friday, Saturday, Sunday.

My question is that when I run the Activity Monitor on two of the sites it
shows successful jobs for both the Full and differential-incremental but the
jobs are split into smaller jobs so that I will get 3 job ids for a
scheduled backup. So it appears that the backup job is being split into
smaller chunks.

When you drill down into these job IDs one job is 32K, and the other two are
larger, but different sizes.

Can you tell me whether this is normal Netbackup behavior?

If it is why does the NetBackup break the scheduled jobs up for some sites
but not all?

If not is there something that I might be doing wrong.

Cheers,

Nick

------_=_NextPart_001_01C3A3B8.471738C0
Content-Type: text/html
Content-Transfer-Encoding: quoted-printable

<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 3.2//EN">
<HTML>
<HEAD>
<META HTTP-EQUIV=3D"Content-Type" CONTENT=3D"text/html; =
charset=3DUS-ASCII">
<META NAME=3D"Generator" CONTENT=3D"MS Exchange Server version =
5.5.2653.12">
<TITLE>RE: [Veritas-bu] Quirky Activity Monitor output</TITLE>
</HEAD>
<BODY>

<P><FONT SIZE=3D2>*note* converted to ascii to reduce post size*</FONT>
</P>

<P><FONT SIZE=3D2>Hi Nick,</FONT>
</P>

<P><FONT SIZE=3D2>It's the filelist differences and differing =
multistreaming differences.</FONT>
</P>

<P><FONT SIZE=3D2>Your multiple job IDs is coming from a filelist of =
&quot;ALL_LOCAL_DRIVES&quot; which, with mulitstreaming on, will make a =
new individual backup job for each mounted filesystem.&nbsp; =
</FONT></P>

<P><FONT SIZE=3D2>The other job is using a distinct filelist that, =
along with the fact that multistreaming off, will create a single job, =
backking up the filesystems in sequence to a single NB =
image.</FONT></P>

<P><FONT SIZE=3D2>I notice that you also have &quot;Client =
Compress&quot; on.&nbsp; Unless you have a very slow network, turning =
this on is often a mistake.&nbsp; I can slow backups and drive CPU =
usage on the client very high.&nbsp; If you have hardware compression =
on your tape drives (very likely), then you're also re-compressing =
pre-compressed data - this can actually increase tape usage (a =
bit).</FONT></P>

<P><FONT SIZE=3D2>What to do?&nbsp; It's only if you consider this a =
problem.&nbsp; Turn off multistream on simsqld will do it.&nbsp; You =
could change the filelist to a distinct list like simsnsw and that'll =
also give you a dependable job list.&nbsp; The problem with specific =
filelists is that if the filesystems change in any way, some other =
admin adds a new filesystem or something like that, then the changes =
may not be picked up by you.&nbsp; </FONT></P>

<P><FONT SIZE=3D2>I had this happen recently with a system that I'm not =
the direct admin of, I only back it up.&nbsp; Two new filesystems were =
added that weren't in my filelist.&nbsp; I've since moved to using a =
series of wild-cards that catch some of their changes.</FONT></P>

<P><FONT SIZE=3D2>HTH - Mark</FONT>
</P>

<P><FONT SIZE=3D2>-----Original Message-----</FONT>
<BR><FONT SIZE=3D2>From: Nick Lefebvre [<A =
HREF=3D"mailto:nick AT solnet.com DOT au">mailto:nick AT solnet.com DOT 
au</A>]</FONT>=

<BR><FONT SIZE=3D2>Sent: Tuesday, November 04, 2003 10:38 PM</FONT>
<BR><FONT SIZE=3D2>To: 'Donaldson, Mark'; =
veritas-bu-admin AT mailman.eng.auburn DOT edu</FONT>
<BR><FONT SIZE=3D2>Subject: RE: [Veritas-bu] Quirky Activity Monitor =
output</FONT>
</P>
<BR>

<P><FONT SIZE=3D2>Hi Mark</FONT>
</P>

<P><FONT SIZE=3D2>this server IS exhibiting multiple job IDs.</FONT>
</P>

<P><FONT SIZE=3D2>bash-2.05# ./bpcllist default -U</FONT>
<BR><FONT =
SIZE=3D2>------------------------------------------------------------</F=
ONT>
</P>

<P><FONT SIZE=3D2>Class Name:&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; =
default</FONT>
</P>

<P><FONT SIZE=3D2>&nbsp; Class =
Type:&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; =
Standard</FONT>
<BR><FONT SIZE=3D2>&nbsp; =
Active:&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp=
;&nbsp;&nbsp; yes</FONT>
<BR><FONT SIZE=3D2>&nbsp; Client Compress:&nbsp;&nbsp;&nbsp;&nbsp; =
yes</FONT>
<BR><FONT SIZE=3D2>&nbsp; Follow NFS Mounts:&nbsp;&nbsp; no</FONT>
<BR><FONT SIZE=3D2>&nbsp; Cross Mount Points:&nbsp; no</FONT>
<BR><FONT SIZE=3D2>&nbsp; Collect TIR info:&nbsp;&nbsp;&nbsp; no</FONT>
<BR><FONT SIZE=3D2>&nbsp; Block Incremental:&nbsp;&nbsp; no</FONT>
<BR><FONT SIZE=3D2>&nbsp; Mult. Data Streams:&nbsp; yes</FONT>
<BR><FONT SIZE=3D2>&nbsp; Client Encrypt:&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; =
no</FONT>
<BR><FONT SIZE=3D2>&nbsp; Class Priority:&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; =
0</FONT>
<BR><FONT SIZE=3D2>&nbsp; Max Jobs/Class:&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; =
Unlimited</FONT>
<BR><FONT SIZE=3D2>&nbsp; Disaster Recovery:&nbsp;&nbsp; 0</FONT>
<BR><FONT SIZE=3D2>&nbsp; =
Residence:&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; =
(specific storage unit not required)</FONT>
<BR><FONT SIZE=3D2>&nbsp; Volume =
Pool:&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; NetBackup</FONT>
<BR><FONT SIZE=3D2>&nbsp; =
Keyword:&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbs=
p;&nbsp; (none specified)</FONT>
</P>

<P><FONT SIZE=3D2>&nbsp; HW/OS/Client:&nbsp; =
Solaris&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; =
Solaris8&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; simsqld</FONT>
</P>

<P><FONT SIZE=3D2>&nbsp; Include:&nbsp; ALL_LOCAL_DRIVES</FONT>
</P>

<P><FONT SIZE=3D2>&nbsp;&lt;snip&gt; </FONT>
</P>

<P><FONT SIZE=3D2>This server is NOT exhibiting multiple job IDs</FONT>
</P>

<P><FONT SIZE=3D2>bash-2.05# /usr/openv/netbackup/bin/admincmd/bpcllist =
default -U</FONT>
<BR><FONT =
SIZE=3D2>------------------------------------------------------------</F=
ONT>
</P>

<P><FONT SIZE=3D2>Class Name:&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; =
default</FONT>
</P>

<P><FONT SIZE=3D2>&nbsp; Class =
Type:&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; =
Standard</FONT>
<BR><FONT SIZE=3D2>&nbsp; =
Active:&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp=
;&nbsp;&nbsp; yes</FONT>
<BR><FONT SIZE=3D2>&nbsp; Client Compress:&nbsp;&nbsp;&nbsp;&nbsp; =
yes</FONT>
<BR><FONT SIZE=3D2>&nbsp; Follow NFS Mounts:&nbsp;&nbsp; no</FONT>
<BR><FONT SIZE=3D2>&nbsp; Cross Mount Points:&nbsp; no</FONT>
<BR><FONT SIZE=3D2>&nbsp; Collect TIR info:&nbsp;&nbsp;&nbsp; no</FONT>
<BR><FONT SIZE=3D2>&nbsp; Block Incremental:&nbsp;&nbsp; no</FONT>
<BR><FONT SIZE=3D2>&nbsp; Mult. Data Streams:&nbsp; no</FONT>
<BR><FONT SIZE=3D2>&nbsp; Client Encrypt:&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; =
no</FONT>
<BR><FONT SIZE=3D2>&nbsp; Class Priority:&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; =
0</FONT>
<BR><FONT SIZE=3D2>&nbsp; Max Jobs/Class:&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; =
Unlimited</FONT>
<BR><FONT SIZE=3D2>&nbsp; Disaster Recovery:&nbsp;&nbsp; 0</FONT>
<BR><FONT SIZE=3D2>&nbsp; =
Residence:&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; =
(specific storage unit not required)</FONT>
<BR><FONT SIZE=3D2>&nbsp; Volume =
Pool:&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; NetBackup</FONT>
<BR><FONT SIZE=3D2>&nbsp; =
Keyword:&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbs=
p;&nbsp; (none specified)</FONT>
</P>

<P><FONT SIZE=3D2>&nbsp; HW/OS/Client:&nbsp; =
Solaris&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; =
Solaris8&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; simsnsw</FONT>
</P>

<P><FONT SIZE=3D2>&nbsp; Include:&nbsp; /</FONT>
<BR><FONT =
SIZE=3D2>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nb=
sp; /data</FONT>
</P>

<P><FONT SIZE=3D2>&nbsp;&nbsp; &lt;snip&gt;</FONT>
</P>

<P><FONT SIZE=3D2>Thanks for your help,</FONT>
</P>

<P><FONT SIZE=3D2>Nick</FONT>
</P>

<P><FONT SIZE=3D2>-----Original Message-----</FONT>
<BR><FONT SIZE=3D2>From: Donaldson, Mark [<A =
HREF=3D"mailto:Mark.Donaldson AT experianems DOT com">mailto:Mark.Donaldson@exp=
erianems.com</A>] </FONT>
<BR><FONT SIZE=3D2>Sent: Wednesday, 5 November 2003 4:12 PM</FONT>
<BR><FONT SIZE=3D2>To: 'Nick Lefebvre'; =
veritas-bu AT mailman.eng.auburn DOT edu</FONT>
<BR><FONT SIZE=3D2>Subject: RE: [Veritas-bu] Quirky Activity Monitor =
output</FONT>
</P>
<BR>

<P><FONT SIZE=3D2>Can you post the listing for the classes, one for the =
class that does split into multiple jobs and one for the one that =
doesn't split?</FONT></P>

<P><FONT SIZE=3D2>bpcllist &lt;classname&gt; -U</FONT>
</P>

<P><FONT SIZE=3D2>-M</FONT>
<BR><FONT SIZE=3D2>-----Original Message-----</FONT>
<BR><FONT SIZE=3D2>From: Nick Lefebvre [<A =
HREF=3D"mailto:nick AT solnet.com DOT au">mailto:nick AT solnet.com DOT 
au</A>]</FONT>=

<BR><FONT SIZE=3D2>Sent: Tuesday, November 04, 2003 8:11 PM</FONT>
<BR><FONT SIZE=3D2>To: 'Donaldson, Mark'; =
veritas-bu AT mailman.eng.auburn DOT edu</FONT>
<BR><FONT SIZE=3D2>Subject: RE: [Veritas-bu] Quirky Activity Monitor =
output</FONT>
<BR><FONT SIZE=3D2>Hi Mark,</FONT>
</P>

<P><FONT SIZE=3D2>Thanks for getting back to me.</FONT>
</P>

<P><FONT SIZE=3D2>Multi-stream has been enabled but we are not using =
wild cards for the file listing of the class. However all sites have =
been configured this way but some don't exhibit this type of =
behaviour.</FONT></P>

<P><FONT SIZE=3D2>Should there be something else that we should be =
looking for?</FONT>
</P>

<P><FONT SIZE=3D2>I have seen this sort of behaviour before on internet =
examples but as I said I need to know whether this is normal Netbackup =
behaviour.</FONT></P>

<P><FONT SIZE=3D2>Cheers,</FONT>
</P>

<P><FONT SIZE=3D2>Nick</FONT>
</P>

<P><FONT SIZE=3D2>-----Original Message-----</FONT>
<BR><FONT SIZE=3D2>From: veritas-bu-admin AT mailman.eng.auburn DOT edu [<A =
HREF=3D"mailto:veritas-bu-admin AT mailman.eng.auburn DOT edu">mailto:veritas-b=
u-admin AT mailman.eng.auburn DOT edu</A>] On Behalf Of Donaldson, =
Mark</FONT></P>

<P><FONT SIZE=3D2>Sent: Wednesday, 5 November 2003 1:15 PM</FONT>
<BR><FONT SIZE=3D2>To: 'Nick Lefebvre'; =
veritas-bu AT mailman.eng.auburn DOT edu</FONT>
<BR><FONT SIZE=3D2>Subject: RE: [Veritas-bu] Quirky Activity Monitor =
output</FONT>
</P>

<P><FONT SIZE=3D2>I suspect the ones that are splitting jobs are =
multistreamed (check main GUI page, &quot;allow multiple streams&quot; =
checkbox&quot;) and that you're using wildcards.</FONT></P>

<P><FONT SIZE=3D2>In the absence of &quot;NEW_STREAM&quot; directives =
in filelist, wild-cards in the filelist will split into individual jobs =
if multi-stream is enabled.</FONT></P>

<P><FONT SIZE=3D2>-M</FONT>
</P>
<BR>

<P><FONT SIZE=3D2>-----Original Message-----</FONT>
<BR><FONT SIZE=3D2>From: Nick Lefebvre [<A =
HREF=3D"mailto:nick AT solnet.com DOT au">mailto:nick AT solnet.com DOT 
au</A>]</FONT>=

<BR><FONT SIZE=3D2>Sent: Tuesday, November 04, 2003 6:41 PM</FONT>
<BR><FONT SIZE=3D2>To: veritas-bu AT mailman.eng.auburn DOT edu</FONT>
<BR><FONT SIZE=3D2>Subject: [Veritas-bu] Quirky Activity Monitor =
output</FONT>
<BR><FONT SIZE=3D2>Hi there,</FONT>
</P>

<P><FONT SIZE=3D2>I just have set up 5 separate offices to use =
NetBackup Business Server 3.4.</FONT>
</P>

<P><FONT SIZE=3D2>Each is running their own business server on =
Solaris.</FONT>
</P>

<P><FONT SIZE=3D2>All are just backing up one client.</FONT>
</P>

<P><FONT SIZE=3D2>All are configured to run a full backup on a Tuesday =
at 22:30.</FONT>
</P>

<P><FONT SIZE=3D2>All are configured to run differential-incremental =
backups under one policy on Monday, Wednesday, Thursday, Friday, =
Saturday, Sunday.</FONT></P>

<P><FONT SIZE=3D2>My question is that when I run the Activity Monitor =
on two of the sites it shows successful jobs for both the Full and =
differential-incremental but the jobs are split into smaller jobs so =
that I will get 3 job ids for a scheduled backup. So it appears that =
the backup job is being split into smaller chunks.</FONT></P>

<P><FONT SIZE=3D2>When you drill down into these job IDs one job is =
32K, and the other two are larger, but different sizes.</FONT>
</P>

<P><FONT SIZE=3D2>Can you tell me whether this is normal Netbackup =
behavior?</FONT>
</P>

<P><FONT SIZE=3D2>If it is why does the NetBackup break the scheduled =
jobs up for some sites but not all?</FONT>
</P>

<P><FONT SIZE=3D2>If not is there something that I might be doing =
wrong.</FONT>
</P>

<P><FONT SIZE=3D2>Cheers,</FONT>
</P>

<P><FONT SIZE=3D2>Nick</FONT>
</P>

</BODY>
</HTML>
------_=_NextPart_001_01C3A3B8.471738C0--

<Prev in Thread] Current Thread [Next in Thread>