Veritas-bu

[Veritas-bu] Multiple streams per single filesystem - Netback up 4.5 (MP2)

2003-03-26 11:57:52
Subject: [Veritas-bu] Multiple streams per single filesystem - Netback up 4.5 (MP2)
From: Mark.Donaldson AT experianems DOT com (Donaldson, Mark)
Date: Wed, 26 Mar 2003 09:57:52 -0700
This message is in MIME format. Since your mail reader does not understand
this format, some or all of this message may not be legible.

------_=_NextPart_001_01C2F3B8.D6ACDC20
Content-Type: text/plain;
        charset="iso-8859-1"

What's your file definition look like?  If you're using ALL_LOCAL_DRIVES,
then this is expected behavior.

One option is to get specific with your file definitions:

NEW_STREAM
/fsname/subdir1
/fsname/subdir2
NEW_STREAM
/fsname/subdir3
/fsname/subdir4

This has a problem in that you now have to maintain the list.  If somebody
adds a "/fsname/subdir5" filesystem, then you have to change the list.
Personally, I hate this kind of maintenance.  I'd love to have an
"ELSE_STREAM" keyword but Veritas hasn't written me one.

Another option is to get creative with wildcards
NEW_STREAM
/fsname/[a-j]*
/fsname/[A-J]*
NEW_STREAM
/fsname/[k-t]*
/fsname/[K-T]*
NEW_STREAM
/fsname/[u-z]*
/fsname/[U-Z]*
/fsname/.??*
/fsname/[0-9]*
/fsname/_*

The problem with this type of definition file is that your streams may not
be well balanced.  It's a toss-up if just dividing by filename will lead at
all to streams that are sized more-or-less the same.

You could get really creative and actively build an include_list using a
pre-shedule client-side job but that's getting pretty advanced.

Lastly, make good use of your exclude_list entries.  No use backing up
netscape cache, core files, spool directories, etc. that are pretty much
transitory.

HTH - Mark

-----Original Message-----
From: Badinter, George [mailto:george.badinter AT citigroup DOT com]
Sent: Wednesday, March 26, 2003 9:16 AM
To: 'veritas-bu AT mailman.eng.auburn DOT edu'
Subject: [Veritas-bu] Multiple streams per single filesystem - Netbackup
4.5 (MP2)



Ladies and Gents,

I have a question about netbackup streaming. It seems that no matter what I
have tried Netbackup opens only one stream per single filesystem. However,
I have some pretty large >100Gig filesystem with large number of small files
and it takes fair amount of time to backup it up (I am getting about 1Mb per
second).  I can get up to 11Mb per second on other systems.


Any ideas?  I appreciate the any  suggestions - it is damn annoying to have
to kill long running backup.

Thanks.

George

_______________________________________________
Veritas-bu maillist  -  Veritas-bu AT mailman.eng.auburn DOT edu
http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu

------_=_NextPart_001_01C2F3B8.D6ACDC20
Content-Type: text/html;
        charset="iso-8859-1"
Content-Transfer-Encoding: quoted-printable

<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 3.2//EN">
<HTML>
<HEAD>
<META HTTP-EQUIV=3D"Content-Type" CONTENT=3D"text/html; =
charset=3Diso-8859-1">
<META NAME=3D"Generator" CONTENT=3D"MS Exchange Server version =
5.5.2653.12">
<TITLE>RE: [Veritas-bu] Multiple streams per single filesystem - =
Netbackup 4.5 (MP2)</TITLE>
</HEAD>
<BODY>

<P><FONT SIZE=3D2>What's your file definition look like?&nbsp; If =
you're using ALL_LOCAL_DRIVES, then this is expected behavior.</FONT>
</P>

<P><FONT SIZE=3D2>One option is to get specific with your file =
definitions:</FONT>
</P>

<P><FONT SIZE=3D2>NEW_STREAM</FONT>
<BR><FONT SIZE=3D2>/fsname/subdir1</FONT>
<BR><FONT SIZE=3D2>/fsname/subdir2</FONT>
<BR><FONT SIZE=3D2>NEW_STREAM</FONT>
<BR><FONT SIZE=3D2>/fsname/subdir3</FONT>
<BR><FONT SIZE=3D2>/fsname/subdir4</FONT>
</P>

<P><FONT SIZE=3D2>This has a problem in that you now have to maintain =
the list.&nbsp; If somebody adds a &quot;/fsname/subdir5&quot; =
filesystem, then you have to change the list.&nbsp; Personally, I hate =
this kind of maintenance.&nbsp; I'd love to have an =
&quot;ELSE_STREAM&quot; keyword but Veritas hasn't written me =
one.</FONT></P>

<P><FONT SIZE=3D2>Another option is to get creative with =
wildcards</FONT>
<BR><FONT SIZE=3D2>NEW_STREAM</FONT>
<BR><FONT SIZE=3D2>/fsname/[a-j]*</FONT>
<BR><FONT SIZE=3D2>/fsname/[A-J]*</FONT>
<BR><FONT SIZE=3D2>NEW_STREAM</FONT>
<BR><FONT SIZE=3D2>/fsname/[k-t]*</FONT>
<BR><FONT SIZE=3D2>/fsname/[K-T]*</FONT>
<BR><FONT SIZE=3D2>NEW_STREAM</FONT>
<BR><FONT SIZE=3D2>/fsname/[u-z]*</FONT>
<BR><FONT SIZE=3D2>/fsname/[U-Z]*</FONT>
<BR><FONT SIZE=3D2>/fsname/.??*</FONT>
<BR><FONT SIZE=3D2>/fsname/[0-9]*</FONT>
<BR><FONT SIZE=3D2>/fsname/_*</FONT>
</P>

<P><FONT SIZE=3D2>The problem with this type of definition file is that =
your streams may not be well balanced.&nbsp; It's a toss-up if just =
dividing by filename will lead at all to streams that are sized =
more-or-less the same.</FONT></P>

<P><FONT SIZE=3D2>You could get really creative and actively build an =
include_list using a pre-shedule client-side job but that's getting =
pretty advanced.</FONT></P>

<P><FONT SIZE=3D2>Lastly, make good use of your exclude_list =
entries.&nbsp; No use backing up netscape cache, core files, spool =
directories, etc. that are pretty much transitory.</FONT></P>

<P><FONT SIZE=3D2>HTH - Mark</FONT>
</P>

<P><FONT SIZE=3D2>-----Original Message-----</FONT>
<BR><FONT SIZE=3D2>From: Badinter, George [<A =
HREF=3D"mailto:george.badinter AT citigroup DOT com">mailto:george.badinter@cit=
igroup.com</A>]</FONT>
<BR><FONT SIZE=3D2>Sent: Wednesday, March 26, 2003 9:16 AM</FONT>
<BR><FONT SIZE=3D2>To: 'veritas-bu AT mailman.eng.auburn DOT edu'</FONT>
<BR><FONT SIZE=3D2>Subject: [Veritas-bu] Multiple streams per single =
filesystem - Netbackup</FONT>
<BR><FONT SIZE=3D2>4.5 (MP2)</FONT>
</P>
<BR>
<BR>

<P><FONT SIZE=3D2>Ladies and Gents,</FONT>
</P>

<P><FONT SIZE=3D2>I have a question about netbackup streaming. It seems =
that no matter what I</FONT>
<BR><FONT SIZE=3D2>have tried Netbackup opens only one stream per =
single filesystem. However,</FONT>
<BR><FONT SIZE=3D2>I have some pretty large &gt;100Gig filesystem with =
large number of small files</FONT>
<BR><FONT SIZE=3D2>and it takes fair amount of time to backup it up (I =
am getting about 1Mb per</FONT>
<BR><FONT SIZE=3D2>second).&nbsp; I can get up to 11Mb per second on =
other systems.</FONT>
</P>
<BR>

<P><FONT SIZE=3D2>Any ideas?&nbsp; I appreciate the any&nbsp; =
suggestions - it is damn annoying to have</FONT>
<BR><FONT SIZE=3D2>to kill long running backup.</FONT>
</P>

<P><FONT SIZE=3D2>Thanks.</FONT>
</P>

<P><FONT SIZE=3D2>George</FONT>
</P>

<P><FONT =
SIZE=3D2>_______________________________________________</FONT>
<BR><FONT SIZE=3D2>Veritas-bu maillist&nbsp; -&nbsp; =
Veritas-bu AT mailman.eng.auburn DOT edu</FONT>
<BR><FONT SIZE=3D2><A =
HREF=3D"http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu"; =
TARGET=3D"_blank">http://mailman.eng.auburn.edu/mailman/listinfo/veritas=
-bu</A></FONT>
</P>

</BODY>
</HTML>
------_=_NextPart_001_01C2F3B8.D6ACDC20--

<Prev in Thread] Current Thread [Next in Thread>
  • [Veritas-bu] Multiple streams per single filesystem - Netback up 4.5 (MP2), Donaldson, Mark <=