Veritas-bu

[Veritas-bu] improving backup speed on NT backups

2000-11-14 22:26:24
Subject: [Veritas-bu] improving backup speed on NT backups
From: Bob Bakh bbakh AT veritas DOT com
Date: Tue, 14 Nov 2000 19:26:24 -0800
There is a NET_BUFFER_SZ setting to manage this.

it is in the /usr/openv/netbackup directory, and it's a file with the size
in bytes.  if I'm wrong please correct me, I don't use this one too often.

Also the other two buffer settings are strictly for media servers.

Bob

-----Original Message-----
From: Michael Traves [mailto:mtraves.news AT home DOT com]
Sent: Tuesday, November 14, 2000 6:04 PM
To: veritas-bu AT mailman.eng.auburn DOT edu
Subject: Re: [Veritas-bu] improving backup speed on NT backups


Does changing the size and number of buffers for a "Network" client have any
effect, or is strictly for "Media" or "SAN Media" Servers which write direct
to tape?  Is there anyone to speed up "Network" based clients, assuming the
later?

Cheers,

Mike

Michael Traves
----- Original Message -----
From: "W. Curtis Preston" <curtis AT colltech DOT com>
To: "Bob Bakh" <bbakh AT veritas DOT com>; "Bob Bakh" <bbakh AT veritas DOT 
com>; "David
A. Chapa" <david AT datastaff DOT com>; "Bob Bakh" <bbakh AT veritas DOT com>; 
"Keahey,
Ricky L" <ricky.l.keahey AT intel DOT com>; "Long, Matt" <Matt.Long AT marriott 
DOT com>;
<veritas-bu AT mailman.eng.auburn DOT edu>
Sent: Tuesday, November 14, 2000 3:56 PM
Subject: RE: [Veritas-bu] improving backup speed on NT backups


> That's good to know, but most NT admins don't seem to know that.
>
> Now, all you've got to do is script it, and you'll have a friend! ;)
>
> At 01:02 PM 11/14/00 -0800, Bob Bakh wrote:
> >actually as Domain admin you can administer the Registry remotely =)
> >
> >Bob "huge fan of UNIX, but forced to live in an NT world" Bakh
> >
> >-----Original Message-----
> >From: W. Curtis Preston [mailto:curtis AT colltech DOT com]
> >Sent: Tuesday, November 14, 2000 12:14 PM
> >To: Bob Bakh; David A. Chapa; Bob Bakh; Keahey, Ricky L; Long, Matt;
> >veritas-bu AT mailman.eng.auburn DOT edu
> >Subject: RE: [Veritas-bu] improving backup speed on NT backups
> >
> >
> >Yeah...
> >
> >Why make things easy to administer when you can put it all inside the
> >registry?  Instead of just pushing a file from the master, all you have
to
> >do is:
> >1. physically go to the machine
> >2. run regedit
> >3. make the changes manually
> >4. save the new registry
> >
> >:(
> >
> >At 09:02 AM 11/14/00 -0800, Bob Bakh wrote:
> > >I could have sworn that the people in engineering have said that in 3.2
you
> > >could put the files, but in 3.4 it all got moved into the registry, to
stay
> > >with Microsoft conventions.
> > >
> > >Bob
> > >
> > >-----Original Message-----
> > >From: David A. Chapa [mailto:david AT datastaff DOT com]
> > >Sent: Tuesday, November 14, 2000 8:43 AM
> > >To: Bob Bakh; Keahey, Ricky L; Long, Matt;
> > >veritas-bu AT mailman.eng.auburn DOT edu
> > >Subject: RE: [Veritas-bu] improving backup speed on NT backups
> > >
> > >
> > >no, actually you don't have to put it in the registry, but just as the
Unix
> > >product, you can put it in veritas\netbackup\db\config.
> > >
> > >Since I am a fan of consistency (and hate modifying my Operations
Manuals),
> > >I prefer to stay out of the registry as much as possible.
> > >
> > >The default, 4 buffers at 64K typically is sufficient.  However, I have
> > >found at one of my client's that the server was having a hard time
filling
> > >up the buffers, and as a result I was seeing network timeout, etc.
> > >
> > >My solution was to increase the number of buffers to 8 and reduce the
size
> > >to 32K.
> > >
> > >This has had very positive results for all machines in the NT domain.
> > >
> > >David Chapa
> > >DataStaff, Inc.
> > >
> > >
> > >-----Original Message-----
> > >From: veritas-bu-admin AT Eng.Auburn DOT EDU
> > >[mailto:veritas-bu-admin AT Eng.Auburn DOT EDU]On Behalf Of Bob Bakh
> > >Sent: Tuesday, November 14, 2000 10:20 AM
> > >To: David A. Chapa; Keahey, Ricky L; Long, Matt;
> > >veritas-bu AT mailman.eng.auburn DOT edu
> > >Subject: RE: [Veritas-bu] improving backup speed on NT backups
> > >
> > >
> > >actually it's
> > >
> > >\HKEY_Local_Machine\SOFTWARE\VERITAS\NetBackup\CurrentVersion\Config
> > >
> > >add a new string
> > >
> > >SIZE_DATA_BUFFERS with the value in bytes maximum 65536 because NT only
> > >allows 64k buffers
> > >
> > >NUMBER_DATA_BUFFERS I usually keep it a power of 8, 1,2,4,8,16,32,64
> > >
> > >but I'm anal
> > >
> > >Bob
> > >
> > >-----Original Message-----
> > >From: David A. Chapa [mailto:david AT datastaff DOT com]
> > >Sent: Friday, November 10, 2000 8:10 AM
> > >To: Keahey, Ricky L; Long, Matt; veritas-bu AT mailman.eng.auburn DOT edu
> > >Subject: RE: [Veritas-bu] improving backup speed on NT backups
> > >
> > >
> > >\veritas\netbackup\db\config\SIZE_DATA_BUFFERS
> > >and NUMBER_DATA_BUFFERS
> > >
> > >do not have any trailing spaces in these files, no comments, etc.
> > >
> > >Here is the technote on the two parameter files
> > >
> > >http://seer.support.veritas.com/docs/183702.htm
> > >
> > >
> > >David
> > >
> > >-----Original Message-----
> > >From: Keahey, Ricky L [mailto:ricky.l.keahey AT intel DOT com]
> > >Sent: Friday, November 10, 2000 10:00 AM
> > >To: 'David A. Chapa'; Long, Matt; veritas-bu AT mailman.eng.auburn DOT edu
> > >Subject: RE: [Veritas-bu] improving backup speed on NT backups
> > >
> > >
> > >I am having this same issue except it is in a SAN environment and some
of
> >my
> > >media servers.  I have been looking for the place to change these
settings,
> > >but can't find them.  Can you point me in the right direction.  I have
a
> > >total NT environment.
> > >
> > >Thanks,
> > >Rick
> > >
> > >-----Original Message-----
> > >From: David A. Chapa [mailto:david AT datastaff DOT com]
> > >Sent: Friday, November 10, 2000 7:29 AM
> > >To: Long, Matt; veritas-bu AT mailman.eng.auburn DOT edu
> > >Subject: RE: [Veritas-bu] improving backup speed on NT backups
> > >
> > >
> > >Matt:
> > >
> > >Create /usr/openv/netbackup/logs/bptm on your media server that is
backing
> > >up your NT machines
> > >
> > >Run some test backups and review this log.
> > >
> > >You will want to look for a line
> > >
> > >waited for full buffer
> > >
> > >-or-
> > >
> > >waited for empty buffer (this **MAY** mean an increase in data buffers
> >could
> > >be used)
> > >
> > >this will let you know how long it waited for a buffer to be filled
prior
> >to
> > >writing to tape.
> > >
> > >If there are considerable delays you may want to investigate the
network
> > >between your media server and your NT clients.  Typical problems are
> > >AUTO-NEGOTIATE on your NT machines and AUTO-NEGOTIATE on switches in
the
> > >closet.  If all of that checks out, and you still aren't satisfied with
the
> > >results, you **MAY** want to look at the NUMBER_DATA_BUFFER and
> > >SIZE_DATA_BUFFERS config options for tuning your performance.  Please
keep
> > >in mind, that  you want to make sure that you don't adversely affect
you
> > >current clients.  Believe it or not, in the most recent NT environment
that
> > >I have been architecting, I found that I needed to reduce the SIZE of
the
> > >databuffer and increase the NUMBER of the data buffers.  This seems to
have
> > >increased the speed, I need to follow up with my client to review the
> >actual
> > >results but the preliminary numbers looked good.
> > >
> > >Just my two cents worth
> > >
> > >David
> > >
> > >-----Original Message-----
> > >From: veritas-bu-admin AT Eng.Auburn DOT EDU
> > >[mailto:veritas-bu-admin AT Eng.Auburn DOT EDU]On Behalf Of Long, Matt
> > >Sent: Thursday, November 09, 2000 11:07 AM
> > >To: veritas-bu AT mailman.eng.auburn DOT edu
> > >Subject: [Veritas-bu] improving backup speed on NT backups
> > >
> > >
> > >Hello,
> > >
> > >         Does anyone know how to improve network performance for NT
client
> > >backups?  Currently,  I am seeing about 4 to 5 mps per second on my
UNIX
> > >servers but I am only seeing lass than a 1 mps for my NT systems.  Any
> > >recommendations out there for this scenario?  Thanks
> > >
> > >1       nt_filesystem   nt_incrimental nodename         master_server
> > >87538   100%    200.075 11/08/2000 5:09:24 PM   00:09:37
11/08/2000
> > >5:19:01 PM
> > >
> > >Matt Long
> > >Systems Administration
> > >Marriott International
> > >301-696-2690
> > >
> > >_______________________________________________
> > >Veritas-bu maillist  -  Veritas-bu AT mailman.eng.auburn DOT edu
> > >http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
> > >
> > >_______________________________________________
> > >Veritas-bu maillist  -  Veritas-bu AT mailman.eng.auburn DOT edu
> > >http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
> > >
> > >
> > >_______________________________________________
> > >Veritas-bu maillist  -  Veritas-bu AT mailman.eng.auburn DOT edu
> > >http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
> > >_______________________________________________
> > >Veritas-bu maillist  -  Veritas-bu AT mailman.eng.auburn DOT edu
> > >http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
> > >_______________________________________________
> > >Veritas-bu maillist  -  Veritas-bu AT mailman.eng.auburn DOT edu
> > >http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
> >
> >---
> >W. Curtis Preston, Principal Consultant at Collective Technologies
> >Email: curtis AT colltech DOT com                (Best way to contact me)
> >Work : 408 452 5555                       (Leave a message.)
> >Pager: 800 946 4646, pin#1436065        (If urgent.)
> >
> >Tap into the Collective Intellect (TM): http://www.colltech.com
> >Backup & Restore resources:        http://www.backupcentral.com
>
> ---
> W. Curtis Preston, Principal Consultant at Collective Technologies
> Email: curtis AT colltech DOT com                (Best way to contact me)
> Work : 408 452 5555                       (Leave a message.)
> Pager: 800 946 4646, pin#1436065        (If urgent.)
>
> Tap into the Collective Intellect (TM): http://www.colltech.com
> Backup & Restore resources:        http://www.backupcentral.com
>
> _______________________________________________
> Veritas-bu maillist  -  Veritas-bu AT mailman.eng.auburn DOT edu
> http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu

_______________________________________________
Veritas-bu maillist  -  Veritas-bu AT mailman.eng.auburn DOT edu
http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu



<Prev in Thread] Current Thread [Next in Thread>