Networker

Re: [Networker] Slow filer backups

2004-03-23 09:44:36
Subject: Re: [Networker] Slow filer backups
From: "Krishnan, Ramamurthy (Temp)" <Ramamurthy.Krishnan AT KPMG.CO DOT UK>
To: NETWORKER AT LISTMAIL.TEMPLE DOT EDU
Date: Tue, 23 Mar 2004 11:46:38 -0000
I could'nt find much difference on the speed though, the IO traffic showed 
some.  However, I don't think this gives a genuine picture as other groups that 
parallely run along with the tested group, do write the indexes. I wanted to 
know the limitations, if any, before changing the configuration of all the 
groups not to backup the indexes.

I'd update this group on the performance, once I run all the backups without 
the index.

Thanks and regards

- Krishnan

> -----Original Message-----
> From: Itzik Meirson [mailto:imeirson AT MBI.CO DOT IL]
> Sent: 23 March 2004 11:32
> To: NETWORKER AT LISTMAIL.TEMPLE DOT EDU
> Subject: Re: [Networker] Slow filer backups
> 
> 
> You will loose the possibility to do "file recoveries" based on the
> "index" - list of files backed up. Your only possibility will be to
> recover the whole saveset or read the whole saveset bit by bit while
> searching for a specific file.
> You did not mention if skipping the index generation provided you with
> better performance...
> Itzik
> 
> > -----Original Message-----
> > From: Legato NetWorker discussion
> [mailto:NETWORKER AT LISTMAIL.TEMPLE DOT EDU] On Behalf Of Krishnan,
> > Ramamurthy (Temp)
> > Sent: Tuesday, March 23, 2004 12:05
> > To: NETWORKER AT LISTMAIL.TEMPLE DOT EDU
> > Subject: Re: [Networker] Slow filer backups
> > 
> > Are there any other intricacies in not backing up the 
> indexes?  What I
> gain is visible.  Is there
> > something I'd lose if I don't backup the index files (such as file
> level recovery not possible
> > etc.,)?
> > 
> > Thanks
> > 
> > - Krishnan
> > 
> > > -----Original Message-----
> > > From: Itzik Meirson [mailto:imeirson AT MBI.CO DOT IL]
> > > Sent: 11 March 2004 17:10
> > > To: NETWORKER AT LISTMAIL.TEMPLE DOT EDU
> > > Subject: Re: [Networker] Slow filer backups
> > >
> > >
> > > It seems you are hitting a bottle neck with indexes generation.
> > > Assuming you have N NDMP drives, the Netapp will send N
> > > independent data
> > > streams to your backup server containing the list of files backed
> up.
> > > This data is all kept in /nsr/tmp.
> > > Once the Netapp finishes with a saveset your backup server will
> start
> > > massaging the accumulated index files and create the 
> actual indexes
> in
> > > /nsr/index/Netapp directory.
> > > During this massaging time, there are no backups to the specific
> drive
> > > that just finished the NDMP portion of the backup. This 
> "drive idle
> > > time" will actually reduce the total average throughput you
> > > see for the
> > > drive.
> > > So I would assume that your /nsr/tmp or even the whole /nsr
> filesystem
> > > is overloaded during these backups.
> > > I would suggest that you look at the I/O utilization of the /nsr
> > > filesystem.
> > >
> > > One way (at least for test) to avoid this overhead would be to
> > > completely suppress index generation for the NDMP backups.
> > > This could be
> > > accomplished by specifying HIST=N as the only application data
> > > information.
> > > Itzik
> > >
> > >
> > > > -----Original Message-----
> > > > From: Legato NetWorker discussion
> > > [mailto:NETWORKER AT LISTMAIL.TEMPLE DOT EDU] On Behalf Of Krishnan,
> > > > Ramamurthy (Temp)
> > > > Sent: Thursday, March 11, 2004 16:22
> > > > To: NETWORKER AT LISTMAIL.TEMPLE DOT EDU
> > > > Subject: Re: [Networker] Slow filer backups
> > > >
> > > > Matt
> > > >
> > > > - They are LTO-1 drives
> > > > - OnTap version is 6.4.2 P9
> > > > - Backing up volumes.
> > > >
> > > > thanks
> > > >
> > > > - Krishnan
> > > >
> > > > -----Original Message-----
> > > > From: Matthew Huff [mailto:mhuff AT ox DOT com]
> > > > Sent: 11 March 2004 14:11
> > > > To: Legato NetWorker discussion; Krishnan, Ramamurthy (Temp)
> > > > Subject: RE: [Networker] Slow filer backups
> > > >
> > > >
> > > > Are those LTO-1 or LTO-2 drives? What OnTap version are you
> running?
> > > Are
> > > > you backing up by volume or quota-tree?
> > > >
> > > > ----
> > > > Matthew Huff           | One Manhattanville Rd
> > > > Director of Operations | Purchase, NY 10577
> > > > OTA LLC                | Phone: 914-460-4039
> > > > http://www.otaotr.com  | Fax:   914-460-4139
> > > >
> > > > > -----Original Message-----
> > > > > From: Krishnan, Ramamurthy (Temp)
> > > > > [mailto:Ramamurthy.Krishnan AT KPMG.CO DOT UK]
> > > > > Sent: Thursday, March 11, 2004 8:49 AM
> > > > > To: NETWORKER AT LISTMAIL.TEMPLE DOT EDU
> > > > > Subject: [Networker] Slow filer backups
> > > > >
> > > > >
> > > > > Hi all
> > > > >
> > > > > We have a set of NetApp 840 Filers that are connected to a
> > > > > ATL P7K through a Gigabit switch.  NetWorker 6.1.3 runs on
> > > > > Solaris 8.  The total backup size on an avg. is ~2TB a day.
> > > > > The backups do run but are too slow.  All the 12 LTO drives
> > > > > of the library won't exceed 12Mb/s speed.  The lowest
> > > being 90Kb/s.
> > > > >
> > > > > Is it a normal show?  Is there some way by which I can
> > > > > improve the transfer speed, so backups finish faster?  Any
> > > > > help is appreciated.
> > > > >
> > > > > TIA
> > > > >
> > > > > - Krishnan
> > > > >
> > > > >
> > > > >                 Email Disclaimer
> > > > >
> > > > > This email has been sent from KPMG LLP, a UK limited
> > > > > liability partnership, or from one of the companies within
> > > > > its control (which include KPMG Audit Plc , KPMG United
> > > > > Kingdom Plc and KPMG UK Limited). The information in
> > > > > this email is confidential and may be legally privileged.
> > > > > It is intended solely for the addressee.  Access to this
> > > > > email by anyone else is unauthorised. If you are not the
> > > > > intended recipient, any disclosure, copying, distribution or
> > > > > any action taken or omitted to be taken in reliance on it,
> > > > > is prohibited and may be unlawful.  When addressed to our
> > > > > clients any opinions or advice contained in this email are
> > > > > subject to the terms and conditions expressed in the
> > > > > governing KPMG client engagement letter.
> > > > >
> > > > > --
> > > > > Note: To sign off this list, send a "signoff networker"
> > > > > command via email to listserv AT listmail.temple DOT edu or visit
> > > > > the list's Web site at
> > > > > http://listmail.temple.edu/archives/networker.> html where you
> > > > > can also view and post messages to the list.
> > > > > 
> =*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=
> > > > >
> > > > >
> > > >
> > > >
> > > >
> > > >                 Email Disclaimer
> > > >
> > > > This email has been sent from KPMG LLP, a UK limited
> > > > liability partnership, or from one of the companies within
> > > > its control (which include KPMG Audit Plc , KPMG United
> > > > Kingdom Plc and KPMG UK Limited). The information in
> > > > this email is confidential and may be legally privileged.
> > > > It is intended solely for the addressee.  Access to this
> > > > email by anyone else is unauthorised. If you are not the
> > > > intended recipient, any disclosure, copying, distribution
> > > > or any action taken or omitted to be taken in reliance on it,
> > > >  is prohibited and may be unlawful.  When addressed to
> > > > our clients any opinions or advice contained in this email
> > > > are subject to the terms and conditions expressed in the
> > > > governing KPMG client engagement letter.
> > > >
> > > > --
> > > > Note: To sign off this list, send a "signoff networker" command
> via
> > > email
> > > > to listserv AT listmail.temple DOT edu or visit the list's Web site at
> > > > http://listmail.temple.edu/archives/networker.html where you can
> > > > also view and post messages to the list.
> > > > =*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=
> > >
> > >
> > > **************************************************************
> > > ************************************
> > > The contents of this email and any attachments are confidential.
> > > It is intended for the named recipient(s) only.
> > > If you have received this email in error please notify the
> > > system manager or  the
> > > sender immediately and do not disclose the contents to any
> > > one or make copies.
> > >
> > > MBI - System Team
> > > **************************************************************
> > > ************************************
> > >
> > > --
> > > Note: To sign off this list, send a "signoff networker"
> > > command via email
> > > to listserv AT listmail.temple DOT edu or visit the list's Web site at
> > > http://listmail.temple.edu/archives/networker.html where you can
> > > also view and post messages to the list.
> > > =*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=
> > >
> > 
> > 
> >                 Email Disclaimer
> > 
> > This email has been sent from KPMG LLP, a UK limited
> > liability partnership, or from one of the companies within
> > its control (which include KPMG Audit Plc , KPMG United
> > Kingdom Plc and KPMG UK Limited). The information in
> > this email is confidential and may be legally privileged.
> > It is intended solely for the addressee.  Access to this
> > email by anyone else is unauthorised. If you are not the
> > intended recipient, any disclosure, copying, distribution
> > or any action taken or omitted to be taken in reliance on it,
> >  is prohibited and may be unlawful.  When addressed to
> > our clients any opinions or advice contained in this email
> > are subject to the terms and conditions expressed in the
> > governing KPMG client engagement letter.
> > 
> > --
> > Note: To sign off this list, send a "signoff networker" command via
> email
> > to listserv AT listmail.temple DOT edu or visit the list's Web site at
> > http://listmail.temple.edu/archives/networker.html where you can
> > also view and post messages to the list.
> > =*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=
> 
> 
> **************************************************************
> ************************************
> The contents of this email and any attachments are confidential.
> It is intended for the named recipient(s) only.
> If you have received this email in error please notify the 
> system manager or  the 
> sender immediately and do not disclose the contents to any 
> one or make copies.
> 
> MBI - System Team
> **************************************************************
> ************************************
> 
> --
> Note: To sign off this list, send a "signoff networker" 
> command via email
> to listserv AT listmail.temple DOT edu or visit the list's Web site at
> http://listmail.temple.edu/archives/networker.html where you can
> also view and post messages to the list.
> =*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=
> 


                Email Disclaimer

This email has been sent from KPMG LLP, a UK limited
liability partnership, or from one of the companies within
its control (which include KPMG Audit Plc , KPMG United
Kingdom Plc and KPMG UK Limited). The information in
this email is confidential and may be legally privileged.
It is intended solely for the addressee.  Access to this
email by anyone else is unauthorised. If you are not the
intended recipient, any disclosure, copying, distribution
or any action taken or omitted to be taken in reliance on it,
 is prohibited and may be unlawful.  When addressed to
our clients any opinions or advice contained in this email
are subject to the terms and conditions expressed in the
governing KPMG client engagement letter.

--
Note: To sign off this list, send a "signoff networker" command via email
to listserv AT listmail.temple DOT edu or visit the list's Web site at
http://listmail.temple.edu/archives/networker.html where you can
also view and post messages to the list.
=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=

<Prev in Thread] Current Thread [Next in Thread>