I would run without the Indexes just to see what the difference in
performance is. If there is a problem, then you can look to see if the
bottleneck is in the NetApp network interfaces, network itself, Legato
server network interface, swap space on Legato server or on /nsr/tmp on
Legato Server.
I would not recommend running the backup without indexes. Individual
file restore will be extremely slow (couple of orders of magnitute
slower than DAR). However, if you have a large space allocated to
snapshots and doing at least daily snapshots, then only backing up to do
disaster recovery is a viable option on the netapps.
----
Matthew Huff | One Manhattanville Rd
Director of Operations | Purchase, NY 10577
OTA LLC | Phone: 914-460-4039
http://www.otaotr.com | Fax: 914-460-4139
> -----Original Message-----
> From: Krishnan, Ramamurthy (Temp)
> [mailto:Ramamurthy.Krishnan AT KPMG.CO DOT UK]
> Sent: Tuesday, March 23, 2004 6:47 AM
> To: NETWORKER AT LISTMAIL.TEMPLE DOT EDU
> Subject: Re: [Networker] Slow filer backups
>
>
> I could'nt find much difference on the speed though, the IO
> traffic showed some. However, I don't think this gives a
> genuine picture as other groups that parallely run along with
> the tested group, do write the indexes. I wanted to know the
> limitations, if any, before changing the configuration of all
> the groups not to backup the indexes.
>
> I'd update this group on the performance, once I run all the
> backups without the index.
>
> Thanks and regards
>
> - Krishnan
>
> > -----Original Message-----
> > From: Itzik Meirson [mailto:imeirson AT MBI.CO DOT IL]
> > Sent: 23 March 2004 11:32
> > To: NETWORKER AT LISTMAIL.TEMPLE DOT EDU
> > Subject: Re: [Networker] Slow filer backups
> >
> >
> > You will loose the possibility to do "file recoveries" based on the
> > "index" - list of files backed up. Your only possibility will be to
> > recover the whole saveset or read the whole saveset bit by
> bit while
> > searching for a specific file. You did not mention if skipping the
> > index generation provided you with better performance...
> > Itzik
> >
> > > -----Original Message-----
> > > From: Legato NetWorker discussion
> > [mailto:NETWORKER AT LISTMAIL.TEMPLE DOT EDU] On Behalf Of Krishnan,
> > > Ramamurthy (Temp)
> > > Sent: Tuesday, March 23, 2004 12:05
> > > To: NETWORKER AT LISTMAIL.TEMPLE DOT EDU
> > > Subject: Re: [Networker] Slow filer backups
> > >
> > > Are there any other intricacies in not backing up the
> > indexes? What I
> > gain is visible. Is there
> > > something I'd lose if I don't backup the index files (such as file
> > level recovery not possible
> > > etc.,)?
> > >
> > > Thanks
> > >
> > > - Krishnan
> > >
> > > > -----Original Message-----
> > > > From: Itzik Meirson [mailto:imeirson AT MBI.CO DOT IL]
> > > > Sent: 11 March 2004 17:10
> > > > To: NETWORKER AT LISTMAIL.TEMPLE DOT EDU
> > > > Subject: Re: [Networker] Slow filer backups
> > > >
> > > >
> > > > It seems you are hitting a bottle neck with indexes generation.
> > > > Assuming you have N NDMP drives, the Netapp will send N
> > > > independent data streams to your backup server
> containing the list
> > > > of files backed
> > up.
> > > > This data is all kept in /nsr/tmp.
> > > > Once the Netapp finishes with a saveset your backup server will
> > start
> > > > massaging the accumulated index files and create the
> > actual indexes
> > in
> > > > /nsr/index/Netapp directory.
> > > > During this massaging time, there are no backups to the specific
> > drive
> > > > that just finished the NDMP portion of the backup. This
> > "drive idle
> > > > time" will actually reduce the total average throughput you see
> > > > for the drive.
> > > > So I would assume that your /nsr/tmp or even the whole /nsr
> > filesystem
> > > > is overloaded during these backups.
> > > > I would suggest that you look at the I/O utilization of
> the /nsr
> > > > filesystem.
> > > >
> > > > One way (at least for test) to avoid this overhead would be to
> > > > completely suppress index generation for the NDMP backups. This
> > > > could be accomplished by specifying HIST=N as the only
> application
> > > > data information.
> > > > Itzik
> > > >
> > > >
> > > > > -----Original Message-----
> > > > > From: Legato NetWorker discussion
> > > > [mailto:NETWORKER AT LISTMAIL.TEMPLE DOT EDU] On Behalf Of Krishnan,
> > > > > Ramamurthy (Temp)
> > > > > Sent: Thursday, March 11, 2004 16:22
> > > > > To: NETWORKER AT LISTMAIL.TEMPLE DOT EDU
> > > > > Subject: Re: [Networker] Slow filer backups
> > > > >
> > > > > Matt
> > > > >
> > > > > - They are LTO-1 drives
> > > > > - OnTap version is 6.4.2 P9
> > > > > - Backing up volumes.
> > > > >
> > > > > thanks
> > > > >
> > > > > - Krishnan
> > > > >
> > > > > -----Original Message-----
> > > > > From: Matthew Huff [mailto:mhuff AT ox DOT com]
> > > > > Sent: 11 March 2004 14:11
> > > > > To: Legato NetWorker discussion; Krishnan, Ramamurthy (Temp)
> > > > > Subject: RE: [Networker] Slow filer backups
> > > > >
> > > > >
> > > > > Are those LTO-1 or LTO-2 drives? What OnTap version are you
> > running?
> > > > Are
> > > > > you backing up by volume or quota-tree?
> > > > >
> > > > > ----
> > > > > Matthew Huff | One Manhattanville Rd
> > > > > Director of Operations | Purchase, NY 10577
> > > > > OTA LLC | Phone: 914-460-4039
> > > > > http://www.otaotr.com | Fax: 914-460-4139
> > > > >
> > > > > > -----Original Message-----
> > > > > > From: Krishnan, Ramamurthy (Temp)
> > > > > > [mailto:Ramamurthy.Krishnan AT KPMG.CO DOT UK]
> > > > > > Sent: Thursday, March 11, 2004 8:49 AM
> > > > > > To: NETWORKER AT LISTMAIL.TEMPLE DOT EDU
> > > > > > Subject: [Networker] Slow filer backups
> > > > > >
> > > > > >
> > > > > > Hi all
> > > > > >
> > > > > > We have a set of NetApp 840 Filers that are
> connected to a ATL
> > > > > > P7K through a Gigabit switch. NetWorker 6.1.3 runs
> on Solaris
> > > > > > 8. The total backup size on an avg. is ~2TB a day. The
> > > > > > backups do run but are too slow. All the 12 LTO
> drives of the
> > > > > > library won't exceed 12Mb/s speed. The lowest
> > > > being 90Kb/s.
> > > > > >
> > > > > > Is it a normal show? Is there some way by which I
> can improve
> > > > > > the transfer speed, so backups finish faster? Any help is
> > > > > > appreciated.
> > > > > >
> > > > > > TIA
> > > > > >
> > > > > > - Krishnan
> > > > > >
> > > > > >
> > > > > > Email Disclaimer
> > > > > >
> > > > > > This email has been sent from KPMG LLP, a UK
> limited liability
> > > > > > partnership, or from one of the companies within
> its control
> > > > > > (which include KPMG Audit Plc , KPMG United Kingdom Plc and
> > > > > > KPMG UK Limited). The information in this email is
> > > > > > confidential and may be legally privileged. It is intended
> > > > > > solely for the addressee. Access to this email by
> anyone else
> > > > > > is unauthorised. If you are not the intended recipient, any
> > > > > > disclosure, copying, distribution or any action taken or
> > > > > > omitted to be taken in reliance on it, is
> prohibited and may
> > > > > > be unlawful. When addressed to our clients any opinions or
> > > > > > advice contained in this email are subject to the terms and
> > > > > > conditions expressed in the governing KPMG client
> engagement
> > > > > > letter.
> > > > > >
> > > > > > --
> > > > > > Note: To sign off this list, send a "signoff networker"
> > > > > > command via email to listserv AT listmail.temple DOT edu
> or visit the
> > > > > > list's Web site at
> > > > > > http://listmail.temple.edu/archives/networker.>
> html where you
> > > > > > can also view and post messages to the list.
> > > > > >
> > =*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=
> > > > > >
> > > > > >
> > > > >
> > > > >
> > > > >
> > > > > Email Disclaimer
> > > > >
> > > > > This email has been sent from KPMG LLP, a UK limited
> liability
> > > > > partnership, or from one of the companies within its control
> > > > > (which include KPMG Audit Plc , KPMG United Kingdom
> Plc and KPMG
> > > > > UK Limited). The information in this email is
> confidential and
> > > > > may be legally privileged. It is intended solely for the
> > > > > addressee. Access to this email by anyone else is
> unauthorised.
> > > > > If you are not the intended recipient, any
> disclosure, copying,
> > > > > distribution or any action taken or omitted to be taken in
> > > > > reliance on it, is prohibited and may be unlawful. When
> > > > > addressed to our clients any opinions or advice contained in
> > > > > this email are subject to the terms and conditions
> expressed in
> > > > > the governing KPMG client engagement letter.
> > > > >
> > > > > --
> > > > > Note: To sign off this list, send a "signoff
> networker" command
> > via
> > > > email
> > > > > to listserv AT listmail.temple DOT edu or visit the list's
> Web site at
> > > > > http://listmail.temple.edu/archives/networker.html
> where you can
> > > > > also view and post messages to the list.
> > > > >
> =*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=
> > > >
> > > >
> > > > **************************************************************
> > > > ************************************
> > > > The contents of this email and any attachments are
> confidential.
> > > > It is intended for the named recipient(s) only. If you have
> > > > received this email in error please notify the system
> manager or
> > > > the sender immediately and do not disclose the contents to any
> > > > one or make copies.
> > > >
> > > > MBI - System Team
> > > > **************************************************************
> > > > ************************************
> > > >
> > > > --
> > > > Note: To sign off this list, send a "signoff networker" command
> > > > via email to listserv AT listmail.temple DOT edu or visit the
> list's Web
> > > > site at
> http://listmail.temple.edu/archives/networker.html where
> > > > you can also view and post messages to the list.
> > > > =*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=
> > > >
> > >
> > >
> > > Email Disclaimer
> > >
> > > This email has been sent from KPMG LLP, a UK limited liability
> > > partnership, or from one of the companies within its
> control (which
> > > include KPMG Audit Plc , KPMG United Kingdom Plc and KPMG UK
> > > Limited). The information in this email is confidential
> and may be
> > > legally privileged. It is intended solely for the
> addressee. Access
> > > to this email by anyone else is unauthorised. If you are not the
> > > intended recipient, any disclosure, copying, distribution
> > > or any action taken or omitted to be taken in reliance on it,
> > > is prohibited and may be unlawful. When addressed to
> > > our clients any opinions or advice contained in this email
> > > are subject to the terms and conditions expressed in the
> > > governing KPMG client engagement letter.
> > >
> > > --
> > > Note: To sign off this list, send a "signoff networker"
> command via
> > email
> > > to listserv AT listmail.temple DOT edu or visit the list's Web site at
> > > http://listmail.temple.edu/archives/networker.html where you can
> > > also view and post messages to the list.
> > > =*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=
> >
> >
> > **************************************************************
> > ************************************
> > The contents of this email and any attachments are
> confidential. It is
> > intended for the named recipient(s) only. If you have received this
> > email in error please notify the system manager or the
> > sender immediately and do not disclose the contents to any
> > one or make copies.
> >
> > MBI - System Team
> > **************************************************************
> > ************************************
> >
> > --
> > Note: To sign off this list, send a "signoff networker"
> > command via email
> > to listserv AT listmail.temple DOT edu or visit the list's Web site at
> > http://listmail.temple.edu/archives/networker.html where you can
> > also view and post messages to the list.
> > =*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=
> >
>
>
> Email Disclaimer
>
> This email has been sent from KPMG LLP, a UK limited
> liability partnership, or from one of the companies within
> its control (which include KPMG Audit Plc , KPMG United
> Kingdom Plc and KPMG UK Limited). The information in
> this email is confidential and may be legally privileged.
> It is intended solely for the addressee. Access to this
> email by anyone else is unauthorised. If you are not the
> intended recipient, any disclosure, copying, distribution
> or any action taken or omitted to be taken in reliance on it,
> is prohibited and may be unlawful. When addressed to
> our clients any opinions or advice contained in this email
> are subject to the terms and conditions expressed in the
> governing KPMG client engagement letter.
>
> --
> Note: To sign off this list, send a "signoff networker"
> command via email
> to listserv AT listmail.temple DOT edu or visit the list's Web site at
> http://listmail.temple.edu/archives/networker.html where you can
> also view and post messages to the list.
> =*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=
>
>
--
Note: To sign off this list, send a "signoff networker" command via email
to listserv AT listmail.temple DOT edu or visit the list's Web site at
http://listmail.temple.edu/archives/networker.html where you can
also view and post messages to the list.
=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=
|
