Networker
[Top] [All Lists]
<prev [Date] next>
[Advanced]
 <prev [Thread] next>

Re: [Networker] How to improve performance

2004-10-22 11:50:58
Subject: Re: [Networker] How to improve performance
From: Robert Maiello <robert.maiello AT PFIZER DOT COM>
To: NETWORKER AT LISTMAIL.TEMPLE DOT EDU
Date: Fri, 22 Oct 2004 11:50:34 -0400 
How many files is networker reporting that it backed up?   I will concur
that at certain number of files, even with directly mounted disks, Networker
can slow down to the rate your saying.   Snapshot and block level type
backup products need to be considered at this point; the fastest disks, SAN
and tapes drives will not help with situations with millions of tiny files.

Legato does make a snapshot product ..anyone using it and care to comment
on it ?



Robert Maiello
Pioneer Data Systems

On Sat, 23 Oct 2004 00:36:18 +0900, Rahul Parasnis <rahulparasnis AT MSN DOT 
COM>
wrote:

>After talking to Legato Support on this case finally I have come to
>conclusion that I can increase speed of the backup .
>
>This is mainly because of high number of files .
>
>Veritas Backup Exec was( using DLT8000 )  doing the backup in 5 hours where
>Legato Takes 8 hours for the same amount of data but higher speed drives(
>LTO-2 )  .
>
>This is really disappointing , when you have bought Legato SAN backup with
>Direct Storeage Node like  Expensive License and it is giving sometimes 256
>K /s speed .
>
>best regards,
>- Rahul
>>From: Tarik El Mansouri <etarik AT YAHOO DOT COM>
>>Reply-To: Legato NetWorker discussion <NETWORKER AT LISTMAIL.TEMPLE DOT EDU>,
>>         Tarik El Mansouri <etarik AT YAHOO DOT COM>
>>To: NETWORKER AT LISTMAIL.TEMPLE DOT EDU
>>Subject: Re: [Networker] How to improve performance
>>Date: Thu, 21 Oct 2004 05:30:55 +0200
>>
>>You wrote:
>>
>>Oct 21 04:56:59 CLIENT1 : E:\      level=full,     18 GB  01:33:37  61978
>>files
>>Oct 21 04:56:59 CLIENT1: F:\       level=full,    246 KB  00:00:06     30
>>files
>>Oct 21 04:56:59 CLIENT1: G:\       level=full,     10 GB  01:01:35  30313
>>files
>>Oct 21 04:56:59 CLIENT1: H:\       level=full,     87 GB  06:51:49 205950
>>files
>>
>>Oct 21 04:46:03 CLIENT2: C:\       level=full,   1180 MB  00:08:26  12540
>>files
>>Oct 21 04:46:03 CLIENT2: D:\       level=full,    225 GB  06:42:09 383748
>>files
>>
>>What can of disk storage do you have ? DAS/JBOD/Array.
>>
>>Are those clients defined in the same group ?  if yes, change the priority
>>of the client2 to start first.
>>Change the target sessions to make sure you don't have several save sets on
>>the same drive, as you have enough drive to do it.
>>
>>
>>Try also to use the backup command "save -i" to ignore directive files
>>scans in your subdirectories during the backup. If there's a lot of
>>directories it canhelp. You are still use the server "NSR directive" if
>>required.
>>
>>Check the fragmentation of your drive, defragment it if necessary. The
>>defragmentation can reduce dramatically your backup.
>>
>>Good luck.
>>
>>
>>Rahul Parasnis <rahulparasnis AT MSN DOT COM> wrote:
>>We have allocated 6 Drives with 3 as taget sessions for Each Drive . Infact
>>One Drive letter has 260 GB Data so one session is requierd .
>>
>>Brocade Switch Model = BROCADE SilkWorm3900 32port 2Gbit FC Switch
>>
>>In fact Backup Exec was having DLT8000 drives and SAN environment brocade
>>Switch , with Lp950 Cards on Direct Storage Nodes . We just replaced these
>>cards to Lp10000 when we installed networker .
>>
>>Nothing was changed from Server point of view .
>>
>> >From: Tarik El Mansouri
>> >Reply-To: Legato NetWorker discussion ,
>> > Tarik El Mansouri
>> >To: NETWORKER AT LISTMAIL.TEMPLE DOT EDU
>> >Subject: Re: [Networker] How to improve performance
>> >Date: Thu, 21 Oct 2004 04:17:09 +0200
>> >
>> >Hello Rahul,
>> >
>> >As I understand you share the 6 LTO2 drives between the Solairs Backup
>> >server and two windows servers.
>> >
>> >- How many drives do you have per FC HBA (related to your zoning)?
>>
>> >- Which Brocade switch model do you have ?
>> >
>> >You must have a maximum of 3 drives per FC HBA, if you SAN is 2GB
>> >end-to-end (HBA and switch). If the switch or the HBA is 1GB, then you
>>can
>> >only have one drive per HBA.
>> >
>> >You compare Backup Exec to Networker backup times, was it on the same
>> >infrastructure ?
>> >
>> >Regards.
>> >
>> >Rahul Parasnis wrote:
>> >As I have mention in my Earlier mail ,
>> >
>> >I am using SAN backup with Brocade Switch , I am not using GB Network .
>> >
>> >Two clients in question are Direct Storage Nodes connected to SAN Switch
>>by
>> >LP10000 HBA card and L180 is also connected to Brocade switch Via Fibre .
>> >
>> >ALL the Six LTO-2 drives are having separate Fibre connection .
>> >
>> >On Server Side I have LP9000 Card on V440 Solaris 9 server also connected
>> >to
>> >SAN Brocade Switch via Fibre .
>> >
>> >Which means my Network has 2GBps Speed .
>> >
>> >
>> > >From: Somen Chanda
>> > >Reply-To: Legato NetWorker discussion ,
>> > > Somen Chanda
>> > >To: NETWORKER AT LISTMAIL.TEMPLE DOT EDU
>> > >Subject: Re: [Networker] How to improve performance
>> > >Date: Wed, 20 Oct 2004 09:19:22 -0400
>> > >
>> > >What kind of network do you have? Make sure to increase the number of
>> > >streams on each drive. With a 100Mb network you should get upto
>> > >11-12Mb/sec and with GigE network you should see a speed of at least
>> > >more than 35Mb/sec on each drive and with LTO-2 you should be faster
>>but
>> > >network is the most important factor.
>> > >
>> > >Somen
>> > >
>> > >-----Original Message-----
>> > >From: Rahul Parasnis [mailto:rahulparasnis AT MSN DOT COM]
>> > >Sent: Tuesday, October 19, 2004 11:20 PM
>> > >To: NETWORKER AT LISTMAIL.TEMPLE DOT EDU
>> > >Subject: [Networker] How to improve performance
>> > >
>> > >Hello ,
>> > >I have recently installd new Networker Server on Solaris 9 with L180 of
>> > >8
>> > >Drives .
>> > >Enviromment .
>> > >
>> > >Server Solaris 9 , V440 2 CPU 4 GB
>> > >Brocade Switch .
>> > >L180 and Lto-2 drives
>> > >Lp9000 HBA card on Solaris
>> > >LP10000 card on Windows 2000 and windows 2003 cluster DSN's .
>> > >
>> > >I am backing the two DSN on this networker Server , these two were
>> > >backed up
>> > >before by Veritas backup exec and time was 3 hours and 5 respectiveyl
>> > >for
>> > >80 GB and 260 GB data size .
>> > >
>> > >
>> > >Now it takes 7 hours .
>> > >
>> > >I need help in making this backup faster . backup speed sometinmes goes
>> > >as
>> > >slow as 300kb/s and sometimes it goes to 45 MB/s (!)
>> > >
>> > >
>> > >Following is just an idea for you to understand characteristics of
>> > >client .
>> > >Oct 17 23:49:03 [ID 702911 daemon.notice] Start time: Sun Oct 17
>> > >16:30:30
>> > >2004
>> > >Oct 17 23:49:03 [ID 702911 daemon.notice] End time: Sun Oct 17
>> > >23:49:03
>> > >2004
>> > >
>> > >Oct 17 23:49:03 [ID 702911 daemon.notice] CLIENT1: C:\
>> > >level=full, 1180 MB 00:07:59 12520 files
>> > >Oct 17 23:49:03 tksubkp1 root: [ID 702911 daemon.notice] CLIENT1D:\
>> > > level=full, 286 GB 07:14:14 491029 files
>> > >
>> > >Oct 17 23:49:03 tksubkp1 root: [ID 702911 daemon.notice] Start time:
>> > >Sun
>> > >Oct 17 16:30:30 2004
>> > >Oct 17 23:49:03 tksubkp1 root: [ID 702911 daemon.notice] End time:
>> > >Sun
>> > >Oct 17 23:49:03 2004
>> > >
>> > >
>> > >Oct 17 23:49:03 [ID 702911 daemon.notice] CLIENT2 : C:\
>> > >level=full, 1180 MB 00:07:59 12520 files
>> > >Oct 17 23:49:03 ID 702911 daemon.notice] CLIENT2 : D:\
>> > >level=full, 286 GB 07:14:14 491029 files
>> > >
>> > >_________________________________________________________________
>> > >Express yourself instantly with MSN Messenger! Download today it's
>>FREE!
>> > >http://messenger.msn.com/
>> > >
>> > >--
>> > >Note: To sign off this list, send a "signoff networker" command via
>> > >email
>> > >to listserv AT listmail.temple DOT edu or visit the list's Web site at
>> > >http://listmail.temple.edu/archives/networker.html where you can
>> > >also view and post messages to the list. Questions regarding this list
>> > >should be sent to stan AT temple DOT edu
>> > >=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=
>> > >
>> > >--
>> > >Note: To sign off this list, send a "signoff networker" command via
>>email
>> > >to listserv AT listmail.temple DOT edu or visit the list's Web site at
>> > >http://listmail.temple.edu/archives/networker.html where you can
>> > >also view and post messages to the list. Questions regarding this list
>> > >should be sent to stan AT temple DOT edu
>> > >=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=
>> >
>> >_________________________________________________________________
>> >Express yourself instantly with MSN Messenger! Download today it's FREE!
>> >http://messenger.msn.com/
>> >
>> >--
>> >Note: To sign off this list, send a "signoff networker" command via email
>> >to listserv AT listmail.temple DOT edu or visit the list's Web site at
>> >http://listmail.temple.edu/archives/networker.html where you can
>> >also view and post messages to the list. Questions regarding this list
>> >should be sent to stan AT temple DOT edu
>> >=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=
>> >
>> >
>> >---------------------------------
>> >Créez gratuitement votre Yahoo! Mail avec 100 Mo de stockage !
>> >Créez votre Yahoo! Mail
>> >
>> >Le nouveau Yahoo! Messenger est arrivé ! Découvrez toutes les nouveautés
>> >pour dialoguer instantanément avec vos amis.Téléchargez GRATUITEMENT ici
>>!
>> >
>> >--
>> >Note: To sign off this list, send a "signoff networker" command via email
>> >to listserv AT listmail.temple DOT edu or visit the list's Web site at
>> >http://listmail.temple.edu/archives/networker.html where you can
>> >also view and post messages to the list. Questions regarding this list
>> >should be sent to stan AT temple DOT edu
>> >=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=
>>
>>_________________________________________________________________
>>Express yourself instantly with MSN Messenger! Download today it's FREE!
>>http://messenger.msn.com/
>>
>>--
>>Note: To sign off this list, send a "signoff networker" command via email
>>to listserv AT listmail.temple DOT edu or visit the list's Web site at
>>http://listmail.temple.edu/archives/networker.html where you can
>>also view and post messages to the list. Questions regarding this list
>>should be sent to stan AT temple DOT edu
>>=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=
>>
>>
>>---------------------------------
>>Créez gratuitement votre Yahoo! Mail avec 100 Mo de stockage !
>>Créez votre Yahoo! Mail
>>
>>Le nouveau Yahoo! Messenger est arrivé ! Découvrez toutes les nouveautés
>>pour dialoguer instantanément avec vos amis.Téléchargez GRATUITEMENT ici !
>>
>>--
>>Note: To sign off this list, send a "signoff networker" command via email
>>to listserv AT listmail.temple DOT edu or visit the list's Web site at
>>http://listmail.temple.edu/archives/networker.html where you can
>>also view and post messages to the list. Questions regarding this list
>>should be sent to stan AT temple DOT edu
>>=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=
>
>_________________________________________________________________
>FREE pop-up blocking with the new MSN Toolbar - get it now!
>http://toolbar.msn.com/
>
>--
>Note: To sign off this list, send a "signoff networker" command via email
>to listserv AT listmail.temple DOT edu or visit the list's Web site at
>http://listmail.temple.edu/archives/networker.html where you can
>also view and post messages to the list. Questions regarding this list
>should be sent to stan AT temple DOT edu
>=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=

--
Note: To sign off this list, send a "signoff networker" command via email
to listserv AT listmail.temple DOT edu or visit the list's Web site at
http://listmail.temple.edu/archives/networker.html where you can
also view and post messages to the list. Questions regarding this list
should be sent to stan AT temple DOT edu
=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=
[More with this subject...]
<Prev in Thread] Current Thread [Next in Thread>
Previous by Date:  [Networker] backup size, Michael Brooks
Next by Date:  Re: [Networker] How to improve performance, Tony Skalski
Previous by Thread:  Re: [Networker] How to improve performance, Tony Skalski
Next by Thread:  Re: [Networker] How to improve performance, Fields, David
Indexes:  [Date] [Thread] [Top] [All Lists]