Networker

Re: [Networker] How to improve performance

2004-10-27 08:54:06
Subject: Re: [Networker] How to improve performance
From: Rahul Parasnis <rahulparasnis AT MSN DOT COM>
To: NETWORKER AT LISTMAIL.TEMPLE DOT EDU
Date: Wed, 27 Oct 2004 21:52:38 +0900
After little more investigation I am giving following information .

This windows 2000 Client ( Which was before backed up by Backup Exec in 3
Hours )
Following result after changing the client Parallelism to 1 ,  infact it is
more slower . But individual drive speed is faster .

Start time:   Tue Oct 26 22:00:00 2004
End time:     Wed Oct 27 06:27:07 2004
--- Successful Save Sets ---
ClusterCLIENT1: C:\                      level=full,   1034 MB 00:07:09
11667 files
ClusterCLIENT1: D:\                      level=full,     14 MB 00:00:06
54 files
ClusterCLIENT1: E:\                      level=full,     18 GB 01:02:28
61978 files
ClusterCLIENT1: F:\                      level=full,    246 KB 00:00:06
30 files
ClusterCLIENT1: G:\                      level=full,     10 GB 00:37:02
30319 files
ClusterCLIENT1: H:\                      level=full,     87 GB 06:34:11
206916 files

Clearly H: drive is taking more than 6 hours .
If it is disk problem , then why Veritas was able to backup this in 3 hours
??

Disk info is like this .
HP storage works 4100 SCSI disks  External Storage connected with Fibre .
Secure Path loaded .
H: is  disk array partition with Raid 5 . . User data is located on this
drive( file server ) , At max 5 users might be accessing this data during
night .
G: is application folder where all executables are stored which is static
data . Faster performance


I  am having hard time understanding that same client with Dlt8000 drives
was getting backedup in 3 Hours and Now with Networker 7.1.2 , Solaris 9
V440 Server with Lp1000 and LP 9000 emulex HBA cards it is taking 8 Hours .

Can anybody tell me , am I missing a point ?
Legato can perform so much worst than backup exec .

Second Node same story . 260 GB data was getting backed up by Backup exec in
6 Hours .

Now

CLIENT2  is windows 2003
Start time:   Tue Oct 26 22:00:00 2004
End time:     Wed Oct 27 06:32:43 2004

Local SCSI drive . D: is Raid 5

--- Successful Save Sets ---
CLIENT2 : C:\                    level=full,   1166 MB 00:08:32  12529 files
CLIENT2: D:\                    level=full,    257 GB 08:28:13 494566 files


Looks like Legato is having problem  with no of files and windows machine .

I am happy to receive anybody's suggestion to improve this performance .
Once again I am disappointed with Legato .

best regards,
- Rahul Parasnis

From: Rahul Parasnis <rahulparasnis AT MSN DOT COM>
Reply-To: Legato NetWorker discussion <NETWORKER AT LISTMAIL.TEMPLE DOT EDU>,
        Rahul Parasnis <rahulparasnis AT MSN DOT COM>
To: NETWORKER AT LISTMAIL.TEMPLE DOT EDU
Subject: Re: [Networker] How to improve performance
Date: Sat, 23 Oct 2004 08:44:41 +0900

500 thousand and 300 thousand for second client , which according to Legato
support " not too much " files .

Snap shot product can work only in Windows , that what I heard . Server can
not be solaris in that case .

Overall point is clearly there is design problem adding extra product may I
can do that but legato has  to improve in this area much quickly .

Japanese charactors I can not see when I am browsing the files in recover
window . According to Legato I have to use japanese Solaris and Japanese
Legato then I can do it . While Veritas does not have to do any of this
kind
.

regards,
- Rahul


From: Robert Maiello <robert.maiello AT PFIZER DOT COM>
To: NETWORKER AT LISTMAIL.TEMPLE DOT EDU,              Rahul Parasnis
<rahulparasnis AT MSN DOT COM>
Subject: Re: How to improve performance
Date: Fri, 22 Oct 2004 11:50:34 -0400

How many files is networker reporting that it backed up?   I will concur
that at certain number of files, even with directly mounted disks,
Networker
can slow down to the rate your saying.   Snapshot and block level type
backup products need to be considered at this point; the fastest disks,
SAN
and tapes drives will not help with situations with millions of tiny
files.

Legato does make a snapshot product ..anyone using it and care to comment
on it ?



Robert Maiello
Pioneer Data Systems

On Sat, 23 Oct 2004 00:36:18 +0900, Rahul Parasnis <rahulparasnis AT MSN DOT 
COM>
wrote:

>After talking to Legato Support on this case finally I have come to
>conclusion that I can increase speed of the backup .
>
>This is mainly because of high number of files .
>
>Veritas Backup Exec was( using DLT8000 )  doing the backup in 5 hours
where
>Legato Takes 8 hours for the same amount of data but higher speed
drives(
>LTO-2 )  .
>
>This is really disappointing , when you have bought Legato SAN backup
with
>Direct Storeage Node like  Expensive License and it is giving sometimes
256
>K /s speed .
>
>best regards,
>- Rahul
>>From: Tarik El Mansouri <etarik AT YAHOO DOT COM>
>>Reply-To: Legato NetWorker discussion <NETWORKER AT LISTMAIL.TEMPLE DOT EDU>,
>>         Tarik El Mansouri <etarik AT YAHOO DOT COM>
>>To: NETWORKER AT LISTMAIL.TEMPLE DOT EDU
>>Subject: Re: [Networker] How to improve performance
>>Date: Thu, 21 Oct 2004 05:30:55 +0200
>>
>>You wrote:
>>
>>Oct 21 04:56:59 CLIENT1 : E:\      level=full,     18 GB  01:33:37
61978
>>files
>>Oct 21 04:56:59 CLIENT1: F:\       level=full,    246 KB  00:00:06
30
>>files
>>Oct 21 04:56:59 CLIENT1: G:\       level=full,     10 GB  01:01:35
30313
>>files
>>Oct 21 04:56:59 CLIENT1: H:\       level=full,     87 GB  06:51:49
205950
>>files
>>
>>Oct 21 04:46:03 CLIENT2: C:\       level=full,   1180 MB  00:08:26
12540
>>files
>>Oct 21 04:46:03 CLIENT2: D:\       level=full,    225 GB  06:42:09
383748
>>files
>>
>>What can of disk storage do you have ? DAS/JBOD/Array.
>>
>>Are those clients defined in the same group ?  if yes, change the
priority
>>of the client2 to start first.
>>Change the target sessions to make sure you don't have several save
sets
on
>>the same drive, as you have enough drive to do it.
>>
>>
>>Try also to use the backup command "save -i" to ignore directive files
>>scans in your subdirectories during the backup. If there's a lot of
>>directories it canhelp. You are still use the server "NSR directive" if
>>required.
>>
>>Check the fragmentation of your drive, defragment it if necessary. The
>>defragmentation can reduce dramatically your backup.
>>
>>Good luck.
>>
>>
>>Rahul Parasnis <rahulparasnis AT MSN DOT COM> wrote:
>>We have allocated 6 Drives with 3 as taget sessions for Each Drive .
Infact
>>One Drive letter has 260 GB Data so one session is requierd .
>>
>>Brocade Switch Model = BROCADE SilkWorm3900 32port 2Gbit FC Switch
>>
>>In fact Backup Exec was having DLT8000 drives and SAN environment
brocade
>>Switch , with Lp950 Cards on Direct Storage Nodes . We just replaced
these
>>cards to Lp10000 when we installed networker .
>>
>>Nothing was changed from Server point of view .
>>
>> >From: Tarik El Mansouri
>> >Reply-To: Legato NetWorker discussion ,
>> > Tarik El Mansouri
>> >To: NETWORKER AT LISTMAIL.TEMPLE DOT EDU
>> >Subject: Re: [Networker] How to improve performance
>> >Date: Thu, 21 Oct 2004 04:17:09 +0200
>> >
>> >Hello Rahul,
>> >
>> >As I understand you share the 6 LTO2 drives between the Solairs
Backup
>> >server and two windows servers.
>> >
>> >- How many drives do you have per FC HBA (related to your zoning)?
>>
>> >- Which Brocade switch model do you have ?
>> >
>> >You must have a maximum of 3 drives per FC HBA, if you SAN is 2GB
>> >end-to-end (HBA and switch). If the switch or the HBA is 1GB, then
you
>>can
>> >only have one drive per HBA.
>> >
>> >You compare Backup Exec to Networker backup times, was it on the same
>> >infrastructure ?
>> >
>> >Regards.
>> >
>> >Rahul Parasnis wrote:
>> >As I have mention in my Earlier mail ,
>> >
>> >I am using SAN backup with Brocade Switch , I am not using GB Network
.
>> >
>> >Two clients in question are Direct Storage Nodes connected to SAN
Switch
>>by
>> >LP10000 HBA card and L180 is also connected to Brocade switch Via
Fibre .
>> >
>> >ALL the Six LTO-2 drives are having separate Fibre connection .
>> >
>> >On Server Side I have LP9000 Card on V440 Solaris 9 server also
connected
>> >to
>> >SAN Brocade Switch via Fibre .
>> >
>> >Which means my Network has 2GBps Speed .
>> >
>> >
>> > >From: Somen Chanda
>> > >Reply-To: Legato NetWorker discussion ,
>> > > Somen Chanda
>> > >To: NETWORKER AT LISTMAIL.TEMPLE DOT EDU
>> > >Subject: Re: [Networker] How to improve performance
>> > >Date: Wed, 20 Oct 2004 09:19:22 -0400
>> > >
>> > >What kind of network do you have? Make sure to increase the number
of
>> > >streams on each drive. With a 100Mb network you should get upto
>> > >11-12Mb/sec and with GigE network you should see a speed of at
least
>> > >more than 35Mb/sec on each drive and with LTO-2 you should be
faster
>>but
>> > >network is the most important factor.
>> > >
>> > >Somen
>> > >
>> > >-----Original Message-----
>> > >From: Rahul Parasnis [mailto:rahulparasnis AT MSN DOT COM]
>> > >Sent: Tuesday, October 19, 2004 11:20 PM
>> > >To: NETWORKER AT LISTMAIL.TEMPLE DOT EDU
>> > >Subject: [Networker] How to improve performance
>> > >
>> > >Hello ,
>> > >I have recently installd new Networker Server on Solaris 9 with
L180
of
>> > >8
>> > >Drives .
>> > >Enviromment .
>> > >
>> > >Server Solaris 9 , V440 2 CPU 4 GB
>> > >Brocade Switch .
>> > >L180 and Lto-2 drives
>> > >Lp9000 HBA card on Solaris
>> > >LP10000 card on Windows 2000 and windows 2003 cluster DSN's .
>> > >
>> > >I am backing the two DSN on this networker Server , these two were
>> > >backed up
>> > >before by Veritas backup exec and time was 3 hours and 5
respectiveyl
>> > >for
>> > >80 GB and 260 GB data size .
>> > >
>> > >
>> > >Now it takes 7 hours .
>> > >
>> > >I need help in making this backup faster . backup speed sometinmes
goes
>> > >as
>> > >slow as 300kb/s and sometimes it goes to 45 MB/s (!)
>> > >
>> > >
>> > >Following is just an idea for you to understand characteristics of
>> > >client .
>> > >Oct 17 23:49:03 [ID 702911 daemon.notice] Start time: Sun Oct 17
>> > >16:30:30
>> > >2004
>> > >Oct 17 23:49:03 [ID 702911 daemon.notice] End time: Sun Oct 17
>> > >23:49:03
>> > >2004
>> > >
>> > >Oct 17 23:49:03 [ID 702911 daemon.notice] CLIENT1: C:\
>> > >level=full, 1180 MB 00:07:59 12520 files
>> > >Oct 17 23:49:03 tksubkp1 root: [ID 702911 daemon.notice] CLIENT1D:\
>> > > level=full, 286 GB 07:14:14 491029 files
>> > >
>> > >Oct 17 23:49:03 tksubkp1 root: [ID 702911 daemon.notice] Start
time:
>> > >Sun
>> > >Oct 17 16:30:30 2004
>> > >Oct 17 23:49:03 tksubkp1 root: [ID 702911 daemon.notice] End time:
>> > >Sun
>> > >Oct 17 23:49:03 2004
>> > >
>> > >
>> > >Oct 17 23:49:03 [ID 702911 daemon.notice] CLIENT2 : C:\
>> > >level=full, 1180 MB 00:07:59 12520 files
>> > >Oct 17 23:49:03 ID 702911 daemon.notice] CLIENT2 : D:\
>> > >level=full, 286 GB 07:14:14 491029 files
>> > >
>> > >_________________________________________________________________
>> > >Express yourself instantly with MSN Messenger! Download today it's
>>FREE!
>> > >http://messenger.msn.com/
>> > >
>> > >--
>> > >Note: To sign off this list, send a "signoff networker" command via
>> > >email
>> > >to listserv AT listmail.temple DOT edu or visit the list's Web site at
>> > >http://listmail.temple.edu/archives/networker.html where you can
>> > >also view and post messages to the list. Questions regarding this
list
>> > >should be sent to stan AT temple DOT edu
>> > >=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=
>> > >
>> > >--
>> > >Note: To sign off this list, send a "signoff networker" command via
>>email
>> > >to listserv AT listmail.temple DOT edu or visit the list's Web site at
>> > >http://listmail.temple.edu/archives/networker.html where you can
>> > >also view and post messages to the list. Questions regarding this
list
>> > >should be sent to stan AT temple DOT edu
>> > >=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=
>> >
>> >_________________________________________________________________
>> >Express yourself instantly with MSN Messenger! Download today it's
FREE!
>> >http://messenger.msn.com/
>> >
>> >--
>> >Note: To sign off this list, send a "signoff networker" command via
email
>> >to listserv AT listmail.temple DOT edu or visit the list's Web site at
>> >http://listmail.temple.edu/archives/networker.html where you can
>> >also view and post messages to the list. Questions regarding this
list
>> >should be sent to stan AT temple DOT edu
>> >=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=
>> >
>> >
>> >---------------------------------
>> >Créez gratuitement votre Yahoo! Mail avec 100 Mo de stockage !
>> >Créez votre Yahoo! Mail
>> >
>> >Le nouveau Yahoo! Messenger est arrivé ! Découvrez toutes les
nouveautés
>> >pour dialoguer instantanément avec vos amis.Téléchargez GRATUITEMENT
ici
>>!
>> >
>> >--
>> >Note: To sign off this list, send a "signoff networker" command via
email
>> >to listserv AT listmail.temple DOT edu or visit the list's Web site at
>> >http://listmail.temple.edu/archives/networker.html where you can
>> >also view and post messages to the list. Questions regarding this
list
>> >should be sent to stan AT temple DOT edu
>> >=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=
>>
>>_________________________________________________________________
>>Express yourself instantly with MSN Messenger! Download today it's
FREE!
>>http://messenger.msn.com/
>>
>>--
>>Note: To sign off this list, send a "signoff networker" command via
email
>>to listserv AT listmail.temple DOT edu or visit the list's Web site at
>>http://listmail.temple.edu/archives/networker.html where you can
>>also view and post messages to the list. Questions regarding this list
>>should be sent to stan AT temple DOT edu
>>=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=
>>
>>
>>---------------------------------
>>Créez gratuitement votre Yahoo! Mail avec 100 Mo de stockage !
>>Créez votre Yahoo! Mail
>>
>>Le nouveau Yahoo! Messenger est arrivé ! Découvrez toutes les
nouveautés
>>pour dialoguer instantanément avec vos amis.Téléchargez GRATUITEMENT
ici
!
>>
>>--
>>Note: To sign off this list, send a "signoff networker" command via
email
>>to listserv AT listmail.temple DOT edu or visit the list's Web site at
>>http://listmail.temple.edu/archives/networker.html where you can
>>also view and post messages to the list. Questions regarding this list
>>should be sent to stan AT temple DOT edu
>>=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=
>
>_________________________________________________________________
>FREE pop-up blocking with the new MSN Toolbar - get it now!
>http://toolbar.msn.com/
>
>--
>Note: To sign off this list, send a "signoff networker" command via
email
>to listserv AT listmail.temple DOT edu or visit the list's Web site at
>http://listmail.temple.edu/archives/networker.html where you can
>also view and post messages to the list. Questions regarding this list
>should be sent to stan AT temple DOT edu
>=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=

_________________________________________________________________
Don't just search. Find. Check out the new MSN Search!
http://search.msn.com/

--
Note: To sign off this list, send a "signoff networker" command via email
to listserv AT listmail.temple DOT edu or visit the list's Web site at
http://listmail.temple.edu/archives/networker.html where you can
also view and post messages to the list. Questions regarding this list
should be sent to stan AT temple DOT edu
=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=

_________________________________________________________________
FREE pop-up blocking with the new MSN Toolbar - get it now!
http://toolbar.msn.com/

--
Note: To sign off this list, send a "signoff networker" command via email
to listserv AT listmail.temple DOT edu or visit the list's Web site at
http://listmail.temple.edu/archives/networker.html where you can
also view and post messages to the list. Questions regarding this list
should be sent to stan AT temple DOT edu
=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=