There was some discussion on this list in the past year about this. I think
the end result was that Legato was looking at how to provide multiple streams
per file system.
I tried searching but I couldn't find it in the archives.
Brian
-----Original Message-----
From: Legato NetWorker discussion on behalf of Rahul Parasnis
Sent: Sat 11/6/2004 5:22 AM
To: NETWORKER AT LISTMAIL.TEMPLE DOT EDU
Cc:
Subject: Re: [Networker] How to improve performance
Here is update on this subject .
Client whose backup was taking 8 houors for 260 GB data size havinf
SCSI
local Hasrd disks and 500 hundred thousand files were reduced t0 3
Hours .
As I was pointing that nothing changed when we moved server from old
Building to new building .
Old building had Backup Exec hacking in 6 hours . Legato was taking 8
hours
.
Then finally we add in the save set directive all the directories and
made
client parallellism to 7 .
Backup was taking time upto 3 hours only .
Conclusion :
1. There is way to improve the backup that is positive sign for
Legato .
But listing all directories is not very good way as whenever new
directory
is added on the server we need to add in saveset list .
Is there anyway we can do this automatically ? Sombody on this list
must
have addressed this already .
2. Clearly Legato has to improve the backup speed , having one drive
letter
with big data size .
Legato starts one session assuming drive letter is one regardless of
size of
the drive .
And moreover Backup exec does the same thing but does it in less time
that
proves some backupexec in this particular case ( having one drive
with big
data size ) has better performance .
However the second client is still not improved .I am working on it .
will keep you posted .
best regards,
- Rahul
>From: Rahul Parasnis <rahulparasnis AT MSN DOT COM>
>Reply-To: Legato NetWorker discussion
<NETWORKER AT LISTMAIL.TEMPLE DOT EDU>,
> Rahul Parasnis <rahulparasnis AT MSN DOT COM>
>To: NETWORKER AT LISTMAIL.TEMPLE DOT EDU
>Subject: Re: [Networker] How to improve performance
>Date: Sat, 23 Oct 2004 08:44:41 +0900
>
>500 thousand and 300 thousand for second client , which according to
Legato
>support " not too much " files .
>
>Snap shot product can work only in Windows , that what I heard .
Server can
>not be solaris in that case .
>
>Overall point is clearly there is design problem adding extra
product may I
>can do that but legato has to improve in this area much quickly .
>
>Japanese charactors I can not see when I am browsing the files in
recover
>window . According to Legato I have to use japanese Solaris and
Japanese
>Legato then I can do it . While Veritas does not have to do any of
this
>kind
>.
>
>regards,
>- Rahul
>
>
>>From: Robert Maiello <robert.maiello AT PFIZER DOT COM>
>>To: NETWORKER AT LISTMAIL.TEMPLE DOT EDU, Rahul Parasnis
>><rahulparasnis AT MSN DOT COM>
>>Subject: Re: How to improve performance
>>Date: Fri, 22 Oct 2004 11:50:34 -0400
>>
>>How many files is networker reporting that it backed up? I will
concur
>>that at certain number of files, even with directly mounted disks,
>>Networker
>>can slow down to the rate your saying. Snapshot and block level
type
>>backup products need to be considered at this point; the fastest
disks,
>>SAN
>>and tapes drives will not help with situations with millions of
tiny
>>files.
>>
>>Legato does make a snapshot product ..anyone using it and care to
comment
>>on it ?
>>
>>
>>
>>Robert Maiello
>>Pioneer Data Systems
>>
>>On Sat, 23 Oct 2004 00:36:18 +0900, Rahul Parasnis
<rahulparasnis AT MSN DOT COM>
>>wrote:
>>
>> >After talking to Legato Support on this case finally I have come
to
>> >conclusion that I can increase speed of the backup .
>> >
>> >This is mainly because of high number of files .
>> >
>> >Veritas Backup Exec was( using DLT8000 ) doing the backup in 5
hours
>>where
>> >Legato Takes 8 hours for the same amount of data but higher speed
>>drives(
>> >LTO-2 ) .
>> >
>> >This is really disappointing , when you have bought Legato SAN
backup
>>with
>> >Direct Storeage Node like Expensive License and it is giving
sometimes
>>256
>> >K /s speed .
>> >
>> >best regards,
>> >- Rahul
>> >>From: Tarik El Mansouri <etarik AT YAHOO DOT COM>
>> >>Reply-To: Legato NetWorker discussion
<NETWORKER AT LISTMAIL.TEMPLE DOT EDU>,
>> >> Tarik El Mansouri <etarik AT YAHOO DOT COM>
>> >>To: NETWORKER AT LISTMAIL.TEMPLE DOT EDU
>> >>Subject: Re: [Networker] How to improve performance
>> >>Date: Thu, 21 Oct 2004 05:30:55 +0200
>> >>
>> >>You wrote:
>> >>
>> >>Oct 21 04:56:59 CLIENT1 : E:\ level=full, 18 GB
01:33:37
>>61978
>> >>files
>> >>Oct 21 04:56:59 CLIENT1: F:\ level=full, 246 KB
00:00:06
>>30
>> >>files
>> >>Oct 21 04:56:59 CLIENT1: G:\ level=full, 10 GB
01:01:35
>>30313
>> >>files
>> >>Oct 21 04:56:59 CLIENT1: H:\ level=full, 87 GB
06:51:49
>>205950
>> >>files
>> >>
>> >>Oct 21 04:46:03 CLIENT2: C:\ level=full, 1180 MB
00:08:26
>>12540
>> >>files
>> >>Oct 21 04:46:03 CLIENT2: D:\ level=full, 225 GB
06:42:09
>>383748
>> >>files
>> >>
>> >>What can of disk storage do you have ? DAS/JBOD/Array.
>> >>
>> >>Are those clients defined in the same group ? if yes, change
the
>>priority
>> >>of the client2 to start first.
>> >>Change the target sessions to make sure you don't have several
save
>>sets
>>on
>> >>the same drive, as you have enough drive to do it.
>> >>
>> >>
>> >>Try also to use the backup command "save -i" to ignore directive
files
>> >>scans in your subdirectories during the backup. If there's a lot
of
>> >>directories it canhelp. You are still use the server "NSR
directive" if
>> >>required.
>> >>
>> >>Check the fragmentation of your drive, defragment it if
necessary. The
>> >>defragmentation can reduce dramatically your backup.
>> >>
>> >>Good luck.
>> >>
>> >>
>> >>Rahul Parasnis <rahulparasnis AT MSN DOT COM> wrote:
>> >>We have allocated 6 Drives with 3 as taget sessions for Each
Drive .
>>Infact
>> >>One Drive letter has 260 GB Data so one session is requierd .
>> >>
>> >>Brocade Switch Model = BROCADE SilkWorm3900 32port 2Gbit FC
Switch
>> >>
>> >>In fact Backup Exec was having DLT8000 drives and SAN
environment
>>brocade
>> >>Switch , with Lp950 Cards on Direct Storage Nodes . We just
replaced
>>these
>> >>cards to Lp10000 when we installed networker .
>> >>
>> >>Nothing was changed from Server point of view .
>> >>
>> >> >From: Tarik El Mansouri
>> >> >Reply-To: Legato NetWorker discussion ,
>> >> > Tarik El Mansouri
>> >> >To: NETWORKER AT LISTMAIL.TEMPLE DOT EDU
>> >> >Subject: Re: [Networker] How to improve performance
>> >> >Date: Thu, 21 Oct 2004 04:17:09 +0200
>> >> >
>> >> >Hello Rahul,
>> >> >
>> >> >As I understand you share the 6 LTO2 drives between the
Solairs
>>Backup
>> >> >server and two windows servers.
>> >> >
>> >> >- How many drives do you have per FC HBA (related to your
zoning)?
>> >>
>> >> >- Which Brocade switch model do you have ?
>> >> >
>> >> >You must have a maximum of 3 drives per FC HBA, if you SAN is
2GB
>> >> >end-to-end (HBA and switch). If the switch or the HBA is 1GB,
then
>>you
>> >>can
>> >> >only have one drive per HBA.
>> >> >
>> >> >You compare Backup Exec to Networker backup times, was it on
the same
>> >> >infrastructure ?
>> >> >
>> >> >Regards.
>> >> >
>> >> >Rahul Parasnis wrote:
>> >> >As I have mention in my Earlier mail ,
>> >> >
>> >> >I am using SAN backup with Brocade Switch , I am not using GB
Network
>>.
>> >> >
>> >> >Two clients in question are Direct Storage Nodes connected to
SAN
>>Switch
>> >>by
>> >> >LP10000 HBA card and L180 is also connected to Brocade switch
Via
>>Fibre .
>> >> >
>> >> >ALL the Six LTO-2 drives are having separate Fibre connection
.
>> >> >
>> >> >On Server Side I have LP9000 Card on V440 Solaris 9 server
also
>>connected
>> >> >to
>> >> >SAN Brocade Switch via Fibre .
>> >> >
>> >> >Which means my Network has 2GBps Speed .
>> >> >
>> >> >
>> >> > >From: Somen Chanda
>> >> > >Reply-To: Legato NetWorker discussion ,
>> >> > > Somen Chanda
>> >> > >To: NETWORKER AT LISTMAIL.TEMPLE DOT EDU
>> >> > >Subject: Re: [Networker] How to improve performance
>> >> > >Date: Wed, 20 Oct 2004 09:19:22 -0400
>> >> > >
>> >> > >What kind of network do you have? Make sure to increase the
number
>>of
>> >> > >streams on each drive. With a 100Mb network you should get
upto
>> >> > >11-12Mb/sec and with GigE network you should see a speed of
at
>>least
>> >> > >more than 35Mb/sec on each drive and with LTO-2 you should
be
>>faster
>> >>but
>> >> > >network is the most important factor.
>> >> > >
>> >> > >Somen
>> >> > >
>> >> > >-----Original Message-----
>> >> > >From: Rahul Parasnis [mailto:rahulparasnis AT MSN DOT COM]
>> >> > >Sent: Tuesday, October 19, 2004 11:20 PM
>> >> > >To: NETWORKER AT LISTMAIL.TEMPLE DOT EDU
>> >> > >Subject: [Networker] How to improve performance
>> >> > >
>> >> > >Hello ,
>> >> > >I have recently installd new Networker Server on Solaris 9
with
>>L180
>>of
>> >> > >8
>> >> > >Drives .
>> >> > >Enviromment .
>> >> > >
>> >> > >Server Solaris 9 , V440 2 CPU 4 GB
>> >> > >Brocade Switch .
>> >> > >L180 and Lto-2 drives
>> >> > >Lp9000 HBA card on Solaris
>> >> > >LP10000 card on Windows 2000 and windows 2003 cluster DSN's
.
>> >> > >
>> >> > >I am backing the two DSN on this networker Server , these
two were
>> >> > >backed up
>> >> > >before by Veritas backup exec and time was 3 hours and 5
>>respectiveyl
>> >> > >for
>> >> > >80 GB and 260 GB data size .
>> >> > >
>> >> > >
>> >> > >Now it takes 7 hours .
>> >> > >
>> >> > >I need help in making this backup faster . backup speed
sometinmes
>>goes
>> >> > >as
>> >> > >slow as 300kb/s and sometimes it goes to 45 MB/s (!)
>> >> > >
>> >> > >
>> >> > >Following is just an idea for you to understand
characteristics of
>> >> > >client .
>> >> > >Oct 17 23:49:03 [ID 702911 daemon.notice] Start time: Sun
Oct 17
>> >> > >16:30:30
>> >> > >2004
>> >> > >Oct 17 23:49:03 [ID 702911 daemon.notice] End time: Sun Oct
17
>> >> > >23:49:03
>> >> > >2004
>> >> > >
>> >> > >Oct 17 23:49:03 [ID 702911 daemon.notice] CLIENT1: C:\
>> >> > >level=full, 1180 MB 00:07:59 12520 files
>> >> > >Oct 17 23:49:03 tksubkp1 root: [ID 702911 daemon.notice]
CLIENT1D:\
>> >> > > level=full, 286 GB 07:14:14 491029 files
>> >> > >
>> >> > >Oct 17 23:49:03 tksubkp1 root: [ID 702911 daemon.notice]
Start
>>time:
>> >> > >Sun
>> >> > >Oct 17 16:30:30 2004
>> >> > >Oct 17 23:49:03 tksubkp1 root: [ID 702911 daemon.notice] End
time:
>> >> > >Sun
>> >> > >Oct 17 23:49:03 2004
>> >> > >
>> >> > >
>> >> > >Oct 17 23:49:03 [ID 702911 daemon.notice] CLIENT2 : C:\
>> >> > >level=full, 1180 MB 00:07:59 12520 files
>> >> > >Oct 17 23:49:03 ID 702911 daemon.notice] CLIENT2 : D:\
>> >> > >level=full, 286 GB 07:14:14 491029 files
>> >> > >
>> >> >
>_________________________________________________________________
>> >> > >Express yourself instantly with MSN Messenger! Download
today it's
>> >>FREE!
>> >> > >http://messenger.msn.com/
>> >> > >
>> >> > >--
>> >> > >Note: To sign off this list, send a "signoff networker"
command via
>> >> > >email
>> >> > >to listserv AT listmail.temple DOT edu or visit the list's Web
site
at
>> >> > >http://listmail.temple.edu/archives/networker.html where you
can
>> >> > >also view and post messages to the list. Questions regarding
this
>>list
>> >> > >should be sent to stan AT temple DOT edu
>> >> >
>=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=
>> >> > >
>> >> > >--
>> >> > >Note: To sign off this list, send a "signoff networker"
command via
>> >>email
>> >> > >to listserv AT listmail.temple DOT edu or visit the list's Web
site
at
>> >> > >http://listmail.temple.edu/archives/networker.html where you
can
>> >> > >also view and post messages to the list. Questions regarding
this
>>list
>> >> > >should be sent to stan AT temple DOT edu
>> >> >
>=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=
>> >> >
>> >>
>_________________________________________________________________
>> >> >Express yourself instantly with MSN Messenger! Download today
it's
>>FREE!
>> >> >http://messenger.msn.com/
>> >> >
>> >> >--
>> >> >Note: To sign off this list, send a "signoff networker"
command via
>>email
>> >> >to listserv AT listmail.temple DOT edu or visit the list's Web
site
at
>> >> >http://listmail.temple.edu/archives/networker.html where you
can
>> >> >also view and post messages to the list. Questions regarding
this
>>list
>> >> >should be sent to stan AT temple DOT edu
>> >>
>=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=
>> >> >
>> >> >
>> >> >---------------------------------
>> >> >Créez gratuitement votre Yahoo! Mail avec 100 Mo de stockage !
>> >> >Créez votre Yahoo! Mail
>> >> >
>> >> >Le nouveau Yahoo! Messenger est arrivé ! Découvrez toutes les
>>nouveautés
>> >> >pour dialoguer instantanément avec vos amis.Téléchargez
GRATUITEMENT
>>ici
>> >>!
>> >> >
>> >> >--
>> >> >Note: To sign off this list, send a "signoff networker"
command via
>>email
>> >> >to listserv AT listmail.temple DOT edu or visit the list's Web
site
at
>> >> >http://listmail.temple.edu/archives/networker.html where you
can
>> >> >also view and post messages to the list. Questions regarding
this
>>list
>> >> >should be sent to stan AT temple DOT edu
>> >>
>=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=
>> >>
>>
>>_________________________________________________________________
>> >>Express yourself instantly with MSN Messenger! Download today
it's
>>FREE!
>> >>http://messenger.msn.com/
>> >>
>> >>--
>> >>Note: To sign off this list, send a "signoff networker" command
via
>>email
>> >>to listserv AT listmail.temple DOT edu or visit the list's Web
site at
>> >>http://listmail.temple.edu/archives/networker.html where you can
>> >>also view and post messages to the list. Questions regarding
this list
>> >>should be sent to stan AT temple DOT edu
>> >>=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=
>> >>
>> >>
>> >>---------------------------------
>> >>Créez gratuitement votre Yahoo! Mail avec 100 Mo de stockage !
>> >>Créez votre Yahoo! Mail
>> >>
>> >>Le nouveau Yahoo! Messenger est arrivé ! Découvrez toutes les
>>nouveautés
>> >>pour dialoguer instantanément avec vos amis.Téléchargez
GRATUITEMENT
>>ici
>>!
>> >>
>> >>--
>> >>Note: To sign off this list, send a "signoff networker" command
via
>>email
>> >>to listserv AT listmail.temple DOT edu or visit the list's Web
site at
>> >>http://listmail.temple.edu/archives/networker.html where you can
>> >>also view and post messages to the list. Questions regarding
this list
>> >>should be sent to stan AT temple DOT edu
>> >>=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=
>> >
>> >_________________________________________________________________
>> >FREE pop-up blocking with the new MSN Toolbar - get it now!
>> >http://toolbar.msn.com/
>> >
>> >--
>> >Note: To sign off this list, send a "signoff networker" command
via
>>email
>> >to listserv AT listmail.temple DOT edu or visit the list's Web site
at
>> >http://listmail.temple.edu/archives/networker.html where you can
>> >also view and post messages to the list. Questions regarding this
list
>> >should be sent to stan AT temple DOT edu
>> >=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=
>
>_________________________________________________________________
>Don't just search. Find. Check out the new MSN Search!
>http://search.msn.com/
>
>--
>Note: To sign off this list, send a "signoff networker" command via
email
>to listserv AT listmail.temple DOT edu or visit the list's Web site at
>http://listmail.temple.edu/archives/networker.html where you can
>also view and post messages to the list. Questions regarding this
list
>should be sent to stan AT temple DOT edu
>=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=
_________________________________________________________________
Don't just search. Find. Check out the new MSN Search!
http://search.msn.com/
--
Note: To sign off this list, send a "signoff networker" command via
email
to listserv AT listmail.temple DOT edu or visit the list's Web site at
http://listmail.temple.edu/archives/networker.html where you can
also view and post messages to the list. Questions regarding this
list
should be sent to stan AT temple DOT edu
=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=
|
