Networker

Re: [Networker] slow san backup performance

2002-11-27 19:07:54
Subject: Re: [Networker] slow san backup performance
From: hanny <k0s5 AT YAHOO DOT COM>
To: NETWORKER AT LISTMAIL.TEMPLE DOT EDU
Date: Thu, 28 Nov 2002 08:02:53 +0800
Hi Terry,

I have tried activate Change Journal, but now with the max value.
Definitely I will try again, post the result later.

cheers - han

At 11/27/2002 10:49 AM, Terry Lemons wrote:
Hi Hanny

To make sure that your infrastructure is solid, place several large files in
a single directory on your storage array; the files can be multiple copies
of the same file.  Then, back up just that directory.  Make sure that you
have enough data, so that the backup will run for ~5 minutes or longer, long
enough for you to watch it run.  Put the directory that you are backing up
on the same LUN with which you are experiencing poor performance during
backups.  If the backup of these large files is fast, using the same
environment as your regular backups, then you'll know that the small files
are the problem.

That said, I have good news.  Since you are using Windows 2000 (and, I'm
assuming, the NTFS file system), you can take advantage of NetWorker's
support for Change Journal.  This is described beginning on p.592 of the
"NetWorker for Windows Administrator's Guide"
(http://web1.legato.com/infodev/publications/NetWorker/WINDOWS/6.2/winag.pdf).

Others in this mailing list have reported that NetWorker's support for
Change Journal doesn't work; I, too, had problems with it not appearing to
work.  But, Legato Technical Support advised me to use the maximum values
(using the NetWorker Change Journal Manager application) for '% of volume
for log file' and % of log for Allocation Delta'.  Once I did this,
NetWorker began using the Change Journal for all non-full backups.  The
results have been dramatic:  the nightly incremental backup completion times
of one disk with several hundred thousand small files has decreased from
12-21 minutes to 1-3 minutes.  Note that this only helps with non-full
backups; full backups do not use the Change Journal.

Hope this helps!
tl

-----Original Message-----
From: hanny [mailto:k0s5 AT YAHOO DOT COM]
Sent: Wednesday, November 27, 2002 5:08 AM
To: NETWORKER AT LISTMAIL.TEMPLE DOT EDU
Subject: [Networker] slow san backup performance


hi guys..

our client recently reported a slow backup performance.
i currently run out of idea, hope the list can shed some light...:)

environtment
1 backup server w2k sp3
2 x xeon 700, 2 GB RAM
1 Emulex FC8000
1 Emulex FC7000
1 ATLP6000 w/ 12 DLT7K
1 ATLP3000 w/ 6 SDLT

8 storage nodes
w2k sp3
2 x emulex 8000
san disk 3 x 130 GB
millions of small files, average size 40K/file.
storage box: 2 x fc4500 (total 2.4TB) and 1 x hp512 (2.6TB)

emulex details:
firmware 3.02
driver version 2.11a2


When the backup start, the backup speed ranging from 300KB/s to 2MB/s
But the speed can easily drop to 50KB/s and stays there forever.

I guess small files contributes to this problem,
but with the speed of only 50KB, there must be something is not correct
somewhere.

So any of you guys using emulex hba with w2k, please share the firwmare and
driver version used

any other idea deeply appreciate...



Network diagram (simplified)

                 backup svr
         ____________|  |_____________
         |                            |
       brocade                      brocade
    ___|  | |______               ___|  | |______
    |      |       |              |     |       |
2xFC4500 |      4 SN           1xXP512 |      4 SN
           |                            |
         ATL P3K                       ATLP6K




cheers - han

--
Note: To sign off this list, send a "signoff" command via email
to listserv AT listmail.temple DOT edu or visit the list's Web site at
http://listmail.temple.edu/archives/networker.html where you can
also view and post messages to the list.
=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=

--
Note: To sign off this list, send a "signoff" command via email
to listserv AT listmail.temple DOT edu or visit the list's Web site at
http://listmail.temple.edu/archives/networker.html where you can
also view and post messages to the list.
=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=

cheers - han

--
Note: To sign off this list, send a "signoff" command via email
to listserv AT listmail.temple DOT edu or visit the list's Web site at
http://listmail.temple.edu/archives/networker.html where you can
also view and post messages to the list.
=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=