Networker

Re: [Networker] NDMP over network speed question

2006-07-18 08:18:34
Subject: Re: [Networker] NDMP over network speed question
From: "Coty, Edward" <Edward.Coty AT AIG DOT COM>
To: NETWORKER AT LISTSERV.TEMPLE DOT EDU
Date: Tue, 18 Jul 2006 08:12:35 -0400
What kind of data are you backing up? I am backing up file share
data(word,excel,PST) directly to tape. Drives are local to NDMP filer. I
am only seeing on average 27MBs. I am using LTOII drives. What kind of
hardware are you using? Do you have hardware compression on? How many
NDMP streams are you sending to one tape drive? The performance can just
depend on the type of data and the network you are running on? 

EDWARD COTY
OPEN SYSTEMS STORAGE ENGINEER, LCNA
WORK - 973-533-2098
CELL - 973-296-0918
EDWARD.COTY AT AIG DOT COM
-----Original Message-----
From: Legato NetWorker discussion [mailto:NETWORKER AT LISTSERV.TEMPLE DOT EDU]
On Behalf Of bob flynn
Sent: Tuesday, July 18, 2006 3:46 AM
To: NETWORKER AT LISTSERV.TEMPLE DOT EDU
Subject: [Networker] NDMP over network speed question

Hi,

I have the following configuration

    * Networker Server 7.2.2
    * SCSI attached LTO2 drives
    * Linux RH 3 AS

Netapp filers running NDMP over network, streaming data to backup
server.

My question is to clarify my understanding of expected speeds of NDMP
backups.

What I think happens is;

    * Networker server requests an ndmp backup from filer.
    * Filer commences ndmp backup.
    * ndmp backup runs through the ndmp phases. Once a tree walk of the
      data is complete, and the file indexes have been created, it
      starts streaming data to the backup server.

My question is;

I expect the job to work as follows;

    * First phases, no data streamed
    * Once index is created, stream this data across
    * Once data is being streamed, a solid stream of data from the filer
      to backup server.

What I see is;

    * First phases, no data streamed
    * Once index is created, a trickle of data
    * Once data is being streamed, data seems to spurt, ie
fast/slow/fast.

What characteristics of ndmp data streaming should I see. Can I run any
tests to verify expected v's actual data rates, to determine if I am
bottlenecking backups at;

    * Filer ( CPU )
    * Filer ( Network )
    * Network
    * Backup Server ( CPU )
    * Backup Server ( network )
    * Backup Server ( tapedrive )

I am currently monitoring the following;

    * Filer ( CPU )
    * Filer ( NIC )
    * Network
    * Backup Server ( CPU )
    * Backup Server ( NIC )

and am not seeing bottlenecks, but still seeing erratic backup
performance.

Any hints to either understand this further, and baseline performance
are appreciated.

-Bob







The information contained in this e-mail and in any attachments is
confidential and is designated solely for the attention of the intended
recipient(s). If you are not an intended recipient, you must not use,
disclose, copy, distribute or retain this e-mail or any part thereof. If
you have received this e-mail in error, please notify the sender by
return e-mail and delete all copies of this e-mail from your computer
system(s).
Please direct any additional queries to: communications AT s3group DOT com.
Thank You.

To sign off this list, send email to listserv AT listserv.temple DOT edu and
type "signoff networker" in the
body of the email. Please write to networker-request AT listserv.temple DOT edu
if you have any problems
wit this list. You can access the archives at
http://listserv.temple.edu/archives/networker.html or
via RSS at http://listserv.temple.edu/cgi-bin/wa?RSS&L=NETWORKER

To sign off this list, send email to listserv AT listserv.temple DOT edu and 
type "signoff networker" in the
body of the email. Please write to networker-request AT listserv.temple DOT edu 
if you have any problems
wit this list. You can access the archives at 
http://listserv.temple.edu/archives/networker.html or
via RSS at http://listserv.temple.edu/cgi-bin/wa?RSS&L=NETWORKER