Networker

Re: [Networker] Index File Size?

2006-08-01 13:01:13
Subject: Re: [Networker] Index File Size?
From: Matthew Huff <mhuff AT OX DOT COM>
To: NETWORKER AT LISTSERV.TEMPLE DOT EDU
Date: Tue, 1 Aug 2006 12:59:54 -0400
 DAR requires NDMP version 4.


--
Matthew Huff           | One Manhattanville Rd
Director of Operations | Purchase, NY 10577
OTA LLC                | Phone: 914-460-4039 
mailto:mhuff AT ox DOT com    | Fax:   914-460-4139   
-----Original Message-----
From: Legato NetWorker discussion [mailto:NETWORKER AT LISTSERV.TEMPLE DOT EDU]
On Behalf Of Krishnan, Ramamurthy
Sent: Tuesday, August 01, 2006 11:06 AM
To: NETWORKER AT LISTSERV.TEMPLE DOT EDU
Subject: Re: [Networker] Index File Size?

You probably are right about the NDMP version.  It is set to 3.  

Rgds, Ram. 

-----Original Message-----
From: Legato NetWorker discussion [mailto:NETWORKER AT LISTSERV.TEMPLE DOT EDU]
On Behalf Of Matthew Huff
Sent: 01 August 2006 15:54
To: NETWORKER AT LISTSERV.TEMPLE DOT EDU
Subject: Re: [Networker] Index File Size?

 What version of NDMP is turned on our your NetApp? It might be set to
NDMP version 3. use "ndmpd version" to check. To change, do a "ndmpd
off", "ndmpd version 4", followed by a "ndmpd on"




--
Matthew Huff           | One Manhattanville Rd
Director of Operations | Purchase, NY 10577
OTA LLC                | Phone: 914-460-4039 
mailto:mhuff AT ox DOT com    | Fax:   914-460-4139   
-----Original Message-----
From: Legato NetWorker discussion [mailto:NETWORKER AT LISTSERV.TEMPLE DOT EDU]
On Behalf Of Krishnan, Ramamurthy
Sent: Tuesday, August 01, 2006 10:34 AM
To: NETWORKER AT LISTSERV.TEMPLE DOT EDU
Subject: Re: [Networker] Index File Size?

No directives set against the client.  I tried restoring a 2GB folder
from a NetApp filer backups and it seemed to take ages.  The backup was
written to a non-NDMP device using DSA (nsrndmp_save -M) option.

We are running NetWorker 7.2.2 on Solaris 9 with a SCSI based SDLT320
tape loader attached to the server.

Rgds, Ram.

-----Original Message-----
From: Legato NetWorker discussion [mailto:NETWORKER AT LISTSERV.TEMPLE DOT EDU]
On Behalf Of Matthew Huff
Sent: 01 August 2006 15:17
To: NETWORKER AT LISTSERV.TEMPLE DOT EDU
Subject: Re: [Networker] Index File Size?

 We are using DAR with DSA, and have no issues with it on 7.2.2. What
are your client configurations/directives?

Here's a sample output of one of our qtree backups.

* pur-sv-filer1-nsr:/vol/vol0/ota nsrndmp_save: Performing backup to
Non-NDMP type of device
* pur-sv-filer1-nsr:/vol/vol0/ota nsrdsa_save: DSA savetime = 1154397616
* pur-sv-filer1-nsr:/vol/vol0/ota nsrndmp_save: Performing DAR Backup..
* pur-sv-filer1-nsr:/vol/vol0/ota nsrdsa_save: READY:(host, ipaddr,
port) = (regulus-nsr, 129.77.15.1, 8468)
* pur-sv-filer1-nsr:/vol/vol0/ota nsrndmp_save: Host = regulus-nsr
(129.77.15.1) port = 8468
* pur-sv-filer1-nsr:/vol/vol0/ota nsrndmp_save:
pur-sv-filer1-nsr:/vol/vol0/ota NDMP save running on 'regulus'
* pur-sv-filer1-nsr:/vol/vol0/ota nsrdsa_save: Performing Immediate save
* pur-sv-filer1-nsr:/vol/vol0/ota nsrndmp_save: NDMP Service Log: DUMP:
creating "/vol/vol0/../snapshot_for_backup.529" snapshot.
* pur-sv-filer1-nsr:/vol/vol0/ota
* pur-sv-filer1-nsr:/vol/vol0/ota nsrndmp_2fh: Reading file
/nsr/tmp/FileIndex2513352246/fhfile
* pur-sv-filer1-nsr:/vol/vol0/ota nsrndmp_save: NDMP Service Log: DUMP:
Using subtree dump
* pur-sv-filer1-nsr:/vol/vol0/ota
* pur-sv-filer1-nsr:/vol/vol0/ota nsrndmp_save: NDMP Service Log: DUMP:
Date of this level 9 dump: Mon Jul 31 22:03:31 2006.
* pur-sv-filer1-nsr:/vol/vol0/ota
* pur-sv-filer1-nsr:/vol/vol0/ota nsrndmp_save: NDMP Service Log: DUMP:
Date of last level 0 dump: Fri Jul 28 22:02:51 2006.
* pur-sv-filer1-nsr:/vol/vol0/ota
* pur-sv-filer1-nsr:/vol/vol0/ota nsrndmp_save: NDMP Service Log: DUMP:
Dumping /vol/vol0/ota to NDMP connection
* pur-sv-filer1-nsr:/vol/vol0/ota
* pur-sv-filer1-nsr:/vol/vol0/ota nsrndmp_save: NDMP Service Log: DUMP:
mapping (Pass I)[regular files]
* pur-sv-filer1-nsr:/vol/vol0/ota
* pur-sv-filer1-nsr:/vol/vol0/ota nsrndmp_save: NDMP Service Log: DUMP:
mapping (Pass II)[directories]
* pur-sv-filer1-nsr:/vol/vol0/ota
* pur-sv-filer1-nsr:/vol/vol0/ota nsrndmp_save: NDMP Service Log: DUMP:
estimated 33211320 KB.
* pur-sv-filer1-nsr:/vol/vol0/ota
* pur-sv-filer1-nsr:/vol/vol0/ota nsrndmp_save: NDMP Service Log: DUMP:
dumping (Pass III) [directories]
* pur-sv-filer1-nsr:/vol/vol0/ota
* pur-sv-filer1-nsr:/vol/vol0/ota nsrndmp_save: NDMP Service Log: DUMP:
Mon Jul 31 22:41:21 2006 : We have written 73714 KB.
* pur-sv-filer1-nsr:/vol/vol0/ota
* pur-sv-filer1-nsr:/vol/vol0/ota nsrndmp_save: NDMP Service Log: DUMP:
Mon Jul 31 22:46:24 2006 : We have written 172905 KB.
* pur-sv-filer1-nsr:/vol/vol0/ota
* pur-sv-filer1-nsr:/vol/vol0/ota nsrndmp_save: NDMP Service Log: DUMP:
Mon Jul 31 22:51:24 2006 : We have written 273841 KB.
* pur-sv-filer1-nsr:/vol/vol0/ota
* pur-sv-filer1-nsr:/vol/vol0/ota nsrndmp_save: NDMP Service Log: DUMP:
Mon Jul 31 22:56:24 2006 : We have written 539428 KB.
* pur-sv-filer1-nsr:/vol/vol0/ota
* pur-sv-filer1-nsr:/vol/vol0/ota nsrndmp_save: NDMP Service Log: DUMP:
dumping (Pass IV) [regular files]
* pur-sv-filer1-nsr:/vol/vol0/ota
* pur-sv-filer1-nsr:/vol/vol0/ota nsrndmp_save: NDMP Service Log: DUMP:
Mon Jul 31 23:01:24 2006 : We have written 8507399 KB.
* pur-sv-filer1-nsr:/vol/vol0/ota
* pur-sv-filer1-nsr:/vol/vol0/ota nsrndmp_save: NDMP Service Log: DUMP:
Mon Jul 31 23:06:24 2006 : We have written 14437073 KB.
* pur-sv-filer1-nsr:/vol/vol0/ota
* pur-sv-filer1-nsr:/vol/vol0/ota nsrndmp_save: NDMP Service Log: DUMP:
Mon Jul 31 23:11:24 2006 : We have written 18874002 KB.
* pur-sv-filer1-nsr:/vol/vol0/ota
* pur-sv-filer1-nsr:/vol/vol0/ota nsrndmp_save: NDMP Service Log: DUMP:
Mon Jul 31 23:16:24 2006 : We have written 22125160 KB.
* pur-sv-filer1-nsr:/vol/vol0/ota
* pur-sv-filer1-nsr:/vol/vol0/ota nsrndmp_save: NDMP Service Log: DUMP:
Mon Jul 31 23:21:24 2006 : We have written 24981773 KB.
* pur-sv-filer1-nsr:/vol/vol0/ota
* pur-sv-filer1-nsr:/vol/vol0/ota nsrndmp_save: NDMP Service Log: DUMP:
Mon Jul 31 23:26:24 2006 : We have written 28083456 KB.
* pur-sv-filer1-nsr:/vol/vol0/ota
* pur-sv-filer1-nsr:/vol/vol0/ota nsrndmp_save: NDMP Service Log: DUMP:
Mon Jul 31 23:31:24 2006 : We have written 31912920 KB.
* pur-sv-filer1-nsr:/vol/vol0/ota
* pur-sv-filer1-nsr:/vol/vol0/ota nsrndmp_save: NDMP Service Log: DUMP:
dumping (Pass V) [ACLs]
* pur-sv-filer1-nsr:/vol/vol0/ota
* pur-sv-filer1-nsr:/vol/vol0/ota nsrndmp_save: NDMP Service Log: DUMP:
33515149 KB
* pur-sv-filer1-nsr:/vol/vol0/ota
* pur-sv-filer1-nsr:/vol/vol0/ota nsrndmp_save: NDMP Service Log: DUMP:
DUMP IS DONE
* pur-sv-filer1-nsr:/vol/vol0/ota
* pur-sv-filer1-nsr:/vol/vol0/ota nsrndmp_save: NDMP Service Log: DUMP:
Deleting "/vol/vol0/../snapshot_for_backup.529" snapshot.
* pur-sv-filer1-nsr:/vol/vol0/ota
* pur-sv-filer1-nsr:/vol/vol0/ota nsrdsa_save: Successfully Done.
* pur-sv-filer1-nsr:/vol/vol0/ota nsrndmp_save: pur-sv-filer1-nsr:
/vol/vol0/ota level=9, 33 GB 01:34:24 443856 files
* pur-sv-filer1-nsr:/vol/vol0/ota nsrndmp_save: Save session closed with
NW server successfully
* pur-sv-filer1-nsr:/vol/vol0/ota
* pur-sv-filer1-nsr:/vol/vol0/ota nsrndmp_save: Sorting File History....
* pur-sv-filer1-nsr:/vol/vol0/ota nsrndmp_save: Sorting File History
completed Successfully in 00:00:01 Hours
* pur-sv-filer1-nsr:/vol/vol0/ota
* pur-sv-filer1-nsr:/vol/vol0/ota nsrndmp_save: Processing NDMP File
History...
* pur-sv-filer1-nsr:/vol/vol0/ota nsrndmp_save:
pur-sv-filer1-nsr:/vol/vol0/ota Processing NDMP File History completed
Successfully on 'regulus' in 00:04:29 Hours
* pur-sv-filer1-nsr:/vol/vol0/ota
V pur-sv-filer1-nsr:/vol/vol0/ota nsrndmp_save: browsable
savetime=1154397616
* pur-sv-filer1-nsr:/vol/vol0/ota nsrndmp_save: Successfully done
--
Matthew Huff           | One Manhattanville Rd
Director of Operations | Purchase, NY 10577
OTA LLC                | Phone: 914-460-4039 
mailto:mhuff AT ox DOT com    | Fax:   914-460-4139   
-----Original Message-----
From: Krishnan, Ramamurthy [mailto:Ramamurthy.Krishnan AT kpmg.co DOT uk]
Sent: Tuesday, August 01, 2006 9:39 AM
To: Legato NetWorker discussion; Matthew Huff
Subject: RE: [Networker] Index File Size?

BTW, it looks like the DAR support for DSA based backups is available
only from NetWorker 7.3 on.  We found our restores going dead slow (not
using DAR) when we tested this option on NetWorker 7.2.2.

Rgds, Ram.

-----Original Message-----
From: Legato NetWorker discussion [mailto:NETWORKER AT LISTSERV.TEMPLE DOT EDU]
On Behalf Of Matthew Huff
Sent: 01 August 2006 14:32
To: NETWORKER AT LISTSERV.TEMPLE DOT EDU
Subject: Re: [Networker] Index File Size?

DSA is short for "Data Server Agent". Look in Chapter 12 of the
Unix/Linux Admin guide for 7.2. It has nice diagrams of the
configuration. Basically, it packages the NDMP datastream (in NetApp's
case, the NetApp modified ufsdump) into a legato stream and sends it
across the network to the Legato server. Local drives are no longer
required

Pro's for DSA
--------------
Support for any Networker device.
No need for DDS (drives are attached to server/storage node)
Multiplexing is supported Backup to Disk is supported Variable block
size (much faster tape performance) No separate storage pool required
(can be multiplexed with other
backups)
Using backups with qtrees, much higher parrallelization can be achieved

Con's for DSA
--------------
Can be a load on the network/nics
Requires custom configuration including tuning


I've got all the Solaris tuning if anyone needs. We use a separate VLAN
with jumbo frames over gigabit ethernet. We tweaked the TCP/IP settings
on the Sun Server (Sun V490 running Solaris 9), and are getting good
performance. The client config in Network Admin is kinda tricky (you
have to use parameters to tell Legato to use a separate NIC for
example). But once it's setup, it is pretty hands-off.


--
Matthew Huff           | One Manhattanville Rd
Director of Operations | Purchase, NY 10577
OTA LLC                | Phone: 914-460-4039 
mailto:mhuff AT ox DOT com    | Fax:   914-460-4139   
-----Original Message-----
From: John Stoffel [mailto:john.stoffel AT taec.toshiba DOT com]
Sent: Monday, July 31, 2006 1:12 PM
To: Legato NetWorker discussion; Matthew Huff
Subject: Re: Index File Size?


Matthew> With Networker 7.1 you should be looking at DSA backups for the

Matthew> NetApps rather than NFS. With DSA, you can keep the drives 
Matthew> attached to your Networker Server and/or Storage Node. The 
Matthew> streams are parallel and are treated like any other NetApp 
Matthew> backup.  I would recommend a seperate VLAN and separate 
Matthew> interfaces for the backups including tweaking the backup 
Matthew> servers TCP/IP settings and running Jumbo frames, but even if 
Matthew> you don't, it should be better than NFS backups.

Interesting.  Poking around the http://software.emc.com/... stuff, I
don't see anything explicitly talking about this.  I assume this is NDMP
by another name?  

The problem I've seen with NDMP is that it barfs with restores of over a
million files, and I have users who have directories/qtrees which exceed
this level.  Annoying, yes, but not something I can do anything about. 

Matthew> DSA is built-in to Networker (although you have to have NDMP 
Matthew> client licenses).

Interesting.  Can you give us more details, such as what DSA really
stands for?  And how you're using it, if you are using it?  I'm always
looking for a better way to backup my NetApps.

Thanks,
John
    John Stoffel - Senior Staff Systems Administrator - System LSI Group
  Toshiba America Electronic Components, Inc. -
http://www.toshiba.com/taec
             john.stoffel AT taec.toshiba DOT com - 508-486-1087

To sign off this list, send email to listserv AT listserv.temple DOT edu and
type "signoff networker" in the body of the email. Please write to
networker-request AT listserv.temple DOT edu
if you have any problems
wit this list. You can access the archives at
http://listserv.temple.edu/archives/networker.html or via RSS at
http://listserv.temple.edu/cgi-bin/wa?RSS&L=NETWORKER



This email has been sent from KPMG LLP, a UK limited liability
partnership, or from one of the companies within its control (which
include KPMG Audit Plc , KPMG United Kingdom Plc and KPMG UK Limited).
The information in this email is confidential and may be legally
privileged. It is intended solely for the addressee.  Access to this
email by anyone else is unauthorised.  If you are not the intended
recipient, any disclosure, copying, distribution or any action taken or
omitted to be taken in reliance on it, is prohibited and may be
unlawful.  When addressed to our clients any opinions or advice
contained in this email are subject to the terms and conditions
expressed in the governing KPMG client engagement letter.

To sign off this list, send email to listserv AT listserv.temple DOT edu and
type "signoff networker" in the body of the email. Please write to
networker-request AT listserv.temple DOT edu if you have any problems wit this
list. You can access the archives at
http://listserv.temple.edu/archives/networker.html or via RSS at
http://listserv.temple.edu/cgi-bin/wa?RSS&L=NETWORKER

To sign off this list, send email to listserv AT listserv.temple DOT edu and
type "signoff networker" in the body of the email. Please write to
networker-request AT listserv.temple DOT edu if you have any problems wit this
list. You can access the archives at
http://listserv.temple.edu/archives/networker.html or via RSS at
http://listserv.temple.edu/cgi-bin/wa?RSS&L=NETWORKER

To sign off this list, send email to listserv AT listserv.temple DOT edu and
type "signoff networker" in the body of the email. Please write to
networker-request AT listserv.temple DOT edu if you have any problems wit this
list. You can access the archives at
http://listserv.temple.edu/archives/networker.html or via RSS at
http://listserv.temple.edu/cgi-bin/wa?RSS&L=NETWORKER

To sign off this list, send email to listserv AT listserv.temple DOT edu and
type "signoff networker" in the body of the email. Please write to
networker-request AT listserv.temple DOT edu if you have any problems wit this
list. You can access the archives at
http://listserv.temple.edu/archives/networker.html or via RSS at
http://listserv.temple.edu/cgi-bin/wa?RSS&L=NETWORKER

To sign off this list, send email to listserv AT listserv.temple DOT edu and 
type "signoff networker" in the
body of the email. Please write to networker-request AT listserv.temple DOT edu 
if you have any problems
wit this list. You can access the archives at 
http://listserv.temple.edu/archives/networker.html or
via RSS at http://listserv.temple.edu/cgi-bin/wa?RSS&L=NETWORKER

<Prev in Thread] Current Thread [Next in Thread>