I've tested NDMP on 6 differetnt arrays and it has never moved millions
of small files well. We maxed out backup performance on our NetApp FAS
2xxx with 2 streams at approx 20MB/sec total.  We're hoping to test
SMTape, which purportedly does a bit level dump of the entire array.  I
haven't had a chance to test this yet, but according to NetApp it will
get us our weekly full and drive LTO3. We'll then need to put some sort
of forever incremental or snapshot backup in-between the SMTape dumps.

-Jonathan

-----Original Message-----
From: veritas-bu-bounces AT mailman.eng.auburn DOT edu
[mailto:veritas-bu-bounces AT mailman.eng.auburn DOT edu] On Behalf Of Nate
Sanders
Sent: Friday, September 10, 2010 12:22 PM
To: veritas-bu AT mailman.eng.auburn DOT edu
Subject: [Veritas-bu] NBU 6.5.6 client on FreeBSD 7.2 host

Now that we made it to 6.5.6 we're able to start testing NFS performance
from our NetApp VS NDMP. For the longest time we've done the backup of
some 1 billion small image files off the NetApp via NDMP. This job
usually took 1-3 weeks to complete a full sweep via NDMP.

Since we have support for FBSD we thought we would try doing NFS via
that client as Linux NFS is not as powerful as the BSD/Solaris variety.
Well on our initial test of a small volume from the NetApp, we're seeing
2-4MB/s performance. Confirmed via bptm log. This is going straight to
LTO4 tape, which usually backs up around 150MB/s. Logs show that the
previous NDMP jobs from the NetApp we're doing around 40MB/s direct to
two dedicated NDMP LTO4 drives.

Supposedly multiplexing for NDMP will come to NBU 7.x shortly and we
will test again with that in the future. Right now I am not multiplexing
this NFS job but while looking in bptm I don't see the usual "waited for
buffer" errors that would tell me that I _should_ increase it. Is it
still likely multiplexing would increase the overall performance here?
Is this a known issue with FBSD clients? Is there something else I
should be looking at?

-- 
Nate Sanders            Digital Motorworks
System Administrator      (512) 692 - 1038




This message and any attachments are intended only for the use of the
addressee and may contain information that is privileged and
confidential. If the reader of the message is not the intended recipient
or an authorized representative of the intended recipient, you are
hereby notified that any dissemination of this communication is strictly
prohibited. If you have received this communication in error, please
notify us immediately by e-mail and delete the message and any
attachments from your system.
_______________________________________________
Veritas-bu maillist  -  Veritas-bu AT mailman.eng.auburn DOT edu
http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
_______________________________________________
Veritas-bu maillist  -  Veritas-bu AT mailman.eng.auburn DOT edu
http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu