We ran into numerous issues with NDMP and volumes with millions of files. Have you considered SnapMirror to tape for the volumes with the millions of files? You lose the capability to restore individual files and incremental backups, but backup/restore speed is ridiculously fast and rock solid. We use snapshots to cover the day to day restores, and restore the entire volume if someone needs older data. We spent years testing NDMP on various filers, and this is the only way we’ve found to solve the millions of files issue. If you want to test it out, just throw set type = smtape into the top of your selection list and run a full.
Good luck,
-Jonathan
From: veritas-bu-bounces AT mailman.eng.auburn DOT edu [mailto:veritas-bu-bounces AT mailman.eng.auburn DOT edu] On Behalf Of Baumann, Kevin
Sent: Monday, August 27, 2012 10:34 AM
To: veritas-bu AT mailman.eng.auburn DOT edu
Subject: [Veritas-bu] NDMP backup problems
All,
Linux OS, NetBackup 7.1.0.4, NDMP
I am running into backup issues with NDMP (NetApp filer). We have over 10 million files and several paths to backup. What is happening is the smaller paths backup fine but once the larger path starts and NetBackup tries to get the file list it times out with error 99. This also causes the smaller paths to sometimes (not always, and not always the same paths) to time out. The error code is my favorite – error 99.
Our paths (some excluded, LONG list)
/vol/checkpoint
/vol/journal
/vol/home_dir
/vol/projects --- LARGE # of files
/vol/spec --- LARGE # of files
/vol/history
/vol/reports
I have tried breaking out the large paths and that seems to help as the smaller paths have no issues. But the large paths still timeout. I tried writing to both tape and disk but I still get error 99. I also have the NDMP_PROGRESS_TIMEOUT set to 24 hours (1440 minutes).
Anyone ever run into this? Any help would be appreciated.
Thanks.
-Kevin
