Re: [Veritas-bu] NDMP backup problems

We have run into this issue as well. I liked the snapmirror to tape. The only problem we had was that we were backing up a snapmirrored volume. As long as we were running the snapmirror to tape backup, the filer to filer snapmirror was suspended. And if the snapmirror backup tried to start when the filer to filer snapmirror was running, it would fail.

We are now back to doing a regular NDMP backup of our 4 TB volume with millions of files. The first 24 hours of the backup hardly moves any data, then it will finally start picking up speed.

I did have to set the NDMP_PROGRESS_TIMEOUT up to 2880 (2 days) for our implementation.

http://www.symantec.com/docs/TECH21246

I think NDMP is about at the end of its rope with large volumes, deep directories and millions of files.

Bryan

From: veritas-bu-bounces AT mailman.eng.auburn DOT edu [mailto:veritas-bu-bounces AT mailman.eng.auburn DOT edu] On Behalf Of Martin, Jonathan
Sent: Monday, August 27, 2012 9:55 AM
To: Baumann, Kevin; veritas-bu AT mailman.eng.auburn DOT edu
Subject: Re: [Veritas-bu] NDMP backup problems

We ran into numerous issues with NDMP and volumes with millions of files. Have you considered SnapMirror to tape for the volumes with the millions of files? You lose the capability to restore individual files and incremental backups, but backup/restore speed is ridiculously fast and rock solid. We use snapshots to cover the day to day restores, and restore the entire volume if someone needs older data. We spent years testing NDMP on various filers, and this is the only way we’ve found to solve the millions of files issue. If you want to test it out, just throw set type = smtape into the top of your selection list and run a full.

Good luck,

-Jonathan

From: veritas-bu-bounces AT mailman.eng.auburn DOT edu [mailto:veritas-bu-bounces AT mailman.eng.auburn DOT edu] On Behalf Of Baumann, Kevin
Sent: Monday, August 27, 2012 10:34 AM
To: veritas-bu AT mailman.eng.auburn DOT edu
Subject: [Veritas-bu] NDMP backup problems

All,

Linux OS, NetBackup 7.1.0.4, NDMP

I am running into backup issues with NDMP (NetApp filer). We have over 10 million files and several paths to backup. What is happening is the smaller paths backup fine but once the larger path starts and NetBackup tries to get the file list it times out with error 99. This also causes the smaller paths to sometimes (not always, and not always the same paths) to time out. The error code is my favorite – error 99.

Our paths (some excluded, LONG list)

/vol/checkpoint

/vol/journal

/vol/home_dir

/vol/projects --- LARGE # of files

/vol/spec --- LARGE # of files

/vol/history

/vol/reports

I have tried breaking out the large paths and that seems to help as the smaller paths have no issues. But the large paths still timeout. I tried writing to both tape and disk but I still get error 99. I also have the NDMP_PROGRESS_TIMEOUT set to 24 hours (1440 minutes).

Anyone ever run into this? Any help would be appreciated.

Thanks.

-Kevin

_____________________________________________________________
DTCC DISCLAIMER: This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom they are addressed. If you have received this email in error, please notify us immediately and delete the email and any attachments from your system. The recipient should check this email and any attachments for the presence of viruses. The company accepts no liability for any damage caused by any virus transmitted by this email.

_______________________________________________
Veritas-bu maillist  -  Veritas-bu AT mailman.eng.auburn DOT edu
http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu