Networker

Re: [Networker] NDMP Backup Problems

2004-03-17 17:29:36
Subject: Re: [Networker] NDMP Backup Problems
From: Ernst Bokkelkamp <ernst AT BOKKELKAMP DOT DE>
To: NETWORKER AT LISTMAIL.TEMPLE DOT EDU
Date: Wed, 17 Mar 2004 23:28:56 +0100
Hallo Jessica

Looking at the NDMP I suspect that you have a problem with nsrndmpix.
Please check your environment variables, that means the values entered under
"application information" in the client resource with the information given
in the legato manuals. Pay attention to "HIST=" and "UPDATE=". Also check
your swap space, see the entry "Important Notes on Swap Space" and check
available memory on your server. Another thing to check is that you have
sufficient temp space available.

> * pacific:/vol/vol2 NDMP Service Log: DUMP: Deleting
> "/vol/vol2/../snapshot_for_backup.98" snapshot.
> * pacific:/vol/vol2
> * pacific:/vol/vol2 03/17/04 02:45:44 AM nsrexec: Attempting a kill on
> remote save
> * pacific:/vol/vol2 has been inactive for 60 minutes since Wed Mar 17
> 01:45:23 2004.
> * pacific:/vol/vol2 is being abandoned by nsrexec.
> * pacific:/vol/vol2 aborted due to inactivity

The above section of the log file indicates the backup to tape has been
completed succesfully. But the savegroup completion will only appear once
the history (ndmp term) has been converted (nsrndmpix) and entered in to the
client index. During this tíme there will be no indication of data transfer.
Stupidly enough the inactivity timer is reset by data transfer activity and
therefor the inactivity timer may cause the backup to be aborted. Best is to
set the inactivity timer to 0. The index conversion can take a lot of time,
if you have a lot of small files and insufficient memory then it can easely
take an hour or more. If your server is very busy or if you are running
multiple ndmp backups then this may worsen the situation.

NDMP, unfortunately, is very different from "normal" backups. A normal
backup needs IO power more then CPU power and RAM. NDMP needs CPU and RAM
for the index but hardly any IO power.

Bye
Ernie



----- Original Message -----
From: "Jessica Blackburn" <jessica.blackburn AT ACTERNA DOT COM>
To: <NETWORKER AT LISTMAIL.TEMPLE DOT EDU>
Sent: Wednesday, March 17, 2004 10:19 PM
Subject: Re: [Networker] NDMP Backup Problems


> What's a really high value?  I have already increased from 30 minutes to
> 60 minutes and now to 120 minutes.
>
> Thanks,
> Jessica Blackburn
> Acterna
> 12410 Milestone Center Drive
> Germantown, MD 20876
>
>
>
>
> Phillip_Young AT i2 DOT com
> 03/17/2004 01:36 PM
>
>
>         To:     Legato NetWorker discussion
<NETWORKER AT LISTMAIL.TEMPLE DOT EDU>, Jessica
> Blackburn <jessica.blackburn AT ACTERNA DOT COM>
>         cc:
>         Subject:        Re: [Networker] NDMP Backup Problems
>
>
>
>
>
>
> Check your "inactivity timeout" setting for the savegroup to which the
> clients have been assigned.  Out of the box it's set at 30 minutes.  A lot
> of us here on the list set this to either a really really really high
> number, or zero (no inactivity timeouts -- the group will hang
> indefinitely
> on a slow client.)
>
>
> -ty
>
> Phillip T. ("Ty") Young, DMA
> Backup/Recovery Systems Mgr.
> Network Services Group
> i2 Technologies, Inc.
>
>
>
>              Jessica Blackburn
>              <jessica.blackbur
>              n AT ACTERNA DOT COM>                                            
>  To
>
>              Sent by: Legato           NETWORKER AT LISTMAIL.TEMPLE DOT EDU
>              NetWorker                                                  cc
>
>              discussion
>              <NETWORKER@LISTMA                                     Subject
>
>              IL.TEMPLE.EDU>            [Networker] NDMP Backup Problems
>
>
>              03/17/2004 11:14
>              AM
>
>
>              Please respond to
>              Legato NetWorker
>                 discussion
>              <NETWORKER@LISTMA
>               IL.TEMPLE.EDU>;
>              Please respond to
>              Jessica Blackburn
>              <jessica.blackbur
>               n AT ACTERNA DOT COM>
>
>
>
>
>
>
> Recently I've purchased and installed NDMP connection license and the
> SnapImage module so that I can backed 2 Network Appliance filers.  The
> backup of the smaller volumes is going well but the backup of the 154 GB
> volume looks like all of the data is being backed up but it's failing a
> "pacific:/vol/vol2 has been inactive for 60 minutes" error message.  Why
> is this occurring and how to I fix this problem?
>
> NetWorker Savegroup: (notice) GrpGER1ZPacific completed, 2 client(s) (All
> Succeeded)
> Restart time: Wed Mar 17 08:40:45 2004
> End time:     Wed Mar 17 08:40:46 2004
>
> --- Unsuccessful Save Sets ---
>
> * savegrp: suppressed 3 lines of verbose output
> * pacific:/vol/vol2
> * pacific:/vol/vol2 NDMP Service Log: DUMP: Wed Mar 17 01:38:44 2004 : We
> have written 152106870 KB.
> * pacific:/vol/vol2
> * pacific:/vol/vol2 NDMP Service Log: DUMP: Wed Mar 17 01:43:44 2004 : We
> have written 154270890 KB.
> * pacific:/vol/vol2
> * pacific:/vol/vol2 NDMP Service Log: DUMP: dumping (Pass V) [ACLs]
> * pacific:/vol/vol2
> * pacific:/vol/vol2 NDMP Service Log: DUMP: 154421655 KB
> * pacific:/vol/vol2
> * pacific:/vol/vol2 NDMP Service Log: DUMP: DUMP IS DONE
> * pacific:/vol/vol2
> * pacific:/vol/vol2 NDMP Service Log: DUMP: Deleting
> "/vol/vol2/../snapshot_for_backup.98" snapshot.
> * pacific:/vol/vol2
> * pacific:/vol/vol2 03/17/04 02:45:44 AM nsrexec: Attempting a kill on
> remote save
> * pacific:/vol/vol2 has been inactive for 60 minutes since Wed Mar 17
> 01:45:23 2004.
> * pacific:/vol/vol2 is being abandoned by nsrexec.
> * pacific:/vol/vol2 aborted due to inactivity
>
> --- Successful Save Sets ---
>
> * savegrp: suppressed 2 lines of verbose output
> * atlantic:/vol/vol0
> * atlantic:/vol/vol0 NDMP Service Log: DUMP: mapping (Pass I)[regular
> files]
> * atlantic:/vol/vol0
> * atlantic:/vol/vol0 NDMP Service Log: DUMP: mapping (Pass
> II)[directories]
> * atlantic:/vol/vol0
> * atlantic:/vol/vol0 NDMP Service Log: DUMP: estimated 1406 KB.
> * atlantic:/vol/vol0
> * atlantic:/vol/vol0 NDMP Service Log: DUMP: dumping (Pass III)
> [directories]
> * atlantic:/vol/vol0
> * atlantic:/vol/vol0 NDMP Service Log: DUMP: dumping (Pass IV) [regular
> files]
> * atlantic:/vol/vol0
> * atlantic:/vol/vol0 NDMP Service Log: DUMP: dumping (Pass V) [ACLs]
> * atlantic:/vol/vol0
> * atlantic:/vol/vol0 NDMP Service Log: DUMP: 37022 KB
> * atlantic:/vol/vol0
> * atlantic:/vol/vol0 NDMP Service Log: DUMP: DUMP IS DONE
> * atlantic:/vol/vol0
> * atlantic:/vol/vol0 NDMP Service Log: DUMP: Deleting
> "/vol/vol0/../snapshot_for_backup.0" snapshot.
> * atlantic:/vol/vol0
>   atlantic: /vol/vol0 level=1, 37 MB 00:04:05    227 files
> * savegrp: suppressed 2 lines of verbose output
> * atlantic:/vol/vol1
> * atlantic:/vol/vol1 NDMP Service Log: DUMP: mapping (Pass I)[regular
> files]
> * atlantic:/vol/vol1
> * atlantic:/vol/vol1 NDMP Service Log: DUMP: mapping (Pass
> II)[directories]
> * atlantic:/vol/vol1
> * atlantic:/vol/vol1 NDMP Service Log: DUMP: estimated 7 KB.
> * atlantic:/vol/vol1
> * atlantic:/vol/vol1 NDMP Service Log: DUMP: dumping (Pass III)
> [directories]
> * atlantic:/vol/vol1
> * atlantic:/vol/vol1 NDMP Service Log: DUMP: dumping (Pass IV) [regular
> files]
> * atlantic:/vol/vol1
> * atlantic:/vol/vol1 NDMP Service Log: DUMP: dumping (Pass V) [ACLs]
> * atlantic:/vol/vol1
> * atlantic:/vol/vol1 NDMP Service Log: DUMP: 142636 KB
> * atlantic:/vol/vol1
> * atlantic:/vol/vol1 NDMP Service Log: DUMP: DUMP IS DONE
> * atlantic:/vol/vol1
> * atlantic:/vol/vol1 NDMP Service Log: DUMP: Deleting
> "/vol/vol1/../snapshot_for_backup.1" snapshot.
> * atlantic:/vol/vol1
>   atlantic: /vol/vol1 level=1, 142 MB 00:00:52      3 files
> * savegrp: suppressed 2 lines of verbose output
> * atlantic:/vol/vol3
> * atlantic:/vol/vol3 NDMP Service Log: DUMP: mapping (Pass I)[regular
> files]
> * atlantic:/vol/vol3
> * atlantic:/vol/vol3 NDMP Service Log: DUMP: mapping (Pass
> II)[directories]
> * atlantic:/vol/vol3
> * atlantic:/vol/vol3 NDMP Service Log: DUMP: estimated 56956 KB.
> * atlantic:/vol/vol3
> * atlantic:/vol/vol3 NDMP Service Log: DUMP: dumping (Pass III)
> [directories]
> * atlantic:/vol/vol3
> * atlantic:/vol/vol3 NDMP Service Log: DUMP: dumping (Pass IV) [regular
> files]
> * atlantic:/vol/vol3
> * atlantic:/vol/vol3 NDMP Service Log: DUMP: dumping (Pass V) [ACLs]
> * atlantic:/vol/vol3
> * atlantic:/vol/vol3 NDMP Service Log: DUMP: 163988 KB
> * atlantic:/vol/vol3
> * atlantic:/vol/vol3 NDMP Service Log: DUMP: DUMP IS DONE
> * atlantic:/vol/vol3
> * atlantic:/vol/vol3 NDMP Service Log: DUMP: Deleting
> "/vol/vol3/../snapshot_for_backup.2" snapshot.
> * atlantic:/vol/vol3
>   atlantic: /vol/vol3 level=1, 163 MB 00:01:02    855 files
>   anacostia: index:atlantic         level=1,        62 KB 00:00:07      5
> files
>
> * savegrp: suppressed 3 lines of verbose output
> * pacific:/vol/vol0
> * pacific:/vol/vol0 NDMP Service Log: DUMP: mapping (Pass I)[regular
> files]
> * pacific:/vol/vol0
> * pacific:/vol/vol0 NDMP Service Log: DUMP: mapping (Pass II)[directories]
> * pacific:/vol/vol0
> * pacific:/vol/vol0 NDMP Service Log: DUMP: estimated 1377 KB.
> * pacific:/vol/vol0
> * pacific:/vol/vol0 NDMP Service Log: DUMP: dumping (Pass III)
> [directories]
> * pacific:/vol/vol0
> * pacific:/vol/vol0 NDMP Service Log: DUMP: dumping (Pass IV) [regular
> files]
> * pacific:/vol/vol0
> * pacific:/vol/vol0 NDMP Service Log: DUMP: dumping (Pass V) [ACLs]
> * pacific:/vol/vol0
> * pacific:/vol/vol0 NDMP Service Log: DUMP: 37014 KB
> * pacific:/vol/vol0
> * pacific:/vol/vol0 NDMP Service Log: DUMP: DUMP IS DONE
> * pacific:/vol/vol0
> * pacific:/vol/vol0 NDMP Service Log: DUMP: Deleting
> "/vol/vol0/../snapshot_for_backup.96" snapshot.
> * pacific:/vol/vol0
>   pacific: /vol/vol0 level=1, 37 MB 00:03:26    125 files
> * savegrp: suppressed 2 lines of verbose output
> * pacific:/vol/vol1
> * pacific:/vol/vol1 NDMP Service Log: DUMP: mapping (Pass I)[regular
> files]
> * pacific:/vol/vol1
> * pacific:/vol/vol1 NDMP Service Log: DUMP: mapping (Pass II)[directories]
> * pacific:/vol/vol1
> * pacific:/vol/vol1 NDMP Service Log: DUMP: estimated 192871 KB.
> * pacific:/vol/vol1
> * pacific:/vol/vol1 NDMP Service Log: DUMP: dumping (Pass III)
> [directories]
> * pacific:/vol/vol1
> * pacific:/vol/vol1 NDMP Service Log: DUMP: dumping (Pass IV) [regular
> files]
> * pacific:/vol/vol1
> * pacific:/vol/vol1 NDMP Service Log: DUMP: dumping (Pass V) [ACLs]
> * pacific:/vol/vol1
> * pacific:/vol/vol1 NDMP Service Log: DUMP: 467280 KB
> * pacific:/vol/vol1
> * pacific:/vol/vol1 NDMP Service Log: DUMP: DUMP IS DONE
> * pacific:/vol/vol1
> * pacific:/vol/vol1 NDMP Service Log: DUMP: Deleting
> "/vol/vol1/../snapshot_for_backup.97" snapshot.
> * pacific:/vol/vol1
>   pacific: /vol/vol1 level=1, 467 MB 00:05:52   4073 files
>   anacostia: index:pacific          level=1,       431 KB 00:02:43      4
> files
>
> Thanks,
> Jessica Blackburn
> Acterna
> 12410 Milestone Center Drive
> Germantown, MD 20876
>
> Phone: 240-404-1533
>
> --
> Note: To sign off this list, send a "signoff networker" command via email
> to listserv AT listmail.temple DOT edu or visit the list's Web site at
> http://listmail.temple.edu/archives/networker.html where you can
> also view and post messages to the list.
> =*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=
>
> --
> Note: To sign off this list, send a "signoff networker" command via email
> to listserv AT listmail.temple DOT edu or visit the list's Web site at
> http://listmail.temple.edu/archives/networker.html where you can
> also view and post messages to the list.
> =*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=

--
Note: To sign off this list, send a "signoff networker" command via email
to listserv AT listmail.temple DOT edu or visit the list's Web site at
http://listmail.temple.edu/archives/networker.html where you can
also view and post messages to the list.
=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=