[Networker] NDMP failling

Well, I ran your command but I'm have no idea what I'm looking at.  Here is the 
output for Oct. 10th, the day the NDMP job failed last.

2009-10-10 18:14:30: NDMP: 4: Session 237 (thread ndmp237) < Backup type: dump >
2009-10-10 18:14:30: NDMP: 4: Session 237 (thread ndmp237) Name: HIST Value: y
2009-10-10 18:14:30: NDMP: 4: Session 237 (thread ndmp237) Name: UPDATE Value: y
2009-10-10 18:14:30: NDMP: 4: Session 237 (thread ndmp237) Name: DIRECT Value: y
2009-10-10 18:14:30: NDMP: 4: Session 237 (thread ndmp237) Name: UTF8 Value: y
2009-10-10 18:14:30: NDMP: 4: Session 237 (thread ndmp237) Name: OPTIONS Value: 
NT
2009-10-10 18:14:30: NDMP: 4: Session 237 (thread ndmp237) Name: HOST Value: 
server_2
2009-10-10 18:14:30: NDMP: 4: Session 237 (thread ndmp237) Name: LEVEL Value: 0
2009-10-10 18:14:30: NDMP: 4: Session 237 (thread ndmp237) Name: NDMP_BUTYPE 
Value: dump
2009-10-10 18:14:30: NDMP: 4: Session 237 (thread ndmp237) Name: TYPE Value: 
dump
2009-10-10 18:14:30: NDMP: 4: Session 237 (thread ndmp237) Name: PREFIX Value: 
/cifs_filesystem
2009-10-10 18:14:30: NDMP: 4: Session 237 (thread ndmp237) Name: FILESYSTEM 
Value: /cifs_filesystem
2009-10-10 18:14:30: NDMP: 4: Session 237 (thread ndmp237) tape service is on a 
remote side, CALLER_ADDRESS 0x10f4d91.
2009-10-10 18:14:30: NDMP: 4: Thread ndmp237 uses a set of Pax threads with 
handle 0.
2009-10-10 18:14:30: NDMP: 6: Thread ndmp237 filterDialect could not be set - 
prereqs not met [pax_cmd_thread::setFilterDialect]
2009-10-10 18:14:30: NDMP: 4: Thread ndmp237 fsSize of /cifs_filesystem is 
826165288960 (../pax_ndmp.cxx: 1173)
2009-10-10 18:14:49: NDMP: 4: Session 238 (thread ndmp238) < Backup type: dump >
2009-10-10 18:14:49: NDMP: 4: Session 238 (thread ndmp238) Name: HIST Value: y
2009-10-10 18:14:49: NDMP: 4: Session 238 (thread ndmp238) Name: UPDATE Value: y
2009-10-10 18:14:49: NDMP: 4: Session 238 (thread ndmp238) Name: DIRECT Value: y
2009-10-10 18:14:49: NDMP: 4: Session 238 (thread ndmp238) Name: UTF8 Value: y
2009-10-10 18:14:49: NDMP: 4: Session 238 (thread ndmp238) Name: OPTIONS Value: 
NT
2009-10-10 18:14:49: NDMP: 4: Session 238 (thread ndmp238) Name: HOST Value: 
server_2
2009-10-10 18:14:49: NDMP: 4: Session 238 (thread ndmp238) Name: LEVEL Value: 0
2009-10-10 18:14:49: NDMP: 4: Session 238 (thread ndmp238) Name: NDMP_BUTYPE 
Value: dump
2009-10-10 18:14:49: NDMP: 4: Session 238 (thread ndmp238) Name: TYPE Value: 
dump
2009-10-10 18:14:49: NDMP: 4: Session 238 (thread ndmp238) Name: PREFIX Value: 
/cifs_filesystem_sata
2009-10-10 18:14:49: NDMP: 4: Session 238 (thread ndmp238) Name: FILESYSTEM 
Value: /cifs_filesystem_sata
2009-10-10 18:14:49: NDMP: 4: Session 238 (thread ndmp238) tape service is on a 
remote side, CALLER_ADDRESS 0x10f4d91.
2009-10-10 18:14:49: NDMP: 4: Thread ndmp238 uses a set of Pax threads with 
handle 1.
2009-10-10 18:14:49: NDMP: 6: Thread ndmp238 filterDialect could not be set - 
prereqs not met [pax_cmd_thread::setFilterDialect]
2009-10-10 18:14:49: NDMP: 4: Thread ndmp238 fsSize of /cifs_filesystem_sata is 
57124306944 (../pax_ndmp.cxx: 1173)
2009-10-10 18:58:28: NDMP: 4: Thread nasa01 Backup root directory: 
/cifs_filesystem_sata
2009-10-10 18:58:28: NDMP: 4: Thread nasa01 write count 70947179177
2009-10-10 18:58:28: NDMP: 4: Thread nasa01 time used 2619 sec
2009-10-10 18:58:28: NDMP: 4: Thread nasa01 write rate 26444 KB/Sec
2009-10-10 18:58:28: NDMP: 4: Thread nasa01 read rate 0 KB/Sec
2009-10-10 18:58:28: NDMP: 4: Thread nasa01 average file size: 302KB
2009-10-10 18:58:28: NDMP: 4: Thread nasa01 dir  or   0  size file processed: 
19263
2009-10-10 18:58:28: NDMP: 4: Thread nasa01   1B -- 8KB  size file processed: 
59120
2009-10-10 18:58:28: NDMP: 4: Thread nasa01  8KB -- 16KB size file processed: 
13967
2009-10-10 18:58:28: NDMP: 4: Thread nasa01 16KB -- 32KB size file processed: 
35773
2009-10-10 18:58:28: NDMP: 4: Thread nasa01 32KB -- 64KB size file processed: 
28015
2009-10-10 18:58:28: NDMP: 4: Thread nasa01 64KB -- 1MB  size file processed: 
61340
2009-10-10 18:58:28: NDMP: 4: Thread nasa01  1MB -- 32MB size file processed: 
11762
2009-10-10 18:58:28: NDMP: 4: Thread nasa01 32MB -- 1GB  size file processed: 79
2009-10-10 18:58:28: NDMP: 4: Thread nasa01    1G more   size file processed: 1
2009-10-10 18:58:28: NDMP: 6: Thread nasa01 server_archive: emctar vol 1, 
229320 files, 0 bytes read, 70947179177 bytes written

2009-10-10 18:58:28: NDMP: 4: Got stat buffer with data pointer=NULL at 1374, 
abort=1
2009-10-10 18:58:28: NDMP: 4: Thread nasa01 cifs_ea new count: 98079104, delete 
count: 98078976, freeListCount: 140
2009-10-10 20:38:48: VRPL: 6: 133: Allocating chunk:9 Add:2360320 Chunks:1796
2009-10-10 21:25:23: VRPL: 6: 133: Allocating chunk:43 Add:11273216 Chunks:1796
2009-10-10 22:14:13: VRPL: 6: 133: Allocating chunk:44 Add:11535360 Chunks:1796
2009-10-10 23:05:53: VRPL: 6: 133: Allocating chunk:45 Add:11797504 Chunks:1796



James Pratt wrote:
> Well, it says the ndmp/celerra job failed, but I don't see exactly why
> myself .... 
> 
> On your Celerra's primary datamover, check the datamover log with :
> 
> $ server_log server_X
> 
> (Where X is your primary datamover number - for example, ours is 2)
> 
> Email me off list if you want commands that will up the NDMP/PAX debug
> level on the Celerra (ie. $ "server_log server_X" output) , but then
> again if it's a very long job your celerra logs may fill up before the
> error occurs! :\
> 
> Cheers,
> Jamie
> 
> 
> > 
> > > -----Original Message-----
> > > From: EMC NetWorker discussion [mailto:NETWORKER < at > 
> > > LISTSERV.TEMPLE.EDU]
> > > 
> > 
> On
> 
> > 
> > > Behalf Of jasondre
> > > Sent: Monday, October 12, 2009 2:49 PM
> > > To: NETWORKER < at > LISTSERV.TEMPLE.EDU
> > > Subject: [Networker] NDMP failling
> > > 
> > > Found this in the daemon.log, anyone understand this?
> > > 
> > > 36 PM  2 0 0 2764 1604 0 s_networker.joa.local nsrexecd An internal
> > > 
> > 
> tracking event:
> 
> > 
> > > GSS Legato authentication user session entry (warning): "User
> > > 
> > 
> authentication
> 
> > 
> > > session timed out and is now invalid.". Session number = 0:4a3a,
> > > 
> > 
> domain = NT
> 
> > 
> > > AUTHORITY, user name = SYSTEM, NetWorker Instance Name =
> > > s_networker.joa.local
> > > 67209 10/10/2009 5:02:36 PM  2 0 0 2764 1604 0 s_networker.joa.local
> > > 
> > 
> nsrexecd
> 
> > 
> > > An internal tracking event: GSS Legato authentication user session
> > > 
> > 
> entry (warning):
> 
> > 
> > > "User authentication session timed out and is now invalid.". Session
> > > 
> > 
> number =
> 
> > 
> > > 0:4a3c, domain = NT AUTHORITY, user name = SYSTEM, NetWorker Instance
> > > 
> > 
> Name
> 
> > 
> > > = s_networker.joa.local
> > > 40473 10/10/2009 5:02:36 PM  2 0 0 5756 6340 0 s_networker.joa.local
> > > 
> > 
> savegrp
> 
> > 
> > > command ' nsrndmp_save -M -T dump -s s_networker.joa.local -c
> > > 
> > 
> server_2 -g
> 
> > 
> > > NDMP_Celerra_Full -l full -LL -q -W 78 -N /cifs_filesystem
> > > 
> > 
> /cifs_filesystem' for client
> 
> > 
> > > server_2 exited with return code -1.
> > > 32496 10/10/2009 5:02:36 PM  2 0 0 5756 6340 0 s_networker.joa.local
> > > 
> > 
> savegrp
> 
> > 
> > > job (2048685) host: server_2 savepoint: /cifs_filesystem had ERROR
> > > 
> > 
> indication(s) at
> 
> > 
> > > completion.
> > > 64690 10/10/2009 5:02:36 PM  2 0 0 5756 6340 0 s_networker.joa.local
> > > 
> > 
> savegrp
> 
> > 
> > > savegrp:NDMP_Celerra_Full * server_2:/cifs_filesystem  See the file
> > > 
> > 
> C:\Program
> 
> > 
> > > Files\Legato\nsr\tmp\sg\NDMP_Celerra_Full\sso.000003 for output of
> > > 
> > 
> save
> 
> > 
> > > command.
> > > 7341 10/10/2009 5:02:36 PM  2 0 0 5756 6340 0 s_networker.joa.local
> > > 
> > 
> savegrp
> 
> > 
> > > server_2:/cifs_filesystem failed.
> > > 7339 10/10/2009 5:02:36 PM  2 0 0 5756 6340 0 s_networker.joa.local
> > > 
> > 
> savegrp
> 
> > 
> > > server_2:/cifs_filesystem will retry 1 more time(s)
> > > 40473 10/10/2009 5:03:03 PM  2 0 0 5756 6340 0 s_networker.joa.local
> > > 
> > 
> savegrp
> 
> > 
> > > command ' nsrndmp_save -M -T dump -s s_networker.joa.local -c
> > > 
> > 
> server_2 -g
> 
> > 
> > > NDMP_Celerra_Full -l full -LL -q -W 78 -N /cifs_filesystem_sata
> > > 
> > 
> /cifs_filesystem_sata'
> 
> > 
> > > for client server_2 exited with return code -1.
> > > 32496 10/10/2009 5:03:03 PM  2 0 0 5756 6340 0 s_networker.joa.local
> > > 
> > 
> savegrp
> 
> > 
> > > job (2048686) host: server_2 savepoint: /cifs_filesystem_sata had
> > > 
> > 
> ERROR
> 
> > 
> > > indication(s) at completion.
> > > 64690 10/10/2009 5:03:03 PM  2 0 0 5756 6340 0 s_networker.joa.local
> > > 
> > 
> savegrp
> 
> > 
> > > savegrp:NDMP_Celerra_Full * server_2:/cifs_filesystem_sata  See the
> > > 
> > 
> file C:\Program
> 
> > 
> > > Files\Legato\nsr\tmp\sg\NDMP_Celerra_Full\sso.000004 for output of
> > > 
> > 
> save
> 
> > 
> > > command.
> > > 7341 10/10/2009 5:03:03 PM  2 0 0 5756 6340 0 s_networker.joa.local
> > > 
> > 
> savegrp
> 
> > 
> > > server_2:/cifs_filesystem_sata failed.
> > > 7339 10/10/2009 5:03:03 PM  2 0 0 5756 6340 0 s_networker.joa.local
> > > 
> > 
> savegrp
> 
> > 
> > > server_2:/cifs_filesystem_sata will retry 1 more time(s)
> > > 
> > > 
> > > 
> > 
> +----------------------------------------------------------------------
> 
> > 
> > > |This was sent by jdrescher < at > joa.com via Backup Central.
> > > |Forward SPAM to abuse < at > backupcentral.com.
> > > 
> > > 
> > 
> +----------------------------------------------------------------------
> 
> > 
> > > 
> > > 
> > > 
> > 
> type "signoff
> 
> > 
> > > networker" in the body of the email. Please write to networker-
> > > request < at > listserv.temple.edu if you have any problems with this 
> > > list.
> > > 
> > 
> You can access
> 
> > 
> > > the archives at http://listserv.temple.edu/archives/networker.html or
> > > via RSS at http://listserv.temple.edu/cgi-bin/wa?RSS&L=NETWORKER
> > > 
> > 
> 
> 
> via RSS at http://listserv.temple.edu/cgi-bin/wa?RSS&L=NETWORKER


+----------------------------------------------------------------------
|This was sent by jdrescher AT joa DOT com via Backup Central.
|Forward SPAM to abuse AT backupcentral DOT com.
+----------------------------------------------------------------------

To sign off this list, send email to listserv AT listserv.temple DOT edu and 
type "signoff networker" in the body of the email. Please write to 
networker-request AT listserv.temple DOT edu if you have any problems with this 
list. You can access the archives at 
http://listserv.temple.edu/archives/networker.html or
via RSS at http://listserv.temple.edu/cgi-bin/wa?RSS&L=NETWORKER