Bacula-users

Re: [Bacula-users] missing a file during verification

2012-01-31 14:09:25
Subject: Re: [Bacula-users] missing a file during verification
From: "Doug Sampson" <dougs AT dawnsign DOT com>
To: "Martin Simmons" <martin AT lispworks DOT com>, <bacula-users AT lists.sourceforge DOT net>
Date: Tue, 31 Jan 2012 11:02:59 -0800
> >>>>> On Mon, 30 Jan 2012 13:28:47 -0800, Doug Sampson said:
> >
> > Hello-
> >
> > Since upgrading to 5.2.3 from 5.0.3 on a FreeBSD 7.4 server two
weeks
> > ago, I've started seeing this message:
> >
> > 28-Jan 06:08 pisces-sd JobId 8299: End of Volume at file 1 on device
> > "FileStoragecepheus" (/backup), Volume
> > "Backup_cepheus-fd_2012-01-28_00.05.01"
> > 28-Jan 06:08 pisces-sd JobId 8299: End of all volumes.
> > 28-Jan 06:08 pisces-dir JobId 8299: Error: Bacula pisces-dir 5.2.3
> > (16Dec11):
> >   Build OS:               i386-portbld-freebsd7.4 freebsd
7.4-RELEASE-p3
> >   JobId:                  8299
> >   Job:                    cepheusVerifyData.2012-01-28_06.00.00_15
> >   FileSet:                cepheus
> >   Verify Level:           VolumeToCatalog
> >   Client:                 cepheus-fd
> >   Verify JobId:           8295
> >   Verify Job:
> >   Start time:             28-Jan-2012 06:00:00
> >   End time:               28-Jan-2012 06:08:40
> >   Files Expected:         989
> >   Files Examined:         988
> >   Non-fatal FD errors:    0
> >   FD termination status:  OK
> >   SD termination status:  OK
> >   Termination:            *** Verify Error ***
> >
> > This is for a differential backup of a Windows machine each
Saturday.
> > The daily incremental backups appear to be fine. The machine
'cepheus'
> > is a Windows 2003 server running Winbacula 5.2.3. Prior to upgrading
to
> > 5.2.3 on all Bacula devices, there were no errors reported on this
> > instance.
> >
> > How do I turn on or increase logging to try to identify the reason
for
> > the skip? Or at least identify the file being skipped?
> 
> Check the log lines above the ones you posted.  Bacula should print
> 
> The following files are in the Catalog but not on the Volume(s):
> 
> followed by the list of them.
> 
> If not, what is your Message resource in the bacula-dir.conf?
> 

Whoops. I thought I had copied the entire message for JobId 8299. I'm
enclosing both JobId 8295 (the original backup job) and JobId 8299 (the
verify job) here:

28-Jan 00:05 pisces-dir JobId 8295: Start Backup JobId 8295,
Job=cepheus.2012-01-28_00.05.00_11
28-Jan 00:05 pisces-dir JobId 8295: There are no more Jobs associated
with Volume "Backup_cepheus-fd_2011-11-19_00.05.03". Marking it purged.
28-Jan 00:05 pisces-dir JobId 8295: All records pruned from Volume
"Backup_cepheus-fd_2011-11-19_00.05.03"; marking it "Purged"
28-Jan 00:05 pisces-dir JobId 8295: There are no more Jobs associated
with Volume "Backup_cepheus-fd_2011-11-26_00.05.02". Marking it purged.
28-Jan 00:05 pisces-dir JobId 8295: All records pruned from Volume
"Backup_cepheus-fd_2011-11-26_00.05.02"; marking it "Purged"
28-Jan 00:05 pisces-dir JobId 8295: Created new Volume
"Backup_cepheus-fd_2012-01-28_00.05.01" in catalog.
28-Jan 00:05 pisces-dir JobId 8295: Using Device "FileStoragecepheus"
28-Jan 00:03 cepheus-fd JobId 8295: DIR and FD clocks differ by -92
seconds, FD automatically compensating.
28-Jan 00:03 cepheus-fd JobId 8295: shell command: run
ClientRunBeforeJob "start /w ntbackup backup systemstate /F
C:\SystemState.bkf"
28-Jan 00:06 pisces-sd JobId 8295: Labeled new Volume
"Backup_cepheus-fd_2012-01-28_00.05.01" on device "FileStoragecepheus"
(/backup).
28-Jan 00:06 pisces-sd JobId 8295: Wrote label to prelabeled Volume
"Backup_cepheus-fd_2012-01-28_00.05.01" on device "FileStoragecepheus"
(/backup)
28-Jan 00:06 pisces-dir JobId 8295: Max Volume jobs=1 exceeded. Marking
Volume "Backup_cepheus-fd_2012-01-28_00.05.01" as Used.
28-Jan 00:05 cepheus-fd JobId 8295: Generate VSS snapshots. Driver="VSS
Win 2003", Drive(s)="CD"
28-Jan 00:21 cepheus-fd JobId 8295: VSS Writer (BackupComplete): "System
Writer", State: 0x1 (VSS_WS_STABLE)
28-Jan 00:21 cepheus-fd JobId 8295: VSS Writer (BackupComplete):
"SqlServerWriter", State: 0x1 (VSS_WS_STABLE)
28-Jan 00:21 cepheus-fd JobId 8295: VSS Writer (BackupComplete):
"Removable Storage Manager", State: 0x1 (VSS_WS_STABLE)
28-Jan 00:21 cepheus-fd JobId 8295: VSS Writer (BackupComplete):
"MSDEWriter", State: 0x1 (VSS_WS_STABLE)
28-Jan 00:21 cepheus-fd JobId 8295: VSS Writer (BackupComplete): "WMI
Writer", State: 0x1 (VSS_WS_STABLE)
28-Jan 00:21 cepheus-fd JobId 8295: VSS Writer (BackupComplete): "BITS
Writer", State: 0x1 (VSS_WS_STABLE)
28-Jan 00:21 cepheus-fd JobId 8295: VSS Writer (BackupComplete):
"Registry Writer", State: 0x1 (VSS_WS_STABLE)
28-Jan 00:21 cepheus-fd JobId 8295: VSS Writer (BackupComplete): "IIS
Metabase Writer", State: 0x1 (VSS_WS_STABLE)
28-Jan 00:21 cepheus-fd JobId 8295: VSS Writer (BackupComplete): "Event
Log Writer", State: 0x1 (VSS_WS_STABLE)
28-Jan 00:21 cepheus-fd JobId 8295: VSS Writer (BackupComplete): "COM+
REGDB Writer", State: 0x1 (VSS_WS_STABLE)
28-Jan 00:22 pisces-sd JobId 8295: Job write elapsed time = 00:16:16,
Transfer rate = 4.801 M Bytes/second
28-Jan 00:23 pisces-dir JobId 8295: Bacula pisces-dir 5.2.3 (16Dec11):
  Build OS:               i386-portbld-freebsd7.4 freebsd 7.4-RELEASE-p3
  JobId:                  8295
  Job:                    cepheus.2012-01-28_00.05.00_11
  Backup Level:           Differential, since=2012-01-07 00:05:12
  Client:                 "cepheus-fd" 5.2.3 (16Dec11) Microsoft Windows
Server 2003 R2 Enterprise Edit
ion Service Pack 2 (build 3790),Cross-compile,Win32
  FileSet:                "cepheus" 2010-02-05 16:54:38
  Pool:                   "cepheus" (From Run pool override)
  Catalog:                "MyCatalog" (From Client resource)
  Storage:                "FileStoragecepheus" (From Job resource)
  Scheduled time:         28-Jan-2012 00:05:00
  Start time:             28-Jan-2012 00:06:41
  End time:               28-Jan-2012 00:23:01
  Elapsed time:           16 mins 20 secs
  Priority:               10
  FD Files Written:       989
  SD Files Written:       989
  FD Bytes Written:       4,685,749,010 (4.685 GB)
  SD Bytes Written:       4,685,928,862 (4.685 GB)
  Rate:                   4781.4 KB/s
  Software Compression:   76.5 %
  VSS:                    yes
  Encryption:             no
  Accurate:               no
  Volume name(s):         Backup_cepheus-fd_2012-01-28_00.05.01
  Volume Session Id:      9
  Volume Session Time:    1327608090
  Last Volume Bytes:      4,692,229,733 (4.692 GB)
  Non-fatal FD errors:    0
  SD Errors:              0
  FD termination status:  OK
  SD termination status:  OK
  Termination:            Backup OK

28-Jan 00:23 pisces-dir JobId 8295: Begin pruning Jobs older than 2
months .
28-Jan 00:23 pisces-dir JobId 8295: No Jobs found to prune.
28-Jan 00:23 pisces-dir JobId 8295: Begin pruning Files.
28-Jan 00:23 pisces-dir JobId 8295: No Files found to prune.
28-Jan 00:23 pisces-dir JobId 8295: End auto prune.



28-Jan 06:00 pisces-dir JobId 8299: Verifying against JobId=8295
Job=cepheus.2012-01-28_00.05.00_11
28-Jan 06:00 pisces-dir JobId 8299: Bootstrap records written to
/var/db/bacula/pisces-dir.restore.4.bsr
28-Jan 06:00 pisces-dir JobId 8299: Start Verify JobId=8299
Level=VolumeToCatalog Job=cepheusVerifyData.2012-01-28_06.00.00_15
28-Jan 06:00 pisces-dir JobId 8299: Using Device "FileStoragecepheus"
28-Jan 06:00 pisces-sd JobId 8299: Ready to read from volume
"Backup_cepheus-fd_2012-01-28_00.05.01" on device "FileStoragecepheus"
(/backup).
28-Jan 06:00 pisces-sd JobId 8299: Forward spacing Volume
"Backup_cepheus-fd_2012-01-28_00.05.01" to file:block 0:237.
28-Jan 06:08 pisces-sd JobId 8299: End of Volume at file 1 on device
"FileStoragecepheus" (/backup), Volume
"Backup_cepheus-fd_2012-01-28_00.05.01"
28-Jan 06:08 pisces-sd JobId 8299: End of all volumes.
28-Jan 06:08 pisces-dir JobId 8299: Error: Bacula pisces-dir 5.2.3
(16Dec11):
  Build OS:               i386-portbld-freebsd7.4 freebsd 7.4-RELEASE-p3
  JobId:                  8299
  Job:                    cepheusVerifyData.2012-01-28_06.00.00_15
  FileSet:                cepheus
  Verify Level:           VolumeToCatalog
  Client:                 cepheus-fd
  Verify JobId:           8295
  Verify Job:             
  Start time:             28-Jan-2012 06:00:00
  End time:               28-Jan-2012 06:08:40
  Files Expected:         989
  Files Examined:         988
  Non-fatal FD errors:    0
  FD termination status:  OK
  SD termination status:  OK
  Termination:            *** Verify Error ***

28-Jan 06:08 pisces-dir JobId 8299: Begin pruning Jobs older than 2
months .
28-Jan 06:08 pisces-dir JobId 8299: No Jobs found to prune.
28-Jan 06:08 pisces-dir JobId 8299: Begin pruning Files.
28-Jan 06:08 pisces-dir JobId 8299: No Files found to prune.
28-Jan 06:08 pisces-dir JobId 8299: End auto prune.

As you can see Bacula does not print anything indicating which file is
not on the Volume. Message resource info below:

# Verify file consistency between data & data backup of cepheus-fd
Job {
  Name = "cepheusVerifyData"
  Type = Verify
  Client = cepheus-fd
  Level = VolumeToCatalog
  FileSet = "cepheus"
  Schedule = "cepheusVerifyWeeklyCycle"
  Storage = FileStoragecepheus
  Messages = Standard
<<<<<<<<<<<<<<<<<=====================
  Pool = cepheus
  Priority = 11                   # run after main backup
  Maximum Concurrent Jobs = 14
}


# Reasonable message delivery -- send most everything to email address
#  and to the console
Messages {
  Name = Standard
#
# NOTE! If you send to two email or more email addresses, you will need
#  to replace the %r in the from field (-f part) with a single valid
#  email address in both the mailcommand and the operatorcommand.
#
  mailcommand = "/usr/local/sbin/bsmtp -h mailfilter.example.org -f
root AT example DOT org -s \"Bacula: %t %e of %c %l\" %r"
  operatorcommand = "/usr/local/sbin/bsmtp -h mailfilter.example.org -f
root AT example DOT org -s \"Bacula: Intervention needed for %j\" %r"
  mail = admin AT example DOT org = all, !skipped            
  operator = admin AT example DOT org, dsamp AT example DOT org = mount      # 
the
alias 'bacula' is defined in /etc/mail/aliases
  console = all, !skipped, !saved
#
# WARNING! the following will create a file that you must cycle from
#          time to time as it will grow indefinitely. However, it will
#          also keep all your messages if they scroll off the console.
#
  append = "/var/db/bacula/log" = all, !skipped
}

Does these help?

~Doug

------------------------------------------------------------------------------
Keep Your Developer Skills Current with LearnDevNow!
The most comprehensive online learning library for Microsoft developers
is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3,
Metro Style Apps, more. Free future releases when you subscribe now!
http://p.sf.net/sfu/learndevnow-d2d
_______________________________________________
Bacula-users mailing list
Bacula-users AT lists.sourceforge DOT net
https://lists.sourceforge.net/lists/listinfo/bacula-users

<Prev in Thread] Current Thread [Next in Thread>