Bacula-users

[Bacula-users] Questions regarding migration job failure

2011-05-09 17:55:09
Subject: [Bacula-users] Questions regarding migration job failure
From: jerry lowry <jlowry AT edt DOT com>
To: bacula-users AT lists.sourceforge DOT net
Date: Mon, 09 May 2011 14:51:40 -0700
Hi,

I am frequently getting errors on my migration jobs and I need some help trying to figure out what the problem is.

I have three migration jobs that migrate data from a daily disk to a raid disk that is setup as a hotswap disk.  Once this is full I pull the disk and move it to an offsite facility.  About half of the time the migration jobs work with out any problems, the other half I get errors on many of the jobs that are being migrated.  Example:  I start a migrate job and it starts to migrate 6 jobs to the offsite disk.  It will get through two of the jobs successfully and then the last four jobs will fail with the error below.  Each of the media are created using  BAT or BConsole without errors.

I have no clue as to what the problem might be, so any help is great.

Below you will find the config files and job output.

thanks,
jerry

Job error:

09-May 12:55 distress-dir JobId 2549: The following 3 JobIds were chosen to be migrated: 2335,2328,2291
09-May 12:55 distress-dir JobId 2549: Job queued. JobId=2550
09-May 12:55 distress-dir JobId 2549: Migration JobId 2550 started.
09-May 12:55 distress-dir JobId 2549: Job queued. JobId=2552
09-May 12:55 distress-dir JobId 2549: Migration JobId 2552 started.
09-May 12:55 distress-dir JobId 2549: Migration using JobId=2291 Job=BackupHardware.2011-04-17_20.05.00_17
09-May 12:55 distress-dir JobId 2549: Bootstrap records written to /var/run/bacula/working/distress-dir.restore.53.bsr
09-May 13:59 distress-dir JobId 2549: Start Migration JobId 2549, Job=CopyHWDiskToDisk.2011-05-09_12.55.37_45
09-May 13:59 distress-dir JobId 2549: Using Device "TopSwap"
09-May 13:59 distress-sd-sd JobId 2549: Ready to read from volume "hardware-0007" on device "Hardware" (/Hardware).
09-May 13:59 distress-sd-sd JobId 2549: Volume "hardwareBS-2" previously written, moving to end of data.
09-May 13:59 distress-sd-sd JobId 2549: Ready to append to end of Volume "hardwareBS-2" size=240021666918
09-May 13:59 distress-sd-sd JobId 2549: Forward spacing Volume "hardware-0007" to file:block 0:215.
09-May 13:59 distress-sd-sd JobId 2549: Error: block.c:275 Volume data error at 0:215! Wanted ID: "BB02", got "2". Buffer discarded.
09-May 13:59 distress-dir JobId 2549: Error: Bacula distress-dir 5.0.1 (24Feb10): 09-May-2011 13:59:15
  Build OS:               x86_64-unknown-linux-gnu redhat 
  Prev Backup JobId:      2291
  Prev Backup Job:        BackupHardware.2011-04-17_20.05.00_17
  New Backup JobId:       2554
  Current JobId:          2549
  Current Job:            CopyHWDiskToDisk.2011-05-09_12.55.37_45
  Backup Level:           Full
  Client:                 distress-sd-fd
  FileSet:                "Top Set" 2011-03-30 10:42:47
  Read Pool:              "HardwarePool" (From Job resource)
  Read Storage:           "hardware" (From command line)
  Write Pool:             "OffsiteTop" (From Job Pool's NextPool resource)
  Write Storage:          "topswap" (From Storage from Pool's NextPool resource)
  Catalog:                "MyCatalog" (From Client resource)
  Start time:             09-May-2011 13:59:15
  End time:               09-May-2011 13:59:15
  Elapsed time:           0 secs
  Priority:               10
  SD Files Written:       0
  SD Bytes Written:       0 (0 B)
  Rate:                   0.0 KB/s
  Volume name(s):         
  Volume Session Id:      27
  Volume Session Time:    1304722130
  Last Volume Bytes:      0 (0 B)
  SD Errors:              1
  SD termination status:  Running
  Termination:            *** Migration Error ***


Configuration files: (This is one of three, they are all setup the same way)

Job {
        Name = "CopyHWDiskToDisk"
        Type = Migrate
        Level = Full
        FileSet = "Top Set"
        Client = distress-sd-fd
        Messages = Standard
	Storage = hardware
        Pool = HardwarePool
        Maximum Concurrent Jobs = 4
        Selection Type = Pool Time
        Selection Pattern = "hardwareTS-*"
}

# File Pool definition
Pool {
  Name = OffsiteTop
  Pool Type = Migrate
  Next Pool = OffsiteTop
  Storage = topswap
  Recycle = yes                       # Bacula can automatically recycle Volumes
  AutoPrune = yes                     # Prune expired volumes
  Volume Retention = 6 months         # one week
  Maximum Volume Bytes = 1800G       # Limit Volume size to something reasonable
  Maximum Volumes = 10               # Limit number of Volumes in Pool
}

FileSet {
	Name = "Top Set"
	Include {
	Options {
	signature = MD5
	}
#    
#  Put your list of files here, preceded by 'File =', one per line
#    or include an external list with:
#
#    File = <file-name
#
#  Note: / backs up everything on the root partition.
#    if you have other partitions such as /usr or /home
#    you will probably want to add them too.
#
	File = /Workstations/
	}

#
# If you backup the root directory, the following two excluded
#   files can be useful
#
Exclude {
#    File = /var/run/bacula/working
#    File = /tmp
#    File = /proc
#    File = /tmp
#    File = /.journal
#    File = /.fsck
	}
}
# Definition of file storage device
Storage {
  Name = topswap			# offsite disk
# Do not use "localhost" here    
  #Address = distress-sd.ACCOUNTING.EDT.LOCAL                # N.B. Use a fully qualified name here
  Address = 10.10.10.9              # N.B. Use a fully qualified name here
  SDPort = 9103
  Password = ""
  Device = TopSwap
  Media Type = File
}

# Client (File Services) storeage director to backup
Client {
  Name = distress-sd-fd
  Address = 10.10.10.9	# distress-sd
  FDPort = 9102
  Catalog = MyCatalog
  Password = ""          # password for FileDaemon
  File Retention = 365 days            # 30 days
  Job Retention = 12 months            # six months
  AutoPrune = yes                     # Prune expired Jobs/Files
}

------------------------------------------------------------------------------
WhatsUp Gold - Download Free Network Management Software
The most intuitive, comprehensive, and cost-effective network 
management toolset available today.  Delivers lowest initial 
acquisition cost and overall TCO of any competing solution.
http://p.sf.net/sfu/whatsupgold-sd
_______________________________________________
Bacula-users mailing list
Bacula-users AT lists.sourceforge DOT net
https://lists.sourceforge.net/lists/listinfo/bacula-users