Bacula-users

Re: [Bacula-users] Questions regarding migration job failure

2011-05-11 11:43:16
Subject: Re: [Bacula-users] Questions regarding migration job failure
From: Jerry Lowry <jlowry AT edt DOT com>
To: bacula-users AT lists.sourceforge DOT net
Date: Wed, 11 May 2011 08:44:18 -0700
Is there anyone that can help me with this problem?  Surely someone is using the migration job.


On 5/9/2011 2:51 PM, jerry lowry wrote:
Hi,

I am frequently getting errors on my migration jobs and I need some help trying to figure out what the problem is.

I have three migration jobs that migrate data from a daily disk to a raid disk that is setup as a hotswap disk.  Once this is full I pull the disk and move it to an offsite facility.  About half of the time the migration jobs work with out any problems, the other half I get errors on many of the jobs that are being migrated.  Example:  I start a migrate job and it starts to migrate 6 jobs to the offsite disk.  It will get through two of the jobs successfully and then the last four jobs will fail with the error below.  Each of the media are created using  BAT or BConsole without errors.

I have no clue as to what the problem might be, so any help is great.

Below you will find the config files and job output.

thanks,
jerry

Job error:

09-May 12:55 distress-dir JobId 2549: The following 3 JobIds were chosen to be migrated: 2335,2328,2291
09-May 12:55 distress-dir JobId 2549: Job queued. JobId=2550
09-May 12:55 distress-dir JobId 2549: Migration JobId 2550 started.
09-May 12:55 distress-dir JobId 2549: Job queued. JobId=2552
09-May 12:55 distress-dir JobId 2549: Migration JobId 2552 started.
09-May 12:55 distress-dir JobId 2549: Migration using JobId=2291 Job=BackupHardware.2011-04-17_20.05.00_17
09-May 12:55 distress-dir JobId 2549: Bootstrap records written to /var/run/bacula/working/distress-dir.restore.53.bsr
09-May 13:59 distress-dir JobId 2549: Start Migration JobId 2549, Job=CopyHWDiskToDisk.2011-05-09_12.55.37_45
09-May 13:59 distress-dir JobId 2549: Using Device "TopSwap"
09-May 13:59 distress-sd-sd JobId 2549: Ready to read from volume "hardware-0007" on device "Hardware" (/Hardware).
09-May 13:59 distress-sd-sd JobId 2549: Volume "hardwareBS-2" previously written, moving to end of data.
09-May 13:59 distress-sd-sd JobId 2549: Ready to append to end of Volume "hardwareBS-2" size=240021666918
09-May 13:59 distress-sd-sd JobId 2549: Forward spacing Volume "hardware-0007" to file:block 0:215.
09-May 13:59 distress-sd-sd JobId 2549: Error: block.c:275 Volume data error at 0:215! Wanted ID: "BB02", got "2". Buffer discarded.
09-May 13:59 distress-dir JobId 2549: Error: Bacula distress-dir 5.0.1 (24Feb10): 09-May-2011 13:59:15
  Build OS:               x86_64-unknown-linux-gnu redhat 
  Prev Backup JobId:      2291
  Prev Backup Job:        BackupHardware.2011-04-17_20.05.00_17
  New Backup JobId:       2554
  Current JobId:          2549
  Current Job:            CopyHWDiskToDisk.2011-05-09_12.55.37_45
  Backup Level:           Full
  Client:                 distress-sd-fd
  FileSet:                "Top Set" 2011-03-30 10:42:47
  Read Pool:              "HardwarePool" (From Job resource)
  Read Storage:           "hardware" (From command line)
  Write Pool:             "OffsiteTop" (From Job Pool's NextPool resource)
  Write Storage:          "topswap" (From Storage from Pool's NextPool resource)
  Catalog:                "MyCatalog" (From Client resource)
  Start time:             09-May-2011 13:59:15
  End time:               09-May-2011 13:59:15
  Elapsed time:           0 secs
  Priority:               10
  SD Files Written:       0
  SD Bytes Written:       0 (0 B)
  Rate:                   0.0 KB/s
  Volume name(s):         
  Volume Session Id:      27
  Volume Session Time:    1304722130
  Last Volume Bytes:      0 (0 B)
  SD Errors:              1
  SD termination status:  Running
  Termination:            *** Migration Error ***


Configuration files: (This is one of three, they are all setup the same way)

Job {
        Name = "CopyHWDiskToDisk"
        Type = Migrate
        Level = Full
        FileSet = "Top Set"
        Client = distress-sd-fd
        Messages = Standard
	Storage = hardware
        Pool = HardwarePool
        Maximum Concurrent Jobs = 4
        Selection Type = Pool Time
        Selection Pattern = "hardwareTS-*"
}

# File Pool definition
Pool {
  Name = OffsiteTop
  Pool Type = Migrate
  Next Pool = OffsiteTop
  Storage = topswap
  Recycle = yes                       # Bacula can automatically recycle Volumes
  AutoPrune = yes                     # Prune expired volumes
  Volume Retention = 6 months         # one week
  Maximum Volume Bytes = 1800G       # Limit Volume size to something reasonable
  Maximum Volumes = 10               # Limit number of Volumes in Pool
}

FileSet {
	Name = "Top Set"
	Include {
	Options {
	signature = MD5
	}
#    
#  Put your list of files here, preceded by 'File =', one per line
#    or include an external list with:
#
#    File = <file-name
#
#  Note: / backs up everything on the root partition.
#    if you have other partitions such as /usr or /home
#    you will probably want to add them too.
#
	File = /Workstations/
	}

#
# If you backup the root directory, the following two excluded
#   files can be useful
#
Exclude {
#    File = /var/run/bacula/working
#    File = /tmp
#    File = /proc
#    File = /tmp
#    File = /.journal
#    File = /.fsck
	}
}
# Definition of file storage device
Storage {
  Name = topswap			# offsite disk
# Do not use "localhost" here    
  #Address = distress-sd.ACCOUNTING.EDT.LOCAL                # N.B. Use a fully qualified name here
  Address = 10.10.10.9              # N.B. Use a fully qualified name here
  SDPort = 9103
  Password = ""
  Device = TopSwap
  Media Type = File
}

# Client (File Services) storeage director to backup
Client {
  Name = distress-sd-fd
  Address = 10.10.10.9	# distress-sd
  FDPort = 9102
  Catalog = MyCatalog
  Password = ""          # password for FileDaemon
  File Retention = 365 days            # 30 days
  Job Retention = 12 months            # six months
  AutoPrune = yes                     # Prune expired Jobs/Files
}

------------------------------------------------------------------------------ WhatsUp Gold - Download Free Network Management Software The most intuitive, comprehensive, and cost-effective network management toolset available today. Delivers lowest initial acquisition cost and overall TCO of any competing solution. http://p.sf.net/sfu/whatsupgold-sd
_______________________________________________ Bacula-users mailing list Bacula-users AT lists.sourceforge DOT net https://lists.sourceforge.net/lists/listinfo/bacula-users

--

---------------------------------------------------------------------------
Jerold Lowry
IT Manager / Software Engineer
Engineering Design Team (EDT), Inc. a HEICO company
1400 NW Compton Drive, Suite 315
Beaverton, Oregon 97006 (U.S.A.)
Phone: 503-690-1234 / 800-435-4320
Fax: 503-690-1243
Web:
www.edt.com

 


------------------------------------------------------------------------------
Achieve unprecedented app performance and reliability
What every C/C++ and Fortran developer should know.
Learn how Intel has extended the reach of its next-generation tools
to help boost performance applications - inlcuding clusters.
http://p.sf.net/sfu/intel-dev2devmay
_______________________________________________
Bacula-users mailing list
Bacula-users AT lists.sourceforge DOT net
https://lists.sourceforge.net/lists/listinfo/bacula-users