Bacula-users

[Bacula-users] restoring big files spanning multiple volumes?

2009-03-18 08:46:12
Subject: [Bacula-users] restoring big files spanning multiple volumes?
From: Stefan Palme <palme AT kapott DOT org>
To: bacula-users AT lists.sourceforge DOT net
Date: Wed, 18 Mar 2009 13:16:32 +0100
Hi all,

I have a setup where I backup some files into a "File" storage
(i.e. not on tape). I have set the maximum volume size to something
around 2 GB to avoid some problems when transfering them later via
FTP, storing them on other file systems etc.

One of the files to be backuped has around 3.5 GB. In all my backups
this file (obviously) spans two volumes.

The problem: this large file can not be restored.

Using the "restore" command in the bacula console results in this:

 * restore
     ...
 Start Restore Job 1und1big-restore.2009-03-18_13.02.08
 Using Device "1und1big"
 Ready to read from volume "1und1big-0146" on device "1und1big" 
(/var/backup/1und1big).
 End of Volume at file 0 on device "1und1big" (/var/backup/1und1big), Volume 
"1und1big-0146"
 Ready to read from volume "1und1big-0147" on device "1und1big" 
(/var/backup/1und1big).
 Forward spacing Volume "1und1big-0147" to file:block 0:202.
 Error: block.c:318 Volume data error at 0:1143604416!
 Block checksum mismatch in block=48729 len=64512: calc=b8260f44 blk=1551553a
 Error: attribs.c:421 File size of restored file 
/tmp/bacula-restore/1und1big/var/lib/postgresql/backup/database.dump not 
correct. Original 3682990713, restored 3120824320.
 

When using "bextract" the following happens:

> bextract -v -V "1und1big-0146|1und1big-0147" .
bextract: match.c:249-0 add_fname_to_include prefix=0 gzip=0 fname=/
bextract: butil.c:282 Using device: "1und1big" for reading.
Ready to read from volume "1und1big-0146" on device "1und1big" 
(/var/backup/1und1big).
... (some extracted files)
-rw-r-----   1 root     bacula  3682990713 2009-03-15 21:02:24  
./var/lib/postgresql/backup/database.dump
Error: block.c:318 Volume data error at 0:329269449!
Block checksum mismatch in block=5105 len=64512: calc=7bf50f5a blk=66f71ed4
Error: attribs.c:421 File size of restored file 
./var/lib/postgresql/backup/database.dump not correct. Original 3682990713, 
restored 309133312.
bextract: acquire.c:436-0 dir_update_vol_info. label=64 Vol=1und1big-0146
131 files restored.


This happens for both full backups and for incremental backups. This
is very likely no hardware defect on my hard disk because this happens
with ALL backups I've ever made.

I've even tried to use bscan to update the catalog, but this did
not change anything - the error messages during "restore" and "bextract"
are the same.


Any ideas how to restore this file? This is a kind of desaster
situation because at the moment I NEED this backup. So of course
it would be nice to know how to avoid this problem for future backups.

But I would also be lucky about a way how to completely restore
this file (I guess all relevant data is available in the backups files, 
but the restore process does not handle it well).

Any help possible?
Thanks and regards
-stefan-



My configuration:
-----------------

Bacula Version: 2.4.3 (10 October 2008) x86_64-pc-linux-gnu gentoo 


bacula-dir.conf (shortened to the relevant parts):
--------------------------------------------------

FileSet {
  Name = 1und1big

  Include {
    Options {
      compression = GZIP
    }
    File = /var/lib/postgresql/backup/
    File = ... (some more dirs here)
  }
}

Storage {
  Name = 1und1big
  Address = 127.0.0.1
  Password = "password-storage-1und1big"
  Device = 1und1big
  MediaType = File
}

Pool {
  Name = 1und1big
  Pool Type = Backup  
  Storage = 1und1big
  Maximum Volume Jobs = 1
  Maximum Volume Bytes = 2000000000
  Volume Retention = 30 days
  Label Format = "1und1big-"
}


bacula-sd.conf:
---------------

Device {
  Name = 1und1big
  Archive Device = "/var/backup/1und1big"
  Device Type = File
  Media Type = File
  Always Open = no
  Removable Media = no
  Random Access = yes
  LabelMedia = yes
}



-- 
-------------------------------------------------------------------
Dipl. Inf. (FH) Stefan Palme
 
email: kleiner AT hora-obscura DOT de
www:   http://hbci4java.kapott.org
       http://converter-db.de
       http://myamavis.kapott.org
icq:   36376278
 
key fingerprint: 1BA7 D217 36A1 534C A5AD  F18A E2D1 488A E904 F9EC
-------------------------------------------------------------------



------------------------------------------------------------------------------
Apps built with the Adobe(R) Flex(R) framework and Flex Builder(TM) are
powering Web 2.0 with engaging, cross-platform capabilities. Quickly and
easily build your RIAs with Flex Builder, the Eclipse(TM)based development
software that enables intelligent coding and step-through debugging.
Download the free 60 day trial. http://p.sf.net/sfu/www-adobe-com
_______________________________________________
Bacula-users mailing list
Bacula-users AT lists.sourceforge DOT net
https://lists.sourceforge.net/lists/listinfo/bacula-users