Bacula-users

Re: [Bacula-users] restoring big files spanning multiple volumes?

2009-03-18 09:35:40
Subject: Re: [Bacula-users] restoring big files spanning multiple volumes?
From: John Drescher <drescherjm AT gmail DOT com>
To: Stefan Palme <palme AT kapott DOT org>, bacula-users <Bacula-users AT lists.sourceforge DOT net>
Date: Wed, 18 Mar 2009 09:24:10 -0400
> I have a setup where I backup some files into a "File" storage
> (i.e. not on tape). I have set the maximum volume size to something
> around 2 GB to avoid some problems when transfering them later via
> FTP, storing them on other file systems etc.
>
> One of the files to be backuped has around 3.5 GB. In all my backups
> this file (obviously) spans two volumes.
>
That is generally not a problem. I have restored dozens of times in
this situation without ever seeing this error.

>
> The problem: this large file can not be restored.
>
> Using the "restore" command in the bacula console results in this:
>
>  * restore
>     ...
>  Start Restore Job 1und1big-restore.2009-03-18_13.02.08
>  Using Device "1und1big"
>  Ready to read from volume "1und1big-0146" on device "1und1big" 
> (/var/backup/1und1big).
>  End of Volume at file 0 on device "1und1big" (/var/backup/1und1big), Volume 
> "1und1big-0146"
>  Ready to read from volume "1und1big-0147" on device "1und1big" 
> (/var/backup/1und1big).
>  Forward spacing Volume "1und1big-0147" to file:block 0:202.
>  Error: block.c:318 Volume data error at 0:1143604416!
>  Block checksum mismatch in block=48729 len=64512: calc=b8260f44 blk=1551553a
>  Error: attribs.c:421 File size of restored file 
> /tmp/bacula-restore/1und1big/var/lib/postgresql/backup/database.dump not 
> correct. Original 3682990713, restored 3120824320.
>
>
> When using "bextract" the following happens:
>
>> bextract -v -V "1und1big-0146|1und1big-0147" .
> bextract: match.c:249-0 add_fname_to_include prefix=0 gzip=0 fname=/
> bextract: butil.c:282 Using device: "1und1big" for reading.
> Ready to read from volume "1und1big-0146" on device "1und1big" 
> (/var/backup/1und1big).
> ... (some extracted files)
> -rw-r-----   1 root     bacula  3682990713 2009-03-15 21:02:24 
>  ./var/lib/postgresql/backup/database.dump
> Error: block.c:318 Volume data error at 0:329269449!
> Block checksum mismatch in block=5105 len=64512: calc=7bf50f5a blk=66f71ed4
> Error: attribs.c:421 File size of restored file 
> ./var/lib/postgresql/backup/database.dump not correct. Original 3682990713, 
> restored 309133312.
> bextract: acquire.c:436-0 dir_update_vol_info. label=64 Vol=1und1big-0146
> 131 files restored.
>
>
> This happens for both full backups and for incremental backups. This
> is very likely no hardware defect on my hard disk because this happens
> with ALL backups I've ever made.
>
I have never seen this with jobs spanning disks and I have been using
bacula for 5 years and 15000 jobs I have run with > 40TB saved.

>
> I've even tried to use bscan to update the catalog, but this did
> not change anything - the error messages during "restore" and "bextract"
> are the same.
>
>
> Any ideas how to restore this file? This is a kind of desaster
> situation because at the moment I NEED this backup. So of course
> it would be nice to know how to avoid this problem for future backups.
>
This is not normal behavior. Some how the volume big-0147 got
corrupted (bacula bug? / kernel bug? / bad hardware? / other software?
/ unclean shutdown?) . I am not sure a corrupted volume is
recoverable, especially one with compression on.

> But I would also be lucky about a way how to completely restore
> this file (I guess all relevant data is available in the backups files,
> but the restore process does not handle it well).
>
> Any help possible?
> Thanks and regards
>
Do you have a bootstrap file for the job?

BTW, are you using a 32 bit OS? I have not had bacula on 32 bits since
late 2004 at work. However I did have 32 bits at home till 2005. What
version of bacula are you using? Are you using concurrent jobs?

John

------------------------------------------------------------------------------
Apps built with the Adobe(R) Flex(R) framework and Flex Builder(TM) are
powering Web 2.0 with engaging, cross-platform capabilities. Quickly and
easily build your RIAs with Flex Builder, the Eclipse(TM)based development
software that enables intelligent coding and step-through debugging.
Download the free 60 day trial. http://p.sf.net/sfu/www-adobe-com
_______________________________________________
Bacula-users mailing list
Bacula-users AT lists.sourceforge DOT net
https://lists.sourceforge.net/lists/listinfo/bacula-users