Bacula-users

Re: [Bacula-users] Bacula fails to backup jobs to Tape

2010-06-09 07:00:42
Subject: Re: [Bacula-users] Bacula fails to backup jobs to Tape
From: Niek Linnenbank <niek.linnenbank AT industrial-tsi DOT com>
To: francisco javier funes nieto <esencia AT gmail DOT com>
Date: Wed, 09 Jun 2010 12:57:53 +0200

Hi Francisco,

 

Thanks for your quick reply! I've modified the bacula-sd.conf to use /dev/nst0 instead of /dev/st0.

Here is the output of the btape test command on /dev/nst0:

 

root@backup01:/etc/bacula# btape /dev/nst0
Tape block granularity is 1024 bytes.
btape: butil.c:284 Using device: "/dev/nst0" for writing.
btape: btape.c:476 open device "Tape Device" (/dev/nst0): OK
*test

=== Write, rewind, and re-read test ===

I'm going to write 10000 records and an EOF
then write 10000 records and an EOF, then rewind,
and re-read the data to verify that it is correct.

This is an *essential* feature ...

btape: btape.c:1148 Wrote 10000 blocks of 64412 bytes.
btape: btape.c:608 Wrote 1 EOF to "Tape Device" (/dev/nst0)
btape: btape.c:1164 Wrote 10000 blocks of 64412 bytes.
btape: btape.c:608 Wrote 1 EOF to "Tape Device" (/dev/nst0)
btape: btape.c:1206 Rewind OK.
10000 blocks re-read correctly.
Got EOF on tape.
10000 blocks re-read correctly.
=== Test Succeeded. End Write, rewind, and re-read test ===

 

btape: btape.c:1274 Block position test
btape: btape.c:1286 Rewind OK.
Reposition to file:block 0:4
Block 5 re-read correctly.
Reposition to file:block 0:200
Block 201 re-read correctly.
Reposition to file:block 0:9999
Block 10000 re-read correctly.
Reposition to file:block 1:0
Block 10001 re-read correctly.
Reposition to file:block 1:600
Block 10601 re-read correctly.
Reposition to file:block 1:9999
Block 20000 re-read correctly.
=== Test Succeeded. End Write, rewind, and re-read test ===



=== Append files test ===

This test is essential to Bacula.

I'm going to write one record  in file 0,
                   two records in file 1,
             and three records in file 2
btape: btape.c:578 Rewound "Tape Device" (/dev/nst0)
btape: btape.c:1905 Wrote one record of 64412 bytes.
btape: btape.c:1907 Wrote block to device.
btape: btape.c:608 Wrote 1 EOF to "Tape Device" (/dev/nst0)
btape: btape.c:1905 Wrote one record of 64412 bytes.
btape: btape.c:1907 Wrote block to device.
btape: btape.c:1905 Wrote one record of 64412 bytes.
btape: btape.c:1907 Wrote block to device.
btape: btape.c:608 Wrote 1 EOF to "Tape Device" (/dev/nst0)
btape: btape.c:1905 Wrote one record of 64412 bytes.
btape: btape.c:1907 Wrote block to device.
btape: btape.c:1905 Wrote one record of 64412 bytes.
btape: btape.c:1907 Wrote block to device.
btape: btape.c:1905 Wrote one record of 64412 bytes.
btape: btape.c:1907 Wrote block to device.
btape: btape.c:608 Wrote 1 EOF to "Tape Device" (/dev/nst0)
btape: btape.c:476 open device "Tape Device" (/dev/nst0): OK
btape: btape.c:578 Rewound "Tape Device" (/dev/nst0)
btape: btape.c:1418 Now moving to end of medium.
btape: btape.c:629 Moved to end of medium.
We should be in file 3. I am at file 3. This is correct!

Now the important part, I am going to attempt to append to the tape.

btape: btape.c:1905 Wrote one record of 64412 bytes.
btape: btape.c:1907 Wrote block to device.
btape: btape.c:608 Wrote 1 EOF to "Tape Device" (/dev/nst0)
btape: btape.c:578 Rewound "Tape Device" (/dev/nst0)
Done appending, there should be no I/O errors

Doing Bacula scan of blocks:
1 block of 64448 bytes in file 1
End of File mark.
2 blocks of 64448 bytes in file 2
End of File mark.
3 blocks of 64448 bytes in file 3
End of File mark.
1 block of 64448 bytes in file 4
End of File mark.
Total files=4, blocks=7, bytes = 451,136
End scanning the tape.
We should be in file 4. I am at file 4. This is correct!

The above Bacula scan should have output identical to what follows.
Please double check it ...
=== Sample correct output ===
1 block of 64448 bytes in file 1
End of File mark.
2 blocks of 64448 bytes in file 2
End of File mark.
3 blocks of 64448 bytes in file 3
End of File mark.
1 block of 64448 bytes in file 4
End of File mark.
Total files=4, blocks=7, bytes = 451,136
=== End sample correct output ===

If the above scan output is not identical to the
sample output, you MUST correct the problem
or Bacula will not be able to write multiple Jobs to
the tape.

=== Write, backup, and re-read test ===

I'm going to write three records and an EOF
then backup over the EOF and re-read the last record.
Bacula does this after writing the last block on the
tape to verify that the block was written correctly.

This is not an *essential* feature ...

btape: btape.c:578 Rewound "Tape Device" (/dev/nst0)
btape: btape.c:813 Wrote first record of 64412 bytes.
btape: btape.c:824 Wrote second record of 64412 bytes.
btape: btape.c:835 Wrote third record of 64412 bytes.
btape: btape.c:608 Wrote 1 EOF to "Tape Device" (/dev/nst0)
btape: btape.c:851 Backspaced over EOF OK.
btape: btape.c:856 Backspace record OK.
btape: btape.c:874
Block re-read correct. Test succeeded!
=== End Write, backup, and re-read test ===



=== Forward space files test ===

This test is essential to Bacula.

I'm going to write five files then test forward spacing
btape: btape.c:578 Rewound "Tape Device" (/dev/nst0)
btape: btape.c:1905 Wrote one record of 64412 bytes.
btape: btape.c:1907 Wrote block to device.
btape: btape.c:608 Wrote 1 EOF to "Tape Device" (/dev/nst0)
btape: btape.c:1905 Wrote one record of 64412 bytes.
btape: btape.c:1907 Wrote block to device.
btape: btape.c:1905 Wrote one record of 64412 bytes.
btape: btape.c:1907 Wrote block to device.
btape: btape.c:608 Wrote 1 EOF to "Tape Device" (/dev/nst0)
btape: btape.c:1905 Wrote one record of 64412 bytes.
btape: btape.c:1907 Wrote block to device.
btape: btape.c:1905 Wrote one record of 64412 bytes.
btape: btape.c:1907 Wrote block to device.
btape: btape.c:1905 Wrote one record of 64412 bytes.
btape: btape.c:1907 Wrote block to device.
btape: btape.c:608 Wrote 1 EOF to "Tape Device" (/dev/nst0)
btape: btape.c:1905 Wrote one record of 64412 bytes.
btape: btape.c:1907 Wrote block to device.
btape: btape.c:1905 Wrote one record of 64412 bytes.
btape: btape.c:1907 Wrote block to device.
btape: btape.c:608 Wrote 1 EOF to "Tape Device" (/dev/nst0)
btape: btape.c:1905 Wrote one record of 64412 bytes.
btape: btape.c:1907 Wrote block to device.
btape: btape.c:608 Wrote 1 EOF to "Tape Device" (/dev/nst0)
btape: btape.c:578 Rewound "Tape Device" (/dev/nst0)
btape: btape.c:1632 Now forward spacing 1 file.
We should be in file 1. I am at file 1. This is correct!
btape: btape.c:1644 Now forward spacing 2 files.
We should be in file 3. I am at file 3. This is correct!
btape: btape.c:578 Rewound "Tape Device" (/dev/nst0)
btape: btape.c:1657 Now forward spacing 4 files.
We should be in file 4. I am at file 4. This is correct!

btape: btape.c:1675 Now forward spacing 1 more file.
We should be in file 5. I am at file 5. This is correct!

=== End Forward space files test ===
 

Looks like the test completed successfully. I'm gonna try to do the backup tonight again,

and I'll post the results here.

 

Thanks for your kind help,

 

Niek Linnenbank

Open Source Consultant

 


Industrial-TSI BV
Dukatenburg 82b
3437 AE Nieuwegein
The Netherlands
E-mail: info(at)industrial-tsi.com
Tel: (+31)30-6005010
Fax: (+31)30-6005019

 

 
 

-----Original message-----
From: francisco javier funes nieto <esencia AT gmail DOT com>
Sent: Wed 09-06-2010 12:46
To: Niek Linnenbank <niek.linnenbank AT industrial-tsi DOT com>;
CC: bacula-users AT lists.sourceforge DOT net; Yuri Kok <yuri.kok AT industrial-tsi DOT com>; Roald Hopman <roald.hopman AT industrial-tsi DOT com>;
Subject: Re: [Bacula-users] Bacula fails to backup jobs to Tape

You must use the  "/dev/nst0" Device in your Storage Daemon config
file (Device Section) better than "/dev/st0". Try to run the btape
test and post the results for more accurate help.


Javier.

2010/6/9 Niek Linnenbank <niek.linnenbank AT industrial-tsi DOT com>:
> Hello,
>
>
>
> We are using Bacula for several months now as our primary backup solution,
>
> yet we are still struggling to get the automatic backup to tape working.
>
> I temporarily disabled them and ran the backup jobs manually. I inserted an
> empty
>
> tape and labelled it 'Maandag'. The jobs started and were doing the backup
> when I left the office,
>
> but the next day I got this error:
>
>
>
> 07-Jun 18:15 backup01-dir JobId 267: Start Backup JobId 267,
> Job=tsi-vms01.2010-06-07_18.15.49_04
> 07-Jun 18:15 backup01-dir JobId 267: Using Device "Tape^ADevice"
> 07-Jun 18:15 backup01-sd JobId 267: Wrote label to prelabeled Volume
> "Maandag" on device "Tape Device" (/dev/st0)
> 08-Jun 00:20 tsi-vms01-fd JobId 267: Fatal error: backup.c:892 Network send
> error to SD. ERR=Input/output error
> 08-Jun 00:16 backup01-sd JobId 267: Fatal error: append.c:242 Network error
> reading from FD. ERR=No data available
> 08-Jun 00:16 backup01-sd JobId 267: Job write elapsed time = 06:00:19,
> Transfer rate = 19.54 M Bytes/second
>
>
> The job for backing up our fileserver has obviously failed, but I can't
> figure out why from this error
>
> message I got in the logs. Even worse, other jobs after it also failed
> because of this message:
>
>
>
> 08-Jun 00:16 backup01-sd JobId 269: Volume "Maandag" previously written,
> moving to end of data.
> 08-Jun 00:16 backup01-sd JobId 269: Error: Bacula cannot write on tape
> Volume "Maandag" because:
> The number of files mismatch! Volume=423 Catalog=422
> 08-Jun 00:16 backup01-sd JobId 269: Marking Volume "Maandag" in Error in
> Catalog.
> 08-Jun 00:16 backup01-sd JobId 269: Job tsi-mail01.2010-06-07_18.17.35_06 is
> waiting. Cannot find any appendable volumes.
> Please use the "label" command to create a new Volume for:
>     Storage:      "Tape Device" (/dev/st0)
>     Pool:         DayPool
>     Media type:   IBM
>
>
> What is going on exactly? I didn't find anything strange in the dmesg or
> syslog of the bacula machine (which
>
> runs bacula-dir and bacula-sd) or the fileserver with bacula-fd.
>
>
>
> I hope somebody can help us out. Thanks in advance,
>
>
>
> Niek Linnenbank
>
> Open Source Consultant
>
>
>
> Industrial-TSI BV
> Dukatenburg 82b
> 3437 AE Nieuwegein
> The Netherlands
> E-mail: info(at)industrial-tsi.com
> Tel: (+31)30-6005010
> Fax: (+31)30-6005019
>
>
>
> ------------------------------------------------------------------------------
> ThinkGeek and WIRED's GeekDad team up for the Ultimate
> GeekDad Father's Day Giveaway. ONE MASSIVE PRIZE to the
> lucky parental unit.  See the prize list and enter to win:
> http://p.sf.net/sfu/thinkgeek-promo
> _______________________________________________
> Bacula-users mailing list
> Bacula-users AT lists.sourceforge DOT net
> https://lists.sourceforge.net/lists/listinfo/bacula-users
>
>



--
_____________________________________________

Francisco Javier Funes Nieto [esencia AT gmail DOT com]
CANONIGOS
Servicios Informáticos para PYMES.
Cl. Cruz 2, 1º Oficina 7
Tlf: 958.536759 / 661134556
Fax: 958.521354
GRANADA - 18002

 

------------------------------------------------------------------------------
ThinkGeek and WIRED's GeekDad team up for the Ultimate 
GeekDad Father's Day Giveaway. ONE MASSIVE PRIZE to the 
lucky parental unit.  See the prize list and enter to win: 
http://p.sf.net/sfu/thinkgeek-promo
_______________________________________________
Bacula-users mailing list
Bacula-users AT lists.sourceforge DOT net
https://lists.sourceforge.net/lists/listinfo/bacula-users