Bacula-users
[Top] [All Lists]
<prev [Date] next>
[Advanced]
 <prev [Thread] next>

Re: [Bacula-users] Bacula fails to backup jobs to Tape

2010-06-09 07:06:03
Subject: Re: [Bacula-users] Bacula fails to backup jobs to Tape
From: francisco javier funes nieto <esencia AT gmail DOT com>
To: Niek Linnenbank <niek.linnenbank AT industrial-tsi DOT com>
Date: Wed, 9 Jun 2010 13:03:29 +0200 
This errors:

08-Jun 00:20 tsi-vms01-fd JobId 267: Fatal error: backup.c:892 Network
send error to SD. ERR=Input/output error
08-Jun 00:16 backup01-sd JobId 267: Fatal error: append.c:242 Network
error reading from FD. ERR=No data available


Maybe are your SD and FD listening on the loopback interface?
127.0.0.1 or localhost ?

You must use in the SDAddress and FDAddress the FQDN or the public IP
not the loopback/localhost.

And there is a firewall between the SD and FD ?

The TAPE tests seems to be ok, wich model of LTO/DLT are you using? SAS/SCSI/FC?

Javier.

2010/6/9 Niek Linnenbank <niek.linnenbank AT industrial-tsi DOT com>:
> Hi Francisco,
>
>
>
> Thanks for your quick reply! I've modified the bacula-sd.conf to use
> /dev/nst0 instead of /dev/st0.
>
> Here is the output of the btape test command on /dev/nst0:
>
>
>
> root@backup01:/etc/bacula# btape /dev/nst0
> Tape block granularity is 1024 bytes.
> btape: butil.c:284 Using device: "/dev/nst0" for writing.
> btape: btape.c:476 open device "Tape Device" (/dev/nst0): OK
> *test
>
> === Write, rewind, and re-read test ===
>
> I'm going to write 10000 records and an EOF
> then write 10000 records and an EOF, then rewind,
> and re-read the data to verify that it is correct.
>
> This is an *essential* feature ...
>
> btape: btape.c:1148 Wrote 10000 blocks of 64412 bytes.
> btape: btape.c:608 Wrote 1 EOF to "Tape Device" (/dev/nst0)
> btape: btape.c:1164 Wrote 10000 blocks of 64412 bytes.
> btape: btape.c:608 Wrote 1 EOF to "Tape Device" (/dev/nst0)
> btape: btape.c:1206 Rewind OK.
> 10000 blocks re-read correctly.
> Got EOF on tape.
> 10000 blocks re-read correctly.
> === Test Succeeded. End Write, rewind, and re-read test ===
>
>
>
> btape: btape.c:1274 Block position test
> btape: btape.c:1286 Rewind OK.
> Reposition to file:block 0:4
> Block 5 re-read correctly.
> Reposition to file:block 0:200
> Block 201 re-read correctly.
> Reposition to file:block 0:9999
> Block 10000 re-read correctly.
> Reposition to file:block 1:0
> Block 10001 re-read correctly.
> Reposition to file:block 1:600
> Block 10601 re-read correctly.
> Reposition to file:block 1:9999
> Block 20000 re-read correctly.
> === Test Succeeded. End Write, rewind, and re-read test ===
>
>
>
> === Append files test ===
>
> This test is essential to Bacula.
>
> I'm going to write one record  in file 0,
>                    two records in file 1,
>              and three records in file 2
> btape: btape.c:578 Rewound "Tape Device" (/dev/nst0)
> btape: btape.c:1905 Wrote one record of 64412 bytes.
> btape: btape.c:1907 Wrote block to device.
> btape: btape.c:608 Wrote 1 EOF to "Tape Device" (/dev/nst0)
> btape: btape.c:1905 Wrote one record of 64412 bytes.
> btape: btape.c:1907 Wrote block to device.
> btape: btape.c:1905 Wrote one record of 64412 bytes.
> btape: btape.c:1907 Wrote block to device.
> btape: btape.c:608 Wrote 1 EOF to "Tape Device" (/dev/nst0)
> btape: btape.c:1905 Wrote one record of 64412 bytes.
> btape: btape.c:1907 Wrote block to device.
> btape: btape.c:1905 Wrote one record of 64412 bytes.
> btape: btape.c:1907 Wrote block to device.
> btape: btape.c:1905 Wrote one record of 64412 bytes.
> btape: btape.c:1907 Wrote block to device.
> btape: btape.c:608 Wrote 1 EOF to "Tape Device" (/dev/nst0)
> btape: btape.c:476 open device "Tape Device" (/dev/nst0): OK
> btape: btape.c:578 Rewound "Tape Device" (/dev/nst0)
> btape: btape.c:1418 Now moving to end of medium.
> btape: btape.c:629 Moved to end of medium.
> We should be in file 3. I am at file 3. This is correct!
>
> Now the important part, I am going to attempt to append to the tape.
>
> btape: btape.c:1905 Wrote one record of 64412 bytes.
> btape: btape.c:1907 Wrote block to device.
> btape: btape.c:608 Wrote 1 EOF to "Tape Device" (/dev/nst0)
> btape: btape.c:578 Rewound "Tape Device" (/dev/nst0)
> Done appending, there should be no I/O errors
>
> Doing Bacula scan of blocks:
> 1 block of 64448 bytes in file 1
> End of File mark.
> 2 blocks of 64448 bytes in file 2
> End of File mark.
> 3 blocks of 64448 bytes in file 3
> End of File mark.
> 1 block of 64448 bytes in file 4
> End of File mark.
> Total files=4, blocks=7, bytes = 451,136
> End scanning the tape.
> We should be in file 4. I am at file 4. This is correct!
>
> The above Bacula scan should have output identical to what follows.
> Please double check it ...
> === Sample correct output ===
> 1 block of 64448 bytes in file 1
> End of File mark.
> 2 blocks of 64448 bytes in file 2
> End of File mark.
> 3 blocks of 64448 bytes in file 3
> End of File mark.
> 1 block of 64448 bytes in file 4
> End of File mark.
> Total files=4, blocks=7, bytes = 451,136
> === End sample correct output ===
>
> If the above scan output is not identical to the
> sample output, you MUST correct the problem
> or Bacula will not be able to write multiple Jobs to
> the tape.
>
> === Write, backup, and re-read test ===
>
> I'm going to write three records and an EOF
> then backup over the EOF and re-read the last record.
> Bacula does this after writing the last block on the
> tape to verify that the block was written correctly.
>
> This is not an *essential* feature ...
>
> btape: btape.c:578 Rewound "Tape Device" (/dev/nst0)
> btape: btape.c:813 Wrote first record of 64412 bytes.
> btape: btape.c:824 Wrote second record of 64412 bytes.
> btape: btape.c:835 Wrote third record of 64412 bytes.
> btape: btape.c:608 Wrote 1 EOF to "Tape Device" (/dev/nst0)
> btape: btape.c:851 Backspaced over EOF OK.
> btape: btape.c:856 Backspace record OK.
> btape: btape.c:874
> Block re-read correct. Test succeeded!
> === End Write, backup, and re-read test ===
>
>
>
> === Forward space files test ===
>
> This test is essential to Bacula.
>
> I'm going to write five files then test forward spacing
> btape: btape.c:578 Rewound "Tape Device" (/dev/nst0)
> btape: btape.c:1905 Wrote one record of 64412 bytes.
> btape: btape.c:1907 Wrote block to device.
> btape: btape.c:608 Wrote 1 EOF to "Tape Device" (/dev/nst0)
> btape: btape.c:1905 Wrote one record of 64412 bytes.
> btape: btape.c:1907 Wrote block to device.
> btape: btape.c:1905 Wrote one record of 64412 bytes.
> btape: btape.c:1907 Wrote block to device.
> btape: btape.c:608 Wrote 1 EOF to "Tape Device" (/dev/nst0)
> btape: btape.c:1905 Wrote one record of 64412 bytes.
> btape: btape.c:1907 Wrote block to device.
> btape: btape.c:1905 Wrote one record of 64412 bytes.
> btape: btape.c:1907 Wrote block to device.
> btape: btape.c:1905 Wrote one record of 64412 bytes.
> btape: btape.c:1907 Wrote block to device.
> btape: btape.c:608 Wrote 1 EOF to "Tape Device" (/dev/nst0)
> btape: btape.c:1905 Wrote one record of 64412 bytes.
> btape: btape.c:1907 Wrote block to device.
> btape: btape.c:1905 Wrote one record of 64412 bytes.
> btape: btape.c:1907 Wrote block to device.
> btape: btape.c:608 Wrote 1 EOF to "Tape Device" (/dev/nst0)
> btape: btape.c:1905 Wrote one record of 64412 bytes.
> btape: btape.c:1907 Wrote block to device.
> btape: btape.c:608 Wrote 1 EOF to "Tape Device" (/dev/nst0)
> btape: btape.c:578 Rewound "Tape Device" (/dev/nst0)
> btape: btape.c:1632 Now forward spacing 1 file.
> We should be in file 1. I am at file 1. This is correct!
> btape: btape.c:1644 Now forward spacing 2 files.
> We should be in file 3. I am at file 3. This is correct!
> btape: btape.c:578 Rewound "Tape Device" (/dev/nst0)
> btape: btape.c:1657 Now forward spacing 4 files.
> We should be in file 4. I am at file 4. This is correct!
>
> btape: btape.c:1675 Now forward spacing 1 more file.
> We should be in file 5. I am at file 5. This is correct!
>
> === End Forward space files test ===
>
>
> Looks like the test completed successfully. I'm gonna try to do the backup
> tonight again,
>
> and I'll post the results here.
>
>
>
> Thanks for your kind help,
>
>
>
> Niek Linnenbank
>
> Open Source Consultant
>
>
>
> Industrial-TSI BV
> Dukatenburg 82b
> 3437 AE Nieuwegein
> The Netherlands
> E-mail: info(at)industrial-tsi.com
> Tel: (+31)30-6005010
> Fax: (+31)30-6005019
>
>
>
>
>
>
> -----Original message-----
> From: francisco javier funes nieto <esencia AT gmail DOT com>
> Sent: Wed 09-06-2010 12:46
> To: Niek Linnenbank <niek.linnenbank AT industrial-tsi DOT com>;
> CC: bacula-users AT lists.sourceforge DOT net; Yuri Kok
> <yuri.kok AT industrial-tsi DOT com>; Roald Hopman
> <roald.hopman AT industrial-tsi DOT com>;
> Subject: Re: [Bacula-users] Bacula fails to backup jobs to Tape
>
> You must use the  "/dev/nst0" Device in your Storage Daemon config
> file (Device Section) better than "/dev/st0". Try to run the btape
> test and post the results for more accurate help.
>
>
> Javier.
>
> 2010/6/9 Niek Linnenbank <niek.linnenbank AT industrial-tsi DOT com>:
>> Hello,
>>
>>
>>
>> We are using Bacula for several months now as our primary backup solution,
>>
>> yet we are still struggling to get the automatic backup to tape working.
>>
>> I temporarily disabled them and ran the backup jobs manually. I inserted
>> an
>> empty
>>
>> tape and labelled it 'Maandag'. The jobs started and were doing the backup
>> when I left the office,
>>
>> but the next day I got this error:
>>
>>
>>
>> 07-Jun 18:15 backup01-dir JobId 267: Start Backup JobId 267,
>> Job=tsi-vms01.2010-06-07_18.15.49_04
>> 07-Jun 18:15 backup01-dir JobId 267: Using Device "Tape^ADevice"
>> 07-Jun 18:15 backup01-sd JobId 267: Wrote label to prelabeled Volume
>> "Maandag" on device "Tape Device" (/dev/st0)
>> 08-Jun 00:20 tsi-vms01-fd JobId 267: Fatal error: backup.c:892 Network
>> send
>> error to SD. ERR=Input/output error
>> 08-Jun 00:16 backup01-sd JobId 267: Fatal error: append.c:242 Network
>> error
>> reading from FD. ERR=No data available
>> 08-Jun 00:16 backup01-sd JobId 267: Job write elapsed time = 06:00:19,
>> Transfer rate = 19.54 M Bytes/second
>>
>>
>> The job for backing up our fileserver has obviously failed, but I can't
>> figure out why from this error
>>
>> message I got in the logs. Even worse, other jobs after it also failed
>> because of this message:
>>
>>
>>
>> 08-Jun 00:16 backup01-sd JobId 269: Volume "Maandag" previously written,
>> moving to end of data.
>> 08-Jun 00:16 backup01-sd JobId 269: Error: Bacula cannot write on tape
>> Volume "Maandag" because:
>> The number of files mismatch! Volume=423 Catalog=422
>> 08-Jun 00:16 backup01-sd JobId 269: Marking Volume "Maandag" in Error in
>> Catalog.
>> 08-Jun 00:16 backup01-sd JobId 269: Job tsi-mail01.2010-06-07_18.17.35_06
>> is
>> waiting. Cannot find any appendable volumes.
>> Please use the "label" command to create a new Volume for:
>>     Storage:      "Tape Device" (/dev/st0)
>>     Pool:         DayPool
>>     Media type:   IBM
>>
>>
>> What is going on exactly? I didn't find anything strange in the dmesg or
>> syslog of the bacula machine (which
>>
>> runs bacula-dir and bacula-sd) or the fileserver with bacula-fd.
>>
>>
>>
>> I hope somebody can help us out. Thanks in advance,
>>
>>
>>
>> Niek Linnenbank
>>
>> Open Source Consultant
>>
>>
>>
>> Industrial-TSI BV
>> Dukatenburg 82b
>> 3437 AE Nieuwegein
>> The Netherlands
>> E-mail: info(at)industrial-tsi.com
>> Tel: (+31)30-6005010
>> Fax: (+31)30-6005019
>>
>>
>>
>>
>> ------------------------------------------------------------------------------
>> ThinkGeek and WIRED's GeekDad team up for the Ultimate
>> GeekDad Father's Day Giveaway. ONE MASSIVE PRIZE to the
>> lucky parental unit.  See the prize list and enter to win:
>> http://p.sf.net/sfu/thinkgeek-promo
>> _______________________________________________
>> Bacula-users mailing list
>> Bacula-users AT lists.sourceforge DOT net
>> https://lists.sourceforge.net/lists/listinfo/bacula-users
>>
>>
>
>
>
> --
> _____________________________________________
>
> Francisco Javier Funes Nieto [esencia AT gmail DOT com]
> CANONIGOS
> Servicios Informáticos para PYMES.
> Cl. Cruz 2, 1º Oficina 7
> Tlf: 958.536759 / 661134556
> Fax: 958.521354
> GRANADA - 18002
>
>



-- 
_____________________________________________

Francisco Javier Funes Nieto [esencia AT gmail DOT com]
CANONIGOS
Servicios Informáticos para PYMES.
Cl. Cruz 2, 1º Oficina 7
Tlf: 958.536759 / 661134556
Fax: 958.521354
GRANADA - 18002

------------------------------------------------------------------------------
ThinkGeek and WIRED's GeekDad team up for the Ultimate 
GeekDad Father's Day Giveaway. ONE MASSIVE PRIZE to the 
lucky parental unit.  See the prize list and enter to win: 
http://p.sf.net/sfu/thinkgeek-promo
_______________________________________________
Bacula-users mailing list
Bacula-users AT lists.sourceforge DOT net
https://lists.sourceforge.net/lists/listinfo/bacula-users
[More with this subject...]
<Prev in Thread] Current Thread [Next in Thread>
Previous by Date:  Re: [Bacula-users] Bacula fails to backup jobs to Tape, Niek Linnenbank
Next by Date:  Re: [Bacula-users] Bacula fails to backup jobs to Tape, Martin Simmons
Previous by Thread:  Re: [Bacula-users] Bacula fails to backup jobs to Tape, Niek Linnenbank
Next by Thread:  Re: [Bacula-users] Bacula fails to backup jobs to Tape, Martin Simmons
Indexes:  [Date] [Thread] [Top] [All Lists]