Bacula-users

Re: [Bacula-users] Tape full before it should.

2017-01-08 22:36:36
Subject: Re: [Bacula-users] Tape full before it should.
From: Gi Dot <gadidot AT gmail DOT com>
To: Bacula Users <bacula-users AT lists.sourceforge DOT net>, gidot <gadidot AT gmail DOT com>
Date: Mon, 9 Jan 2017 11:35:48 +0800
Additional info on the volume:

*list media=A00053L5
+---------+------------+-----------+---------+-----------------+----------+--------------+---------+------+-----------+-----------+---------------------+
| mediaid | volumename | volstatus | enabled | volbytes        | volfiles | volretention | recycle | slot | inchanger | mediatype | lastwritten         |
+---------+------------+-----------+---------+-----------------+----------+--------------+---------+------+-----------+-----------+---------------------+
|     114 | A00053L5   | Full      |       1 | 150,990,400,512 |    2,107 |       43,200 |       1 |    2 |         1 | LTO5      | 2017-01-08 01:31:55 |
+---------+------------+-----------+---------+-----------------+----------+--------------+---------+------+-----------+-----------+---------------------+

*llist media=A00053L5 mediaid: 114 volumename: A00053L5 slot: 2 poolid: 2 mediatype: LTO5 firstwritten: 2017-01-08 01:00:03 lastwritten: 2017-01-08 01:31:55 labeldate: 2017-01-08 01:00:03 voljobs: 1 volfiles: 2,107 volblocks: 2,340,501 volmounts: 1 volbytes: 150,990,400,512 volerrors: 0 volwrites: 2,340,502 volcapacitybytes: 0 volstatus: Full enabled: 1 recycle: 1 volretention: 43,200 voluseduration: 0 maxvoljobs: 0 maxvolfiles: 0 maxvolbytes: 0 inchanger: 1 endfile: 2,106 endblock: 0 volparts: 0 labeltype: 0 storageid: 1 deviceid: 0 locationid: 0 recyclecount: 0 initialwrite: scratchpoolid: 0 recyclepoolid: 0 comment:


On Mon, Jan 9, 2017 at 11:29 AM, Gi Dot <gadidot AT gmail DOT com> wrote:
Hi all,


At the data centre we are using IBM-LTO tape - 3.0TB compressed, 1.5T uncompressed. Last 2 nights a backup was running and it stopped at about 150GB size and bacula marked the tape as full.

Since the total amount of backed up data sometimes could be huge, I have purged the volume straight away before the tape was inserted. There is a total of 10 jobs, and the first job holds the biggest data, somewhere around 500GB to 2TB at a time. Backup failed at the first job, at 150GB size.

| 3,053 | db01Job          | 2017-01-08 01:00:03 | B    | F     |   43,942 |   150,874,925,633 | f  

Excerpt from the logs:
07-Jan 05:00 phisbackupdns1-dir JobId 3052: shell command: run AfterJob "/usr/lib64/bacula/delete_catalog_backup"
08-Jan 01:00 phisbackupdns1-dir JobId 3053: Start Backup JobId 3053, Job=phisdb01Job.2017-01-08_01.00.00_52
08-Jan 01:00 phisbackupdns1-dir JobId 3053: Using Device "Drive0"
08-Jan 01:00 phisbackupdns1-sd JobId 3053: Volume "A00053L5" previously written, moving to end of data.
08-Jan 01:01 phisbackupdns1-sd JobId 3053: Warning: For Volume "A00053L5":
The number of files mismatch! Volume=1955 Catalog=0
Correcting Catalog
08-Jan 01:31 phisbackupdns1-sd JobId 3053: End of Volume "A00053L5" at 2106:1 on device "Drive0" (/dev/nst1). Write of 64512
bytes got -1.
08-Jan 01:31 phisbackupdns1-sd JobId 3053: Re-read of last block succeeded.
08-Jan 01:31 phisbackupdns1-sd JobId 3053: End of medium on Volume "A00053L5" Bytes=150,990,400,512 Blocks=2,340,501 at 08-Ja
n-2017 01:31.
08-Jan 01:31 phisbackupdns1-sd JobId 3053: 3307 Issuing autochanger "unload slot 2, drive 0" command.
08-Jan 01:33 phisbackupdns1-sd JobId 3053: No slot defined in catalog (slot=0) for Volume "A00032L5" on "Drive0" (/dev/nst1).
08-Jan 01:33 phisbackupdns1-sd JobId 3053: Cartridge change or "update slots" may be required.
08-Jan 01:33 phisbackupdns1-sd JobId 3053: Warning: mount.c:217 Open device "Drive0" (/dev/nst1) Volume "A00032L5" failed: ER
R=dev.c:513 Unable to open device "Drive0" (/dev/nst1): ERR=No medium found


Hardware compression is enabled:
# tapeinfo -f /dev/nst1 Product Type: Tape Drive Vendor ID: 'IBM ' Product ID: 'ULT3580-TD5 ' Revision: 'G360' Attached Changer API: No SerialNumber: '10WT008032' MinBlock: 1 MaxBlock: 8388608 SCSI ID: 1 SCSI LUN: 0 Ready: yes BufferedMode: yes Medium Type: 0x58 Density Code: 0x58 BlockSize: 0 DataCompEnabled: yes DataCompCapable: yes DataDeCompEnabled: yes CompType: 0x1 DeCompType: 0x1 BOP: yes Block Position: 0 Partition 0 Remaining Kbytes: -1 Partition 0 Size in Kbytes: -1 ActivePartition: 0 EarlyWarningSize: 0 NumPartitions: 0 MaxPartitions: 1

Pool configuration for the volume:
Pool { Name = ADHOC Label Format = "ADHOC_Vol" Pool Type = Backup Recycle = yes AutoPrune = yes Storage = ibmts3310 Volume Retention = 12h Recycle Current Volume = Yes }
Side note: I just realized that I missed the "Volume Use Duration = 10h" directive in the pool. Reason being is the same tape would be in the drive for 2 nights (Saturday and Sunday), since there is no operator around to change a tape. The tape supposed to be recycled on Sunday night.


Appreciate if anyone can enlighten me as to why the tape is full way earlier compared to the size that it is able to contain.

Thanks.




------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most 
engaging tech sites, SlashDot.org! http://sdm.link/slashdot
_______________________________________________
Bacula-users mailing list
Bacula-users AT lists.sourceforge DOT net
https://lists.sourceforge.net/lists/listinfo/bacula-users