Bacula-users

Re: [Bacula-users] Change in behaviour with 7.4 when truncating volumes

2016-03-01 17:21:55
Subject: Re: [Bacula-users] Change in behaviour with 7.4 when truncating volumes
From: Kern Sibbald <kern AT sibbald DOT com>
To: "Brady, Mike" <mike.brady AT devnull.net DOT nz>, bacula-users AT lists.sourceforge DOT net
Date: Wed, 2 Mar 2016 08:18:47 +1000
I am not sure what the problem is. If you ask Bacula to truncate a 
volume and all the prerequisites are satisfied, it is going to truncate 
it whether or not it was already truncated.

On 03/02/2016 03:38 AM, Brady, Mike wrote:
> Hi Kern,
>
> Sorry I have been a bit slow responding.  Day job has been getting the
> way.
>
> The simplest way for me to reproduce this is to just run by admin job
> with the prune and truncate commands in it twice in a row from bconsole.
>
> Running the job the first time I get
> 02-Mar 06:11 bacula04-dir JobId 0: Automatically selected Catalog:
> MyCatalog
> 02-Mar 06:11 bacula04-dir JobId 0: Using Catalog "MyCatalog"
> 02-Mar 06:11 bacula04-dir JobId 0: Connecting to Storage daemon
> FileStorage01 at 192.168.42.55:9103 ...
> 02-Mar 06:11 bacula04-dir JobId 0: 3000 OK label. VolBytes=215
> VolABytes=0 VolType=1 Volume="DiffPool-0046" Device="FileDevice01"
> (/bacula_storage/FileDevice)
> 02-Mar 06:11 bacula04-dir JobId 0: The volume "DiffPool-0046" has been
> truncated
> 02-Mar 06:11 bacula04-dir JobId 0: 3000 OK label. VolBytes=214
> VolABytes=0 VolType=1 Volume="IncPool-0051" Device="FileDevice01"
> (/bacula_storage/FileDevice)
> 02-Mar 06:11 bacula04-dir JobId 0: The volume "IncPool-0051" has been
> truncated
>
> and the volumes
>
> [root@bacula04 FileDevice]# date
> Wed Mar  2 06:21:11 NZDT 2016
> [root@bacula04 FileDevice]# ls -lrt
> total 7586540
> -rw-r-----. 1 bacula tape    7578482 Jan 29 06:18 FullPool-0001
> -rw-r-----. 1 bacula tape  293394412 Jan 30 07:17 FullPool-0043
> -rw-r-----. 1 bacula tape 1172880708 Feb  4 08:31 FullPool-0056
> -rw-r-----. 1 bacula tape 1471826078 Feb  7 00:14 FullPool-0064
> -rw-r-----. 1 bacula tape  327231298 Feb 14 00:13 DiffPool-0077
> -rw-r-----. 1 bacula tape  322588494 Feb 18 00:13 IncPool-0053
> -rw-r-----. 1 bacula tape  319982796 Feb 19 00:13 IncPool-0055
> -rw-r-----. 1 bacula tape  321408918 Feb 20 00:13 IncPool-0059
> -rw-r-----. 1 bacula tape  331552046 Feb 21 00:13 DiffPool-0079
> -rw-r-----. 1 bacula tape  320865931 Feb 22 00:13 IncPool-0062
> -rw-r-----. 1 bacula tape  320845891 Feb 23 00:13 IncPool-0066
> -rw-r-----. 1 bacula tape  328525230 Feb 24 00:14 IncPool-0068
> -rw-r-----. 1 bacula tape  329473617 Feb 25 00:13 IncPool-0070
> -rw-r-----. 1 bacula tape  321353644 Feb 26 00:13 IncPool-0072
> -rw-r-----. 1 bacula tape  321667319 Feb 27 00:13 IncPool-0074
> -rw-r-----. 1 bacula tape  318488774 Feb 29 00:13 IncPool-0076
> -rw-r-----. 1 bacula tape  327395050 Mar  1 00:13 IncPool-0044
> -rw-r-----. 1 bacula tape  317324869 Mar  2 00:13 IncPool-0049
> -rw-r-----. 1 bacula tape  294184604 Mar  2 02:10 CatalogBackup0002
> -rw-r-----. 1 bacula tape        215 Mar  2 06:11 DiffPool-0046
> -rw-r-----. 1 bacula tape        214 Mar  2 06:11 IncPool-0051
>
> Running the job again 10 minutes later
> 02-Mar 06:21 bacula04-dir JobId 0: Automatically selected Catalog:
> MyCatalog
> 02-Mar 06:21 bacula04-dir JobId 0: Using Catalog "MyCatalog"
> 02-Mar 06:21 bacula04-dir JobId 0: Connecting to Storage daemon
> FileStorage01 at 192.168.42.55:9103 ...
> 02-Mar 06:21 bacula04-dir JobId 0: 3000 OK label. VolBytes=215
> VolABytes=0 VolType=1 Volume="DiffPool-0046" Device="FileDevice01"
> (/bacula_storage/FileDevice)
> 02-Mar 06:21 bacula04-dir JobId 0: The volume "DiffPool-0046" has been
> truncated
> 02-Mar 06:21 bacula04-dir JobId 0: 3000 OK label. VolBytes=214
> VolABytes=0 VolType=1 Volume="IncPool-0051" Device="FileDevice01"
> (/bacula_storage/FileDevice)
> 02-Mar 06:21 bacula04-dir JobId 0: The volume "IncPool-0051" has been
> truncated
>
> and the volumes
>
> [root@bacula04 FileDevice]# date
> Wed Mar  2 06:23:22 NZDT 2016
> [root@bacula04 FileDevice]# ls -lrt
> total 7586540
> -rw-r-----. 1 bacula tape    7578482 Jan 29 06:18 FullPool-0001
> -rw-r-----. 1 bacula tape  293394412 Jan 30 07:17 FullPool-0043
> -rw-r-----. 1 bacula tape 1172880708 Feb  4 08:31 FullPool-0056
> -rw-r-----. 1 bacula tape 1471826078 Feb  7 00:14 FullPool-0064
> -rw-r-----. 1 bacula tape  327231298 Feb 14 00:13 DiffPool-0077
> -rw-r-----. 1 bacula tape  322588494 Feb 18 00:13 IncPool-0053
> -rw-r-----. 1 bacula tape  319982796 Feb 19 00:13 IncPool-0055
> -rw-r-----. 1 bacula tape  321408918 Feb 20 00:13 IncPool-0059
> -rw-r-----. 1 bacula tape  331552046 Feb 21 00:13 DiffPool-0079
> -rw-r-----. 1 bacula tape  320865931 Feb 22 00:13 IncPool-0062
> -rw-r-----. 1 bacula tape  320845891 Feb 23 00:13 IncPool-0066
> -rw-r-----. 1 bacula tape  328525230 Feb 24 00:14 IncPool-0068
> -rw-r-----. 1 bacula tape  329473617 Feb 25 00:13 IncPool-0070
> -rw-r-----. 1 bacula tape  321353644 Feb 26 00:13 IncPool-0072
> -rw-r-----. 1 bacula tape  321667319 Feb 27 00:13 IncPool-0074
> -rw-r-----. 1 bacula tape  318488774 Feb 29 00:13 IncPool-0076
> -rw-r-----. 1 bacula tape  327395050 Mar  1 00:13 IncPool-0044
> -rw-r-----. 1 bacula tape  317324869 Mar  2 00:13 IncPool-0049
> -rw-r-----. 1 bacula tape  294184604 Mar  2 02:10 CatalogBackup0002
> -rw-r-----. 1 bacula tape        215 Mar  2 06:21 DiffPool-0046
> -rw-r-----. 1 bacula tape        214 Mar  2 06:21 IncPool-0051
>
> So in this case, DiffPool-0046 and IncPool-0051 are "truncated" twice.
>
> I noticed this on a system that has quit a few more volumes than it
> really needs (I will get around to deleting them one day) and the same
> volumes are re-truncated every time (once a day) the truncate job is
> run.
>
> Let me know if there is any other information that you need.
>
> Thanks
>
> Mike
>
> On 2016-02-29 21:03, Kern Sibbald wrote:
>> Hello,
>>
>> What you describe would not be normal behavior, but to the best of my
>> knowledge the truncate code has not recently changed, so if it is
>> happening for you, please "show" us with before and after output.
>>
>> Best regards,
>> Kern
>>
>> On 02/29/2016 07:28 AM, Brady, Mike wrote:
>>> I am seeing a change in behaviour with Bacula 7.4 to what I had seen
>>> on
>>> previous releases when truncating volumes.
>>>
>>> I have a job that contains the following:
>>>
>>>      RunScript {
>>>          RunsWhen=Before
>>>          RunsOnClient=No
>>>          Console = "prune expired volume yes"
>>>          Console = "truncate allpools storage=S-FilesForTape"
>>>          Console = "truncate allpools storage=File"
>>>      }
>>>
>>> The prune and truncate is doing what it has always done, except that
>>> every volume for a particular storage that is marked as purged is
>>> written to every time the truncate command is run.  For previous
>>> releases (7.0.x and earlier - I haven't run 7.2) the behaviour was
>>> that
>>> only purged volumes that had not been truncated were written to (i.e.
>>> the truncate was done).
>>>
>>> Possibly related, I see that volumes that are marked as purged have a
>>> non zero job count.
>>>
>>> Are these expected behaviours?
>>>
>>> Regards
>>>
>>> Mike
>>>
>>> ------------------------------------------------------------------------------
>>> Site24x7 APM Insight: Get Deep Visibility into Application Performance
>>> APM + Mobile APM + RUM: Monitor 3 App instances at just $35/Month
>>> Monitor end-to-end web transactions and take corrective actions now
>>> Troubleshoot faster and improve end-user experience. Signup Now!
>>> http://pubads.g.doubleclick.net/gampad/clk?id=272487151&iu=/4140
>>> _______________________________________________
>>> Bacula-users mailing list
>>> Bacula-users AT lists.sourceforge DOT net
>>> https://lists.sourceforge.net/lists/listinfo/bacula-users
>>>
>
> ------------------------------------------------------------------------------
> Site24x7 APM Insight: Get Deep Visibility into Application Performance
> APM + Mobile APM + RUM: Monitor 3 App instances at just $35/Month
> Monitor end-to-end web transactions and take corrective actions now
> Troubleshoot faster and improve end-user experience. Signup Now!
> http://pubads.g.doubleclick.net/gampad/clk?id=272487151&iu=/4140
> _______________________________________________
> Bacula-users mailing list
> Bacula-users AT lists.sourceforge DOT net
> https://lists.sourceforge.net/lists/listinfo/bacula-users
>

------------------------------------------------------------------------------
Site24x7 APM Insight: Get Deep Visibility into Application Performance
APM + Mobile APM + RUM: Monitor 3 App instances at just $35/Month
Monitor end-to-end web transactions and take corrective actions now
Troubleshoot faster and improve end-user experience. Signup Now!
http://pubads.g.doubleclick.net/gampad/clk?id=272487151&iu=/4140
_______________________________________________
Bacula-users mailing list
Bacula-users AT lists.sourceforge DOT net
https://lists.sourceforge.net/lists/listinfo/bacula-users

<Prev in Thread] Current Thread [Next in Thread>