Bacula-users

Re: [Bacula-users] Change in behaviour with 7.4 when truncating volumes

2016-03-01 17:53:25
Subject: Re: [Bacula-users] Change in behaviour with 7.4 when truncating volumes
From: "Brady, Mike" <mike.brady AT devnull.net DOT nz>
To: bacula-users AT lists.sourceforge DOT net
Date: Wed, 02 Mar 2016 11:50:46 +1300
Ok thanks. As far as I can tell this isn't causing any issues.  It is 
just different from what I recall for previous releases.

I have a couple of 7.0.5 systems still and will try and capture exactly 
what they are doing in this space.

On 2016-03-02 11:18, Kern Sibbald wrote:
> I am not sure what the problem is. If you ask Bacula to truncate a
> volume and all the prerequisites are satisfied, it is going to
> truncate it whether or not it was already truncated.
> 
> On 03/02/2016 03:38 AM, Brady, Mike wrote:
>> Hi Kern,
>> 
>> Sorry I have been a bit slow responding.  Day job has been getting the
>> way.
>> 
>> The simplest way for me to reproduce this is to just run by admin job
>> with the prune and truncate commands in it twice in a row from 
>> bconsole.
>> 
>> Running the job the first time I get
>> 02-Mar 06:11 bacula04-dir JobId 0: Automatically selected Catalog:
>> MyCatalog
>> 02-Mar 06:11 bacula04-dir JobId 0: Using Catalog "MyCatalog"
>> 02-Mar 06:11 bacula04-dir JobId 0: Connecting to Storage daemon
>> FileStorage01 at 192.168.42.55:9103 ...
>> 02-Mar 06:11 bacula04-dir JobId 0: 3000 OK label. VolBytes=215
>> VolABytes=0 VolType=1 Volume="DiffPool-0046" Device="FileDevice01"
>> (/bacula_storage/FileDevice)
>> 02-Mar 06:11 bacula04-dir JobId 0: The volume "DiffPool-0046" has been
>> truncated
>> 02-Mar 06:11 bacula04-dir JobId 0: 3000 OK label. VolBytes=214
>> VolABytes=0 VolType=1 Volume="IncPool-0051" Device="FileDevice01"
>> (/bacula_storage/FileDevice)
>> 02-Mar 06:11 bacula04-dir JobId 0: The volume "IncPool-0051" has been
>> truncated
>> 
>> and the volumes
>> 
>> [root@bacula04 FileDevice]# date
>> Wed Mar  2 06:21:11 NZDT 2016
>> [root@bacula04 FileDevice]# ls -lrt
>> total 7586540
>> -rw-r-----. 1 bacula tape    7578482 Jan 29 06:18 FullPool-0001
>> -rw-r-----. 1 bacula tape  293394412 Jan 30 07:17 FullPool-0043
>> -rw-r-----. 1 bacula tape 1172880708 Feb  4 08:31 FullPool-0056
>> -rw-r-----. 1 bacula tape 1471826078 Feb  7 00:14 FullPool-0064
>> -rw-r-----. 1 bacula tape  327231298 Feb 14 00:13 DiffPool-0077
>> -rw-r-----. 1 bacula tape  322588494 Feb 18 00:13 IncPool-0053
>> -rw-r-----. 1 bacula tape  319982796 Feb 19 00:13 IncPool-0055
>> -rw-r-----. 1 bacula tape  321408918 Feb 20 00:13 IncPool-0059
>> -rw-r-----. 1 bacula tape  331552046 Feb 21 00:13 DiffPool-0079
>> -rw-r-----. 1 bacula tape  320865931 Feb 22 00:13 IncPool-0062
>> -rw-r-----. 1 bacula tape  320845891 Feb 23 00:13 IncPool-0066
>> -rw-r-----. 1 bacula tape  328525230 Feb 24 00:14 IncPool-0068
>> -rw-r-----. 1 bacula tape  329473617 Feb 25 00:13 IncPool-0070
>> -rw-r-----. 1 bacula tape  321353644 Feb 26 00:13 IncPool-0072
>> -rw-r-----. 1 bacula tape  321667319 Feb 27 00:13 IncPool-0074
>> -rw-r-----. 1 bacula tape  318488774 Feb 29 00:13 IncPool-0076
>> -rw-r-----. 1 bacula tape  327395050 Mar  1 00:13 IncPool-0044
>> -rw-r-----. 1 bacula tape  317324869 Mar  2 00:13 IncPool-0049
>> -rw-r-----. 1 bacula tape  294184604 Mar  2 02:10 CatalogBackup0002
>> -rw-r-----. 1 bacula tape        215 Mar  2 06:11 DiffPool-0046
>> -rw-r-----. 1 bacula tape        214 Mar  2 06:11 IncPool-0051
>> 
>> Running the job again 10 minutes later
>> 02-Mar 06:21 bacula04-dir JobId 0: Automatically selected Catalog:
>> MyCatalog
>> 02-Mar 06:21 bacula04-dir JobId 0: Using Catalog "MyCatalog"
>> 02-Mar 06:21 bacula04-dir JobId 0: Connecting to Storage daemon
>> FileStorage01 at 192.168.42.55:9103 ...
>> 02-Mar 06:21 bacula04-dir JobId 0: 3000 OK label. VolBytes=215
>> VolABytes=0 VolType=1 Volume="DiffPool-0046" Device="FileDevice01"
>> (/bacula_storage/FileDevice)
>> 02-Mar 06:21 bacula04-dir JobId 0: The volume "DiffPool-0046" has been
>> truncated
>> 02-Mar 06:21 bacula04-dir JobId 0: 3000 OK label. VolBytes=214
>> VolABytes=0 VolType=1 Volume="IncPool-0051" Device="FileDevice01"
>> (/bacula_storage/FileDevice)
>> 02-Mar 06:21 bacula04-dir JobId 0: The volume "IncPool-0051" has been
>> truncated
>> 
>> and the volumes
>> 
>> [root@bacula04 FileDevice]# date
>> Wed Mar  2 06:23:22 NZDT 2016
>> [root@bacula04 FileDevice]# ls -lrt
>> total 7586540
>> -rw-r-----. 1 bacula tape    7578482 Jan 29 06:18 FullPool-0001
>> -rw-r-----. 1 bacula tape  293394412 Jan 30 07:17 FullPool-0043
>> -rw-r-----. 1 bacula tape 1172880708 Feb  4 08:31 FullPool-0056
>> -rw-r-----. 1 bacula tape 1471826078 Feb  7 00:14 FullPool-0064
>> -rw-r-----. 1 bacula tape  327231298 Feb 14 00:13 DiffPool-0077
>> -rw-r-----. 1 bacula tape  322588494 Feb 18 00:13 IncPool-0053
>> -rw-r-----. 1 bacula tape  319982796 Feb 19 00:13 IncPool-0055
>> -rw-r-----. 1 bacula tape  321408918 Feb 20 00:13 IncPool-0059
>> -rw-r-----. 1 bacula tape  331552046 Feb 21 00:13 DiffPool-0079
>> -rw-r-----. 1 bacula tape  320865931 Feb 22 00:13 IncPool-0062
>> -rw-r-----. 1 bacula tape  320845891 Feb 23 00:13 IncPool-0066
>> -rw-r-----. 1 bacula tape  328525230 Feb 24 00:14 IncPool-0068
>> -rw-r-----. 1 bacula tape  329473617 Feb 25 00:13 IncPool-0070
>> -rw-r-----. 1 bacula tape  321353644 Feb 26 00:13 IncPool-0072
>> -rw-r-----. 1 bacula tape  321667319 Feb 27 00:13 IncPool-0074
>> -rw-r-----. 1 bacula tape  318488774 Feb 29 00:13 IncPool-0076
>> -rw-r-----. 1 bacula tape  327395050 Mar  1 00:13 IncPool-0044
>> -rw-r-----. 1 bacula tape  317324869 Mar  2 00:13 IncPool-0049
>> -rw-r-----. 1 bacula tape  294184604 Mar  2 02:10 CatalogBackup0002
>> -rw-r-----. 1 bacula tape        215 Mar  2 06:21 DiffPool-0046
>> -rw-r-----. 1 bacula tape        214 Mar  2 06:21 IncPool-0051
>> 
>> So in this case, DiffPool-0046 and IncPool-0051 are "truncated" twice.
>> 
>> I noticed this on a system that has quit a few more volumes than it
>> really needs (I will get around to deleting them one day) and the same
>> volumes are re-truncated every time (once a day) the truncate job is
>> run.
>> 
>> Let me know if there is any other information that you need.
>> 
>> Thanks
>> 
>> Mike
>> 
>> On 2016-02-29 21:03, Kern Sibbald wrote:
>>> Hello,
>>> 
>>> What you describe would not be normal behavior, but to the best of my
>>> knowledge the truncate code has not recently changed, so if it is
>>> happening for you, please "show" us with before and after output.
>>> 
>>> Best regards,
>>> Kern
>>> 
>>> On 02/29/2016 07:28 AM, Brady, Mike wrote:
>>>> I am seeing a change in behaviour with Bacula 7.4 to what I had seen
>>>> on
>>>> previous releases when truncating volumes.
>>>> 
>>>> I have a job that contains the following:
>>>> 
>>>>      RunScript {
>>>>          RunsWhen=Before
>>>>          RunsOnClient=No
>>>>          Console = "prune expired volume yes"
>>>>          Console = "truncate allpools storage=S-FilesForTape"
>>>>          Console = "truncate allpools storage=File"
>>>>      }
>>>> 
>>>> The prune and truncate is doing what it has always done, except that
>>>> every volume for a particular storage that is marked as purged is
>>>> written to every time the truncate command is run.  For previous
>>>> releases (7.0.x and earlier - I haven't run 7.2) the behaviour was
>>>> that
>>>> only purged volumes that had not been truncated were written to 
>>>> (i.e.
>>>> the truncate was done).
>>>> 
>>>> Possibly related, I see that volumes that are marked as purged have 
>>>> a
>>>> non zero job count.
>>>> 
>>>> Are these expected behaviours?
>>>> 
>>>> Regards
>>>> 
>>>> Mike
>>>> 
>>>> ------------------------------------------------------------------------------
>>>> Site24x7 APM Insight: Get Deep Visibility into Application 
>>>> Performance
>>>> APM + Mobile APM + RUM: Monitor 3 App instances at just $35/Month
>>>> Monitor end-to-end web transactions and take corrective actions now
>>>> Troubleshoot faster and improve end-user experience. Signup Now!
>>>> http://pubads.g.doubleclick.net/gampad/clk?id=272487151&iu=/4140
>>>> _______________________________________________
>>>> Bacula-users mailing list
>>>> Bacula-users AT lists.sourceforge DOT net
>>>> https://lists.sourceforge.net/lists/listinfo/bacula-users
>>>> 
>> 
>> ------------------------------------------------------------------------------
>> Site24x7 APM Insight: Get Deep Visibility into Application Performance
>> APM + Mobile APM + RUM: Monitor 3 App instances at just $35/Month
>> Monitor end-to-end web transactions and take corrective actions now
>> Troubleshoot faster and improve end-user experience. Signup Now!
>> http://pubads.g.doubleclick.net/gampad/clk?id=272487151&iu=/4140
>> _______________________________________________
>> Bacula-users mailing list
>> Bacula-users AT lists.sourceforge DOT net
>> https://lists.sourceforge.net/lists/listinfo/bacula-users
>> 

------------------------------------------------------------------------------
Site24x7 APM Insight: Get Deep Visibility into Application Performance
APM + Mobile APM + RUM: Monitor 3 App instances at just $35/Month
Monitor end-to-end web transactions and take corrective actions now
Troubleshoot faster and improve end-user experience. Signup Now!
http://pubads.g.doubleclick.net/gampad/clk?id=272487151&iu=/4140
_______________________________________________
Bacula-users mailing list
Bacula-users AT lists.sourceforge DOT net
https://lists.sourceforge.net/lists/listinfo/bacula-users

<Prev in Thread] Current Thread [Next in Thread>