Bacula-users

Re: [Bacula-users] Cryptic SD status: zero despooling speed

2014-09-14 02:31:59
Subject: Re: [Bacula-users] Cryptic SD status: zero despooling speed
From: Kern Sibbald <kern AT sibbald DOT com>
To: Ivan Adzhubey <iadzhubey AT rics.bwh.harvard DOT edu>, bacula-users AT lists.sourceforge DOT net
Date: Sun, 14 Sep 2014 08:26:23 +0200
Hello,

The rates that are shown in the status report are meant to be the
incoming data rates, and as you say do not take into account
spooling/despooling.  I will be very surprised if there is any decrease
in throughput from version 2.4.x to 7.0.x.  Concerning reporting
despooling rates: as far as I can see from your output, version 7.0.x is
indeed reporting the despooling rate, which is larger than for 2.4.x. 

The despooling rate is only reported in the job log when the spool is
committed typically at the end of the job, but if it despools multiple
times, it can be reported multiple times. 

If I remember right the status command will give you despooling rates if
the command is done during despooling, but that rate is shown with the
drive information not the job information.

Also it appears that the precise wording of the output has changed to
make it more specific (accurate).  If you were previously running 5.2.x
I would check to see if there is any real change in the code, which I
doubt because that part of the SD hasn't changed at least from 5.2.x --
however, 2.4.x is too old any comparison of the code would probably not
be useful.

Bottom line: I don't see a problem other than the labels for the
statistics are slightly different.

Best regards,
Kern



On 09/14/2014 05:06 AM, Ivan Adzhubey wrote:
> On Saturday, September 13, 2014 06:37:31 PM Ivan Adzhubey wrote:
>> The "Running Jobs" Files, Bytes, AveBytes/sec, and LastBytes/sec track 
>> spooling process only. These counters stop as soon as the spooling to disk
>> is  completed. They do *not* track despooling at all. Despooling to tape is
>> only tracked under corresponding Device sections.
> I've also discovered the following inconsistency in backup job logs between 
> v2.4.4 (which I had previously installed) and v 7.0.5 I am running now:
>
> v2.4.4:
>
> 10-Sep 08:39 rosalind-dir JobId 52600: Start Backup JobId 52600, 
> Job=BackupCatalog.2014-09-10_08.30.00.48
> 10-Sep 08:39 rosalind-dir JobId 52600: Using Device "Drive-1"
> 10-Sep 08:39 rosalind-sd JobId 52600: Spooling data ...
> 10-Sep 08:42 rosalind-sd JobId 52600: Job write elapsed time = 00:02:38, 
> Transfer rate = 11.14 M bytes/second
>
> ## Note: The line above reports spooling stage transfer rate
>
> 10-Sep 08:42 rosalind-sd JobId 52600: Committing spooled data to Volume 
> "LF0033". Despooling 1,762,247,516 bytes ...
> 10-Sep 08:43 rosalind-sd JobId 52600: Despooling elapsed time = 00:01:08, 
> Transfer rate = 25.91 M bytes/second
>
> ## Note: Here the transfer rate during despooling to tape is reported
>
> 10-Sep 08:43 rosalind-sd JobId 52600: Sending spooled attrs to the Director. 
> Despooling 289 bytes ...
> 10-Sep 08:43 rosalind-dir JobId 52600: Bacula rosalind-dir 2.4.4 (28Dec08): 
> 10-Sep-2014 08:43:34
>
> V7.0.5 (logs for the same job):
>
> 13-Sep 22:47 rosalind-dir JobId 52636: Start Backup JobId 52636, 
> Job=BackupCatalog.2014-09-13_22.36.44_48
> 13-Sep 22:47 rosalind-dir JobId 52636: Using Device "Drive-1" to write.
> 13-Sep 22:47 rosalind-sd JobId 52636: Spooling data ...
>
> ## Note: No transfer rate is now reported for the spooling stage at all
>
> 13-Sep 22:51 rosalind-sd JobId 52636: Committing spooled data to Volume 
> "LF0033". Despooling 2,102,934,459 bytes ...
> 13-Sep 22:52 rosalind-sd JobId 52636: Despooling elapsed time = 00:01:27, 
> Transfer rate = 24.17 M Bytes/second
> 13-Sep 22:52 rosalind-sd JobId 52636: Elapsed time=00:05:02, Transfer 
> rate=6.956 M Bytes/second
>
> ## Note: Transfer rate during despooling to tape is still reported
>
> 13-Sep 22:52 rosalind-sd JobId 52636: Sending spooled attrs to the Director. 
> Despooling 291 bytes ...
> 13-Sep 22:52 rosalind-dir JobId 52636: Bacula rosalind-dir 7.0.5 (28Jul14)
>
> Why this has been changed?
>
> --Ivan
>
>
> ------------------------------------------------------------------------------
> Want excitement?
> Manually upgrade your production database.
> When you want reliability, choose Perforce
> Perforce version control. Predictably reliable.
> http://pubads.g.doubleclick.net/gampad/clk?id=157508191&iu=/4140/ostg.clktrk
> _______________________________________________
> Bacula-users mailing list
> Bacula-users AT lists.sourceforge DOT net
> https://lists.sourceforge.net/lists/listinfo/bacula-users
>


------------------------------------------------------------------------------
Want excitement?
Manually upgrade your production database.
When you want reliability, choose Perforce
Perforce version control. Predictably reliable.
http://pubads.g.doubleclick.net/gampad/clk?id=157508191&iu=/4140/ostg.clktrk
_______________________________________________
Bacula-users mailing list
Bacula-users AT lists.sourceforge DOT net
https://lists.sourceforge.net/lists/listinfo/bacula-users