Bacula-users

Re: [Bacula-users] Spooling and transfer rates

2012-06-12 16:29:00
Subject: Re: [Bacula-users] Spooling and transfer rates
From: John Drescher <drescherjm AT gmail DOT com>
To: "Clark, Patricia A." <clarkpa AT ornl DOT gov>, bacula-users <Bacula-users AT lists.sourceforge DOT net>
Date: Tue, 12 Jun 2012 16:26:47 -0400
On Tue, Jun 12, 2012 at 4:08 PM, Clark, Patricia A. <clarkpa AT ornl DOT gov> 
wrote:
> I have data spooling turned on as the default.  I have blocking on my tapes 
> set to 2MB.  The file systems that I am backing up are mounted to the backup 
> server.
>
> Am I correct in interpreting the despooling lines that the transfer rate is 
> the speed that the backup is writing to tape?

Yes. This is the speed of writing the spool file to the tape drive.

>How do I interpret the transfer rate on the Job write elapsed time and further 
>down the standalone line of Rate: 29932.1 KB/s?

That is the speed for the total job. Remember that during despooling
the job that is despooling is paused on the client. One way to
minimize that is to divide your job up into multiple jobs and filesets
and run these concurrently. Each individual job will pause during the
despool but other jobs will continue to run.

>I am trying to get the maximum performance from my backups and this fileset is 
>an indicator of how the rest of my major backups will perform (Question on 
>fileset config in another post).  I am concerned that as a 1 TB file system, 
>my multi-TB file systems will take days.  Should I spool for the Full backups?
>

I spool for everything.

>>>>>>>>
> 12-Jun 02:23 back1-sd JobId 195: Despooling elapsed time = 01:43:40, Transfer 
> rate = 80.38 M Bytes/second
> 12-Jun 02:23 back1-sd JobId 195: Spooling data again ...
> 12-Jun 05:17 back1-sd JobId 195: User specified spool size reached.
> 12-Jun 05:17 back1-sd JobId 195: Writing spooled data to Volume. Despooling 
> 500,001,646,248 bytes ...
> 12-Jun 07:14 back1-sd JobId 195: Despooling elapsed time = 01:54:36, Transfer 
> rate = 72.71 M Bytes/second
> 12-Jun 07:14 back1-sd JobId 195: Spooling data again ...
> 12-Jun 07:25 back1-sd JobId 195: Job write elapsed time = 09:18:47, Transfer 
> rate = 30.16 M Bytes/second
> 12-Jun 07:25 back1-sd JobId 195: Committing spooled data to Volume 
> "071571L5". Despooling 11,503,866,756 bytes ...
> 12-Jun 07:28 back1-sd JobId 195: Despooling elapsed time = 00:02:36, Transfer 
> rate = 73.74 M Bytes/second
> 12-Jun 07:28 back1-sd JobId 195: Sending spooled attrs to the Director. 
> Despooling 117,122,059 bytes ...
> 12-Jun 07:28 back1-dir JobId 195: Bacula back1-dir 5.2.6 (21Feb12):
>  Build OS:               x86_64-redhat-linux-gnu redhat Enterprise release
>  JobId:                  195
>  Job:                    homedirs1.2012-06-11_22.05.00_14
>  Backup Level:           Full (upgraded from Incremental)
>  Client:                 "back1-fd" 5.2.6 (21Feb12) 
> x86_64-redhat-linux-gnu,redhat,Enterprise release
>  FileSet:                "homedirs1 Set" 2012-06-11 15:18:49
>  Pool:                   "Admin" (From Job resource)
>  Catalog:                "MyCatalog" (From Client resource)
>  Storage:                "Changer" (From Pool resource)
>  Scheduled time:         11-Jun-2012 22:05:00
>  Start time:             11-Jun-2012 22:05:41
>  End time:               12-Jun-2012 07:28:45
>  Elapsed time:           9 hours 23 mins 4 secs
>  Priority:               10
>  FD Files Written:       348,669
>  SD Files Written:       348,669
>  FD Bytes Written:       1,011,225,151,816 (1.011 TB)
>  SD Bytes Written:       1,011,283,529,561 (1.011 TB)
>  Rate:                   29932.1 KB/s
>  Software Compression:   None
>  VSS:                    no
>  Encryption:             no
>  Accurate:               no
>  Volume name(s):         071571L5
>  Volume Session Id:      51
>  Volume Session Time:    1338556034
>  Last Volume Bytes:      1,178,167,320,576 (1.178 TB)
>  Non-fatal FD errors:    0
>  SD Errors:              0
>  FD termination status:  OK
>  SD termination status:  OK
>  Termination:            Backup OK
> <snip>
>>>>>>>>
>
> Patti Clark
> Information International Associates, Inc.
> Linux Administrator and subcontractor to:
> Research and Development Systems Support Oak Ridge National Laboratory
>
>
> ------------------------------------------------------------------------------
> Live Security Virtual Conference
> Exclusive live event will cover all the ways today's security and
> threat landscape has changed and how IT managers can respond. Discussions
> will include endpoint security, mobile security and the latest in malware
> threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
> _______________________________________________
> Bacula-users mailing list
> Bacula-users AT lists.sourceforge DOT net
> https://lists.sourceforge.net/lists/listinfo/bacula-users



-- 
John M. Drescher

------------------------------------------------------------------------------
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and 
threat landscape has changed and how IT managers can respond. Discussions 
will include endpoint security, mobile security and the latest in malware 
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
_______________________________________________
Bacula-users mailing list
Bacula-users AT lists.sourceforge DOT net
https://lists.sourceforge.net/lists/listinfo/bacula-users

<Prev in Thread] Current Thread [Next in Thread>