> On Feb 17, 2016, at 1:49 AM, Andrey Tataranovich <tataranovich AT gmail DOT 
> com> wrote:
> 
> On Tue, 16 Feb 2016 15:21:27 -0500
> Dan Langille <dan AT langille DOT org> wrote:
> 
>> I can scp a 5GB Volume from one system to another in about 90 seconds.
>> 
>> Why does that take the SD 8-10 minutes to do the same?
>> 
>> The two systems are on the same 1Gb/s network.  We are copying from
>> HDD local to SSD remote.
>> 
>> I'm running a copy job, from disk on one SD to tape on another SD.
>> Data spooling is enabled.
>> 
>> The full job can be seen here
>> https://gist.github.com/dlangille/210fd8a8c3418f9004f6
>> <https://gist.github.com/dlangille/210fd8a8c3418f9004f6> :
>> 
> 
> I think the main speed limiter is this case is database. Copy job do not
> operate with raw volumes but creates a new job and mark it as a copy.
> 
> Check job output:
> 
> SD Files Written:       1,365,074
> SD Bytes Written:       333,216,925,325 (333.2 GB)
> 
> So copy job need to store information in database about 1,365,074 files.

Yes, it does.  shat only takes a few minutes though.  Look at line 6 in the 
above URL:

16-Feb 00:12 tape01-sd JobId 231188: Sending spooled attrs to the Director. 
Despooling 422,031,119 bytes ...

Then look at line 204:

16-Feb 00:15 bacula-dir JobId 231187: Bacula bacula-dir 7.4.0 (16Jan16):

I think attribute spooling takes only 3-4 minutes.

If you look at the URL, you can see that reading and sending the data takes up 
the rest of the job.

Line 2-3:

15-Feb 13:23 tape01-sd JobId 231188: Spooling data ...
15-Feb 22:59 tape01-sd JobId 231188: Committing spooled data to Volume 
"000003L4". Despooling 333,554,921,501 bytes ...

Spooling takes 9.5 hours.

Line 4:

16-Feb 00:12 tape01-sd JobId 231188: Despooling elapsed time = 01:13:23, 
Transfer rate = 75.75 M Bytes/second

Writing 334GB to tape takes about 13 minutes.

-- 
Dan 
------------------------------------------------------------------------------
Site24x7 APM Insight: Get Deep Visibility into Application Performance
APM + Mobile APM + RUM: Monitor 3 App instances at just $35/Month
Monitor end-to-end web transactions and take corrective actions now
Troubleshoot faster and improve end-user experience. Signup Now!
http://pubads.g.doubleclick.net/gampad/clk?id=272487151&iu=/4140
_______________________________________________
Bacula-users mailing list
Bacula-users AT lists.sourceforge DOT net
https://lists.sourceforge.net/lists/listinfo/bacula-users