Bacula-users

Re: [Bacula-users] Migration takes hours

2011-03-02 11:13:16
Subject: Re: [Bacula-users] Migration takes hours
From: Dermot Beirne <dermot.beirne AT dpd DOT ie>
To: dragonstone1020 AT gmail DOT com
Date: Wed, 2 Mar 2011 09:47:53 +0000
Hello Chris,
Thanks for responding.
The PE 124T is connected externally to a SCSI card in a Dell T610.

I have 6 x 1 TB SAS drives in a Raid 5 array.

I haven't considered the transfer rates between the disks and the
drive, but clearly it could be an issue.

There is nothing else accessing the disks during a migration.

Your suggestions are good, but I'd like some advice on how to test the
above to get the statistics I need to narrow down the problem, and how
to interpret the statistics returned.

If someone has already done such tests on their own setup, and can
share commands and/or output, that would be great.

Pointers to recommended reading would be welcome also.

Thanks,
Dermot.



On 25 February 2011 18:02, Chris Geegan <dragonstone1020 AT gmail DOT com> 
wrote:
> The data transfer rate seems much slower than the tape device supports.
> Approximately 1/6. Have you considered the interface from Server to Tape
> device, data transfer rates of internal storage (SAS vs SATA), and current
> disk I/O?
> Just throwing some ideas out there.
>
> On Fri, Feb 25, 2011 at 10:20 AM, Dermot Beirne <dermot.beirne AT dpd DOT ie>
> wrote:
>>
>> Hi,
>> I am using Bacula 5.0.3 on Ubuntu 9.04
>>
>> The length of time taken to migrate from disk to tape is causing
>> problems with my backup window.
>>
>> The Monthly full backups I run takes up to 3 days.
>>
>> Here is the output of one client:
>>
>>  Build OS:               i686-pc-linux-gnu ubuntu 9.04
>>  Prev Backup JobId:      12473
>>  Prev Backup Job:        Livetest.2011-02-06_22.00.00_56
>>  New Backup JobId:       12487
>>  Current JobId:          12486
>>  Current Job:            Monthly-Disk-Tape-Migrate.2011-02-07_05.00.02_09
>>  Backup Level:           Full
>>  Client:                 interlink-pdc-fd
>>  FileSet:                "interlink-pdc Fileset" 2009-09-17 18:04:55
>>  Read Pool:              "Monthly-Disk-Pool" (From Job resource)
>>  Read Storage:           "MonthlyStorage" (From Pool resource)
>>  Write Pool:             "Monthly-Tape-Pool" (From Job Pool's NextPool
>> resource)
>>  Write Storage:          "Tape" (From Storage from Pool's NextPool
>> resource)
>>  Catalog:                "MyCatalog" (From Client resource)
>>  Start time:             07-Feb-2011 08:24:21
>>  End time:               07-Feb-2011 19:36:13
>>  Elapsed time:           11 hours 11 mins 52 secs
>>  Priority:               20
>>  SD Files Written:       5,654,088
>>  SD Bytes Written:       768,958,410,352 (768.9 GB)
>>  Rate:                   19075.2 KB/s
>>  Volume name(s):         000072L4
>>  Volume Session Id:      258
>>  Volume Session Time:    1295882384
>>  Last Volume Bytes:      769,726,218,240 (769.7 GB)
>>  SD Errors:              0
>>  SD termination status:  OK
>>  Termination:            Migration OK
>>
>>
>>
>> There are around 26 disk volumes to migrate for this job.  Each is 50Gb.
>>
>> My drive is a Dell PowerVault 124T LTO4
>>
>> Can anyone suggest how best to go about troubleshooting this performance.
>>
>> Thank you.
>> Dermot.
>>
>>
>> ------------------------------------------------------------------------------
>> Free Software Download: Index, Search & Analyze Logs and other IT data in
>> Real-Time with Splunk. Collect, index and harness all the fast moving IT
>> data
>> generated by your applications, servers and devices whether physical,
>> virtual
>> or in the cloud. Deliver compliance at lower cost and gain new business
>> insights. http://p.sf.net/sfu/splunk-dev2dev
>> _______________________________________________
>> Bacula-users mailing list
>> Bacula-users AT lists.sourceforge DOT net
>> https://lists.sourceforge.net/lists/listinfo/bacula-users
>
>

------------------------------------------------------------------------------
Free Software Download: Index, Search & Analyze Logs and other IT data in 
Real-Time with Splunk. Collect, index and harness all the fast moving IT data 
generated by your applications, servers and devices whether physical, virtual
or in the cloud. Deliver compliance at lower cost and gain new business 
insights. http://p.sf.net/sfu/splunk-dev2dev 
_______________________________________________
Bacula-users mailing list
Bacula-users AT lists.sourceforge DOT net
https://lists.sourceforge.net/lists/listinfo/bacula-users

<Prev in Thread] Current Thread [Next in Thread>