Bacula-users

Re: [Bacula-users] slow performance copy/migrate disk to tape

2008-11-04 15:40:17
Subject: Re: [Bacula-users] slow performance copy/migrate disk to tape
From: Pasi Kärkkäinen <pasik AT iki DOT fi>
To: Ulrich Leodolter <ulrich.leodolter AT obvsg DOT at>
Date: Tue, 4 Nov 2008 22:38:18 +0200
On Tue, Nov 04, 2008 at 09:02:46PM +0100, Ulrich Leodolter wrote:
> Hi,
> 
> Problem:  Migrate/Copy jobs from disk pool (DiskBackup)
> to tape (DiskCopy) only get overall speed of 10-20MB/s.
> 
> full backup job size varies from 10-50GB.
> 
> Pool setup is simple, just one pool for full an incremental backups
> to disk (automatic recycle works good)
> 
> Pool {
>   Name = DiskBackup
>   Pool Type = Backup
>   Recycle = yes
>   RecyclePool = DiskBackup
>   AutoPrune = yes
>   Volume Retention = 15 days
>   Volume Use Duration = 6 days
>   Maximum Volume Bytes = 4G
>   Label Format = Backup-
>   Next Pool = DiskCopy
> }
> 
> DiskCopy pool goes to LTO4 tape device.
> DiskBackup goes to SATA external raid (6T ext3).
>

Which raid-level your SATA external raid is? 

 
> concurrency for DiskBackup jobs is 15,  jobs are spread
> over DiskBackup Valumes (maybe thats the main problem)
> 
> i can read write/continuous on both devices at about 70MB/s
> (SATA is not fast)
>

So your SATA-raid can do max 70 MB/sec.. 

How much your LTO4 can do? 
 
> i tried spooling to local SAS raid, but overall speed is lower
> than direct writing to tape.
> despooling from SAS raid to Tape runs at Tape maximum spped.
>

So SAS-RAID to Tape is faster than SATA-RAID to Tape? 
 
> 
> 
> I need some Performance tuning tips, maybe:
> 
> Limit jobs per Volume in DiskBackup pools?
> Split DiskBackup into DiskFull and DiskIncr pools?
> 

First determine the bottleneck and then work around it.. 

Btw. could you post your 'copy' job? I'm in the process of trying it out but
I'm still stuck with trying to implement 'copy only uncopied jobs'-feature.. 

-- Pasi

-------------------------------------------------------------------------
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/
_______________________________________________
Bacula-users mailing list
Bacula-users AT lists.sourceforge DOT net
https://lists.sourceforge.net/lists/listinfo/bacula-users