Bacula-users

Re: [Bacula-users] Compress speed

2010-07-01 16:05:14
Subject: Re: [Bacula-users] Compress speed
From: Steve Polyack <korvus AT comcast DOT net>
To: Derek Harkness <dharknes AT umich DOT edu>
Date: Thu, 01 Jul 2010 15:47:55 -0400
On 07/01/10 15:27, Derek Harkness wrote:
> Sorry I miss spoke in the original post.  I'm backing up a server which has 
> 24x2.6ghz cpus and is barely using any of them.  I bacula server is much 
> smaller, only 4 cpus.  It looks like bacula has a single threaded compress 
> engine which appears to bottle neck the whole process.  For most backup jobs 
> this isn't a problem but for the size of these backups I need speed over 
> backup size on disk.
>
>    

It does indeed use a single threaded implementation of libz.  Iirc, it 
also works using fairly small block sizes (read, compress, read, 
compress, read, compress...).  Someone on bacula-devel may be able to 
expand on this some more.  The performance is still pretty slow even 
with GZIP1.
> Thanks,
> Derek
>
> On Jul 1, 2010, at 11:55 , Gavin McCullagh wrote:
>
>    
>> On Thu, 01 Jul 2010, Derek Harkness wrote:
>>
>>      
>>> I've seen a very significant slow in backup speed by enabling gzip
>>> compress, 32MB/s (without gzip) vs 4MB/s  (with gzip).  The server I'm
>>> backing up has lots of CPU 24x2.6ghz so the compression time shouldn't be
>>> a huge factor.  Is this normal for bacula or is there an optimization I'm
>>> missing.
>>>        
>> As I understand it, the compression is done on the client (ie the file
>> daemon), not the server, so it's the CPU speed of the client you need to
>> consider, not that of the server.  Is the CPU maxed out on the client
>> during the backup?
>>
>> Gavin
>>
>>
>> ------------------------------------------------------------------------------
>> This SF.net email is sponsored by Sprint
>> What will you do first with EVO, the first 4G phone?
>> Visit sprint.com/first -- http://p.sf.net/sfu/sprint-com-first
>> _______________________________________________
>> Bacula-users mailing list
>> Bacula-users AT lists.sourceforge DOT net
>> https://lists.sourceforge.net/lists/listinfo/bacula-users
>>
>>
>>      
>
> ------------------------------------------------------------------------------
> This SF.net email is sponsored by Sprint
> What will you do first with EVO, the first 4G phone?
> Visit sprint.com/first -- http://p.sf.net/sfu/sprint-com-first
> _______________________________________________
> Bacula-users mailing list
> Bacula-users AT lists.sourceforge DOT net
> https://lists.sourceforge.net/lists/listinfo/bacula-users
>
>    



------------------------------------------------------------------------------
This SF.net email is sponsored by Sprint
What will you do first with EVO, the first 4G phone?
Visit sprint.com/first -- http://p.sf.net/sfu/sprint-com-first
_______________________________________________
Bacula-users mailing list
Bacula-users AT lists.sourceforge DOT net
https://lists.sourceforge.net/lists/listinfo/bacula-users

<Prev in Thread] Current Thread [Next in Thread>