Bacula-users

Re: [Bacula-users] bacula not use all bandwidth of network

2009-03-12 08:59:53
Subject: Re: [Bacula-users] bacula not use all bandwidth of network
From: Victor Hugo dos Santos <listas.vhs AT gmail DOT com>
To: bacula-users AT lists.sourceforge DOT net
Date: Thu, 12 Mar 2009 09:52:26 -0300
On Wed, Mar 11, 2009 at 6:31 PM, Dan Langille <dan AT langille DOT org> wrote:
> Victor Hugo dos Santos wrote:
>>
>> Hello,
>>
>> I have this network topology:
>> - ~ 40 servers/clients
>> - 1 director
>> - 2 storages
>> - all servers connect in Gigabits switches and GB network cards too.  :-)
>> - all baculas (director and sotrages) and all linux servers connect
>> with 2 network card in bonding mode 6
>>
>> well.. my problem is that jobs, don't exceed more that "1500 KB/s" !!! :-(
>> this is a report, with 20 faster jobs of today.
>> ========
>> 9.2 KB/s
>> 10.6 KB/s
>> 16.2 KB/s
>> 53.9 KB/s
>> 72.2 KB/s
>> 98.2 KB/s
>> 311.3 KB/s
>> 380.5 KB/s
>> 521.6 KB/s
>> 720.1 KB/s
>> 805.8 KB/s
>> 1044.6 KB/s
>> 1188.1 KB/s
>> 1325.9 KB/s
>> 1381.5 KB/s
>> 1409.5 KB/s
>> 1419.9 KB/s
>> 1446.9 KB/s
>> 1462.8 KB/s
>> 8597.6 KB/s
>> ============
>>
>> ridiculously, the last job in the list (the fastest).. is my own
>> machine.. a PC connected in 100MB switch !!! :-(
>> testing performance between clients and bacula servers (with rsync,
>> scp, nc) ... the worst result is 40 MB/s
>
> Bacula does much more than what rsync etc do.  Bacula also updates the
> Catalog database, for example.  That is the usual bottleneck.

I have jobs with unless 25 files and 200MB, running alone (no parallel
jobs in director and storage).
this should not a bottleneck to catalog !! :-(

>> ideas ?? commentaries ??
>
> Note: I believe that the bandwidth you are looking at is 'data transfered' /
> 'time for job'.  The time for a job is longer than that taken to transfer
> the data.  Thus, the bandwidth used will ALWAYS be less than the practical
> maxiumu.

I'm looking information in logs of executed jobs:

==============
  Build OS:               i486-pc-linux-gnu debian lenny/sid
  JobId:                  9727
  Job:                    Respaldar_BDCatalogo.2009-03-12_00.10.17
  Backup Level:           Full
  Client:                 "bacula-fd" 2.2.8 (26Jan08)
i486-pc-linux-gnu,debian,lenny/sid
  FileSet:                "MyCatalog" 2007-09-28 17:10:40
  Pool:                   "Default" (From Job resource)
  Storage:                "Storage1" (From Job resource)
  Scheduled time:         12-Mar-2009 00:10:00
  Start time:             12-Mar-2009 00:56:59
  End time:               12-Mar-2009 00:58:04
  Elapsed time:           1 min 5 secs
  Priority:               15
  FD Files Written:       1
  SD Files Written:       1
  FD Bytes Written:       95,091,659 (95.09 MB)
  SD Bytes Written:       95,091,772 (95.09 MB)
  Rate:                   1462.9 KB/s
  Software Compression:   63.4 %
==============

this is a output of full catalog backup from director in one machine
and storage in other machine.
1 file - 1 jobs running - 100 MB - no more access/services in both
servers - and 1462 KBs of bandwidth.
:-(

thanks of any other idea.

-- 
-- 
Victor Hugo dos Santos
Linux Counter #224399

------------------------------------------------------------------------------
Apps built with the Adobe(R) Flex(R) framework and Flex Builder(TM) are
powering Web 2.0 with engaging, cross-platform capabilities. Quickly and
easily build your RIAs with Flex Builder, the Eclipse(TM)based development
software that enables intelligent coding and step-through debugging.
Download the free 60 day trial. http://p.sf.net/sfu/www-adobe-com
_______________________________________________
Bacula-users mailing list
Bacula-users AT lists.sourceforge DOT net
https://lists.sourceforge.net/lists/listinfo/bacula-users