Bacula-users

Re: [Bacula-users] Tuning Bacula

2010-10-04 13:47:17
Subject: Re: [Bacula-users] Tuning Bacula
From: "Jeremiah D. Jester" <jjest AT u.washington DOT edu>
To: Tim Gustafson <tjg AT soe.ucsc DOT edu>, "bacula-users AT lists.sourceforge DOT net" <bacula-users AT lists.sourceforge DOT net>
Date: Mon, 4 Oct 2010 10:43:06 -0700
Tim,

Have you tried backing up other hosts on your network? What are the speeds with 
these hosts? I've noticed that different host respond with varying speeds 
despite being on the same network. Wondering if this has to do the client OS 
doing some throttling based on work load.

JJ

-----Original Message-----
From: Tim Gustafson [mailto:tjg AT soe.ucsc DOT edu] 
Sent: Monday, October 04, 2010 10:38 AM
To: bacula-users AT lists.sourceforge DOT net
Subject: [Bacula-users] Tuning Bacula

We have recently installed Bacula onto a FreeBSD server and several Linux, 
SunOS and FreeBSD clients.  The Bacula director and storage daemon run on a box 
with about 6 terabytes of RAID6 storage (SATA 300 drives, 1TB each, Adaptec 
RAID controller with 512MB cache).  The box has 16GB of RAM and is not really 
doing much else right now. We're using mySQL for our database back-end, and we 
have MD5 hashing of files turned off ("Accurate = mcs" and "Verify = mcs" are 
set in bacula-dir.conf).

However, we're getting pretty pitiful throughput numbers.  When I scp a file 
from my workstation to the Bacula server, I get something like 40MB/s 
(320Mb/s).  When Bacula runs, we're lucky to get 20MB/s (160Mb/s), and we often 
get numbers closer to 10MB/s (80Mb/s).

I Googled "tuning bacula" and came up with primarily stuff related to tuning 
Postgres as it relates to Bacula, but nothing about tuning the file daemon or 
the storage daemon.  Can anyone point me to some leads as far as what I can do 
to bump up the throughput?  We have a data set that is several terabytes large 
to back up, and it will never complete in a reasonable amount of time at 
10MB/s.  I need to achieve something closer to 40MB/s to make this a workable 
option.

Tim Gustafson
Baskin School of Engineering
UC Santa Cruz
tjg AT soe.ucsc DOT edu
831-459-5354


------------------------------------------------------------------------------
Virtualization is moving to the mainstream and overtaking non-virtualized
environment for deploying applications. Does it make network security 
easier or more difficult to achieve? Read this whitepaper to separate the 
two and get a better understanding.
http://p.sf.net/sfu/hp-phase2-d2d
_______________________________________________
Bacula-users mailing list
Bacula-users AT lists.sourceforge DOT net
https://lists.sourceforge.net/lists/listinfo/bacula-users

------------------------------------------------------------------------------
Virtualization is moving to the mainstream and overtaking non-virtualized
environment for deploying applications. Does it make network security 
easier or more difficult to achieve? Read this whitepaper to separate the 
two and get a better understanding.
http://p.sf.net/sfu/hp-phase2-d2d
_______________________________________________
Bacula-users mailing list
Bacula-users AT lists.sourceforge DOT net
https://lists.sourceforge.net/lists/listinfo/bacula-users