Bacula-users

Re: [Bacula-users] Performance with latent networks

2011-04-11 04:40:34
Subject: Re: [Bacula-users] Performance with latent networks
From: Gavin McCullagh <gavin.mccullagh AT gcd DOT ie>
To: bacula-users AT lists.sourceforge DOT net
Date: Mon, 11 Apr 2011 09:37:38 +0100
Hi,

On Mon, 11 Apr 2011, Peter Hoskin wrote:

> I'm using bacula to do backups of some remote servers, over the Internet
> encapsulated in OpenVPN (just to make sure things are encrypted and kept off
> public address space).
> 
> The bacula-fd is in Montreal Canada with 100mbit Ethernet. I also have
> another bacula-fd in Canberra Australia on 100mbit Ethernet. The
> bacula-director is in Sydney Australia with ADSL2+ at full line sync. The
> latency to Montreal is about 300ms while the latency to Canberra is about
> 30ms.

The issue, I imagine with transfer rates is between the bacula-fd and
bacula-sd.  Do we presume the -sd is in Sydney?  You don't say what speed
the Sydney ADSL2+ link is (though apparently it can manage at least
2.2MByte/sec).

Is that 300ms over the VPN?  If you run a long ping, is there any
noticeable packet loss?

> The problem I'm encountering. backups from the Montreal box will peak at a
> transfer rate of 100kb/sec despite my ability to do 2.2mb/sec via http, ftp,
> ssh, rsync, etc. from the same host.

Presumably these tests are between the -fd and -sd hosts along the same VPN.

Broadly AIUI, one bulk TCP transfer should be the same as another and the
two should be affected by latency in the same way.  This suggests to me
that there's something else going on.  Maybe the bacula-fd host is busy or
the bacula-fd itself is doing encryption or compression which is slowing
down its send rate?  Are these incremental backups or full?  Are you using
"accurate" backups (which need data to be sent to the fd from the dir)?

Have you checked the disk and cpu load on the bacula fd and sd during these
backups?

> So it appears the problem is network latency. Is there anything I can try to
> improve backup speeds from Montreal?

I may be wrong, but I'm not convinced it's just latency.

Gavin




------------------------------------------------------------------------------
Xperia(TM) PLAY
It's a major breakthrough. An authentic gaming
smartphone on the nation's most reliable network.
And it wants your games.
http://p.sf.net/sfu/verizon-sfdev
_______________________________________________
Bacula-users mailing list
Bacula-users AT lists.sourceforge DOT net
https://lists.sourceforge.net/lists/listinfo/bacula-users

<Prev in Thread] Current Thread [Next in Thread>