Bacula-users

Re: [Bacula-users] Are my Bacula backups fast enough?

2016-04-22 18:19:08
Subject: Re: [Bacula-users] Are my Bacula backups fast enough?
From: Ana Emília M. Arruda <emiliaarruda AT gmail DOT com>
To: Jason Voorhees <jvoorhees1 AT gmail DOT com>
Date: Sat, 23 Apr 2016 00:17:45 +0200
Hello Jason,

On Fri, Apr 22, 2016 at 4:57 PM, Jason Voorhees <jvoorhees1 AT gmail DOT com> wrote:
Hello guys:

I'd like you to share some thoughs about my scenario and performance.
Here's what I have:

Server (Director & Storage)
====================
System: KVM guest running on Proxmox 4.1 host
Network: virtio
Storage: 5x200 GB Virtual disks (qcow2 format), used as physical volumes
Filesystem: ext4 'by default' on LVM
Memory: 4 GB
CPU: 1 core on guest, 8 cores on host (Intel Core i7 3.4 GHz)
Bacula: 7.4.0 built from source
OS: CentOS 7 x86_64
Roles: Bacula with MySQL (used only for backups, nothing else)


​Which kind of physical disks you have? Could you try a dd command to tell us their writing speed performance?​
 


- iperf tests between my bacula server and one of my clients (which is
also a KVM guest sharing the same physical host with virtio network)
gave me near 9.78 Gbps rate which seems awesome.
- I'm using disk backups without Attribute Spooling enabled, yet.
- GZIP compression and SHA1 signatures are also enabled for all my jobs.
- MySQL hasn't been tuned at all, it came by default.

​Attribute spooling, a lower level of GZIP compression (default is 6 and affects backup performances) and MySQL tunning are a good idea to improve backup performance. ​



Yesterday, I ran a Full backup for a Samba fileserver with 280 GB of
data. Such backup took about 6 hours, having near 15% compression rate
and near 240 GB written by SD and FD daemons. This Samba server have
Bacula Client 2.4.4.

​Bacula 2.4.4 is outdated. The last version is a 7.4.0 with a lot of new improvements. Do you think it would be posible for you to migrate/install/build a more recent version?​
 

Today I'm running a Full backup for a Zimbra server with near 450 GB
of data to be backed up. I'm running iptraf-ng right now and I can see
variable rate transfer through my network interface from 10 Mbps up to
80 Mbps with an average of 50 Mbps.

​These are good networks transfer rates in a gigabit switch infrastructure. Which kind of network environment do you have?​
 

I'd like to hear some thoughts from you because I have some questions:

- Is it normal to have a rate of 50 Mbps rate while running a backup?
- How can I know if MySQL is a bottleneck?
- Should I disable compression and signatures to improve speed of
backups? Is it worth it?
- What if I enable attribute spooling? I've read posts in which some
people noticed an improvement on data transfer but the despooling
process of attributes it took too long.
- Is my backup speed good enough? Should I worry about it? Can they be
even faster?

​It is very recommended to upgrade to a new version (preferably 7.4.0) before trying to solve these problems.​


Thanks in advance for reading and helping :)

Have a nice day

​Best regards,
Ana​

 

------------------------------------------------------------------------------
Find and fix application performance issues faster with Applications Manager
Applications Manager provides deep performance insights into multiple tiers of
your business applications. It resolves application problems quickly and
reduces your MTTR. Get your free trial!
https://ad.doubleclick.net/ddm/clk/302982198;130105516;z
_______________________________________________
Bacula-users mailing list
Bacula-users AT lists.sourceforge DOT net
https://lists.sourceforge.net/lists/listinfo/bacula-users

------------------------------------------------------------------------------
Find and fix application performance issues faster with Applications Manager
Applications Manager provides deep performance insights into multiple tiers of
your business applications. It resolves application problems quickly and
reduces your MTTR. Get your free trial!
https://ad.doubleclick.net/ddm/clk/302982198;130105516;z
_______________________________________________
Bacula-users mailing list
Bacula-users AT lists.sourceforge DOT net
https://lists.sourceforge.net/lists/listinfo/bacula-users
<Prev in Thread] Current Thread [Next in Thread>