Bacula-users

[Bacula-users] Bacula backups are painfully slow

2010-08-12 11:32:48
Subject: [Bacula-users] Bacula backups are painfully slow
From: "Matt Schraeder" <MSchraeder AT btsb DOT com>
To: <bacula-users AT lists.sourceforge DOT net>
Date: Thu, 12 Aug 2010 09:54:50 -0500
I got my first backup jobs running on Bacula, and while they appear to be working, they are extremely slow.  The client is reporting only a 200-600 KB/s rate.
 
Automatically selected Client: mort-fd
 
mort-fd Version: 5.0.2 (28 April 2010)  i686-pc-linux-gnu suse 10
Daemon started 12-Aug-10 09:05, 0 Jobs run since started.
 Heap: heap=557,056 smbytes=176,711 max_bytes=178,834 bufs=142 max_bufs=143
 Sizeof: boffset_t=8 size_t=4 debug=0 trace=0
 
Running Jobs:
JobId 22 Job DailyNetwork.2010-08-12_09.05.58_04 is running.
    Full Backup Job started: 12-Aug-10 09:06
    Files=1,250 Bytes=271,511,671 Bytes/sec=386,768 Errors=0
    Files Examined=1,250
    Processing file: /mnt/Frodo/VOL1/./<Filename removed>
    SDReadSeqNo=5 fd=5
Director connected at: 12-Aug-10 09:17
====
 
The configuration is mostly a default install and backups are being done directly to file, never to tape.  This particular job backs up 3 Novell eDirectory servers mounted by nwmap and symbolic linked to /mnt/<ServerName>.   Backups get written to /mnt/Herbert which is an NFS mount to our QNAP NAS.  Manual file copies work fine over these network connections with Frodo being a 100 mbps connection, and everything else being 1000 mbps.
 
I have already attempted removing MD5 and GZIP from the FileSet, as well as toying with the Maximum Network Buffer Size options on the Storage Daemon's Device Resource as well as in the FileDaemon's FileDaemon resource.  MD5/GZIP had little or no effect on the speed, and attempting to raise the buffer size made it go even slower.  I've also tried turning on attribute spooling, which also had no effect on the speed.  I'm not sure what else to check. 
 
While the backup is running, network traffic is miniscule (floats between 0 and 30 KB/s) and CPU usage is barely even being touched.
 
Here's a top printout:
 
top - 09:46:06 up 1 day, 22:41,  2 users,  load average: 0.13, 0.13, 0.11
Tasks: 206 total,   1 running, 205 sleeping,   0 stopped,   0 zombie
Cpu(s):  0.7%us,  1.0%sy,  0.0%ni, 97.0%id,  0.7%wa,  0.3%hi,  0.3%si,  0.0%st
Mem:   1036432k total,  1021356k used,    15076k free,     6068k buffers
Swap:  1052216k total,     1012k used,  1051204k free,   585752k cached
 
  PID USER      PR  NI  VIRT  RES  SHR S %CPU %MEM    TIME+  COMMAND
 3639 root      16   0  334m  47m  16m S  0.3  4.7   0:06.18 ndsd
 4504 root      15   0 29008  18m 8444 S  0.3  1.9   3:38.55 X
 5507 root      16   0  181m  15m 3552 S  0.3  1.6   8:48.26 novfsd
11772 root      16   0 53320 1904 1136 S  0.3  0.2   0:42.03 bacula-fd
 
And here's a free printout:
 
             total       used       free     shared    buffers     cached
Mem:       1036432     881028     155404          0       7444     405940
-/+ buffers/cache:     467644     568788
Swap:      1052216       1144    1051072
 
And finally relevant configuration files for Bacula:
 
JobDefs {
  Name = "DefaultJob"
  Type = Backup
  Level = Incremental
  Client = mort-fd
  Schedule = "DailyCycle"
  Messages = Standard
  Priority = 10
  Write Bootstrap = "/root/bacula/bin/working/%c.bsr"
  Spool Attributes = yes
}
 
Job {
  Name = "DailyNetwork"
  JobDefs = "DefaultJob"
  Storage = HerbertStorageDailyNetwork
  Pool = DailyNetworkBackupPool
  FileSet = "Network Files"
}
 
FileSet {
  Name = "Network Files"
  Include {
    Options {
      signature = MD5
      compression = GZIP
    }
    File = /mnt/Frodo/VOL1/.
    File = /mnt/Narya/VOL1/.
    File = /mnt/Nenya/VOL1/.
  }
}
 
Storage {
  Name = HerbertStorageDailyNetwork
# Do not use "localhost" here   
  Address = mort                # N.B. Use a fully qualified name here
  SDPort = 9103
  Password = "+0WNXvB6Qz4jOCM5voBbGm4M3FD9JoCZVol4xDit0UW7"
  Device = HerbertBackupDailyNetwork
  Media Type = HerbertDailyNetworkMedia
}
 
Pool {
  Name = DailyNetworkBackupPool
  Pool Type = Backup
  Storage = HerbertStorageDailyNetwork
  Recycle = yes                       # Bacula can automatically recycle Volumes
  AutoPrune = yes                     # Prune expired volumes
  Volume Retention = 14 days          # Two weeks!
  Maximum Volume Jobs = 1       # Each job is it's own volume
  LabelFormat = "DailyNetworkBackup_$Year-$Month-$Day"       # Bacula will create volume names NetworkBackupXXXX
}
 
Device {
  Name = HerbertBackupDailyNetwork
  Media Type = HerbertDailyNetworkMedia
  Device Type = File
  Archive Device = /mnt/Herbert/Backup/Network/Daily
  LabelMedia = yes;                   # lets Bacula label unlabeled media
  Random Access = Yes;
  AutomaticMount = yes;               # when device opened, read it
  RemovableMedia = no;
  AlwaysOpen = no;
  LabelMedia = yes
}
------------------------------------------------------------------------------
This SF.net email is sponsored by 

Make an app they can't live without
Enter the BlackBerry Developer Challenge
http://p.sf.net/sfu/RIM-dev2dev 
_______________________________________________
Bacula-users mailing list
Bacula-users AT lists.sourceforge DOT net
https://lists.sourceforge.net/lists/listinfo/bacula-users
<Prev in Thread] Current Thread [Next in Thread>
  • [Bacula-users] Bacula backups are painfully slow, Matt Schraeder <=