Re: [Bacula-users] Slow Backups to Disk?

On 5/22/2015 5:28 AM, Charles Tassell wrote:
> Hello,
>
>     I'm using external USB drives setup with the vchanger system to
> simulate a tape library, and I've got a problem where the backups are
> running horrendously slow.  IE, the full backup of my small server
> (5.5GB) takes 8 hours and 10 minutes, and the backup of my 690GB file
> server takes 5-6 DAYS.  The problem doesn't seem to be the USB drives
> themselves as I can push 3GB/minute to them easily which means the 690GB
> backup should take under 6 hours.
>
>     Does anyone know what could be going on here?  Right now the Bacula
> director and storage-director are running on the file server as I
> thought that would be faster, but maybe that's a bad idea? There doesn't
> seem to be a big load issue, at least not enough of one to make the
> backups take 20-25x longer than with rsync...

First look at dmesg and make sure that the USB drives are indeed working 
properly.

If not the drives, then follow Heitor's advice and check DB performance. 
Spooling data should not be needed, however you should most definitely 
be spooling attributes. Without attribute spooling, Bacula must write to 
the DB after every file and can really slow things down. I suggest first 
to enable attribute spooling.With attribute spooling, all of the DB 
updates are cached while the data is being written to the USB drives. At 
the end of the job, all of the cached DB updates are written to the DB 
in batch transactions. You will see in the job status when it begins 
despooling attributes. If the despooling of attributes takes a long 
time, then you need to tune the DB.

The volumes are regular disk files. Bacula SD opens them and writes to 
them directly. If the writes to the USB disk file are still slow with 
attribute spooling enabled, then something else is going on, perhaps the 
client is the issue or a network problem.

I have a system using the same setup (vchanger with USB drives). Doing a 
virtual full, both read and write volumes on USB drives, I get:

   Build OS:               x86_64-redhat-linux-gnu redhat Enterprise release
   JobId:                  47392
   Job:                    josh.2015-04-30_12.56.31_09
   Backup Level:           Virtual Full
   Client:                 "josh-fd" 5.2.10 (28Jun12) Microsoft Windows Vista 
Business Edition Service Pack 2 (build 6002), 32-bit,Cross-compile,Win32
   FileSet:                "josh_fileset" 2009-05-05 19:01:00
   Pool:                   "full" (From Pool's NextPool resource)
   Catalog:                "MyCatalog" (From Client resource)
   Storage:                "vchanger1" (From Pool's NextPool resource)
   Scheduled time:         30-Apr-2015 12:56:23
   Start time:             29-Apr-2015 22:01:03
   End time:               29-Apr-2015 22:04:51
   Elapsed time:           3 mins 48 secs
   Priority:               4
   SD Files Written:       238,921
   SD Bytes Written:       23,243,222,038 (23.24 GB)
   Rate:                   101944.0 KB/s
   Volume name(s):         vchanger1_7_11
   Volume Session Id:      4
   Volume Session Time:    1430412645
   Last Volume Bytes:      1,699,706,114 (1.699 GB)
   SD Errors:              0
   SD termination status:  OK
   Termination:            Backup OK




------------------------------------------------------------------------------
One dashboard for servers and applications across Physical-Virtual-Cloud 
Widest out-of-the-box monitoring support with 50+ applications
Performance metrics, stats and reports that give you Actionable Insights
Deep dive visibility with transaction tracing using APM Insight.
http://ad.doubleclick.net/ddm/clk/290420510;117567292;y
_______________________________________________
Bacula-users mailing list
Bacula-users AT lists.sourceforge DOT net
https://lists.sourceforge.net/lists/listinfo/bacula-users