Bacula-users

Re: [Bacula-users] [Bacula-devel] Despooling attrs does not finish

2014-10-18 13:39:19
Subject: Re: [Bacula-users] [Bacula-devel] Despooling attrs does not finish
From: Dan Langille <dan AT langille DOT org>
To: Ulrich Leodolter <ulrich.leodolter AT obvsg DOT at>
Date: Sat, 18 Oct 2014 13:32:48 -0400
On Oct 18, 2014, at 4:03 AM, Ulrich Leodolter <ulrich.leodolter AT obvsg DOT 
at> wrote:

> Hello,
> 
> we have Win7 backup which does not come to an end within MaxRunTime=12h.
> server runs 7.0.5 (28 July 2014),  the client has installed the
> bacula-enterprise-win64-7.0.5.exe.  but the problem started about 2
> months ago,  at that time windows client 5.2.10 was installed on the
> machine.
> 
> the backup itself is about 100GB compressed and seems to finish
> on the client after about 6 hours, below are the last messages of
> the job before it gets stuck.
> 
> 2014-10-18 03:18:09 troll-sd JobId 635821: Committing spooled data to
> Volume "Backup-0779". Despooling 1,692,736,419 bytes ...
> 2014-10-18 03:18:18 troll-sd JobId 635821: Despooling elapsed time = 
> 00:00:09, Transfer rate = 188.0 M Bytes/second
> 2014-10-18 03:18:19 troll-sd JobId 635821: Elapsed time=06:11:45, Transfer 
> rate=4.691 M Bytes/second
> 2014-10-18 03:18:22 troll-sd JobId 635821: Sending spooled attrs to the 
> Director. Despooling 603,449,667 bytes .
> 
> mysql status at the same time:
> 
> # echo "show full processlist" | mysql
> Id    User    Host    db      Command Time    State   Info
> 6854  bacula  localhost       bacula  Sleep   522             NULL
> 6873  bacula  localhost       bacula  Query   21143   Sending data    INSERT 
> INTO File (FileIndex, JobId, PathId, FilenameId, LStat, MD5, DeltaSeq) SELECT 
> batch.FileIndex, batch.JobId, Path.PathId, Filename.FilenameId,batch.LStat, 
> batch.MD5, batch.DeltaSeq FROM batch JOIN Path ON (batch.Path = Path.Path) 
> JOIN Filename ON (batch.Name = Filename.Name)
> 6899  root    localhost       NULL    Query   0       NULL    show full 
> processlist
> 
> 
> we have a bunch of other clients (about 30), a mixture of linux, win7 and mac 
> powerpc.
> all other backups run without problems for years now.  there are even larger 
> backups,
> in size and in number of files.
> 
> 
> does anyone have an idea why this single batch insert does not complete?
> 
> do i need to analyze the attrs spool file itself ?
> 
> yesterday i optimized the bacula database, but that doesn't help.
> there must be something special in the attrs spool file which the
> mysql server can't handle. the server runs on standard CentOS 6.5 x86_64.

This is something which should be asked in the user mailing list, not the devel 
mailing list.  I am replying to that list instead.

Is this a large number of files?

I had something which took a while.  I sped it up by giving PostgreSQL more 
memory.  Perhaps MySQL can do the same.

Here’s what I did: https://plus.google.com/+DanLangille/posts/AKXoRido3U1

— 
Dan Langille

Attachment: signature.asc
Description: Message signed with OpenPGP using GPGMail

------------------------------------------------------------------------------
Comprehensive Server Monitoring with Site24x7.
Monitor 10 servers for $9/Month.
Get alerted through email, SMS, voice calls or mobile push notifications.
Take corrective actions from your mobile device.
http://p.sf.net/sfu/Zoho
_______________________________________________
Bacula-users mailing list
Bacula-users AT lists.sourceforge DOT net
https://lists.sourceforge.net/lists/listinfo/bacula-users