Bacula-users

Re: [Bacula-users] VirtualFull mysql query blocks other jobs for a long time

2010-04-06 09:17:48
Subject: Re: [Bacula-users] VirtualFull mysql query blocks other jobs for a long time
From: Graham Keeling <graham AT equiinet DOT com>
To: bacula-users AT lists.sourceforge DOT net
Date: Tue, 6 Apr 2010 14:21:10 +0100
On Tue, Apr 06, 2010 at 12:59:49PM +0200, Matija Nalis wrote:
> On Tue, Apr 06, 2010 at 11:13:44AM +0100, Graham Keeling wrote:
> > I'm using bacula-5.0.1.
> > 
> > At about Apr 6 10:00, I logged into mysql, and ran 'show full processlist;',
> > which gave the following.
> > 
> > | 3033 | root | localhost | bacula | Query   | 22464 | executing | SELECT 
> > Path.P
> > ath, Filename.Name, Temp.FileIndex, Temp.JobId, LStat, MD5 FROM ( SELECT 
> > FileId,
> >  Job.JobId AS JobId, FileIndex, File.PathId AS PathId, File.FilenameId AS 
> > Filena
> > meId, LStat, MD5 FROM Job, File, ( SELECT MAX(JobTDate) AS JobTDate, 
> > PathId, Fil
> > enameId FROM ( SELECT JobTDate, PathId, FilenameId FROM File JOIN Job USING 
> > (Job
> > Id) WHERE File.JobId IN (22,23,31,34,42,48,52) UNION ALL SELECT JobTDate, 
> > PathId
> > , FilenameId FROM BaseFiles JOIN File USING (FileId) JOIN Job  ON    
> > (BaseJobId 
> > = Job.JobId) WHERE BaseFiles.JobId IN (22,23,31,34,42,48,52) ) AS tmp GROUP 
> > BY P
> > athId, FilenameId ) AS T1 WHERE (Job.JobId IN ( SELECT DISTINCT BaseJobId 
> > FROM B
> > aseFiles WHERE JobId IN (22,23,31,34,42,48,52)) OR Job.JobId IN 
> > (22,23,31,34,42,
> > 48,52)) AND T1.JobTDate = Job.JobTDate AND Job.JobId = File.JobId AND 
> > T1.PathId 
> > = File.PathId AND T1.FilenameId = File.FilenameId ) AS Temp JOIN Filename 
> > ON (Fi
> > lename.FilenameId = Temp.FilenameId) JOIN Path ON (Path.PathId = 
> > Temp.PathId) WH
> > ERE FileIndex > 0 ORDER BY Temp.JobId, FileIndex ASC | 
> > 
> > 'Time 22464' is equivalent to about 6 hours, so I presume that after 
> > 'Bootstrap
> > records written', bacula has been waiting for this sql command, during which
> > time it could not do anything else. Backups of other clients were failing
> > because I had Max Wait Time set to something less than 6 hours.
> 
> Yes, it happens, especially with bigger File tables - what does 
> "Select count(*) from File" returns for you ?

3239328

> This slowdown was not present in 3.0.3 but is new to 5.0.x series and
> has been documented on http://bugs.bacula.org/view.php?id=1472
> which is in process of being debugged currently

Thanks for that.
A colleague of mine did exactly "start several jobs; very soon the query
gets run and everything else stops" this morning.


------------------------------------------------------------------------------
Download Intel&#174; Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
_______________________________________________
Bacula-users mailing list
Bacula-users AT lists.sourceforge DOT net
https://lists.sourceforge.net/lists/listinfo/bacula-users