Bacula-users

Re: [Bacula-users] VirtualFull mysql query blocks other jobs for a long time

2010-04-06 07:02:06
Subject: Re: [Bacula-users] VirtualFull mysql query blocks other jobs for a long time
From: Matija Nalis <mnalis+bacula AT CARNet DOT hr>
To: Graham Keeling <graham AT equiinet DOT com>
Date: Tue, 6 Apr 2010 12:59:49 +0200
On Tue, Apr 06, 2010 at 11:13:44AM +0100, Graham Keeling wrote:
> I'm using bacula-5.0.1.
> 
> At about Apr 6 10:00, I logged into mysql, and ran 'show full processlist;',
> which gave the following.
> 
> | 3033 | root | localhost | bacula | Query   | 22464 | executing | SELECT 
> Path.P
> ath, Filename.Name, Temp.FileIndex, Temp.JobId, LStat, MD5 FROM ( SELECT 
> FileId,
>  Job.JobId AS JobId, FileIndex, File.PathId AS PathId, File.FilenameId AS 
> Filena
> meId, LStat, MD5 FROM Job, File, ( SELECT MAX(JobTDate) AS JobTDate, PathId, 
> Fil
> enameId FROM ( SELECT JobTDate, PathId, FilenameId FROM File JOIN Job USING 
> (Job
> Id) WHERE File.JobId IN (22,23,31,34,42,48,52) UNION ALL SELECT JobTDate, 
> PathId
> , FilenameId FROM BaseFiles JOIN File USING (FileId) JOIN Job  ON    
> (BaseJobId 
> = Job.JobId) WHERE BaseFiles.JobId IN (22,23,31,34,42,48,52) ) AS tmp GROUP 
> BY P
> athId, FilenameId ) AS T1 WHERE (Job.JobId IN ( SELECT DISTINCT BaseJobId 
> FROM B
> aseFiles WHERE JobId IN (22,23,31,34,42,48,52)) OR Job.JobId IN 
> (22,23,31,34,42,
> 48,52)) AND T1.JobTDate = Job.JobTDate AND Job.JobId = File.JobId AND 
> T1.PathId 
> = File.PathId AND T1.FilenameId = File.FilenameId ) AS Temp JOIN Filename ON 
> (Fi
> lename.FilenameId = Temp.FilenameId) JOIN Path ON (Path.PathId = Temp.PathId) 
> WH
> ERE FileIndex > 0 ORDER BY Temp.JobId, FileIndex ASC | 
> 
> 'Time 22464' is equivalent to about 6 hours, so I presume that after 
> 'Bootstrap
> records written', bacula has been waiting for this sql command, during which
> time it could not do anything else. Backups of other clients were failing
> because I had Max Wait Time set to something less than 6 hours.

Yes, it happens, especially with bigger File tables - what does 
"Select count(*) from File" returns for you ?

This slowdown was not present in 3.0.3 but is new to 5.0.x series and
has been documented on http://bugs.bacula.org/view.php?id=1472
which is in process of being debugged currently

-- 
Matija Nalis
Odjel racunalno-informacijskih sustava i servisa                                
                                                      
Hrvatska akademska i istrazivacka mreza - CARNet 
Josipa Marohnica 5, 10000 Zagreb
tel. +385 1 6661 616, fax. +385 1 6661 766
www.CARNet.hr

------------------------------------------------------------------------------
Download Intel&#174; Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
_______________________________________________
Bacula-users mailing list
Bacula-users AT lists.sourceforge DOT net
https://lists.sourceforge.net/lists/listinfo/bacula-users