Bacula-users

Re: [Bacula-users] Best way to backup simultaneously

2009-03-19 21:14:23
Subject: Re: [Bacula-users] Best way to backup simultaneously
From: Kevin Keane <subscription AT kkeane DOT com>
Date: Thu, 19 Mar 2009 18:08:23 -0700
Jason Dixon wrote:
> On Thu, Mar 19, 2009 at 03:41:10PM -0700, Kevin Keane wrote:
>   
>> If you are using a single tape drive, you will have an issue.
>>
>> One thing you could theoretically do is configure the storage daemon, 
>> storage resource, job, and pool all for multiple concurrent jobs. The 
>> bacula manual explains how to do that. But I'm not sure if that really 
>> gives you the results you would want, and it can potentially be a problem.
>>     
>
> I've tried that.  But since the scheduled OS backup jobs are already
> running, the client-initiated transaction log jobs are forced to wait.
>   
Then you probaby still had a Maximum Concurrent Jobs = 1 setting somewhere.
>> A couple other thoughts:
>>
>> - I actually shut down the monitoring system during backup runs for 
>> exactly that type of reason. I know and expect that some services will 
>> be slower than normal, no need to be alerted about it. I am using 
>> Nagios, and simply configured a script to create a scheduled downtime 
>> when the nightly backup starts. I don't know if that is acceptable for 
>> your situation, of course.
>>     
>
> It's not a question of being annoyed by the alerts.  If the logs aren't
> backed up it causes the next batch of logs to not get flushed from the
> database (if I understand the dba).
>   
Oh, OK. That is what I had thought happened during the daily backup.

Is flushing the ONLY purpose of backing up the transaction log? Would 
you ever restore a transaction log backup? And if so, would you or the 
dba know HOW to restore a transaction log properly? How long do you need 
this backup to be retained?

What I am thinking is that if the transaction log only needs to be kept 
for 24 hours (since the last full backup), you might be able - and 
better off - storing it on a hard disk rather than a tape in the first 
place. Preferably of course a separate hard disk.
>> - You could use spooling for the transaction logs, since you say that 
>> you have local file storage available. That way, the client would see 
>> the backup completed quickly, and bacula would later write the actual 
>> files to tape at its convenience.
>>     
>
> I've been unable to get Migration working as intended.  I've posted
> previously about that but never got a working conclusion.
>   
I'm not talking about migration. Spooling is a pretty low-level feature; 
it's in the original job itself. Basically, instead of writing the data 
from a job straight to the tape, bacula creates a file, stores the data 
there, and then as soon as the tape becomes available copies it to the tape.
>> - Maybe I'm showing my ignorance on databases here, but does it even 
>> make sense to flush transaction logs to tape while the database itself 
>> is being backed up? Maybe you can suspend flushing the logs during the 
>> backup? My admittedly very rusty SQL Server skills seem to recall that 
>> the transaction log will be cleaned up during the database backup. Not 
>> sure if that still applies, or if it translates to other databases.
>>     
>
> The full database backup is a ZFS snapshot.
>   
See above. It seems it's the transaction log backup that does what I 
thought the full backup did.

-- 
Kevin Keane
Owner
The NetTech
Find the Uncommon: Expert Solutions for a Network You Never Have to Think About

Office: 866-642-7116
http://www.4nettech.com

This e-mail and attachments, if any, may contain confidential and/or 
proprietary information. Please be advised that the unauthorized use or 
disclosure of the information is strictly prohibited. The information herein is 
intended only for use by the intended recipient(s) named above. If you have 
received this transmission in error, please notify the sender immediately and 
permanently delete the e-mail and any copies, printouts or attachments thereof.


------------------------------------------------------------------------------
Apps built with the Adobe(R) Flex(R) framework and Flex Builder(TM) are
powering Web 2.0 with engaging, cross-platform capabilities. Quickly and
easily build your RIAs with Flex Builder, the Eclipse(TM)based development
software that enables intelligent coding and step-through debugging.
Download the free 60 day trial. http://p.sf.net/sfu/www-adobe-com
_______________________________________________
Bacula-users mailing list
Bacula-users AT lists.sourceforge DOT net
https://lists.sourceforge.net/lists/listinfo/bacula-users