Bacula-users

Re: [Bacula-users] Breaking backup archive to multiple parts

2014-03-07 18:15:01
Subject: Re: [Bacula-users] Breaking backup archive to multiple parts
From: "Brady, Mike" <mike.brady AT devnull.net DOT nz>
To: bacula-users AT lists.sourceforge DOT net
Date: Sat, 08 Mar 2014 12:12:41 +1300
On 2014-03-08 10:06, Brady, Mike wrote:
> On 2014-03-08 08:23, Michael Potts wrote:
>> I have set up Bacula to backup several servers and everything is
>> humming along nicely.
>> 
>> My goal is to get Bacula to backup to multiple smaller files instead
>> of one large (in my case ~2GB) file for offsite to Amazon S3. My
>> thought being if I can get the incremental changes from all the
>> servers each day to go to a new file. This file will then get picked
>> up by a cron job and sent to S3.
>> 
>> The way to do this seems to center around 
>> 
>>>> Use Volume Once = yes
>> 
>> but right now that just creates a new volume for every backup. I just
>> want one volume per day and like 14 days history (so 14 volumes that
>> rotate around or I can use my cron job to delete volumes as needed).
>> For scale's sake, this will probably have 20 or so jobs run to it and
>> each job seems to net around 7MB of changed data. Total on the initial
>> backup is like 250MB per job. Backup jobs run at night but eventually
>> I want to crank that up to run several times a day (all to the same
>> daily volume)
>> 
>> Relevant data from config files to follow:
>> 
>> bacula-dir.conf
>> 
>> Client {
>>  Name = server-sandbox-fd
>>  Password = <crazypassword>
>>  Address = fqdn-to-server.srv.internal.domain.com [1]
>>  FDPort = 9102
>>  Catalog = MyCatalog
>>  File Retention = 30 days
>>  Job Retention = 6 months
>> }
>> 
>> Job {
>>  Name = server_SandboxBackup
>>  Type = Backup
>>  Level = Incremental
>>  Client = server-sandbox-fd
>>  FileSet = "Data Opt Backup"
>>  Schedule = "Daily Evening"
>>  Storage = File
>>  Pool = Serverpool
>>  Messages = Standard
>> }
>> 
>> Pool {
>>  Name = Serverpool
>>  Pool Type = Backup
>>  Volume Retention = 24h
>>  Recycle = yes
>>  AutoPrune = yes
>>  LabelFormat = servervol_
>>  Maximum Volumes = 12
>>  Use Volume Once = yes
>> }
>> 
>> Storage {
>>  Name = File
>>  Address = fqdn-to-server.srv.domain.com [2]
>>  SDPort = 9103
>>  Password = <crazypassword>
>>  Device = FileStorage
>>  Media Type = File
>>  Maximum Concurrent Jobs = 20
>> }
>> 
>> bacula-sd.conf
>> 
>> Device {
>>  Name = FileStorage
>>  Media Type = File
>>  Archive Device = /mnt/backupdisk/serverbackups
>>  LabelMedia = yes
>>  Random Access = yes
>>  AutomaticMount = yes
>>  RemovableMedia = no
>>  AlwaysOpen = no
>> }
>> 
>> Thanks so much! Any insight or alternative approaches are appreciated!
>> 
>> Michael Potts
>> 
> 
> Have a look at "Volume User Duration" in the Pool definition.  Sounds
> like it might what you are looking for.
> 
> Regards
> 
> Mike
> 

Oops I meant "Volume Use Duration".

------------------------------------------------------------------------------
Subversion Kills Productivity. Get off Subversion & Make the Move to Perforce.
With Perforce, you get hassle-free workflows. Merge that actually works. 
Faster operations. Version large binaries.  Built-in WAN optimization and the
freedom to use Git, Perforce or both. Make the move to Perforce.
http://pubads.g.doubleclick.net/gampad/clk?id=122218951&iu=/4140/ostg.clktrk
_______________________________________________
Bacula-users mailing list
Bacula-users AT lists.sourceforge DOT net
https://lists.sourceforge.net/lists/listinfo/bacula-users
<Prev in Thread] Current Thread [Next in Thread>