Bacula-users

Re: [Bacula-users] Base jobs and incremental backups

2011-05-18 18:09:24
Subject: Re: [Bacula-users] Base jobs and incremental backups
From: TipMeAbout <tipmeabout AT gmail DOT com>
To: bacula-users AT lists.sourceforge DOT net
Date: Thu, 19 May 2011 00:05:03 +0200
Thank you Pablo for your help.
I will do a test with the base job done through LAN, then the full through 
wifi. I will post the result here.

JC


Le mercredi 18 mai 2011 j'ai reçu le message suivant:

> > Are there any informations in the log file that prove the first full
> > after a base job is effectively using the base job ?
> 
> The Bacula report after the FULL gives you very useful information,
> including the BASE backup files used.
> 
> This is a sample report after a FULL backup, notice the line Base
> files/Used files:
> 
> JobId: 371
> Job: server-fd-data.2011-05-09_16.58.33_17
> Backup Level: Full (upgraded from Incremental)
> Client: "server-fd" 5.0.3 (04Aug10) Linux,Cross-compile,Win32
> FileSet: "server-set" 2011-05-09 14:29:09
> Pool: "Yearly" (From User input)
> Catalog: "MyCatalog" (From Client resource)
> Storage: "FileStorage" (From Job resource)
> Scheduled time: 09-May-2011 16:58:24
> Start time: 09-May-2011 17:02:10
> End time: 09-May-2011 18:01:16
> Elapsed time: 59 mins 6 secs
> Priority: 10
> FD Files Written: 39,344
> SD Files Written: 39,344
> FD Bytes Written: 8,600,464,982 (8.600 GB)
> SD Bytes Written: 8,606,510,471 (8.606 GB)
> Rate: 2425.4 KB/s
> Software Compression: 39.7 %
> Base files/Used files: 39336/39114 (99.44%)
> VSS: yes
> Encryption: no
> Accurate: yes
> Volume name(s): Tape-Year-0001
> Volume Session Id: 358
> Volume Session Time: 1302812565
> Last Volume Bytes: 252,270,109,076 (252.2 GB)
> Non-fatal FD errors: 0
> SD Errors: 0
> FD termination status: OK
> SD termination status: OK
> Termination: Backup OK
> 
> For your case, depending on how much data changes on the Laptop, it maybe
> OK just to leave it on the WiFi for all backups (except for the BASE).
> 
> Pablo
> ----- Original Message -----
> From: "- -" <tipmeabout AT gmail DOT com>
> To: "Pablo Marques" <pmarques AT miamilinux DOT net>
> Cc: bacula-users AT lists.sourceforge DOT net
> Sent: Wednesday, May 18, 2011 9:10:55 AM
> Subject: Re: [Bacula-users] Base jobs and incremental backups
> 
> 
> 2011/5/18 Pablo Marques < pmarques AT miamilinux DOT net >
> 
> 
> 
> When you do a Base backup, you need to do a FULL immediately after,
> because the BASE backup is a "special" backup and you cannot restore only
> from it.
> 
> From then on you can do Incrementals, Fulls or Differentials.
> 
> All the FULL backups that you will run after that fist FULL are going to be
> very small, so you should only need to have the laptop on Gig on your
> first BASE backup.
> 
> Hope this helps.
> 
> Pablo
> 
> 
> 
> 
> 
> 
> 
> 
> Hello !
> 
> That's an interesting point ! I did not understand when read the
> documentation that a full is necessary after a base job. I though a base
> replaces a full. For me the interesting point of a base job was that you
> can do a base job of a "template" server, and then backup n servers
> directly without having n full backups to do. Writing that, I now
> understand better the concept of base jobs, all the n full would contain
> pointers on the base jobs. Are there any informations in the log file that
> prove the first full after a base job is effectively using the base job ?
> Something like "running 'client-bkp job' based on 'based-job' " ?
> 
> So for my problem, I should try to do a floating IP between the 2 interface
> - GiB and wifi - and do the backup on this interface: if the LAN cable is
> connected, backup goes through the LAN, if there is only the wifi it would
> use it. I think I can do that with a piece of script. eth0 would be
> "client-lan", wlan0 "client-wlan" and the backup interface would be
> "client-bkp" pointing on "eth0:0" if cable is connected or "wlan0:0".
> 
> Thanks for your help !
> 
> JC
> 
> 
> 
> <blockquote>
> 
> 
> ----- Original Message -----
> From: "TipMeAbout" < tipmeabout AT gmail DOT com >
> To: bacula-users AT lists.sourceforge DOT net
> Sent: Tuesday, May 17, 2011 5:09:10 PM
> Subject: Re: [Bacula-users] Base jobs and incremental backups
> 
> > On Mon, May 16, 2011 at 11:07 PM, TipMeAbout < tipmeabout AT gmail DOT com 
> > > 
wrote:
> > > Hello all,
> > > 
> > > I use Bacula for some times now and I experiment now the base job
> > > backup. I have to solve a problem and I need help: I have to backup a
> > > laptop.
> > > 
> > > This laptop is most of the time connected by wifi. As it contains quite
> > > large
> > > data, I have decided to do a full the 1st of each month and an
> > > incremental the
> > > other days.
> > > To let the full run quickly, I decided that the laptop will be
> > > connected by its LAN 1Gb connection the 1st and by wifi the rest of
> > > the month. So I have 2
> > > client instances configured: "client-lan" and "client-wlan", one for
> > > each type
> > > of backup, each with its own IP address. But when I start an
> > > incremental for
> > > "client-wlan", Bacula tells me it does not find a valid full, so it
> > > starts a
> > > full through the wifi connection. Too long !!
> > > I have decided to do a base job the 1st of the month by LAN for
> > > instance "client-lan" and then each incremental for "client-wlan"
> > > would be based on this base job. It does not work neither as it still
> > > starts a full backup in wifi mode instead of incremental. I have read
> > > that a base job is like a full
> > > and let full backup base on it: so I change my incremental backup by a
> > > full with hope it would saved only some datas, for instance
> > > "client-wlan". But after a while running, I have the impression Bacula
> > > does a new total full without taking into consideration the base job
> > > backup.
> > > 
> > > So my questions are simple: does base job can be used with incremental
> > > backups
> > > to realise what I would like and how to do that ?
> > > 
> > > Thanks in advance for your help !
> > > 
> > > 
> > > JC
> > 
> > Rather than try to backup the laptop with Bacula, I would use RSYNC to on
> > the laptop and then backup the rsync "mirror" of the laptop, that way you
> > don't rely on the laptop being connected and once you have done the
> > initial rsync the incrementals are much easier to manage over your WiFi
> > bandwidth. You could also trigger your rsync job to run when the
> > interface comes up, and if you did this over SSH via an Internet
> > resolvable f.q.d.n then you can backup from "anywhere"
> > 
> > Although Bacula is fantastic for backing up, sometimes other "tools" can
> > make the overall process better
> 
> Hello,
> 
> Thanks for your answer !
> Of course I could use other tools, but the challenge is to do that with
> bacula and to highlight how to use base job backup as a base for
> incremental backup.
> 
> By using RSYNC, I have to provide space left on the bacula server which
> would act as mirror, and then space to backup this mirror with bacula (I
> use backup on disk file of 4GiB).
> Moreover, the rsync would mirror data I don't care (iso, mpeg, jpg) which
> are space and bandwidth consuming through wifi; with bacula, it excluded
> from the beginning. And maintaining 2 lists of exclusion - one for each
> tool - is not the most recommended I think.
> 
> If someone else has a proposal, I'm still open for an answer.
> I will myself think if a solution based on virtual IPs can be set up. If I
> found something, I would of course complete this thread.
> 
> See you all !
> 
> JC
-- 
http://www.tipmeabout.org
http://www.tipmeabout.com

------------------------------------------------------------------------------
What Every C/C++ and Fortran developer Should Know!
Read this article and learn how Intel has extended the reach of its 
next-generation tools to help Windows* and Linux* C/C++ and Fortran 
developers boost performance applications - including clusters. 
http://p.sf.net/sfu/intel-dev2devmay
_______________________________________________
Bacula-users mailing list
Bacula-users AT lists.sourceforge DOT net
https://lists.sourceforge.net/lists/listinfo/bacula-users