Bacula-users

Re: [Bacula-users] File jobs purged when they should not

2012-11-20 14:10:39
Subject: Re: [Bacula-users] File jobs purged when they should not
From: Felip Moll <lipixx AT gmail DOT com>
To: "Melissari, Ryan Joseph" <rmelissari AT tamu DOT edu>
Date: Tue, 20 Nov 2012 20:06:04 +0100
So, my problem is that the retention period that I defined in the pools are applied to the client regardless of the pool where the backup job is done?

So, probably, the pool defined for a 7 days retention is pruning all files from the backups defined to run in a different pool, eg. 4 weeks, 1 month, 5 years pools... "messing up" these jobs.

I have some clients with TiB of data, and I would like to have a list of files to recover in a 7 days period, and every 7 days prune oldest jobs and files. I want also that this clients backup their data to the pool of 1 month and 5y, but not saving files... so from what you said, i must define multiple clients for every "real client".

Is it correct?

2012/11/20 Melissari, Ryan Joseph <rmelissari AT tamu DOT edu>
I didn't see this in your configuration you sent to the list, but I saw you mention a question about multiple pools.  I also saw you have retention settings defined in both client and pool resources.  Volume retention is the only one out of the three that is a pool attribute. Job and client retention should be placed in the client resource.  Since job and client retention are client resources, when a client resource is called (assuming autoprune is enabled) it will go and prune any job on all of its pools.

You can define these values in the pool resource if you want, but just remember that they apply to the client and not the pool itself.  The only safe way I know of to backup clients to multiple pools with separate retention times are to setup multiple client resources for each client.


----- Original Message -----
> From: "Felip Moll" <lipixx AT gmail DOT com>
> To: "lst hoe02" <lst_hoe02 AT kwsoft DOT de>
> Cc: bacula-users AT lists.sourceforge DOT net
> Sent: Tuesday, November 20, 2012 10:54:11 AM
> Subject: Re: [Bacula-users] File jobs purged when they should not
>
>
> This is correct. I took care of the priority for purging.
>
> By the way, as you noticed, I must be able to restore individually
> the files of the backup done at 01-nov 22.00h, from 01 nov to 01
> dec.
>
> On 06 november, the files of the backup were purged.. so NO 1 month
> restore.. and was a full backup.
>
>
>
>
> 2012/11/20 < lst_hoe02 AT kwsoft DOT de >
>
>
>
> Zitat von Felip Moll < lipixx AT gmail DOT com >:
>
>
> > Hi people,
> >
> > Recently I found a problem when trying to recover my files from a
> > Job. The
> > Files of a Job are purged when they shouldn't be.
> >
>
>
> > #######################
> > ####################### RELEVANT CONFIGURATIONS
> > #######################
> >
> > Job {
> > Name = "Backup Dades : Dominator 6m"
> > Client = dominator-fd
> > JobDefs = "JobTemplate"
> > Fileset = "home"
> > Schedule = "CicleMensual-6mesos-22h"
> > Storage = Autochanger
> > Pool = Cintes-Data-6mesos
> > }
> >
> > Schedule {
> > Name = "CicleMensual-6mesos-22h"
> > Run = Full january 1 at 22:00
> > Run = Full july 1 at 22:00
> > Run = Incremental feb-jun 1 at 22:00
> > Run = Incremental aug-dec 1 at 22:00
> > }
> >
> > Client {
> > Name = dominator-fd
> > Address = dominator.domain.com
> > FDPort = 9102
> > Catalog = MyCatalog
> > Password = "****" # password for FileDaemon
> > File Retention = 10 years # 10 years
> > Job Retention = 10 years # six months
> > AutoPrune = yes # Prune expired Jobs/Files
> > }
> >
> >
> >
> > Pool {
> > Name = Cintes-Data-6mesos
> > Pool Type = Backup
> > Recycle = yes
> > AutoPrune = yes
> > File Retention = 1 month
> > Job Retention = 6 months
> > Volume Retention = 12 months
> > }
> >
> > #######################
> > #######################
> > #######################
> >
> > #######################
> > ####################### What happens when I try to restore
> > #######################
> > Enter JobId(s), comma separated, to restore: 7444
> > You have selected the following JobId: 7444
> >
> > Building directory tree for JobId(s) 7444 ...
> >
> > For one or more of the JobIds selected, no files were found,
> > so file selection is not possible.
> > Most likely your retention policy pruned the files.
> >
> > Do you want to restore all the files? (yes|no): no
> >
>
> You should be aware of the "priority" for purging. From my knowledge
> the pool purging has priority against the setting for the client.
> Furthermore the purge is inclusive as purging jobs do purge all
> related file records and so on. For your example you have a "File
> Retention = 1 month" and a "Job Retention = 6 months" which means
> after 1 month you can only restore the full job without file
> selection
> (that's what bacula suggested).
>
> Regards
>
> Andreas
>
>
>
> ------------------------------------------------------------------------------
> Monitor your physical, virtual and cloud infrastructure from a single
> web console. Get in-depth insight into apps, servers, databases,
> vmware,
> SAP, cloud infrastructure, etc. Download 30-day Free Trial.
> Pricing starts from $795 for 25 servers or applications!
> http://p.sf.net/sfu/zoho_dev2dev_nov
> _______________________________________________
> Bacula-users mailing list
> Bacula-users AT lists.sourceforge DOT net
> https://lists.sourceforge.net/lists/listinfo/bacula-users
>
>
> ------------------------------------------------------------------------------
> Monitor your physical, virtual and cloud infrastructure from a single
> web console. Get in-depth insight into apps, servers, databases,
> vmware,
> SAP, cloud infrastructure, etc. Download 30-day Free Trial.
> Pricing starts from $795 for 25 servers or applications!
> http://p.sf.net/sfu/zoho_dev2dev_nov
> _______________________________________________
> Bacula-users mailing list
> Bacula-users AT lists.sourceforge DOT net
> https://lists.sourceforge.net/lists/listinfo/bacula-users
>

------------------------------------------------------------------------------
Monitor your physical, virtual and cloud infrastructure from a single
web console. Get in-depth insight into apps, servers, databases, vmware,
SAP, cloud infrastructure, etc. Download 30-day Free Trial.
Pricing starts from $795 for 25 servers or applications!
http://p.sf.net/sfu/zoho_dev2dev_nov
_______________________________________________
Bacula-users mailing list
Bacula-users AT lists.sourceforge DOT net
https://lists.sourceforge.net/lists/listinfo/bacula-users