Bacula-users

Re: [Bacula-users] Need help understanding and applying some Retention/Recycle concepts

2013-07-11 12:47:06
Subject: Re: [Bacula-users] Need help understanding and applying some Retention/Recycle concepts
From: Ana Emília Machado de Arruda <emiliaarruda AT gmail DOT com>
Date: Thu, 11 Jul 2013 13:43:56 -0300
Hi Mingus,

When using disk volumes with automatic volume labeling, you have to tell bacula when to stop labeling new volumes... You can do it limiting the number of volumes in the pool. Also, you can try Recycle Oldest Volume = yes. Pasted from http://www.bacula.org/en/dev-manual/main/main/Basic_Volume_Management.html:

"The Maximum Volumes record can also be used in conjunction with the Volume Retention period to limit the total number of archive Volumes (files) that Bacula will create. By setting an appropriate Volume Retention period, a Volume will be purged just before it is needed and thus Bacula can cycle through a fixed set of Volumes. Cycling through a fixed set of Volumes can also be done by setting Recycle Oldest Volume = yes or Recycle Current Volume = yes. In this case, when Bacula needs a new Volume, it will prune the specified volume."

Regards,
Ana


On Thu, Jul 11, 2013 at 11:01 AM, Mingus Dew <shon.stephens AT gmail DOT com> wrote:
Dear All,
     I am running Bacula Community Edition 5.2.13 on Solaris 10 x86. I am trying to understand why Bacula doesn't seem to recycle when I think it should. 
     I have recently moved to a configuration where each Volume contains only a single Job. I had envisioned that when the Volume Retention period was reached, the Volume would be set to Recycle and reused. Instead what I'm finding is that Bacula is taking much longer to Recycle Volumes than I think it should and is instead creating more new Volumes. 

This is a relevant Pool Config

Pool {
  Name = Archimedes-FS_Full
  Pool Type = Backup
  Storage = Archimedes_Full_Files
  Recycle = Yes
  AutoPrune = Yes
  Volume Retention = 14d
  Maximum Volume Jobs = 1
  Label Format = Archimedes-FS_Full-
  Next Pool = Archimedes_LTO5_Tapes
}

This is a standard Job Config using Volumes in that Pool

Job {
  Name = "ar-web1_Daily_Disk"
  Type = Backup
  Client = ar-web1.archimedes
  FileSet = "Archimedes_Solaris_FileSystems"
  Schedule = "Incr_0300_Wed_Full"
  Pool = Archimedes-FS_Incr
  JobDefs = "DiskDefs"
  Full Backup Pool = Archimedes-FS_Full
  Incremental Backup Pool = Archimedes-FS_Incr
  Messages = Standard
  Write Bootstrap = "/mnt/backup1/archimedes/bacula/bootstrap/%n.bsr"
}

This is the Client definition

Client {
  Name = ar-web1.archimedes
  Address = 10.0.6.101
  FDPort = 9102
  Catalog = Mentora_Catalog
  Password = "m7pJY91cdgeYjknTffyj3/vBd+vpRzh6briOhZV5yWWN"
  AutoPrune = yes
}


As you can see, the only place where I define retention period is in the Pool. Nothing should be overriding this. Yet, here are the Volumes. I can see that the period between LastWritten is 7 days, coinciding with my Full Backup Schedule, however Bacula should not be retaining 4 weeks of these files, only 2 (14d)

     108 | Archimedes-FS_Full-0108 | Recycle   |       1 |              1 |        0 |    1,209,600 |       1 |    0 |         0 | Archimedes_File | 2013-06-06 03:07:21 |
|     128 | Archimedes-FS_Full-0128 | Used      |       1 | 33,862,178,634 |        7 |    1,209,600 |       1 |    0 |         0 | Archimedes_File | 2013-06-06 06:53:05 |
|     129 | Archimedes-FS_Full-0129 | Used      |       1 | 39,038,099,750 |        9 |    1,209,600 |       1 |    0 |         0 | Archimedes_File | 2013-06-06 10:01:46 |
|     130 | Archimedes-FS_Full-0130 | Used      |       1 |  5,130,340,345 |        1 |    1,209,600 |       1 |    0 |         0 | Archimedes_File | 2013-06-06 10:04:51 |
|     131 | Archimedes-FS_Full-0131 | Used      |       1 |  4,744,597,690 |        1 |    1,209,600 |       1 |    0 |         0 | Archimedes_File | 2013-06-06 10:07:48 |
|     132 | Archimedes-FS_Full-0132 | Used      |       1 |  5,376,150,353 |        1 |    1,209,600 |       1 |    0 |         0 | Archimedes_File | 2013-06-12 03:09:06 |
|     133 | Archimedes-FS_Full-0133 | Used      |       1 |  4,790,685,951 |        1 |    1,209,600 |       1 |    0 |         0 | Archimedes_File | 2013-06-12 03:11:47 |
|     134 | Archimedes-FS_Full-0134 | Used      |       1 |  2,878,371,042 |        0 |    1,209,600 |       1 |    0 |         0 | Archimedes_File | 2013-06-12 03:16:04 |
|     135 | Archimedes-FS_Full-0135 | Used      |       1 | 33,834,286,944 |        7 |    1,209,600 |       1 |    0 |         0 | Archimedes_File | 2013-06-12 07:03:00 |
|     136 | Archimedes-FS_Full-0136 | Used      |       1 | 39,201,368,421 |        9 |    1,209,600 |       1 |    0 |         0 | Archimedes_File | 2013-06-12 10:10:53 |
|     137 | Archimedes-FS_Full-0137 | Used      |       1 |  4,820,516,075 |        1 |    1,209,600 |       1 |    0 |         0 | Archimedes_File | 2013-06-19 03:06:47 |
|     138 | Archimedes-FS_Full-0138 | Used      |       1 | 40,170,205,038 |        9 |    1,209,600 |       1 |    0 |         0 | Archimedes_File | 2013-06-19 06:22:59 |
|     139 | Archimedes-FS_Full-0139 | Used      |       1 |  5,126,884,169 |        1 |    1,209,600 |       1 |    0 |         0 | Archimedes_File | 2013-06-19 06:25:25 |
|     140 | Archimedes-FS_Full-0140 | Used      |       1 | 33,890,965,413 |        7 |    1,209,600 |       1 |    0 |         0 | Archimedes_File | 2013-06-19 10:13:47 |
|     141 | Archimedes-FS_Full-0141 | Used      |       1 |  2,920,752,161 |        0 |    1,209,600 |       1 |    0 |         0 | Archimedes_File | 2013-06-19 10:17:54 |
|     142 | Archimedes-FS_Full-0142 | Used      |       1 |  5,567,216,031 |        1 |    1,209,600 |       1 |    0 |         0 | Archimedes_File | 2013-07-03 03:14:42 |
|     143 | Archimedes-FS_Full-0143 | Used      |       1 | 33,858,531,390 |        7 |    1,209,600 |       1 |    0 |         0 | Archimedes_File | 2013-07-03 07:02:09 |
|     144 | Archimedes-FS_Full-0144 | Used      |       1 | 31,142,987,941 |        7 |    1,209,600 |       1 |    0 |         0 | Archimedes_File | 2013-07-03 10:11:46 |
|     145 | Archimedes-FS_Full-0145 | Used      |       1 |  3,086,752,333 |        0 |    1,209,600 |       1 |    0 |         0 | Archimedes_File | 2013-07-03 10:15:13 |
|     146 | Archimedes-FS_Full-0146 | Used      |       1 |  4,907,978,588 |        1 |    1,209,600 |       1 |    0 |         0 | Archimedes_File | 2013-07-03 10:16:50 |
|     149 | Archimedes-FS_Full-0149 | Used      |       1 | 36,551,294,734 |        8 |    1,209,600 |       1 |    0 |         0 | Archimedes_File | 2013-07-10 06:52:31 |
|     163 | Archimedes-FS_Full-0163 | Used      |       1 | 33,899,466,368 |        7 |    1,209,600 |       1 |    0 |         0 | Archimedes_File | 2013-07-10 10:40:22 |
|     181 | Archimedes-FS_Full-0181 | Used      |       1 |  3,216,852,372 |        0 |    1,209,600 |       1 |    0 |         0 | Archimedes_File | 2013-07-10 10:44:19 |
|   1,035 | Archimedes-FS_Full-1035 | Used      |       1 |  4,963,655,982 |        1 |    1,209,600 |       1 |    0 |         0 | Archimedes_File | 2013-07-10 10:46:16 |
|   1,036 | Archimedes-FS_Full-1036 | Used      |       1 |  5,952,418,020 |        1 |    1,209,600 |       1 |    0 |         0 | Archimedes_File | 2013-07-10 10:49:56 |
|   1,043 | Archimedes-FS_Full

Can anyone explain what is going on?

Thank you,
Shon


------------------------------------------------------------------------------
See everything from the browser to the database with AppDynamics
Get end-to-end visibility with application monitoring from AppDynamics
Isolate bottlenecks and diagnose root cause in seconds.
Start your free trial of AppDynamics Pro today!
http://pubads.g.doubleclick.net/gampad/clk?id=48808831&iu=/4140/ostg.clktrk
_______________________________________________
Bacula-users mailing list
Bacula-users AT lists.sourceforge DOT net
https://lists.sourceforge.net/lists/listinfo/bacula-users


------------------------------------------------------------------------------
See everything from the browser to the database with AppDynamics
Get end-to-end visibility with application monitoring from AppDynamics
Isolate bottlenecks and diagnose root cause in seconds.
Start your free trial of AppDynamics Pro today!
http://pubads.g.doubleclick.net/gampad/clk?id=48808831&iu=/4140/ostg.clktrk
_______________________________________________
Bacula-users mailing list
Bacula-users AT lists.sourceforge DOT net
https://lists.sourceforge.net/lists/listinfo/bacula-users