Bacula-users
[Top] [All Lists]
<prev [Date] next>
[Advanced]
 <prev [Thread] next>

[Bacula-users] Job pre-allocating 20 volumes from a pool un-necessary

2010-11-28 15:29:49
Subject: [Bacula-users] Job pre-allocating 20 volumes from a pool un-necessary
From: "Francois D." <bacula-f AT duchatelet DOT org>
To: <bacula-users AT lists.sourceforge DOT net>
Date: Sun, 28 Nov 2010 20:51:07 +0100 
Hello,

I've an issue preventing the correct recycling of my Pool's volume.

Given the definitions at the end of the message, I have the job for locutus
pre-create 20 volumes in the Default pool right after the 60 seconds sleep.

What happens:
- at 02:05, two jobs (Sulu and Locutus) starts. 
- to avoid them compelling for the same Volume, the Locutus job does a
'sleep 60'.
- due, I think, to the known bug in 5.0.2 (bug-1578), the locutus job waits
for the sulu completion before going on.
- sometimes (I was not able to deduce a pattern yet), while it is waiting,
the locutus job creates new volumes in the target pool, even before it needs
it.

When the pool is empty, like today (I've cleaned and rebuild the pool
yesterday), this is not really an issue, but when there are 100+ volumes,
with about 50 of them purged, and ready to be re-used, this is annoying, as
this makes the pool growing.

Any ideas of what I did wrong ?

Cheers,
François


=============================================

Here is an extract of the Sulu job log:
--------------------
28-Nov 02:05 spock-dir JobId 1446: Start Backup JobId 1446,
Job=sulu.2010-11-28_02.05.00_44
28-Nov 02:05 spock-dir JobId 1446: Created new Volume "BDSK-002" in catalog.
28-Nov 02:05 spock-dir JobId 1446: Using Device "FileStorage"
28-Nov 02:05 spock-sd JobId 1446: Labeled new Volume "BDSK-002" on device
"FileStorage" (/backups).
28-Nov 02:05 spock-sd JobId 1446: Wrote label to prelabeled Volume
"BDSK-002" on device "FileStorage" (/backups)
28-Nov 02:05 spock-dir JobId 1446: Max Volume jobs exceeded. Marking Volume
"BDSK-002" as Used.
28-Nov 02:05 sulu-fd JobId 1446: Generate VSS snapshots. Driver="VSS Vista",
Drive(s)="C"
28-Nov 02:08 spock-sd JobId 1446: User defined maximum volume capacity
1,073,741,824 exceeded on device "FileStorage" (/backups).
28-Nov 02:08 spock-sd JobId 1446: End of medium on Volume "BDSK-002"
Bytes=1,073,737,912 Blocks=16,644 at 28-Nov-2010 02:08.
28-Nov 02:08 spock-sd JobId 1446: Labeled new Volume "BDSK-003" on device
"FileStorage" (/backups).
28-Nov 02:08 spock-sd JobId 1446: Wrote label to prelabeled Volume
"BDSK-003" on device "FileStorage" (/backups)
28-Nov 02:08 spock-dir JobId 1446: Max Volume jobs exceeded. Marking Volume
"BDSK-003" as Used.
28-Nov 02:08 spock-sd JobId 1446: New volume "BDSK-003" mounted on device
"FileStorage" (/backups) at 28-Nov-2010 02:08.
28-Nov 02:24 spock-sd JobId 1446: User defined maximum volume capacity
1,073,741,824 exceeded on device "FileStorage" (/backups).
28-Nov 02:24 spock-sd JobId 1446: End of medium on Volume "BDSK-003"
Bytes=1,073,737,675 Blocks=16,644 at 28-Nov-2010 02:24.
28-Nov 02:24 spock-sd JobId 1446: Labeled new Volume "BDSK-004" on device
"FileStorage" (/backups).
28-Nov 02:24 spock-sd JobId 1446: Wrote label to prelabeled Volume
"BDSK-004" on device "FileStorage" (/backups)
28-Nov 02:24 spock-dir JobId 1446: Max Volume jobs exceeded. Marking Volume
"BDSK-004" as Used.
28-Nov 02:24 spock-sd JobId 1446: New volume "BDSK-004" mounted on device
"FileStorage" (/backups) at 28-Nov-2010 02:24.

And here is an extract of the locutus job log:
--------------------
28-Nov 02:05 spock-dir JobId 1447: shell command: run BeforeJob "/bin/sleep
60"
28-Nov 02:06 spock-dir JobId 1447: Start Backup JobId 1447,
Job=locutus.2010-11-28_02.05.01_45
28-Nov 02:06 spock-dir JobId 1447: Created new Volume "BDSK-003" in catalog.
28-Nov 02:06 spock-dir JobId 1447: Created new Volume "BDSK-004" in catalog.
28-Nov 02:06 spock-dir JobId 1447: Created new Volume "BDSK-005" in catalog.
28-Nov 02:06 spock-dir JobId 1447: Created new Volume "BDSK-006" in catalog.
28-Nov 02:06 spock-dir JobId 1447: Created new Volume "BDSK-007" in catalog.
28-Nov 02:06 spock-dir JobId 1447: Created new Volume "BDSK-008" in catalog.
28-Nov 02:06 spock-dir JobId 1447: Created new Volume "BDSK-009" in catalog.
28-Nov 02:06 spock-dir JobId 1447: Created new Volume "BDSK-010" in catalog.
28-Nov 02:06 spock-dir JobId 1447: Created new Volume "BDSK-011" in catalog.
28-Nov 02:06 spock-dir JobId 1447: Created new Volume "BDSK-012" in catalog.
28-Nov 02:06 spock-dir JobId 1447: Created new Volume "BDSK-013" in catalog.
28-Nov 02:06 spock-dir JobId 1447: Created new Volume "BDSK-014" in catalog.
28-Nov 02:06 spock-dir JobId 1447: Created new Volume "BDSK-015" in catalog.
28-Nov 02:06 spock-dir JobId 1447: Created new Volume "BDSK-016" in catalog.
28-Nov 02:06 spock-dir JobId 1447: Created new Volume "BDSK-017" in catalog.
28-Nov 02:06 spock-dir JobId 1447: Created new Volume "BDSK-018" in catalog.
28-Nov 02:06 spock-dir JobId 1447: Created new Volume "BDSK-019" in catalog.
28-Nov 02:06 spock-dir JobId 1447: Created new Volume "BDSK-020" in catalog.
28-Nov 02:06 spock-dir JobId 1447: Created new Volume "BDSK-021" in catalog.
28-Nov 02:08 spock-dir JobId 1447: Created new Volume "BDSK-022" in catalog.
28-Nov 02:24 spock-dir JobId 1447: Created new Volume "BDSK-023" in catalog.
28-Nov 02:29 spock-dir JobId 1447: Using Device "FileStorage"
28-Nov 02:29 spock-sd JobId 1447: Labeled new Volume "BDSK-005" on device
"FileStorage" (/backups).
28-Nov 02:29 spock-sd JobId 1447: Wrote label to prelabeled Volume
"BDSK-005" on device "FileStorage" (/backups)

Extract of configuration:
-------------------------
# Default pool definition, targeting the disk storage
Pool {
  Name = Default
  Pool Type = Backup
  Recycle = yes                 # Bacula can automatically recycle Volumes
  AutoPrune = yes               # Prune expired volumes
  Volume Retention = 7 days
  Maximum Volume Jobs = 1       # On disk, I want a new volume for each job
  Maximum Volume Bytes = 1G     # Limit the size of volumes to something
reasonnable for disk files
  LabelFormat = "BDSK-${BDSK+:p/3/0/r}"
  Storage = File
  Next Pool = LTO1
  Migration Time = 1 hour
}

# Those are generic defaults for all my backups
JobDefs {
  Name = "DefaultJob"
  Type = Backup
  Level = Incremental
  Schedule = "WeeklyCycle"
  Messages = Standard
  Pool = Default
  Priority = 10
}

Job {
  Name = "sulu"
  Client = sulu-fd
  FileSet = "Sulu Set"
  JobDefs = "DefaultJob"
  # Force it to be started ahead of others, so the schedule is kept"
  Priority = 9
}

Job {
  Name = "locutus"
  Client = locutus-fd
  FileSet = "Locutus Set"
  JobDefs = "DefaultJob"
  # Force it to be started ahead of others, so the schedule is kept"
  Priority = 9

  RunScript {
    RunsWhen = Before
    RunsOnClient  = No
    FailJobOnError = No
    Command = "/bin/sleep 60"
  }
}




------------------------------------------------------------------------------
Increase Visibility of Your 3D Game App & Earn a Chance To Win $500!
Tap into the largest installed PC base & get more eyes on your game by
optimizing for Intel(R) Graphics Technology. Get started today with the
Intel(R) Software Partner Program. Five $500 cash prizes are up for grabs.
http://p.sf.net/sfu/intelisp-dev2dev
_______________________________________________
Bacula-users mailing list
Bacula-users AT lists.sourceforge DOT net
https://lists.sourceforge.net/lists/listinfo/bacula-users
[More with this subject...]
<Prev in Thread] Current Thread [Next in Thread>
Previous by Date:  Re: [Bacula-users] bacula not compressing some filetypes, Gavin McCullagh
Next by Date:  Re: [Bacula-users] Job pre-allocating 20 volumes from a pool un-necessary, Kleber Leal
Previous by Thread:  [Bacula-users] bacula not compressing some filetypes, bopfi68
Next by Thread:  Re: [Bacula-users] Job pre-allocating 20 volumes from a pool un-necessary, Kleber Leal
Indexes:  [Date] [Thread] [Top] [All Lists]