Re: [Bacula-users] Recycling issue

Kern:

Thanks for the pointers. I absolutely understand why can’t provider support, and I appreciate any help you can give.

Unfortunately, I’m not sure the MediaType is my answer. I do have two auto-changers configured. (One’s for local backups, one if for off-site backups.) Each auto-changer has a unique Media Type.

I just tried Martin Simmons’ suggestion of adding “Autochanger = yes” to the bacula-dir.conf storage stanza. I will know on Friday night if that was indeed the answer, but it certainly looks promising. Assuming this is supposed to work, and I’m getting the same problem on two different installations, missing something like that certainly seems like a reasonable explanation.

I didn’t include the full config files in an effort to keep my original post from getting too long. My apologies. I’ve pulled some of the configuration out into separate files in an effort to keep my config files more manageable. I’m happy to provider more if it would be helpful. My bacula-sd.conf is as follows:

Storage {
  Name = mail.roundhouse.local-sd
  SDPort = 9103   # Director's port
  WorkingDirectory = "/var/bacula"
  Pid Directory = "/var/run"
  Maximum Concurrent Jobs = 20
  Client Connect Wait = 60 seconds
}

Director {
  Name = mail.roundhouse.local-dir
  Password = “password"
}

Director {
  Name = mail.roundhouse.local-mon
  Password = “password"
  Monitor = yes
}

# Define a Virtual autochanger
#
Autochanger {
  Name = ExternalDrives
  Device = ExternalDrives-Drive1
  Changer Command = "/usr/local/bin/vchanger -u root  %c %o %S %a %d"
  Changer Device = "/etc/bacula/vchanger1.conf"
}

Device {
  Name = ExternalDrives-Drive1
  DriveIndex = 0
  Autochanger = yes
  DeviceType = File
  Media Type = File
  Archive Device = /var/lib/bacula/removeable-drives/0/drive0
  Random Access = Yes;
  AutomaticMount = yes;
  RemovableMedia = no;
  AlwaysOpen = no;
  Maximum Concurrent Jobs = 5;
  Maximum Volume Size = 476250 M;  # with 8 volumes per drive, this should leave about
  # 4,800 MB free for other things, or about 0.125%
}

Autochanger {
  Name = LocalStorage
  Device = LocalDrives-Drive1, LocalDrives-Drive2
  Changer Command = "/usr/local/bin/vchanger -u root  %c %o %S %a %d"
  Changer Device = "/etc/bacula/vchanger2.conf"
}

Device {
  Name = LocalDrives-Drive1
  Device Type = File
  Media Type = Local
  Archive Device = /var/lib/bacula/LocalStorage/0/drive0
  Random Access = Yes;
  AutomaticMount = yes;
  RemovableMedia = no;
  AlwaysOpen = no;
  Maximum Volume Size = 237500 MB  # We limit the pool to 24 volumes in the director.conf and autochanger
  # config file.  We have a 6 TB drive system.
  DriveIndex = 0
  Autochanger = yes
}

Device {
  Name = LocalDrives-Drive2
  Device Type = File
  Media Type = Local
  Archive Device = /var/lib/bacula/LocalStorage/1/drive1
  Random Access = Yes;
  AutomaticMount = yes;     # when device opened, read it
  RemovableMedia = no;
  AlwaysOpen = no;
  Maximum Volume Size = 237500 MB  # We limit the pool to 24 volumes in the director.conf and autochanger
  # config file.  We have a 6 TB drive system.
  DriveIndex = 1
  Autochanger = yes
}

Messages {
  Name = Standard
  director = mail.roundhouse.local-dir = all
}

My bacula-dir.conf file:

Director { # define myself
Name = mail.roundhouse.local-dir
DIRport = 9101 # where we listen for UA connections
QueryFile = "/etc/bacula/query.sql"
WorkingDirectory = "/var/bacula"
PidDirectory = "/var/run"
Maximum Concurrent Jobs = 20
Password = “password" # Console password
Messages = Daemon
}

#########################################################################
#
# Job Defaults
#
#########################################################################

@|"sh -c 'for f in /etc/bacula/JobDef/*.defaults ; do echo @${f} ; done'"

#########################################################################
#
# Jobs
#
#########################################################################


Job {
  Name = "Server"
  Client = server
  Type = Backup
  Level = Full
  SpoolAttributes = yes
  Schedule = "WeeklyCycle"
  Cancel Lower Level Duplicates = yes
  Cancel Queued Duplicates = yes
  Rerun Failed Levels = yes
  Messages = Standard
  Priority = 10
  Write Bootstrap = "/var/bacula/%c.bsr"
  Pool = FullSet
  File Set = "Linux Server"
  Storage = removeable-drives
  Run Before Job = "/etc/bacula/mount-drive.sh"
}

# Include all the jobs listed in the "jobs" folder
@|"sh -c 'for f in /etc/bacula/jobs/*.job ; do echo @${f} ; done'"

# Backup the catalog database (after the nightly save)
Job {
Name = "BackupCatalog"
Pool = OnSite_A
Client = server
Type = Admin
#Level = Full
FileSet="Catalog"
Schedule = "WeeklyCycleAfterBackup"
# This creates an ASCII copy of the mysql databases and puts it on the first attached bacup drive.
RunBeforeJob = "/etc/bacula/mysql_backup.sh"
RunAfterJob = "/etc/bacula/unmount-drives.sh"
Write Bootstrap = "/var/bacula/%n.bsr"
Priority = 50 # run after main backup
Messages = Standard
Storage = removeable-drives
}

Job {
Name = "RestoreFiles"
Type = Restore
Client=server
FileSet="Linux Server"
Storage = removeable-drives
Pool = OnSite_A
Messages = Standard
Where = /tmp/bacula-restores
}

#########################################################################
#
# File Sets
#
#########################################################################

# This file set is for Mac OS X
# Name = "Mac Files"
@/etc/bacula/filesets/mac_files

#This file set will backup the server
# Name = "Linux Server Files"
@/etc/bacula/filesets/linux_server_files

# This file set is for Windows 7/Vista machines
# Name = "Windows 7 Files"
@/etc/bacula/filesets/windows_7_files

# This file set is for Windows XP. May it RIP.
# Name = "Windows XP Files"
@/etc/bacula/filesets/windows_xp_files

# This is the backup of the catalog
FileSet {
Name = "Catalog"
Include {
Options {
signature = MD5
compression = GZIP
}
File = /var/bacula/bacula.sql.gz
}
}

#########################################################################
#
# Schedules
#
#########################################################################

Schedule {
Name = "WeeklyCycle"
Run = Full Pool=FullSet 1st Fri at 18:00
Run = Differential Pool=Weekly 2nd-5th Fri at 18:00
Run = Incremental Pool=Weekly Mon-Thu at 18:00

}

Schedule {
Name = "Desktops"
Run = Incremental Mon-Fri at 18:00
}

# This schedule does the catalog. It starts after the WeeklyCycle
Schedule {
Name = "WeeklyCycleAfterBackup"
Run = Full Mon-Fri at 18:30
}

Schedule {
Name = "Daytime"
Run = Level=Incremental Mon-Fri at 12:00
}

Schedule {
Name = "Offsite Migration"
# Run this every weedkay. The job will check to see if a FullSet volume is availble
# before actually running.
# Run = Mon-Fri at 19:00

}

#########################################################################
#
# Clients to Backup
#
#########################################################################

# Client (File Services) to backup

# Client (File Services) to backup

Client {

  Name = server

  Address = mail

  FDPort = 9102

  Catalog = MyCatalog

Password = “password" # password for FileDaemon

  AutoPrune = yes                     # Prune expired Jobs/Files

}

# This will include all clients listed in the "clients" folder.
@|"sh -c 'for f in /etc/bacula/clients/*.conf ; do echo @${f} ; done'"

#########################################################################
#
# Storage
#
#########################################################################

# Definition of file Virtual Autochanger device

Storage {
Name = removeable-drives
Address = 10.11.1.2
SDPort = 9103
Password = "RoundHouseBackup"
Device = ExternalDrives
Media Type = File
Maximum Concurrent Jobs = 1
}

Storage {
Name = LocalStorage
Address = 10.11.1.2
SDPort = 9103
Password = "RoundHouseBackup"
Device = LocalStorage
Media Type = Local
Maximum Concurrent Jobs = 8
}

# Generic catalog service
Catalog {
Name = MyCatalog
dbname = "bacula"; dbuser = "bacula"; dbpassword = ""
}

# Reasonable message delivery -- send most everything to email address
# and to the console
Messages {
Name = Standard

mailcommand = "/sbin/bsmtp -h localhost -f \"$Bacula$ \<%r\>\" -s \"Bacula: %t %e of %c %l\" %r"
operatorcommand = "/sbin/bsmtp -h localhost -f \"$Bacula$ \<%r\>\" -s \"Bacula: Intervention needed for %j\" %r"
mail = root@localhost = all, !skipped
operator = root@localhost = mount
console = all, !skipped, !saved

append = "/var/log/bacula/bacula.log" = all, !skipped
catalog = all
}

#
# Message delivery for daemon messages (no job).
Messages {
Name = Daemon
mailcommand = "/sbin/bsmtp -h localhost -f \"$Bacula$ \<%r\>\" -s \"Bacula daemon message\" %r"
mail = root@localhost = all, !skipped
console = all, !skipped, !saved
append = "/var/log/bacula/bacula.log" = all, !skipped
}

Pool {
Name = FullSet
Pool Type = Backup
Recycle = yes
AutoPrune = yes
Volume Use Duration = 1 week
#We're on an 2 month rotation
VolumeRetention = 58 days
Maximum Volumes = 32 # 4 drives with 8 volumes on each
Storage = removeable-drives
}

Pool {
Name = Weekly
Pool Type = Backup
Recycle = yes
AutoPrune = yes
Volume Use Duration = 1 week
VolumeRetention = 3 weeks
Maximum Volumes = 40 # 5 drives with 8 volumes on each
Storage = removeable-drives
}

Pool {
Name = OnSite_A
Pool Type = Backup
Recycle = yes
AutoPrune = yes
Volume Retention = 6 weeks
Volume Use Duration = 1 week
Maximum Volumes = 24
Next Pool = OnSite_B
Storage = LocalStorage
}

Pool {
Name = OnSite_B
Pool Type = Backup
Recycle = yes
AutoPrune = yes
Volume Retention = 6 weeks
Volume Use Duration = 1 week
Maximum Volumes = 24
Next Pool = OnSite_A
Storage = LocalStorage
}

#
# Restricted console used by tray-monitor to get the status of the director
#
Console {
Name = mail.roundhouse.local-mon
Password = “password"
CommandACL = status, .status
}

Output from a failed job. Volumes “removeable_drives_0003_0001-8” are in the pool “Weeklly”, which is where this this job should be writing too. Volumes starting with “removeable_drives_0006” were on the previously connected drive that it had been successfully writing to.

04-Aug 18:00 mail.roundhouse.local-dir JobId 298: shell command: run BeforeJob "/etc/bacula/mount-drive.sh"
04-Aug 18:00 mail.roundhouse.local-dir JobId 298: BeforeJob: Connecting to Director mail:9101
04-Aug 18:00 mail.roundhouse.local-dir JobId 298: BeforeJob: 1000 OK: 1 mail.roundhouse.local-dir Version: 7.0.4 (04 June 2014)
04-Aug 18:00 mail.roundhouse.local-dir JobId 298: BeforeJob: Enter a period to cancel a command.
04-Aug 18:00 mail.roundhouse.local-dir JobId 298: BeforeJob: update slots removeable-drives
04-Aug 18:00 mail.roundhouse.local-dir JobId 298: BeforeJob: Automatically selected Catalog: MyCatalog
04-Aug 18:00 mail.roundhouse.local-dir JobId 298: BeforeJob: Using Catalog "MyCatalog"
04-Aug 18:00 mail.roundhouse.local-dir JobId 298: BeforeJob: Connecting to Storage daemon removeable-drives at 10.11.1.2:9103 ...
04-Aug 18:00 mail.roundhouse.local-dir JobId 298: BeforeJob: 3306 Issuing autochanger "slots" command.
04-Aug 18:00 mail.roundhouse.local-dir JobId 298: BeforeJob: Device "ExternalDrives" has 72 slots.
04-Aug 18:00 mail.roundhouse.local-dir JobId 298: BeforeJob: Connecting to Storage daemon removeable-drives at 10.11.1.2:9103 ...
04-Aug 18:00 mail.roundhouse.local-dir JobId 298: BeforeJob: 3306 Issuing autochanger "list" command.
04-Aug 18:00 mail.roundhouse.local-dir JobId 298: BeforeJob: Catalog record for Volume "removeable-drives_0001_0001" is up to date.
04-Aug 18:00 mail.roundhouse.local-dir JobId 298: BeforeJob: Catalog record for Volume "removeable-drives_0001_0002" is up to date.
04-Aug 18:00 mail.roundhouse.local-dir JobId 298: BeforeJob: Catalog record for Volume "removeable-drives_0001_0003" is up to date.
04-Aug 18:00 mail.roundhouse.local-dir JobId 298: BeforeJob: Catalog record for Volume "removeable-drives_0001_0004" is up to date.
04-Aug 18:00 mail.roundhouse.local-dir JobId 298: BeforeJob: Catalog record for Volume "removeable-drives_0001_0005" is up to date.
04-Aug 18:00 mail.roundhouse.local-dir JobId 298: BeforeJob: Catalog record for Volume "removeable-drives_0001_0006" is up to date.
04-Aug 18:00 mail.roundhouse.local-dir JobId 298: BeforeJob: Catalog record for Volume "removeable-drives_0001_0007" is up to date.
04-Aug 18:00 mail.roundhouse.local-dir JobId 298: BeforeJob: Catalog record for Volume "removeable-drives_0001_0008" is up to date.
04-Aug 18:00 mail.roundhouse.local-dir JobId 298: BeforeJob: Catalog record for Volume "removeable-drives_0002_0001" is up to date.
04-Aug 18:00 mail.roundhouse.local-dir JobId 298: BeforeJob: Catalog record for Volume "removeable-drives_0002_0002" is up to date.
04-Aug 18:00 mail.roundhouse.local-dir JobId 298: BeforeJob: Catalog record for Volume "removeable-drives_0002_0003" is up to date.
04-Aug 18:00 mail.roundhouse.local-dir JobId 298: BeforeJob: Catalog record for Volume "removeable-drives_0002_0004" is up to date.
04-Aug 18:00 mail.roundhouse.local-dir JobId 298: BeforeJob: Catalog record for Volume "removeable-drives_0002_0005" is up to date.
04-Aug 18:00 mail.roundhouse.local-dir JobId 298: BeforeJob: Catalog record for Volume "removeable-drives_0002_0006" is up to date.
04-Aug 18:00 mail.roundhouse.local-dir JobId 298: BeforeJob: Catalog record for Volume "removeable-drives_0002_0007" is up to date.
04-Aug 18:00 mail.roundhouse.local-dir JobId 298: BeforeJob: Catalog record for Volume "removeable-drives_0002_0008" is up to date.
04-Aug 18:00 mail.roundhouse.local-dir JobId 298: BeforeJob: Catalog record for Volume "removeable-drives_0003_0001" is up to date.
04-Aug 18:00 mail.roundhouse.local-dir JobId 298: BeforeJob: Catalog record for Volume "removeable-drives_0003_0002" is up to date.
04-Aug 18:00 mail.roundhouse.local-dir JobId 298: BeforeJob: Catalog record for Volume "removeable-drives_0003_0003" is up to date.
04-Aug 18:00 mail.roundhouse.local-dir JobId 298: BeforeJob: Catalog record for Volume "removeable-drives_0003_0004" is up to date.
04-Aug 18:00 mail.roundhouse.local-dir JobId 298: BeforeJob: Catalog record for Volume "removeable-drives_0003_0005" is up to date.
04-Aug 18:00 mail.roundhouse.local-dir JobId 298: BeforeJob: Catalog record for Volume "removeable-drives_0003_0006" is up to date.
04-Aug 18:00 mail.roundhouse.local-dir JobId 298: BeforeJob: Catalog record for Volume "removeable-drives_0003_0007" is up to date.
04-Aug 18:00 mail.roundhouse.local-dir JobId 298: BeforeJob: Catalog record for Volume "removeable-drives_0003_0008" is up to date.
04-Aug 18:00 mail.roundhouse.local-dir JobId 298: BeforeJob: You have messages.
04-Aug 18:00 mail.roundhouse.local-dir JobId 298: BeforeJob: quit
04-Aug 18:00 mail.roundhouse.local-dir JobId 298: Start Backup JobId 298, Job=Server.2014-08-04_18.00.00_33
04-Aug 18:00 mail.roundhouse.local-dir JobId 298: Using Device "ExternalDrives-Drive1" to write.
04-Aug 18:00 mail.roundhouse.local-sd JobId 298: No slot defined in catalog (slot=0) for Volume "removeable-drives_0009_0008" on "ExternalDrives-Drive1" (/var/lib/bacula/removeable-drives/0/drive0).
04-Aug 18:00 mail.roundhouse.local-sd JobId 298: Cartridge change or "update slots" may be required.
04-Aug 18:00 mail.roundhouse.local-sd JobId 298: Warning: Volume "removeable-drives_0009_0008" not on file device "ExternalDrives-Drive1" (/var/lib/bacula/removeable-drives/0/drive0).
04-Aug 18:00 mail.roundhouse.local-sd JobId 298: Marking Volume "removeable-drives_0009_0008" in Error in Catalog.
04-Aug 18:00 mail.roundhouse.local-sd JobId 298: 3307 Issuing autochanger "unload slot 9, drive 0" command.
04-Aug 18:00 mail.roundhouse.local-sd JobId 298: No slot defined in catalog (slot=0) for Volume "removeable-drives_0006_0001" on "ExternalDrives-Drive1" (/var/lib/bacula/removeable-drives/0/drive0).
04-Aug 18:00 mail.roundhouse.local-sd JobId 298: Cartridge change or "update slots" may be required.
04-Aug 18:00 mail.roundhouse.local-sd JobId 298: Warning: Volume "removeable-drives_0006_0001" not on file device "ExternalDrives-Drive1" (/var/lib/bacula/removeable-drives/0/drive0).
04-Aug 18:00 mail.roundhouse.local-sd JobId 298: Marking Volume "removeable-drives_0006_0001" in Error in Catalog.
04-Aug 18:00 mail.roundhouse.local-sd JobId 298: Warning: Volume "removeable-drives_0006_0001" not on file device "ExternalDrives-Drive1" (/var/lib/bacula/removeable-drives/0/drive0).
04-Aug 18:00 mail.roundhouse.local-sd JobId 298: Marking Volume "removeable-drives_0006_0001" in Error in Catalog.
04-Aug 18:00 mail.roundhouse.local-sd JobId 298: Warning: mount.c:212 Open of file device "ExternalDrives-Drive1" (/var/lib/bacula/removeable-drives/0/drive0) Volume "removeable-drives_0006_0001" failed: ERR=file_dev.c:172 Could not open(/var/lib/bacula/removeable-drives/0/drive0,OPEN_READ_WRITE,0640): ERR=No such file or directory

04-Aug 18:00 mail.roundhouse.local-sd JobId 298: No slot defined in catalog (slot=0) for Volume "removeable-drives_0006_0002" on "ExternalDrives-Drive1" (/var/lib/bacula/removeable-drives/0/drive0).
04-Aug 18:00 mail.roundhouse.local-sd JobId 298: Cartridge change or "update slots" may be required.
04-Aug 18:00 mail.roundhouse.local-sd JobId 298: Warning: Volume "removeable-drives_0006_0002" not on file device "ExternalDrives-Drive1" (/var/lib/bacula/removeable-drives/0/drive0).
04-Aug 18:00 mail.roundhouse.local-sd JobId 298: Marking Volume "removeable-drives_0006_0002" in Error in Catalog.
04-Aug 18:00 mail.roundhouse.local-sd JobId 298: Warning: Volume "removeable-drives_0006_0002" not on file device "ExternalDrives-Drive1" (/var/lib/bacula/removeable-drives/0/drive0).
04-Aug 18:00 mail.roundhouse.local-sd JobId 298: Marking Volume "removeable-drives_0006_0002" in Error in Catalog.
04-Aug 18:00 mail.roundhouse.local-sd JobId 298: Warning: mount.c:212 Open of file device "ExternalDrives-Drive1" (/var/lib/bacula/removeable-drives/0/drive0) Volume "removeable-drives_0006_0002" failed: ERR=file_dev.c:172 Could not open(/var/lib/bacula/removeable-drives/0/drive0,OPEN_READ_WRITE,0640): ERR=No such file or directory

04-Aug 18:00 mail.roundhouse.local-sd JobId 298: No slot defined in catalog (slot=0) for Volume "removeable-drives_0006_0003" on "ExternalDrives-Drive1" (/var/lib/bacula/removeable-drives/0/drive0).
04-Aug 18:00 mail.roundhouse.local-sd JobId 298: Cartridge change or "update slots" may be required.
04-Aug 18:00 mail.roundhouse.local-sd JobId 298: Warning: Volume "removeable-drives_0006_0003" not on file device "ExternalDrives-Drive1" (/var/lib/bacula/removeable-drives/0/drive0).
04-Aug 18:00 mail.roundhouse.local-sd JobId 298: Marking Volume "removeable-drives_0006_0003" in Error in Catalog.
04-Aug 18:00 mail.roundhouse.local-sd JobId 298: Warning: Volume "removeable-drives_0006_0003" not on file device "ExternalDrives-Drive1" (/var/lib/bacula/removeable-drives/0/drive0).
04-Aug 18:00 mail.roundhouse.local-sd JobId 298: Marking Volume "removeable-drives_0006_0003" in Error in Catalog.
04-Aug 18:00 mail.roundhouse.local-sd JobId 298: Warning: mount.c:212 Open of file device "ExternalDrives-Drive1" (/var/lib/bacula/removeable-drives/0/drive0) Volume "removeable-drives_0006_0003" failed: ERR=file_dev.c:172 Could not open(/var/lib/bacula/removeable-drives/0/drive0,OPEN_READ_WRITE,0640): ERR=No such file or directory

04-Aug 18:00 mail.roundhouse.local-sd JobId 298: No slot defined in catalog (slot=0) for Volume "removeable-drives_0006_0004" on "ExternalDrives-Drive1" (/var/lib/bacula/removeable-drives/0/drive0).
04-Aug 18:00 mail.roundhouse.local-sd JobId 298: Cartridge change or "update slots" may be required.
04-Aug 18:00 mail.roundhouse.local-sd JobId 298: Warning: Volume "removeable-drives_0006_0004" not on file device "ExternalDrives-Drive1" (/var/lib/bacula/removeable-drives/0/drive0).
04-Aug 18:00 mail.roundhouse.local-sd JobId 298: Marking Volume "removeable-drives_0006_0004" in Error in Catalog.
04-Aug 18:00 mail.roundhouse.local-sd JobId 298: Warning: Volume "removeable-drives_0006_0004" not on file device "ExternalDrives-Drive1" (/var/lib/bacula/removeable-drives/0/drive0).
04-Aug 18:00 mail.roundhouse.local-sd JobId 298: Marking Volume "removeable-drives_0006_0004" in Error in Catalog.
04-Aug 18:00 mail.roundhouse.local-sd JobId 298: Warning: mount.c:212 Open of file device "ExternalDrives-Drive1" (/var/lib/bacula/removeable-drives/0/drive0) Volume "removeable-drives_0006_0004" failed: ERR=file_dev.c:172 Could not open(/var/lib/bacula/removeable-drives/0/drive0,OPEN_READ_WRITE,0640): ERR=No such file or directory

04-Aug 18:00 mail.roundhouse.local-sd JobId 298: Please mount append Volume "removeable-drives_0006_0004" or label a new one for:
   Job:          Server.2014-08-04_18.00.00_33
   Storage:      "ExternalDrives-Drive1" (/var/lib/bacula/removeable-drives/0/drive0)
   Pool:         Weekly
   Media type:   File
04-Aug 18:05 mail.roundhouse.local-sd JobId 298: Warning: mount.c:212 Open of file device "ExternalDrives-Drive1" (/var/lib/bacula/removeable-drives/0/drive0) Volume "removeable-drives_0006_0005" failed: ERR=file_dev.c:172 Could not open(/var/lib/bacula/removeable-drives/0/drive0,OPEN_READ_WRITE,0640): ERR=No such file or directory

04-Aug 18:10 mail.roundhouse.local-sd JobId 298: Warning: mount.c:212 Open of file device "ExternalDrives-Drive1" (/var/lib/bacula/removeable-drives/0/drive0) Volume "removeable-drives_0006_0005" failed: ERR=file_dev.c:172 Could not open(/var/lib/bacula/removeable-drives/0/drive0,OPEN_READ_WRITE,0640): ERR=No such file or directory

04-Aug 18:15 mail.roundhouse.local-sd JobId 298: Warning: mount.c:212 Open of file device "ExternalDrives-Drive1" (/var/lib/bacula/removeable-drives/0/drive0) Volume "removeable-drives_0006_0005" failed: ERR=file_dev.c:172 Could not open(/var/lib/bacula/removeable-drives/0/drive0,OPEN_READ_WRITE,0640): ERR=No such file or directory

04-Aug 18:20 mail.roundhouse.local-sd JobId 298: Warning: mount.c:212 Open of file device "ExternalDrives-Drive1" (/var/lib/bacula/removeable-drives/0/drive0) Volume "removeable-drives_0006_0005" failed: ERR=file_dev.c:172 Could not open(/var/lib/bacula/removeable-drives/0/drive0,OPEN_READ_WRITE,0640): ERR=No such file or directory

04-Aug 23:51 mail.roundhouse.local-sd JobId 298: Cartridge change or "update slots" may be required.
04-Aug 23:51 mail.roundhouse.local-sd JobId 298: Warning: Volume "removeable-drives_0006_0005" not on file device "ExternalDrives-Drive1" (/var/lib/bacula/removeable-drives/0/drive0).
04-Aug 23:51 mail.roundhouse.local-sd JobId 298: Marking Volume "removeable-drives_0006_0005" in Error in Catalog.
04-Aug 23:51 mail.roundhouse.local-sd JobId 298: Warning: Volume "removeable-drives_0006_0005" not on file device "ExternalDrives-Drive1" (/var/lib/bacula/removeable-drives/0/drive0).
04-Aug 23:51 mail.roundhouse.local-sd JobId 298: Marking Volume "removeable-drives_0006_0005" in Error in Catalog.
04-Aug 23:51 mail.roundhouse.local-sd JobId 298: Warning: mount.c:212 Open of file device "ExternalDrives-Drive1" (/var/lib/bacula/removeable-drives/0/drive0) Volume "removeable-drives_0006_0005" failed: ERR=file_dev.c:172 Could not open(/var/lib/bacula/removeable-drives/0/drive0,OPEN_READ_WRITE,0640): ERR=No such file or directory

04-Aug 23:51 mail.roundhouse.local-sd JobId 298: Please mount append Volume "removeable-drives_0006_0005" or label a new one for:
   Job:          Server.2014-08-04_18.00.00_33
   Storage:      "ExternalDrives-Drive1" (/var/lib/bacula/removeable-drives/0/drive0)
   Pool:         Weekly
   Media type:   File
04-Aug 23:56 mail.roundhouse.local-sd JobId 298: Warning: mount.c:212 Open of file device "ExternalDrives-Drive1" (/var/lib/bacula/removeable-drives/0/drive0) Volume "removeable-drives_0006_0006" failed: ERR=file_dev.c:172 Could not open(/var/lib/bacula/removeable-drives/0/drive0,OPEN_READ_WRITE,0640): ERR=No such file or directory

05-Aug 00:01 mail.roundhouse.local-sd JobId 298: Warning: mount.c:212 Open of file device "ExternalDrives-Drive1" (/var/lib/bacula/removeable-drives/0/drive0) Volume "removeable-drives_0006_0006" failed: ERR=file_dev.c:172 Could not open(/var/lib/bacula/removeable-drives/0/drive0,OPEN_READ_WRITE,0640): ERR=No such file or directory

05-Aug 00:05 mail.roundhouse.local-sd JobId 298: Fatal error: Job 298 canceled.
05-Aug 00:05 mail.roundhouse.local-dir JobId 298: Bacula mail.roundhouse.local-dir 7.0.4 (04Jun14):
Build OS:               x86_64-unknown-linux-gnu ubuntu 14.04
JobId:                  298
Job:                    Server.2014-08-04_18.00.00_33
Backup Level:           Incremental, since=2014-08-01 23:18:37
Client:                 "server" 7.0.4 (04Jun14) x86_64-unknown-linux-gnu,ubuntu,14.04
FileSet:                "Linux Server" 2014-07-10 13:39:56
Pool:                   "Weekly" (From Run Pool override)
Catalog:                "MyCatalog" (From Client resource)
Storage:                "removeable-drives" (From Pool resource)
Scheduled time:         04-Aug-2014 18:00:00
Start time:             04-Aug-2014 18:00:41
End time:               05-Aug-2014 00:05:51
Elapsed time:           6 hours 5 mins 10 secs
Priority:               10
FD Files Written:       0
SD Files Written:       0
FD Bytes Written:       0 (0 B)
SD Bytes Written:       0 (0 B)
Rate:                   0.0 KB/s
Software Compression:   None
VSS:                    no
Encryption:             no
Accurate:               no
Volume name(s):
Volume Session Id:      110
Volume Session Time:    1406833087
Last Volume Bytes:      241 (241 B)
Non-fatal FD errors:    0
SD Errors:              1
FD termination status: Canceled
SD termination status: Canceled
Termination:            Backup Canceled

On Aug 6, 2014, at 1:41 AM, Kern Sibbald <kern AT sibbald DOT com> wrote:

Hello,

Probably 95% of all such problems are due to configurations where the MediaType is not properly set.

- If you are using any form of autochanger, each autochanger must have a *unique* MediaType.

- Each Device configuration in the SD must have a unique MediaType for each different ArchiveDevice definition. Said the other way around, each ArchiveDevice definition must have its own unique MediaType.

The .conf files you list are incomplete, so it is not possible to analyze them, but when I see: MediaType = File, that raises a red flag that indicates that there may be other Storage devices with the same MediaType, and if that is the case, sooner or later, you will find that Bacula is very confused.

In the next Bacula version, I will probably modify the SD and possibly the Dir to require unique MediaTypes, then this problem will be resolved.

I don't usually supply "support" because I don't have the time, but this particular problem interests me from the standpoint that I would like to prevent it, but with no console/job output showing the failures and incomplete DIR and SD confs I cannot do any more.

Best regards,
Kern

On 08/05/2014 03:08 PM, Joe Rhodes wrote:
I’m also running into this issue.

In my case, I’ve setup a disk-based auto-changer (vchanger) with two pools: Full and Weekly. Each pool has multiple drives with 8 volumes on each drive. The script that mounts the disk also issues an “update slots” command in bconsole, and I can verify that bacula sees the correct volumes as “InChanger”.

When I swap out disks (weekly), Bacula continues to look for volumes that were append-able, but on the previous disk (and not currently marked as “InChanger”) and refuses to write to the append-able volumes on the new disk that are marked as “InChanger”. It marks all the previous volumes it cannot access as “Error”, and only then will it begin writing to the currently loaded volumes.

This line from the “Recycling Algorithm” led me to believe that it would use a volume that was InChanger first: "If the request is for an Autochanger device, look only for Volumes in the Autochanger (i.e. with InChanger set and that have the correct Storage device).”

But it seems I’m missing something. I’ve included relevant bits from my bacula-dir.conf file if anyone can see what I’m doing wrong. I’m getting this on two systems, one running Bacula 5.2.12 and one running 7.0.4.

My other option is to split these all into separate pools, but that’s going to make scheduling much harder.

Thanks in advance!

-Joe Rhodes

# Definition of file Virtual Autochanger device

Storage {
  Name = removeable-drives
  Address = 10.11.1.2
  SDPort = 9103
  Password = “password"
  Device = ExternalDrives
  Media Type = File
  Maximum Concurrent Jobs = 1
}

# Pools

Pool {
  Name = FullSet
  Pool Type = Backup
  Recycle = yes
  AutoPrune = yes
  Volume Use Duration = 1 week
  #We're on an 2 month rotation
  VolumeRetention = 58 days
  Maximum Volumes = 32  # 4 drives with 8 volumes on each
  Storage = removeable-drives
}

Pool {
  Name = Weekly
  Pool Type = Backup
  Recycle = yes
  AutoPrune = yes
  Volume Use Duration = 1 week
  VolumeRetention =  3 weeks
  Maximum Volumes = 40  # 5 drives with 8 volumes on each
  Storage = removeable-drives
}

And my bacula-sd.conf:

# Define a Virtual autochanger

Autochanger {
  Name = ExternalDrives
  Device = ExternalDrives-Drive1
  Changer Command = "/usr/local/bin/vchanger -u root  %c %o %S %a %d"
  Changer Device = "/etc/bacula/vchanger1.conf"
}

Device {
  Name = ExternalDrives-Drive1
  DriveIndex = 0
  Autochanger = yes
  DeviceType = File
  Media Type = File
  Archive Device = /var/lib/bacula/removeable-drives/0/drive0
  Random Access = Yes;
  AutomaticMount = yes;
  RemovableMedia = no;
  AlwaysOpen = no;
  Maximum Concurrent Jobs = 5;
  Maximum Volume Size = 476250 M;  # with 8 volumes per drive, this should leave about
  # 4,800 MB free for other things, or about 0.125%
}

From: Gael Guilmin <Gael.Guilmin AT PDGM DOT com>
Subject: [Bacula-users] Recycling issue
To: "bacula-users AT lists.sourceforge DOT net"
<bacula-users AT lists.sourceforge DOT net>
Message-ID:
<05520d1d14f2408f8d048f1e1dfe6268 AT BLUPR07MB836.namprd07.prod.outlook DOT com>

Content-Type: text/plain; charset="us-ascii"

Hello,
I'm facing an issue with Bacula (5.2.12) on a Ubuntu server (12.04.4 LTS): I don't know why, but the server, after finishing writing on a tape, tries to use a tape that is not in the autochanger, despite the fact that there are plenty of online and usable tape in the Scratch pool...

Any idea?

Best regards,
Gael
--
System Administrator / IT
[PDM_Logo_RGB - registered]
78, Avenue du XXeme Corps
54000 Nancy
France
Phone(Paris): +33 (0)1 49 49 05 25
Phone(Nancy): +33 (0)3 83 67 66 39
Cell: +33 (0)6 10 18 48 43
Web: www.pdgm.com<http://www.pdgm.com/>
------------------------------------------------------------------------------
Infragistics Professional
Build stunning WinForms apps today!
Reboot your WinForms applications with our WinForms controls. 
Build a bridge from your legacy apps to the future.
http://pubads.g.doubleclick.net/gampad/clk?id=153845071&iu=/4140/ostg.clktrk
_______________________________________________
Bacula-users mailing list
Bacula-users AT lists.sourceforge DOT net
https://lists.sourceforge.net/lists/listinfo/bacula-users

------------------------------------------------------------------------------
Infragistics Professional
Build stunning WinForms apps today!
Reboot your WinForms applications with our WinForms controls. 
Build a bridge from your legacy apps to the future.
http://pubads.g.doubleclick.net/gampad/clk?id=153845071&iu=/4140/ostg.clktrk

_______________________________________________
Bacula-users mailing list
Bacula-users AT lists.sourceforge DOT net
https://lists.sourceforge.net/lists/listinfo/bacula-users