Bacula-users

[Bacula-users] list jobs is showing zero files for all tape copy jobs

2010-08-16 18:56:22
Subject: [Bacula-users] list jobs is showing zero files for all tape copy jobs
From: Dermot Beirne <dermot.beirne AT dpd DOT ie>
To: bacula-users AT lists.sourceforge DOT net
Date: Mon, 16 Aug 2010 23:28:20 +0100
Hi,
I need to restore an important file, and am having trouble.
The file restore is from last March.

I'm using bacula 3.0.2 on ubuntu 9.04.

I usually do as follows: restore -> opt 2 -> enter filename
Then once i have the jobid, use restore option 3 and browse to the
file and restore it.

It hasn't failed me yet, but all restores have been very recent file deletions.
This time, I have no record of the file when using option 2.  The user
is absolutely certain about the file name.  I try doing a list jobs,
and hope to pick out the backup jobid manually for that client around
the date, and then use that with option 3, but I see that all the jobs
that were copied to tape are showing zero files.

It reports no sign of my file, and that several of the job ids can't
be found in the catalog.  I'm choosing monthly disk to tape copy jobs,
which have a retention of 1 year.  Yet they all have zero files, and
the job id's are not showing in the catalog.

I could do with some verification of the backup configuration, as not
finding this file will be serious for me.

Some details:

1. extract of list jobs output:

+-------+------------------------+---------------------+------+-------+-----------+-----------------+-----------+

| JobId | Name | StartTime | Type | Level | JobFiles | JobBytes | JobStatus |

+-------+------------------------+---------------------+------+-------+-----------+-----------------+-----------+

| 3,260 | Monthly-Disk-Tape-Copy | 2010-03-07 06:46:54 | c    | F
|         0 |               0 | T         |
| 3,261 | Yearly-Disk-Tape-Copy  | 2010-03-07 06:46:54 | c    | F
|         0 |               0 | T         |
| 3,304 | Interlink-pdc          | 2010-03-07 23:05:00 | B    | F
| 1,398,566 | 181,042,642,706 | T         |
| 3,306 | ho-mail-7201-fd        | 2010-03-07 23:05:00 | B    | F
|   606,449 | 203,427,450,551 | T         |
| 3,308 | Livetest               | 2010-03-07 23:05:00 | B    | F
| 8,285,880 | 460,742,413,284 | T         |
| 3,274 | dcsql2-fd              | 2010-03-07 23:05:08 | B    | F
|    18,983 | 183,632,024,714 | T         |
| 3,310 | docserver_main-fd      | 2010-03-07 23:05:08 | B    | F
| 8,775,892 | 257,820,257,779 | T         |
| 3,336 | docserver_main-fd      | 2010-03-07 23:05:08 | C    | F
| 8,775,892 | 257,820,257,779 | T         |
| 3,276 | crystal-server-fd      | 2010-03-08 01:34:23 | B    | F
|   473,088 |   3,949,011,017 | T         |
| 3,277 | BackupClient1          | 2010-03-08 02:17:59 | B    | F
|        56 |      20,318,455 | T         |
| 3,311 | BackupCatalog          | 2010-03-08 09:18:22 | B    | F
|         1 |   6,557,618,866 | T         |
| 3,337 | BackupCatalog          | 2010-03-08 09:18:22 | C    | F
|         1 |   6,557,618,866 | T         |
| 3,270 | Daily-Disk-Tape-Copy   | 2010-03-08 09:21:24 | c    | F
|         0 |               0 | T         |
| 3,271 | Weekly-Disk-Tape-Copy  | 2010-03-08 09:21:24 | c    | F
|         0 |               0 | T         |
| 3,273 | Monthly-Disk-Tape-Copy | 2010-03-08 09:22:42 | c    | F
|         0 |               0 | T         |
| 3,275 | Monthly-Disk-Tape-Copy | 2010-03-08 12:18:15 | c    | F
|         0 |               0 | T         |
| 3,272 | Monthly-Disk-Tape-Copy | 2010-03-08 12:41:23 | c    | F
|         0 |               0 | T         |
| 3,278 | Yearly-Disk-Tape-Copy  | 2010-03-08 12:41:35 | c    | F
|         0 |               0 | T         |
| 3,285 | BackupClient1          | 2010-03-08 22:34:42 | B    | I
|         0 |               0 | T         |
| 3,288 | Daily-Disk-Tape-Copy   | 2010-03-09 03:02:51 | c    | F
|         0 |               0 | T         |
| 3,290 | Daily-Disk-Tape-Copy   | 2010-03-09 04:01:49 | c    | F
|         0 |               0 | T         |
| 3,292 | Daily-Disk-Tape-Copy   | 2010-03-09 04:14:27 | c    | F
|         0 |               0 | T         |
| 3,294 | Daily-Disk-Tape-Copy   | 2010-03-09 05:12:15 | c    | F
|         0 |               0 | T         |
| 3,296 | Daily-Disk-Tape-Copy   | 2010-03-09 05:34:29 | c    | F
|         0 |               0 | T         |
| 3,298 | Daily-Disk-Tape-Copy   | 2010-03-09 05:37:04 | c    | F
|         0 |               0 | T         |
| 3,287 | Daily-Disk-Tape-Copy   | 2010-03-09 05:43:39 | c    | F
|         0 |               0 | T         |
| 3,301 | Weekly-Disk-Tape-Copy  | 2010-03-09 05:47:58 | c    | F
|         0 |               0 | T         |
| 3,303 | Monthly-Disk-Tape-Copy | 2010-03-09 05:50:09 | c    | F
|         0 |               0 | T         |
| 3,305 | Monthly-Disk-Tape-Copy | 2010-03-09 11:58:29 | c    | F
|         0 |               0 | T         |
| 3,307 | Monthly-Disk-Tape-Copy | 2010-03-09 17:09:13 | c    | F
|         0 |               0 | T         |
| 3,318 | crystal-server-fd      | 2010-03-10 01:14:30 | B    | I
|         0 |               0 | E         |
| 3,319 | BackupClient1          | 2010-03-10 01:17:33 | B    | I
|         0 |               0 | T         |
| 3,309 | Monthly-Disk-Tape-Copy | 2010-03-10 02:27:01 | c    | F
|         0 |               0 | T         |
| 3,302 | Monthly-Disk-Tape-Copy | 2010-03-10 09:47:36 | c    | F
|         0 |               0 | T         |
| 3,312 | Yearly-Disk-Tape-Copy  | 2010-03-10 09:51:50 | c    | F
|         0 |               0 | T         |


All the Disk-Tape-Copy (Daily, Weekly, Monthly, Yearly) jobs have no files.

You can see above jobid 3309 has zero files, however, here is the job
report for that job back in March:

09-Mar 03:00 ho-bksrv-11139-dir JobId 3309: The following 1 JobId was
chosen to be copied: 3266
09-Mar 03:00 ho-bksrv-11139-dir JobId 3309: Copying using JobId=3266
Job=docserver_main-fd.2010-03-07_23.05.00_05
09-Mar 03:00 ho-bksrv-11139-dir JobId 3309: Bootstrap records written
to /usr/local/bacula/bin/working/ho-bksrv-11139-dir.restore.77.bsr
10-Mar 02:27 ho-bksrv-11139-dir JobId 3309: Start Copying JobId 3309,
Job=Monthly-Disk-Tape-Copy.2010-03-09_03.00.02_48
10-Mar 02:27 ho-bksrv-11139-dir JobId 3309: Using Device "LTO-4"
10-Mar 02:27 ho-bksrv-11139-sd JobId 3309: Ready to read from volume
"Monthly-Disk-Vol-0775" on device "Monthly" (/disk-backup/Monthly).
10-Mar 02:27 ho-bksrv-11139-sd JobId 3309: Forward spacing Volume
"Monthly-Disk-Vol-0775" to file:block 0:237.
10-Mar 02:28 ho-bksrv-11139-sd JobId 3309: End of Volume at file 1 on
device "Monthly" (/disk-backup/Monthly), Volume
"Monthly-Disk-Vol-0775"
10-Mar 02:28 ho-bksrv-11139-sd JobId 3309: Ready to read from volume
"Monthly-Disk-Vol-0776" on device "Monthly" (/disk-backup/Monthly).
10-Mar 02:28 ho-bksrv-11139-sd JobId 3309: Forward spacing Volume
"Monthly-Disk-Vol-0776" to file:block 0:6709485.
10-Mar 02:29 ho-bksrv-11139-sd JobId 3309: End of Volume at file 1 on
device "Monthly" (/disk-backup/Monthly), Volume
"Monthly-Disk-Vol-0776"
10-Mar 02:29 ho-bksrv-11139-sd JobId 3309: Ready to read from volume
"Monthly-Disk-Vol-0777" on device "Monthly" (/disk-backup/Monthly).
10-Mar 02:29 ho-bksrv-11139-sd JobId 3309: Forward spacing Volume
"Monthly-Disk-Vol-0777" to file:block 0:1354989.
<snip..to save space.>
10-Mar 09:19 ho-bksrv-11139-sd JobId 3309: Ready to read from volume
"Monthly-Disk-Vol-0810" on device "Monthly" (/disk-backup/Monthly).
10-Mar 09:19 ho-bksrv-11139-sd JobId 3309: Forward spacing Volume
"Monthly-Disk-Vol-0810" to file:block 0:237.
10-Mar 09:21 ho-bksrv-11139-sd JobId 3309: End of Volume at file 0 on
device "Monthly" (/disk-backup/Monthly), Volume
"Monthly-Disk-Vol-0810"
10-Mar 09:21 ho-bksrv-11139-sd JobId 3309: End of all volumes.
10-Mar 09:47 ho-bksrv-11139-dir JobId 3309: Bacula ho-bksrv-11139-dir
3.0.2 (18Jul09): 10-Mar-2010 09:47:33
 Build OS:               i686-pc-linux-gnu ubuntu 9.04
 Prev Backup JobId:      3266
 Prev Backup Job:        docserver_main-fd.2010-03-07_23.05.00_05
 New Backup JobId:       3310
 Current JobId:          3309
 Current Job:            Monthly-Disk-Tape-Copy.2010-03-09_03.00.02_48
 Backup Level:           Full
 Client:                 interlink-pdc-fd
 FileSet:                "interlink-pdc Fileset" 2009-09-17 18:04:55
 Read Pool:              "Monthly-Disk-Pool" (From Job resource)
 Read Storage:           "MonthlyStorage" (From Pool resource)
 Write Pool:             "Monthly-Tape-Pool" (From Job Pool's NextPool resource)
 Write Storage:          "Tape" (From Storage from Pool's NextPool resource)
 Catalog:                "MyCatalog" (From Client resource)
 Start time:             10-Mar-2010 02:27:01
 End time:               10-Mar-2010 09:47:33
 Elapsed time:           7 hours 20 mins 32 secs
 Priority:               20
 SD Files Written:       8,775,892
 SD Bytes Written:       257,820,257,779 (257.8 GB)
 Rate:                   9754.1 KB/s
 Volume name(s):         000012L4
 Volume Session Id:      362
 Volume Session Time:    1265910152
 Last Volume Bytes:      923,245,166,592 (923.2 GB)
 SD Errors:              0
 SD termination status:  OK
 Termination:            Copying OK

10-Mar 09:47 ho-bksrv-11139-dir JobId 3309: Begin pruning Jobs.
10-Mar 09:47 ho-bksrv-11139-dir JobId 3309: No Jobs found to prune.
10-Mar 09:47 ho-bksrv-11139-dir JobId 3309: Begin pruning Files.
10-Mar 09:47 ho-bksrv-11139-dir JobId 3309: Pruned Files from 1 Jobs
for client interlink-pdc-fd from catalog.
10-Mar 09:47 ho-bksrv-11139-dir JobId 3309: End auto prune.

You can see here that it successfully copied this backup from disk to
tape. If i try and restore the file i need, i get as follows:

*restore

Automatically selected Catalog: MyCatalog
Using Catalog "MyCatalog"
First you select one or more JobIds that contain files
to be restored. You will be presented several methods
of specifying the JobIds. Then you will be allowed to
select which files from those JobIds are to be restored.

To select the JobIds, you have the following choices:

     1: List last 20 Jobs run
     2: List Jobs where a given File is saved
     3: Enter list of comma separated JobIds to select
     4: Enter SQL list command
     5: Select the most recent backup for a client
     6: Select backup for a client before a specified time
     7: Enter a list of files to restore
     8: Enter a list of files to restore before a specified time
     9: Find the JobIds of the most recent backup for a client
    10: Find the JobIds for a backup for a client before a specified time
    11: Enter a list of directories to restore for found JobIds
    12: Select full restore to a specified JobId
    13: Cancel

Select item:  (1-13): 3

Enter JobId(s), comma separated, to restore: 3309
You have selected the following JobId: 3309

Building directory tree for JobId(s) 3309 ...

For one or more of the JobIds selected, no files were found,
so file selection is not possible.
Most likely your retention policy pruned the files.

Do you want to restore all the files? (yes|no):

The copy job was copying from the Daily-Disk-Pool job 3266, to
Daily-Tape-Pool job 3309.
The Tape pools are configured as follows:

## Tape Pool Definitions
# Daily Tape Pool Definition
Pool {
  Name = Daily-Tape-Pool
  Pool Type = Backup
  Storage = Tape
  Recycle = yes
  AutoPrune = yes
  Volume Retention = 12 days
  Cleaning Prefix = "CLNU"
  RecyclePool = Scratch
  Volume Use Duration = 23h
  RecycleOldestVolume = yes
}

# Weekly Tape Pool Definition
Pool {
  Name = Weekly-Tape-Pool
  Pool Type = Backup
  Storage = Tape
  Recycle = yes
  AutoPrune = yes
  Volume Retention = 32 days
  Cleaning Prefix = "CLNU"
  RecyclePool = Scratch
  Volume Use Duration = 23h
  RecycleOldestVolume = yes
}
# Monthly Tape Pool Definition
Pool {
  Name = Monthly-Tape-Pool
  Pool Type = backup
  Storage = Tape
  Recycle = yes
  AutoPrune = yes
  Volume Retention = 12 months
  Cleaning Prefix = "CLNU"
  RecyclePool = Scratch
  Volume Use Duration = 23h
  RecycleOldestVolume = yes
}
# Yearly Tape Pool Definition
Pool {
  Name = Yearly-Tape-Pool
  Pool Type = backup
  Storage = Tape
  Recycle = no
  AutoPrune = no
  Volume Retention =  10 years
  Cleaning Prefix = "CLNU"
  Volume Use Duration = 23h
}


In the case of Jobid 3309, I believe it should have a retention of 12
months, but it's already gone from the catalog, and shows zero jobs,
even though the backup report shows it copied nearly 260Gb.

As all the Tape-Copy jobs are listed with zero files, I'm now not sure
if i can restore files from tape at all, if the catalog thinks there
are no files.

Can anyone advise if this is a config issue or something else?  How
can i access my files from tape, or even see the ones backed up from
months back?

I'm anxious for advice, as this file is needed for something important
and urgently.  Thanks in advance.

Dermot.

------------------------------------------------------------------------------
This SF.net email is sponsored by 

Make an app they can't live without
Enter the BlackBerry Developer Challenge
http://p.sf.net/sfu/RIM-dev2dev 
_______________________________________________
Bacula-users mailing list
Bacula-users AT lists.sourceforge DOT net
https://lists.sourceforge.net/lists/listinfo/bacula-users

<Prev in Thread] Current Thread [Next in Thread>