Hi,

On Mon, Jun 22, 2015 at 4:07 PM, Win Htin <win.htin AT gmail DOT com> wrote:

Hi,

I am trying to recover a number of directories all under the same parent directory structure like the following example.

/etc/app/storage/<multiple_sub-directories_starting_with_bloomberg>

When I run the restore with option 6, it gives me an error message like the following:

For one or more of the JobIds selected, no files were found,
so file selection is not possible.
Most likely your retention policy pruned the files.

​This is not an error message. This occurs because your files were pruned from catalog. The jobs still exist in catalog but not the files related to them. How do you have configured the "File retention" directive? You can change this value for the same as your job and volume retention. This way you will always have your files until your jobs/volumes are pruned (if your volume retention is the smaller one, then your jobs/files are pruned when the volume is pruned).

 

My full backup volumes are kept for 7 years and my incremental volumes from 6 months to 1 year. Since the earliest job (Full backup) was from March 9th, why am I getting the error message?

The Bacula version is  Version: 5.2.12.

Is there another way of recovering the data?

The full bconsole details :
----------------------------------------------------------------------------------------------
*restore

First you select one or more JobIds that contain files
to be restored. You will be presented several methods
of specifying the JobIds. Then you will be allowed to
select which files from those JobIds are to be restored.

To select the JobIds, you have the following choices:
     1: List last 20 Jobs run
     2: List Jobs where a given File is saved
     3: Enter list of comma separated JobIds to select
     4: Enter SQL list command
    

​​

​​

5: Select the most recent backup for a client
     6: Select backup for a client before a specified time
     7: Enter a list of files to restore
     8: Enter a list of files to restore before a specified time
     9: Find the JobIds of the most recent backup for a client
    10: Find the JobIds for a backup for a client before a specified time
    11: Enter a list of directories to restore for found JobIds
    12: Select full restore to a specified Job date
    13: Cancel
Select item:  (1-13): 6

The restored files will the most current backup
BEFORE the date you specify below.
Enter date as YYYY-MM-DD HH:MM:SS :2015-06-17 06:00:00
Defined Clients:
     1: server1-fd
    ....
    ....
    53: server123-fd
    ....
    ....
    ....
    77: serverABC-fd
Select the Client (1-77): 53

Automatically selected FileSet: RHEL5Set
+--------+-------+----------+----------------+---------------------+------------+
| JobId  | Level | JobFiles | JobBytes       | StartTime           | VolumeName |
+--------+-------+----------+----------------+---------------------+------------+
| 75,460 | F     |  324,733 | 44,986,672,768 | 2015-03-14 16:37:13 | 211GED     |
| 75,532 | I     |      741 |  5,241,982,828 | 2015-03-18 02:50:24 | 200GED     |
| 75,570 | I     |      590 |  7,013,559,687 | 2015-03-19 02:44:04 | 200GED     |
| 75,608 | I     |   11,816 |  5,414,469,990 | 2015-03-20 03:00:47 | 200GED     |
| 75,646 | I     |      582 |  5,523,345,423 | 2015-03-21 03:06:06 | 200GED     |
| 75,685 | I     |      631 |  5,367,905,777 | 2015-03-24 04:01:12 | 200GED     |
| 75,723 | I     |      593 |  3,692,578,019 | 2015-03-25 03:43:42 | 200GED     |
| 75,761 | I     |      584 |  5,173,355,247 | 2015-03-26 03:52:57 | 200GED     |
| 75,799 | I     |      631 |  5,232,843,208 | 2015-03-27 04:04:57 | 200GED     |
| 75,837 | I     |      579 |  4,750,087,159 | 2015-03-28 04:30:31 | 200GED     |
| 75,876 | I     |   13,473 |  4,252,855,324 | 2015-03-31 06:01:58 | 200GED     |
| 75,914 | I     |      596 |  6,715,125,390 | 2015-04-01 04:54:43 | 200GED     |
| 75,952 | I     |      675 |  6,460,085,020 | 2015-04-02 05:04:24 | 200GED     |
| 75,990 | I     |      598 |  4,034,530,487 | 2015-04-03 05:20:46 | 200GED     |
| 76,028 | I     |      563 |  3,314,101,816 | 2015-04-04 05:06:51 | 200GED     |
| 76,105 | I     |      733 |  4,720,848,553 | 2015-04-08 00:01:54 | 207GED     |
| 76,143 | I     |      589 |  5,021,682,272 | 2015-04-09 00:37:14 | 207GED     |
| 76,181 | I     |      597 |  4,308,934,401 | 2015-04-10 00:39:07 | 207GED     |
| 76,219 | I     |      610 |  3,997,458,146 | 2015-04-11 00:52:01 | 207GED     |
| 76,258 | I     |      664 |  4,401,333,943 | 2015-04-14 01:35:53 | 207GED     |
| 76,296 | I     |      636 |  4,522,460,103 | 2015-04-15 01:21:59 | 207GED     |
| 76,334 | I     |   11,850 |  6,507,691,744 | 2015-04-16 02:02:24 | 207GED     |
| 76,372 | I     |    3,244 |  6,167,950,288 | 2015-04-17 01:59:34 | 207GED     |
| 76,410 | I     |      623 |  5,449,249,564 | 2015-04-18 02:16:11 | 207GED     |
| 76,449 | I     |      653 |  4,002,752,739 | 2015-04-21 03:43:23 | 207GED     |
| 76,487 | I     |      642 |  5,797,674,958 | 2015-04-22 02:51:26 | 207GED     |
| 76,525 | I     |      634 |  4,350,167,539 | 2015-04-23 02:48:16 | 207GED     |
| 76,563 | I     |      609 |  4,475,955,733 | 2015-04-24 03:10:52 | 207GED     |
| 76,601 | I     |      604 |  4,384,707,132 | 2015-04-25 02:54:22 | 206GED     |
| 76,640 | I     |      641 |  4,344,028,098 | 2015-04-28 02:42:05 | 206GED     |
| 76,678 | I     |      613 |  4,802,102,865 | 2015-04-29 02:35:01 | 206GED     |
| 76,716 | I     |      614 |  6,340,974,751 | 2015-04-30 02:51:37 | 206GED     |
| 76,754 | I     |      634 |  5,281,481,710 | 2015-05-01 03:05:38 | 206GED     |
| 76,792 | I     |      637 |  4,259,195,844 | 2015-05-02 04:39:32 | 206GED     |
| 76,831 | I     |      665 |  4,084,332,864 | 2015-05-05 04:56:16 | 206GED     |
| 76,869 | I     |   11,636 |  4,881,849,611 | 2015-05-06 00:56:05 | 213GED     |
| 76,907 | I     |      658 |  5,180,192,787 | 2015-05-07 00:15:54 | 219GED     |
| 76,945 | I     |      628 |  4,351,939,088 | 2015-05-08 00:59:06 | 213GED     |
| 76,983 | I     |      611 |  5,144,240,602 | 2015-05-09 01:06:15 | 213GED     |
| 77,022 | I     |      662 |  4,028,489,428 | 2015-05-12 02:01:02 | 213GED     |
| 77,060 | I     |      617 |  5,568,161,866 | 2015-05-13 01:42:29 | 213GED     |
| 77,098 | I     |      628 |  6,017,464,096 | 2015-05-14 01:58:43 | 213GED     |
| 77,136 | I     |      617 |  4,476,820,391 | 2015-05-15 02:08:05 | 213GED     |
| 77,174 | I     |      620 |  4,402,181,420 | 2015-05-16 02:17:22 | 213GED     |
| 77,205 | I     |      624 |  3,945,767,630 | 2015-05-19 02:57:21 | 213GED     |
| 77,241 | I     |      764 |  4,493,113,312 | 2015-05-20 03:49:38 | 213GED     |
| 77,277 | I     |      651 |  5,303,858,863 | 2015-05-21 01:17:39 | 145GED     |
| 77,313 | I     |      667 |  4,346,143,321 | 2015-05-22 01:23:01 | 145GED     |
| 77,349 | I     |      647 |  4,241,264,142 | 2015-05-23 01:37:28 | 145GED     |
| 77,386 | I     |      649 |  2,409,015,932 | 2015-05-26 02:21:59 | 145GED     |
| 77,422 | I     |      664 |  4,208,382,697 | 2015-05-27 02:16:41 | 145GED     |
| 77,458 | I     |      651 |  4,612,859,124 | 2015-05-28 00:01:11 | 00201G     |
| 77,494 | I     |      680 |  4,720,601,775 | 2015-05-29 03:01:18 | 00201G     |
| 77,530 | I     |      643 |  4,752,401,898 | 2015-05-30 02:23:05 | 00201G     |
| 77,567 | I     |      685 |  4,349,421,174 | 2015-06-02 02:38:57 | 00201G     |
| 77,602 | I     |      649 |  8,354,718,748 | 2015-06-03 03:07:04 | 00201G     |
| 77,637 | I     |      644 |  5,021,323,274 | 2015-06-04 03:12:36 | 00201G     |
| 77,672 | I     |      709 |  5,430,337,613 | 2015-06-05 03:25:16 | 00201G     |
| 77,707 | I     |      642 |  4,836,836,437 | 2015-06-06 03:57:50 | 00201G     |
| 77,780 | I     |      655 |  4,485,897,105 | 2015-06-10 02:27:36 | 221GED     |
| 77,816 | I     |      681 |  5,043,546,248 | 2015-06-11 02:39:51 | 221GED     |
| 77,852 | I     |      684 |  4,876,848,717 | 2015-06-12 02:54:56 | 221GED     |
| 77,888 | I     |      681 |  4,279,408,848 | 2015-06-13 03:10:44 | 221GED     |
| 77,925 | I     |      721 |  4,040,191,217 | 2015-06-16 04:13:33 | 221GED     |
| 77,961 | I     |      728 |  3,639,585,689 | 2015-06-17 04:00:01 | 221GED     |
+--------+-------+----------+----------------+---------------------+------------+
You have selected the following JobIds: 75460,75532,75570,75608,75646,75685,75723,75761,75799,75837,75
876,75914,75952,75990,76028,76105,76143,76181,76219,76258,76296,76334,76372,76410,76449,76487,76525,76
563,76601,76640,76678,76716,76754,76792,76831,76869,76907,76945,76983,77022,77060,77098,77136,77174,77
205,77241,77277,77313,77349,77386,77422,77458,77494,77530,77567,77602,77637,77672,77707,77744,77780,77
816,77852,77888,77925,77961

| 77,744 | I     |      751 |  6,430,040,211 | 2015-06-09 02:16:49 | 221GED     |
Building directory tree for JobId(s) 75460,75532,75570,75608,75646,75685,75723,75761,75799,75837,75876
,75914,75952,75990,76028,76105,76143,76181,76219,76258,76296,76334,76372,76410,76449,76487,76525,76563
,76601,76640,76678,76716,76754,76792,76831,76869,76907,76945,76983,77022,77060,77098,77136,77174,77205
,77241,77277,77313,77349,77386,77422,77458,77494,77530,77567,77602,77637,77672,77707,77744,77780,77816
,77852,77888,77925,77961 ...  ++++++++++++++++++++++++++++++++++++++++++++++++

For one or more of the JobIds selected, no files were found,
so file selection is not possible.
Most likely your retention policy pruned the files.

Do you want to restore all the files? (yes|no): no

Regexp matching files to restore? (empty to abort):

​​

/etc/app/storage/bloomberg*
Bootstrap records written to /var/bacula/working/baculaserver-dir.restore.3.bsr

The job will require the following
   Volume(s)                 Storage(s)                SD Device(s)
===========================================================================
  
   *211GED                    TS3200_1_DRV1             LTO4_1                  
   *200GED                    TS3200_1_DRV1             LTO4_1                  
   *207GED                    TS3200_1_DRV1             LTO4_1                  
   *206GED                    TS3200_1_DRV1             LTO4_1                  
   *213GED                    TS3200_1_DRV1             LTO4_1                  
   *219GED                    TS3200_1_DRV1             LTO4_1
   *145GED                    TS3200_1_DRV1             LTO4_1
    *00201G                    TS3200_1_DRV2             LTO4_2                  
   *221GED                    TS3200_1_DRV2             LTO4_2                  

Volumes marked with "*" are online.


415,424 files selected to be restored.   <== WHY SO MANY FILES??

​Because of your selection. Bacula will restore the same set of directories (

​

/etc/app/storage/bloomberg*) from the same client, but that were backed up in different date/times and jobs. ​If you want to restore just one set of the "/etc/app/storage/<multiple_sub-directories_starting_with_bloomberg>", maybe you should use option 

​

5: Select the most recent backup for a client and then use the regexp to select the directories.

 

Run Restore job
JobName:         RestoreFiles
Bootstrap:       /var/bacula/working/baculaserver-dir.restore.3.bsr
Where:           /tmp/bacula-restores
Replace:         always
FileSet:         LinuxServerSet
Backup Client:   server123-fd
Restore Client:  server123-fd

---------------------------------------------

Thanks,

Win       

​Best regards,

Ana​