[Bacula-users] Need help understanding what Bacula is doing

Guys

I have been running Bacula for years and love it, but every now andthen it does something that I can't figure out. So here's the currentissue:


   The system is telling me that there are no appendable volumes, as in :

08-Mar 08:56 bkupsvr2-sd JobId 18818: Job 
seismicfs-seismic08.2011-03-06_20.05.01_02 is waiting. Cannot find any 
appendable volumes.
Please use the "label" command to create a new Volume for:
   Storage:      "V-LTO4-5" (/dev/nst3)
   Pool:         V-Seismic
   Media type:   LTO4

But in looking at the list of volumes in the pool we see:

*list media pool=V-Seismic
Automatically selected Catalog: MyCatalog
Using Catalog "MyCatalog"
+---------+------------+-----------+---------+-------------------+----------+--------------+---------+------+-----------+-----------+---------------------+
| MediaId | VolumeName | VolStatus | Enabled | VolBytes          | VolFiles | 
VolRetention | Recycle | Slot | InChanger | MediaType | LastWritten         |
+---------+------------+-----------+---------+-------------------+----------+--------------+---------+------+-----------+-----------+---------------------+
|      43 | AAA043L4   | Full      |       1 | 1,162,725,322,752 |    1,276 |   
 5,616,000 |       1 |   43 |         1 | LTO4      | 2011-01-20 00:36:46 |
|      44 | AAA044L4   | Full      |       1 | 1,410,411,792,384 |    1,517 |   
 5,616,000 |       1 |   44 |         1 | LTO4      | 2011-02-06 22:11:22 |
|      45 | AAA045L4   | Full      |       1 | 1,560,367,291,392 |    1,625 |   
 5,616,000 |       1 |   45 |         1 | LTO4      | 2011-02-08 07:06:11 |
|      46 | AAA046L4   | Full      |       1 | 1,293,359,735,808 |    1,499 |   
 5,616,000 |       1 |   46 |         1 | LTO4      | 2011-02-04 21:55:08 |
|      47 | AAA047L4   | Full      |       1 | 1,559,112,468,480 |    1,639 |   
 5,616,000 |       1 |   47 |         1 | LTO4      | 2011-03-07 13:55:22 |
|      48 | AAA048L4   | Full      |       1 | 2,324,146,277,376 |    2,371 |   
 5,616,000 |       1 |   48 |         1 | LTO4      | 2011-03-08 05:59:13 |
|      49 | AAA049L4   | Full      |       1 | 1,487,829,805,056 |    1,535 |   
 5,616,000 |       1 |   49 |         1 | LTO4      | 2011-03-07 03:17:19 |
|      50 | AAA050L4   | Full      |       1 | 1,454,582,062,080 |    1,577 |   
 5,616,000 |       1 |   50 |         1 | LTO4      | 2011-01-06 06:37:06 |
|      51 | AAA051L4   | Full      |       1 | 1,502,821,232,640 |    1,727 |   
 5,616,000 |       1 |   51 |         1 | LTO4      | 2011-02-07 04:02:15 |
|      52 | AAA052L4   | Append    |       1 |   871,944,192,000 |      872 |   
 5,616,000 |       1 |   52 |         1 | LTO4      | 2011-03-08 13:10:17 |
|      53 | AAA053L4   | Append    |       1 |   304,698,046,464 |      310 |   
 5,616,000 |       1 |   53 |         1 | LTO4      | 2011-03-08 04:00:43 |
|      54 | AAA054L4   | Full      |       1 | 1,447,661,214,720 |    1,614 |   
 5,616,000 |       1 |   54 |         1 | LTO4      | 2011-02-04 22:30:11 |
|      55 | AAA055L4   | Full      |       1 | 1,227,525,239,808 |    1,229 |   
 5,616,000 |       1 |   55 |         1 | LTO4      | 2011-02-07 16:45:37 |
|      56 | AAA056L4   | Full      |       1 | 1,534,675,000,320 |    1,538 |   
 5,616,000 |       1 |   56 |         1 | LTO4      | 2011-02-09 21:05:57 |
|      57 | AAA057L4   | Full      |       1 | 2,129,585,375,232 |    2,132 |   
 5,616,000 |       1 |   57 |         1 | LTO4      | 2011-02-08 23:26:25 |
|      58 | AAA058L4   | Full      |       1 | 1,737,372,801,024 |    1,740 |   
 5,616,000 |       1 |   58 |         1 | LTO4      | 2011-02-08 18:09:52 |
|      59 | AAA059L4   | Full      |       1 | 2,007,634,987,008 |    2,014 |   
 5,616,000 |       1 |   59 |         1 | LTO4      | 2011-02-12 04:14:28 |
|      60 | AAA060L4   | Full      |       1 | 1,436,913,257,472 |    1,438 |   
 5,616,000 |       1 |   60 |         1 | LTO4      | 2011-02-09 12:16:57 |
|      98 | AAA098L4   | Full      |       1 | 1,791,398,504,448 |    1,825 |   
 5,616,000 |       1 |   98 |         1 | LTO4      | 2011-02-11 07:17:56 |
|      99 | AAA099L4   | Full      |       1 | 1,173,149,107,200 |    1,185 |   
 5,616,000 |       1 |   99 |         1 | LTO4      | 2011-02-12 04:25:17 |
|     100 | AAA100L4   | Full      |       1 | 1,579,988,680,704 |    1,594 |   
 5,616,000 |       1 |  100 |         1 | LTO4      | 2011-03-08 05:56:15 |
|     101 | AAA101L4   | Append    |       1 |    50,825,650,176 |       68 |   
 5,616,000 |       1 |  101 |         1 | LTO4      | 2011-02-16 05:18:25 |
|     102 | AAA102L4   | Append    |       1 |   463,469,110,272 |      467 |   
 5,616,000 |       1 |  102 |         1 | LTO4      | 2011-02-15 20:46:57 |
|     103 | AAA103L4   | Append    |       1 |   330,413,690,880 |      349 |   
 5,616,000 |       1 |  103 |         1 | LTO4      | 2011-02-16 20:17:52 |
|     104 | AAA104L4   | Full      |       1 | 1,808,303,809,536 |    1,969 |   
 5,616,000 |       1 |  104 |         1 | LTO4      | 2011-03-07 05:12:32 |
+---------+------------+-----------+---------+-------------------+----------+--------------+---------+------+-----------+-----------+---------------------+


If we look a the status of the system jobs we see, that jobs are definitely 
blocked:

*st jobs
The defined Storage resources are:
    1: REO4600
    2: NEO4200
Select Storage resource (1-2): 1
Connecting to Storage daemon REO4600 at bkupsvr2.gg.uwyo.edu:9103

bkupsvr2-sd Version: 5.0.3 (04 August 2010) x86_64-unknown-linux-gnu redhatDaemon started 27-Jan-11 14:57. Jobs: run=3136, running=5.

Heap: heap=6,238,208 smbytes=3,692,524 max_bytes=7,370,544 bufs=593 
max_bufs=1,113
Sizes: boffset_t=8 size_t=8 int32_t=4 int64_t=8

Running Jobs:
Writing: Full Backup job seismicfs-seismic06 JobId=18816 Volume="AAA052L4"
   pool="V-Seismic" device="V-LTO4-4" (/dev/nst10)
   spooling=0 despooling=0 despool_wait=0
   Files=11,329,116 Bytes=901,145,177,358 Bytes/sec=10,408,116
   FDReadSeqNo=114,159,021 in_msg=80211140 out_msg=5 fd=10
Writing: Full Backup job seismicfs-seismic08 JobId=18818 Volume=""
   pool="V-Seismic" device="V-LTO4-5" (/dev/nst3)
   spooling=0 despooling=0 despool_wait=0
   Files=2,979,121 Bytes=884,325,476,180 Bytes/sec=10,980,771
   FDReadSeqNo=39,785,760 in_msg=30858647 out_msg=92 fd=20
Writing: Full Backup job seismicfs-seismic09 JobId=18819 Volume=""
   pool="V-Seismic" device="V-LTO4-3" (/dev/nst2)
   spooling=0 despooling=0 despool_wait=0
   Files=917,789 Bytes=493,358,041,584 Bytes/sec=7,067,761
   FDReadSeqNo=15,662,486 in_msg=12910969 out_msg=92 fd=16
Writing: Full Backup job nicoya-blake JobId=18782 Volume="AAA108L4"
   pool="V-Steve" device="V-LTO4-2" (/dev/nst9)
   spooling=0 despooling=0 despool_wait=0
   Files=17,730 Bytes=635,225,003,634 Bytes/sec=13,131,537
   FDReadSeqNo=9,841,253 in_msg=9790517 out_msg=5 fd=8
Writing: Full Backup job nicoya-cabo1 JobId=18783 Volume="AAA030L4"
   pool="V-Steve" device="V-LTO4-0" (/dev/nst8)
   spooling=0 despooling=0 despool_wait=0
   Files=39,783 Bytes=517,709,277,739 Bytes/sec=11,541,326
   FDReadSeqNo=8,238,956 in_msg=8123860 out_msg=5 fd=12
Writing: Full Backup job nicoya-cabo2 JobId=18784 Volume="AAA031L4"
   pool="V-Steve" device="V-LTO4-1" (/dev/nst1)
   spooling=0 despooling=0 despool_wait=0
   Files=754 Bytes=588,093,825,928 Bytes/sec=22,919,592
   FDReadSeqNo=8,979,176 in_msg=8977243 out_msg=5 fd=13
====

Jobs waiting to reserve a drive:
====

Terminated Jobs:

JobId Level Files Bytes Status Finished Name===================================================================

18858  Full      8,883    96.84 G  OK       07-Mar-11 21:44 h2ocfs-h2oc01
18777  Full   4,674,110    922.5 G  OK       07-Mar-11 23:38 nicoya-adak
18856  Full     52,766    204.4 G  OK       07-Mar-11 23:46 h2ocfs-home
18780  Full      1,708    860.4 G  OK       08-Mar-11 00:47 nicoya-stommel1
18942  Full         55    1.253 G  OK       08-Mar-11 04:00 seismicoracle-hot
18781  Full        604    684.4 G  OK       08-Mar-11 06:07 nicoya-stommel2
18860  Full    346,693    689.8 G  OK       08-Mar-11 06:51 h2ocfs-h2oc02
18864  Full      1,404    887.8 M  OK       08-Mar-11 06:53 h2ocfs-h2oc04
18866  Full         36    9.044 G  OK       08-Mar-11 06:58 h2ocfs-h2oc05
18862  Full      8,380    894.0 G  OK       08-Mar-11 08:44 h2ocfs-h2oc03
====

Device status:
Autochanger "REO4600" with devices:
  "V-LTO4-0" (/dev/nst8)
  "V-LTO4-1" (/dev/nst1)
  "V-LTO4-2" (/dev/nst9)
  "V-LTO4-3" (/dev/nst2)
  "V-LTO4-4" (/dev/nst10)
  "V-LTO4-5" (/dev/nst3)
  "V-LTO4-6" (/dev/nst11)
  "V-LTO4-7" (/dev/nst4)
  "V-LTO4-8" (/dev/nst12)
  "V-LTO4-9" (/dev/nst5)
Autochanger "NEO4200" with devices:
  "LTO5-0" (/dev/nst7)
  "LTO5-1" (/dev/nst13)
  "LTO5-2" (/dev/nst0)
  "LTO5-3" (/dev/nst6)
Device "V-LTO4-0" (/dev/nst8) is mounted with:
   Volume:      AAA030L4
   Pool:        V-Steve
   Media type:  LTO4
   Slot 30 is loaded in drive 0.
   Total Bytes=919,662,621,696 Blocks=14,255,682 Bytes/block=64,512
   Positioned at File=920 Block=1,978
Device "V-LTO4-1" (/dev/nst1) is mounted with:
   Volume:      AAA031L4
   Pool:        V-Steve
   Media type:  LTO4
   Slot 31 is loaded in drive 1.
   Total Bytes=334,485,301,248 Blocks=5,184,853 Bytes/block=64,512
   Positioned at File=334 Block=7,854
Device "V-LTO4-2" (/dev/nst9) is mounted with:
   Volume:      AAA108L4
   Pool:        V-Steve
   Media type:  LTO4
   Slot 108 is loaded in drive 2.
   Total Bytes=916,373,477,376 Blocks=14,204,697 Bytes/block=64,512
   Positioned at File=984 Block=7,262
Device "V-LTO4-3" (/dev/nst2) is not open.
   Device is BLOCKED waiting to create a volume for:
      Pool:        V-Seismic
      Media type:  LTO4
   Drive 3 is not loaded.
Device "V-LTO4-4" (/dev/nst10) is mounted with:
   Volume:      AAA052L4
   Pool:        V-Seismic
   Media type:  LTO4
   Slot 52 is loaded in drive 4.
   Total Bytes=872,934,193,152 Blocks=13,531,345 Bytes/block=64,512
   Positioned at File=872 Block=15,346
Device "V-LTO4-5" (/dev/nst3) is not open.
   Device is BLOCKED waiting to create a volume for:
      Pool:        V-Seismic
      Media type:  LTO4
   Drive 5 is not loaded.
Device "V-LTO4-6" (/dev/nst11) is mounted with:
   Volume:      AAA012L4
   Pool:        V-Linda
   Media type:  LTO4
   Slot 12 is loaded in drive 6.
   Total Bytes=697,335,625,728 Blocks=10,809,393 Bytes/block=64,512
   Positioned at File=750 Block=0
Device "V-LTO4-7" (/dev/nst4) is mounted with:
   Volume:      AAA070L4
   Pool:        V-Linda
   Media type:  LTO4
   Slot 70 is loaded in drive 7.
   Total Bytes=2,194,576,763,904 Blocks=18,572,055 Bytes/block=118,165
   Positioned at File=2,342 Block=0
Device "V-LTO4-8" (/dev/nst12) is mounted with:
   Volume:      AAA053L4
   Pool:        V-Seismic
   Media type:  LTO4
   Slot 53 is loaded in drive 8.
   Total Bytes=304,698,046,464 Blocks=4,723,121 Bytes/block=64,512
   Positioned at File=310 Block=0
Device "V-LTO4-9" (/dev/nst5) is not open.
   Drive 9 is not loaded.
Device "LTO5-0" (/dev/nst7) is not open.
   Drive 0 status unknown.
Device "LTO5-1" (/dev/nst13) is not open.
   Drive 1 status unknown.
Device "LTO5-2" (/dev/nst0) is not open.
   Drive 2 status unknown.
Device "LTO5-3" (/dev/nst6) is not open.
   Drive 3 status unknown.
====

Used Volume status:
AAA004L4 on device "V-LTO4-0" (/dev/nst8)
   Reader=0 writers=1 devres=0 volinuse=0
AAA005L4 on device "V-LTO4-9" (/dev/nst5)
   Reader=0 writers=0 devres=0 volinuse=0
AAA011L4 on device "V-LTO4-0" (/dev/nst8)
   Reader=0 writers=1 devres=0 volinuse=0
AAA012L4 on device "V-LTO4-6" (/dev/nst11)
   Reader=0 writers=0 devres=0 volinuse=0
AAA013L4 on device "V-LTO4-7" (/dev/nst4)
   Reader=0 writers=0 devres=0 volinuse=0
AAA016L4 on device "V-LTO4-4" (/dev/nst10)
   Reader=0 writers=1 devres=0 volinuse=0
AAA028L4 on device "V-LTO4-7" (/dev/nst4)
   Reader=0 writers=0 devres=0 volinuse=0
AAA029L4 on device "V-LTO4-3" (/dev/nst2)
   Reader=0 writers=1 devres=0 volinuse=1
AAA030L4 on device "V-LTO4-0" (/dev/nst8)
   Reader=0 writers=1 devres=0 volinuse=1
AAA031L4 on device "V-LTO4-1" (/dev/nst1)
   Reader=0 writers=1 devres=0 volinuse=1
AAA036L4 on device "V-LTO4-1" (/dev/nst1)
   Reader=0 writers=1 devres=0 volinuse=0
AAA052L4 on device "V-LTO4-4" (/dev/nst10)
   Reader=0 writers=1 devres=0 volinuse=1
AAA053L4 on device "V-LTO4-8" (/dev/nst12)
   Reader=0 writers=0 devres=0 volinuse=0
AAA070L4 on device "V-LTO4-7" (/dev/nst4)
   Reader=0 writers=0 devres=0 volinuse=0
AAA072L4 on device "V-LTO4-2" (/dev/nst9)
   Reader=0 writers=1 devres=0 volinuse=0
AAA077L4 on device "V-LTO4-9" (/dev/nst5)
   Reader=0 writers=0 devres=0 volinuse=0
AAA078L4 on device "V-LTO4-3" (/dev/nst2)
   Reader=0 writers=1 devres=0 volinuse=1
AAA091L4 on device "V-LTO4-6" (/dev/nst11)
   Reader=0 writers=0 devres=0 volinuse=0
AAA096L4 on device "V-LTO4-7" (/dev/nst4)
   Reader=0 writers=0 devres=0 volinuse=0
AAA100L4 on device "V-LTO4-5" (/dev/nst3)
   Reader=0 writers=1 devres=0 volinuse=0
AAA101L4 on device "V-LTO4-0" (/dev/nst8)
   Reader=0 writers=1 devres=0 volinuse=0
AAA102L4 on device "V-LTO4-1" (/dev/nst1)
   Reader=0 writers=1 devres=0 volinuse=0
AAA103L4 on device "V-LTO4-1" (/dev/nst1)
   Reader=0 writers=1 devres=0 volinuse=0
AAA107L4 on device "V-LTO4-4" (/dev/nst10)
   Reader=0 writers=1 devres=0 volinuse=0
AAA108L4 on device "V-LTO4-2" (/dev/nst9)
   Reader=0 writers=1 devres=0 volinuse=1
AAA109L4 on device "V-LTO4-4" (/dev/nst10)
   Reader=0 writers=1 devres=0 volinuse=0
AAA110L4 on device "V-LTO4-3" (/dev/nst2)
   Reader=0 writers=1 devres=0 volinuse=0
====

====



So the question is, why does bacula think there are not appendable volumes in 
the V-Seismic pool?

This system has been running fine for about a year now, with any problems.  I 
just don't see what it's problem is.

If you need the configs I can attached them, but this email is already long, so 
will wait and see.

jeff

jrlang.vcf
Description: Vcard

------------------------------------------------------------------------------
What You Don't Know About Data Connectivity CAN Hurt You
This paper provides an overview of data connectivity, details
its effect on application quality, and explores various alternative
solutions. http://p.sf.net/sfu/progress-d2d

_______________________________________________
Bacula-users mailing list
Bacula-users AT lists.sourceforge DOT net
https://lists.sourceforge.net/lists/listinfo/bacula-users