Bacula-users

Re: [Bacula-users] A reasonable way to get a list of files backed up ina job?

2008-05-07 04:48:51
Subject: Re: [Bacula-users] A reasonable way to get a list of files backed up ina job?
From: Arno Lehmann <al AT its-lehmann DOT de>
To: Bacula-users AT lists.sourceforge DOT net
Date: Wed, 07 May 2008 10:17:39 +0200
Hi,

06.05.2008 17:59, K. M. Peterson wrote:
> Hi Tom,
> 
> Thanks for your response. 
> 
> I was trying to avoid using the console - it seemed that it would be 
> cleaner if there was some way of getting this information out of the 
> verify job or if there was a parameter in the messages resource that 
> would do this.  Again, both these will give me files either not backed 
> up or not comparing to the backup, I was hoping that someone had a way 
> to get the list of files that were backed up.
> 
> What I would need to do is use llist rather than list (easier to parse, 
> less likely to change in a way to break a script), but then there's more 
> work in getting that last jobid (although this isn't an issue if the 
> script is run as a Run After Job with the right parameter).  It sure 
> does seem like there'd be a way to do this with Verify at least.

I don't know why you want this through a verify job... if, after a job 
is run, you want a complete file list you can create that using 
bconsol's list or query command. This can be scripted, as shown 
previously. That script, in turn, could be put into a run after job 
command.

>  That's 
> what I was hoping for.  Cleaner to me means less likely to break, and 
> fewer things to go wrong - and I'd like to put as much of the logic as 
> possible in the conf file as opposed to, well, a hack using bconsole.

There's no hack involved.

> Doesn't look like this is possible.  Since I decided that I also want to 
> report on jobs on a per-volume basis, I may end up writing SQL as well...

Which would be much more likely to break, and could go wrong easily... 
if you go that way, have a look into the query.sql file to see how 
these queries are done. I guess some of them do exactly what you want. 
Also, most of the needed work has already been done, so you don't need 
to dig your way through the SQL yourself.

Arno

> Again, I appreciated your getting back to me...
> 
> On Sun, May 4, 2008 at 8:06 PM, Thomas Krwawecz III <tom AT bluegravity DOT 
> com 
> <mailto:tom AT bluegravity DOT com>> wrote:
> 
>     "list files jobid=nn" from bconsole isn't working?
>      
>     Thomas Krwawecz III
>     --
>     Blue Gravity Communications, Inc.
>     3495 Haddonfield Rd, Suite 6
>     Pennsauken, NJ 08109
>      
>     Toll Free: 1-877-8 HOSTING
>     Tel: (856) 662-9100, Fax: (856) 662-9101
>     Web: http://www.bluegravity.com
> 
>         ----- Original Message -----
>         *From:* K. M. Peterson <mailto:kmp.lists+bacula-users AT gmail DOT 
> com>
>         *To:* Bacula-users AT lists.sourceforge DOT net
>         <mailto:Bacula-users AT lists.sourceforge DOT net>
>         *Sent:* Sunday, May 04, 2008 5:11 PM
>         *Subject:* [Bacula-users] A reasonable way to get a list of
>         files backed up ina job?
> 
>         Hi all,
> 
>         We're migrating to Bacula from a fairly random system of
>         backups, many of which used tar jobs being run on servers and
>         then copying them to a "backup machine" (via NFS) where they
>         were manually migrated to another medium.  (You don't want to
>         hear what that other medium is...)
> 
>         To move this migration along, I'd like to have a way to
>         determine the files that were backed up in job, so that I can
>         delete them.  This way, I could migrate these tar files over to
>         our bacula machine, and then delete them once I know they are on
>         tape.  Generally, the names are date-tagged in some way, but
>         this isn't something that I want to rely on (in case the copy
>         process gets hosed, and there are 'old' files that actually
>         haven't been copied by Bacula).
> 
>         If there were some reasonable way to get a list from Bacula of
>         the files in a particular job, that would help.  I see that I
>         can run a Verify job (say, type DiskToCatalog) and get a list of
>         the files that have changed or otherwise differ from the state
>         of those on the backup set, or I can get a list of files that
>         were /not/ saved or encountered errors using parameters in a
>         message resource ("skipped" or "notsaved" types) in a particular
>         backup job.  This is the converse of what I'd like to have.
> 
>         There doesn't seem to be a way to determine in this way what
>         files /were/ backed up, or haven't been changed since a backup
>         was made.
> 
>         What I'm doing now is creating a sentinel file in the
>         RunBeforeJob and then deleting all files "older" than this on
>         successful completion (in a RunAfterJob) script.  This works,
>         but it's not something that I'm particularly comfortable with -
>         I can't think of how it might get screwed up, but I'd rather
>         again have a positive state to check rather than the lack of a
>         negative state.  And, I presume that I could write an SQL query
>         of some sort and query the database - perhaps through a script
>         talking to bconsole - but that strikes me as again not really
>         plain enough for whomever takes over management of this task
>         from me when I'm done with it.
> 
>         Is there something that I'm missing here, either in my general
>         approach or in how the particular code in the daemons is
>         implemented?  I'm running 2.2.8 on OpenSUSE 10.2 with MySQL.
> 
>         Thanks!
>         _KMP
>         Boston
> 
>         
> -------------------------------------------------------------------------
>         This SF.net email is sponsored by the 2008 JavaOne(SM) Conference
>         Don't miss this year's exciting event. There's still time to
>         save $100.
>         Use priority code J8TL2D2.
>         
> http://ad.doubleclick.net/clk;198757673;13503038;p?http://java.sun.com/javaone
> 
> 
>         _______________________________________________
>         Bacula-users mailing list
>         Bacula-users AT lists.sourceforge DOT net
>         <mailto:Bacula-users AT lists.sourceforge DOT net>
>         https://lists.sourceforge.net/lists/listinfo/bacula-users
> 
> 
>     -------------------------------------------------------------------------
>     This SF.net email is sponsored by the 2008 JavaOne(SM) Conference
>     Don't miss this year's exciting event. There's still time to save $100.
>     Use priority code J8TL2D2.
>     
> http://ad.doubleclick.net/clk;198757673;13503038;p?http://java.sun.com/javaone
>     _______________________________________________
>     Bacula-users mailing list
>     Bacula-users AT lists.sourceforge DOT net
>     <mailto:Bacula-users AT lists.sourceforge DOT net>
>     https://lists.sourceforge.net/lists/listinfo/bacula-users
> 
> 
> 
> ------------------------------------------------------------------------
> 
> -------------------------------------------------------------------------
> This SF.net email is sponsored by the 2008 JavaOne(SM) Conference 
> Don't miss this year's exciting event. There's still time to save $100. 
> Use priority code J8TL2D2. 
> http://ad.doubleclick.net/clk;198757673;13503038;p?http://java.sun.com/javaone
> 
> 
> ------------------------------------------------------------------------
> 
> _______________________________________________
> Bacula-users mailing list
> Bacula-users AT lists.sourceforge DOT net
> https://lists.sourceforge.net/lists/listinfo/bacula-users

-- 
Arno Lehmann
IT-Service Lehmann
www.its-lehmann.de

-------------------------------------------------------------------------
This SF.net email is sponsored by the 2008 JavaOne(SM) Conference 
Don't miss this year's exciting event. There's still time to save $100. 
Use priority code J8TL2D2. 
http://ad.doubleclick.net/clk;198757673;13503038;p?http://java.sun.com/javaone
_______________________________________________
Bacula-users mailing list
Bacula-users AT lists.sourceforge DOT net
https://lists.sourceforge.net/lists/listinfo/bacula-users