Hi,
22.09.2008 07:14, Ken Barclay wrote:
>
>
> Hello again,
> Well the good news is that everything is backing up correctly again.
> The best news is that Bacula has been found NOT guilty and has been
> cleared of all suspicion.
> So, what happened? It seems that one of my colleagues changed the
> directory structure on the offending server. The contents of /share
> were all copied to /public/share. /share was now no longer an active
> directory and as such couldn't do an Incremental back up simply because
> nothing had changed. And when did he make this change? As coincidence
> would have it, he changed the directory on 22 August, that's the same
> day that the server did its last Full backup.
Murphy's Law...
> Sorry for the false alarm, and Thanks to everyone who replied. Can
> anyone recommend some good Change Management software? (Or perhaps a
> good Inter-office Communications skills course).
The latter is the more important one, I guess... you could simply set
up a shared directory for all admins where you keep simple text files
describing the system setup and what everyone did.
Putting that into a version control system allows you to track changes
more easily.
If you find the discipline to keep those files updated is not there
I'd start googling... but my personal experience is that, if you can't
rely on the admins cooperating you're in deep trouble because
enforcing any type of change management is a) difficult, and b)
usually indicates you've got a serious communication problem in your
organization. But that's far beyond the scope of Bacula (unless you
run verify jobs to see what changes happened ;-)
Arno
> Best Regards,
> Ken
>
>
> -----Original Message-----
> From: bacula-users-bounces AT lists.sourceforge DOT net
> [mailto:bacula-users-bounces AT lists.sourceforge DOT net] On Behalf Of Arno
> Lehmann
> Sent: Friday, 19 September 2008 2:55 PM
> To: bacula-users AT lists.sourceforge DOT net
> Subject: Re: [Bacula-users] FW: Files/Directories missing from backup
>
> Hello,
>
> 19.09.2008 07:04, Ken Barclay wrote:
> >
> >
> > Thanks for your response Martin.
> >
> > I did check the logs and found nothing of interest.
> > I did the @output as you suggested and sure enough /share and all its
> > contents were included.
>
> Interesting coincidence... I had a customer report something similar
> recently - a certain directory that *should* have been included was not.
>
> Investigation goes slowly, so I don't know anything definitive yet,
> but as far as I know, cleaning up the fileset definition, reloading,
> and then verifying the job with 'estimate listing' seemed to show that
> everything was picked up.
>
> Sounds like a miracle, a bug that only triggers in certain situations
> which I don't understand yet, or a configuration issue (perhaps as
> simple as forgetting the 'reload' after a previous configuration
> change) - I'm still working on it, or rather, my customer is, with my
> advice. I'll let you know if I find something that looks like a Bacula
> issue.
>
> By the way - my customer's problem occurred on a windows server FD.
>
> > In my Fileset, the only Exclude is for /var/lib/nfs/rpc_pipefs - so I
> > don't think that is a problem.
> > Your final suggestion re: strace -f -p might be a job for Monday, if
> > necessary.
> > In the meantime, yesterday I changed the schedule to force a Full backup
> > last night hoping that this would put things back into sync. The Full
> > backup was successful and included everything that had previously been
> > missing. What will be interesting is tonight's Incremental. Just have
> > to wait and see. Should all go well, I'll let you know. If not, then
> > I'll 'strace' on Monday. [Fingers crossed].
>
> From what I know now, I guess you'll find the jobs works as it should
> - looks like one of those issues where, once you look closely,
> everything works correctly (though the files in question were really
> never backed up previously).
>
> Good luck!
>
> Arno
>
> > Thanks again,
> > Ken
> >
> > -----Original Message-----
> > From: bacula-users-bounces AT lists.sourceforge DOT net
> > [mailto:bacula-users-bounces AT lists.sourceforge DOT net] On Behalf Of
> Martin
> > Simmons
> > Sent: Friday, 19 September 2008 2:57 AM
> > To: bacula-users AT lists.sourceforge DOT net
> > Subject: Re: [Bacula-users] Files/Directories missing from backup
> >
> > >>>>> On Thu, 18 Sep 2008 12:41:56 +0700 (ICT), Ken Barclay said:
> > >
> > > On one of my servers there's a directory called /share , inside
> /share
> > > there are departmental folders such as Marketing, Finance, IT,
> etc. and
> > > within those directories there are multiple directories and
> files. The
> > > contents of these directories change on a daily basis, so will
> therefore
> > > be included in each nights back up.
> > >
> > > /share is included in the FileSet, and in the last Full backup on 22
> > > August, the entire contents of /share was backed up (as expected).
> > >
> > >
> > >
> > > This morning I was asked to restore a single file from 10 September
> > > located within the /share directory, and guess what - there is no
> /share
> > > at all! The other directories (/var, /etc, ....) are there but no
> > /share.
> > >
> > >
> > >
> > > I then checked every Differential and Incremental backup since 22
> August
> > > and sure enough there is no /share directory. Strange!
> > >
> > > Next, I had a look at the backups for 20 & 21 August (both
> Incremental)
> > > and would you believe it, /share and its contents were backed up just
> > > fine. On August 22 there was a Full backup - everything backed
> up fine,
> > > but since then /share hasn't been backing up.
> > >
> > >
> > >
> > > Each nights back up Message has been Backup OK, and there has been
> > > nothing like "/share is a different filesystem. Will not descend
> ..etc."
> > >
> > >
> > >
> > >
> > > I just did an 'estimate job' in bconsole and the number of files and
> > bytes
> > > equates roughly to what was backed up in the last Full on 22 August.
> > >
> > >
> > >
> > > Does anyone have any clues about this one?
> >
> > Did you check the logs of the backups for any messages about this?
> >
> > Does the listing option in the estimate command show files in
> /share? (You
> > can use the @output command to capture the output into a file.)
> >
> > Does the fileset have any exclude options that might be accidentally
> > matching
> > files in /share?
> >
> > You could try running attaching strace -f -p to the bacula-fd process
> > during a
> > backup to see if it even looks at /share.
> >
> > __Martin
> >
> > -------------------------------------------------------------------------
> > This SF.Net email is sponsored by the Moblin Your Move Developer's
> challenge
> > Build the coolest Linux based applications with Moblin SDK & win great
> > prizes
> > Grand prize is a trip for two to an Open Source event anywhere in the
> world
> > http://moblin-contest.org/redirect.php?banner_id=100&url=/
> <http://moblin-contest.org/redirect.php?banner_id=100&url=/>
> > <http://moblin-contest.org/redirect.php?banner_id=100&url=/
> <http://moblin-contest.org/redirect.php?banner_id=100&url=/>>
> > _______________________________________________
> > Bacula-users mailing list
> > Bacula-users AT lists.sourceforge DOT net
> > https://lists.sourceforge.net/lists/listinfo/bacula-users
> >
> >
> > ------------------------------------------------------------------------
> >
> > -------------------------------------------------------------------------
> > This SF.Net email is sponsored by the Moblin Your Move Developer's
> challenge
> > Build the coolest Linux based applications with Moblin SDK & win
> great prizes
> > Grand prize is a trip for two to an Open Source event anywhere in the
> world
> > http://moblin-contest.org/redirect.php?banner_id=100&url=/
> <http://moblin-contest.org/redirect.php?banner_id=100&url=/>
> >
> >
> > ------------------------------------------------------------------------
> >
> > _______________________________________________
> > Bacula-users mailing list
> > Bacula-users AT lists.sourceforge DOT net
> > https://lists.sourceforge.net/lists/listinfo/bacula-users
>
> --
> Arno Lehmann
> IT-Service Lehmann
> Sandstr. 6, 49080 Osnabrück
> www.its-lehmann.de
>
> -------------------------------------------------------------------------
> This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
> Build the coolest Linux based applications with Moblin SDK & win great
> prizes
> Grand prize is a trip for two to an Open Source event anywhere in the world
> http://moblin-contest.org/redirect.php?banner_id=100&url=/
> <http://moblin-contest.org/redirect.php?banner_id=100&url=/>
> _______________________________________________
> Bacula-users mailing list
> Bacula-users AT lists.sourceforge DOT net
> https://lists.sourceforge.net/lists/listinfo/bacula-users
>
>
> ------------------------------------------------------------------------
>
> -------------------------------------------------------------------------
> This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
> Build the coolest Linux based applications with Moblin SDK & win great prizes
> Grand prize is a trip for two to an Open Source event anywhere in the world
> http://moblin-contest.org/redirect.php?banner_id=100&url=/
>
>
> ------------------------------------------------------------------------
>
> _______________________________________________
> Bacula-users mailing list
> Bacula-users AT lists.sourceforge DOT net
> https://lists.sourceforge.net/lists/listinfo/bacula-users
--
Arno Lehmann
IT-Service Lehmann
Sandstr. 6, 49080 Osnabrück
www.its-lehmann.de
-------------------------------------------------------------------------
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/
_______________________________________________
Bacula-users mailing list
Bacula-users AT lists.sourceforge DOT net
https://lists.sourceforge.net/lists/listinfo/bacula-users
|
