Bacula-users

Re: [Bacula-users] Could not connect to Storage daemon

2014-10-09 12:55:47
Subject: Re: [Bacula-users] Could not connect to Storage daemon
From: Ana Emília M. Arruda <emiliaarruda AT gmail DOT com>
To: David Newman <dnewman AT networktest DOT com>
Date: Thu, 9 Oct 2014 13:53:16 -0300
Hi David,

Could you clarify some points?

1) your storage daemon is running on backups.networktest.com:9103.?
2) who is listening on the 3 ports bellow?
$ sudo netstat -an -f inet | grep 910
tcp4       0      0 *.9102                 *.*                    LISTEN
tcp4       0      0 *.9103                 *.*                    LISTEN
tcp4       0      0 *.9101                 *.*                    LISTEN
3) are your director and storage at the same host?
4) all the failed jobs presents the same connection error?
02-Oct 00:45 nye-dir JobId 20983: Warning: bsock.c:132 Could not connect
to Storage daemon on backups.networktest.com:9103. ERR=Connection refused
Retrying ...

It seems to me you have some networking problems....

Regards,
Ana

On Tue, Oct 7, 2014 at 1:56 PM, David Newman <dnewman AT networktest DOT com> wrote:
On 10/6/14, 9:20 PM, David Newman wrote:
> On 10/3/14, 7:47 AM, Ana Emília M. Arruda wrote:
>> Hi David,
>>
>> Have you tried to schedule the job at another time? Just for checking if
>> the problem is at the scheduled time you're trying to run the job or not.
>
> Great question. First time I tried this, it failed. Also, bconsole could
> not connect.
>
> After a reboot, the rescheduled incremental backup worked for the first
> few hosts. It's still running.
>
> When it's done, I'll change bacula-dir.conf back to the original time,
> restart everything, and report back.

An update: Incremental jobs for some (not all) of the hosts completed
successfully after changing the start time in bacula-dir.conf. I do not
see a pattern as to which ones failed or succeeded.

After changing back to the original time and restarting via the
bacula-dir script, all incremental jobs failed. The netstat utility says
the backup machine is listening on ports 910[1-3]:

$ sudo netstat -an -f inet | grep 910
tcp4       0      0 *.9102                 *.*                    LISTEN
tcp4       0      0 *.9103                 *.*                    LISTEN
tcp4       0      0 *.9101                 *.*                    LISTEN

Thanks in advance for additional troubleshooting skills.

dn


>
> dn
>
>
>
>>
>> Regards,
>> Ana
>>
>> On Fri, Oct 3, 2014 at 11:07 AM, David Newman <dnewman AT networktest DOT com
>> <mailto:dnewman AT networktest DOT com>> wrote:
>>
>>     On 10/2/14, 8:03 PM, Ana Emília M. Arruda wrote:
>>
>>     > Hi David,
>>     >
>>     > Have you checked about scheduled events that could be leading your
>>     > bacula-sd host unavailable at that time? Some kind of outage?
>>
>>     Hi Ana,
>>
>>     As far as I know there's no other service doing anything with bacula-sd.
>>     The same setup worked for years with FreeBSD 8.x and 9.x; the only
>>     difference is that it doesn't work with FreeBSD 10.x.
>>
>>     Puzzling that manual backups work, but automated ones don't.
>>
>>     dn
>>
>>
>>     >
>>     > Regards,
>>     > Ana
>>     >
>>     > On Thu, Oct 2, 2014 at 2:01 PM, David Newman <dnewman AT networktest DOT com <mailto:dnewman AT networktest DOT com>
>>     > <mailto:dnewman AT networktest DOT com <mailto:dnewman AT networktest DOT com>>> wrote:
>>     >
>>     >     Bacula 5.2.12 installed as a pkg on FreeBSD 10.0-RELEASE-p9
>>     >
>>     >     Nightly backups fail with "Connection refused" errors like those pasted
>>     >     below.
>>     >
>>     >     However:
>>     >
>>     >     - backups succeed when run manually from bconsole; and
>>     >
>>     >     - the Bacula server can telnet to the backups.networktest.com <http://backups.networktest.com>
>>     >     <http://backups.networktest.com> address on
>>     >     port 9103.
>>     >
>>     >     I've also pasted the Schedule sections from bacula-dir.conf.
>>     >
>>     >     Thanks in advance for troubleshooting clues.
>>     >
>>     >     dn
>>     >
>>     >
>>     >
>>     >     02-Oct 00:35 nye-dir JobId 20983: Start Backup JobId 20983,
>>     >     Job=ca.2014-10-01_23.05.00_04
>>     >     02-Oct 00:35 nye-dir JobId 20983: Warning: bsock.c:132 Could not connect
>>     >     to Storage daemon on backups.networktest.com:9103 <http://backups.networktest.com:9103>
>>     >     <http://backups.networktest.com:9103>. ERR=Connection refused
>>     >     Retrying ...
>>     >     02-Oct 00:40 nye-dir JobId 20983: Warning: bsock.c:132 Could not connect
>>     >     to Storage daemon on backups.networktest.com:9103 <http://backups.networktest.com:9103>
>>     >     <http://backups.networktest.com:9103>. ERR=Connection refused
>>     >     Retrying ...
>>     >     02-Oct 00:45 nye-dir JobId 20983: Warning: bsock.c:132 Could not connect
>>     >     to Storage daemon on backups.networktest.com:9103 <http://backups.networktest.com:9103>
>>     >     <http://backups.networktest.com:9103>. ERR=Connection refused
>>     >     Retrying ...
>>     >     02-Oct 00:50 nye-dir JobId 20983: Warning: bsock.c:132 Could not connect
>>     >     to Storage daemon on backups.networktest.com:9103 <http://backups.networktest.com:9103>
>>     >     <http://backups.networktest.com:9103>. ERR=Connection refused
>>     >     Retrying ...
>>     >     02-Oct 00:56 nye-dir JobId 20983: Warning: bsock.c:132 Could not connect
>>     >     to Storage daemon on backups.networktest.com:9103 <http://backups.networktest.com:9103>
>>     >     <http://backups.networktest.com:9103>. ERR=Connection refused
>>     >     Retrying ...
>>     >     02-Oct 01:01 nye-dir JobId 20983: Warning: bsock.c:132 Could not connect
>>     >     to Storage daemon on backups.networktest.com:9103 <http://backups.networktest.com:9103>
>>     >     <http://backups.networktest.com:9103>. ERR=Connection refused
>>     >     Retrying ...
>>     >     02-Oct 01:05 nye-dir JobId 20983: Fatal error: bsock.c:138 Unable to
>>     >     connect to Storage daemon on backups.networktest.com:9103 <http://backups.networktest.com:9103>
>>     >     <http://backups.networktest.com:9103>.
>>     >     ERR=Connection refused
>>     >
>>     >
>>     >
>>     >     # List of files to be backed up
>>     >     # When to do the backups, full backup on first sunday of the month,
>>     >     #  differential (i.e. incremental since full) every other sunday,
>>     >     #  and incremental backups other days
>>     >     Schedule {
>>     >       Name = "WeeklyCycle"
>>     >       Run = Full 1st sun at 23:05
>>     >       Run = Differential 2nd-5th sun at 23:05
>>     >       Run = Incremental mon-sat at 23:05
>>     >     }
>>     >
>>     >     # This schedule does the catalog. It starts after the WeeklyCycle
>>     >     Schedule {
>>     >       Name = "WeeklyCycleAfterBackup"
>>     >       Run = Full sun-sat at 23:55
>>     >     }
>>     >
>>     >
>>     >     ------------------------------------------------------------------------------
>>     >     Meet PCI DSS 3.0 Compliance Requirements with EventLog Analyzer
>>     >     Achieve PCI DSS 3.0 Compliant Status with Out-of-the-box PCI DSS Reports
>>     >     Are you Audit-Ready for PCI DSS 3.0 Compliance? Download White paper
>>     >     Comply to PCI DSS 3.0 Requirement 10 and 11.5 with EventLog Analyzer
>>     >     http://pubads.g.doubleclick.net/gampad/clk?id=154622311&iu=/4140/ostg.clktrk
>>     >     _______________________________________________
>>     >     Bacula-users mailing list
>>     >     Bacula-users AT lists.sourceforge DOT net
>>     <mailto:Bacula-users AT lists.sourceforge DOT net>
>>     >     <mailto:Bacula-users AT lists.sourceforge DOT net
>>     <mailto:Bacula-users AT lists.sourceforge DOT net>>
>>     >     https://lists.sourceforge.net/lists/listinfo/bacula-users
>>     >
>>     >
>>
>>     ------------------------------------------------------------------------------
>>     Meet PCI DSS 3.0 Compliance Requirements with EventLog Analyzer
>>     Achieve PCI DSS 3.0 Compliant Status with Out-of-the-box PCI DSS Reports
>>     Are you Audit-Ready for PCI DSS 3.0 Compliance? Download White paper
>>     Comply to PCI DSS 3.0 Requirement 10 and 11.5 with EventLog Analyzer
>>     http://pubads.g.doubleclick.net/gampad/clk?id=154622311&iu=/4140/ostg.clktrk
>>     _______________________________________________
>>     Bacula-users mailing list
>>     Bacula-users AT lists.sourceforge DOT net
>>     <mailto:Bacula-users AT lists.sourceforge DOT net>
>>     https://lists.sourceforge.net/lists/listinfo/bacula-users
>>
>>
>
> ------------------------------------------------------------------------------
> Meet PCI DSS 3.0 Compliance Requirements with EventLog Analyzer
> Achieve PCI DSS 3.0 Compliant Status with Out-of-the-box PCI DSS Reports
> Are you Audit-Ready for PCI DSS 3.0 Compliance? Download White paper
> Comply to PCI DSS 3.0 Requirement 10 and 11.5 with EventLog Analyzer
> http://pubads.g.doubleclick.net/gampad/clk?id=154622311&iu=/4140/ostg.clktrk
> _______________________________________________
> Bacula-users mailing list
> Bacula-users AT lists.sourceforge DOT net
> https://lists.sourceforge.net/lists/listinfo/bacula-users
>

------------------------------------------------------------------------------
Meet PCI DSS 3.0 Compliance Requirements with EventLog Analyzer
Achieve PCI DSS 3.0 Compliant Status with Out-of-the-box PCI DSS Reports
Are you Audit-Ready for PCI DSS 3.0 Compliance? Download White paper
Comply to PCI DSS 3.0 Requirement 10 and 11.5 with EventLog Analyzer
http://pubads.g.doubleclick.net/gampad/clk?id=154622311&iu=/4140/ostg.clktrk
_______________________________________________
Bacula-users mailing list
Bacula-users AT lists.sourceforge DOT net
https://lists.sourceforge.net/lists/listinfo/bacula-users

------------------------------------------------------------------------------
Meet PCI DSS 3.0 Compliance Requirements with EventLog Analyzer
Achieve PCI DSS 3.0 Compliant Status with Out-of-the-box PCI DSS Reports
Are you Audit-Ready for PCI DSS 3.0 Compliance? Download White paper
Comply to PCI DSS 3.0 Requirement 10 and 11.5 with EventLog Analyzer
http://pubads.g.doubleclick.net/gampad/clk?id=154622311&iu=/4140/ostg.clktrk
_______________________________________________
Bacula-users mailing list
Bacula-users AT lists.sourceforge DOT net
https://lists.sourceforge.net/lists/listinfo/bacula-users