Hello,
29.11.2008 19:45, Bob Hetzel wrote:
>
>> From: Arno Lehmann <al AT its-lehmann DOT de>
> > Date: Thu, 27 Nov 2008 08:14:45 +0100
>> Hi,
> >
>> 26.11.2008 21:22, Bob Hetzel wrote:
>>>> I've got bacula currently in a hung state with the following interesting
>>>> info. When I run a status storage produces the following...
>> Is your Bacula still stuck? If so, and you have gdb installed, and a
>> Bacula with debug symbols, now might be a good time to see what it's
>> doing...
>>
>
> I'll put the traceback at the end
Great.
>>>> Used Volume status:
>>>> [nothing further and the bconsole program hangs here]
>> That alone would be a bug, I guess...
> [snip]
>> Sounds like it's worth a bug report - especially if you can re-create
>> the problem. I cc'ed this to Eric, who - I believe - has been working
>> on this sort of problems recently.
As I'm a bit too busy right now I forward this to Eric again - if he's
still working on this he might know if it relates to any current bug
report. Perhaps he even opens one himself :-)
Please see my inline comments first, especially the last ones...
>> Arno
>>
> It didn't crash so I tried to force the traceback per the instructions
> at http://www.bacula.org/en/dev-manual/What_Do_When_Bacula.html
>
> The first line of the output implies that I did something wrong but
> anyway...
I don't know why that message appears, but the traceback looks good to me.
> /usr/sbin: No such file or directory.
> Using host libthread_db library "/lib/libthread_db.so.1".
> [Thread debugging using libthread_db enabled]
> [New Thread -1214433584 (LWP 5411)]
> [New Thread -1416819824 (LWP 9229)]
> [New Thread -1425212528 (LWP 8819)]
> [New Thread -1374856304 (LWP 8816)]
> [New Thread -1341285488 (LWP 8670)]
> [New Thread -1400034416 (LWP 8553)]
> [New Thread -1366463600 (LWP 8402)]
> [New Thread -1442006128 (LWP 8160)]
> [New Thread -1408427120 (LWP 8157)]
> [New Thread -1383249008 (LWP 8154)]
> [New Thread -1358070896 (LWP 8151)]
> [New Thread -1324434544 (LWP 8017)]
> [New Thread -1316041840 (LWP 8016)]
> [New Thread -1307649136 (LWP 8015)]
> [New Thread -1282483312 (LWP 8014)]
> [New Thread -1274090608 (LWP 8013)]
> [New Thread -1265697904 (LWP 8012)]
> [New Thread -1257292912 (LWP 8007)]
> [New Thread -1248900208 (LWP 8004)]
> [New Thread -1240507504 (LWP 8003)]
> [New Thread -1299256432 (LWP 8002)]
> [New Thread -1332892784 (LWP 8001)]
> [New Thread -1433613424 (LWP 8000)]
> [New Thread -1231897712 (LWP 7921)]
> [New Thread -1223505008 (LWP 5414)]
> [New Thread -1215112304 (LWP 5413)]
> 0xb7f6a410 in __kernel_vsyscall ()
> $1 = "gyrus-dir", '\0' <repeats 20 times>
> $2 = 0x80f8e00 "bacula-dir"
> $3 = 0x80f90b0 "/usr/sbin/"
> $4 = 0x80f91e0 "MySQL"
> $5 = 0x80ed18b "2.4.3 (10 October 2008)"
> $6 = 0x80ed1a3 "i686-pc-linux-gnu"
> $7 = 0x80ed1b5 "suse"
> $8 = 0x80ed1ba "10.2"
> #0 0xb7f6a410 in __kernel_vsyscall ()
> #1 0xb7c73876 in __nanosleep_nocancel () from /lib/libpthread.so.0
> #2 0x080a827b in bmicrosleep (sec=60, usec=0) at bsys.c:71
> #3 0x08071b28 in wait_for_next_job (one_shot_job_to_run=0x0) at
> scheduler.c:130
> #4 0x0804de85 in main (argc=0, argv=0xbfe00164) at dird.c:288
>
> Thread 26 (Thread -1215112304 (LWP 5413)):
> #0 0xb7f6a410 in __kernel_vsyscall ()
> #1 0xb7adba41 in ___newselect_nocancel () from /lib/libc.so.6
> #2 0x080a99b9 in bnet_thread_server (addrs=0x80f9860, max_clients=20,
> client_wq=0x80f64e0, handle_client_request=0x808d536
> <handle_UA_client_request>)
> at bnet_server.c:161
The above line looks like it might be related to the problem... in
general, there's one thread per job running (plus the parent threads),
and the variable max_clients might indicate the number of currently
active thread servers is exhausted or something...
> #3 0x0808d52e in connect_thread (arg=0x80f9860) at ua_server.c:84
> #4 0xb7c6c112 in start_thread () from /lib/libpthread.so.0
> #5 0xb7ae22ee in clone () from /lib/libc.so.6
>
> Thread 25 (Thread -1223505008 (LWP 5414)):
> #0 0xb7f6a410 in __kernel_vsyscall ()
> #1 0xb7c707dc in pthread_cond_timedwait@@GLIBC_2.3.2 () from
> /lib/libpthread.so.0
> #2 0x080ccf27 in watchdog_thread (arg=0x0) at watchdog.c:307
> #3 0xb7c6c112 in start_thread () from /lib/libpthread.so.0
> #4 0xb7ae22ee in clone () from /lib/libc.so.6
Above: a watchdog / timer thread?
> Thread 24 (Thread -1231897712 (LWP 7921)):
> #0 0xb7f6a410 in __kernel_vsyscall ()
> #1 0xb7c7302b in __read_nocancel () from /lib/libpthread.so.0
> #2 0x080a9300 in read_nbytes (bsock=0x8213df0, ptr=0xb692b1b4
> "\333\v\016\b\350\261\222\266\217#", nbytes=4) at bnet.c:82
> #3 0x080aba1c in BSOCK::recv (this=0x8213df0) at bsock.c:381
> #4 0x080a9021 in bnet_recv (bsock=0x8213df0) at bnet.c:187
> #5 0x0808ef27 in do_storage_status (ua=0x8173d48, store=0x81d9f00) at
> ua_status.c:325
> #6 0x0808f6ae in status_cmd (ua=0x8173d48, cmd=0x8160778 "status
> storage") at ua_status.c:134
> #7 0x08076dd0 in do_a_command (ua=0x8173d48, cmd=0x8160778 "status
> storage") at ua_cmds.c:180
> #8 0x0808d647 in handle_UA_client_request (arg=0x81b77e8) at
> ua_server.c:147
> #9 0x080cd952 in workq_server (arg=0x80f64e0) at workq.c:357
> #10 0xb7c6c112 in start_thread () from /lib/libpthread.so.0
> #11 0xb7ae22ee in clone () from /lib/libc.so.6
This one: a storage status request.
> Thread 23 (Thread -1433613424 (LWP 8000)):
> #0 0xb7f6a410 in __kernel_vsyscall ()
> #1 0xb7c7302b in __read_nocancel () from /lib/libpthread.so.0
> #2 0x080a9300 in read_nbytes (bsock=0x820e898, ptr=0xaa8cc024 "",
> nbytes=4) at bnet.c:82
> #3 0x080aba1c in BSOCK::recv (this=0x820e898) at bsock.c:381
> #4 0x0805de81 in bget_dirmsg (bs=0x820e898) at getmsg.c:109
> #5 0x080513f8 in wait_for_job_termination (jcr=0x821ac70) at backup.c:274
> #6 0x08051abd in do_backup (jcr=0x821ac70) at backup.c:235
> #7 0x08063da5 in job_thread (arg=0x821ac70) at job.c:290
> #8 0x080659db in jobq_server (arg=0x80f6340) at jobq.c:466
> #9 0xb7c6c112 in start_thread () from /lib/libpthread.so.0
> #10 0xb7ae22ee in clone () from /lib/libc.so.6
This one: A job running?
>
> Thread 22 (Thread -1332892784 (LWP 8001)):
> #0 0xb7f6a410 in __kernel_vsyscall ()
> #1 0xb7c7302b in __read_nocancel () from /lib/libpthread.so.0
> #2 0x080a9300 in read_nbytes (bsock=0xb2f00b28, ptr=0xb08d9f44
> "\264/Ç·(\240\215\260\340\354\030\b0\354\030\bp", nbytes=4) at bnet.c:82
> #3 0x080aba1c in BSOCK::recv (this=0xb2f00b28) at bsock.c:381
> #4 0x0805de81 in bget_dirmsg (bs=0xb2f00b28) at getmsg.c:109
> #5 0x0806c08f in start_storage_daemon_job (jcr=0x82238c8, rstore=0x0,
> wstore=0x818f970) at msgchan.c:285
> #6 0x080517e3 in do_backup (jcr=0x82238c8) at backup.c:142
> #7 0x08063da5 in job_thread (arg=0x82238c8) at job.c:290
> #8 0x080659db in jobq_server (arg=0x80f6340) at jobq.c:466
> #9 0xb7c6c112 in start_thread () from /lib/libpthread.so.0
> #10 0xb7ae22ee in clone () from /lib/libc.so.6
Another job running?
> Thread 21 (Thread -1299256432 (LWP 8002)):
> #0 0xb7f6a410 in __kernel_vsyscall ()
> #1 0xb7c707dc in pthread_cond_timedwait@@GLIBC_2.3.2 () from
> /lib/libpthread.so.0
> #2 0x0806afd8 in wait_for_storage_daemon_termination (jcr=0x8211270) at
> msgchan.c:409
> #3 0x080514e2 in wait_for_job_termination (jcr=0x8211270) at backup.c:304
> #4 0x08051abd in do_backup (jcr=0x8211270) at backup.c:235
> #5 0x08063da5 in job_thread (arg=0x8211270) at job.c:290
> #6 0x080659db in jobq_server (arg=0x80f6340) at jobq.c:466
> #7 0xb7c6c112 in start_thread () from /lib/libpthread.so.0
> #8 0xb7ae22ee in clone () from /lib/libc.so.6
Another job?
> Thread 20 (Thread -1240507504 (LWP 8003)):
> #0 0xb7f6a410 in __kernel_vsyscall ()
> #1 0xb7c7302b in __read_nocancel () from /lib/libpthread.so.0
> #2 0x080a9300 in read_nbytes (bsock=0xb2f02f28, ptr=0xb60f5024 "",
> nbytes=4) at bnet.c:82
> #3 0x080aba1c in BSOCK::recv (this=0xb2f02f28) at bsock.c:381
> #4 0x0805de81 in bget_dirmsg (bs=0xb2f02f28) at getmsg.c:109
> #5 0x080513f8 in wait_for_job_termination (jcr=0x8221cb8) at backup.c:274
> #6 0x08051abd in do_backup (jcr=0x8221cb8) at backup.c:235
> #7 0x08063da5 in job_thread (arg=0x8221cb8) at job.c:290
> #8 0x080659db in jobq_server (arg=0x80f6340) at jobq.c:466
> #9 0xb7c6c112 in start_thread () from /lib/libpthread.so.0
> #10 0xb7ae22ee in clone () from /lib/libc.so.6
Another job?
> Thread 19 (Thread -1248900208 (LWP 8004)):
> #0 0xb7f6a410 in __kernel_vsyscall ()
> #1 0xb7c7302b in __read_nocancel () from /lib/libpthread.so.0
> #2 0x080a9300 in read_nbytes (bsock=0xb2f03008, ptr=0xb58f4024 "",
> nbytes=4) at bnet.c:82
> #3 0x080aba1c in BSOCK::recv (this=0xb2f03008) at bsock.c:381
> #4 0x0805de81 in bget_dirmsg (bs=0xb2f03008) at getmsg.c:109
> #5 0x080513f8 in wait_for_job_termination (jcr=0x8215870) at backup.c:274
> #6 0x08051abd in do_backup (jcr=0x8215870) at backup.c:235
> #7 0x08063da5 in job_thread (arg=0x8215870) at job.c:290
> #8 0x080659db in jobq_server (arg=0x80f6340) at jobq.c:466
> #9 0xb7c6c112 in start_thread () from /lib/libpthread.so.0
> #10 0xb7ae22ee in clone () from /lib/libc.so.6
Another job?
> Thread 18 (Thread -1257292912 (LWP 8007)):
> #0 0xb7f6a410 in __kernel_vsyscall ()
> #1 0xb7c7302b in __read_nocancel () from /lib/libpthread.so.0
> #2 0x080a9300 in read_nbytes (bsock=0x82af080,
> ptr=0xb50f2f44
> +"\264/Ç·(0\017\265\360\366\032\b@\366\032\b\220\004\033\b\3100\017\265\201\336\005\b\200\360*\b\264/Ç·H0\017\265\260\221\n\b\200\360*\b\234}\032\b\004",
> +nbytes=4)
> at bnet.c:82
> #3 0x080aba1c in BSOCK::recv (this=0x82af080) at bsock.c:381
> #4 0x0805de81 in bget_dirmsg (bs=0x82af080) at getmsg.c:109
> #5 0x0806c08f in start_storage_daemon_job (jcr=0x82246d0, rstore=0x0,
> wstore=0x8190518) at msgchan.c:285
> #6 0x080517e3 in do_backup (jcr=0x82246d0) at backup.c:142
> #7 0x08063da5 in job_thread (arg=0x82246d0) at job.c:290
> #8 0x080659db in jobq_server (arg=0x80f6340) at jobq.c:466
> #9 0xb7c6c112 in start_thread () from /lib/libpthread.so.0
> #10 0xb7ae22ee in clone () from /lib/libc.so.6
Another job?
> Thread 17 (Thread -1265697904 (LWP 8012)):
> #0 0xb7f6a410 in __kernel_vsyscall ()
> #1 0xb7c707dc in pthread_cond_timedwait@@GLIBC_2.3.2 () from
> /lib/libpthread.so.0
> #2 0x0806afd8 in wait_for_storage_daemon_termination (jcr=0x8222ac0) at
> msgchan.c:409
> #3 0x080514e2 in wait_for_job_termination (jcr=0x8222ac0) at backup.c:304
> #4 0x08051abd in do_backup (jcr=0x8222ac0) at backup.c:235
> #5 0x08063da5 in job_thread (arg=0x8222ac0) at job.c:290
> #6 0x080659db in jobq_server (arg=0x80f6340) at jobq.c:466
> #7 0xb7c6c112 in start_thread () from /lib/libpthread.so.0
> #8 0xb7ae22ee in clone () from /lib/libc.so.6
Another running job?
> Thread 16 (Thread -1274090608 (LWP 8013)):
> #0 0xb7f6a410 in __kernel_vsyscall ()
> #1 0xb7c707dc in pthread_cond_timedwait@@GLIBC_2.3.2 () from
> /lib/libpthread.so.0
> #2 0x0806afd8 in wait_for_storage_daemon_termination (jcr=0x8212e70) at
> msgchan.c:409
> #3 0x080514e2 in wait_for_job_termination (jcr=0x8212e70) at backup.c:304
> #4 0x08051abd in do_backup (jcr=0x8212e70) at backup.c:235
> #5 0x08063da5 in job_thread (arg=0x8212e70) at job.c:290
> #6 0x080659db in jobq_server (arg=0x80f6340) at jobq.c:466
> #7 0xb7c6c112 in start_thread () from /lib/libpthread.so.0
> #8 0xb7ae22ee in clone () from /lib/libc.so.6
Another job running...
> Thread 15 (Thread -1282483312 (LWP 8014)):
> #0 0xb7f6a410 in __kernel_vsyscall ()
> #1 0xb7c7302b in __read_nocancel () from /lib/libpthread.so.0
> #2 0x080a9300 in read_nbytes (bsock=0x82adf18, ptr=0xb38ecf44
> "\264/Ç·(\320\216\263\020\345\032\b`\344\032\b", nbytes=4) at bnet.c:82
> #3 0x080aba1c in BSOCK::recv (this=0x82adf18) at bsock.c:381
> #4 0x0805de81 in bget_dirmsg (bs=0x82adf18) at getmsg.c:109
> #5 0x0806c08f in start_storage_daemon_job (jcr=0x8227ef0, rstore=0x0,
> wstore=0x818ff98) at msgchan.c:285
> #6 0x080517e3 in do_backup (jcr=0x8227ef0) at backup.c:142
> #7 0x08063da5 in job_thread (arg=0x8227ef0) at job.c:290
> #8 0x080659db in jobq_server (arg=0x80f6340) at jobq.c:466
> #9 0xb7c6c112 in start_thread () from /lib/libpthread.so.0
> #10 0xb7ae22ee in clone () from /lib/libc.so.6
Another job...
> Thread 14 (Thread -1307649136 (LWP 8015)):
> #0 0xb7f6a410 in __kernel_vsyscall ()
> #1 0xb7c707dc in pthread_cond_timedwait@@GLIBC_2.3.2 () from
> /lib/libpthread.so.0
> #2 0x0806afd8 in wait_for_storage_daemon_termination (jcr=0x8208a08) at
> msgchan.c:409
> #3 0x080514e2 in wait_for_job_termination (jcr=0x8208a08) at backup.c:304
> #4 0x08051abd in do_backup (jcr=0x8208a08) at backup.c:235
> #5 0x08063da5 in job_thread (arg=0x8208a08) at job.c:290
> #6 0x080659db in jobq_server (arg=0x80f6340) at jobq.c:466
> #7 0xb7c6c112 in start_thread () from /lib/libpthread.so.0
> #8 0xb7ae22ee in clone () from /lib/libc.so.6
Another job...
> Thread 13 (Thread -1316041840 (LWP 8016)):
> #0 0xb7f6a410 in __kernel_vsyscall ()
> #1 0xb7c707dc in pthread_cond_timedwait@@GLIBC_2.3.2 () from
> /lib/libpthread.so.0
> #2 0x0806afd8 in wait_for_storage_daemon_termination (jcr=0x821e470) at
> msgchan.c:409
> #3 0x080514e2 in wait_for_job_termination (jcr=0x821e470) at backup.c:304
> #4 0x08051abd in do_backup (jcr=0x821e470) at backup.c:235
> #5 0x08063da5 in job_thread (arg=0x821e470) at job.c:290
> #6 0x080659db in jobq_server (arg=0x80f6340) at jobq.c:466
> #7 0xb7c6c112 in start_thread () from /lib/libpthread.so.0
> #8 0xb7ae22ee in clone () from /lib/libc.so.6
Another job?
> Thread 12 (Thread -1324434544 (LWP 8017)):
> #0 0xb7f6a410 in __kernel_vsyscall ()
> #1 0xb7c707dc in pthread_cond_timedwait@@GLIBC_2.3.2 () from
> /lib/libpthread.so.0
> #2 0x0806afd8 in wait_for_storage_daemon_termination (jcr=0x8204df0) at
> msgchan.c:409
> #3 0x080514e2 in wait_for_job_termination (jcr=0x8204df0) at backup.c:304
> #4 0x08051abd in do_backup (jcr=0x8204df0) at backup.c:235
> #5 0x08063da5 in job_thread (arg=0x8204df0) at job.c:290
> #6 0x080659db in jobq_server (arg=0x80f6340) at jobq.c:466
> #7 0xb7c6c112 in start_thread () from /lib/libpthread.so.0
> #8 0xb7ae22ee in clone () from /lib/libc.so.6
Another job...
> Thread 11 (Thread -1358070896 (LWP 8151)):
> #0 0xb7f6a410 in __kernel_vsyscall ()
> #1 0xb7c7302b in __read_nocancel () from /lib/libpthread.so.0
> #2 0x080a9300 in read_nbytes (bsock=0x820f190, ptr=0xaf0d7114 "",
> nbytes=4) at bnet.c:82
> #3 0x080aba1c in BSOCK::recv (this=0x820f190) at bsock.c:381
> #4 0x0805de81 in bget_dirmsg (bs=0x820f190) at getmsg.c:109
> #5 0x0806b2f5 in msg_thread (arg=0x8208a08) at msgchan.c:374
> #6 0xb7c6c112 in start_thread () from /lib/libpthread.so.0
> #7 0xb7ae22ee in clone () from /lib/libc.so.6
Something I can't guess what it does... some message thread, currently
reading from somewhere.
> Thread 10 (Thread -1383249008 (LWP 8154)):
> #0 0xb7f6a410 in __kernel_vsyscall ()
> #1 0xb7c7302b in __read_nocancel () from /lib/libpthread.so.0
> #2 0x080a9300 in read_nbytes (bsock=0x82b5000, ptr=0xad8d4114 "",
> nbytes=4) at bnet.c:82
> #3 0x080aba1c in BSOCK::recv (this=0x82b5000) at bsock.c:381
> #4 0x0805de81 in bget_dirmsg (bs=0x82b5000) at getmsg.c:109
> #5 0x0806b2f5 in msg_thread (arg=0x8211270) at msgchan.c:374
> #6 0xb7c6c112 in start_thread () from /lib/libpthread.so.0
> #7 0xb7ae22ee in clone () from /lib/libc.so.6
Another message thread?
> Thread 9 (Thread -1408427120 (LWP 8157)):
> #0 0xb7f6a410 in __kernel_vsyscall ()
> #1 0xb7c7302b in __read_nocancel () from /lib/libpthread.so.0
> #2 0x080a9300 in read_nbytes (bsock=0x82ade78, ptr=0xac0d1114 "",
> nbytes=4) at bnet.c:82
> #3 0x080aba1c in BSOCK::recv (this=0x82ade78) at bsock.c:381
> #4 0x0805de81 in bget_dirmsg (bs=0x82ade78) at getmsg.c:109
> #5 0x0806b2f5 in msg_thread (arg=0x8204df0) at msgchan.c:374
> #6 0xb7c6c112 in start_thread () from /lib/libpthread.so.0
> #7 0xb7ae22ee in clone () from /lib/libc.so.6
Another message thread?
> Thread 8 (Thread -1442006128 (LWP 8160)):
> #0 0xb7f6a410 in __kernel_vsyscall ()
> #1 0xb7c7302b in __read_nocancel () from /lib/libpthread.so.0
> #2 0x080a9300 in read_nbytes (bsock=0x8160da8, ptr=0xaa0cb114 "",
> nbytes=4) at bnet.c:82
> #3 0x080aba1c in BSOCK::recv (this=0x8160da8) at bsock.c:381
> #4 0x0805de81 in bget_dirmsg (bs=0x8160da8) at getmsg.c:109
> #5 0x0806b2f5 in msg_thread (arg=0x8212e70) at msgchan.c:374
> #6 0xb7c6c112 in start_thread () from /lib/libpthread.so.0
> #7 0xb7ae22ee in clone () from /lib/libc.so.6
Another message thread?
> Thread 7 (Thread -1366463600 (LWP 8402)):
> #0 0xb7f6a410 in __kernel_vsyscall ()
> #1 0xb7c7302b in __read_nocancel () from /lib/libpthread.so.0
> #2 0x080a9300 in read_nbytes (bsock=0xb2f01f20, ptr=0xae8d6114 "",
> nbytes=4) at bnet.c:82
> #3 0x080aba1c in BSOCK::recv (this=0xb2f01f20) at bsock.c:381
> #4 0x0805de81 in bget_dirmsg (bs=0xb2f01f20) at getmsg.c:109
> #5 0x0806b2f5 in msg_thread (arg=0x8215870) at msgchan.c:374
> #6 0xb7c6c112 in start_thread () from /lib/libpthread.so.0
> #7 0xb7ae22ee in clone () from /lib/libc.so.6
Messagethread, again?
> Thread 6 (Thread -1400034416 (LWP 8553)):
> #0 0xb7f6a410 in __kernel_vsyscall ()
> #1 0xb7c7302b in __read_nocancel () from /lib/libpthread.so.0
> #2 0x080a9300 in read_nbytes (bsock=0x8188718, ptr=0xac8d2114 "",
> nbytes=4) at bnet.c:82
> #3 0x080aba1c in BSOCK::recv (this=0x8188718) at bsock.c:381
> #4 0x0805de81 in bget_dirmsg (bs=0x8188718) at getmsg.c:109
> #5 0x0806b2f5 in msg_thread (arg=0x821ac70) at msgchan.c:374
> #6 0xb7c6c112 in start_thread () from /lib/libpthread.so.0
> #7 0xb7ae22ee in clone () from /lib/libc.so.6
One more...
> Thread 5 (Thread -1341285488 (LWP 8670)):
> #0 0xb7f6a410 in __kernel_vsyscall ()
> #1 0xb7c7302b in __read_nocancel () from /lib/libpthread.so.0
> #2 0x080a9300 in read_nbytes (bsock=0x82b6fc8, ptr=0xb00d9114 "",
> nbytes=4) at bnet.c:82
> #3 0x080aba1c in BSOCK::recv (this=0x82b6fc8) at bsock.c:381
> #4 0x0805de81 in bget_dirmsg (bs=0x82b6fc8) at getmsg.c:109
> #5 0x0806b2f5 in msg_thread (arg=0x821e470) at msgchan.c:374
> #6 0xb7c6c112 in start_thread () from /lib/libpthread.so.0
> #7 0xb7ae22ee in clone () from /lib/libc.so.6
And another one...
> Thread 4 (Thread -1374856304 (LWP 8816)):
> #0 0xb7f6a410 in __kernel_vsyscall ()
> #1 0xb7c7302b in __read_nocancel () from /lib/libpthread.so.0
> #2 0x080a9300 in read_nbytes (bsock=0xb2f01940, ptr=0xae0d5114 "",
> nbytes=4) at bnet.c:82
> #3 0x080aba1c in BSOCK::recv (this=0xb2f01940) at bsock.c:381
> #4 0x0805de81 in bget_dirmsg (bs=0xb2f01940) at getmsg.c:109
> #5 0x0806b2f5 in msg_thread (arg=0x8221cb8) at msgchan.c:374
> #6 0xb7c6c112 in start_thread () from /lib/libpthread.so.0
> #7 0xb7ae22ee in clone () from /lib/libc.so.6
And one more...
> Thread 3 (Thread -1425212528 (LWP 8819)):
> #0 0xb7f6a410 in __kernel_vsyscall ()
> #1 0xb7c7302b in __read_nocancel () from /lib/libpthread.so.0
> #2 0x080a9300 in read_nbytes (bsock=0x820c000, ptr=0xab0cf114 "",
> nbytes=4) at bnet.c:82
> #3 0x080aba1c in BSOCK::recv (this=0x820c000) at bsock.c:381
> #4 0x0805de81 in bget_dirmsg (bs=0x820c000) at getmsg.c:109
> #5 0x0806b2f5 in msg_thread (arg=0x8222ac0) at msgchan.c:374
> #6 0xb7c6c112 in start_thread () from /lib/libpthread.so.0
> #7 0xb7ae22ee in clone () from /lib/libc.so.6
And one more...
> Thread 2 (Thread -1416819824 (LWP 9229)):
> #0 0xb7f6a410 in __kernel_vsyscall ()
> #1 0xb7c7302b in __read_nocancel () from /lib/libpthread.so.0
> #2 0x080a9300 in read_nbytes (bsock=0x820ea78, ptr=0xab8d01d4
> "\377\001", nbytes=4) at bnet.c:82
> #3 0x080aba1c in BSOCK::recv (this=0x820ea78) at bsock.c:381
> #4 0x080a9021 in bnet_recv (bsock=0x820ea78) at bnet.c:187
> #5 0x0807594b in do_mount_cmd (ua=0x8213c70, command=0x80db09d "mount")
> at ua_cmds.c:1489
> #6 0x080759d1 in mount_cmd (ua=0x8213c70, cmd=0x8225cd8 "") at
> ua_cmds.c:1502
> #7 0x08076dd0 in do_a_command (ua=0x8213c70, cmd=0x8225cd8 "") at
> ua_cmds.c:180
> #8 0x0808d647 in handle_UA_client_request (arg=0x8213e90) at
> ua_server.c:147
> #9 0x080cd952 in workq_server (arg=0x80f64e0) at workq.c:357
> #10 0xb7c6c112 in start_thread () from /lib/libpthread.so.0
> #11 0xb7ae22ee in clone () from /lib/libc.so.6
A console job, doing a mount command.
> Thread 1 (Thread -1214433584 (LWP 5411)):
> #0 0xb7f6a410 in __kernel_vsyscall ()
> #1 0xb7c73876 in __nanosleep_nocancel () from /lib/libpthread.so.0
> #2 0x080a827b in bmicrosleep (sec=60, usec=0) at bsys.c:71
> #3 0x08071b28 in wait_for_next_job (one_shot_job_to_run=0x0) at
> scheduler.c:130
> #4 0x0804de85 in main (argc=0, argv=0xbfe00164) at dird.c:288
> #0 0xb7f6a410 in __kernel_vsyscall ()
> #0 0xb7f6a410 in __kernel_vsyscall ()
> No symbol table info available.
The main thread, I guess.
> #1 0xb7c73876 in __nanosleep_nocancel () from /lib/libpthread.so.0
> No symbol table info available.
> #2 0x080a827b in bmicrosleep (sec=60, usec=0) at bsys.c:71
> 71 stat = nanosleep(&timeout, NULL);
> Current language: auto; currently c++
> timeout = {tv_sec = 60, tv_nsec = 0}
> tv = {tv_sec = 3, tv_usec = 48}
> tz = {tz_minuteswest = 3, tz_dsttime = 10}
> stat = 0
> #3 0x08071b28 in wait_for_next_job (one_shot_job_to_run=0x0) at
> scheduler.c:130
> 130 bmicrosleep(next_check_secs, 0); /* recheck once per minute */
> jcr = (JCR *) 0x82254d8
> job = (JOB *) 0x8164af8
> run = (RUN *) 0x81dbfa8
> now = 45766
> prev = 1227723000
> next_job = (job_item *) 0x0
> first = false
> #4 0x0804de85 in main (argc=0, argv=0xbfe00164) at dird.c:288
> 288 while ( (jcr = wait_for_next_job(runjob)) ) {
> ch = -1
> jcr = (JCR *) 0x82254d8
> no_signals = false
> test_config = false
> uid = 0xbfe0051a "bacula"
> gid = 0xbfe00524 "bacula"
> #0 0x00000000 in ?? ()
> No symbol table info available.
> #0 0x00000000 in ?? ()
> No symbol table info available.
> #0 0x00000000 in ?? ()
> No symbol table info available.
Ok... there are quite a number of threads that could be console
connections. There is a hard limit of the active console connections -
it seems possible that you ran into that limit.
Have you checked how many console connections are currently open?
IIRC, if you SIGTERM a console, it does not necessarily die... so
there could be console processes laying around somewhere, keeping
their connections open.
If you find those and 'kill -9' them, do your new console connections
work?
Arno
--
Arno Lehmann
IT-Service Lehmann
Sandstr. 6, 49080 Osnabrück
www.its-lehmann.de
-------------------------------------------------------------------------
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/
_______________________________________________
Bacula-users mailing list
Bacula-users AT lists.sourceforge DOT net
https://lists.sourceforge.net/lists/listinfo/bacula-users
|