I'm having more weird problems backing up the server I mentioned
yesterday (where amstatus was dying). I came in this morning, and
discovered that last night's incremental backup job is still running,
and that it seems to be because 4 dumper threads to that server are
stalled out.
amstatus shows the following:
fileserver:/files/1 1 25455835k dumping 25212958k (
99.05%) (4:02:22)
fileserver:/files/2 1 600485k dumping 0k (8:58:54)
fileserver:/files/3 1 4588766k dumping 4766k ( 0.10%)
(7:22:08)
fileserver:/files/4 1 5691741k dumping 27k (
0.00%) (6:19:02)
These numbers haven't changed in the last hour. As well, it looks like
perhaps half of the disk entries for that server, the other half are
still waiting to be dumped. A ps on the amanda server reveals:
5420 ? S 0:00 \_ /bin/sh /usr/sbin/amdump daily
5430 ? S 0:02 \_ /usr/lib/amanda/driver daily
5431 ? S 0:27 \_ taper daily
5432 ? S 0:05 | \_ taper daily
5439 ? S 0:14 \_ dumper0 daily
6763 ? Z 0:01 | \_ [gzip] <defunct>
6764 ? Z 0:00 | \_ [gzip] <defunct>
5440 ? S 3:47 \_ dumper1 daily
6519 ? Z 85:00 | \_ [gzip] <defunct>
6520 ? Z 0:00 | \_ [gzip] <defunct>
5441 ? S 0:28 \_ dumper2 daily
6585 ? Z 0:00 | \_ [gzip] <defunct>
6586 ? Z 0:00 | \_ [gzip] <defunct>
5442 ? S 1:46 \_ dumper3 daily
6792 ? S 0:00 | \_ /bin/gzip --fast
6793 ? S 0:00 | \_ /bin/gzip --best
5443 ? S 0:05 \_ dumper4 daily
Doesn't look good. :(
On the client server, I see the following:
5128 ? S 0:00 /usr/lib/amanda/sendbackup
7659 ? S 0:00 /usr/lib/amanda/sendbackup
9345 ? S 0:00 /usr/lib/amanda/sendbackup
11830 ? S 0:00 /usr/lib/amanda/sendbackup
According to top, none of them is using any processor time.
I'm doing server-side compression on these disks, so that shouldn't be a
problem. Does anyone have any ideas what's going on here, or any ideas
what I should look at next? This config was all working just last week,
the only thing I've changed is added a few more disklist entries. :(
Graeme
--
Graeme Humphries (graeme.humphries AT vcom DOT com)
(306) 955-7075 ext. 485
My views are not the views of my employers.
|
