Amanda-Users

Disappearing Dumps...

2005-12-19 17:59:07
Subject: Disappearing Dumps...
From: Dan Brown <monkeypants AT shaw DOT ca>
To: amanda-users AT amanda DOT org
Date: Mon, 19 Dec 2005 16:53:32 -0600
 
I have recently just upgraded amanda an amanda installation from 2.4.4p1 and
upgraded the backup host from RedHat 7.3 to Fedora FC4.

I've also conglomerated the backed up hosts from several configurations
which ran independantly of each other, into a single configuration which
amanda will manage itself (hopefully well).
Other than the move of all hosts from their respective configurations into
one, not much else has changed.

There is a host however in this new config whose backups magically disappear
after the first chunk.  This host is a temporary copy of the old backup
host, something which will sit in the backup rotation for a month or two to
ensure we don't need any files off of the machine before it's completely
wiped out.
Strangely enough, level 0 backups don't want to be dumped to the holding
disks either.  This is the mailout from amanda after the backup attempt
(I've removed all other hosts in order to debug this).  The holding disks
are 150GB and 50GB in size respectively, both more than enough to hold any
one part of the split up disks.


-----------amanda
mailout----------------------------------------------------------
*** A TAPE ERROR OCCURRED: [cannot overwrite active tape Full00].
Some dumps may have been left in the holding disk.
Run amflush to flush them to tape.
The next tape Amanda expects to use is: a new tape.

FAILURE AND STRANGE DUMP SUMMARY:
  oldgimp  /clients         lev 0  FAILED [dumps too big, 12627453 KB, but
cannot incremental dump
 new disk]
  oldgimp  /var/lib/mysql   lev 0  FAILED [dumps too big, 12627455 KB, but
cannot incremental dump
 new disk]
  oldgimp  /everythingelse  lev 0  FAILED 20051219 [dumper3 died]
  oldgimp  /home            lev 0  FAILED 20051219 [dumper4 died]
  oldgimp  /zu/incoming     lev 0  FAILED 20051219 [dumper5 died]


STATISTICS:
                          Total       Full      Incr.
                        --------   --------   --------
Estimate Time (hrs:min)    0:01
Run Time (hrs:min)         4:34
Dump Time (hrs:min)        0:00       0:00       0:00
Output Size (meg)           0.0        0.0        0.0
Original Size (meg)         0.0        0.0        0.0
Avg Compressed Size (%)     --         --         -- 
Filesystems Dumped            0          0          0
Avg Dump Rate (k/s)         --         --         -- 

Tape Time (hrs:min)        0:00       0:00       0:00
Tape Size (meg)             0.0        0.0        0.0
Tape Used (%)               0.0        0.0        0.0
Filesystems Taped             0          0          0
Avg Tp Write Rate (k/s)     --         --         -- 

^L
NOTES:
  planner: tapecycle (8) <= runspercycle (20)
  planner: Adding new disk oldgimp:/clients.
  planner: Adding new disk oldgimp:/var/lib/mysql.
  planner: Adding new disk oldgimp:/zu/incoming.
  planner: Adding new disk oldgimp:/home.
  planner: Adding new disk oldgimp:/everythingelse.
  driver: dumper0 pid 18807 is messed up, ignoring it.
  driver: dumper0 died while dumping oldgimp:/everythingelse lev 0.
  driver: dumper1 pid 18808 is messed up, ignoring it.
  driver: dumper1 died while dumping oldgimp:/home lev 0.
  driver: dumper2 pid 18809 is messed up, ignoring it.
  driver: dumper2 died while dumping oldgimp:/zu/incoming lev 0.
  driver: dumper3 pid 18810 is messed up, ignoring it.
  driver: dumper4 pid 18811 is messed up, ignoring it.
  driver: dumper5 pid 18812 is messed up, ignoring it.
  driver: dumper0 exited with signal 25
  driver: dumper1 exited with signal 25
  driver: dumper2 exited with signal 25
  driver: dumper3 exited with signal 25
  driver: dumper4 exited with signal 25
  driver: dumper5 exited with signal 25

^L
DUMP SUMMARY:
                                     DUMPER STATS            TAPER STATS 
HOSTNAME     DISK        L ORIG-kB OUT-kB COMP% MMM:SS  KB/s MMM:SS  KB/s
-------------------------- --------------------------------- ------------
oldgimp      /clients    0 FAILED ---------------------------------------
oldgimp      -ythingelse 0 FAILED ---------------------------------------
oldgimp      /home       0 FAILED ---------------------------------------
oldgimp      -/lib/mysql 0 FAILED ---------------------------------------
oldgimp      -u/incoming 0 FAILED ---------------------------------------




And I'll spam with the rest of my config as well since someone will ask for
it...

-----------amanda.conf-----------------
org "Zu.COM - all hosts"# your organization name for reports
mailto "dan"            # space separated list of operators at your site
dumpuser "amanda"       # the user to run dumps under

inparallel 4            # maximum dumpers that will run in parallel (max 63)
dumporder "BTBT"        # specify the priority order of each dumper

netusage  10000 Kbps    # maximum net bandwidth for Amanda, in KB per sec

dumpcycle 4 weeks       # the number of days in the normal dump cycle
runspercycle 20         # the number of amdump runs in dumpcycle days
tapecycle 8 tapes       # the number of tapes in rotation

bumpsize 20 Mb          # minimum savings (threshold) to bump level 1 -> 2
bumpdays 1              # minimum days at each level
bumpmult 4              # threshold = bumpsize * bumpmult^(level-1)

etimeout 300            # number of seconds per filesystem for estimates.

dtimeout 1800           # number of idle seconds before a dump is aborted.

ctimeout 30             # maximum number of seconds that amcheck waits
                        # for each client host
 
tapebufs 256

runtapes 1              # number of tapes to be used in a single run of
amdump
tapedev "/dev/nst0"     # the no-rewind tape device to be used
rawtapedev "/dev/null"  # the raw device to be used (ftape only)

maxdumpsize -1          # Maximum number of bytes the planner will schedule
tapetype DLT4           # what kind of tape it is (see tapetypes below)
labelstr "^Full[0-9][0-9]*$"    # label constraint regex: all tapes must
match

amrecover_do_fsf yes            # amrecover will call amrestore with the
amrecover_check_label yes       # amrecover will call amrestore with the
amrecover_changer "/dev/null"   # amrecover will use the changer if you
restore

# holding disks
holdingdisk hd1 {
    comment "Main Holding Disk - 150GB"
    directory "/var/amanda/dumps"       # where the holding disk is
    use -1Gb            # how much space can we use on it
    chunksize 0         # size of chunk if you want big dump to be
    }
holdingdisk hd2 {
    comment "Secondary Holding Disk - 50GB"
    directory "/var/amanda/dumps2"
    use -1Gb
    chunksize 0
    }

reserve 30 # percent

autoflush no #

infofile "/var/amanda/Full/curinfo"     # database DIRECTORY
logdir   "/var/amanda/Full"             # log directory
indexdir "/var/amanda/Full/index"       # index directory
#tapelist "/var/amanda/Full/tapelist"   # list of used tapes
# tapelist is stored, by default, in the directory that contains amanda.conf


# tapetypes

define tapetype DLT4 {
    comment "DLT4 tape drives"
    length 40960 mbytes         # 40 Gig tapes
    filemark 4000 kbytes        # I don't know what this means
    speed 2814 kbytes           # 3.5 Mb/s
}

# dumptypes

define dumptype global {
    comment "Global definitions"
}


define dumptype high-tar-comp {
   comment "partitions dumped with tar, compressed with gzip"
   priority high
   compress client best
   index yes
   exclude list "/etc/amanda/exclude.gtar"
}


define dumptype comp-high-full {
    global
    comment "High Compression Dump"
    compress client best
    dumpcycle 0
    index yes
    priority high
}


define interface local {
    comment "a local disk"
    use 1000 kbps
}

define interface eth0 {
    comment "100 Mbps ethernet"
    use 1000 kbps
}


---------- disklist ----------
# Separation of other servers into multiple disks #blackhawk /clients / {
#       high-tar-comp
#       include "./clients"
#       } 1
#blackhawk /notclients / {
#       high-tar-comp
#       exclude "./clients" "./tmp"
#       } 1
#gimp /clients / {
#        # all client directories
#        high-tar-comp
#        include "./clients"
#        } 1
#gimp /mysql / {
#        # the mysql databases
#        high-tar-comp
#        include "./var/lib/mysql"
#        } 1
#gimp /home / {
#        # home directories
#        high-tar-comp
#        include "./home"
#        } 1
#gimp /incoming / {
#        # the incoming directory
#        high-tar-comp
#        include "./zu/incoming"
#        } 1
#gimp /everythingelse / {
#        # whatever isn't included in the above four definitions
#        high-tar-comp
#        include "./*"
#        exclude "./clients" "./tmp" "./zu/incoming" "./home"
"./var/lib/mysql"
#        } 1
#arahk /everything / {
#        # the entire 15GB disk of the server arahk
#       high-tar-comp
#       include "./*"
#       } 1
oldgimp /clients / {
        # all client directories
        high-tar-comp
        include "./clients"
        } 1
oldgimp /var/lib/mysql / {
        # mysqld databases
        high-tar-comp
#       include "./var/lib/mysql"
        } 2
oldgimp /zu/incoming / {
        # the old zu/incoming
        high-tar-comp
#       include "./zu/incoming"
        } 1
oldgimp /home / {
        # home directories
        high-tar-comp
        include "./home"
        } 1
oldgimp /everythingelse / {
        # whatever isn't included in the above four definitions
        high-tar-comp
        include "./*"
        exclude "./clients" "./tmp" "./zu/incoming" "./home"
"./var/lib/mysql"
        } 1


Oh yeah, the identical definitions which work on gimp, don't work on
oldgimp...


---
Dan Brown
monkeypants AT shaw DOT ca



<Prev in Thread] Current Thread [Next in Thread>