Hello,
Im having a bit of a problem backing up over a WAN connection.
The problem is that it took 17 hours to backup roughly 5G of data over a
512K circuit.
The 2 boxes are pretty much identical in software and hardware.
Debian Distro(testing)
Amanda 2.4.3
Freeswan 1.96/1.99
Gnutar 1.3.25
Kernel 2.4.20
Hardware:
AMD 1800+
512M RAM
ATA100 drives(mirrored - software raid)
I used `netperf` to test my bandwidth (not during the backup) and it
averages about 610K/sec. Makes sense since both ends have a Frac T1 @
512K.
During the backup netperf returns 2-6K/sec.
The Amanda server side does not seem to be clogged during the backup
process, as I can get into it remotely and there is very little latency.
However the client side is VERY slow.
When I view the process with "top" it doesn't seem like gzip & tar are
really eating up that much processor and memory.
Here are my configs:
/etc/amanda/DailySet1/amanda.conf:
-----
org "DailySet1" # your organization name for reports
mailto "mtx" # space separated list of operators at your site
dumpuser "backup" # the user to run dumps under
inparallel 4 # maximum dumpers that will run in parallel
netusage 10000 # maximum net bandwidth for Amanda, in KB per sec
dumpcycle 4 weeks # the number of days in the normal dump cycle
tapecycle 21 tapes # the number of tapes in rotation
bumpsize 20 MB # minimum savings (threshold) to bump level 1 -> 2
bumpdays 1 # minimum days at each level
bumpmult 4 # threshold = bumpsize * (level-1)**bumpmult
runtapes 1 # explained in WHATS.NEW
tpchanger "chg-multi" # the tape-changer glue script, see TAPE.CHANGERS
changerfile "/etc/amanda/DailySet1/chg-multi.conf"
tapetype HARD-DISK # what kind of tape it is (see tapetypes below)
labelstr "^DailySet1\.[0-9][0-9]*$" # label constraint regex: all tapes
must match
diskdir "/var/backups/amanda" # where the holding disk is
disksize 4500 MB # how much space can we use on it
infofile "/var/lib/amanda/DailySet1/curinfo" # database filename
logfile "/var/log/amanda/DailySet1/log" # log filename
indexdir "/var/lib/amanda/DailySet1/index"
define tapetype HARD-DISK {
comment "Hard disk instead of tape"
lbl-templ "/etc/amanda/DailySet1/3hole.ps"
length 15000 mbytes
} first, to insure the important disks are dumped first.
define dumptype hd-dump {
comment "Backup to hard disk instead of tape - using dump"
holdingdisk no
index yes
priority high
no-record
}
define dumptype hd-tar {
hd-dump
program "GNUTAR"
comment "Backup to hard disk instead of tape - using tar"
options compress-fast, index
}
define dumptype low-hd-tar {
hd-dump
program "GNUTAR"
comment "Root partitions with compression to hard disk"
options compress-fast, index
priority low
}
includefile /etc/amanda/interfaces
*All other dumptypes are variations like above, eg. priority med,high,etc..
-----
/etc/amanda/DailySet1/disklist:
------
mtxsac.sac / {
low-hd-tar
exclude list "/etc/amanda/exclude_lists/root.excl"
compress client fast
} 0 local
All DLE's have spindle number "0" at this location
max.corp / {
low-hd-tar
exclude list "/etc/amanda/exclude_lists/root.excl"
compress client fast
} 1 eth0
All DLE's have spindle number "1" at this location
*Again other DLE's are same as above 2 examples only med-high priority
variations.
On the first run I had the spindle number set at "0" for all of the DLE's
at both sites. I changed it according to above, but it didn't help.
------
/etc/amanda/interfaces:
-----
define interface local {
comment "a local disk"
use 20000 kbps
}
define interface eth0 {
comment "512 Kbps ethernet"
use 5000 kbps
}
-----
Here is my amreport output:
These dumps were to tape DailySet1.01.
The next tape Amanda expects to use is: DailySet1.03.
FAILURE AND STRANGE DUMP SUMMARY:
matrixex.c /var lev 0 STRANGE
STATISTICS:
Total Full Daily
-------- -------- --------
Estimate Time (hrs:min) 0:00
Run Time (hrs:min) 17:46
Dump Time (hrs:min) 17:45 17:45 0:00
Output Size (meg) 4787.7 4787.7 0.0
Original Size (meg) 7709.6 7709.6 0.0
Avg Compressed Size (%) 62.1 62.1 --
Filesystems Dumped 14 14 0
Avg Dump Rate (k/s) 76.7 76.7 --
Tape Time (hrs:min) 17:45 17:45 0:00
Tape Size (meg) 4788.4 4788.4 0.0
Tape Used (%) 32.0 32.0 0.0
Filesystems Taped 14 14 0
Avg Tp Write Rate (k/s) 76.7 76.7 --
FAILED AND STRANGE DUMP DETAILS:
/-- matrixex.c /var lev 0 STRANGE
sendbackup: start [matrixex.corp.ontrols.com:/var level 0]
sendbackup: info BACKUP=/bin/tar
sendbackup: info RECOVER_CMD=/bin/gzip -dc |/bin/tar -f... -
sendbackup: info COMPRESS_SUFFIX=.gz
sendbackup: info end
--snip--
| Total bytes written: 245749760 (234MB, 117kB/s)
sendbackup: size 239990
sendbackup: end
\--------
NOTES:
--snip--
taper: tape DailySet1.01 kb 4903296 fm 14 [OK]
DUMP SUMMARY:
DUMPER STATS TAPER STATS
HOSTNAME DISK L ORIG-KB OUT-KB COMP% MMM:SS KB/s MMM:SS KB/s
-------------------------- --------------------------------- ------------
max.corp / 0 37470 16032 42.8 4:41 56.9 4:41 57.1
max.corp /home 0 18085001430752 79.1 419:52 56.8 419:52 56.8
max.corp /opt 0 10 64 640.0 0:00 0.0 0:00 152.1
max.corp /safe 0 11000 3616 32.9 1:03 57.0 1:03 57.4
max.corp /usr 0 422140 198720 47.1 59:03 56.1 59:03 56.1
max.corp /var 0 239990 116160 48.4 34:09 56.7 34:09 56.7
max.corp /work 0 30306401834176 60.5 538:53 56.7 538:53 56.7
mtxsac.sac / 0 36450 17696 48.5 0:082089.3 0:082090.5
mtxsac.sac /home 0 61160 57984 94.8 0:144144.7 0:144142.9
mtxsac.sac /opt 0 10 64 640.0 0:00 0.0 0:00 224.7
mtxsac.sac /safe 0 10 64 640.0 0:00 0.0 0:00 473.2
mtxsac.sac /usr 0 415960 170400 41.0 2:001418.2 2:001418.1
mtxsac.sac /var 0 156850 39424 25.1 0:271440.6 0:271441.4
mtxsac.sac /work 0 16744301018144 60.8 4:543459.4 4:543459.1
(brought to you by Amanda version 2.4.3)
Any help/advice would be greatly appreciated.
Thanks
Shawn
|
