Amanda-Users

backup over slow internet line, Broken pipe?

2003-10-27 08:54:09
Subject: backup over slow internet line, Broken pipe?
From: Palle Girgensohn <girgen AT pingpong DOT net>
To: amanda-users AT amanda DOT org
Date: Mon, 27 Oct 2003 14:50:19 +0100
Hi!

I get Broken pipe all the time when backing up using tar. The backup client is at a different site, so backup is performed over a 2 Mbit/s line. While the 2Mb line is not top quality, using netstat -i 1 reveals that after a number of hours, almost no backup data is sent at all. Finally, it gives up with a "broken pipe" error. Looks to me that the tar program fails? Any ideas how get this working better? Can I force TCP connections instead of UDP? Anything else I've missed?

Thanks,
Palle

I use freebsd 4.8p3, amanda 2.4.4.

netusage 400 kbps       # maximum net bandwidth for Amanda, in KB per sec

dumpcycle 21 days       # the number of days in the normal dump cycle
runspercycle 12         # number  of  amdump runs in dumpcycle days
tapecycle 18 tapes      # the number of tapes in rotation

bumpsize 20 Mb          # minimum savings (threshold) to bump level 1 -> 2
bumpdays 2              # minimum days at each level
bumpmult 1.5            # threshold = bumpsize * (level-1)**bumpmult
reserve 10              # reserve N % of holding disk for non-level-0 dumps

# Remember to switch between the 2 tape device
tapedev "/dev/nrsa1"    # The no-rewind tape device to be uesd DLT
tapetype Adic           # DLT

...

define interface iponly {
   comment "iponly in the bergrum"
   use 2 mbps
}
----
and the disklist:
...

myclient.mydomain /                     inferior   -1 iponly
myclient.mydomain /usr/local/www/server tar_normal -1 iponly
...

All other backups run smooth, as well as the dump of the root disk.



log, on the client:

sendbackup: debug 1 pid 11405 ruid 10 euid 10: start at Thu Oct 23 03:52:08 2003
/usr/local/libexec/amanda/sendbackup: version 2.4.4
 parsed request as: program `GNUTAR'
                    disk `/usr/local/www/server'
                    device `/usr/local/www/server'
                    level 0
                    since 1970:1:1:0:0:0
options `|;auth=bsd;index;include-list=.amanda.includes;'
sendbackup: try_socksize: send buffer size is 65536
sendbackup: time 0.000: stream_server: waiting for connection: 0.0.0.0.4531
sendbackup: time 0.000: stream_server: waiting for connection: 0.0.0.0.4532
sendbackup: time 0.000: stream_server: waiting for connection: 0.0.0.0.4533
sendbackup: time 0.000: waiting for connect on 4531, then 4532, then 4533
sendbackup: time 0.013: stream_accept: connection from 195.178.168.86.1382
sendbackup: time 0.020: stream_accept: connection from 195.178.168.86.1383
sendbackup: time 0.034: stream_accept: connection from 195.178.168.86.1384
sendbackup: time 0.034: got all connections
sendbackup-gnutar: time 0.048: doing level 0 dump as listed-incremental to /usr/local/var/amanda/gnutar-lists/myclient.mydomain_usr_local_www_server_0
.new
sendbackup-gnutar: time 0.065: doing level 0 dump from date: 1970-01-01 0:00:00 GMT sendbackup: time 0.088: spawning /usr/local/libexec/amanda/runtar in pipeline sendbackup: argument list: gtar --create --file - --directory /usr/local/www/server --one-file-system --listed-inc remental /usr/local/var/amanda/gnutar-lists/myclient.mydomain_usr_local_www_server_0
.new --sparse --ignore-failed
-read --totals --files-from /tmp/amanda/sendbackup._usr_local_www_server.20031023035208.include
sendbackup-gnutar: time 0.090: /usr/local/libexec/amanda/runtar: pid 11408
sendbackup: time 0.094: started index creator: "/usr/local/bin/gtar -tf - 2>/dev/null | sed -e 's/^\.//'"
sendbackup: time 45609.758: index tee cannot write [Broken pipe]
sendbackup: time 45609.758: pid 11407 finish time Thu Oct 23 16:32:18 2003
sendbackup: time 45609.761: 124: strange(?): sendbackup: index tee cannot write [Broken pipe]
sendbackup: time 45609.763: error [/usr/local/bin/gtar got signal 13]
sendbackup: time 45609.763: pid 11405 finish time Thu Oct 23 16:32:18 2003



log, serverside:

STRANGE dumper myclient.mydomain /usr/local/www/server 0 [sec 42722.653 kb 4990910 kps 116.8 orig-kb 4990910]
 sendbackup: start [myclient.mydomain:/usr/local/www/server level 0]
 sendbackup: info BACKUP=/usr/local/bin/gtar
 sendbackup: info RECOVER_CMD=/usr/local/bin/gtar -f... -
 sendbackup: info end
 ? gtar: ./libfiles/58992: Warning: Cannot stat: (null)
 ? gtar: ./libfiles/58993: Warning: Cannot stat: (null)
 | Total bytes written: 5110691840 (4.8GB, 117kB/s)
 sendbackup: size 4990910
 sendbackup: end


<Prev in Thread] Current Thread [Next in Thread>