Amanda-Users

sendbackup speed issue

2005-06-06 11:16:56
Subject: sendbackup speed issue
From: Chris Loken <cloken AT cita.utoronto DOT ca>
To: amanda-users AT amanda DOT org
Date: Mon, 06 Jun 2005 10:56:00 -0400


I have one amanda server and one client. I have 2 separate amanda configs to backup different DLEs on the client.

The problem is that backups with one config seem to be much slower than the other. The amanda tar files on the holding disk are being created at about 10MB/s with one config and 1MB/s for the other config. The tape writes are fine - it's the creation/transfer of the backup from client to server that is at issue. Some sendbackup numbers from the logs are shown below.

I've done some simple dd tests to convince myself that read and write speeds are essentially the same for the various client disks in the two configs. scp and netpipe tests don't show any obvious problems with the network connection between the machines. The configs are essentially the same except for the DLE list. Using gnutar, no compression anywhere.

The "effect" is reproducible and doesn't seem to be the result of client or server loads or network traffic. This same backup setup had been working fine for many months and only recently started exhibiting this problem.

The main thing that has changed is that the server was upgraded to AS4 (amanda-2.4.4p3-1; installed from RH's rpms) while the client is still AS3 (amanda-2.4.4p1-0.3E). I figured this mismatch could be a potential problem but it doesn't seem to explain why one backup config is fine and the other is slow.

Any ideas on what to check?

  Thanks,

     Chris


A good/normal backup. In this config, the larger backups average close to 10MB/s from client to server.

-sh-2.05b# grep Total sendbackup.20050603*
sendbackup.20050603180005.debug:sendbackup: time 72.031: 53: size(|): Total bytes written: 23429120 (22MB, 327kB/s) sendbackup.20050603180118.debug:sendbackup: time 34.298: 53: size(|): Total bytes written: 4362240 (4.2MB, 125kB/s) sendbackup.20050603180153.debug:sendbackup: time 23.347: 53: size(|): Total bytes written: 144988160 (138MB, 6.0MB/s) sendbackup.20050603180216.debug:sendbackup: time 88.705: 53: size(|): Total bytes written: 248064000 (237MB, 2.7MB/s) sendbackup.20050603180345.debug:sendbackup: time 436.415: 53: size(|): Total bytes written: 4142970880 (3.9GB, 9.1MB/s) sendbackup.20050603181104.debug:sendbackup: time 566.154: 53: size(|): Total bytes written: 397721600 (379MB, 687kB/s) sendbackup.20050603182031.debug:sendbackup: time 732.676: 53: size(|): Total bytes written: 2780784640 (2.6GB, 3.6MB/s) sendbackup.20050603183247.debug:sendbackup: time 2158.990: 53: size(|): Total bytes written: 28192501760 (26GB, 12MB/s) sendbackup.20050603190849.debug:sendbackup: time 3991.073: 53: size(|): Total bytes written: 41417011200 (39GB, 9.9MB/s)


A slow backup. In this config, all the large DLEs are in the 1-4MB/s range. These same DLEs have been backed-up for a year without seeing this type of behaviour.

sendbackup.20050602090954.debug:sendbackup: time 4.188: 53: size(|): Total bytes written: 450560 (440kB, 147kB/s) sendbackup.20050602091009.debug:sendbackup: time 0.921: 53: size(|): Total bytes written: 1525760 (1.5MB, ?B/s) sendbackup.20050602091023.debug:sendbackup: time 0.415: 53: size(|): Total bytes written: 460800 (450kB, ?B/s) sendbackup.20050602091038.debug:sendbackup: time 1.542: 53: size(|): Total bytes written: 3860480 (3.7MB, 1.8MB/s) sendbackup.20050602091053.debug:sendbackup: time 14.394: 53: size(|): Total bytes written: 130816000 (125MB, 8.9MB/s) sendbackup.20050602091108.debug:sendbackup: time 21.795: 53: size(|): Total bytes written: 32348160 (31MB, 1.5MB/s) sendbackup.20050602091130.debug:sendbackup: time 16.251: 53: size(|): Total bytes written: 39792640 (38MB, 2.4MB/s) sendbackup.20050602091147.debug:sendbackup: time 24.225: 53: size(|): Total bytes written: 54579200 (52MB, 2.2MB/s) sendbackup.20050602091211.debug:sendbackup: time 123.051: 53: size(|): Total bytes written: 1158154240 (1.1GB, 9.0MB/s) sendbackup.20050602091415.debug:sendbackup: time 83.428: 53: size(|): Total bytes written: 1158922240 (1.1GB, 13MB/s) sendbackup.20050602091539.debug:sendbackup: time 3676.957: 53: size(|): Total bytes written: 17134336000 (16GB, 4.4MB/s) sendbackup.20050602101658.debug:sendbackup: time 15626.616: 53: size(|): Total bytes written: 19249469440 (18GB, 1.2MB/s) sendbackup.20050602143727.debug:sendbackup: time 5863.356: 53: size(|): Total bytes written: 18078484480 (17GB, 2.9MB/s) sendbackup.20050602161512.debug:sendbackup: time 33717.794: 53: size(|): Total bytes written: 42903377920 (40GB, 1.2MB/s)


--
----------------------------------------------------
Chris Loken                     Phone: 416-978-5619
Computing Facility Manager      Fax:   416-978-3921
Canadian Institute for Theoretical Astrophysics

<Prev in Thread] Current Thread [Next in Thread>