BackupPC-users

Re: [BackupPC-users] Slow Rsync Transfer?

2011-04-28 13:53:14
Subject: Re: [BackupPC-users] Slow Rsync Transfer?
From: Gerald Brandt <gbr AT majentis DOT com>
To: "General list for user discussion, questions and support" <backuppc-users AT lists.sourceforge DOT net>
Date: Thu, 28 Apr 2011 12:51:03 -0500 (CDT)

----- Original Message -----
> Hi,
> 
> I've been running BackupPC for a while now and I've been noticing an
> odd trend, I have 29 servers which are identical in hardware and
> very similar in configuration. 28 of these servers transfer at
> 30-40MB/s via Rsync, one host and the database servers transfer
> between 2-10MB/s, even when ran individually when no other hosts are
> being backed up.
> 
> I've checked the IOwait on both the  BackupPC server which is a 12
> disk raid 10, with 2TB of usable space, 15k RPM drives, it has 5% IO
> while the host has 0%.
> 
> I've done simple sftp transfers and they transfer at 20-30MB/s with
> no issues.
> 
> Here is a backuppc log on one of the problem hosts,
> 
>     Backup# Type    Filled  Level   Start Date      Duration/mins
>       Age/days        Server Backup Path
>     112     full    yes     0         2/5 19:06        62.3
>                             81.6    /backuppc/pc/ras03/112
>     140     full    yes     0                 3/5 22:00        55.8
>                             53.5    /backuppc/pc/ras03/140
>     154     full    yes     0                 3/20 04:35      465.2
>                          39.2    /backuppc/pc/ras03/154
>     161     full    yes     0                 3/27 21:42      142.3
>                          31.5    /backuppc/pc/ras03/161
>     167     full    yes     0         4/4 18:00        854.0
>                          23.7    /backuppc/pc/ras03/167
>     173     full    yes     0         4/11 18:00      1032.9
>                       16.7    /backuppc/pc/ras03/173
>     174     incr    no      1                 4/12 18:00      152.2
>                         15.7    /backuppc/pc/ras03/174
>     175     incr    no      1         4/13 18:00      1019.5
>                       14.7    /backuppc/pc/ras03/175
>     176     incr    no      1         4/14 18:00      1594.4
>                       13.7    /backuppc/pc/ras03/176
>     177     incr    no      1         4/15 21:11      2094.5
>                       12.6    /backuppc/pc/ras03/177
>     178     full    yes     0         4/19 03:00      2037.8
>                       9.3     /backuppc/pc/ras03/178
>     179     incr    no      1         4/20 18:16      1147.2
>                       7.7     /backuppc/pc/ras03/179
>     180     incr    no      1         4/21 18:04      1840.7
>                       6.7     /backuppc/pc/ras03/180
>     181     partial yes     0         4/25 12:32      2389.1
>                       2.9     /backuppc/pc/ras03/181
> 
> I've already modified the checksum but it had no impact,
> '--checksum-seed=32761'. How does backuppc calculate the duration
> and speed? I know my oracle hosts, I kick off the RMAN prior to
> pulling the backuppc, so that might explain the "slow transfer
> speeds" if it calculated size/time which is inclusive of the RMAN
> (Database Export) backup. This host (above) boggles me though, these
> are static files that are being transferred and all other 28 hosts
> transfer just fine.
> 
> Thanks in advance for any input or troubleshooting steps.
>  

My best speed on Windows and Linux servers via rsync is 21 MB/s, the average is 
closer to 6 MB/s.

Gerald

------------------------------------------------------------------------------
WhatsUp Gold - Download Free Network Management Software
The most intuitive, comprehensive, and cost-effective network 
management toolset available today.  Delivers lowest initial 
acquisition cost and overall TCO of any competing solution.
http://p.sf.net/sfu/whatsupgold-sd
_______________________________________________
BackupPC-users mailing list
BackupPC-users AT lists.sourceforge DOT net
List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:    http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/