BackupPC-users

Re: [BackupPC-users] backuppc slow rsync speeds

2012-09-17 14:34:57
Subject: Re: [BackupPC-users] backuppc slow rsync speeds
From: John Rouillard <rouilj-backuppc AT renesys DOT com>
To: "General list for user discussion, questions and support" <backuppc-users AT lists.sourceforge DOT net>
Date: Mon, 17 Sep 2012 18:33:34 +0000
On Mon, Sep 17, 2012 at 06:05:28PM +0000, John Rouillard wrote:
> On Mon, Sep 17, 2012 at 12:54:35PM -0400, Timothy J Massey wrote:
> > No matter the size of the system, I seem to top out at about 50GB/hour for 
> > full backups.  Here is a perfectly typical example:
> > 
> > Full Backup:  769.3 minutes for 675677.3MB of data.  That works out to be 
> > 878MB/min, or about 15MB/s.  For a system with an array that can move 
> > 200MB/s, and a network system that can move at least 70MB/s.
> 
> My last full backup of a 2559463.2 MB backup ran 306.9 minutes. Which
> if I am doing my math right is 138MB/s. This was overlapping in i/o
> with 9 other backups in various backup stages.

I have another system that is lower power:

  2632652.8 MB at 662.5 minutes or 66MB/s

the BackupPC system is a 4 core system with Dual-Core AMD Opteron(tm)
Processor 2216 (2412.400 MHz). 16GB of memory with 4x1TB disks. Raid 5
running 3ware raid card with BBU cache. For the majority of the time
that backup runs, there are only 3 or so other jobs runing at the same
time.

> But I had much the
> same numbers running on a 4 core, 32 GB (or maybe 16) machine with an
> attached SCSI disk array raid 6 with 14 or 15 spindles (Dell
> MD1000). Disk is isci using ext4 noatime.

If this memory is true (the system is offline at the moment so I can't
check) then the amount of memory on the system may play a role.

-- 
                                -- rouilj

John Rouillard       System Administrator
Renesys Corporation  603-244-9084 (cell)  603-643-9300 x 111

------------------------------------------------------------------------------
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and 
threat landscape has changed and how IT managers can respond. Discussions 
will include endpoint security, mobile security and the latest in malware 
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
_______________________________________________
BackupPC-users mailing list
BackupPC-users AT lists.sourceforge DOT net
List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:    http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/