BackupPC-users

Re: [BackupPC-users] backuppc slow rsync speeds

2012-09-19 11:50:51
Subject: Re: [BackupPC-users] backuppc slow rsync speeds
From: Timothy J Massey <tmassey AT obscorp DOT com>
To: "General list for user discussion, questions and support" <backuppc-users AT lists.sourceforge DOT net>
Date: Wed, 19 Sep 2012 11:45:18 -0400
Les Mikesell <lesmikesell AT gmail DOT com> wrote on 09/18/2012 02:40:55 PM:

> On Tue, Sep 18, 2012 at 1:14 PM, Timothy J Massey <tmassey AT obscorp DOT com> wrote:
> >
> > I have just performed some full backups on a host after disabling
> > compression.  Results:
> >
> > Not-first backup with compression:  139.9 minutes for 70000.6 MB
> > First backup without compression:  76.7 minutes for 70181.5 MB.
> > Second backup without compression:  36.6 minutes for 70187.4 MB.
> >
> > Wow:  Four times the performance.  Looks like compression is a
> > *significant* performance-eater.
>
> Can you repeat those the 3rd time with checksum-caching enabled so we
> have a better idea of how much time that saves?  (If you didn't have
> it on already, you'd need to repeat again to store them first)


The host I was playing with is a bad one for that:  it's a pretty visible host, and about 30% of the data changes constantly.  I've selected another host to experiment with.  One issue is that it's three times as large, so each full backup is slower.  Good news is that it's an unused server, so 99.99% of the data is static, and no one cares if I hammer the server for no real reason!  :)

I just ran a first backup of that host with compression disabled, and it took the same amount of time as not-first fulls were taking with compression.  The backup server is busy right now and probably for the next 2 or so hours.  Once it's free, I will start a second non-compression full and we'll see how it goes.

Right now, still no hash caching.  Once I gather the stats for non-compression only, I will add in hash caching and we'll see from there.

Timothy Massey

 
Out of the Box Solutions, Inc.
Creative IT Solutions Made Simple!

http://www.OutOfTheBoxSolutions.com
tmassey AT obscorp DOT com
      22108 Harper Ave.
St. Clair Shores, MI 48080
Office: (800)750-4OBS (4627)
Cell: (586)945-8796




Tim Massey

>
> --
>   Les Mikesell
>      lesmikesell AT gmail DOT com
>
> ------------------------------------------------------------------------------
> Live Security Virtual Conference
> Exclusive live event will cover all the ways today's security and
> threat landscape has changed and how IT managers can respond. Discussions
> will include endpoint security, mobile security and the latest in malware
> threats.
http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
> _______________________________________________
> BackupPC-users mailing list
> BackupPC-users AT lists.sourceforge DOT net
> List:    
https://lists.sourceforge.net/lists/listinfo/backuppc-users
> Wiki:    
http://backuppc.wiki.sourceforge.net
> Project:
http://backuppc.sourceforge.net/
------------------------------------------------------------------------------
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and 
threat landscape has changed and how IT managers can respond. Discussions 
will include endpoint security, mobile security and the latest in malware 
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
_______________________________________________
BackupPC-users mailing list
BackupPC-users AT lists.sourceforge DOT net
List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:    http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/