BackupPC-users

Re: [BackupPC-users] How scalable is backuppc?

2009-03-17 15:38:10
Subject: Re: [BackupPC-users] How scalable is backuppc?
From: Chris Robertson <crobertson AT gci DOT net>
To: "General list for user discussion, questions and support" <backuppc-users AT lists.sourceforge DOT net>
Date: Tue, 17 Mar 2009 11:25:12 -0800
Mike Dresser wrote:
> Chris Robertson wrote:
>   
>> How many hosts do you back up?
>>   
>>     
> About 30 are active, 12 are sporadic (laptops, etc).  Total that gets 
> written out to off site backup is about 300GB of data a day, compressed.
>   
>> What does df -i show for the mount point?
>>   
>>     
> /dev/sdb1               6.4G     19M    6.3G    1%
>   

Yeah, I had really good performance when I was running around 20M 
inodes.  But the more I look the less I think that's related to my problem::

100 TB of 1 MB files (~100 M files):
http://oss.sgi.com/archives/xfs/2007-10/msg00320.html
"...billions of 1k files..."
http://www.mail-archive.com/linux-raid AT vger.kernel DOT org/msg05100.html

>> Did you use an external log?
>>   
>>     
> No.
>   
>> Did you use any other specific optimizations when creating the file 
>> system (version 2 log, modified suint and/or swidth)?
>>   
>>     
> No.  Default options for Debian etch.  This filesystem has been 
> xfs_growfs'd a few times after being dd'd to a new volume, since it's 
> impossible to back it up with xfsdump|xfsrestore.  I mount with noatime, 
> and logbufs=8
>
>   
>> How big is the filesystem?
>>   
>>     
> 6.4TB, and 2.8TB is in use, with 2TB or so of that being backuppc's.
>   
>> [root@archive-1 ~]# xfs_db -c frag -r /dev/sdb1
>> actual 41673387, ideal 40843714, fragmentation factor 1.99%
>>     
> actual 10977124, ideal 10669547, fragmentation factor 2.80%
>   

Thanks for the numbers.  I'm starting to think my problems might be 
related to the kernel I'm running (default Centos 5.2, with xfs-kmod).  
It's been years since I rolled my own kernel, but I might just have to 
break out the compiler...

> Mike

Chris

------------------------------------------------------------------------------
Apps built with the Adobe(R) Flex(R) framework and Flex Builder(TM) are
powering Web 2.0 with engaging, cross-platform capabilities. Quickly and
easily build your RIAs with Flex Builder, the Eclipse(TM)based development
software that enables intelligent coding and step-through debugging.
Download the free 60 day trial. http://p.sf.net/sfu/www-adobe-com
_______________________________________________
BackupPC-users mailing list
BackupPC-users AT lists.sourceforge DOT net
List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:    http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/