BackupPC-users

Re: [BackupPC-users] optimal backuppc filesystem & backuppc_trashclean

2010-04-14 15:45:53
Subject: Re: [BackupPC-users] optimal backuppc filesystem & backuppc_trashclean
From: Les Mikesell <lesmikesell AT gmail DOT com>
To: backuppc-users AT lists.sourceforge DOT net
Date: Wed, 14 Apr 2010 14:43:46 -0500
On 4/14/2010 1:58 PM, Eric Persson wrote:
> Hi,
>
> I've been trying out backuppc for a few months now, on my small home
> network. Backing up 2 windows boxes, a linux desktop, and 3 remote
> servers. All using rsync. It works quite well. The backuppool is 120gb
> at the moment, so not extremely big from what I can tell from the
> mailinglist.
>
> However, 2 questions have been brought up.
>
> The backuppc_trashclean is running a lot, and causes _a lot_ of disk-io,
> the disks sounds like they are beeing grinded to dust. I read some older
> posts, and I did an strace on the backuppc_trashclean. I get a bunch of
> unlink-messages and something called getdents. Its mostly unlink though,
> and they all seem to refer to maildir-file(each mail is a file) from a
> mailserver, so lots of smaller files.
>
> unlink("f1206112790.M463161P32730V0000000000000801I00148118_0.mail01,S=90828:2,S")
> = 0
> unlink("f1218413551.M603690P6667V0000000000000801I001480C8_0.mail01,S=46816:2,S")
> = 0
> unlink("f1206813486.M269304P6702V0000000000000801I0014809A_0.mail01,S=93095:2,S")
> = 0
>
> Is this normal? How long should I expect it to run? Its a raid0 with
> quite normal sata-disks, nothing fancy.

Basically it has to traverse the pool directory which contains a link 
for each unique file you have backed up, stat() it, which requires a 
read of the inode which isn't likely to be near the directory, then it 
unlinks any that only have one remaining link, meaning they have expired 
from the backups you keep.  So it involves a lot of disk seeks which are 
slow.  If you have disk space to spare you can bump up 
$Conf{BackupPCNightlyPeriod} so it takes several days for each complete 
pass.

> And also, I'm using ext3, is there any benefit to changeing to xfs or
> whats the optimal filesystem?

Xfs is probably better if you have plenty of ram and a 64-bit OS, but it 
is still mostly a matter of chance how far the inodes are from the 
directory.

-- 
   Les Mikesell
    lesmikesell AT gmail DOT com

------------------------------------------------------------------------------
Download Intel&#174; Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
_______________________________________________
BackupPC-users mailing list
BackupPC-users AT lists.sourceforge DOT net
List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:    http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

<Prev in Thread] Current Thread [Next in Thread>