BackupPC-users

Re: [BackupPC-users] An idea to fix both SIGPIPE and memory issues with rsync

2009-12-16 08:27:18
Subject: Re: [BackupPC-users] An idea to fix both SIGPIPE and memory issues with rsync
From: Les Mikesell <lesmikesell AT gmail DOT com>
To: "General list for user discussion, questions and support" <backuppc-users AT lists.sourceforge DOT net>
Date: Wed, 16 Dec 2009 07:25:23 -0600
Robin Lee Powell wrote:
> On Tue, Dec 15, 2009 at 05:42:55PM -0800, Robin Lee Powell wrote:
>> Just to give a sense of scale here:
>>
>> # date ; find /pictures -xdev -type f -printf "%h\n" >/tmp/dirs ; date
>> Tue Dec 15 12:50:57 PST 2009
>> Tue Dec 15 17:26:44 PST 2009
>>
>> (something I ran to try to figure out how to partition the tree)
>>
>> The other one isn't even close to finishing, as far as I can tell.
> 
> Just for amusement:
> 
> # date ; find /data -xdev -type f -printf "%h\n" >/tmp/dirs ; date
> Tue Dec 15 12:51:17 PST 2009
> [snip many errors caused by things disappearing during the walk]
> Wed Dec 16 00:55:52 PST 2009
> 
> RedHat GFS *really* doesn't like directories with large numbers of
> files.  It's not a big fan of stat() calls, either.

Usually it is just simple physics.  The disk head can only be in on place at a 
time.  It's never where you want it, and it is slow to move.

-- 
   Les Mikesell
    lesmikesell AT gmail DOT com

------------------------------------------------------------------------------
This SF.Net email is sponsored by the Verizon Developer Community
Take advantage of Verizon's best-in-class app development support
A streamlined, 14 day to market process makes app distribution fast and easy
Join now and get one step closer to millions of Verizon customers
http://p.sf.net/sfu/verizon-dev2dev 
_______________________________________________
BackupPC-users mailing list
BackupPC-users AT lists.sourceforge DOT net
List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:    http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

<Prev in Thread] Current Thread [Next in Thread>