Re: [BackupPC-users] An idea to fix both SIGPIPE and memory issues with rsync
2009-12-16 08:27:18
Robin Lee Powell wrote:
> On Tue, Dec 15, 2009 at 05:42:55PM -0800, Robin Lee Powell wrote:
>> Just to give a sense of scale here:
>>
>> # date ; find /pictures -xdev -type f -printf "%h\n" >/tmp/dirs ; date
>> Tue Dec 15 12:50:57 PST 2009
>> Tue Dec 15 17:26:44 PST 2009
>>
>> (something I ran to try to figure out how to partition the tree)
>>
>> The other one isn't even close to finishing, as far as I can tell.
>
> Just for amusement:
>
> # date ; find /data -xdev -type f -printf "%h\n" >/tmp/dirs ; date
> Tue Dec 15 12:51:17 PST 2009
> [snip many errors caused by things disappearing during the walk]
> Wed Dec 16 00:55:52 PST 2009
>
> RedHat GFS *really* doesn't like directories with large numbers of
> files. It's not a big fan of stat() calls, either.
Usually it is just simple physics. The disk head can only be in on place at a
time. It's never where you want it, and it is slow to move.
--
Les Mikesell
lesmikesell AT gmail DOT com
------------------------------------------------------------------------------
This SF.Net email is sponsored by the Verizon Developer Community
Take advantage of Verizon's best-in-class app development support
A streamlined, 14 day to market process makes app distribution fast and easy
Join now and get one step closer to millions of Verizon customers
http://p.sf.net/sfu/verizon-dev2dev
_______________________________________________
BackupPC-users mailing list
BackupPC-users AT lists.sourceforge DOT net
List: https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki: http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/
|
<Prev in Thread] |
Current Thread |
[Next in Thread>
|
- Re: [BackupPC-users] An idea to fix both SIGPIPE and memory issues with rsync, (continued)
- Re: [BackupPC-users] An idea to fix both SIGPIPE and memory issues with rsync, Les Mikesell
- Re: [BackupPC-users] An idea to fix both SIGPIPE and memory issues with rsync, Robin Lee Powell
- [BackupPC-users] You were right (Re: An idea to fix both SIGPIPE and memory issues with rsync), Robin Lee Powell
- Re: [BackupPC-users] An idea to fix both SIGPIPE and memory issues with rsync, Ralf Gross
- Re: [BackupPC-users] An idea to fix both SIGPIPE and memory issues with rsync, Carl Wilhelm Soderstrom
- Re: [BackupPC-users] An idea to fix both SIGPIPE and memory issues with rsync, Robin Lee Powell
- Re: [BackupPC-users] An idea to fix both SIGPIPE and memory issues with rsync, Robin Lee Powell
- Re: [BackupPC-users] An idea to fix both SIGPIPE and memory issues with rsync,
Les Mikesell <=
- Re: [BackupPC-users] An idea to fix both SIGPIPE and memory issues with rsync, Ralf Gross
- Re: [BackupPC-users] An idea to fix both SIGPIPE and memory issues with rsync, Carl Wilhelm Soderstrom
- Re: [BackupPC-users] An idea to fix both SIGPIPE and memory issues with rsync, Carl Wilhelm Soderstrom
Re: [BackupPC-users] An idea to fix both SIGPIPE and memory issues with rsync, Les Mikesell
|
|
|