BackupPC-users

Re: [BackupPC-users] An idea to fix both SIGPIPE and memory issues with rsync

2009-12-16 04:01:41
Subject: Re: [BackupPC-users] An idea to fix both SIGPIPE and memory issues with rsync
From: Robin Lee Powell <rlpowell AT digitalkingdom DOT org>
To: "General list for user discussion, questions and support" <backuppc-users AT lists.sourceforge DOT net>
Date: Wed, 16 Dec 2009 00:58:52 -0800
On Tue, Dec 15, 2009 at 05:42:55PM -0800, Robin Lee Powell wrote:
> Just to give a sense of scale here:
> 
> # date ; find /pictures -xdev -type f -printf "%h\n" >/tmp/dirs ; date
> Tue Dec 15 12:50:57 PST 2009
> Tue Dec 15 17:26:44 PST 2009
> 
> (something I ran to try to figure out how to partition the tree)
> 
> The other one isn't even close to finishing, as far as I can tell.

Just for amusement:

# date ; find /data -xdev -type f -printf "%h\n" >/tmp/dirs ; date
Tue Dec 15 12:51:17 PST 2009
[snip many errors caused by things disappearing during the walk]
Wed Dec 16 00:55:52 PST 2009

RedHat GFS *really* doesn't like directories with large numbers of
files.  It's not a big fan of stat() calls, either.

-Robin

-- 
They say:  "The first AIs will be built by the military as weapons."
And I'm  thinking:  "Does it even occur to you to try for something
other  than  the default  outcome?"  See http://shrunklink.com/cdiz
http://www.digitalkingdom.org/~rlpowell/ *** http://www.lojban.org/

------------------------------------------------------------------------------
This SF.Net email is sponsored by the Verizon Developer Community
Take advantage of Verizon's best-in-class app development support
A streamlined, 14 day to market process makes app distribution fast and easy
Join now and get one step closer to millions of Verizon customers
http://p.sf.net/sfu/verizon-dev2dev 
_______________________________________________
BackupPC-users mailing list
BackupPC-users AT lists.sourceforge DOT net
List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:    http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

<Prev in Thread] Current Thread [Next in Thread>