On 03/31/2016 12:20 PM, Dimitri Maziuk wrote:
> On 03/31/2016 12:35 PM, Lloyd Brown wrote:
>
>> > ...  Unfortunately, I'm
>> > not exaggerating to say that we have users with file profiles that
>> > consist of 35million files (or more) with average file sizes less than
>> > 10kb.  The user might be long-gone, and eligible for deletion, but it
>> > takes forever to spider that filesystem, and occasionally causes
>> > problems like directory cache thrashing, etc.
> "I don't have a solution but I admire the problem". How long would
> bacula take to stat 35M files?

Yeah, I've been trying not to think about that.

To tell the truth, so far we're only seeing those profiles in the
compute/scratch directories, which we don't back up.  We are increasing
the quotas for user home dirs, though, so it's possible that people will
start doing this in home dirs, too.  I hope not.


-- 
Lloyd Brown
Systems Administrator
Fulton Supercomputing Lab
Brigham Young University
http://marylou.byu.edu


------------------------------------------------------------------------------
Transform Data into Opportunity.
Accelerate data analysis in your applications with
Intel Data Analytics Acceleration Library.
Click to learn more.
http://pubads.g.doubleclick.net/gampad/clk?id=278785471&iu=/4140
_______________________________________________
Bacula-users mailing list
Bacula-users AT lists.sourceforge DOT net
https://lists.sourceforge.net/lists/listinfo/bacula-users