Veritas-bu

Re: [Veritas-bu] Linux catalog file system

2010-09-15 11:05:58
Subject: Re: [Veritas-bu] Linux catalog file system
From: Nate Sanders <sandersn AT dmotorworks DOT com>
To: Justin Piszcz <jpiszcz AT lucidpixels DOT com>
Date: Wed, 15 Sep 2010 10:05:49 -0500
catalog is 65GB and only 47k inodes. Not large by any means. Single
master/media server. I may try the dir_index option on ext3 to see if
that gives us any longer term performance increase.

On 09/15/2010 09:59 AM, Justin Piszcz wrote:
> Hi,
>
> Using ext3 here on the production systems.
>
> It depends on what your catalog looks like and how many simultaenous 
> backup/restores you are doing at any one time.
>
> For some catalogs with 1M+ files I'd suggest ext3, ext4 at some point.
> XFS (while it is being worked on) typically does not bode well with many 
> files.
>
> Could you use BRTFS / ReiserFS / etc? Yes, but for mission-critical 
> systems (master servers) IMO it is best to use what the majority of the 
> population use so you do not run into a weird error that causes problems 
> down the line.  That is currently ext3, at least with RHEL3-RHEL5.
>
> I used to use XFS for personal use for a long time, it worked great, but 
> it was always slow when deleting lots of small files or working with a lot 
> of files.  In addition, over the years there were some data loss issue 
> with one kernel and I got bitten a couple of times.
>
> I think XFS is great if you are needing a high-performance FS for large 
> files, EXT4 as well.  But I would think you would want the most 
> stable/tried and true filesystem that the most people use/etc you would 
> want to use ext3.
>
> Justin.
>
>
> On Wed, 15 Sep 2010, Nate Sanders wrote:
>
>   
>> What are you all using for your catalog filesystem on linux? While ext3
>> claims it doesn't need defragging we see a huge performance increase
>> when we rebuild the file system once every 6 months. So I'm curious to
>> know if XFS or VxFS work any better and/or are supported? I think XFS
>> was not support or may still not be.
>>
>> -- 
>> Nate Sanders            Digital Motorworks
>> System Administrator      (512) 692 - 1038
>>
>>
>>
>>
>> This message and any attachments are intended only for the use of the 
>> addressee and may contain information that is privileged and confidential. 
>> If the reader of the message is not the intended recipient or an authorized 
>> representative of the intended recipient, you are hereby notified that any 
>> dissemination of this communication is strictly prohibited. If you have 
>> received this communication in error, please notify us immediately by e-mail 
>> and delete the message and any attachments from your system.
>> _______________________________________________
>> Veritas-bu maillist  -  Veritas-bu AT mailman.eng.auburn DOT edu
>> http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
>>
>>     
> .
>
>   

-- 
Nate Sanders            Digital Motorworks
System Administrator      (512) 692 - 1038




This message and any attachments are intended only for the use of the addressee 
and may contain information that is privileged and confidential. If the reader 
of the message is not the intended recipient or an authorized representative of 
the intended recipient, you are hereby notified that any dissemination of this 
communication is strictly prohibited. If you have received this communication 
in error, please notify us immediately by e-mail and delete the message and any 
attachments from your system.
_______________________________________________
Veritas-bu maillist  -  Veritas-bu AT mailman.eng.auburn DOT edu
http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu

<Prev in Thread] Current Thread [Next in Thread>