ADSM-L

Re: Performance Large Files vs. Small Files

2001-02-20 18:42:28
Subject: Re: Performance Large Files vs. Small Files
From: Steve Harris <Steve_Harris AT HEALTH.QLD.GOV DOT AU>
Date: Wed, 21 Feb 2001 09:42:32 +1000
Ben 
>>> bbullock <bbullock AT MICRON DOT COM> 21/02/2001 8:21:34 >>>
>>>Big Snip
        This one nightmare host now has over 20 million files (and an
unknown number of directories) across 10 filesystems. We have found from
experience, that any more than about 500,000 files in any filesystem means a
full filesystem restore would take many hours. Just to restore the directory
structure seems to take a few hours at least. I have told the admins of this
host that it is very much unrecoverable in it's current state, and would
take on the order of days to restore the whole box.

        They are disappointed that an "enterprise backup solution" can't
handle this number of files any better. They are willing to work with us to
get a solution that will both cover the daily "disaster recovery" backup
need for the host and the long term retentions they desire.
>>> remainder snipped

I would debate whether the host is "unrecoverable".  It seems that this data is 
write once/read seldom in nature.  In that case, in the event of a disaster the 
priorities are
1. get the server back to the state where it can write more files
2. get back any individual required file in reasonable time
TSM can provide both of those objects.  If a full restore is required it *can* 
be spread over days because most of the data will never be needed.  You will of 
course need to negotiate wth your users exactly what is urgent and needs to be 
restored immediately and maybe have some canned macro to do this in the heat of 
an emergency.

Regards


Steve Harris
AIX and ADSM Admin
Queensland Health, Brisbane Australia