Networker

Re: [Networker] Index File Size?

2006-07-28 04:28:59
Subject: Re: [Networker] Index File Size?
From: Stuart Whitby <swhitby AT DATAPROTECTORS.CO DOT UK>
To: NETWORKER AT LISTSERV.TEMPLE DOT EDU
Date: Fri, 28 Jul 2006 09:26:50 +0100
The indexes in NetWorker 5 were based on a single, monolithic index for each 
client.  That hurt performance all round.  From NetWorker 6, each backup 
creates its own index file.  This way, rather than having to read that half 
terrabyte index file which John may have had with NW 5, NW 6+ maybe needs to 
read a 400MB file for the full backup followed by 3x50MB files to recover files 
from an incremental backup.  Works out much more efficient and, AFAIK, has been 
rock solid in terms of reliability since 6.0.1.
 
The size of the directories will also be based on the browse period of the 
files.  Give everything a 10 year browse time and your indexes will quickly 
grow to massive sizes.  The only real downside in terms of NW performance for 
something like that would be the number of files in the index directory causing 
performance problems with the getdents() call that's used to get the contents 
of the directory, and that's a filesystem issue rather than a problem with 
NetWorker.
 
Cheers,
 
Stuart.

 
________________________________

From: Legato NetWorker discussion on behalf of Shyam Hegde
Sent: Thu 27-Jul-06 21:43
To: NETWORKER AT LISTSERV.TEMPLE DOT EDU
Subject: Re: [Networker] Index File Size?



Thats nice to hear, however Stan's test shows that recovery prformance is
not affected because of larger index size! interesting....

**BACKUP IS ONE THING, RECOVERY IS EVERYTHING**


On 7/28/06, John Stoffel <john.stoffel AT taec.toshiba DOT com> wrote:
>
>
> Heh, that's nothing, I've got a server with one client index that's
> 147G in size.  And nother one thats 538G in size.
>
> Lots of itty bitty files will do that to you.  Sigh...
>

To sign off this list, send email to listserv AT listserv.temple DOT edu and 
type "signoff networker" in the
body of the email. Please write to networker-request AT listserv.temple DOT edu 
if you have any problems
wit this list. You can access the archives at 
http://listserv.temple.edu/archives/networker.html or
via RSS at http://listserv.temple.edu/cgi-bin/wa?RSS&L=NETWORKER



To sign off this list, send email to listserv AT listserv.temple DOT edu and 
type "signoff networker" in the
body of the email. Please write to networker-request AT listserv.temple DOT edu 
if you have any problems
wit this list. You can access the archives at 
http://listserv.temple.edu/archives/networker.html or
via RSS at http://listserv.temple.edu/cgi-bin/wa?RSS&L=NETWORKER

<Prev in Thread] Current Thread [Next in Thread>