ADSM-L

Re: Backing up 50 Thousand Files

1998-06-15 09:47:11
Subject: Re: Backing up 50 Thousand Files
From: Dwight Cook <decook AT AMOCO DOT COM>
Date: Mon, 15 Jun 1998 08:47:11 -0500
     yep, same problem with 1/2 million files
     make sure root has basically unlimited everything in
     /etc/security/limits, then start adding CPU's to the AIX box, then add
     more memory (max it out on both really)... might have to get a more
     powerful box...

     OR JUST MAKE SMALLER FILE SYSTEMS ! ! !

     try to issue a "ls -lR" against that file system... if it takes more
     than an hour to scroll across the screen it is WAY TO BIG !

     If  you look into things you'll see that ADSM allows somewhere around
     2368 bytes for server name, high level qualifier, low level qualifier,
     and file name... if you have the directory with the 50,000 files
     buried down some path that is about 2,000 characters large you can see
     where the "in core tree" being built for backup processing will be
     very large.  You will reach the point of having a 1-GB tree of info
     relating to backups... I'm not sure of the specifics but say it has to
     traverse this tree 6 times during the backup process.... things get
     real ugly real fast.

     and I know there are as many different CORRECT ways to do things as
     there are people to do them (in computing) but large file systems
     makes me think of the 'ol "don't put all your eggs in one basket"
     saying.

     later,
           Dwight


______________________________ Reply Separator _________________________________
Subject: Backing up 50 Thousand Files
Author:  rgil1 (rgil1 AT us.ibm DOT com) at unix,mime
Date:    6/12/98 10:31 AM


Has anyone had any problems trying to backup a 30-50 thousand file filesystem?
Any time we attempt to
backup, we get a TCP/IP communication failure message.  We have increased the
"Commtimeout from 60
to 600 and the Idletimeout from 15 to 60" to no avail.
O/S is AIX 4.2.1 on Server and Clients.

Thanks,

Roger Gil Jr.
I/T Specialist Systems

Management Integrator Sr.
Information Processing Services
<Prev in Thread] Current Thread [Next in Thread>