yep, same problem with 1/2 million files
make sure root has basically unlimited everything in
/etc/security/limits, then start adding CPU's to the AIX box, then add
more memory (max it out on both really)... might have to get a more
powerful box...
OR JUST MAKE SMALLER FILE SYSTEMS ! ! !
try to issue a "ls -lR" against that file system... if it takes more
than an hour to scroll across the screen it is WAY TO BIG !
If you look into things you'll see that ADSM allows somewhere around
2368 bytes for server name, high level qualifier, low level qualifier,
and file name... if you have the directory with the 50,000 files
buried down some path that is about 2,000 characters large you can see
where the "in core tree" being built for backup processing will be
very large. You will reach the point of having a 1-GB tree of info
relating to backups... I'm not sure of the specifics but say it has to
traverse this tree 6 times during the backup process.... things get
real ugly real fast.
and I know there are as many different CORRECT ways to do things as
there are people to do them (in computing) but large file systems
makes me think of the 'ol "don't put all your eggs in one basket"
saying.
later,
Dwight
______________________________ Reply Separator _________________________________
Subject: Backing up 50 Thousand Files
Author: rgil1 (rgil1 AT us.ibm DOT com) at unix,mime
Date: 6/12/98 10:31 AM
Has anyone had any problems trying to backup a 30-50 thousand file filesystem?
Any time we attempt to
backup, we get a TCP/IP communication failure message. We have increased the
"Commtimeout from 60
to 600 and the Idletimeout from 15 to 60" to no avail.
O/S is AIX 4.2.1 on Server and Clients.
Thanks,
Roger Gil Jr.
I/T Specialist Systems
Management Integrator Sr.
Information Processing Services
|