Networker

[Networker] Too Many Open Files

2009-11-16 17:33:32
Subject: [Networker] Too Many Open Files
From: Chester Martin <cmartin AT SPP DOT ORG>
To: NETWORKER AT LISTSERV.TEMPLE DOT EDU
Date: Mon, 16 Nov 2009 16:32:14 -0600
In our networker environment we have about 330 clients, nw 7.5.1, redhat
4.  For index backups these clients are a member of an group which I run
a savegrp -O command against for index backups.  In the owner
notification field I have it pointed to a script, I also give the script
the argument of the actual server name being backed up. 

 

The problem is whenever an index backup runs I get hundreds of the error
below after the index backup completes and it runs the "owner
notification" script.

 

"11/16/2009 02:52:32 PM  nsrexecd svc_tcp: svcfd_create: Too many open
files"

 

Here's my script:

------------------------------------------------------

ScriptDirectory="/scripts/jobs"

#LogsDirectory="$ScriptDirectory/logs"

TempDirectory="$ScriptDirectory/temp"

 

CurrentEpochTime=$(date +%s)

JobOutputFile=($TempDirectory/$1$CurrentEpochTime)

cat>>$JobOutputFile

 

cat $JobOutputFile |grep -i "Indexes"

if [ $? = 0 ];then

#  rm -rf $JobOutputFile

  exit 0

fi

------------------------------------------------------

 

I've verified that it detects the word "Indexes" in the log (the word
indexes is in the group name) because when I commented out the line to
remove the log file in the "TempDirectory" it leaves the log files in
the directory.  Also, by passing the server name to the script that
verifies that it doesn't try to write/read to the same file during the
same operation.

 

Here's some values that I've reset already

cat /proc/sys/fs/file-max

200000

 

ulimit -n

65535

 

Added to /etc/security/limits.conf

* hard nofile 65535

* soft nofile 65535

 

 

If I exit out of the script before it does any processing I don't get an
error, so does networker open more files than the logs I'm creating....
:?

 

Thanks in advance.


To sign off this list, send email to listserv AT listserv.temple DOT edu and 
type "signoff networker" in the body of the email. Please write to 
networker-request AT listserv.temple DOT edu if you have any problems with this 
list. You can access the archives at 
http://listserv.temple.edu/archives/networker.html or
via RSS at http://listserv.temple.edu/cgi-bin/wa?RSS&L=NETWORKER

<Prev in Thread] Current Thread [Next in Thread>
  • [Networker] Too Many Open Files, Chester Martin <=