I wouldn't put the blame solely on Networker or Windows 2000.

I have a litte perl script that generates many directories with 1000 small
files each. I used it on two high performance NAS systems (from two well
known manufacturers). During the NDMP backup the throughput dropped to < 200
KB/sec, there was no significant difference between the two systems. The
same backup without filehistory did not perform any better.

Bye
Ernie




-----Original Message-----
From: Paul Brears [mailto:paul AT IFL DOT NET]
Sent: Thursday, April 24, 2003 12:08 PM
To: NETWORKER AT LISTMAIL.TEMPLE DOT EDU
Subject: Re: [Networker] Number of files backup for W2K


I've not seen a hard limit for the number of files but I have seen
performance problems with big
file systems and they seem to get slower as the number of files grows.

We've got a file system on a W2K server with over a 1 million small files
(mostly in their own small
directories) and have had some problems with slow backups. (<100KB/s)

We found the following thing out:
1.    Networker was spending 40% of the time (as monitored by sysinternals
filemon) looking for
nsr.dir in each directory.
Putting a directive to ignore nsr.dir files gave us a significant (~20%)
performance increase
backing up that filesystem.
<< "E:\" >>
ignore

2.    For reasons I don't yet understand 6.1.1 was also significantly (~20%)
faster than the 6.2
client (I've not tried 6.1.3 on it yet)

3.    Check the change journal size, the default will probably be too small
for a file system of
that size and so it might not be using it for incrementals. (huge
improvement)

Once we'd got the backup times down the client became more reliable as well.

Paul

----- Original Message -----
From: "Howard Martin" <howard.martin AT EDS DOT COM>
To: <NETWORKER AT LISTMAIL.TEMPLE DOT EDU>
Sent: Thursday, April 24, 2003 10:03 AM
Subject: Re: [Networker] Number of files backup for W2K


I haven't seen a limit on the number of files in a saveset.
Can you give more details on the problems ?


On Thu, 24 Apr 2003 11:37:26 +0800, Robert Loh <robert AT SOFTSOURCE.COM DOT SG>
wrote:

>Hi All
>What is the maximum number of files that Networker 6.2 can backup for W2K
>server under one saveset ?
>We have 2.5 million of files in one directory always causing problem
backing
>up, the size is about 25GB only.
>The saveset is the directory.
>cheers..
>Robert
>
>
>--
>Note: To sign off this list, send a "signoff networker" command via email
>to listserv AT listmail.temple DOT edu or visit the list's Web site at
>http://listmail.temple.edu/archives/networker.html where you can
>also view and post messages to the list.
>=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=

--
Note: To sign off this list, send a "signoff networker" command via email
to listserv AT listmail.temple DOT edu or visit the list's Web site at
http://listmail.temple.edu/archives/networker.html where you can
also view and post messages to the list.
=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=

--
Note: To sign off this list, send a "signoff networker" command via email
to listserv AT listmail.temple DOT edu or visit the list's Web site at
http://listmail.temple.edu/archives/networker.html where you can
also view and post messages to the list.
=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=

--
Note: To sign off this list, send a "signoff networker" command via email
to listserv AT listmail.temple DOT edu or visit the list's Web site at
http://listmail.temple.edu/archives/networker.html where you can
also view and post messages to the list.
=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=