Networker

Re: [Networker] Large directories slow acces using save -I input_ filename

2003-07-24 09:14:02
Subject: Re: [Networker] Large directories slow acces using save -I input_ filename
From: TONKS Pieter - 8507 <TONKS AT EIB DOT ORG>
To: NETWORKER AT LISTMAIL.TEMPLE DOT EDU
Date: Thu, 24 Jul 2003 15:03:31 +0200
Lubos,

For a similar situation, I have broken up the file system logically with 
softlinks, this allows the creation of a smaller saveset.


Piet
-----Original Message-----
From: Lubos Bohm [mailto:lubos.bohm AT OSKARMOBIL DOT CZ]
Sent: Thursday 24 July 2003 14:48 PM
To: NETWORKER AT LISTMAIL.TEMPLE DOT EDU
Subject: [Networker] Large directories slow acces using save -I
input_filename


Hi All,


trying to backup aprox. 200.000 files listed in "input_filename" from large
directory containing aprox. 960.000 files takes IMHO too long. Well, it
takes hours before the tape is even loaded and first bytes are written..

We use:
1/ save -s lgt-blan -q -I /var/opt/Storage/Apr.in -b"BGW"
   on Solaris 8 with VXFS
2/ Networker 6.1.1 build 238 on both sides

I suppose the problem is inside the "save" - it can not search through the
large directory.

Folks, what are your experiences? Could it be a bug solved in new version?
Or should I better take care about pre-processing these files like moving
them in a directory tree (like for example Squid does)? Or some advanced
VxFS tuning?

Thanks a lot, Lubos

--
Note: To sign off this list, send a "signoff networker" command via email
to listserv AT listmail.temple DOT edu or visit the list's Web site at
http://listmail.temple.edu/archives/networker.html where you can
also view and post messages to the list.
=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=


--------------------------------------------------------------------

Les informations contenues dans ce message et/ou ses annexes sont
réservées à l'attention et à l'utilisation de leur destinataire et
peuvent être confidentielles. Si vous n'êtes pas destinataire de ce
message, vous êtes informés que vous l'avez reçu par erreur et que
toute utilisation en est interdite. Dans ce cas, vous êtes priés de
le détruire et d'en informer la Banque européenne d'investissement.

The information in this message and/or attachments is intended
solely for the attention and use of the named addressee and may be
confidential. If you are not the intended recipient, you are hereby
notified that you have received this transmittal in error and that
any use of it is prohibited. In such a case please delete this
message and kindly notify the European Investment Bank accordingly.

--
Note: To sign off this list, send a "signoff networker" command via email
to listserv AT listmail.temple DOT edu or visit the list's Web site at
http://listmail.temple.edu/archives/networker.html where you can
also view and post messages to the list.
=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=

<Prev in Thread] Current Thread [Next in Thread>