Hi Calvin

My gut feel is that 12 simultaneous streams might be too many.  Unless you
have a very high speed file system and disk subsystem, I'd cut that number
at least in half.

By the by, has the file system holding these 100,000 files been defragmented
recently?  Fragmentation certainly won't help the backup performance.

Thanks
tl

-----Original Message-----
From: Calvin Thomas [mailto:calvin.thomas AT nacalogistics DOT com]
Sent: Tuesday, October 15, 2002 2:44 PM
To: NETWORKER AT LISTMAIL.TEMPLE DOT EDU
Subject: Re: [Networker] What is the best way to backup 100,000 files in
a single subdirectory on a W2K Client


    Most of the streams start (after a variable amount of time).  The *.302,
*.303,*.304 Etc up to *.320 all start.  I have seen 12 streams running from
this client at one time, but the *.301 doesn't start since it has 1/2 the
files in it.  It appears the client doesn't have enough time to select all
60K files to backup before the 90 minute timeout.  I can't raise the timeout
value because it extends out of our backup window.

    I know it isn't the tape drive, because I am backing up to a hard drive.
This eliminates such problems as shoe-shining, and contention between
clients.

    What I seem to need is a way of archiveing the files on the client to a
single file, that I can then backup in place of this subdirectory.  I tried
winzip to create a zip archive, but it is limited to 65K files.
Any other ideas?
Calvin Thomas



----- Original Message -----
From: "Patrick Sibilio" <patrick.sibilio AT COMMERZBANK DOT COM>
To: <NETWORKER AT LISTMAIL.TEMPLE DOT EDU>
Sent: Tuesday, October 15, 2002 1:01 AM
Subject: Re: [Networker] What is the best way to backup 100,000 files in a
single subdirectory on a W2K Client


> Hi,
>
> how many streams are acitve during the backup? How many clients are in the
> group?
>
> Try backing up the client with a new group and a different start time.
>
> regards,
> Patrick Sibilio
>
> On Mon, 14 Oct 2002 18:10:00 -0700, Calvin Thomas
> <calvin.thomas AT NACALOGISTICS DOT COM> wrote:
>
> >I have tried seperate save streams by specifying
> >
> >C:\Directory\*.301
> >C:\Directory\*.302
> >C:\Directory\*.303
> >Etc.
> >The problem is the biggest save stream (c:\directory\*.301) never starts
> >even though I have set the time out to 90Minutes. I can't set the time
out
> >any longer due to other considerations.
> >When I back up using ALL, the writes happen at 32-64KBPS, and the backup
> >takes 20 hours.
> >I tried to create a zip file using WinZip, but WinZip is limited to 65K
> >files.
> >
> >What have your experiences been in similar sittuations?
> >
> >Thanks
> >Calvin Thomas
> >UNIX system administrator
> >NACA Logistics
> >
> >--
> >Note: To sign off this list, send a "signoff" command via email
> >to listserv AT listmail.temple DOT edu or visit the list's Web site at
> >http://listmail.temple.edu/archives/networker.html where you can
> >also view and post messages to the list.
> >=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=
>
> --
> Note: To sign off this list, send a "signoff" command via email
> to listserv AT listmail.temple DOT edu or visit the list's Web site at
> http://listmail.temple.edu/archives/networker.html where you can
> also view and post messages to the list.
> =*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=
>

--
Note: To sign off this list, send a "signoff" command via email
to listserv AT listmail.temple DOT edu or visit the list's Web site at
http://listmail.temple.edu/archives/networker.html where you can
also view and post messages to the list.
=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=

--
Note: To sign off this list, send a "signoff" command via email
to listserv AT listmail.temple DOT edu or visit the list's Web site at
http://listmail.temple.edu/archives/networker.html where you can
also view and post messages to the list.
=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=