Networker

Re: [Networker] Slow Win2k backup with lots of files

2006-06-06 20:07:48
Subject: Re: [Networker] Slow Win2k backup with lots of files
From: Siobhán Ellis <siobhanellis AT HOTMAIL DOT COM>
To: NETWORKER AT LISTSERV.TEMPLE DOT EDU
Date: Wed, 7 Jun 2006 10:05:31 +1000
If you use disk to disk backup, you can consider snap image. This does block level incremental backups. However, if you don't use disk to disk, then it sucks for restores as a single file will, potentially, have different blocks on different tapes and make restores a massive burden!

A company I used to work for, had a modle that would automatically split a saveset into multiple savesets thus giving some parallelism, this only works if your millions of tny files are in multiple directories. You can try doing this by hand, but you run the danger of missing directories if new ones are added.

Unfortunately, the company I worked for went bust and the software is now owned by one company, with no developers, and the developer is in another company. Hopefully, this stuff will become available again.

Siobhan


From: "Dewhirst, Rob" <dewey AT KU DOT EDU>
Reply-To: Legato NetWorker discussion <NETWORKER AT LISTSERV.TEMPLE DOT EDU>, "Dewhirst, Rob" <dewey AT KU DOT EDU>
To: NETWORKER AT LISTSERV.TEMPLE DOT EDU
Subject: [Networker] Slow Win2k backup with lots of files
Date: Tue, 6 Jun 2006 17:49:09 -0500

I have a Win2k server with over 3.5 million tiny files on it comprising
about 200GB. (not by my choice or design)

I see from the archives that older versions of the client had problems
with large file systems structured like this.  I am using 7.1.x, and my
backup times are over 24 hours only for this client.  My Networker
server is a windows server.

Any suggestions on improving the performance here?  I have a lot of
options available, but I can't skip the millions of tiny files, nor
require that users tar/zip up these directories of files.

To sign off this list, send email to listserv AT listserv.temple DOT edu and type "signoff networker" in the body of the email. Please write to networker-request AT listserv.temple DOT edu if you have any problems wit this list. You can access the archives at http://listserv.temple.edu/archives/networker.html or
via RSS at http://listserv.temple.edu/cgi-bin/wa?RSS&L=NETWORKER

To sign off this list, send email to listserv AT listserv.temple DOT edu and type 
"signoff networker" in the
body of the email. Please write to networker-request AT listserv.temple DOT edu 
if you have any problems
wit this list. You can access the archives at 
http://listserv.temple.edu/archives/networker.html or
via RSS at http://listserv.temple.edu/cgi-bin/wa?RSS&L=NETWORKER