Networker

Re: [Networker] Slow Win2k backup with lots of files

2006-06-07 09:03:40
Subject: Re: [Networker] Slow Win2k backup with lots of files
From: Albert Eddie Contractor AFRPA CIO/IT <Eddie.Albert AT AFRPA.PENTAGON.AF DOT MIL>
To: NETWORKER AT LISTSERV.TEMPLE DOT EDU
Date: Wed, 7 Jun 2006 09:05:35 -0400
Talk a little more about your setup if you would.

How many CPUs if one or two consider upgrade to 4 cpus.
How much RAM memory - More = faster backups
What storage devices are you using (LTO2/LTO3)? This borders on
religious preference but check performance stats of your backup media
and upgrade where appropriate.
Is the file directory structure static or dynamic?
Does your support agreement allow you to upgrade to at least 7.2?
Can you afford the Disk2Disk backup option?
        Backup from your fileserver to a storage node of Sata3 drives,
then perform exclusive file backup to tape from the storage node.

Answering your question with what you have given us.

With millions of file, compression is an issue. Compression means CPU
power, not so speed of cpu as much as number of CPUs. That and Memory...

200GB is a none issue to me as even the lowly LTO2 tape drives can
handle those in native format.

The number of files to me would be the issue.

To help with that you could manually set the directories being backed
up, but you would have to tell your staff if they create new directories
they should notify you. Or you monitor the file structure on a regular
basis. Again if file structure is static

Backup C:\Directory1
Backup C:\Directory2
Backup C:\Directory3
Backup C:\Directory4
Backup C:\Directory5
Backup C:\Directory6

Set parrellism up to 6 Viola you have a streamin' screamin' backup!

My answers were free, you get what you paid for.... Don't sue me!

Semper Fidelis et Paratus! /ALE

> -----Original Message-----
> From: Legato NetWorker discussion 
> [mailto:NETWORKER AT LISTSERV.TEMPLE DOT EDU] On Behalf Of Dewhirst, Rob
> Sent: Tuesday, June 06, 2006 6:49 PM
> To: NETWORKER AT LISTSERV.TEMPLE DOT EDU
> Subject: [Networker] Slow Win2k backup with lots of files
> 
> I have a Win2k server with over 3.5 million tiny files on it 
> comprising about 200GB. (not by my choice or design)
> 
> I see from the archives that older versions of the client had 
> problems with large file systems structured like this.  I am 
> using 7.1.x, and my backup times are over 24 hours only for 
> this client.  My Networker server is a windows server.
> 
> Any suggestions on improving the performance here?  I have a 
> lot of options available, but I can't skip the millions of 
> tiny files, nor require that users tar/zip up these 
> directories of files.  
> 
> To sign off this list, send email to 
> listserv AT listserv.temple DOT edu and type "signoff networker" in 
> the body of the email. Please write to 
> networker-request AT listserv.temple DOT edu if you have any 
> problems wit this list. You can access the archives at 
> http://listserv.temple.edu/archives/networker.html or via RSS 
> at http://listserv.temple.edu/cgi-bin/wa?RSS&L=NETWORKER
> 

To sign off this list, send email to listserv AT listserv.temple DOT edu and 
type "signoff networker" in the
body of the email. Please write to networker-request AT listserv.temple DOT edu 
if you have any problems
wit this list. You can access the archives at 
http://listserv.temple.edu/archives/networker.html or
via RSS at http://listserv.temple.edu/cgi-bin/wa?RSS&L=NETWORKER

<Prev in Thread] Current Thread [Next in Thread>