Networker

Re: [Networker] Poor performance with disk backups after un upgrade

2009-11-24 10:32:13
Subject: Re: [Networker] Poor performance with disk backups after un upgrade
From: MIchael Leone <Michael.Leone AT PHA.PHILA DOT GOV>
To: NETWORKER AT LISTSERV.TEMPLE DOT EDU
Date: Tue, 24 Nov 2009 10:28:47 -0500
> > I have a similar config (clustered Win2003 servers, 
> > as storage nodes, with SAN disk space as AFTD devices), mostly for 
SQL, 
> > altho my largest is a file server (1.5TB). 
> 
> 
> Michael, how did you setup VSS on the file servers ? Are you using 
> space from the same drive for shadow storage volumes ?

I didn't set up the shares from the SAN, but I don't think we actually did 
any configuration of VSS on the client. The client is a MS cluster, 
Win2003 standard. I back up the clustered resource, which has a SAN disk 
of about 1.6TB assigned to it (and it's close to full ...)

> After putting VSS*=OFF in the client's save operations , the backup 
> became even slower.
> Weekly full backup for the clustered file servers take ~ 55 hrs :(

My last full (which I do Friday nights, after midnight) says it ran for 
1200 minutes, so about 20 hours. That was backup to AFTD, then clone to 
LTO-4 tape. 

This is the biggest saevset on that file server I do: 

name,savetime(22),sscomp(22),totalsize(3),nfiles
H:\Users    11/21/2009 1:21:38 AM 11/21/2009 12:27:03 PM 929 GB 873977

So it wrote about 1TB to disk in about 10.5 hrs, and the rest of the time 
was spent cloning all that onto tape. Other jobs were also running, but 
none as large, or as long, as that client.

I enumerate the folders I want backed up (i.e., I don't use ALL; I list 
each directory separately; there are only a dozen top level directories on 
the disk); it helps write more in parallel. That client has a parallelism 
of 10 (I may bump it back up to 12).

I had limited the server paralleism, in an effort to track down 
performance problems. So I dropped it from the standard 32 to 16. Now that 
I have figured out the performance problems, I will increase it back to 
the standard of 32.

I only backup about 2.1 million files total from this server; you backup 
24M? That's probably the issue; Windows is a whole lot slower, the greater 
the number of files (especially smaller files)

To sign off this list, send email to listserv AT listserv.temple DOT edu and 
type "signoff networker" in the body of the email. Please write to 
networker-request AT listserv.temple DOT edu if you have any problems with this 
list. You can access the archives at 
http://listserv.temple.edu/archives/networker.html or
via RSS at http://listserv.temple.edu/cgi-bin/wa?RSS&L=NETWORKER