Networker

Re: [Networker] How to speed up this backup (4GB -> 8 hours) ?

2009-03-19 11:24:27
Subject: Re: [Networker] How to speed up this backup (4GB -> 8 hours) ?
From: "Rutherford, Rodney" <RRutherford AT PEABODYENERGY DOT COM>
To: NETWORKER AT LISTSERV.TEMPLE DOT EDU
Date: Thu, 19 Mar 2009 10:19:23 -0500
> -----Original Message-----
> From: EMC NetWorker discussion [mailto:NETWORKER AT LISTSERV.TEMPLE DOT EDU]
> On Behalf Of Fazil Saiyed
> Sent: Thursday, March 19, 2009 9:49 AM
> To: NETWORKER AT LISTSERV.TEMPLE DOT EDU
> Subject: Re: [Networker] How to speed up this backup (4GB -> 8 hours) ?
> 
> Hello,
> I misspoke, i did not realize that many files were in the saveset, i
> only
> looked at saveset size, this issue regarding  large number of small
> files
> has been around for long time, the only reasonable option might be
> snapshots and\or NDMP backup ( i believe you can buy and use NDMP
> licence
> for server file systems-please check).
> Thanks
> 


The way I have dealt with this is to split it into multiple savesets
at the directory level.  It made a huge difference in both incremental
and full backup times.

To automate it, I created a script that ran via cron prior to the
sheduled backup time and updated the client saveset configs with the
current directory listing.

Rodney

-----------------------------------------
E-mail Disclaimer:
The information contained in this e-mail, and in any accompanying
documents, may constitute confidential and/or legally privileged
information.  The information is intended only for use by the
designated recipient.  If you are not the intended recipient (or
responsible for the delivery of the message to the intended
recipient), you are hereby notified that any dissemination, 
distribution, copying, or other use of, or taking of any action
in reliance on this e-mail is strictly prohibited.  If you have
received this email communication in error, please notify the
sender immediately and delete the message from your system.

To sign off this list, send email to listserv AT listserv.temple DOT edu and 
type "signoff networker" in the body of the email. Please write to 
networker-request AT listserv.temple DOT edu if you have any problems with this 
list. You can access the archives at 
http://listserv.temple.edu/archives/networker.html or
via RSS at http://listserv.temple.edu/cgi-bin/wa?RSS&L=NETWORKER