Networker

Re: [Networker] Incremental backup of large volume takes longer than full

2006-10-27 01:23:56
Subject: Re: [Networker] Incremental backup of large volume takes longer than full
From: Kobus Strydom <KStrydom AT MEDIHELP.CO DOT ZA>
To: NETWORKER AT LISTSERV.TEMPLE DOT EDU
Date: Fri, 27 Oct 2006 07:13:34 +0200
I am sorry, I meant in comparison 36 hours for 500GB to 17 hours for
about 10GB
:)

>>> k_f_o AT YAHOO DOT COM 2006/10/27 02:47 AM >>>
OK, point of clarification first.  Your subject suggests that the full
is shorter than the incrementals, but the detail of the message suggests
that your fulls take 36 hours and your incrementals take 17 hours.  Am I
missing something here?

I wish I had a silver bullet for you here, but I don't.  I used to work
at a company that had a similar issue.  After months of working on the
problem and trying to write custom software to aggregate the large
number of files into a smaller number of compressed directories, we
ended up re-architecting the environment so that we could fill
directories and make them read-only after they were backed up.  It was
more of a management nightmare, but we had faster, cleaner backups that
we were confident in.

-Kyle

----- Original Message ----
From: Kobus Strydom <kstrydom AT MEDIHELP.CO DOT ZA>
To: NETWORKER AT LISTSERV.TEMPLE DOT EDU 
Sent: Thursday, October 26, 2006 7:51:26 PM
Subject: [Networker] Incremental backup of large volume takes longer
than full

Please can someone help.

I have a Windows 2003 server HPDL580 4 x 3.2Ghz, 4GB ram, 72GB local
disk, 500GB EMC volume, Gigabit ether, 2GB Fiber for backup purpose.
Networker 7.3.1

On the EMC volume are very roughly about 30mil files, all images.

A full backup of this volume takes roughly 36hours. There are about
10GB's worth of new images added daily, yet the incrementals that I
perform takes forever and seldom completes before 11:am the next
working
day. They start at 18:00 each night. The speed I get out of
incrementals
are in the region of 500KB to 1MB p/s.

I have journal manager enabled on this volume, yet it looks lik all
files are checked for changes?

Any suggestions/help would be greatly appreciated. I have worked with
our local supplier on this issue for months now and still no joy. They
suggested a raw backup, which is great, I get an average speed of 50MB
p/s, but this doesn't help when I need to restore individual files.

Kobus Strydom
Systems Engineer
Medihelp
Mobile +27 82 9090882
Tel +27 12 3342295
Fax +27 12 3342426
e-mail kstrydom AT medihelp.co DOT za 














Medihelp is an Authorised Financial Services Provider
---------------------------------------------------------------------------
NOTICE: Please note that this eMail, and the contents thereof,
is subject to the standard Medihelp eMail disclaimer which may be found
at:
http://www.medihelp.co.za/disclaimer.htm 
<<<< GWAVASIG >>>>

To sign off this list, send email to listserv AT listserv.temple DOT edu and
type "signoff networker" in the
body of the email. Please write to
networker-request AT listserv.temple DOT edu if you have any problems
wit this list. You can access the archives at
http://listserv.temple.edu/archives/networker.html or
via RSS at http://listserv.temple.edu/cgi-bin/wa?RSS&L=NETWORKER 

To sign off this list, send email to listserv AT listserv.temple DOT edu and
type "signoff networker" in the
body of the email. Please write to
networker-request AT listserv.temple DOT edu if you have any problems
wit this list. You can access the archives at
http://listserv.temple.edu/archives/networker.html or
via RSS at http://listserv.temple.edu/cgi-bin/wa?RSS&L=NETWORKER

To sign off this list, send email to listserv AT listserv.temple DOT edu and 
type "signoff networker" in the
body of the email. Please write to networker-request AT listserv.temple DOT edu 
if you have any problems
wit this list. You can access the archives at 
http://listserv.temple.edu/archives/networker.html or
via RSS at http://listserv.temple.edu/cgi-bin/wa?RSS&L=NETWORKER