BackupPC-users

Re: [BackupPC-users] Slow backup

2010-10-21 03:29:52
Subject: Re: [BackupPC-users] Slow backup
From: Andrea Visinoni <a.visinoni AT autron DOT it>
To: "General list for user discussion, questions and support" <backuppc-users AT lists.sourceforge DOT net>
Date: Thu, 21 Oct 2010 09:27:52 +0200
The main problem is the really first full backup that least 1859 minutes 
for 171511 files and 36GB!
I'll try the parameter you suggested to improve the incrementals backups 
though.

Andrea

Il 14/10/2010 18.24, Tyler J. Wagner ha scritto:
> What is your IncrLevels setting? I bet you a donut that it is "1", which
> means each incremental references the last full. So over time, more and
> more files have changed from the last full.
>
> Try setting IncrLevels to "1, 2, 3, 4, 5, 6". This means each
> incremental will only back up files changed since the last incremental.
>
> Regards,
> Tyler
>
> On Thu, 2010-10-14 at 15:03 +0200, Andrea Visinoni wrote:
>> On a brand new Dell server with RAID5 SAS disk configuration we get this
>> backup results...and slowing down through time.
>> The backup is local, from the server disk to the server disk.
>> Changing compression level doesn't give results.
>>
>> Any Hints?
>>
>> Andrea
>>
>> Backup Summary
>> Click on the backup number to browse and restore backup files.
>>
>> Backup#  Type  Filled  Level  Start Date  Duration/mins  Age/days Server
>> Backup Path
>> 20  full  yes  0  10/6 02:00  1859.4  8.3  /home/backuppc/pc/localhost/20
>> 21  incr  no  1  10/7 20:00  16.9  6.5  /home/backuppc/pc/localhost/21
>> 22  incr  no  1  10/8 20:00  24.2  5.5  /home/backuppc/pc/localhost/22
>> 23  incr  no  1  10/9 20:00  24.4  4.5  /home/backuppc/pc/localhost/23
>> 24  incr  no  1  10/10 20:00  24.5  3.5  /home/backuppc/pc/localhost/24
>> 25  incr  no  1  10/11 20:00  33.2  2.5  /home/backuppc/pc/localhost/25
>> 26  incr  no  1  10/12 20:00  42.4  1.5  /home/backuppc/pc/localhost/26
>>
>> Xfer Error Summary
>>
>>
>> Backup#  Type  View  #Xfer errs  #bad files  #bad share  #tar errs
>> 20  full  XferLOG, Errors  1  0  0  0
>> 21  incr  XferLOG, Errors  0  0  0  0
>> 22  incr  XferLOG, Errors  0  0  0  0
>> 23  incr  XferLOG, Errors  0  0  0  0
>> 24  incr  XferLOG, Errors  0  0  0  0
>> 25  incr  XferLOG, Errors  0  0  0  0
>> 26  incr  XferLOG, Errors  0  0  0  0
>>
>> File Size/Count Reuse Summary
>> Existing files are those already in the pool; new files are those added
>> to the pool. Empty files and SMB errors aren't counted in the reuse and
>> new counts.
>>
>> Totals  Existing Files  New Files
>> Backup#  Type  #Files  Size/MB  MB/sec  #Files  Size/MB  #Files  Size/MB
>> 20  full  171785  36906.0  0.33  171511  36839.2  339  67.8
>> 21  incr  600  151.5  0.15  168  25.5  538  126.1
>> 22  incr  841  197.8  0.14  628  146.8  263  51.2
>> 23  incr  841  197.8  0.14  841  197.8  2  0.0
>> 24  incr  841  197.8  0.13  841  197.8  2  0.0
>> 25  incr  1109  261.0  0.13  889  201.3  275  59.9
>> 26  incr  1365  327.0  0.13  1142  263.0  273  64.1
>>
>> Compression Summary
>> Compression performance for files already in the pool and newly
>> compressed files.
>>
>> Existing Files  New Files
>> Backup#  Type  Comp Level  Size/MB  Comp/MB  Comp  Size/MB  Comp/MB  Comp
>> 20  full  3  36839.2  10261.3  72.1%  67.8  12.9  80.9%
>> 21  incr  3  25.5  6.9  72.8%  126.1  16.5  86.9%
>> 22  incr  3  146.8  21.8  85.1%  51.2  7.9  84.5%
>> 23  incr  3  197.8  29.7  85.0%  0.0  0.0  44.1%
>> 24  incr  3  197.8  29.7  85.0%  0.0  0.0  44.0%
>> 25  incr  3  201.3  29.9  85.2%  59.9  8.5  85.8%
>> 26  incr  3  263.0  38.5  85.4%  64.1  9.4  85.3%
>>
>>
>> caronte:/etc/backuppc# cat localhost.pl
>> #
>> # Local server backup of /etc as user backuppc
>> #
>> $Conf{XferMethod} = 'tar';
>>
>> $Conf{TarShareName} = ['/etc', '/home/users', '/home/pub',
>> '/home/utente', '/roo
>> t'];
>>
>> $Conf{TarClientCmd} = '/usr/bin/env LC_ALL=C /usr/bin/sudo $tarPath -c
>> -v -f - -
>> C $shareName'
>>                          . ' --totals';
>>
>> # remove extra shell escapes ($fileList+ etc.) that are
>> # needed for remote backups but may break local ones
>> $Conf{TarFullArgs} = '$fileList';
>> $Conf{TarIncrArgs} = '--newer=$incrDate $fileList';
>>
>> # Livello minimo di compressione dei files
>> $Conf{CompressLevel} = 3
>> caronte:/etc/backuppc#
>>
>> ------------------------------------------------------------------------------
>> Beautiful is writing same markup. Internet Explorer 9 supports
>> standards for HTML5, CSS3, SVG 1.1,  ECMAScript5, and DOM L2&  L3.
>> Spend less time writing and  rewriting code and more time creating great
>> experiences on the web. Be a part of the beta today.
>> http://p.sf.net/sfu/beautyoftheweb
>> _______________________________________________
>> BackupPC-users mailing list
>> BackupPC-users AT lists.sourceforge DOT net
>> List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
>> Wiki:    http://backuppc.wiki.sourceforge.net
>> Project: http://backuppc.sourceforge.net/
>>
>
> --
> "A competent and self-confident person is incapable of jealousy in
> anything. Jealousy is invariably a symptom of neurotic insecurity."
>     -- Lazarus Long, "Time Enough for Love", by Robert A. Heinlein
>


-- 
Autron
Tel: +39 035 335623
Fax: +39 035 322879

------------------------------------------------------------------------------
Nokia and AT&T present the 2010 Calling All Innovators-North America contest
Create new apps & games for the Nokia N8 for consumers in  U.S. and Canada
$10 million total in prizes - $4M cash, 500 devices, nearly $6M in marketing
Develop with Nokia Qt SDK, Web Runtime, or Java and Publish to Ovi Store 
http://p.sf.net/sfu/nokia-dev2dev
_______________________________________________
BackupPC-users mailing list
BackupPC-users AT lists.sourceforge DOT net
List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:    http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

<Prev in Thread] Current Thread [Next in Thread>