BackupPC-users

Re: [BackupPC-users] Slow backup

2010-10-14 12:26:16
Subject: Re: [BackupPC-users] Slow backup
From: "Tyler J. Wagner" <tyler AT tolaris DOT com>
To: a.visinoni AT autron DOT it, "General list for user discussion, questions and support" <backuppc-users AT lists.sourceforge DOT net>
Date: Thu, 14 Oct 2010 17:24:17 +0100
What is your IncrLevels setting? I bet you a donut that it is "1", which
means each incremental references the last full. So over time, more and
more files have changed from the last full.

Try setting IncrLevels to "1, 2, 3, 4, 5, 6". This means each
incremental will only back up files changed since the last incremental.

Regards,
Tyler

On Thu, 2010-10-14 at 15:03 +0200, Andrea Visinoni wrote:
> On a brand new Dell server with RAID5 SAS disk configuration we get this 
> backup results...and slowing down through time.
> The backup is local, from the server disk to the server disk.
> Changing compression level doesn't give results.
> 
> Any Hints?
> 
> Andrea
> 
> Backup Summary
> Click on the backup number to browse and restore backup files.
> 
> Backup#  Type  Filled  Level  Start Date  Duration/mins  Age/days Server 
> Backup Path
> 20  full  yes  0  10/6 02:00  1859.4  8.3  /home/backuppc/pc/localhost/20
> 21  incr  no  1  10/7 20:00  16.9  6.5  /home/backuppc/pc/localhost/21
> 22  incr  no  1  10/8 20:00  24.2  5.5  /home/backuppc/pc/localhost/22
> 23  incr  no  1  10/9 20:00  24.4  4.5  /home/backuppc/pc/localhost/23
> 24  incr  no  1  10/10 20:00  24.5  3.5  /home/backuppc/pc/localhost/24
> 25  incr  no  1  10/11 20:00  33.2  2.5  /home/backuppc/pc/localhost/25
> 26  incr  no  1  10/12 20:00  42.4  1.5  /home/backuppc/pc/localhost/26
> 
> Xfer Error Summary
> 
> 
> Backup#  Type  View  #Xfer errs  #bad files  #bad share  #tar errs
> 20  full  XferLOG, Errors  1  0  0  0
> 21  incr  XferLOG, Errors  0  0  0  0
> 22  incr  XferLOG, Errors  0  0  0  0
> 23  incr  XferLOG, Errors  0  0  0  0
> 24  incr  XferLOG, Errors  0  0  0  0
> 25  incr  XferLOG, Errors  0  0  0  0
> 26  incr  XferLOG, Errors  0  0  0  0
> 
> File Size/Count Reuse Summary
> Existing files are those already in the pool; new files are those added 
> to the pool. Empty files and SMB errors aren't counted in the reuse and 
> new counts.
> 
> Totals  Existing Files  New Files
> Backup#  Type  #Files  Size/MB  MB/sec  #Files  Size/MB  #Files  Size/MB
> 20  full  171785  36906.0  0.33  171511  36839.2  339  67.8
> 21  incr  600  151.5  0.15  168  25.5  538  126.1
> 22  incr  841  197.8  0.14  628  146.8  263  51.2
> 23  incr  841  197.8  0.14  841  197.8  2  0.0
> 24  incr  841  197.8  0.13  841  197.8  2  0.0
> 25  incr  1109  261.0  0.13  889  201.3  275  59.9
> 26  incr  1365  327.0  0.13  1142  263.0  273  64.1
> 
> Compression Summary
> Compression performance for files already in the pool and newly 
> compressed files.
> 
> Existing Files  New Files
> Backup#  Type  Comp Level  Size/MB  Comp/MB  Comp  Size/MB  Comp/MB  Comp
> 20  full  3  36839.2  10261.3  72.1%  67.8  12.9  80.9%
> 21  incr  3  25.5  6.9  72.8%  126.1  16.5  86.9%
> 22  incr  3  146.8  21.8  85.1%  51.2  7.9  84.5%
> 23  incr  3  197.8  29.7  85.0%  0.0  0.0  44.1%
> 24  incr  3  197.8  29.7  85.0%  0.0  0.0  44.0%
> 25  incr  3  201.3  29.9  85.2%  59.9  8.5  85.8%
> 26  incr  3  263.0  38.5  85.4%  64.1  9.4  85.3%
> 
> 
> caronte:/etc/backuppc# cat localhost.pl
> #
> # Local server backup of /etc as user backuppc
> #
> $Conf{XferMethod} = 'tar';
> 
> $Conf{TarShareName} = ['/etc', '/home/users', '/home/pub', 
> '/home/utente', '/roo
> t'];
> 
> $Conf{TarClientCmd} = '/usr/bin/env LC_ALL=C /usr/bin/sudo $tarPath -c 
> -v -f - -
> C $shareName'
>                         . ' --totals';
> 
> # remove extra shell escapes ($fileList+ etc.) that are
> # needed for remote backups but may break local ones
> $Conf{TarFullArgs} = '$fileList';
> $Conf{TarIncrArgs} = '--newer=$incrDate $fileList';
> 
> # Livello minimo di compressione dei files
> $Conf{CompressLevel} = 3
> caronte:/etc/backuppc#
> 
> ------------------------------------------------------------------------------
> Beautiful is writing same markup. Internet Explorer 9 supports
> standards for HTML5, CSS3, SVG 1.1,  ECMAScript5, and DOM L2 & L3.
> Spend less time writing and  rewriting code and more time creating great
> experiences on the web. Be a part of the beta today.
> http://p.sf.net/sfu/beautyoftheweb
> _______________________________________________
> BackupPC-users mailing list
> BackupPC-users AT lists.sourceforge DOT net
> List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
> Wiki:    http://backuppc.wiki.sourceforge.net
> Project: http://backuppc.sourceforge.net/
> 

--
"A competent and self-confident person is incapable of jealousy in
anything. Jealousy is invariably a symptom of neurotic insecurity."
   -- Lazarus Long, "Time Enough for Love", by Robert A. Heinlein


------------------------------------------------------------------------------
Beautiful is writing same markup. Internet Explorer 9 supports
standards for HTML5, CSS3, SVG 1.1,  ECMAScript5, and DOM L2 & L3.
Spend less time writing and  rewriting code and more time creating great
experiences on the web. Be a part of the beta today.
http://p.sf.net/sfu/beautyoftheweb
_______________________________________________
BackupPC-users mailing list
BackupPC-users AT lists.sourceforge DOT net
List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:    http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

<Prev in Thread] Current Thread [Next in Thread>