BackupPC-users

Re: [BackupPC-users] speed up backups

2010-05-26 14:55:45
Subject: Re: [BackupPC-users] speed up backups
From: Ralf Gross <Ralf-Lists AT ralfgross DOT de>
To: backuppc-users AT lists.sourceforge DOT net
Date: Wed, 26 May 2010 20:35:36 +0200
Ralf Gross schrieb:
> Tyler J. Wagner schrieb:
> > 
> > 
> > On Wednesday 26 May 2010 14:34:40 Sorin Srbu wrote:
> > > >-----Original Message-----
> > > >From: Les Mikesell [mailto:lesmikesell AT gmail DOT com]
> > > >Sent: Wednesday, May 26, 2010 2:55 PM
> > > >To: General list for user discussion, questions and support
> > > >Subject: Re: [BackupPC-users] speed up backups
> > > >
> > > >After the 1st 2 fulls, rsync should be better if you have enabled 
> > > >checksum
> > > >caching.  You do need plenty of RAM to hold the directory listing if you
> > > 
> > > have a
> > > 
> > > >large number of files.
> > > 
> > > That was the checksum= 31thousandsomething to be added somewhere. I need 
> > > to
> > > find that mail in the archives...
> > > 
> > 
> > Add to RsyncArgs and RsyncRestoreArgs:
> > 
> > --checksum-seed=32761
> > 
> > The best thing about BackupPC is that all help is available from the web 
> > interface.
> 
> Ok, I give it a shot. Changed the Xfer method to rsync, updated to
> rsync 3.0.2 (I know I will not benefit much because of BackupPC's own
> rsync perl module) and added the --checksum-seed option.
> 
> Right now the rsync process is consuming 370 MB and is still growing.
> The file server has 7.000.000 files. Let's see what happens...

Hm, after 45 minutes the memory usage stopped growing at 540 MB. But now I
don't see any activity at all. Neither on the file server, nor on the BackupPC
server.  Nothing in the BackupPC log since start of the backup. Nothing in the
the NewFileList file.

On the file server I get this info with lsof:

# lsof | grep rsync
rsync     31139      root  cwd       DIR              104,1     4096          2 
/
rsync     31139      root  rtd       DIR              104,1     4096          2 
/
rsync     31139      root  txt       REG              104,1   384304     571696 
/usr/bin/rsync
rsync     31139      root  mem       REG                0,0                   0 
[heap] (stat: No such file or directory)
rsync     31139      root  mem       REG              104,1    97928    2026757 
/lib/ld-2.3.6.so
rsync     31139      root  mem       REG              104,1    26088    2023687 
/lib/libacl.so.1.1.0
rsync     31139      root  mem       REG              104,1    31784    2023965 
/lib/libpopt.so.0.0.0
rsync     31139      root  mem       REG              104,1  1286104    2026779 
/lib/libc-2.3.6.so
rsync     31139      root  mem       REG              104,1    15568    2023689 
/lib/libattr.so.1.1.0
rsync     31139      root    0u     unix 0xffff81020f1ffc80            29056104 
socket
rsync     31139      root    1u     unix 0xffff81020f1ffc80            29056104 
socket
rsync     31139      root    2u     unix 0xffff81020f1ff380            29056106 
socket


strace on the BackupPC server (BackupPC_dump process):

$strace -f -p 11972
Process 11972 attached - interrupt to quit
select(8, [7], NULL, [7], NULL


strace on the file server (rsync):

$strace -f -p 31139
Process 31139 attached - interrupt to quit
select(1, [0], [], NULL, {11, 972000}


Ralf

------------------------------------------------------------------------------

_______________________________________________
BackupPC-users mailing list
BackupPC-users AT lists.sourceforge DOT net
List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:    http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/