Ralf Gross schrieb:
> Ralf Gross schrieb:
> > Tyler J. Wagner schrieb:
> > >
> > >
> > > On Wednesday 26 May 2010 14:34:40 Sorin Srbu wrote:
> > > > >-----Original Message-----
> > > > >From: Les Mikesell [mailto:lesmikesell AT gmail DOT com]
> > > > >Sent: Wednesday, May 26, 2010 2:55 PM
> > > > >To: General list for user discussion, questions and support
> > > > >Subject: Re: [BackupPC-users] speed up backups
> > > > >
> > > > >After the 1st 2 fulls, rsync should be better if you have enabled
> > > > >checksum
> > > > >caching. You do need plenty of RAM to hold the directory listing if
> > > > >you
> > > >
> > > > have a
> > > >
> > > > >large number of files.
> > > >
> > > > That was the checksum= 31thousandsomething to be added somewhere. I
> > > > need to
> > > > find that mail in the archives...
> > > >
> > >
> > > Add to RsyncArgs and RsyncRestoreArgs:
> > >
> > > --checksum-seed=32761
> > >
> > > The best thing about BackupPC is that all help is available from the web
> > > interface.
> >
> > Ok, I give it a shot. Changed the Xfer method to rsync, updated to
> > rsync 3.0.2 (I know I will not benefit much because of BackupPC's own
> > rsync perl module) and added the --checksum-seed option.
> >
> > Right now the rsync process is consuming 370 MB and is still growing.
> > The file server has 7.000.000 files. Let's see what happens...
>
> Hm, after 45 minutes the memory usage stopped growing at 540 MB. But now I
> don't see any activity at all. Neither on the file server, nor on the BackupPC
> server. Nothing in the BackupPC log since start of the backup. Nothing in the
> the NewFileList file.
>
> On the file server I get this info with lsof:
>
> # lsof | grep rsync
> rsync 31139 root cwd DIR 104,1 4096
> 2 /
> rsync 31139 root rtd DIR 104,1 4096
> 2 /
> rsync 31139 root txt REG 104,1 384304
> 571696 /usr/bin/rsync
> rsync 31139 root mem REG 0,0
> 0 [heap] (stat: No such file or directory)
> rsync 31139 root mem REG 104,1 97928
> 2026757 /lib/ld-2.3.6.so
> rsync 31139 root mem REG 104,1 26088
> 2023687 /lib/libacl.so.1.1.0
> rsync 31139 root mem REG 104,1 31784
> 2023965 /lib/libpopt.so.0.0.0
> rsync 31139 root mem REG 104,1 1286104
> 2026779 /lib/libc-2.3.6.so
> rsync 31139 root mem REG 104,1 15568
> 2023689 /lib/libattr.so.1.1.0
> rsync 31139 root 0u unix 0xffff81020f1ffc80
> 29056104 socket
> rsync 31139 root 1u unix 0xffff81020f1ffc80
> 29056104 socket
> rsync 31139 root 2u unix 0xffff81020f1ff380
> 29056106 socket
>
>
> strace on the BackupPC server (BackupPC_dump process):
>
> $strace -f -p 11972
> Process 11972 attached - interrupt to quit
> select(8, [7], NULL, [7], NULL
>
>
> strace on the file server (rsync):
>
> $strace -f -p 31139
> Process 31139 attached - interrupt to quit
> select(1, [0], [], NULL, {11, 972000}
>
next try
# strace -e trace=\!file -f -p 12795
[60 minutes later]
fstat(3, {st_mode=S_IFDIR|0755, st_size=12288, ...}) = 0
fcntl(3, F_SETFD, FD_CLOEXEC) = 0
getdents64(3, /* 126 entries */, 4096) = 4096
select(2, NULL, [1], [1], {60, 0}) = 1 (out [1], left {60, 0})
write(1, "\374\17\0\7", 4) = 4
select(2, NULL, [1], [1], {60, 0}) = 1 (out [1], left {60, 0})
write(1, "he/pagelinks\6\0\0\0\35\216\333H:K\ttext_html"..., 4092) = 4092
getdents64(3, /* 85 entries */, 4096) = 2752
select(2, NULL, [1], [1], {60, 0}) = 1 (out [1], left {60, 0})
write(1, "\374\17\0\7", 4) = 4
select(2, NULL, [1], [1], {60, 0}) = 1 (out [1], left {60, 0})
write(1, "rsion:\5\2ip\7\0\0\0\33I\246E\7\0\0\0/bin/ip8\5\6"..., 4092) = 4092
getdents64(3, /* 0 entries */, 4096) = 0
close(3) = 0
fstat(3, {st_mode=S_IFDIR|0700, st_size=16384, ...}) = 0
fcntl(3, F_SETFD, FD_CLOEXEC) = 0
getdents64(3, /* 2 entries */, 4096) = 48
getdents64(3, /* 0 entries */, 4096) = 0
close(3) = 0
fstat(3, {st_mode=S_IFDIR|0755, st_size=0, ...}) = 0
fcntl(3, F_SETFD, FD_CLOEXEC) = 0
getdents64(3, /* 11 entries */, 4096) = 320
getdents64(3, /* 0 entries */, 4096) = 0
close(3) = 0
mmap(NULL, 29110272, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) =
0x2ac342e63000
munmap(0x2ac342e63000, 29110272) = 0
select(2, NULL, [1], [1], {60, 0}) = 1 (out [1], left {60, 0})
write(1, "N\2\0\7\5\3lvs\r\0\0\0\r\0\0\0lvmiopversion8\5"..., 594) = 594
select(1, [0], [], NULL, {60, 0}) = 0 (Timeout)
select(1, [0], [], NULL, {60, 0}) = 0 (Timeout)
select(1, [0], [], NULL, {60, 0}) = 0 (Timeout)
select(1, [0], [], NULL, {60, 0}) = 0 (Timeout)
select(1, [0], [], NULL, {60, 0}
smells like a time out, but I don't know where. I found a couple of messages
with similar output in the list archives, but none of them had a solution yet.
Ralf
------------------------------------------------------------------------------
_______________________________________________
BackupPC-users mailing list
BackupPC-users AT lists.sourceforge DOT net
List: https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki: http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/
|
