This may be a question more suited for backuppc-devel, but I thought
I should try here first.
Running BackupPC-3.2.0beta1 (difference from 3.2.0 is likely not
relevant), backing up a Windows client using FTP. There is an 11GB movie
file on the Windows client, and when BackupPC is trying to copy it from
the Windows machine, BackupPC_dump just keeps growing and eventually (I'm
assuming) runs out of memory.
I don't think Windows is relevant here, I think the problem is because
it's a large file and backup is via FTP.
strace output looks like this:
select(8, [7], NULL, NULL, {120, 0}) = 1 (in [7], left {120, 0})
read(7, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"...,
10240) = 10240
mremap(0x9dbac000, 266067968, 266080256, MREMAP_MAYMOVE) = 0x9dbac000
select(8, [7], NULL, NULL, {120, 0}) = 1 (in [7], left {120, 0})
read(7, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"...,
10240) = 10240
mremap(0x9dbac000, 266080256, 266088448, MREMAP_MAYMOVE) = 0x9dbac000
select(8, [7], NULL, NULL, {120, 0}) = 1 (in [7], left {120, 0})
read(7, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"...,
10240) = 10240
mremap(0x9dbac000, 266088448, 266100736, MREMAP_MAYMOVE) = 0x9dbac000
and BackupPC_dump just keeps on growing, 8K or 12K bytes at a time.
I think it's because in lib/BackupPC/Xfer/Ftp.pm we have at line 909
in handleFile():
eval { tie ( *FTP, 'Net::FTP::RetrHandle', $ftp, $f->{fullName} ); };
which I think sucks the entire file into memory, and then writes to disk.
Am I reading that correctly? I had a look but couldn't find any other
references to this problem. Anyone else run into this and created a
workaround?
(I'm using FTP because my Windows rsync of choice - DeltaCopy - seemed
to be confused by Windows 7's multitude of links/shortcuts, and we
don't want to use a share on portable machines, out of a belief that
we can control FTP better than we can control shares.)
Thanks for any help you can provide!
John
jsellens AT syonex DOT com
------------------------------------------------------------------------------
Benefiting from Server Virtualization: Beyond Initial Workload
Consolidation -- Increasing the use of server virtualization is a top
priority.Virtualization can reduce costs, simplify management, and improve
application availability and disaster protection. Learn more about boosting
the value of server virtualization. http://p.sf.net/sfu/vmware-sfdev2dev
_______________________________________________
BackupPC-users mailing list
BackupPC-users AT lists.sourceforge DOT net
List: https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki: http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/
|
