BackupPC-users

Re: [BackupPC-users] Backup faiures, how to troublehoot

2009-03-11 15:21:45
Subject: Re: [BackupPC-users] Backup faiures, how to troublehoot
From: Andrew Libby <alibby AT xforty DOT com>
To: "General list for user discussion, questions and support" <backuppc-users AT lists.sourceforge DOT net>
Date: Wed, 11 Mar 2009 15:15:01 -0400
Andrew Libby wrote:
> Les Mikesell wrote:
>> Andrew Libby wrote:
>>>> There are a lot of files on the system, and backups take
>>> quite a while so I upped the timeout to 40 hrs, but
>>> backups seem to be failing now in under 20 hrs when they
>>> were failing at the 20 hr mark.
>>>
>>> Any hints or suggestions are greatly apprecaiated.  Other
>>> info that might be helpful:
>>>
>>> Both client and server are ubuntu 8.04.
>>> Transport is rsync.  Client has about 6.5 million files.
>> One possibility is a corrupted file system. Have you done an fsck 
>> recently?  That's also a lot of files to process in one run.  Rsync 
>> loads the whole directory tree in RAM and becomes extremely slow if you 
>> go into swap.
>>
> 
> Hi Les,
> 
> So we calculated it and the ram comes to under a gig.  We've
> got 4G of ram.  The system does not seem to swap when
> processing a backup.   fsck also seems to be in good standing.
> 
> Thanks for the suggestions,
> 
> Andy

Okay, so I've got some more information.  Seems that the
log in /var/lib/backuppc/log called LOG has

2009-03-11 10:12:23 shyamalan: Out of memory!
2009-03-11 10:12:35 Backup failed on shyamalan (Child exited
prematurely)


I thought out of memory errors were to happen on the client,
rather than the server.  I don't know why I would think that
though.

The server here has 4G, and as I said, the ram required for
the 6M files should be under a gig 6512257 * 100 == 621M
unless my math stinks (and it frequently does).

My sar stats clearly show the backuppc server running out
of memory, but swap utilization remains low.

Thanks for any further insight.

Andy

------------------------------------------------------------------------------
Apps built with the Adobe(R) Flex(R) framework and Flex Builder(TM) are
powering Web 2.0 with engaging, cross-platform capabilities. Quickly and
easily build your RIAs with Flex Builder, the Eclipse(TM)based development
software that enables intelligent coding and step-through debugging.
Download the free 60 day trial. http://p.sf.net/sfu/www-adobe-com
_______________________________________________
BackupPC-users mailing list
BackupPC-users AT lists.sourceforge DOT net
List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:    http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/