BackupPC-users

Re: [BackupPC-users] BackupPC on XFS getting lots of error -4 when calling...

2011-05-24 10:41:29
Subject: Re: [BackupPC-users] BackupPC on XFS getting lots of error -4 when calling...
From: Timothy J Massey <tmassey AT obscorp DOT com>
To: "General list for user discussion, questions and support" <backuppc-users AT lists.sourceforge DOT net>
Date: Tue, 24 May 2011 10:36:09 -0400
"Doherty, Peter Charles" <Peter_Doherty AT hms.harvard DOT edu> wrote on 05/24/2011 10:21:39 AM:

> >Just a note - our large xfs backuppc partition with many years of
> >historic backups and tens of millions of hardlinks does not even allow
> >for xfs_check - the program consumes all available memory (8GB) and
> >after a few days swaps itself to death.
>
> My memory is a little uncertain, and I can't find a solid reference, but I
> think you can use "xfs_repair -n" in place of xfs_check, without making
> any changes to the FS, and xfs_repair is less memory intensive.
> I'd be pretty worried operating a file system that had grown beyond the
> limits of what the FS check utility can handle.

I had that happen on EXT3.  My backup systems tend to run with a relatively small amount of memory (512MB).  I had a 2TB EXT2 partition mark itself dirty, and I could not get it to come back up without running fsck on it.  However, the OOM killer would kill it before it could complete.

I ended up upgrading that system to 2GB of RAM merely so that I could finish the fsck.

(Oh, and to a long-ago debate about would more RAM help BackupPC to do its job:  nope.  The backups with 2GB took almost exactly the same amount of time as the ones with 512MB.  I wasn't swapping with 512MB, and there just isn't that much data that can be profitably cached while doing a backup, as long as the file list can fit in RAM:  the few dentries and inodes in use at a time just don't take that much space...)

Timothy J. Massey
 
Out of the Box Solutions, Inc.
Creative IT Solutions Made Simple!

http://www.OutOfTheBoxSolutions.com
tmassey AT obscorp DOT com
      22108 Harper Ave.
St. Clair Shores, MI 48080
Office: (800)750-4OBS (4627)
Cell: (586)945-8796

------------------------------------------------------------------------------
vRanger cuts backup time in half-while increasing security.
With the market-leading solution for virtual backup and recovery, 
you get blazing-fast, flexible, and affordable data protection.
Download your free trial now. 
http://p.sf.net/sfu/quest-d2dcopy1
_______________________________________________
BackupPC-users mailing list
BackupPC-users AT lists.sourceforge DOT net
List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:    http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/