BackupPC-users

Re: [BackupPC-users] Backup fails after running 8-10 hours

2009-11-10 16:18:40
Subject: Re: [BackupPC-users] Backup fails after running 8-10 hours
From: Shawn Perry <redmopml AT comcast DOT net>
To: "General list for user discussion, questions and support" <backuppc-users AT lists.sourceforge DOT net>
Date: Tue, 10 Nov 2009 14:14:58 -0700
That sounds like a different sort of problem then.

A deduplicator is a program that walks through a filesystem and finds
identical files, and then hard links them together to save space.

On Tue, Nov 10, 2009 at 12:57 PM, Nick Bright <nick.bright AT valnet DOT net> 
wrote:
> Shawn Perry wrote:
>> Did you use a disk deduplicator on the drive? Is there a directory
>> with alot of files in it?  How many files are you backing up?
>
> Sorry, I'm not familiar with a "deduplicator".
>
> There aren't any directories with "a lot" of files any more than any of
> the other systems I'm backing up.
>
> There are 202,984 files on the system.
>
>>
>> If you have MANY hardlinks on a file system, rsync with the
>> --hard-links option has a tendency to croak, leaving tar as the best
>> option.
>
> find / -printf "%n %i %p\n" | sort -nr
>
> Doesn't seem to indicate that there is an unusually large number of hard
> links. The only stuff listed with a sizable amount of hard links appear
> to be directories that are all system stuff that would exists on all
> servers.
>
> The system itself is a cPanel hosting server, and hasn't had anything
> special done to it. Let me put it this way - I didn't do anything to
> knowingly create "a lot" of hardlinks. I'm sure there's some, but
> probably not an unusually high number.
>
>>
>> Dirvish has this same issue.
>>
>> To answer your question, find a directory or a couple of them that
>> have a lot of files.  run "ls -l" or "ls -lR" (the latter is
>> recursive) in that directory.  Look at the output.
>>
>> sample:
>>
>> -rw-r--r-- 79 shawn users   37888 2005-12-04 14:36 X-mas list.xls
>>
>> The first field after the permissions us the number of links to the
>> data in that file, 79 in this case.  That means there are 79 hard
>> links to that file.  There will always be at least one.
>
> Similar to the output of my find command, which was telling me how many
> hard links it found for each file/directory on the system. As I said,
> nothing that seemed to unusual.
>
>>
>> Shawn
>>
>
> You mentioned TAR being a better option on a system with lots of hard
> links. I'll give that a try and see if it's able to perform a successful
> backup.
>
> I will point out that I have a 2nd BackupPC server that is backing up a
> *different* machine running the cPanel system, which has many, many,
> many more files/domains on it; and that is successfully backing up.
>
> I'll also try backing the client in question up to said 2nd BackupPC
> server and see if that works.
>
>>
>>
>> On Tue, Nov 10, 2009 at 10:05 AM, Nick Bright <nick.bright AT valnet DOT 
>> net> wrote:
>>>> Shawn Perry wrote:
>>>> Does this host have alot of hard links?
>>>>
>>> That's a good question that I have no idea how to answer.
>>>
>>>
>>
>> ------------------------------------------------------------------------------
>> Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day
>> trial. Simplify your report design, integration and deployment - and focus on
>> what you do best, core application coding. Discover what's new with
>> Crystal Reports now.  http://p.sf.net/sfu/bobj-july
>> _______________________________________________
>> BackupPC-users mailing list
>> BackupPC-users AT lists.sourceforge DOT net
>> List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
>> Wiki:    http://backuppc.wiki.sourceforge.net
>> Project: http://backuppc.sourceforge.net/
>
> ------------------------------------------------------------------------------
> Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day
> trial. Simplify your report design, integration and deployment - and focus on
> what you do best, core application coding. Discover what's new with
> Crystal Reports now.  http://p.sf.net/sfu/bobj-july
> _______________________________________________
> BackupPC-users mailing list
> BackupPC-users AT lists.sourceforge DOT net
> List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
> Wiki:    http://backuppc.wiki.sourceforge.net
> Project: http://backuppc.sourceforge.net/
>

------------------------------------------------------------------------------
Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day 
trial. Simplify your report design, integration and deployment - and focus on 
what you do best, core application coding. Discover what's new with
Crystal Reports now.  http://p.sf.net/sfu/bobj-july
_______________________________________________
BackupPC-users mailing list
BackupPC-users AT lists.sourceforge DOT net
List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:    http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/