BackupPC-users

Re: [BackupPC-users] Backup fails after running 8-10 hours

2009-11-10 16:31:10
Subject: Re: [BackupPC-users] Backup fails after running 8-10 hours
From: Nick Bright <nick.bright AT valnet DOT net>
To: "General list for user discussion, questions and support" <backuppc-users AT lists.sourceforge DOT net>
Date: Tue, 10 Nov 2009 15:28:19 -0600
The backup successfully completed with the "tar" method.

Shawn Perry wrote:
> That sounds like a different sort of problem then.
> 
> A deduplicator is a program that walks through a filesystem and finds
> identical files, and then hard links them together to save space.
> 
> On Tue, Nov 10, 2009 at 12:57 PM, Nick Bright <nick.bright AT valnet DOT net> 
> wrote:
>> Shawn Perry wrote:
>>> Did you use a disk deduplicator on the drive? Is there a directory
>>> with alot of files in it?  How many files are you backing up?
>> Sorry, I'm not familiar with a "deduplicator".
>>
>> There aren't any directories with "a lot" of files any more than any of
>> the other systems I'm backing up.
>>
>> There are 202,984 files on the system.
>>
>>> If you have MANY hardlinks on a file system, rsync with the
>>> --hard-links option has a tendency to croak, leaving tar as the best
>>> option.
>> find / -printf "%n %i %p\n" | sort -nr
>>
>> Doesn't seem to indicate that there is an unusually large number of hard
>> links. The only stuff listed with a sizable amount of hard links appear
>> to be directories that are all system stuff that would exists on all
>> servers.
>>
>> The system itself is a cPanel hosting server, and hasn't had anything
>> special done to it. Let me put it this way - I didn't do anything to
>> knowingly create "a lot" of hardlinks. I'm sure there's some, but
>> probably not an unusually high number.
>>
>>> Dirvish has this same issue.
>>>
>>> To answer your question, find a directory or a couple of them that
>>> have a lot of files.  run "ls -l" or "ls -lR" (the latter is
>>> recursive) in that directory.  Look at the output.
>>>
>>> sample:
>>>
>>> -rw-r--r-- 79 shawn users   37888 2005-12-04 14:36 X-mas list.xls
>>>
>>> The first field after the permissions us the number of links to the
>>> data in that file, 79 in this case.  That means there are 79 hard
>>> links to that file.  There will always be at least one.
>> Similar to the output of my find command, which was telling me how many
>> hard links it found for each file/directory on the system. As I said,
>> nothing that seemed to unusual.
>>
>>> Shawn
>>>
>> You mentioned TAR being a better option on a system with lots of hard
>> links. I'll give that a try and see if it's able to perform a successful
>> backup.
>>
>> I will point out that I have a 2nd BackupPC server that is backing up a
>> *different* machine running the cPanel system, which has many, many,
>> many more files/domains on it; and that is successfully backing up.
>>
>> I'll also try backing the client in question up to said 2nd BackupPC
>> server and see if that works.
>>
>>>
>>> On Tue, Nov 10, 2009 at 10:05 AM, Nick Bright <nick.bright AT valnet DOT 
>>> net> wrote:
>>>>> Shawn Perry wrote:
>>>>> Does this host have alot of hard links?
>>>>>
>>>> That's a good question that I have no idea how to answer.
>>>>
>>>>
>>> ------------------------------------------------------------------------------
>>> Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day
>>> trial. Simplify your report design, integration and deployment - and focus 
>>> on
>>> what you do best, core application coding. Discover what's new with
>>> Crystal Reports now.  http://p.sf.net/sfu/bobj-july
>>> _______________________________________________
>>> BackupPC-users mailing list
>>> BackupPC-users AT lists.sourceforge DOT net
>>> List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
>>> Wiki:    http://backuppc.wiki.sourceforge.net
>>> Project: http://backuppc.sourceforge.net/
>> ------------------------------------------------------------------------------
>> Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day
>> trial. Simplify your report design, integration and deployment - and focus on
>> what you do best, core application coding. Discover what's new with
>> Crystal Reports now.  http://p.sf.net/sfu/bobj-july
>> _______________________________________________
>> BackupPC-users mailing list
>> BackupPC-users AT lists.sourceforge DOT net
>> List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
>> Wiki:    http://backuppc.wiki.sourceforge.net
>> Project: http://backuppc.sourceforge.net/
>>
> 
> ------------------------------------------------------------------------------
> Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day 
> trial. Simplify your report design, integration and deployment - and focus on 
> what you do best, core application coding. Discover what's new with
> Crystal Reports now.  http://p.sf.net/sfu/bobj-july
> _______________________________________________
> BackupPC-users mailing list
> BackupPC-users AT lists.sourceforge DOT net
> List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
> Wiki:    http://backuppc.wiki.sourceforge.net
> Project: http://backuppc.sourceforge.net/

------------------------------------------------------------------------------
Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day 
trial. Simplify your report design, integration and deployment - and focus on 
what you do best, core application coding. Discover what's new with
Crystal Reports now.  http://p.sf.net/sfu/bobj-july
_______________________________________________
BackupPC-users mailing list
BackupPC-users AT lists.sourceforge DOT net
List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:    http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/