BackupPC-users

Re: [BackupPC-users] Backup fails after running 8-10 hours

2009-11-12 10:12:17
Subject: Re: [BackupPC-users] Backup fails after running 8-10 hours
From: Nick Bright <nick.bright AT valnet DOT net>
To: "General list for user discussion, questions and support" <backuppc-users AT lists.sourceforge DOT net>
Date: Thu, 12 Nov 2009 09:09:16 -0600
I didn't try it with rsyncd.

  - Nick

Shawn Perry wrote:
> Does it work with rsyncd?
> 
> On Tue, Nov 10, 2009 at 2:28 PM, Nick Bright <nick.bright AT valnet DOT net> 
> wrote:
>> The backup successfully completed with the "tar" method.
>>
>> Shawn Perry wrote:
>>> That sounds like a different sort of problem then.
>>>
>>> A deduplicator is a program that walks through a filesystem and finds
>>> identical files, and then hard links them together to save space.
>>>
>>> On Tue, Nov 10, 2009 at 12:57 PM, Nick Bright <nick.bright AT valnet DOT 
>>> net> wrote:
>>>> Shawn Perry wrote:
>>>>> Did you use a disk deduplicator on the drive? Is there a directory
>>>>> with alot of files in it?  How many files are you backing up?
>>>> Sorry, I'm not familiar with a "deduplicator".
>>>>
>>>> There aren't any directories with "a lot" of files any more than any of
>>>> the other systems I'm backing up.
>>>>
>>>> There are 202,984 files on the system.
>>>>
>>>>> If you have MANY hardlinks on a file system, rsync with the
>>>>> --hard-links option has a tendency to croak, leaving tar as the best
>>>>> option.
>>>> find / -printf "%n %i %p\n" | sort -nr
>>>>
>>>> Doesn't seem to indicate that there is an unusually large number of hard
>>>> links. The only stuff listed with a sizable amount of hard links appear
>>>> to be directories that are all system stuff that would exists on all
>>>> servers.
>>>>
>>>> The system itself is a cPanel hosting server, and hasn't had anything
>>>> special done to it. Let me put it this way - I didn't do anything to
>>>> knowingly create "a lot" of hardlinks. I'm sure there's some, but
>>>> probably not an unusually high number.
>>>>
>>>>> Dirvish has this same issue.
>>>>>
>>>>> To answer your question, find a directory or a couple of them that
>>>>> have a lot of files.  run "ls -l" or "ls -lR" (the latter is
>>>>> recursive) in that directory.  Look at the output.
>>>>>
>>>>> sample:
>>>>>
>>>>> -rw-r--r-- 79 shawn users   37888 2005-12-04 14:36 X-mas list.xls
>>>>>
>>>>> The first field after the permissions us the number of links to the
>>>>> data in that file, 79 in this case.  That means there are 79 hard
>>>>> links to that file.  There will always be at least one.
>>>> Similar to the output of my find command, which was telling me how many
>>>> hard links it found for each file/directory on the system. As I said,
>>>> nothing that seemed to unusual.
>>>>
>>>>> Shawn
>>>>>
>>>> You mentioned TAR being a better option on a system with lots of hard
>>>> links. I'll give that a try and see if it's able to perform a successful
>>>> backup.
>>>>
>>>> I will point out that I have a 2nd BackupPC server that is backing up a
>>>> *different* machine running the cPanel system, which has many, many,
>>>> many more files/domains on it; and that is successfully backing up.
>>>>
>>>> I'll also try backing the client in question up to said 2nd BackupPC
>>>> server and see if that works.
>>>>
>>>>> On Tue, Nov 10, 2009 at 10:05 AM, Nick Bright <nick.bright AT valnet DOT 
>>>>> net> wrote:
>>>>>>> Shawn Perry wrote:
>>>>>>> Does this host have alot of hard links?
>>>>>>>
>>>>>> That's a good question that I have no idea how to answer.
>>>>>>
>>>>>>
>>>>> ------------------------------------------------------------------------------
>>>>> Let Crystal Reports handle the reporting - Free Crystal Reports 2008 
>>>>> 30-Day
>>>>> trial. Simplify your report design, integration and deployment - and 
>>>>> focus on
>>>>> what you do best, core application coding. Discover what's new with
>>>>> Crystal Reports now.  http://p.sf.net/sfu/bobj-july
>>>>> _______________________________________________
>>>>> BackupPC-users mailing list
>>>>> BackupPC-users AT lists.sourceforge DOT net
>>>>> List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
>>>>> Wiki:    http://backuppc.wiki.sourceforge.net
>>>>> Project: http://backuppc.sourceforge.net/
>>>> ------------------------------------------------------------------------------
>>>> Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day
>>>> trial. Simplify your report design, integration and deployment - and focus 
>>>> on
>>>> what you do best, core application coding. Discover what's new with
>>>> Crystal Reports now.  http://p.sf.net/sfu/bobj-july
>>>> _______________________________________________
>>>> BackupPC-users mailing list
>>>> BackupPC-users AT lists.sourceforge DOT net
>>>> List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
>>>> Wiki:    http://backuppc.wiki.sourceforge.net
>>>> Project: http://backuppc.sourceforge.net/
>>>>
>>> ------------------------------------------------------------------------------
>>> Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day
>>> trial. Simplify your report design, integration and deployment - and focus 
>>> on
>>> what you do best, core application coding. Discover what's new with
>>> Crystal Reports now.  http://p.sf.net/sfu/bobj-july
>>> _______________________________________________
>>> BackupPC-users mailing list
>>> BackupPC-users AT lists.sourceforge DOT net
>>> List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
>>> Wiki:    http://backuppc.wiki.sourceforge.net
>>> Project: http://backuppc.sourceforge.net/
>> ------------------------------------------------------------------------------
>> Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day
>> trial. Simplify your report design, integration and deployment - and focus on
>> what you do best, core application coding. Discover what's new with
>> Crystal Reports now.  http://p.sf.net/sfu/bobj-july
>> _______________________________________________
>> BackupPC-users mailing list
>> BackupPC-users AT lists.sourceforge DOT net
>> List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
>> Wiki:    http://backuppc.wiki.sourceforge.net
>> Project: http://backuppc.sourceforge.net/
>>
> 
> ------------------------------------------------------------------------------
> Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day 
> trial. Simplify your report design, integration and deployment - and focus on 
> what you do best, core application coding. Discover what's new with
> Crystal Reports now.  http://p.sf.net/sfu/bobj-july
> _______________________________________________
> BackupPC-users mailing list
> BackupPC-users AT lists.sourceforge DOT net
> List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
> Wiki:    http://backuppc.wiki.sourceforge.net
> Project: http://backuppc.sourceforge.net/

------------------------------------------------------------------------------
Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day 
trial. Simplify your report design, integration and deployment - and focus on 
what you do best, core application coding. Discover what's new with
Crystal Reports now.  http://p.sf.net/sfu/bobj-july
_______________________________________________
BackupPC-users mailing list
BackupPC-users AT lists.sourceforge DOT net
List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:    http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/