Re: [BackupPC-users] Backup fails after running 8-10 hours

Does it work with rsyncd?

On Tue, Nov 10, 2009 at 2:28 PM, Nick Bright <nick.bright AT valnet DOT net> 
wrote:
> The backup successfully completed with the "tar" method.
>
> Shawn Perry wrote:
>> That sounds like a different sort of problem then.
>>
>> A deduplicator is a program that walks through a filesystem and finds
>> identical files, and then hard links them together to save space.
>>
>> On Tue, Nov 10, 2009 at 12:57 PM, Nick Bright <nick.bright AT valnet DOT 
>> net> wrote:
>>> Shawn Perry wrote:
>>>> Did you use a disk deduplicator on the drive? Is there a directory
>>>> with alot of files in it?  How many files are you backing up?
>>> Sorry, I'm not familiar with a "deduplicator".
>>>
>>> There aren't any directories with "a lot" of files any more than any of
>>> the other systems I'm backing up.
>>>
>>> There are 202,984 files on the system.
>>>
>>>> If you have MANY hardlinks on a file system, rsync with the
>>>> --hard-links option has a tendency to croak, leaving tar as the best
>>>> option.
>>> find / -printf "%n %i %p\n" | sort -nr
>>>
>>> Doesn't seem to indicate that there is an unusually large number of hard
>>> links. The only stuff listed with a sizable amount of hard links appear
>>> to be directories that are all system stuff that would exists on all
>>> servers.
>>>
>>> The system itself is a cPanel hosting server, and hasn't had anything
>>> special done to it. Let me put it this way - I didn't do anything to
>>> knowingly create "a lot" of hardlinks. I'm sure there's some, but
>>> probably not an unusually high number.
>>>
>>>> Dirvish has this same issue.
>>>>
>>>> To answer your question, find a directory or a couple of them that
>>>> have a lot of files.  run "ls -l" or "ls -lR" (the latter is
>>>> recursive) in that directory.  Look at the output.
>>>>
>>>> sample:
>>>>
>>>> -rw-r--r-- 79 shawn users   37888 2005-12-04 14:36 X-mas list.xls
>>>>
>>>> The first field after the permissions us the number of links to the
>>>> data in that file, 79 in this case.  That means there are 79 hard
>>>> links to that file.  There will always be at least one.
>>> Similar to the output of my find command, which was telling me how many
>>> hard links it found for each file/directory on the system. As I said,
>>> nothing that seemed to unusual.
>>>
>>>> Shawn
>>>>
>>> You mentioned TAR being a better option on a system with lots of hard
>>> links. I'll give that a try and see if it's able to perform a successful
>>> backup.
>>>
>>> I will point out that I have a 2nd BackupPC server that is backing up a
>>> *different* machine running the cPanel system, which has many, many,
>>> many more files/domains on it; and that is successfully backing up.
>>>
>>> I'll also try backing the client in question up to said 2nd BackupPC
>>> server and see if that works.
>>>
>>>>
>>>> On Tue, Nov 10, 2009 at 10:05 AM, Nick Bright <nick.bright AT valnet DOT 
>>>> net> wrote:
>>>>>> Shawn Perry wrote:
>>>>>> Does this host have alot of hard links?
>>>>>>
>>>>> That's a good question that I have no idea how to answer.
>>>>>
>>>>>
>>>> ------------------------------------------------------------------------------
>>>> Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day
>>>> trial. Simplify your report design, integration and deployment - and focus 
>>>> on
>>>> what you do best, core application coding. Discover what's new with
>>>> Crystal Reports now.  http://p.sf.net/sfu/bobj-july
>>>> _______________________________________________
>>>> BackupPC-users mailing list
>>>> BackupPC-users AT lists.sourceforge DOT net
>>>> List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
>>>> Wiki:    http://backuppc.wiki.sourceforge.net
>>>> Project: http://backuppc.sourceforge.net/
>>> ------------------------------------------------------------------------------
>>> Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day
>>> trial. Simplify your report design, integration and deployment - and focus 
>>> on
>>> what you do best, core application coding. Discover what's new with
>>> Crystal Reports now.  http://p.sf.net/sfu/bobj-july
>>> _______________________________________________
>>> BackupPC-users mailing list
>>> BackupPC-users AT lists.sourceforge DOT net
>>> List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
>>> Wiki:    http://backuppc.wiki.sourceforge.net
>>> Project: http://backuppc.sourceforge.net/
>>>
>>
>> ------------------------------------------------------------------------------
>> Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day
>> trial. Simplify your report design, integration and deployment - and focus on
>> what you do best, core application coding. Discover what's new with
>> Crystal Reports now.  http://p.sf.net/sfu/bobj-july
>> _______________________________________________
>> BackupPC-users mailing list
>> BackupPC-users AT lists.sourceforge DOT net
>> List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
>> Wiki:    http://backuppc.wiki.sourceforge.net
>> Project: http://backuppc.sourceforge.net/
>
> ------------------------------------------------------------------------------
> Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day
> trial. Simplify your report design, integration and deployment - and focus on
> what you do best, core application coding. Discover what's new with
> Crystal Reports now.  http://p.sf.net/sfu/bobj-july
> _______________________________________________
> BackupPC-users mailing list
> BackupPC-users AT lists.sourceforge DOT net
> List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
> Wiki:    http://backuppc.wiki.sourceforge.net
> Project: http://backuppc.sourceforge.net/
>

------------------------------------------------------------------------------
Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day 
trial. Simplify your report design, integration and deployment - and focus on 
what you do best, core application coding. Discover what's new with
Crystal Reports now.  http://p.sf.net/sfu/bobj-july
_______________________________________________
BackupPC-users mailing list
BackupPC-users AT lists.sourceforge DOT net
List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:    http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/