BackupPC-users
[Top] [All Lists]
<prev [Date] next>
[Advanced]
 <prev [Thread] next>

[BackupPC-users] Noted Observations & Complaints Using BackupPC for 5 mon

2010-04-29 11:27:01
Subject: [BackupPC-users] Noted Observations & Complaints Using BackupPC for 5 mon
From: Saturn2888 <backuppc-forum AT backupcentral DOT com>
To: backuppc-users AT lists.sourceforge DOT net
Date: Thu, 29 Apr 2010 11:25:22 -0400 
Sorin, with your setup, VLANs don't seem out of the question.

In another case, I seem to be figuring out more and more why my machines are 
taking so long, Windows and Linux ones included. This PC started backing up 
over 8 hours ago. I looked at the PID, nothing. I looked at the Xfer PID, 
here's what I found:

> 
> open("/var/lib/backuppc/pc/main/69/full-drive/var/lib/ebox/gconf/ebox-ro/modules/events/configureEventTable/keys/conf6266",
>  O_RDONLY|O_NONBLOCK|O_LARGEFILE|O_DIRECTORY|0x80000) = 3
> open("/var/lib/backuppc/pc/main/69/full-drive/var/lib/ebox/gconf/ebox-ro/modules/events/configureEventTable/keys/conf6266/attrib",
>  O_RDONLY|O_LARGEFILE) = 3
> open("/var/lib/backuppc/pc/main/68/full-drive/var/lib/ebox/gconf/ebox-ro/modules/events/configureEventTable/keys/conf6266",
>  O_RDONLY|O_NONBLOCK|O_LARGEFILE|O_DIRECTORY|0x80000) = 3
> open("/var/lib/backuppc/pc/main/68/full-drive/var/lib/ebox/gconf/ebox-ro/modules/events/configureEventTable/keys/conf6266/attrib",
>  O_RDONLY|O_LARGEFILE) = 3
> open("/var/lib/backuppc/pc/main/67/full-drive/var/lib/ebox/gconf/ebox-ro/modules/events/configureEventTable/keys/conf6266",
>  O_RDONLY|O_NONBLOCK|O_LARGEFILE|O_DIRECTORY|0x80000) = 3
> open("/var/lib/backuppc/pc/main/67/full-drive/var/lib/ebox/gconf/ebox-ro/modules/events/configureEventTable/keys/conf6266/attrib",
>  O_RDONLY|O_LARGEFILE) = 3
> open("/var/lib/backuppc/pc/main/66/full-drive/var/lib/ebox/gconf/ebox-ro/modules/events/configureEventTable/keys/conf6266",
>  O_RDONLY|O_NONBLOCK|O_LARGEFILE|O_DIRECTORY|0x80000) = 3
> open("/var/lib/backuppc/pc/main/66/full-drive/var/lib/ebox/gconf/ebox-ro/modules/events/configureEventTable/keys/conf6266/attrib",
>  O_RDONLY|O_LARGEFILE) = 3
> open("/var/lib/backuppc/pc/main/65/full-drive/var/lib/ebox/gconf/ebox-ro/modules/events/configureEventTable/keys/conf6266",
>  O_RDONLY|O_NONBLOCK|O_LARGEFILE|O_DIRECTORY|0x80000) = 3
> open("/var/lib/backuppc/pc/main/65/full-drive/var/lib/ebox/gconf/ebox-ro/modules/events/configureEventTable/keys/conf6266/attrib",
>  O_RDONLY|O_LARGEFILE) = 3
> open("/var/lib/backuppc/pc/main/64/full-drive/var/lib/ebox/gconf/ebox-ro/modules/events/configureEventTable/keys/conf6266",
>  O_RDONLY|O_NONBLOCK|O_LARGEFILE|O_DIRECTORY|0x80000) = 3
> open("/var/lib/backuppc/pc/main/64/full-drive/var/lib/ebox/gconf/ebox-ro/modules/events/configureEventTable/keys/conf6266/attrib",
>  O_RDONLY|O_LARGEFILE) = 3
> open("/var/lib/backuppc/pc/main/63/full-drive/var/lib/ebox/gconf/ebox-ro/modules/events/configureEventTable/keys/conf6266",
>  O_RDONLY|O_NONBLOCK|O_LARGEFILE|O_DIRECTORY|0x80000) = 3
> open("/var/lib/backuppc/pc/main/63/full-drive/var/lib/ebox/gconf/ebox-ro/modules/events/configureEventTable/keys/conf6266/attrib",
>  O_RDONLY|O_LARGEFILE) = 3
> open("/var/lib/backuppc/pc/main/62/full-drive/var/lib/ebox/gconf/ebox-ro/modules/events/configureEventTable/keys/conf6266",
>  O_RDONLY|O_NONBLOCK|O_LARGEFILE|O_DIRECTORY|0x80000) = 3
> open("/var/lib/backuppc/pc/main/62/full-drive/var/lib/ebox/gconf/ebox-ro/modules/events/configureEventTable/keys/conf6266/attrib",
>  O_RDONLY|O_LARGEFILE) = 3
> open("/var/lib/backuppc/pc/main/61/full-drive/var/lib/ebox/gconf/ebox-ro/modules/events/configureEventTable/keys/conf6266",
>  O_RDONLY|O_NONBLOCK|O_LARGEFILE|O_DIRECTORY|0x80000) = 3
> open("/var/lib/backuppc/pc/main/61/full-drive/var/lib/ebox/gconf/ebox-ro/modules/events/configureEventTable/keys/conf6266/attrib",
>  O_RDONLY|O_LARGEFILE) = 3
> open("/var/lib/backuppc/pc/main/60/full-drive/var/lib/ebox/gconf/ebox-ro/modules/events/configureEventTable/keys/conf6266",
>  O_RDONLY|O_NONBLOCK|O_LARGEFILE|O_DIRECTORY|0x80000) = 3
> open("/var/lib/backuppc/pc/main/60/full-drive/var/lib/ebox/gconf/ebox-ro/modules/events/configureEventTable/keys/conf6266/attrib",
>  O_RDONLY|O_LARGEFILE) = 3
> stat64("/var/lib/backuppc/pc/main/new/full-drive/var/lib/ebox/gconf/ebox-ro/modules/events/configureEventTable/keys/conf6266/%25gconf.xml",
>  0x81530c8) = -1 ENOENT (No such file or directory)
> stat64("/var/lib/backuppc/pc/main/new//full-drive/RStmp", 0x81530c8) = -1 
> ENOENT (No such file or directory)
> stat64("/var/lib/backuppc/cpool/b//5/bf50328e06a80bcea0293670cc726879", 
> 0x81530c8) = -1 ENOENT (No such file or directory)
> open("/var/lib/backuppc/pc/main/new/full-drive/var/lib/ebox/gconf/ebox-ro/modules/events/configureEventTable/keys/conf6266/%25gconf.xml",
>  O_WRONLY|O_CREAT|O_TRUNC|O_LARGEFILE, 0666) = 3
> stat64("/var/lib/backuppc/pc/main/new/full-drive/var/lib/ebox/gconf/ebox-ro/modules/events/configureEventTable/keys/conf6266/%25gconf.xml",
>  {st_mode=S_IFREG|0644, st_size=203, ...}) = 0
> stat64("/var/lib/backuppc/pc/main/new/full-drive/var/lib/ebox/gconf/ebox-ro/modules/events/configureEventTable/keys/conf6266/attrib",
>  0x81530c8) = -1 ENOENT (No such file or directory)
> stat64("/var/lib/backuppc/pc/main/new/full-drive/var/lib/ebox/gconf/ebox-ro/modules/events/configureEventTable/keys/conf6266/attrib",
>  0x81530c8) = -1 ENOENT (No such file or directory)
> stat64("/var/lib/backuppc/cpool/5/e/c/5ec8ffd787cc5f2e88704a76cc3ec86b", 
> 0x81530c8) = -1 ENOENT (No such file or directory)
> open("/var/lib/backuppc/pc/main/new/full-drive/var/lib/ebox/gconf/ebox-ro/modules/events/configureEventTable/keys/conf6266/attrib",
>  O_WRONLY|O_CREAT|O_TRUNC|O_LARGEFILE, 0666) = 3
> stat64("/var/lib/backuppc/pc/main/new/full-drive/var/lib/ebox/gconf/ebox-ro/modules/events/configureEventTable/keys/conf6266/attrib",
>  {st_mode=S_IFREG|0644, st_size=36, ...}) = 0
> stat64("/var/lib/backuppc/pc/main/new//full-drive/var/lib/ebox/gconf/ebox-ro/modules/events/configureEventTable/keys/conf7761",
>  0x81530c8) = -1 ENOENT (No such file or directory)
> stat64("/var/lib/backuppc/pc/main/new//full-drive/var/lib/ebox/gconf/ebox-ro/modules/events/configureEventTable/keys/conf7761",
>  0x81530c8) = -1 ENOENT (No such file or directory)
> stat64("/var/lib/backuppc/pc/main/new//full-drive/var/lib/ebox/gconf/ebox-ro/modules/events/configureEventTable/keys",
>  {st_mode=S_IFDIR|0744, st_size=4096, ...}) = 0
> mkdir("/var/lib/backuppc/pc/main/new//full-drive/var/lib/ebox/gconf/ebox-ro/modules/events/configureEventTable/keys/conf7761",
>  0777) = 0
> stat64("/var/lib/backuppc/pc/main/new//full-drive/var/lib/ebox/gconf/ebox-ro/modules/events/configureEventTable/keys/conf7761",
>  {st_mode=S_IFDIR|0744, st_size=4096, ...}) = 0
> open("/var/lib/backuppc/pc/main/100/full-drive/var/lib/ebox/gconf/ebox-ro/modules/events/configureEventTable/keys/conf7761",
>  O_RDONLY|O_NONBLOCK|O_LARGEFILE|O_DIRECTORY|0x80000) = 3
> open("/var/lib/backuppc/pc/main/100/full-drive/var/lib/ebox/gconf/ebox-ro/modules/events/configureEventTable/keys/conf7761/attrib",
>  O_RDONLY|O_LARGEFILE) = 3
> open("/var/lib/backuppc/pc/main/99/full-drive/var/lib/ebox/gconf/ebox-ro/modules/events/configureEventTable/keys/conf7761",
>  O_RDONLY|O_NONBLOCK|O_LARGEFILE|O_DIRECTORY|0x80000) = 3
> open("/var/lib/backuppc/pc/main/99/full-drive/var/lib/ebox/gconf/ebox-ro/modules/events/configureEventTable/keys/conf7761/attrib",
>  O_RDONLY|O_LARGEFILE) = 3
> open("/var/lib/backuppc/pc/main/98/full-drive/var/lib/ebox/gconf/ebox-ro/modules/events/configureEventTable/keys/conf7761",
>  O_RDONLY|O_NONBLOCK|O_LARGEFILE|O_DIRECTORY|0x80000) = 3
> open("/var/lib/backuppc/pc/main/98/full-drive/var/lib/ebox/gconf/ebox-ro/modules/events/configureEventTable/keys/conf7761/attrib",
>  O_RDONLY|O_LARGEFILE) = 3
> open("/var/lib/backuppc/pc/main/97/full-drive/var/lib/ebox/gconf/ebox-ro/modules/events/configureEventTable/keys/conf7761",
>  O_RDONLY|O_NONBLOCK|O_LARGEFILE|O_DIRECTORY|0x80000) = 3
> open("/var/lib/backuppc/pc/main/97/full-drive/var/lib/ebox/gconf/ebox-ro/modules/events/configureEventTable/keys/conf7761/attrib",
>  O_RDONLY|O_LARGEFILE) = 3
> open("/var/lib/backuppc/pc/main/96/full-drive/var/lib/ebox/gconf/ebox-ro/modules/events/configureEventTable/keys/conf7761",
>  O_RDONLY|O_NONBLOCK|O_LARGEFILE|O_DIRECTORY|0x80000) = 3
> open("/var/lib/backuppc/pc/main/96/full-drive/var/lib/ebox/gconf/ebox-ro/modules/events/configureEventTable/keys/conf7761/attrib",
>  O_RDONLY|O_LARGEFILE) = 3
> open("/var/lib/backuppc/pc/main/95/full-drive/var/lib/ebox/gconf/ebox-ro/modules/events/configureEventTable/keys/conf7761",
>  O_RDONLY|O_NONBLOCK|O_LARGEFILE|O_DIRECTORY|0x80000) = 3
> open("/var/lib/backuppc/pc/main/95/full-drive/var/lib/ebox/gconf/ebox-ro/modules/events/configureEventTable/keys/conf7761/attrib",
>  O_RDONLY|O_LARGEFILE) = 3
> open("/var/lib/backuppc/pc/main/94/full-drive/var/lib/ebox/gconf/ebox-ro/modules/events/configureEventTable/keys/conf7761",
>  O_RDONLY|O_NONBLOCK|O_LARGEFILE|O_DIRECTORY|0x80000) = 3
> open("/var/lib/backuppc/pc/main/94/full-drive/var/lib/ebox/gconf/ebox-ro/modules/events/configureEventTable/keys/conf7761/attrib",
>  O_RDONLY|O_LARGEFILE) = 3
> open("/var/lib/backuppc/pc/main/93/full-drive/var/lib/ebox/gconf/ebox-ro/modules/events/configureEventTable/keys/conf7761",
>  O_RDONLY|O_NONBLOCK|O_LARGEFILE|O_DIRECTORY|0x80000
> o
> 


I noticed last night something else that seems an issue. While Rsync should be 
faster because it doesn't have to download files, it also seems to check all 
the previous backups for that file on that host. As you might be able to tell, 
it's searching through at least 40 incrementals here all with increasing 
sequential level numbers. Still, that shouldn't be so bad, but each incremental 
I add, it's getting easier and easier to figure out why the times have 
increased.

While I didn't say this in my first post, I used to have full backups on a lot 
of machines happen frequently, like weekly or every other week. With those 
machines only being based on just a few incrementals most of the time, it left 
a lot of laptops free to be backed up during the day using all of the available 
bandwidth on the machine and only needing a new full ever 30-60 days or so. 
That tied with my move to Rsyncd could very possibly have caused some of these 
slowdown issues for both Windows and Linux hosts.

+----------------------------------------------------------------------
|This was sent by Saturn2888 AT gmail DOT com via Backup Central.
|Forward SPAM to abuse AT backupcentral DOT com.
+----------------------------------------------------------------------



------------------------------------------------------------------------------
_______________________________________________
BackupPC-users mailing list
BackupPC-users AT lists.sourceforge DOT net
List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:    http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/
[More with this subject...]
<Prev in Thread] Current Thread [Next in Thread>
Previous by Date:  [BackupPC-users] Moved cable, backup kept going, Saturn2888
Next by Date:  [BackupPC-users] rsync on windows, Saturn2888
Previous by Thread:  Re: [BackupPC-users] Noted Observations & Complaints Using BackupPC for 5 mon, Sorin Srbu
Next by Thread:  Re: [BackupPC-users] Noted Observations & Complaints Using BackupPC for 5 mon, Les Mikesell
Indexes:  [Date] [Thread] [Top] [All Lists]