smallpox wrote at about 07:15:07 -0800 on Friday, January 20, 2012:
> i was under the impression that rsync does the comparison with little or
> no bandwidth.
First, PLEASE DON'T TOP-POST - it makes following and responding
to a thread near impossible.
Second, what makes you think the issue is a bandwidth issue? You just
said that it takes 10 minutes. Have you determined that the time is
due to bandwidth bottlenecks and not just disk reads and rsync
computations?
Third, why would you expect rsync -- even without backuppc -- to take
significantly fewer than 10 minutes to crawl a directory tree of
"a hundred thousand files" including in reading in the inode
information from each file, transmitting it across the network,
comparing it to said information stored in the BackupPC attrib
file. Plus any changed files will require reading, decompressing, and
computing rolling md4 checksums on each of the target files as part of
the rsync algorithm. Then the full directory tree needs to be
constructed on the BackupPC Server including attrib files and any
changed files (this is for incrementals). Do you expect this to all
happen instantaneously?
Fourth, are you sure that you want to do "continuous" (your words)
backups? That means that you are creating an ever-increasing (and
theoretically infinite) number of incremental backups each requiring a
full directory tree parallel to the source plus attrib files and
changed files. Additionally, any time a file changes by even one byte,
than a whole new copy is saved to the pool (think log files or system
files that may change multiple times per second).
In summary, I think you are trying to solve a problem that may not
need to be solved, using a tool that is not meant to solve it, without
understanding what is causing your problems and without knowing how
the tool actually works in the first place :)
> On 1/20/2012 5:50 AM, Michael Stowe wrote:
> >> BackupPC 3.2.1
> >> Windows 7 rsyncd over ssh, west coast
> >> the server is in the east.
> >>
> >> my goal is to have it updated every 15 minutes, i've gotten that to work
> >> but for incremental, with no changes, it's still taking about 10 minutes
> >> most of the time and it is doing traffic.
> > I would expect most of that traffic would be checking to see if there are
> > changes to the files.
> >
> >> i do not understand why incremental with absolutely no changes is taking
> >> so long ? ultimately i'd like to have a hundred thousand files being
> >> backed up constantly, is this just a dream ?
> > How would you propose that changes be recognized, if not through rsync's
> > mechanisms of comparison?
> >
> > You can always go to cmd/cifs and use time stamps to determine what's
> > changed, I suppose.
> >
> >> thanks in advance
> >
> > ------------------------------------------------------------------------------
> > Keep Your Developer Skills Current with LearnDevNow!
> > The most comprehensive online learning library for Microsoft developers
> > is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3,
> > Metro Style Apps, more. Free future releases when you subscribe now!
> > http://p.sf.net/sfu/learndevnow-d2d
> > _______________________________________________
> > BackupPC-users mailing list
> > BackupPC-users AT lists.sourceforge DOT net
> > List: https://lists.sourceforge.net/lists/listinfo/backuppc-users
> > Wiki: http://backuppc.wiki.sourceforge.net
> > Project: http://backuppc.sourceforge.net/
> >
>
> ------------------------------------------------------------------------------
> Keep Your Developer Skills Current with LearnDevNow!
> The most comprehensive online learning library for Microsoft developers
> is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3,
> Metro Style Apps, more. Free future releases when you subscribe now!
> http://p.sf.net/sfu/learndevnow-d2d
> _______________________________________________
> BackupPC-users mailing list
> BackupPC-users AT lists.sourceforge DOT net
> List: https://lists.sourceforge.net/lists/listinfo/backuppc-users
> Wiki: http://backuppc.wiki.sourceforge.net
> Project: http://backuppc.sourceforge.net/
------------------------------------------------------------------------------
Keep Your Developer Skills Current with LearnDevNow!
The most comprehensive online learning library for Microsoft developers
is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3,
Metro Style Apps, more. Free future releases when you subscribe now!
http://p.sf.net/sfu/learndevnow-d2d
_______________________________________________
BackupPC-users mailing list
BackupPC-users AT lists.sourceforge DOT net
List: https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki: http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/
|
