On 1/20/2012 11:49 AM, Jeffrey J. Kosowsky wrote:
> smallpox wrote at about 07:15:07 -0800 on Friday, January 20, 2012:
> > i was under the impression that rsync does the comparison with little or
> > no bandwidth.
>
> First, PLEASE DON'T TOP-POST - it makes following and responding
> to a thread near impossible.
Sorry about that.
> Second, what makes you think the issue is a bandwidth issue? You just
> said that it takes 10 minutes. Have you determined that the time is
> due to bandwidth bottlenecks and not just disk reads and rsync
> computations?
I see mrtg's graph, it's doing about 5mbit for 10 minutes.
>
> Third, why would you expect rsync -- even without backuppc -- to take
> significantly fewer than 10 minutes to crawl a directory tree of
> "a hundred thousand files" including in reading in the inode
> information from each file, transmitting it across the network,
> comparing it to said information stored in the BackupPC attrib
> file. Plus any changed files will require reading, decompressing, and
> computing rolling md4 checksums on each of the target files as part of
> the rsync algorithm. Then the full directory tree needs to be
> constructed on the BackupPC Server including attrib files and any
> changed files (this is for incrementals). Do you expect this to all
> happen instantaneously?
I do not have hundreds of thousands of files yet. 141 Files, 20 Folders,
388 MB (407,536,068 bytes)
>
> Fourth, are you sure that you want to do "continuous" (your words)
> backups? That means that you are creating an ever-increasing (and
> theoretically infinite) number of incremental backups each requiring a
> full directory tree parallel to the source plus attrib files and
> changed files. Additionally, any time a file changes by even one byte,
> than a whole new copy is saved to the pool (think log files or system
> files that may change multiple times per second).
>
> In summary, I think you are trying to solve a problem that may not
> need to be solved, using a tool that is not meant to solve it, without
> understanding what is causing your problems and without knowing how
> the tool actually works in the first place :)
I am trying to mimic Iron Mountain's software which runs as some
software on the system and sends differences every 15 minutes.
>
>
>
> > On 1/20/2012 5:50 AM, Michael Stowe wrote:
> > >> BackupPC 3.2.1
> > >> Windows 7 rsyncd over ssh, west coast
> > >> the server is in the east.
> > >>
> > >> my goal is to have it updated every 15 minutes, i've gotten that to
> work
> > >> but for incremental, with no changes, it's still taking about 10
> minutes
> > >> most of the time and it is doing traffic.
> > > I would expect most of that traffic would be checking to see if there
> are
> > > changes to the files.
> > >
> > >> i do not understand why incremental with absolutely no changes is
> taking
> > >> so long ? ultimately i'd like to have a hundred thousand files being
> > >> backed up constantly, is this just a dream ?
> > > How would you propose that changes be recognized, if not through
> rsync's
> > > mechanisms of comparison?
> > >
> > > You can always go to cmd/cifs and use time stamps to determine what's
> > > changed, I suppose.
> > >
> > >> thanks in advance
> > >
> > >
> ------------------------------------------------------------------------------
> > > Keep Your Developer Skills Current with LearnDevNow!
> > > The most comprehensive online learning library for Microsoft
> developers
> > > is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3,
> MVC3,
> > > Metro Style Apps, more. Free future releases when you subscribe now!
> > > http://p.sf.net/sfu/learndevnow-d2d
> > > _______________________________________________
> > > BackupPC-users mailing list
> > > BackupPC-users AT lists.sourceforge DOT net
> > > List: https://lists.sourceforge.net/lists/listinfo/backuppc-users
> > > Wiki: http://backuppc.wiki.sourceforge.net
> > > Project: http://backuppc.sourceforge.net/
> > >
> >
> >
> ------------------------------------------------------------------------------
> > Keep Your Developer Skills Current with LearnDevNow!
> > The most comprehensive online learning library for Microsoft developers
> > is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3,
> > Metro Style Apps, more. Free future releases when you subscribe now!
> > http://p.sf.net/sfu/learndevnow-d2d
> > _______________________________________________
> > BackupPC-users mailing list
> > BackupPC-users AT lists.sourceforge DOT net
> > List: https://lists.sourceforge.net/lists/listinfo/backuppc-users
> > Wiki: http://backuppc.wiki.sourceforge.net
> > Project: http://backuppc.sourceforge.net/
>
> ------------------------------------------------------------------------------
> Keep Your Developer Skills Current with LearnDevNow!
> The most comprehensive online learning library for Microsoft developers
> is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3,
> Metro Style Apps, more. Free future releases when you subscribe now!
> http://p.sf.net/sfu/learndevnow-d2d
> _______________________________________________
> BackupPC-users mailing list
> BackupPC-users AT lists.sourceforge DOT net
> List: https://lists.sourceforge.net/lists/listinfo/backuppc-users
> Wiki: http://backuppc.wiki.sourceforge.net
> Project: http://backuppc.sourceforge.net/
>
------------------------------------------------------------------------------
Try before you buy = See our experts in action!
The most comprehensive online learning library for Microsoft developers
is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3,
Metro Style Apps, more. Free future releases when you subscribe now!
http://p.sf.net/sfu/learndevnow-dev2
_______________________________________________
BackupPC-users mailing list
BackupPC-users AT lists.sourceforge DOT net
List: https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki: http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/
|
