Bacula-users

Re: [Bacula-users] An idea for a feature (not a request yet :) - weighted concurrency

2009-03-21 05:46:36
Subject: Re: [Bacula-users] An idea for a feature (not a request yet :) - weighted concurrency
From: "James Harper" <james.harper AT bendigoit.com DOT au>
To: "Arno Lehmann" <al AT its-lehmann DOT de>, <bacula-users AT lists.sourceforge DOT net>
Date: Sat, 21 Mar 2009 20:41:11 +1100
> > I have half an idea for a feature request but it's not well defined
> > yet...
> >
> > Basically, I have a bunch of clients to back up, some are on gigabit
> > network and some are stuck on 100mbit. They are being backed up to a
> > disk that has throughput of around 20-30mbytes/second.
> >
> > I am allowing 2 jobs to run at once, which works well but I think it
> > could work better. I was thinking of something along the lines of
> > assigning a 'cost' to each client, and have the scheduler make sure
> > that
> > the sum of all current clients is under some threshold, something
> > like:
> >
> 
> Sounds interesting.
> 
> If you add the clause "The maximum number of jobs run concurrently is
> still limited by the existing configuration settings" it might be
> implemented sooner.

Yes, my idea would be that the current maximum is still a hard limit.

> 
> In that case, the DIR would only have to determine cost and choose
> which jobs to start one level below the current concurreny management.
> 
> I.e., do everything as today, but when it comes to actually starting
> one more job, consider the cost to choose the job, or not start one at
> all. Might be easier to implement - and it keeps the configuration
> compatible, assuming default MaxCost is unlimited.

Yes. I don't know whether the algorithm would be "start as many jobs
(subject to the concurrency limit) as possible by searching the list of
waiting jobs (only in the current priority)", or simply "only start the
next job if it wouldn't exceed the budget". The first might be better,
but the second would be simpler.

> > Comments?
> 
> Sounds good... massage it into a feature request and I'm sure people
> will be interested - perhaps even developers :-)
> 

Thanks for the feedback Arno. I can probably code this myself easily
enough. I'll wait for the 3.0 release before posting anything further so
it doesn't get lost in the noise :)

James


------------------------------------------------------------------------------
Apps built with the Adobe(R) Flex(R) framework and Flex Builder(TM) are
powering Web 2.0 with engaging, cross-platform capabilities. Quickly and
easily build your RIAs with Flex Builder, the Eclipse(TM)based development
software that enables intelligent coding and step-through debugging.
Download the free 60 day trial. http://p.sf.net/sfu/www-adobe-com
_______________________________________________
Bacula-users mailing list
Bacula-users AT lists.sourceforge DOT net
https://lists.sourceforge.net/lists/listinfo/bacula-users

<Prev in Thread] Current Thread [Next in Thread>