Amanda-Users

Re: how to split partitions

2006-04-02 16:21:10
Subject: Re: how to split partitions
From: Paul Bijnens <paul.bijnens AT xplanation DOT com>
To: Frank Smith <fsmith AT hoovers DOT com>
Date: Sun, 02 Apr 2006 22:15:34 +0200
Frank Smith schreef:
Paul Bijnens wrote:
Josef Wolf schreef:
On Thu, Mar 30, 2006 at 07:31:59PM +0200, Stefan G. Weichinger wrote:

As promised, I updated the wiki docs on this topic, see
http://wiki.zmanda.com/index.php/Backing_up_large_amounts_of_data.
Am I the only one to find this setup needlessly error prone and complicated?
Would amanda automatically create appropriate exclude entries from its DLE
information, all this would be greatly simplified.

For example, with this set of DLE entries:

  /share/
  /share/financial
  /share/financial/company-a
  /share/financial/company-b
  /share/reports

amanda should automatically create following exclude entries:

  DLE                 exclude entry
  --------------------------------------------
  /share              ./financial ./reports
  /share/financial    ./company-a ./company-b

With this, the whole described procedure would be reduced just to add a
directory to the disklist.  No more risk to get the "catch all" entry wrong.

Interesting idea.

That would mean that the estimate phase should be smart enough (may
be add an option "autosplit" for those DLE's where you want that) to
pick a few large subdirectories out and then split the DLE dynamically.
We could change "calcsize" for this.

Autosplit seems confusing.  If your disklist is dynamic, how would
you do a restore? What would you use as an argument to setdisk, as
the DLE containing a particular file would vary from day to day.
Also, how would planner interact with a dynamic disklist?

Taking a closer look, makes it indeed a little bit complicated.
Maybe too complicated?  Let's see what is involved.

Autosplit can only split a DLE into "members" of a DLE when doing
a level 0.
Otherwise, you couldn't base the incremental on the level 0.
Also when "joining" two members, the joined member-DLE should dump
with a level 0 first.

For restoring:
Because Amanda knows a DLE it is autosplit in members, Amanda can
interpret the "setdisk", followed by "cd", and tell librestore to extract the needed dumps of the members on tape.
In fact: instead of a human doing the necessary mapping of subdir
to DLE and managing the include/exclude stuff, Amanda can do that
for you.

The implications for planner are in the beginning not too large,
because only level 0 is involved.   Maybe planner could be involved
to give hints to calcsize of which DLE's need more splitting.
But for one run, the totals of doing two smaller level 0 or one larger
level 0 are the same.

After sleeping on it for one night, I'll probably see more clear.

--
Paul Bijnens, Xplanation                            Tel  +32 16 397.511
Technologielaan 21 bus 2, B-3001 Leuven, BELGIUM    Fax  +32 16 397.512
http://www.xplanation.com/          email:  Paul.Bijnens AT xplanation DOT com
***********************************************************************
* I think I've got the hang of it now:  exit, ^D, ^C, ^\, ^Z, ^Q, F6, *
* quit,  ZZ, :q, :q!,  M-Z, ^X^C,  logoff, logout, close, bye,  /bye, *
* stop, end, F3, ~., ^]c, +++ ATH, disconnect, halt,  abort,  hangup, *
* PF4, F20, ^X^X, :D::D, KJOB, F14-f-e, F8-e,  kill -1 $$,  shutdown, *
* kill -9 1,  Alt-F4,  Ctrl-Alt-Del,  AltGr-NumLock,  Stop-A,  ...    *
* ...  "Are you sure?"  ...   YES   ...   Phew ...   I'm out          *
***********************************************************************