Amanda-Users

Re: Huge file number in one directory makes problems while recovering

2008-11-21 12:13:54
Subject: Re: Huge file number in one directory makes problems while recovering
From: Paul Bijnens <Paul.Bijnens AT xplanation DOT com>
To: uwe.beger AT unixprojekt DOT de
Date: Fri, 21 Nov 2008 18:08:49 +0100
On 2008-11-21 15:38, Uwe Beger wrote:
Hello list members,

I am using amanda since many years successfully (and with still an old version VERSION="Amanda-2.4.4p3") for backing up a small server.

The backup scheme is comp-user-tar for the disklist entry in question. I try to restore one subdirectory of this disklist entry containing about 2 MILLION files using amrecover. This restore takes very very very long and I am looking for a faster method.

Any ideas are highly appreciated.

Did you do in amrecover:

  cd subdirectory
  add  *

(this is very slow, and I even doubt it would work at all...)

or did you do:

  cd parentfolder
  add subdirectory

should be faster.

But anyway, 2 million (2000000) files for one folder *is* much in any case.
Even on disk, I wouldn't even *dare* to execute an "ls" there!

And then, do you restore *over* the existing folder?  In that case
the OS will need to hunt through the existing *huge* folder removing eventually
the already existing entry, and then probably slower each time, adding
a new name into the directory.

Anyway, a completely different approach would be to use amrestore
and pipe to tar:

  cd /the/destination/top/level/dir
  amrestore -p /dev/nst0 hostname '^/disk/name$' |
  tar --numeric-owner -xpGvf -  ./your/lost/subfolder

(from: http://wiki.zmanda.com/index.php/Restoring_files#Using_amrestore )
And see the above page for e.g. the meaning of tar option "G", possibly
slowing down your process...

--
Paul Bijnens, xplanation Technology Services        Tel  +32 16 397.511
Technologielaan 21 bus 2, B-3001 Leuven, BELGIUM    Fax  +32 16 397.512
http://www.xplanation.com/          email:  Paul.Bijnens AT xplanation DOT com
***********************************************************************
* I think I've got the hang of it now:  exit, ^D, ^C, ^\, ^Z, ^Q, ^^, *
* F6, quit, ZZ, :q, :q!, M-Z, ^X^C, logoff, logout, close, bye, /bye, *
* stop, end, F3, ~., ^]c, +++ ATH, disconnect, halt,  abort,  hangup, *
* PF4, F20, ^X^X, :D::D, KJOB, F14-f-e, F8-e,  kill -1 $$,  shutdown, *
* init 0, kill -9 1, Alt-F4, Ctrl-Alt-Del, AltGr-NumLock, Stop-A, ... *
* ...  "Are you sure?"  ...   YES   ...   Phew ...   I'm out          *
***********************************************************************

<Prev in Thread] Current Thread [Next in Thread>