Amanda-Users

Status Summary for June 2007

2007-07-06 16:48:09
Subject: Status Summary for June 2007
From: "Dustin J. Mitchell" <dustin AT zmanda DOT com>
To: amanda-hackers AT amanda DOT org, amanda-users AT amanda DOT org, amanda-announce AT amanda DOT org
Date: Fri, 6 Jul 2007 15:38:29 -0500
This is the second month in which we've prepared status updates.  We'd
love your feedback!

As always, a fully linked version of this text is available at
 http://wiki.zmanda.com/index.php/Monthly_Status_Updates/June_2007

June saw the release of Amanda 2.5.2p1 on June 6, a patch release which
was thoroughly tested with the help of the Platform Experts and many
users from the mailing lists and forums. This patch release has proven
quite stable, and development has shifted to feature development for the
next release.

 Wiki Changes

* Marc Muehlfeld provided a link to a useful script for performing
  backups of MySQL databases.

* Harald Schioeberg provided Lto-barcode, a perl script to generate
  barcode labels for LTO Tapes. Chris Hoogendyk suggested barcodewriter,
  a PostScript-based barcode utility, as a more general solution.

* Erik W wrote a detailed How To:Install Amanda Server on AIX.

* Harald Schioeberg provided Chg-multiplex, a wrapper to use multiple
  Amanda configs in a single restore operation.

* Paul Bijnens contributed a multitude of minor edits all over the wiki,
  increasing readability and clarity.

* Dustin J. Mitchell refactored Stefan G. Weichinger's file driver into
  How To:Set Up Virtual Tapes, FAQ:Should I use a holdingdisk when the
  final destination of the backup is a virtual tape?, How To:Migrate
  Virtual Tapes to Real Tapes, and How To:Restore from Virtual Tapes.

 Forums Discussions

Many users had questions about configuring Amanda to their needs. Most
questions were about communication problems, and were quickly addressed.
Among the more unusual questions were the following.

* tamiral asked several interesting questions:

  * How can I verify that AMANDA has successfully backed-up files? --
    Shailen Patel suggested using amrecover to test a full restore, which
    is more thorough than the tape verification performed by amverify.

  * I'm concerned that because my defined tape size is larger than the
    amount of diskspace I have... -- Shailen Patel and Dustin J.
    Mitchell responded that yes, this could cause a problem, and
    referencing wiki pages describing the optimal configuration.

  * Basically, I'd rather use 'dd' for those kind of jobs (even unmount
    the filesystem so it won't change), but I guess I can't with AMANDA.
    What is the recommended dumptype for this kind of backup...? --
    Paddy Sreenivasan suggested a dumptype with always-full, compression
    off, and encryption off.

* George Reeke had a client machine which exceeded Amanda's connect
  timeout because its hard drives took too long to spin up. Paddy
  Sreenivasan suggested increasing ctimeout and etimeout.

* mickeyn has clients with dynamically-assigned addresses. Marc Muehlfeld
  suggested using static IP assignments in the DHCP server as a way to
  stabilize the clients' addresses.

 Mailing List Discussions

* Charlie Reitsma asked if any work had been done on migrating dumps
  from vtapes to real tapes. Dustin Mitchell, Gene Heskett, and Jon
  LaBadie replied with some pointers, and Charlie started work on an
  implementation to suit his needs.

* Philip Weber sparked an interesting conversation about Amanda
  automatically detecting disks that are not in Amanda's disklist and
  thus are not being backed up. While the problem is difficult to solve
  in the general case, a few specific solutions were suggested as
  wrappers around Amanda.

* Jon LaBadie tried running amtapetype on a vtape, and the results
  touched off an interesting discussion on what amtapetype should do in
  such a situation.

* Marc Muehlfeld wondered how Amanda can fill a tape to more than 100%
  capacity. Cyrille Bollu and Paul Bijnens answered, pointing out that
  tapes differ in actual capacity, and that Amanda only uses the
  tapelength for planning purposes, but will happily consume any extra
  space it finds.

* Robert P. McGraw, Chris Hoogendyk, and Brian Cuttler discussed the
  relative merits of hardware and software compression, noting that
  Amanda has a difficult time calculating the number of dumps it can fit
  on a tape when hardware compression is enabled.

* Rudy Setiawan asked for advice setting up a large disk-to-disk
  configuration, and prompted a lengthy discussion about calculating
  space requirements of a configuration, optimizing a system for fast
  disk-to-disk backups, and ensuring sufficient redundancy for backup
  data in such a configuration. Chris Hoogendyk hijacked the thread to
  consider ways of running incremental backups only over a weekend.

* Sebastian Marten asked about the relationship of runtapes to
  tape_splitsize. Marc Muehlfeld replied to say that splitting dumps
  across tapes is impossible with only one tape (runtapes=1). Sebastian
  does not have a changer, but nightly backups are larger than his media
  (DVD-RAM), so Marc suggested using multiple DVD drives, spooling some
  dumps to holding and flushing between dumps, or using chg-manual to
  use two DVD-RAMs per dump.

* Phillip Weber wondered if he could run two Amanda configs against the
  same tape changer. Ian Turner, Joshua Baker-LePain, and Jean-Francois
  Malouin chipped in to say that this configuration could work, but that
  some extra machinery was required to ensure that only one
  configuration was making requests of the changer at any given time.

* "fedora" saw "file changed as we read it" in his backup report for
  MySQL data files. This triggered a lengthy discussion: Oliver Nicole
  pointed out that this is just a "STRANGE" warning, not an error, and
  that it is caused by tar being unable to back up a large file while
  that file is changing.  Marc Muehlfeld, Bruce Thompson and Linda
  Pahdoco offered pointers to scripts for backing up MySQL databases via
  mysqldump or mysqlhotcopy.  Dustin J. Mitchell pointed out that ZRM
  for MySQL is designed to back up MySQL databases without making
  textual dumps.

* Glenn Gillis had trouble with estimates failing on a partition with a
  very large, constantly changing file. Kevin Till and Oliver Nicole
  agreed that this was a result of a bad tar version returning an
  incorrect status.

* Paul Crittenden discovered an error in the file-locking support
  detection, which caused Solaris builds of Amanda to use no file
  locking at all. Chris Hoogendyk, Jon LaBadie, Jean-Louis Martineau,
  and Dustin J. Mitchell chased down a solution.

* Alan Jedlow discovered a bug in chg-zd-mtx, which was fixed by Dustin
  J. Mitchell.

* Jean-Francois Malouin had trouble with estimates timing out after 6
  hours. Jean-Louis Martineau provided a patch to reset this limit for
  each estimate.

* Jordan Desroches had errors backing up a subdirectory of an NFS mount.
  Paul Bijnens, Dustin J. Mitchell, Olivier Nicole, and Jean-Louis
  Martineau contributed advice, eventually determining that the amanda
  user did not have adequate permissions on the subdirectory.  Harald
  Schioeberg had trouble with Amanda not finishing when /tmp was full.
  Dustin J. Mitchell pointed out that many of the external programs on
  which Amanda relies use /tmp, and that the failure most likely
  occurred there.

* Fedora had trouble getting client-server communication to work, and
  the eventual resolution was that host-based firewalls like netfilter
  and iptables can interfere with Amanda's communication.

* Ladislav Michnovic alerted amanda-hackers to a regression in SUSE
  Linux, reported by Matthias Andree, relating to multihomed machines.
  The issue has stalled without any feedback from Matthias.

 Code Development

Most of the development work in June was focused on testing and
bugfixes for the 2.5.2p1 release. Subsequent to the release, Dustin J.
Mitchell committed a number of minor changes that had been queued up
awaiting release, including improved holding-disk management,
streamined internationalization, and debugging support.

Jean-Louis Martineau
* fixed a bug discovered by Marc Muehlfeld where hosts running in a mixed
  IPv4/IPv6 environment would encounter errors (r397)
* fixed a bug discovered by Christopher McCrory where amfetchdump sent
  messages to stdout, corrupting the resulting tarfiles (r410)
* fixed spurious detection of GNU Tar's backup as a dump-compatible
  program (r411)

Dustin J. Mitchell
* streamlined the handling of exit statuses from the programs Amanda
  invokes (r420)
* fixed broken file-locking support on Solaris, as reported by Paul
  Crittenden (r422)
* clarified the error message resulting from incorrect entries in
  .amandahosts (r423)

Franz Fischer submitted a patch to make amtapetype close the tape device
after rewinding, to work around a hardware/OS bug on his system. The
patch was modified and committed by Jean-Louis Martineau (r416)

Dustin

-- 
        Dustin J. Mitchell
        Storage Software Engineer, Zmanda, Inc.
        http://www.zmanda.com/

<Prev in Thread] Current Thread [Next in Thread>
  • Status Summary for June 2007, Dustin J. Mitchell <=