Thanks John for all your input:
On Fri, 2005-02-18 at 15:50, Gene Heskett wrote:
Looking down below at the errors, I'm wondering if up2date or yum has
> replaced your version of tar, known to be good, with another in the
> 1.14 family, known to be bad? 1.15 however seems to be fine, I've
> been using it for about a month and have yet to see an amverify
> error, which my own scripts run after amdump and its wrappers has
> exited.
$ gzip -V
gzip 1.3.3
(2002-03-08)
Copyright 2002 Free Software Foundation
Copyright 1992-1993 Jean-loup Gailly
This program comes with ABSOLUTELY NO WARRANTY.
You may redistribute copies of this program
under the terms of the GNU General Public License.
For more information about these matters, see the file named COPYING.
Compilation options:
DIRENT UTIME STDC_HEADERS HAVE_UNISTD_H HAVE_MEMORY_H HAVE_STRING_H HAVE_LSTAT
Written by Jean-loup Gailly.
$ tar --version
tar (GNU tar) 1.13.25
Copyright © 2001 Free Software Foundation, Inc.
This program comes with NO WARRANTY, to the extent permitted by law.
You may redistribute it under the terms of the GNU General Public License;
see the file named COPYING for details.
Written by John Gilmore and Jay Fenlason.
An interesting point is that after a second run of my test 'some' of the
dump-files verified as good. This indicates a intermittent problem.
Would bad memory gives this type of behaviour?
Regards,
Tom
On Fri, 2005-02-18 at 15:32, Lauro, John wrote:
> Hmmm, nevermind... I see you already provided that info.
>
> I have no other ideas. Good luck.
Thanks John for all your input:
>
> > -----Original Message-----
> > From: Lauro, John
> > Sent: Friday, February 18, 2005 10:31 AM
> > To: 'robinstc AT ocean.com DOT au'
> > Subject: RE: invalid compressed data--crc error and other
> > corruption ondiskfiles
> >
> > Does sound more like a gzip issue (or something corrupting
> > the storage). (If it was tar, you wouldn't have complaints
> > from gzip, whereas gzip problems will cause problems to
> > trickle down to tar).
> >
> > What version of gzip do you have? It has to be >1.3 to handle >4GB.
> >
> >
> >
> >
> >
> > > -----Original Message-----
> > > From: Thomas Charles Robinson [mailto:robinstc AT ocean.com DOT au]
> > > Sent: Friday, February 18, 2005 9:52 AM
> > > To: Lauro, John
> > > Subject: RE: invalid compressed data--crc error and other
> > corruption
> > > ondiskfiles
> > >
> > > Hi John,
> > >
> > > Thanks for your reply.
> > >
> > > On Fri, 2005-02-18 at 13:07, Lauro, John wrote:
> > > > You give the errors, but fail to show if anything is
> > > extracted ok or
> > > > not...
> > >
> > > > Is anything coming out correctly from the tar tf if you
> > > don't dump it
> > > > all in the bit bucket (/dev/null)?
> > > >
> > >
> > > I did originally record the output but as the archives are
> > quite large
> > > I decided to discard it...(the output looked like a normal
> > tar table)
> > > I thought the errors were more important.
> > > Is there anything specific I should look for in the tar listing?
> > >
> > >
> > > > If nothing listed, then the error is probably yours...
> > > >
> > > > As a sanity check, what does "strings $FILE | head" give?
> > >
> > > $ strings danube._home_samba_apps.0 | head
> > > AMANDA: FILE 20050217 danube /home/samba/apps lev 0 comp
> > .gz program
> > > /bin/tar To restore, position tape at start of file and run:
> > > dd if=<tape> bs=32k skip=1 | /usr/bin/gzip -dc | /bin/tar
> > > -f...
> > > -
> > > G~r'
> > > 8I(<E
> > > LJh4
> > > gD M
> > > &w~H
> > > Dr&KH
> > > DK8=z
> > >
> > >
> > > > > -----Original Message-----
> > > > > From: owner-amanda-users AT amanda DOT org
> > > > > [mailto:owner-amanda-users AT amanda DOT org] On Behalf Of
> > > Thomas Charles
> > > > > Robinson
> > > > > Sent: Friday, February 18, 2005 6:37 AM
> > > > > To: amanda mailing list
> > > > > Subject: invalid compressed data--crc error and other
> > > corruption on
> > > > > diskfiles
> > > > >
> > > > > Hi,
> > > > >
> > > > > Currently I have several configurations backing up to
> > > disk (just not
> > > > > using a tape in the slot leaves dump-files on the holding
> > > disk) but
> > > > > when I check the dump files for consistency, about a
> > > third of them
> > > > > are corrupted.
> > > > >
> > > > > I am doing the dump directly to disk now and purposely
> > > not flushing
> > > > > them so I can verifying each dump file manually (I was unsure
> > > > > whether our tape unit was the cause of the corruption.
> > > Unfortunately
> > > > > I still get corruption).
> > > > >
> > > > > The manual verification is done using dd, gzip and tar:
> > > > >
> > > > > dd if=$FILE bs=32k skip=1 | /usr/bin/gzip -dc 2>>$LOGFILE
> > > | /bin/tar
> > > > > tf - 2>>$LOGFILE > /dev/null
> > > > >
> > > > > BTW I am using rpm versions of amanda, gzip and tar on
> > a Red Hat 9
> > > > > system:
> > > > >
> > > > > amanda-2.4.4p1-1
> > > > > gzip-1.3.3-9
> > > > > tar-1.13.25-11
> > > > >
> > > > > All the backups (except for one configuration which I have not
>
> > > > > bothered to test) are done on the backup host (i.e.
> > > > > locally) from an ext3 file-system which is rsync-ed to
> > > another host.
> > > > > The rsync does not run during the backup.
> > > > >
> > > > > Lastly, I am currently using an nfs share for the holding
> > > disk but
> > > > > this was NOT being used previously and I was still getting the
>
> > > > > corruption mentioned.
> > > > >
> > > > > My experience with amanda has been nothing but good in
> > > the past but
> > > > > now I find I need some help on this as I don't know
> > whether gzip,
> > > > > tar or amanda is at fault. Any help is appreciated.
> > > > >
> > > > > Thanks in advance,
> > > > >
> > > > > Tom
> > > > >
> > > > > The errors are:
> > > > > --- a file --
> > > > > gzip: stdin: invalid compressed data--crc error
> > > > >
> > > > > --- another file ---
> > > > > /bin/tar: Skipping to next header
> > > > > /bin/tar: Archive contains obsolescent base-64 headers
> > > > >
> > > > > gzip: stdin: invalid compressed data--crc error
> > > > >
> > > > > gzip: stdin: invalid compressed data--length error
> > > > > /bin/tar: Error exit delayed from previous errors
> > > > >
> > > > > --- yet another file ---
> > > > > /bin/tar: Skipping to next header
> > > > > /bin/tar: Archive contains obsolescent base-64 headers
> > > > > /bin/tar: Skipping to next header
> > > > > /bin/tar: Skipping to next header
> > > > > /bin/tar: Archive contains `v where numeric off_t value
> expected
> > > > > /bin/tar: Skipping to next header
> > > > > /bin/tar: Skipping to next header
> > > > > /bin/tar: Skipping to next header
> > > > > /bin/tar: Skipping to next header
> > > > > /bin/tar: Skipping to next header
> > > > > /bin/tar: Skipping to next header
> > > > > /bin/tar: Skipping to next header
> > > > > /bin/tar: Skipping to next header
> > > > > /bin/tar: Skipping to next header
> > > > > /bin/tar: Skipping to next header
> > > > > /bin/tar: Skipping to next header
> > > > > /bin/tar: Skipping to next header
> > > > > /bin/tar: Skipping to next header
> > > > > /bin/tar: Skipping to next header
> > > > > /bin/tar: Skipping to next header
> > > > > /bin/tar: Skipping to next header
> > > > > /bin/tar: Skipping to next header
> > > > > /bin/tar: Skipping to next header
> > > > > /bin/tar: Skipping to next header
> > > > > /bin/tar: Skipping to next header
> > > > > /bin/tar: Skipping to next header
> > > > > /bin/tar: Skipping to next header
> > > > > /bin/tar: Skipping to next header
> > > > > /bin/tar: Skipping to next header
> > > > > /bin/tar: Skipping to next header
> > > > > /bin/tar: Skipping to next header
> > > > > /bin/tar: Skipping to next header
> > > > > /bin/tar: Skipping to next header
> > > > > /bin/tar: Skipping to next header
> > > > > /bin/tar: Skipping to next header
> > > > > /bin/tar: Skipping to next header
> > > > > /bin/tar: Archive contains `\224\321\377u\241\317'
> > where numeric
> > > > > off_t value expected
> > > > > /bin/tar: Skipping to next header
> > > > > /bin/tar: Skipping to next header
> > > > > /bin/tar: Skipping to next header
> > > > > /bin/tar: Skipping to next header
> > > > > /bin/tar: Archive contains `v where numeric off_t value
> expected
> > > > > /bin/tar: Skipping to next header
> > > > > /bin/tar: Skipping to next header
> > > > > /bin/tar: Skipping to next header
> > > > > /bin/tar: Skipping to next header
> > > > > /bin/tar: Skipping to next header
> > > > > /bin/tar: Skipping to next header
> > > > > /bin/tar: Archive contains `v where numeric off_t value
> expected
> > > > > /bin/tar: Skipping to next header
> > > > > /bin/tar: Skipping to next header
> > > > > /bin/tar: Skipping to next header
> > > > > /bin/tar: Skipping to next header
> > > > > /bin/tar: Skipping to next header
> > > > > /bin/tar: Skipping to next header
> > > > > /bin/tar: Archive contains `n\226\006\n-9\377' where
> > > numeric off_t
> > > > > value expected
> > > > > /bin/tar: Skipping to next header
> > > > > /bin/tar: Skipping to next header
> > > > > /bin/tar: Skipping to next header
> > > > > /bin/tar: Skipping to next header
> > > > > /bin/tar: Skipping to next header
> > > > > /bin/tar: Skipping to next header
> > > > > /bin/tar: Skipping to next header
> > > > > /bin/tar: Skipping to next header
> > > > > /bin/tar: Archive contains `r\n\032\356\212\377' where
> > > numeric off_t
> > > > > value expected
> > > > > /bin/tar: Skipping to next header
> > > > > /bin/tar: Skipping to next header
> > > > > /bin/tar: Skipping to next header
> > > > > /bin/tar: Skipping to next header
> > > > > /bin/tar: Skipping to next header
> > > > >
> > > > > gzip: stdin: invalid compressed data--crc error
> > > > >
> > > > > gzip: stdin: invalid compressed data--length error
> > > > > /bin/tar: Error exit delayed from previous errors
> > > > > --
> > > > >
> > > > > --script-- amdumpfileverify
> > > > > #!/bin/bash
> > > > >
> > > > > FILES=$(ls -Sr)
> > > > >
> > > > > echo testing $FILES
> > > > >
> > > > > for FILE in $FILES
> > > > > do
> > > > > /var/lib/amanda/bin/amdumpfiletest $FILE done
> > > > >
> > > > > exit 0
> > > > > --script-- amdumpfiletest
> > > > > #!/bin/bash
> > > > >
> > > > > LOGFILE=$(basename $0).log
> > > > >
> > > > > function usage()
> > > > > {
> > > > > echo "usage: $(basename $0) <file>"
> > > > > }
> > > > >
> > > > > # start
> > > > >
> > > > > # check the arguments and call correct function if [ $# -ne 1
> ];
> > > > then
> > > > > usage
> > > > > #exit 0
> > > > > else
> > > > > FILE=$1
> > > > > echo TESTING $FILE >> $LOGFILE
> > > > > dd if=$FILE bs=32k skip=1 | /usr/bin/gzip -dc
> > > > > 2>>$LOGFILE | /bin/tar tf - 2>>$LOGFILE > /dev/null
> > > > > echo DONE >> $LOGFILE
> > > > > fi
> > > > >
> > > > > exit 0
> > > > > -------------
> > > > > __--__-- A programmer from a very large computer company
> > > went to a
> > > > > software conference and then returned to report to his
> manager,
> > > > > saying:
> > > > > "What sort of programmers work for other companies?
> > They behaved
> > > > > badly and were unconcerned with appearances. Their hair
> > > was long and
> > > > > unkempt and their clothes were wrinkled and old. They
> > crashed out
> > > > > hospitality suites and they made rude noises during my
> > > > > presentation." The manager
> > > > > said: "I should have never sent you to the conference. Those
> > > > > programmers live beyond the physical world. They consider life
>
> > > > > absurd, an accidental coincidence. They come and go
> > > without knowing
> > > > > limitations. Without a care, they live only for their
> > > programs. Why
> > > > > should they bother with social conventions?" "They are
> > > alive within
> > > > > the Tao." -- Geoffrey James, "The Tao of Programming"
> > > > >
> > > The introduction of a new kind of music must be shunned as
> > imperiling
> > > the whole state, for styles of music are never disturbed without
> > > affecting the most important political institutions. ... The new
> > > style, gradually gaining a lodgement, quitely insinuates
> > itself into
> > > manners and customs, and from it ... goes on to attack laws and
> > > constitutions, displaying the utmost impudence, until it ends by
> > > overturning everything. -- Plato, "Republic", 370 B.C.
> > >
Slang is language that takes off its coat, spits on its hands, and goes
to work.
signature.asc
Description: This is a digitally signed message part
|
