RE: 2GB filesize limit?

Simple solution to this problem, once I found the compile time options.
You can force all file access calls to 64bit using the following CFLAG
options

CFLAGS="-D_FILE_OFFSET_BITS=64 -D_LARGEFILE_SOURCE"

This solved all of my filesize issues with amanda.

Will

On Fri, 16 Jan 2004, William S. Bear wrote:

>
> I'm running ext3, but I don't think it is the problem.
>
> After looking at the code for output-file.c. I noticed it was failing with
> a 'write' function call with a Maximum File Size Exceeded error.  I took a
> look at the code for dump, which will properly dump a file >2gb, and
> noticed macros have been setup to reference 'open64', instead of 'open'
> when large file support is enabled.
>
> Getting the kernel and glibc to jive seems to be the problem.  Suse does
> have a good article on the current state of lfs at:
>
> http://www.suse.de/~aj/linux_lfs.html
>
> I'm not sure how I should proceed from here.  I could easily update the
> open call to open64, and it should work fine.  But, maybe Amanda dist
> should be updated to support large files with the open64 call or
> O_LARGEFILE flag.  Thoughts?
>
> Will
>
> ------------------
> William S. Bear
> Math Systems Office
> 5-4895
> Vincent Hall 11
> www.math.umn.edu/~bear
> GNUPG Fingerprint: CFB6 A12C 3D44 F0C3 FB8D  B902 139E 6939 DC64 ED34
> ------------------
>
> On Thu, 15 Jan 2004, Dana Bourgeois wrote:
>
> > Are you using ext2 or ext3 as your file system?  If not, check the file
> > system docs.
> >
> > I ran into this problem with Amanda 2.4.4p1 on a RedHat 7.1 system but when
> > I switched to Suse 8.1, it went away.  I could reproduce the problem with dd
> > but I was also using ext2 file systems.  I don't what happens if you are
> > using something else.  I know that Suse 8.1 dump won't work on a Reiser file
> > system although tar works just fine.
> >
> >
> > Dana Bourgeois
> >
> >
> > > -----Original Message-----
> > > From: owner-amanda-users AT amanda DOT org
> > > [mailto:owner-amanda-users AT amanda DOT org] On Behalf Of Gene Heskett
> > > Sent: Thursday, January 15, 2004 7:53 AM
> > > To: Toomas Aas; amanda-users AT amanda DOT org
> > > Subject: Re: 2GB filesize limit?
> > >
> > >
> > > On Thursday 15 January 2004 05:27, Toomas Aas wrote:
> > > >> From:          Gene Heskett <gene.heskett AT verizon DOT net>
> > > >> Date:          Wed, 14 Jan 2004 19:25:54 -0500
> > > >>
> > > >> On Wednesday 14 January 2004 17:42, William S. Bear wrote:
> > > >> >I'm trying to use Amanda to backup to disk (4TB RAID) using the
> > > >> >tapeless config from the FAQ.  Dumps of the file systems
> > > are  well
> > > >> >over 100GB, but Amanda appears to die with the following
> > > error once
> > > >> >the dump reaches 2GB:
> > > >>
> > > >> There is, or should be, a variable named chunksize within the
> > > >> amanda.conf holding disk description.  If not there,
> > > you'll need it,
> > > >
> > > >Note that this parameter relates to holding disk, not the actual
> > > >backup image when backing up to hard disk.
> > >
> > > Sorry Toomas, I thought that was a given that most understood.
> > >
> > > >I'm sure this is not a hard-coded limitation of Amanda. I
> > > successfully
> > > >back up a 16 GB DLE to hard disk and I've never had  any errors. The
> > > >backup image is stored as one 16 GB file.
> > > >
> > > >> As you can see above the chunksize is set for 1Gb.  Now on
> > > my system,
> > > >> that would not be required, but there are still in use,
> > > filesystems
> > > >> which have file size limits of less than infinitity, typically 2GB,
> > > >
> > > >I don't think this is the problem here, since William said he can
> > > >create >2 GB files with dd and dump.
> > >
> > > Yes, that bit of incongruity bothered me too.  And it got
> > > real curious
> > > when I realized he was writing to disk, so if he had the problem in
> > > the holdng disk he really, really should have had the same problem
> > > with the virtual tapes too since they use the same filesystem.  I hit
> > > the send button somewhat confused, but thinking there might be a
> > > usefull clue someplace in my ramblings.
> > >
> > > >The most likely suspect to me seems to be the tapetype definition.
> > > >What's the length set to in the tapetype? If backing up to
> > > hard  disk,
> > > >Amanda is said to "emulate" end of tape when hitting the
> > > limit set in
> > > >tapetype. Maybe 2 GB is the default when no limit is  set?
> > >
> > > That I don't know, but a peruse of the code should answer
> > > that handily
> > > enough.  Something I don't have time for this morning as I'm in the
> > > middle of a new vinyl on the kitchen floor, fresh 1/4 round etc.
> > >
> > > >--
> > > >Toomas Aas | toomas.aas AT raad.tartu DOT ee |
> > > >http://www.raad.tartu.ee/~toomas/ * No problem is so big
> > > that it  can't
> > > >be run away from.
> > >
> > > --
> > > Cheers Toomas, Gene
> > > "There are four boxes to be used in defense of liberty: soap,
> > > ballot, jury, and ammo. Please use in that order." -Ed
> > > Howdershelt (Author) 99.22% setiathome rank, not too shabby
> > > for a WV hillbilly Yahoo.com attornies please note, additions
> > > to this message by Gene Heskett are: Copyright 2004 by
> > > Maurice Eugene Heskett, all rights reserved.
> > >
> > >
> >
> >
>