I would have to say that Bob Hetzel is on to something. I have 769 clients
and the client list is unwieldly. The only way for me to find my client is
to cut and past the list into an editor and use a search function. After
choosing a restore client I often restore to an alternate computer. The
restore client list is returned alphabetically. Why the inconsistency?
Sometimes I run out of screen buffer (putty) and can't see the entire list.
Is it possible for me to pass params to bconsole to initiate a restore
without having to deal with long lists of clients?
Brian Kelly
-----Original Message-----
From: bacula-users-request AT lists.sourceforge DOT net
[mailto:bacula-users-request AT lists.sourceforge DOT net]
Sent: Wednesday, November 12, 2008 5:09 PM
To: bacula-users AT lists.sourceforge DOT net
Subject: Bacula-users Digest, Vol 31, Issue 21
Send Bacula-users mailing list submissions to
bacula-users AT lists.sourceforge DOT net
To subscribe or unsubscribe via the World Wide Web, visit
https://lists.sourceforge.net/lists/listinfo/bacula-users
or, via email, send a message with subject or body 'help' to
bacula-users-request AT lists.sourceforge DOT net
You can reach the person managing the list at
bacula-users-owner AT lists.sourceforge DOT net
When replying, please edit your Subject line so it is more specific
than "Re: Contents of Bacula-users digest..."
Today's Topics:
1. Re: offsite backup question (Berend Dekens)
2. Re: offsite backup question (John Fitzpatrick)
3. Disk hash/catalog comparisons. (Alan Brown)
4. Re: Hung on "Dir inserting attributes" (Jason Dixon)
5. Re: Hung on "Dir inserting attributes" (ebollengier)
6. Bacula restore strange error. (Brice Figureau)
7. Re: Hung on "Dir inserting attributes" (Dan Langille)
8. Re: Bacula in the press (Dan Langille)
9. Re: Hung on "Dir inserting attributes" (Jason Dixon)
10. Re: Looking for a better setup (James Cort)
11. Re: How to clear the restore job history (Martin Simmons)
12. bacula-sd volume data errors during copy from disk to tape
(Pasi K?rkk?inen)
13. Re: Hung on "Dir inserting attributes" (Dan Langille)
14. deadlock on batch insert (Dan Langille)
15. Re: Bacula-usersMoving from Tape to DVD (Wes Hardaker)
16. Re: Bacula-usersMoving from Tape to DVD (Jari Fredriksson)
17. SD on Ethernet Disk (subbustrato)
18. Problems appending to a Tape (Russell Sutherland)
19. Re: SD on Ethernet Disk (Arno Lehmann)
20. Re: client list for restores sort order (Arno Lehmann)
21. Re: Fatal Error doing Full Backup (Arno Lehmann)
----------------------------------------------------------------------
Message: 1
Date: Wed, 12 Nov 2008 13:18:59 +0100
From: Berend Dekens <berend AT cyberwizzard DOT nl>
Subject: Re: [Bacula-users] offsite backup question
To: John Fitzpatrick <john.fitzpatrick AT altobridge DOT com>,
bacula-users AT lists.sourceforge DOT net
Message-ID: <491AC9B3.1000702 AT cyberwizzard DOT nl>
Content-Type: text/plain; charset=UTF-8; format=flowed
Hey John,
I have a similar problem at the moment. The problem originates from the
fact that Bacula seems to be unable to seperate restore jobs based on
storage pools (so a system with files stored in multiple pools will
require volumes from all pools used).
As far as I know this is currently not solved - you might work around it
by making a full offsite backup followed by a full local backup: this
way both locations have a complete data set. But for my sake it is too
much work and takes too much space.
Bacula 3.0 will have Copy Jobs - a job type which copies backup jobs
between storage pools. I think that is great for getting the offsite
backups you and me want :-)
Regards,
Berend Dekens
John Fitzpatrick schreef:
>
> Hi everyone,
>
> I have been running nightly backups using a single pool of 19 volumes.
> The schedule is for
> Schedule {
> Name = "WeeklyCycle"
> Run = Full 1st sat at 23:05
> Run = Differential 2nd-5th sat at 23:05
> Run = Incremental mon-fri at 23:05
> }
>
> What i want to do is take tapes offsite once a month and what I did
> was to create a new pool
> Pool {
> Name = Offsite_Backup
> Pool Type = Backup
> Recycle = yes # Bacula can automatically
> recycle Volumes
> AutoPrune = yes # Prune expired volumes
> Volume Retention = 30 days # one year
> Accept Any Volume = yes # write on any volume in the pool
> Cleaning Prefix = LTC
> }
>
> then added 2 tapes to it and ran the jobs associated with each client
> Job {
> Name = "ie-serv-2_backup"
> Type = Backup
> Level = Incremental
> Client = ie-serv-2-fd
> FileSet = "ie-serv-2 Full Set"
> Schedule = "WeeklyCycle"
> Storage = PV128T
> Messages = Standard
> Pool = Servers_Nightly
> Priority = 10
> Write Bootstrap = "/var/bacula/ie-serv-2.bsr"
> }
>
> modifying the Type to Full
>
> This seemed fine and the usual scheduled backup ran as expected
>
> So I removed the tapes for offsite, put the other 2 back in and
> restarted bacula.
>
> Tested a backup and it keeps asking for the two offsite tapes which is
> alright now as I have them on my desk but how should I be doing this?
>
> was thinking define another job for offsite with new bootstrap but
> then what about the catalog I only have one, can I create another?
>
> All comments welcome.
>
> regard,
> John
>
> ------------------------------------------------------------------------
>
> -------------------------------------------------------------------------
> This SF.Net email is sponsored by the Moblin Your Move Developer's
challenge
> Build the coolest Linux based applications with Moblin SDK & win great
prizes
> Grand prize is a trip for two to an Open Source event anywhere in the
world
> http://moblin-contest.org/redirect.php?banner_id=100&url=/
> ------------------------------------------------------------------------
>
> _______________________________________________
> Bacula-users mailing list
> Bacula-users AT lists.sourceforge DOT net
> https://lists.sourceforge.net/lists/listinfo/bacula-users
>
------------------------------
Message: 2
Date: Wed, 12 Nov 2008 12:34:27 +0000 (GMT)
From: John Fitzpatrick <jfitzpatrick AT altobridge DOT com>
Subject: Re: [Bacula-users] offsite backup question
To: Berend Dekens <berend AT cyberwizzard DOT nl>
Cc: bacula-users AT lists.sourceforge DOT net
Message-ID: <16510804.141226493017927.JavaMail.ALTO32$@alto32>
Content-Type: text/plain; charset=utf-8
Hi Berend,
I was thinking of doing it that way, a full backup for offsite followed by a
full to stay in the changer. It just seems a long way around it, a full
backup for each client takes 15 hours in total.
Thanks Kevin, but I thought I had already included that
"Add the option 'recycle current volume = yes' to the offsite pool"
with recycle = yes
I will run another full back locally and test a restore from local, then
restore from my offsite set.
Thanks,
John
Berend wrote:
Hey John,
I have a similar problem at the moment. The problem originates from the
fact that Bacula seems to be unable to seperate restore jobs based on
storage pools (so a system with files stored in multiple pools will
require volumes from all pools used).
As far as I know this is currently not solved - you might work around it
by making a full offsite backup followed by a full local backup: this
way both locations have a complete data set. But for my sake it is too
much work and takes too much space.
Bacula 3.0 will have Copy Jobs - a job type which copies backup jobs
between storage pools. I think that is great for getting the offsite
backups you and me want :-)
Regards,
Berend Dekens
John Fitzpatrick schreef:
>
> Hi everyone,
>
> I have been running nightly backups using a single pool of 19 volumes.
> The schedule is for
> Schedule {
> Name = "WeeklyCycle"
> Run = Full 1st sat at 23:05
> Run = Differential 2nd-5th sat at 23:05
> Run = Incremental mon-fri at 23:05
> }
>
> What i want to do is take tapes offsite once a month and what I did
> was to create a new pool
> Pool {
> Name = Offsite_Backup
> Pool Type = Backup
> Recycle = yes # Bacula can automatically
> recycle Volumes
> AutoPrune = yes # Prune expired volumes
> Volume Retention = 30 days # one year
> Accept Any Volume = yes # write on any volume in the pool
> Cleaning Prefix = LTC
> }
>
> then added 2 tapes to it and ran the jobs associated with each client
> Job {
> Name = "ie-serv-2_backup"
> Type = Backup
> Level = Incremental
> Client = ie-serv-2-fd
> FileSet = "ie-serv-2 Full Set"
> Schedule = "WeeklyCycle"
> Storage = PV128T
> Messages = Standard
> Pool = Servers_Nightly
> Priority = 10
> Write Bootstrap = "/var/bacula/ie-serv-2.bsr"
> }
>
> modifying the Type to Full
>
> This seemed fine and the usual scheduled backup ran as expected
>
> So I removed the tapes for offsite, put the other 2 back in and
> restarted bacula.
>
> Tested a backup and it keeps asking for the two offsite tapes which is
> alright now as I have them on my desk but how should I be doing this?
>
> was thinking define another job for offsite with new bootstrap but
> then what about the catalog I only have one, can I create another?
>
> All comments welcome.
>
> regard,
> John
>
> ------------------------------------------------------------------------
>
> -------------------------------------------------------------------------
> This SF.Net email is sponsored by the Moblin Your Move Developer's
challenge
> Build the coolest Linux based applications with Moblin SDK & win great
prizes
> Grand prize is a trip for two to an Open Source event anywhere in the
world
> http://moblin-contest.org/redirect.php?banner_id=100&url=/
> ------------------------------------------------------------------------
>
> _______________________________________________
> Bacula-users mailing list
> Bacula-users AT lists.sourceforge DOT net
> https://lists.sourceforge.net/lists/listinfo/bacula-users
>
------------------------------
Message: 3
Date: Wed, 12 Nov 2008 13:04:16 +0000 (GMT)
From: Alan Brown <ajb2 AT mssl.ucl.ac DOT uk>
Subject: [Bacula-users] Disk hash/catalog comparisons.
To: bacula-users AT lists.sourceforge DOT net
Message-ID: <alpine.LRH.2.00.0811121255250.3868 AT mssle5.mssl.ucl.ac DOT uk>
Content-Type: TEXT/PLAIN; charset=US-ASCII
Bacula 2.4.1
I need to do a verify of the state of a filesystem at a particular date
vs what's in there now, as some files have been overwritten with nulls
whilst having their timestamps preserved (hardware problems).
I've tried using "Verify Disk to Catalog", but this only seems to say if a
file is newer/older than the Catalog entry, vs changed checksum (all
backup sets have SHA1 checksums)
Am I approaching this the wrong way or does bacula not currently have the
capability of detecting changed checksums for backed up files?
(I know about initcatalog, but that's not appropriate in this instance)
------------------------------
Message: 4
Date: Wed, 12 Nov 2008 08:23:58 -0500
From: Jason Dixon <jdixon AT omniti DOT com>
Subject: Re: [Bacula-users] Hung on "Dir inserting attributes"
To: ebollengier <eric AT eb.homelinux DOT org>
Cc: bacula-users AT lists.sourceforge DOT net
Message-ID: <20081112132358.GK32688 AT omniti DOT com>
Content-Type: text/plain; charset=us-ascii
On Wed, Nov 12, 2008 at 12:56:21AM -0800, ebollengier wrote:
>
> Hello,
>
> The batch mode improve the speed with postgresql by a factor of 10 (maybe
> 20), using
> a very big job (15M files) with the standard mode won't work too.
I don't understand what you're saying. Are you suggesting that either
way I won't be able to perform this backup due to the number of files?
Thanks,
--
Jason Dixon
OmniTI Computer Consulting, Inc.
jdixon AT omniti DOT com
443.325.1357 x.241
------------------------------
Message: 5
Date: Wed, 12 Nov 2008 05:46:54 -0800 (PST)
From: ebollengier <eric AT eb.homelinux DOT org>
Subject: Re: [Bacula-users] Hung on "Dir inserting attributes"
To: bacula-users AT lists.sourceforge DOT net
Message-ID: <20460645.post AT talk.nabble DOT com>
Content-Type: text/plain; charset=us-ascii
Jason Dixon-6 wrote:
>
> On Wed, Nov 12, 2008 at 12:56:21AM -0800, ebollengier wrote:
>>
>> Hello,
>>
>> The batch mode improve the speed with postgresql by a factor of 10 (maybe
>> 20), using
>> a very big job (15M files) with the standard mode won't work too.
>
> I don't understand what you're saying. Are you suggesting that either
> way I won't be able to perform this backup due to the number of files?
>
The backup is possible, but your configuration (hardware and software) needs
to be able to
do this big insert. For example, if you have only 256MB for ram and 1 poor
old ide drive, it
will take some time.
I just say that the old "per file" insertion mode will take 10 more time,
and it's already too
long for you.
With Postgres, you can run your catalog backup at the same time than other
jobs (try to
avoid having 10 jobs during this job)
Bye
--
View this message in context:
http://www.nabble.com/Hung-on-%22Dir-inserting-attributes%22-tp20450040p2046
0645.html
Sent from the Bacula - Users mailing list archive at Nabble.com.
------------------------------
Message: 6
Date: Wed, 12 Nov 2008 15:38:06 +0100
From: Brice Figureau <brice+bacula AT daysofwonder DOT com>
Subject: [Bacula-users] Bacula restore strange error.
To: bacula-users AT lists.sourceforge DOT net
Message-ID: <[email protected]>
Content-Type: text/plain
Hi,
I'm using a LTO-4 autochanger with a bacula-sd (v2.4.2) configured since
about one or two months with:
Maximum Block Size = 2097152
When I configured this setting I didn't get any SD or director warnings
or issues (or at least none that I could see).
Today I wanted to restore a full backup of a client that crashed hard.
I got the following error:
12-Nov 12:08 backup-sd JobId 2357: Ready to read from volume "ACM504L4"
on device "LTO4" (/dev/nst0).
12-Nov 12:08 backup-sd JobId 2357: Forward spacing Volume "ACM504L4" to
file:block 43:16.
12-Nov 12:09 backup-sd JobId 2357: Error: block.c:290 Volume data error
at 43:16! Block length 2097152 is insane (too large), probably due to a
bad archive.
Looking to block.c around line 290, I see:
/* Sanity check */
if (block_len > MAX_BLOCK_SIZE) {
dev->dev_errno = EIO;
MAX_BLOCK_SIZE is a constant whose value is: 1024*1024+1, which is
smaller than what I configured.
Is there really a limit on the maximum size of a block?
The documentation doesn't seem to say this.
Maybe some of the developper should change the documentation to indicate
that there is indeed a limit and check at sd start that the currently
given maximum block size is under this limit?
I can file a bug report if needed. Should I?
Anyway, I increased the value of this constant and I could restore this
full jobs without any issue (ok that wasn't so straightforward, but I
finally could restore the job).
Thanks,
--
Brice Figureau <brice+bacula AT daysofwonder DOT com>
------------------------------
Message: 7
Date: Wed, 12 Nov 2008 07:07:13 -0800
From: Dan Langille <dan AT langille DOT org>
Subject: Re: [Bacula-users] Hung on "Dir inserting attributes"
To: Jason Dixon <jdixon AT omniti DOT com>
Cc: bacula-users AT lists.sourceforge DOT net
Message-ID: <4968AF51-9410-489C-B74A-77AE9BE43669 AT langille DOT org>
Content-Type: text/plain; charset=US-ASCII; format=flowed; delsp=yes
On Nov 11, 2008, at 2:32 PM, Jason Dixon wrote:
> We have a new Bacula server (2.4.2 on Solaris 10 x86) that runs fine
> for
> most backup jobs. However, we've encountered a particular job that
> hangs indefinitely with the status "Dir inserting attributes". It's
> important to note that all of our other jobs complete successfully
> except this one.
What others have said confirmed what I thought. I too think this job
is not hanging. It is inserting.
select * from pg_stat_activity
The above will probably show the INSERT below.
Using systems tools such as top, vmstat, iostat, and ps, you should
be able to prove that progress is being made.
>
>
> Running Jobs:
> JobId Level Name Status
> ======================================================================
> 90 Full Unix_zimbra.2008-11-10_15.26.10 Dir inserting Attributes
> ====
>
> This particular job is for our Zimbra server (2.4.3 on Linux x86_64).
> The job is predictably large (275GB, 15M files). I asked our
> PostgreSQL
> DBA to review the database and he found a hung statement (backslashes
> are mine):
>
> INSERT INTO File (FileIndex, JobId, PathId, FilenameId, LStat, \
> MD5)SELECT batch.FileIndex, batch.JobId, Path.PathId, \
> Filename.FilenameId,batch.LStat, batch.MD5 FROM batch JOIN Path ON \
> (batch.Path = Path.Path) JOIN Filename ON (batch.Name = Filename.Name)
>
> At this point, other jobs (except Catalog Backup) will continue to run
> and complete successfully. But to get the Catalog Backup running, I
> have to cancel the zimbra job, restart bacula-dir, and kick off the
> Catalog Backup job. Otherwise, the Catalog jobs will just sit there
> waiting to execute. I've let these jobs sit for days in this state,
> so
> it's not like I'm being impatient. :)
Days? Oh. Hmmm. Perhaps you need to tune postgresql.conf a bit more.
What are the hardware specs for the database server?
>
>
> One other note. If the DBA kills that query in the database, the job
> completes. Although the director reports an Error, it updates the
> catalog successfully. If I cancel the job inside bconsole, nothing
> else gets updated in the catalog, presumably due to a database lock.
> The first job below (jobid 90) was one I cancelled; the next (jobid
> 104) was where the database query was killed.
>
> *llist jobid=90
> No results to list.
>
> *llist jobid=104
> jobid: 104
> job: Unix_zimbra.2008-11-11_11.19.05
> name: Unix_zimbra
> purgedfiles: 0
> type: B
> level: F
> clientid: 2
> name: zimbra
> jobstatus: f
> schedtime: 2008-11-11 11:19:29
> starttime: 2008-11-11 11:19:33
> endtime: 2008-11-11 17:10:42
> realendtime: 2008-11-11 17:10:42
> jobtdate: 1,226,441,442
> volsessionid: 16
> volsessiontime: 1,226,346,967
> jobfiles: 15,020,757
> joberrors: 1
> jobmissingfiles: 0
> poolid: 1
> poolname: Default
> priorjobid: 0
> filesetid: 2
> fileset: Zimbra Set
--
Dan Langille
http://langille.org/
------------------------------
Message: 8
Date: Wed, 12 Nov 2008 07:27:03 -0800
From: Dan Langille <dan AT langille DOT org>
Subject: Re: [Bacula-users] Bacula in the press
To: Arno Lehmann <al AT its-lehmann DOT de>
Cc: bacula-users <bacula-users AT lists.sourceforge DOT net>
Message-ID: <383D6004-4E77-4CCB-9A23-842774D64FDD AT langille DOT org>
Content-Type: text/plain; charset=US-ASCII; format=flowed; delsp=yes
On Nov 12, 2008, at 12:20 AM, Arno Lehmann wrote:
> Hi,
>
> 12.11.2008 03:00, Dan Langille wrote:
>> http://www.enterprisenetworkingplanet.com/netos/article.php/3784081
>>
>> "If you're looking for a darned good open-source backup solution,
>> this
>> may be your lucky day for an interview with this data-sucking
>> vampire."
>>
>> It does a good job of introducing the components.
>
> But it also talks about Storage DIRECTOR and File DIRECTOR... and the
> feedback form does not work because, instead of a captcha image, I
> just get a text stating that the session is invalid or expired.
>
> Not that funny...
I let the author know. I think this type of mistake is not a big issue.
--
Dan Langille
http://langille.org/
------------------------------
Message: 9
Date: Wed, 12 Nov 2008 10:39:00 -0500
From: Jason Dixon <jdixon AT omniti DOT com>
Subject: Re: [Bacula-users] Hung on "Dir inserting attributes"
To: Dan Langille <dan AT langille DOT org>
Cc: bacula-users AT lists.sourceforge DOT net
Message-ID: <20081112153859.GL32688 AT omniti DOT com>
Content-Type: text/plain; charset=us-ascii
On Wed, Nov 12, 2008 at 07:07:13AM -0800, Dan Langille wrote:
>
> On Nov 11, 2008, at 2:32 PM, Jason Dixon wrote:
>
>> We have a new Bacula server (2.4.2 on Solaris 10 x86) that runs fine for
>> most backup jobs. However, we've encountered a particular job that
>> hangs indefinitely with the status "Dir inserting attributes". It's
>> important to note that all of our other jobs complete successfully
>> except this one.
>
> What others have said confirmed what I thought. I too think this job
> is not hanging. It is inserting.
For two days? This isn't a slow box. Here is the pg_stat_activity we
gathered yesterday. According to our DBA, it was deadlocked as
exhibited by pids 6192 and 21732 both having ExclusiveLock's.
http://pastebin.com/f26d96438
Thanks,
--
Jason Dixon
OmniTI Computer Consulting, Inc.
jdixon AT omniti DOT com
443.325.1357 x.241
------------------------------
Message: 10
Date: Wed, 12 Nov 2008 15:56:05 +0000
From: James Cort <james.cort AT u4eatech DOT com>
Subject: Re: [Bacula-users] Looking for a better setup
To: "junior.listas" <junior.listas AT gmail DOT com>
Cc: bacula-users AT lists.sourceforge DOT net
Message-ID: <491AFC95.4080101 AT u4eatech DOT com>
Content-Type: text/plain; charset=ISO-8859-1
junior.listas wrote:
> 1) mysql tables became huge ( each backup adds a million and six
> hundred thousand lines ), so i split the configuration into 2 daemons
> with 2 different bases, one for mon,tue,wed and other for thu,fri( and
> one 3th for monthly bkps ) ; because between a backup starts, delete old
> lines and start add newest lines take 45 mins; just to re-create the
> catalog, before restore anything it takes 1 hour.
I have a similar problem with postgres; the catalog database is now so
large that restoring it from a pg_dump backup takes 3-4 hours. This is
before you account for the length of time taken to read it from the tape.
In a DR scenario, that's 3-4 hours sitting there twiddling your thumbs
waiting for the catalog to come back so you can do some useful restores.
My solution so far has been to script a database sync and LVM snapshot
of the volume on which the database resides, and then backup the snapshot.
In theory at least, restoring the snapshot should give me the underlying
files back and it's undergone no worse than a system crash. Provided
things like wal_sync are enabled, everything should be OK.
All my testing indicates that this should work but I'm a little nervous
as it's far from a properly supported solution.
James.
--
James Cort
IT Manager
U4EA Technologies Ltd.
--
U4EA Technologies
http://www.u4eatech.com
------------------------------
Message: 11
Date: Wed, 12 Nov 2008 17:13:12 GMT
From: Martin Simmons <martin AT lispworks DOT com>
Subject: Re: [Bacula-users] How to clear the restore job history
To: bacula-users AT lists.sourceforge DOT net
Message-ID: <200811121713.mACHDCpx001313 AT higson.cam.lispworks DOT com>
There is no other related data for these jobs.
I made a mistake though: you need
delete from job where type in ('R') ...
to delete restore jobs. Type 'V' is verify and type 'D' is admin.
__Martin
>>>>> On Wed, 12 Nov 2008 10:47:11 +0800, Quanzhong Zhang said:
>
> Hello Martin,
>
> Thank you very much for your replay!
> But are you sure there are no related data in other table for this data?
>
> Best Regards,
> Zhang QZ
>
>
> -----Original Message-----
> From: Martin Simmons [mailto:martin AT lispworks DOT com]
> Sent: Tuesday, November 11, 2008 6:57 PM
> To: Quanzhong Zhang
> Cc: bacula-users AT lists.sourceforge DOT net
> Subject: Re: [Bacula-users] How to clear the restore job history
>
>>>>> On Tue, 11 Nov 2008 09:28:28 +0800, Quanzhong Zhang said:
> >
> > Hello,
> >
> > I found there are many restore job history in the table "Job", and can
> > not find out the way for clear it.
> > Could you kindly give me help?
>
> Bacula never deletes them.
>
> I run the following SQL once a week (on PostgreSQL) to delete those
> older than
> 2 months:
>
> delete from job where type in ('V', 'D') and starttime < now()-interval
> '2 months';
>
> __Martin
>
------------------------------
Message: 12
Date: Wed, 12 Nov 2008 19:38:40 +0200
From: Pasi K?rkk?inen <pasik AT iki DOT fi>
Subject: [Bacula-users] bacula-sd volume data errors during copy from
disk to tape
To: bacula-users AT lists.sourceforge DOT net
Message-ID: <20081112173840.GE1691 AT edu.joroinen DOT fi>
Content-Type: text/plain; charset=us-ascii
Hello list!
I'm testing Bacula 2.5.19 (upcoming 3.0.0) and copying jobs from disk pools
to tape.
I'm getting some errors during the copy process.. has anyone else seen
these?:
bacula-sd JobId 2994: Start Copying JobId 2994,
Job=CopyPool3UncopiedToTape.2008-11-12_16.40.09.26
bacula-sd JobId 2994: Using Device "IBM-LTO3-Drive"
bacula-sd JobId 2994: Ready to read from volume "Pool3-Vol-0090" on device
"FSDevice3" (/mnt/backup1/pool03).
bacula-sd JobId 2994: Forward spacing Volume "Pool3-Vol-0090" to file:block
0:218.
bacula-sd JobId 2994: Error: block.c:1098 Volume data error at 0:2594608255!
Short block of 2944 bytes on device "FSDevice3" (/mnt/backup1/pool03)
discarded.
bacula-sd JobId 2994: Error: read_record.c:148 block.c:1098 Volume data
error at 0:2594608255! Short block of 2944 bytes on device "FSDevice3"
(/mnt/backup1/pool03) discarded.
bacula-sd JobId 2994: End of file 0 on device "FSDevice3"
(/mnt/backup1/pool03), Volume "Pool3-Vol-0090"
bacula-sd JobId 2994: End of Volume at file 0 on device "FSDevice3"
(/mnt/backup1/pool03), Volume "Pool3-Vol-0090"
bacula-sd JobId 2994: Ready to read from volume "Pool3-Vol-0091" on device
"FSDevice3" (/mnt/backup1/pool03).
bacula-sd JobId 2994: Forward spacing Volume "Pool3-Vol-0091" to file:block
0:218.
bacula-sd JobId 2994: Error: block.c:1098 Volume data error at 0:2314368047!
Short block of 3024 bytes on device "FSDevice3" (/mnt/backup1/pool03)
discarded.
bacula-sd JobId 2994: Error: read_record.c:148 block.c:1098 Volume data
error at 0:2314368047! Short block of 3024 bytes on device "FSDevice3"
(/mnt/backup1/pool03) discarded.
bacula-sd JobId 2994: End of file 0 on device "FSDevice3"
(/mnt/backup1/pool03), Volume "Pool3-Vol-0091"
bacula-sd JobId 2994: End of Volume at file 0 on device "FSDevice3"
(/mnt/backup1/pool03), Volume "Pool3-Vol-0091"
bacula-sd JobId 2994: Ready to read from volume "Pool3-Vol-0092" on device
"FSDevice3" (/mnt/backup1/pool03).
bacula-sd JobId 2994: Forward spacing Volume "Pool3-Vol-0092" to file:block
0:218.
However, the job terminates with:
SD Files Written: 102,756
SD Bytes Written: 14,278,163,609 (14.27 GB)
SD Errors: 0
SD termination status: OK
Termination: Copying OK
So.. does someone what's going on?
-- Pasi
------------------------------
Message: 13
Date: Wed, 12 Nov 2008 10:05:24 -0800
From: Dan Langille <dan AT langille DOT org>
Subject: Re: [Bacula-users] Hung on "Dir inserting attributes"
To: Jason Dixon <jdixon AT omniti DOT com>
Cc: bacula-users AT lists.sourceforge DOT net
Message-ID: <8D7E90E8-DCC3-4883-842F-BE335599D2FA AT langille DOT org>
Content-Type: text/plain; charset=US-ASCII; format=flowed; delsp=yes
On Nov 12, 2008, at 7:39 AM, Jason Dixon wrote:
> On Wed, Nov 12, 2008 at 07:07:13AM -0800, Dan Langille wrote:
>>
>> On Nov 11, 2008, at 2:32 PM, Jason Dixon wrote:
>>
>>> We have a new Bacula server (2.4.2 on Solaris 10 x86) that runs
>>> fine for
>>> most backup jobs. However, we've encountered a particular job that
>>> hangs indefinitely with the status "Dir inserting attributes". It's
>>> important to note that all of our other jobs complete successfully
>>> except this one.
>>
>> What others have said confirmed what I thought. I too think this job
>> is not hanging. It is inserting.
>
> For two days?
Yes. For two days. :) This is why I asked for hardware details later
in my post. :)
> This isn't a slow box. Here is the pg_stat_activity we
> gathered yesterday. According to our DBA, it was deadlocked as
> exhibited by pids 6192 and 21732 both having ExclusiveLock's.
>
> http://pastebin.com/f26d96438
Thank you. That is someone we can use to debug the issue.
By we, I don't include me. Sorry, I won't be able to look at this
for a while.
>
>
> Thanks,
>
> --
> Jason Dixon
> OmniTI Computer Consulting, Inc.
> jdixon AT omniti DOT com
> 443.325.1357 x.241
--
Dan Langille
http://langille.org/
------------------------------
Message: 14
Date: Wed, 12 Nov 2008 10:17:05 -0800
From: Dan Langille <dan AT langille DOT org>
Subject: [Bacula-users] deadlock on batch insert
To: bacula-users <bacula-users AT lists.sourceforge DOT net>
Message-ID: <D34F4F21-F75A-418C-814A-8DCE0672759F AT langille DOT org>
Content-Type: text/plain; charset=US-ASCII; format=flowed; delsp=yes
We may have a problem with deadlock on batch insert.
I have not looked closely, it it appears to be two batch inserts
running at the same time.
Begin forwarded message:
> From: Jason Dixon <jdixon AT omniti DOT com>
> Date: November 12, 2008 7:39:00 AM PST
> To: Dan Langille <dan AT langille DOT org>
> Cc: bacula-users AT lists.sourceforge DOT net
> Subject: Re: [Bacula-users] Hung on "Dir inserting attributes"
>
> On Wed, Nov 12, 2008 at 07:07:13AM -0800, Dan Langille wrote:
>>
>> On Nov 11, 2008, at 2:32 PM, Jason Dixon wrote:
>>
>>> We have a new Bacula server (2.4.2 on Solaris 10 x86) that runs
>>> fine for
>>> most backup jobs. However, we've encountered a particular job that
>>> hangs indefinitely with the status "Dir inserting attributes". It's
>>> important to note that all of our other jobs complete successfully
>>> except this one.
>>
>> What others have said confirmed what I thought. I too think this job
>> is not hanging. It is inserting.
>
> For two days? This isn't a slow box. Here is the pg_stat_activity we
> gathered yesterday. According to our DBA, it was deadlocked as
> exhibited by pids 6192 and 21732 both having ExclusiveLock's.
>
> http://pastebin.com/f26d96438
>
> Thanks,
>
> --
> Jason Dixon
> OmniTI Computer Consulting, Inc.
> jdixon AT omniti DOT com
> 443.325.1357 x.241
--
Dan Langille
http://langille.org/
------------------------------
Message: 15
Date: Wed, 12 Nov 2008 10:20:32 -0800
From: Wes Hardaker <hardaker AT users.sourceforge DOT net>
Subject: Re: [Bacula-users] Bacula-usersMoving from Tape to DVD
To: "Jari Fredriksson" <jarif AT iki DOT fi>
Cc: bacula-users AT lists.sourceforge DOT net
Message-ID: <sdmyg4olfz.fsf AT wes.hardakers DOT net>
Content-Type: text/plain; charset=us-ascii
>>>>> On Fri, 7 Nov 2008 22:14:29 +0200, "Jari Fredriksson" <jarif AT iki DOT
>>>>> fi>
said:
JF> Now wondering best practises with DVD backups.
The biggest one for me was adding -dvd-compat to the "self.growparams"
settings in /etc/bacula/dvd-handler (near line 112)
--
"In the bathtub of history the truth is harder to hold than the soap,
and much more difficult to find." -- Terry Pratchett
------------------------------
Message: 16
Date: Wed, 12 Nov 2008 20:50:30 +0200
From: "Jari Fredriksson" <jarif AT iki DOT fi>
Subject: Re: [Bacula-users] Bacula-usersMoving from Tape to DVD
To: "Wes Hardaker" <hardaker AT users.sourceforge DOT net>
Cc: bacula-users AT lists.sourceforge DOT net
Message-ID: <135AE647FD2143D7AADA8BA9E71BB24E@mosquito>
Content-Type: text/plain; charset="iso-8859-1"
>>>>>> On Fri, 7 Nov 2008 22:14:29 +0200, "Jari
>>>>>> Fredriksson" <jarif AT iki DOT fi> said:
>
>> Now wondering best practises with DVD backups.
>
> The biggest one for me was adding -dvd-compat to the
> "self.growparams" settings in /etc/bacula/dvd-handler
> (near line 112)
Ok, a happy camper! Which version of Bacula you are using? Seems the current
ones are broken or I have a serious configuration error somewhere.
I think -dvd-compat fixes some dvd writing issues, but I have no problems
there. DVD will be written fine, but the problems are in catalog updating
and using recucled volumes.
------------------------------
Message: 17
Date: Wed, 12 Nov 2008 22:06:50 +0000 (UTC)
From: subbustrato <subbustrato AT gmail DOT com>
Subject: [Bacula-users] SD on Ethernet Disk
To: bacula-users AT lists.sourceforge DOT net
Message-ID: <loom.20081112T220504-805 AT post.gmane DOT org>
Content-Type: text/plain; charset=us-ascii
Is it possible set as storage demon an Ethernet Disk?
bye,
sub
------------------------------
Message: 18
Date: Wed, 12 Nov 2008 17:01:52 -0500
From: "Russell Sutherland" <russ AT quist DOT ca>
Subject: [Bacula-users] Problems appending to a Tape
To: bacula-users AT lists.sourceforge DOT net
Message-ID:
<2cb417230811121401l71525bb6gc71d398c2aa7b930 AT mail.gmail DOT com>
Content-Type: text/plain; charset=ISO-8859-1
When trying to write/append some data to an existing labelled and
mounted tape I get:
*messages
12-Nov 16:56 backup-sd JobId 12120: Job
backup-data.2008-11-12_16.56.30 waiting. Cannot find any appendable
volumes.
Please use the "label" command to create a new Volume for:
Storage: "Dell-PV-110T" (/dev/nsa0)
Pool: Default
Media type: LTO-2
*list media Pool=Default
+---------+------------+-----------+---------+---------------+----------+---
-----------+---------+------+-----------+--------------+--------------------
-+
| MediaId | VolumeName | VolStatus | Enabled | VolBytes |
VolFiles | VolRetention | Recycle | Slot | InChanger | MediaType |
LastWritten |
+---------+------------+-----------+---------+---------------+----------+---
-----------+---------+------+-----------+--------------+--------------------
-+
| 595 | Catalog-01 | Append | 1 | 4,023,197,419 |
0 | 34,560,000 | 1 | 0 | 0 | Media-backup |
2008-11-12 04:59:35 |
| 642 | BG7385 | Append | 1 | 2,644,992 |
2 | 34,560,000 | 1 | 0 | 0 | LTO-2 |
2008-11-12 16:47:41 |
+---------+------------+-----------+---------+---------------+----------+---
-----------+---------+------+-----------+--------------+--------------------
-+
*
Why can my system not find any appendable volumes? It appears that the
default Pool is ready to append to Volume Name: BG7385.
In general, I find adding, mounting and labelling new tapes a bit
confusing, especially when this is being done to an existing running
system.
--
Russell Sutherland
russ AT quist DOT ca
+1.416.696.7600
------------------------------
Message: 19
Date: Wed, 12 Nov 2008 23:24:01 +0100
From: Arno Lehmann <al AT its-lehmann DOT de>
Subject: Re: [Bacula-users] SD on Ethernet Disk
To: bacula-users AT lists.sourceforge DOT net
Message-ID: <491B5781.80702 AT its-lehmann DOT de>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Hi,
12.11.2008 23:06, subbustrato wrote:
> Is it possible set as storage demon an Ethernet Disk?
I assume that by "Ethernet disk" you mean a NAS device.
Yes, it is possible if the device actually runs a SD.
Yes, it is possible to use a NAS device as final destination for
Baculas volumes.
No, it is not possible to simply refer to the NAS device as a storage
device in the Director configuration if there is *no* SD running on it.
No, it is not possible to use a NAS device if you can't mount it to
the machine the SD runs on.
Select whichever answer fits to your environment :-)
Arno
> bye,
> sub
--
Arno Lehmann
IT-Service Lehmann
Sandstr. 6, 49080 Osnabr?ck
www.its-lehmann.de
------------------------------
Message: 20
Date: Thu, 13 Nov 2008 00:03:18 +0100
From: Arno Lehmann <al AT its-lehmann DOT de>
Subject: Re: [Bacula-users] client list for restores sort order
To: bacula-users AT lists.sourceforge DOT net
Message-ID: <491B60B6.80409 AT its-lehmann DOT de>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Hello,
11.11.2008 18:15, Bob Hetzel wrote:
> I've currently got over 150 backup clients installed with bacula so when
> I want to do a restore and I have it list the clients by name the list
> is rather unwieldy. I'm thinking the list is ordered by when they were
> added?
>
> If it's doing a database query to generate this client list, where can
> the sort order be changed? Ideally I'd like to change it to order by
> client name.
This seems to be done in cats/sql_get.c function get_client_ids(). I'm
not sure if simply adding an "ORDER BY" statement works with all
databases if you order by a field not actually requested.
Also, this could break existing scripts where you do something like
echo 'status client
1
'
so I would carefully consider such a change.
Arno
> Bob
>
> -------------------------------------------------------------------------
> This SF.Net email is sponsored by the Moblin Your Move Developer's
challenge
> Build the coolest Linux based applications with Moblin SDK & win great
prizes
> Grand prize is a trip for two to an Open Source event anywhere in the
world
> http://moblin-contest.org/redirect.php?banner_id=100&url=/
> _______________________________________________
> Bacula-users mailing list
> Bacula-users AT lists.sourceforge DOT net
> https://lists.sourceforge.net/lists/listinfo/bacula-users
>
--
Arno Lehmann
IT-Service Lehmann
Sandstr. 6, 49080 Osnabr?ck
www.its-lehmann.de
------------------------------
Message: 21
Date: Thu, 13 Nov 2008 00:08:19 +0100
From: Arno Lehmann <al AT its-lehmann DOT de>
Subject: Re: [Bacula-users] Fatal Error doing Full Backup
To: bacula-users AT lists.sourceforge DOT net
Message-ID: <491B61E3.7000602 AT its-lehmann DOT de>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Hello,
11.11.2008 10:00, Isabel Bermejo wrote:
> Hi,
> I'm using Bacula to backup servers into files (not tapes). One of the
> servers has to backup 30GB of information. It has been working fine for 2
> years but 3 weeks ago I received a Fatal Error message.
>
> Here I post a little bit of the message (it's too large):
> 10-Nov 22:40 iesa8-dir: BackupIESA4.2008-11-10_21.30.00 Fatal error:
> sql_create.c:564 sql_create.c:564 insert INSERT INTO File
> (FileIndex,JobId,PathId,FilenameId,LStat,MD5) VALUES
> (42322,10216,14961,17509,'MK EgAR IH0 B IM IM A SXHu BAA CTY BJEhK1 BCNzD+
> BFE418 A A E','0') failed:
> database is locked
I think the error message is quite clear - the database is locked.
...
> This message appears only when doing Full Backup. Does anyone know what is
> the problem?
That'S more interesting... Bacula itself should be well able to
serialize database accesses. Also, if this only happens for this one
job, that indicates a more serious problem.
Have you checked that the database is usable and what else happens
there while the job in question runs? You don't tell us which database
you use - with MySQL, 'mysqladmin processlist' will give you something
useful, perhaps.
> I've read it could be the amount of data I'm backing up but
> this has been working fine till 3 weeks ago. I'm using Bacula 1.38 and I
> haven't modified nothing at all because it was working fine.
1.38 is definitely no longer fully supported. I suggest you upgrade to
the current released version and see if that behaves differently. If
the error persists, you should report that, or submit a bug report
directly at bugs.bacula.org.
Arno
> Thank you
> ISABEL
>
>
> -------------------------------------------------------------------------
> This SF.Net email is sponsored by the Moblin Your Move Developer's
challenge
> Build the coolest Linux based applications with Moblin SDK & win great
prizes
> Grand prize is a trip for two to an Open Source event anywhere in the
world
> http://moblin-contest.org/redirect.php?banner_id=100&url=/
> _______________________________________________
> Bacula-users mailing list
> Bacula-users AT lists.sourceforge DOT net
> https://lists.sourceforge.net/lists/listinfo/bacula-users
>
--
Arno Lehmann
IT-Service Lehmann
Sandstr. 6, 49080 Osnabr?ck
www.its-lehmann.de
------------------------------
-------------------------------------------------------------------------
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great
prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/
------------------------------
_______________________________________________
Bacula-users mailing list
Bacula-users AT lists.sourceforge DOT net
https://lists.sourceforge.net/lists/listinfo/bacula-users
End of Bacula-users Digest, Vol 31, Issue 21
********************************************
smime.p7s
Description: S/MIME cryptographic signature
-------------------------------------------------------------------------
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/ _______________________________________________
Bacula-users mailing list
Bacula-users AT lists.sourceforge DOT net
https://lists.sourceforge.net/lists/listinfo/bacula-users
|
