Bacula-users
[Top] [All Lists]
<prev [Date] next>
[Advanced]
 <prev [Thread] next>

Re: [Bacula-users] Saving each client to a seperate file?

2008-05-01 09:48:28
Subject: Re: [Bacula-users] Saving each client to a seperate file?
From: "Mantas M." <mantasmlist AT gmail DOT com>
To: bacula-users AT lists.sourceforge DOT net
Date: Thu, 01 May 2008 16:48:21 +0300 
Hi,

First of all, I don't think you should recycle volumes.
You embed backup date in the file name (aka label). Once the volume is 
expired, bacula will reuse the volume (thats because of "Recycle = 
Yes"), but the volume already has a label (it will not be re-labeled!) 
so you will end up with erroneous dates in the file names.

Moreover, i have a similar configuration and I'd suggest having a 
separate pool for every client in the system. I'll explain why.
Suppose that for some reason a backup fails, but the volume used by that 
backup job has a status of "append". When the next backup job for some 
different client starts, it will use that Volume instead of creating a 
new one (thats just the way bacula works. Existing writable volumes have 
a higher precedence that new ones.) In the end you'll have a filename of 
Client1, and data of Client2.


That is how my pools looke like:

Pool {
         Name = ClientA
         Maximum volumes = 0
         Pool Type = Backup
         Maximum Volume Jobs = 1
         Volume Retention = 60d
         Recycle = no
         AutoPrune = yes
         Label Format = "${Year}-${Month:p/2/0/r}-${Day:p/2/0/r}-ClientA"
}

Also, check what is your Job retention period. I'm not sure if that is 
related to the problem you are having with your three jobs, but it says 
something about "no jobs associated with volume"..


Cheers,

Mantas



Hemant Shah wrote:
> 
> 
> --- On Tue, 4/29/08, Drew Bentley <bacula.user AT gmail DOT com> wrote:
> 
>  > From: Drew Bentley <bacula.user AT gmail DOT com>
>  > Subject: Re: [Bacula-users] Saving each client to a seperate file?
>  > To: hjrrs AT yahoo DOT com
>  > Cc: "baculausers" <bacula-users AT lists.sourceforge DOT net>
>  > Date: Tuesday, April 29, 2008, 12:58 PM
>  > On Tue, Apr 29, 2008 at 12:51 PM, Hemant Shah
>  > <hjrrs AT yahoo DOT com> wrote:
>  > > Folks,
>  > >
>  > > I am backing up systems to disk and I have set pool
>  > resource as follows:
>  > >
>  > > # Full backup to disk pool definition
>  > > Pool
>  > > {
>  > > Name = FullBackupDiskPool
>  > > Pool Type = Backup
>  > > Recycle = yes
>  > > AutoPrune = yes
>  > > Maximum Volume Jobs = 1
>  > > Volume Retention = 2 weeks
>  > > Storage = File
>  > > Label Format =
>  > "FullBackup-${Client}-${Month:p/2/0/r}-${Day:p/2/0/r}-${Year}"
>  > > }
>  > >
>  > > I am running 3 concurrent jobs. Bacula does not save
>  > each client to seperate file.
>  > >
>  > > Here is the relevant lines from "stat dir"
>  > >
>  > > 23 Full 94,881 4.797 G OK 29-Apr-08
>  > 08:45 lidp7FullBackupToDisk
>  > > 24 Full 303,309 8.392 G OK 29-Apr-08
>  > 08:48 lidp1FullBackupToDisk
>  > > 26 Full 402,286 4.665 G OK 29-Apr-08
>  > 09:11 lidp5FullBackupToDisk
>  > >
>  > >
>  > >
>  > > 22 Full lidp11FullBackupToDisk.2008-04-28_22.00.32
>  > is running
>  > > 25 Full lidp4FullBackupToDisk.2008-04-28_22.00.35
>  > is running
>  > > 27 Full lidp6FullBackupToDisk.2008-04-28_22.00.37
>  > is running
>  > >
>  > >
>  > > As you can see, three clients have finished, and
>  > three are running.
>  > > The directory listing of the backup file directory
>  > shows only three files:
>  > >
>  > > # ls -ltrh
>  > > total 189G
>  > > -rw-r----- 1 root root 1.5G 2008-04-29 08:34
>  > FullBackup-lidp11-fd-04-29-2008
>  > > -rw-r----- 1 root root 14G 2008-04-29 08:45
>  > FullBackup-lidp7-fd-04-29-2008
>  > > -rw-r----- 1 root root 14G 2008-04-29 09:11
>  > FullBackup-lidp4-fd-04-29-2008
>  > > -rw-r----- 1 root root 161G 2008-04-29 12:44
>  > FullBackup-lidp6-fd-04-29-2008
>  > >
>  > > It looks like lidp11 backup is being saved in
>  > FullBackup-lidp6* file. lidp6 backup should be only 20GB
>  > when it is complete. lidp11 backup is 125GB. lidp7 should
>  > only be about 4GB instead it is 14GB so some other client
>  > is stored in it.
>  > >
>  > >
>  > > What am I doing wrong?
>  > >
>  > >
>  > > Hemant Shah
>  > > E-mail: hjrrs AT yahoo DOT com
>  >
>  > Try this option:
>  >
>  > Use Volume Once = yes
>  >
>  > It's outlined in the Pool Resource from the online
>  > manual.
>  >
> 
> I set "Use Volume Once" and "Maximum Volume Jobs", but now I have 
> another problem. I have three concurrent jobs running. I messes up the 
> first two jobs by using same file and purging data for the two jobs. 
> Starting from 4th job it saves each to seperate file.
> 
> Here is my pool resource:
> 
> # Full backup to disk pool definition
> Pool
> {
> Name = FullBackupDiskPool
> Pool Type = Backup
> Recycle = yes # Bacula can automatically recycle Volumes
> AutoPrune = yes # Prune expired volumes
> Maximum Volume Jobs = 1
> Use Volume Once = yes
> Volume Retention = 2 weeks
> Storage = File
> Label Format = 
> "FullBackup-${Client}-${Month:p/2/0/r}-${Day:p/2/0/r}-${Year}"
> }
> 
> 
> Here is what I see on bconsole:
> 
> 30-Apr 14:45 lidp11-dir JobId 1: Start Backup JobId 1, 
> Job=lidp11FullBackupToDisk.2008-04-30_14.45.04
> 30-Apr 14:45 lidp11-dir JobId 1: Created new Volume 
> "FullBackup-lidp11-fd-04-30-2008" in catalog.
> 30-Apr 14:45 lidp11-dir JobId 1: Using Device "FileStorage"
> 30-Apr 14:45 lidp11-sd JobId 1: Labeled new Volume 
> "FullBackup-lidp11-fd-04-30-2008" on device "FileStorage" 
> (/backups/backupfiles).
> 30-Apr 14:45 lidp11-sd JobId 1: Wrote label to prelabeled Volume 
> "FullBackup-lidp11-fd-04-30-2008" on device "FileStorage" 
> (/backups/backupfiles)
> 30-Apr 14:45 lidp11-dir JobId 1: Volume used once. Marking Volume 
> "FullBackup-lidp11-fd-04-30-2008" as Used.
> 30-Apr 14:45 lidp11-dir JobId 2: Start Backup JobId 2, 
> Job=lidp7FullBackupToDisk.2008-04-30_14.45.05
> 30-Apr 14:45 lidp11-dir JobId 3: Start Backup JobId 3, 
> Job=lidp1FullBackupToDisk.2008-04-30_14.45.06
> 30-Apr 14:45 lidp11-dir JobId 2: There are no more Jobs associated with 
> Volume "FullBackup-lidp11-fd-04-30-2008". Marking it purged.
> 30-Apr 14:45 lidp11-dir JobId 2: All records pruned from Volume 
> "FullBackup-lidp11-fd-04-30-2008"; marking it "Purged"
> 30-Apr 14:45 lidp11-dir JobId 2: Recycled volume 
> "FullBackup-lidp11-fd-04-30-2008"
> 30-Apr 14:45 lidp11-dir JobId 2: Using Device "FileStorage"
> 30-Apr 14:45 lidp11-sd JobId 2: Recycled volume 
> "FullBackup-lidp11-fd-04-30-2008" on device "FileStorage" 
> (/backups/backupfiles), all previous data lost.
> 30-Apr 14:45 lidp11-dir JobId 2: Volume used once. Marking Volume 
> "FullBackup-lidp11-fd-04-30-2008" as Used.
> 30-Apr 14:46 lidp11-dir JobId 3: There are no more Jobs associated with 
> Volume "FullBackup-lidp11-fd-04-30-2008". Marking it purged.
> 30-Apr 14:46 lidp11-dir JobId 3: All records pruned from Volume 
> "FullBackup-lidp11-fd-04-30-2008"; marking it "Purged"
> 30-Apr 14:46 lidp11-dir JobId 3: Recycled volume 
> "FullBackup-lidp11-fd-04-30-2008"
> 30-Apr 14:46 lidp11-dir JobId 3: Using Device "FileStorage"
> 30-Apr 14:46 lidp11-sd JobId 3: Recycled volume 
> "FullBackup-lidp11-fd-04-30-2008" on device "FileStorage" 
> (/backups/backupfiles), all previous data lost.
> 30-Apr 14:46 lidp11-dir JobId 3: Volume used once. Marking Volume 
> "FullBackup-lidp11-fd-04-30-2008" as Used.
> 30-Apr 14:59 lidp11-sd JobId 2: Job write elapsed time = 00:14:41, 
> Transfer rate = 5.459 M bytes/second
> 30-Apr 15:00 lidp11-dir JobId 2: Bacula lidp11-dir 2.2.8 (26Jan08): 
> 30-Apr-2008 15:00:04
> 30-Apr 15:00 lidp11-dir JobId 4: Start Backup JobId 4, 
> Job=lidp5FullBackupToDisk.2008-04-30_14.45.07
> 30-Apr 15:00 lidp11-dir JobId 4: Created new Volume 
> "FullBackup-lidp5-fd-04-30-2008" in catalog.
> 30-Apr 15:00 lidp11-dir JobId 4: Using Device "FileStorage"
> 30-Apr 15:00 lidp11-sd JobId 4: Labeled new Volume 
> "FullBackup-lidp5-fd-04-30-2008" on device "FileStorage" 
> (/backups/backupfiles).
> 30-Apr 15:00 lidp11-sd JobId 4: Wrote label to prelabeled Volume 
> "FullBackup-lidp5-fd-04-30-2008" on device "FileStorage" 
> (/backups/backupfiles)
> 30-Apr 15:00 lidp11-dir JobId 4: Volume used once. Marking Volume 
> "FullBackup-lidp5-fd-04-30-2008" as Used.
> 30-Apr 15:00 lidp11-sd JobId 3: Job write elapsed time = 00:14:44, 
> Transfer rate = 3.979 M bytes/second
> 30-Apr 15:02 lidp11-dir JobId 3: Bacula lidp11-dir 2.2.8 (26Jan08): 
> 30-Apr-2008 15:02:02
> 30-Apr 15:02 lidp11-dir JobId 5: Start Backup JobId 5, 
> Job=lidp8FullBackupToDisk.2008-04-30_14.45.08
> 30-Apr 15:02 lidp11-dir JobId 5: Created new Volume 
> "FullBackup-lidp8-fd-04-30-2008" in catalog.
> 30-Apr 15:02 lidp11-dir JobId 5: Using Device "FileStorage"
> 30-Apr 15:02 lidp11-sd JobId 5: Labeled new Volume 
> "FullBackup-lidp8-fd-04-30-2008" on device "FileStorage" 
> (/backups/backupfiles).
> 30-Apr 15:02 lidp11-sd JobId 5: Wrote label to prelabeled Volume 
> "FullBackup-lidp8-fd-04-30-2008" on device "FileStorage" 
> (/backups/backupfiles)
> 30-Apr 15:02 lidp11-dir JobId 5: Volume used once. Marking Volume 
> "FullBackup-lidp8-fd-04-30-2008" as Used.30-Apr 15:20 lidp11-sd JobId 4: 
> Job write elapsed time = 00:20:39, Transfer rate = 1.469 M bytes/second
> 30-Apr 15:22 lidp11-dir JobId 4: Bacula lidp11-dir 2.2.8 (26Jan08): 
> 30-Apr-2008 15:22:23
> 30-Apr 15:22 lidp11-dir JobId 6: Start Backup JobId 6, 
> Job=lidp9FullBackupToDisk.2008-04-30_14.45.09
> 30-Apr 15:22 lidp11-dir JobId 6: Created new Volume 
> "FullBackup-lidp9-fd-04-30-2008" in catalog.
> 30-Apr 15:22 lidp11-dir JobId 6: Using Device "FileStorage"
> 30-Apr 15:22 lidp11-sd JobId 6: Labeled new Volume 
> "FullBackup-lidp9-fd-04-30-2008" on device "FileStorage" 
> (/backups/backupfiles).
> 30-Apr 15:22 lidp11-sd JobId 6: Wrote label to prelabeled Volume 
> "FullBackup-lidp9-fd-04-30-2008" on device "FileStorage" 
> (/backups/backupfiles)
> 30-Apr 15:22 lidp11-dir JobId 6: Volume used once. Marking Volume 
> "FullBackup-lidp9-fd-04-30-2008" as Used.
> 
> 
> As you can see it uses same volume, FullBackup-lidp11-fd-04-30-2008, for 
> first three jobs, and it purges the volumes when it starts second and 
> third job.
> 
> Is this a bug or am I doing something wrong?
> 
> 
> 
> Hemant Shah
> E-mail: hjrrs AT yahoo DOT com
> 
>  > -Drew
> 
> 
> ------------------------------------------------------------------------
> Be a better friend, newshound, and know-it-all with Yahoo! Mobile. Try 
> it now. 
> <http://us.rd.yahoo.com/evt=51733/*http://mobile.yahoo.com/;_ylt=Ahu06i62sR8HDtDypao8Wcj9tAcJ
>  
>  >
> 
> 
> ------------------------------------------------------------------------
> 
> -------------------------------------------------------------------------
> This SF.net email is sponsored by the 2008 JavaOne(SM) Conference 
> Don't miss this year's exciting event. There's still time to save $100. 
> Use priority code J8TL2D2. 
> http://ad.doubleclick.net/clk;198757673;13503038;p?http://java.sun.com/javaone
> 
> 
> ------------------------------------------------------------------------
> 
> _______________________________________________
> Bacula-users mailing list
> Bacula-users AT lists.sourceforge DOT net
> https://lists.sourceforge.net/lists/listinfo/bacula-users


-------------------------------------------------------------------------
This SF.net email is sponsored by the 2008 JavaOne(SM) Conference 
Don't miss this year's exciting event. There's still time to save $100. 
Use priority code J8TL2D2. 
http://ad.doubleclick.net/clk;198757673;13503038;p?http://java.sun.com/javaone
_______________________________________________
Bacula-users mailing list
Bacula-users AT lists.sourceforge DOT net
https://lists.sourceforge.net/lists/listinfo/bacula-users
[More with this subject...]
<Prev in Thread] Current Thread [Next in Thread>
Previous by Date:  Re: [Bacula-users] Migration from Arkeia, Other Questions, Mikael Kermorgant
Next by Date:  Re: [Bacula-users] Saving each client to a seperate file?, Hemant Shah
Previous by Thread:  Re: [Bacula-users] Migration from Arkeia, Other Questions, Mikael Kermorgant
Next by Thread:  Re: [Bacula-users] Saving each client to a seperate file?, Hemant Shah
Indexes:  [Date] [Thread] [Top] [All Lists]