Bacula-users

[Bacula-users] full and diff backups to differnt storages

2011-02-03 06:26:35
Subject: [Bacula-users] full and diff backups to differnt storages
From: "Ronny Seffner" <ronny AT seffner DOT de>
To: <bacula-users AT lists.sourceforge DOT net>
Date: Thu, 3 Feb 2011 12:04:17 +0100
Hi list,

I've a machine containig 2 different devices which I'ld like to use for
backup. An RDX drive for full backups and an LTO drive for the differntials.

So I defined:
Jobs : "full_Job" and "diff_Job"
FileSets : only one for both jobs togehter called "data_FileSet"
Schedules : "data_full_Schedule" and "data_diff_Schedule"
Storages : "LTO_Storage" and "RDX_Storage"

Now I believed starting a full_Job to RDX_Storage allows to run a diff_Job
to LTO_storage next time backing up only the difference. But my diff_Job
makes also one full backup per schedule rotation.

How it's possible to get both backups togehter, so that diff_Job's were
based on last full_Job?

Following some config parts:


Job {
        Name = "full_Job"
        Type = Backup
        Client = gg-server-fd
        FileSet = "data_FileSet"
        Schedule = "data_full_Schedule"
        Storage = "RDX_Storage"
        Messages = Standard
        Pool = "RDX_Pool"
        Write Bootstrap = "/var/lib/bacula/%c.bsr"
        Priority = 10
        MaxStartDelay = 22h
        Level = "Full"
        RunBeforeJob = "/etc/bacula/scripts/mount_RDX"
        RunAfterJob = "/etc/bacula/scripts/umount_RDX"
}

Job {
        Name = "diff_Job"
        Type = Backup
        Client = gg-server-fd
        FileSet = "data_FileSet"
        Schedule = "data_diff_Schedule"
        Storage = "LTO_Storage"
        Messages = Standard
        Pool = "LTO_Pool"
        Write Bootstrap = "/var/lib/bacula/%c.bsr"
        Priority = 10
        MaxStartDelay = 2h
        Level = "Differential"
        RunAfterJob = "/etc/bacula/scripts/eject_LTO"
}

FileSet {
        Name = "data_FileSet"
        Include {
                Options {
                        signature = MD5
                        onefs = yes
                }
                File = /user
        }
        Exclude {
                File = /user/lost+found
        }
}

Schedule {
        Name = "data_full_Schedule"
        Run = Full sun at 23:15
}

Schedule {
        Name = "data_diff_Schedule"
        Run = Differential mon-sat at 23:15
}

Storage {
        Name = RDX_Storage
        Address = 127.0.0.1
        SDPort = 9103
        Password = "********"
        Device = RDX_Device
        Media Type = File
}

Storage {
        Name = LTO_Storage
        Address = 127.0.0.1
        SDPort = 9103
        Password = "********"
        Device = LTO_Device
        Media Type = LTO-2
}



And 'list media' to see the actual problem with on full backup in
"LTO_Pool":


Pool: RDX_Pool
+---------+------------+-----------+---------+-----------------+----------+-
-------------+---------+------+-----------+-----------+---------------------
+
| MediaId | VolumeName | VolStatus | Enabled | VolBytes        | VolFiles |
VolRetention | Recycle | Slot | InChanger | MediaType | LastWritten
|
+---------+------------+-----------+---------+-----------------+----------+-
-------------+---------+------+-----------+-----------+---------------------
+
|      42 | 02         | Used      |       1 | 380,986,958,736 |       88 |
1,036,800 |       1 |    0 |         0 | File      | 2011-01-31 02:39:29 |
|      43 | 01         | Used      |       1 | 380,149,720,584 |       88 |
1,036,800 |       1 |    0 |         0 | File      | 2011-01-24 02:37:23 |
+---------+------------+-----------+---------+-----------------+----------+-
-------------+---------+------+-----------+-----------+---------------------
+
Pool: LTO_Pool
+---------+------------+-----------+---------+-----------------+----------+-
-------------+---------+------+-----------+-----------+---------------------
+
| MediaId | VolumeName | VolStatus | Enabled | VolBytes        | VolFiles |
VolRetention | Recycle | Slot | InChanger | MediaType | LastWritten
|
+---------+------------+-----------+---------+-----------------+----------+-
-------------+---------+------+-----------+-----------+---------------------
+
|      36 | montag     | Used      |       1 |     800,529,408 |        1 |
518,400 |       1 |    0 |         0 | LTO-2     | 2011-01-31 23:17:24 |
|      37 | dienstag   | Used      |       1 |     944,584,704 |        1 |
518,400 |       1 |    0 |         0 | LTO-2     | 2011-02-01 23:17:37 |
|      38 | mittwoch   | Used      |       1 |   1,167,602,688 |        1 |
518,400 |       1 |    0 |         0 | LTO-2     | 2011-02-02 23:18:09 |
|      39 | freitag    | Used      |       1 |     344,816,640 |        1 |
518,400 |       1 |    0 |         0 | LTO-2     | 2011-01-28 23:16:55 |
|      40 | samstag    | Used      |       1 |     609,186,816 |        1 |
518,400 |       1 |    0 |         0 | LTO-2     | 2011-01-29 23:17:13 |
|      41 | donnerstag | Used      |       1 | 380,501,968,896 |      127 |
518,400 |       1 |    0 |         0 | LTO-2     | 2011-01-28 06:55:37 |
+---------+------------+-----------+---------+-----------------+----------+-
-------------+---------+------+-----------+-----------+---------------------
+


You'll see I'ld like to get full backups to RDX on sundays and differntials
on monday to saturday. But at Thursday there was made an full backup to LTO
and so will it be today again I guess. I've left out any catalog backup her
to keep it simple, but I've one configured and its working.


Here also an part of my log on Thursdays diff backup:


19-Jan 23:15 gg-server.ayous.org-dir JobId 300: No prior Full backup Job
record found.
19-Jan 23:15 gg-server.ayous.org-dir JobId 300: No prior or suitable Full
backup found in catalog. Doing FULL backup.
19-Jan 23:15 gg-server.ayous.org-dir JobId 300: Start Backup JobId 300,
Job=diff_Job.2011-01-19_23.15.00_28
19-Jan 23:15 gg-server.ayous.org-dir JobId 300: There are no more Jobs
associated with Volume "mittwoch". Marking it purged.
19-Jan 23:15 gg-server.ayous.org-dir JobId 300: All records pruned from
Volume "mittwoch"; marking it "Purged"
19-Jan 23:15 gg-server.ayous.org-dir JobId 300: Recycled volume "mittwoch"
19-Jan 23:15 gg-server.ayous.org-dir JobId 300: Using Device "LTO_Device"
19-Jan 23:15 gg-server.ayous.org-sd JobId 300: Recycled volume "mittwoch" on
device "LTO_Device" (/dev/nst0), all previous data lost.
19-Jan 23:15 gg-server.ayous.org-dir JobId 300: Volume used once. Marking
Volume "mittwoch" as Used.
20-Jan 06:45 gg-server.ayous.org-sd JobId 300: Job write elapsed time =
07:30:24, Transfer rate = 14.03 M Bytes/second
20-Jan 06:47 gg-server.ayous.org-dir JobId 300: Bacula
gg-server.ayous.org-dir 5.0.1 (24Feb10): 20-Jan-2011 06:47:08
  Build OS:               i486-pc-linux-gnu debian 5.0.4
  JobId:                  300
  Job:                    diff_Job.2011-01-19_23.15.00_28
  Backup Level:           Full (upgraded from Differential)
  Client:                 "gg-server-fd" 5.0.1 (24Feb10)
i486-pc-linux-gnu,debian,5.0.4
  FileSet:                "data_FileSet" 2010-06-25 23:15:00
  Pool:                   "LTO_Pool" (From Job resource)
  Catalog:                "backup_Catalog" (From Client resource)
  Storage:                "LTO_Storage" (From Job resource)
  Scheduled time:         19-Jan-2011 23:15:00
  Start time:             19-Jan-2011 23:15:02
  End time:               20-Jan-2011 06:47:08
  Elapsed time:           7 hours 32 mins 6 secs
  Priority:               10
  FD Files Written:       816,779
  SD Files Written:       816,779
  FD Bytes Written:       379,189,707,214 (379.1 GB)
  SD Bytes Written:       379,308,730,490 (379.3 GB)
  Rate:                   13978.8 KB/s
  Software Compression:   None
  VSS:                    no
  Encryption:             no
  Accurate:               no
  Volume name(s):         mittwoch
  Volume Session Id:      122
  Volume Session Time:    1286909862
  Last Volume Bytes:      379,614,606,336 (379.6 GB)
  Non-fatal FD errors:    0
  SD Errors:              0
  FD termination status:  OK
  SD termination status:  OK
  Termination:            Backup OK

20-Jan 06:47 gg-server.ayous.org-dir JobId 300: Begin pruning Jobs older
than 6 months .
20-Jan 06:47 gg-server.ayous.org-dir JobId 300: No Jobs found to prune.
20-Jan 06:47 gg-server.ayous.org-dir JobId 300: Begin pruning Jobs.
20-Jan 06:47 gg-server.ayous.org-dir JobId 300: No Files found to prune.
20-Jan 06:47 gg-server.ayous.org-dir JobId 300: End auto prune.

20-Jan 06:47 gg-server.ayous.org-dir JobId 300: shell command: run AfterJob
"/etc/bacula/scripts/eject_LTO"



Mit freundlichen Grüßen / With kind regards
     Ronny Seffner
-- 
Ronny Seffner  |  Alter Viehweg 1  |  01665 Triebischtal

www.seffner.de  |  ronny AT seffner DOT de  |  +49 35245 72950





------------------------------------------------------------------------------
Special Offer-- Download ArcSight Logger for FREE (a $49 USD value)!
Finally, a world-class log management solution at an even better price-free!
Download using promo code Free_Logger_4_Dev2Dev. Offer expires 
February 28th, so secure your free ArcSight Logger TODAY! 
http://p.sf.net/sfu/arcsight-sfd2d
_______________________________________________
Bacula-users mailing list
Bacula-users AT lists.sourceforge DOT net
https://lists.sourceforge.net/lists/listinfo/bacula-users