Bacula-users

Re: [Bacula-users] Why does a COPY job require a FileSet selection?

2012-10-03 09:06:04
Subject: Re: [Bacula-users] Why does a COPY job require a FileSet selection?
From: Dan Langille <dan AT langille DOT org>
To: <bacula-users AT lists.sourceforge DOT net>
Date: Wed, 03 Oct 2012 09:02:28 -0400
On 2012-10-03 01:47, comport3 wrote:
> Can anyone explain why a FileSet is required when migrating/copying
> from one volume to another?

Because a Job requires a FileSet.  :)

I use this FileSet for such jobs:

FileSet {
   Name = "EmptyCopyToTape"
}

and I use it like this:

Job {
   Name     = "CopyToTape-Inc"
   Type     = Copy
   Level    = Incremental
   Pool     = IncrFile

   FileSet   = "EmptyCopyToTape"

   Client      = kraken-fd
   Schedule    = "CopyToTape-Inc"
   Storage     = DigitalTapeLibrary
   Messages    = Standard

   # don't spool date when backing up to tape from local disk
   Spool Data  = no
   Spool Attributes = yes

   RunAfterJob  = "/home/dan/bin/dlt-stats-kraken"

   # no sense spooling local data
   Spool Data       = no
   Spool Attributes = yes
   Maximum Concurrent Jobs = 40



   Priority    = 410

   Selection Type = SQL Query
   Selection Pattern = "
  SELECT DISTINCT J.JobId, J.StartTime
    FROM Job J, Pool P
    WHERE P.Name = 'IncrFile'
      AND P.PoolId = J.PoolId
      AND J.Type = 'B'
      AND J.JobStatus IN ('T','W')
      AND J.jobBytes > 0
      AND J.JobId NOT IN
          (SELECT PriorJobId
             FROM Job
            WHERE Type IN ('B','C')
              AND Job.JobStatus IN ('T','W')
              AND PriorJobId != 0)
ORDER BY J.StartTime
"
}


> Essentially we have an "OFFSITE" backup that I want on local (iSCSI)
> disk, then to be copied to LTO-4 tape.
>
> There are several backup jobs, each with a different FileSet 
> selection.

Yes, the FileSet defined in the Copy Job does not necessarily have to 
match
the FileSet in the job[s] it will copy.

> Can anyone suggest a way to migrate the entire contents of the
> OFFSITE disk volume to tape without creating multiple COPY jobs in
> Bacula?

Done.  See above.

What you may want more help with is the selection process. The 
'Selection Type'
I use above will copy waiting Jobs in the IncrFile pool and copy them.  
Where does
it copy them?  To the Incremental pool, which is a tape pool.  This 
aspect is defined
in the IncrFile pool:

Pool {
   Name             = IncrFile
   Pool Type        = Backup
   Recycle          = yes
   AutoPrune        = yes
   Volume Retention = 3 weeks
   Storage          = MegaFile
   Next Pool        = Incrementals

   Maximum Volume Bytes = 5G

   LabelFormat = "IncrAuto-"
}

I wrote up two posts while I was setting up my copy jobs.  I hope they 
are useful to you:

- http://www.freebsddiary.org/bacula-disk-to-tape.php
- http://www.freebsddiary.org/bacula-disk-to-tape-via-sql.php

Hope that helps.



-- 
Dan Langille - http://langille.org/

------------------------------------------------------------------------------
Don't let slow site performance ruin your business. Deploy New Relic APM
Deploy New Relic app performance management and know exactly
what is happening inside your Ruby, Python, PHP, Java, and .NET app
Try New Relic at no cost today and get our sweet Data Nerd shirt too!
http://p.sf.net/sfu/newrelic-dev2dev
_______________________________________________
Bacula-users mailing list
Bacula-users AT lists.sourceforge DOT net
https://lists.sourceforge.net/lists/listinfo/bacula-users