Re: [Bacula-users] Backup challenge :-)

Thanks for the reply,

I also use the script you describe (hard links) for a daily (quick retrieval) backup, but in this case I can`t put my entire backup in the safe.
maybe I should look at a tape robot, (my tought was they were slow ????)

Any ideas of the do`s and dont`s with these tape robots ?

thanks in advance.

Daniel

The information transmitted is intended only for the person or entity to which it is addressed and may contain confidential and/or privileged material. Any review, retransmission, dissemination or other use of, or taking of any action in reliance upon, this information by persons or entities other than the intended recipient is prohibited. If you received this in error, please contact the sender and delete the material from any computer.

PanTerra Geoconsultants B.V.
Weversbaan 1-3, Leiderdorp
The Netherlands

Phone: +31 (0) 71 581 3505
Fax: +31 (0) 71 301 0802
Website:
eMail: d.sierat AT panterra DOT nl ict AT panterra DOT nl

-----Original Message-----
From: Kevin Keane [mailto:subscription AT kkeane DOT com]
Sent: Tuesday, September 01, 2009 11:04 PM
Cc: bacula-users AT lists.sourceforge DOT net
Subject: Re: [Bacula-users] Backup challenge :-)

Your rsync script may actually be appropriate for your job, after all.
The trick is to use hard links. I don't remember the exact options off
the top of my head, but here is approximately what I did in a somewhat
similar situation. For this to work, your full and incremental backups
must be on the same partition.

FULLBACKUPLOCATION=/mnt/backup
INCREMENTALBACKUPLOCATION=/mnt/incremental
# make a copy of the full backup, but have cp create hard links instead
of physically copying the data
cp -R ... $FULLBACKUPLOCATION $INCREMENTALBACKUPLOCATION
# Now rsync only those files that have changed. Be sure to also use the
option that deletes files that no longer exist
rsync ... /home $INCREMENTALBACKUPLOCATION

With this scheme, you only need 13TB for the full backup, and 500 GB per
day for the hard links and the data that actually changed.

As far as bacula goes, I LOVE it, it beats any script hands down. But
you will need to rework your requirements a bit to make it work. For
that matter, rework your whole backup strategy. Backing up 13 TB will
take a lot of time no matter what you do. I'm assuming that most of the
data is not going to change much, maybe from some older projects? In
that case, archive the old data and never back it up again (or maybe
once a year or so).

Stay away from USB hard disks! For one, it's FAR too slow. Just the
physical data transfer alone will kill you. 13 GB will likely take a
week or more. For another, I have had two cases where a USB drive gone
bad had prevented a computer from even booting properly.

At the very least, use eSATA, and make sure your configuration is
hot-pluggable.

Also, rethink the tape if you can at all afford the budget. Bacula's
support for backing up to disk is kind of an afterthought, and it
basically assumes that the disk is fixed and will never be swapped. You
can change that, but have to jump through some substantial hoops.

On my own system, I do back up to disk (but it's only about 60 GB), and
then copy these files to an external drive that I can then take off
site. Works very well for me, but I wouldn't want to do that with 13 TB
of data. I've heard of others who use rsync to copy the backup files
offsite.

ict AT panterra DOT nl wrote:
> Dear Bacula users,
>
> I am looking for a backup solution for our company and found bacula on the net.
> We use a linux (centos 4.4) server running samba to serve our domain and windows clients.
> At the moment I have an Iscsi network storage of 4 TB and use the rsync commands (in a neat script) to create a backup of the drive.
> This script excludes the samba Recycle bins.
> since we are growing out of our current data store :-o I would like to buy an 13 TB (raid 6 + hotspare) sata das unit. However using my current script would need me to have 8 x 13 x 1TB = 104 backup disks :-o, this ofcourse is not an option. my idea would be a full backup on monday and a incremental every day to a single 1TB or 2TB drive.
>
> I would like to have a backup scheme of -Monday -Tuesday -Wednesday -Thursday Friday1 and Friday2 or so, with minimal amount of external disk to swap.
> It would also be important that the data can be stored in a fire safe.
>
> Can bacula provide me this system, and would this be a good solution ?
> Or does bacula provides another solution better for this problem?
>
> key features of system:
> maximum storage of 13 TB.
> maximum of 500 Gb changing on a day (exept of some new projects rarely and not more than 1 TB)
> 1 weekly full backup other incremental on smaller disks
> external (firesafe) copy
> prefferably on a harddisk(usb) (due to the size/prize of tape and/or tape robot)
> expandable over couple of years.
>
> Some good advise wanted
>
> Regards Daniel
>
> The information transmitted is intended only for the person or entity to which it is addressed and may contain confidential and/or privileged material. Any review, retransmission, dissemination or other use of, or taking of any action in reliance upon, this information by persons or entities other than the intended recipient is prohibited. If you received this in error, please contact the sender and delete the material from any computer.
>
> PanTerra Geoconsultants B.V.
> Weversbaan 1-3, Leiderdorp
> The Netherlands
>
> Phone: +31 (0) 71 581 3505
> Fax: +31 (0) 71 301 0802
> Website:
> eMail: d.sierat AT panterra DOT nl ict AT panterra DOT nl
>
>
> ------------------------------------------------------------------------
>
> ------------------------------------------------------------------------------
> Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day
> trial. Simplify your report design, integration and deployment - and focus on
> what you do best, core application coding. Discover what's new with
> Crystal Reports now. http://p.sf.net/sfu/bobj-july
> ------------------------------------------------------------------------
>
> _______________________________________________
> Bacula-users mailing list
> Bacula-users AT lists.sourceforge DOT net
> https://lists.sourceforge.net/lists/listinfo/bacula-users
>

--
Kevin Keane
Owner
The NetTech
Find the Uncommon: Expert Solutions for a Network You Never Have to Think About

Office: 866-642-7116
http://www.4nettech.com

This e-mail and attachments, if any, may contain confidential and/or proprietary information. Please be advised that the unauthorized use or disclosure of the information is strictly prohibited. The information herein is intended only for use by the intended recipient(s) named above. If you have received this transmission in error, please notify the sender immediately and permanently delete the e-mail and any copies, printouts or attachments thereof.

------------------------------------------------------------------------------
Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day
trial. Simplify your report design, integration and deployment - and focus on
what you do best, core application coding. Discover what's new with
Crystal Reports now. http://p.sf.net/sfu/bobj-july
_______________________________________________
Bacula-users mailing list
Bacula-users AT lists.sourceforge DOT net
https://lists.sourceforge.net/lists/listinfo/bacula-users

------------------------------------------------------------------------------
Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day 
trial. Simplify your report design, integration and deployment - and focus on 
what you do best, core application coding. Discover what's new with 
Crystal Reports now.  http://p.sf.net/sfu/bobj-july

_______________________________________________
Bacula-users mailing list
Bacula-users AT lists.sourceforge DOT net
https://lists.sourceforge.net/lists/listinfo/bacula-users