All,
Nevermind about dedup with Bacula. It seems that the current block
format doesn't work too well with it:
http://changelog.complete.org/archives/5547-research-on-deduplicating-disk-based-and-cloud-backups
I'm getting descent compression rates though with LZJB (compression=on),
which makes it compelling enough to stick with ZFS.
My original question of recommended "Maximum Volume Bytes" size still
stands though. The documentation seems to recommend 50 GB, but we need
to backup 15 TB of data. I'm just wondering if that changes things or not.
Cheers,
Mike
On 05/20/2011 10:48 AM, Mike Seda wrote:
> Hi All,
> I'm currently setting up a disk-based storage pool in Bacula and am
> wondering what I should set "Maximum Volume Bytes" to. I was thinking of
> setting it to "100G", but am just wondering if this is sane.
>
> FYI, the total data of our clients is 15 TB, but we are told that this
> data should at least double each year.
>
> I noticed that there seems to be a limit on the number of disk-based
> volumes in a pool due to the suffix having 4 digits, i.e. 0001. This
> adds up to about 10,000 possible volumes per pool. So 10,000 volumes x
> 100 GB is 1 PB. That seems like overkill. Perhaps setting "Maximum
> Volume Bytes = 10G" would be more reasonable since this would add up to
> 100 TB.
>
> I'm also storing these file volumes on ZFS (v28 w/ dedup=on), and am
> wondering if smaller volumes will dedup better than larger ones. I'm
> curious to see what others are doing to take advantage of dedup-enabled
> ZFS storage w/ Bacula.
>
> Thanks,
> Mike
>
> ------------------------------------------------------------------------------
> What Every C/C++ and Fortran developer Should Know!
> Read this article and learn how Intel has extended the reach of its
> next-generation tools to help Windows* and Linux* C/C++ and Fortran
> developers boost performance applications - including clusters.
> http://p.sf.net/sfu/intel-dev2devmay
> _______________________________________________
> Bacula-users mailing list
> Bacula-users AT lists.sourceforge DOT net
> https://lists.sourceforge.net/lists/listinfo/bacula-users
------------------------------------------------------------------------------
What Every C/C++ and Fortran developer Should Know!
Read this article and learn how Intel has extended the reach of its
next-generation tools to help Windows* and Linux* C/C++ and Fortran
developers boost performance applications - including clusters.
http://p.sf.net/sfu/intel-dev2devmay
_______________________________________________
Bacula-users mailing list
Bacula-users AT lists.sourceforge DOT net
https://lists.sourceforge.net/lists/listinfo/bacula-users
|
