Bacula-users

Re: [Bacula-users] Optimize backup/database

2014-06-02 12:53:13
Subject: Re: [Bacula-users] Optimize backup/database
From: Kern Sibbald <kern AT sibbald DOT com>
To: lst_hoe02 AT kwsoft DOT de, bacula-users AT lists.sourceforge DOT net
Date: Mon, 02 Jun 2014 18:50:35 +0200
Good advice.

One additional point: ensure that you have Attribute Spooling enabled
otherwise
attributes (file metadata) are inserted into the catalog one at a time
rather than in big batches, which is obviously much more efficient.

Regards,
Kern

On 05/31/2014 09:31 AM, lst_hoe02 AT kwsoft DOT de wrote:
> Zitat von bdelagree <bacula-forum AT backupcentral DOT com>:
>
>> This post follows one of my old posts (see :  
>> http://www.backupcentral.com/phpBB2/two-way-mirrors-of-external-mailing-lists-3/bacula-25/slow-backup-how-to-optimize-122683/index-15.html)
>>
>> My backups are still long .
>> After listening to the network and servers I think my problem comes  
>> from the database.
>> After much research some say migrate from MySQL to PostgreSQL .
>>
>> Before doing so I need your opinion , is there a real added value?
> You should first check how long it actually takes to insert the  
> attributes in the database. With this information you can decide if  
> you are optimizing the right point. For example our biggest job has  
> around 1.1TB with 4 mio files which grow to around 1.2G attributes per  
> job according to the logs. This job finish within around 32 hours but  
> inserting the attributes only takes ~3 minutes. We have additional  
> overhead per file and overall throughput because using encryption and  
> Windows isn't that fast either.
>
> So what is the time it takes to insert the attributes?
> What is the transfer speed you get?
> Do you use data/attribute spooling as you should?
> What is the transfer speed to tape (LTO-5)?
>
> Without carefully measuring this values no one could say if you got a  
> real value from switching to PostgreSQL.
>
> Regards
>
> Andreas
>
>
>
>
>
> ------------------------------------------------------------------------------
> Time is money. Stop wasting it! Get your web API in 5 minutes.
> www.restlet.com/download
> http://p.sf.net/sfu/restlet
> _______________________________________________
> Bacula-users mailing list
> Bacula-users AT lists.sourceforge DOT net
> https://lists.sourceforge.net/lists/listinfo/bacula-users
>


------------------------------------------------------------------------------
Learn Graph Databases - Download FREE O'Reilly Book
"Graph Databases" is the definitive new guide to graph databases and their 
applications. Written by three acclaimed leaders in the field, 
this first edition is now available. Download your free book today!
http://p.sf.net/sfu/NeoTech
_______________________________________________
Bacula-users mailing list
Bacula-users AT lists.sourceforge DOT net
https://lists.sourceforge.net/lists/listinfo/bacula-users

<Prev in Thread] Current Thread [Next in Thread>
  • Re: [Bacula-users] Optimize backup/database, Kern Sibbald <=