-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Tobias Bartel wrote:
> Hello,
> 
>> Even with 800,000 files, that sounds very slow.  How much data is
>> involved, how is it stored and how fast is your database server?
> 
> It's about 70GB of data, stored on a Raid5 (3Ware controller).
> 
> The database is a SQLite one, on the same machine but on a Software 
> Raid 1.
> 
> The backup device is an LTO3 connected via SCSI
> 
> OS is a Debian stable.
> 
> 
> I already thought about moving the Database to MySQL but there is
> already a MySQL Server on the same box, it is a slave for our MySQL
> master and used for hourly Backups of our database (Stop the
> replication, do the backups and start the replication again).
> I don't really like the idea of adding a DB to the Slave that isn't on
> the master, nor do i like the idea of hacking up some custom MySQL
> install that runs parallel caus that will cost me with every future
> update.
> 
> To be honest, i didn't expect that SQLite could be the bottle neck, it
> just can't be that slow. What made me think that its the number files,
> is that when i do an ls in that directory it takes ~15min before I see
> any output.

My understanding is that you cannot expect decent performance out of
SQLite for Bacula for any production level backup. I could be wrong
here, but I say forget about SQLite for anything other than a trial, and
definitely not using it for a backup that is extra demanding.

You could use PostgreSQL if you wanted to avoid messing with the slave
server (though something tells me that's not a major worry, but I am not
sure about it), or just run MySQL on a different port which I don't
think is all that hard (or, actually, use it in socket-only mode, which
is even easier and I think would suffice).

- --
 ---- _  _ _  _ ___  _  _  _
 |Y#| |  | |\/| |  \ |\ |  | |Ryan Novosielski - Systems Programmer II
 |$&| |__| |  | |__/ | \| _| |novosirj AT umdnj DOT edu - 973/972.0922 (2-0922)
 \__/ Univ. of Med. and Dent.|IST/AST - NJMS Medical Science Bldg - C630
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.6 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org

iD8DBQFJLtgHmb+gadEcsb4RApbKAJ4gTg9fF8susc4iS6e44D9s7uWTxwCg2T/n
hd0IuSIG6mg6J4FPrL/aRz8=
=M8R0
-----END PGP SIGNATURE-----

novosirj.vcf
Description: Vcard

-------------------------------------------------------------------------
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/

_______________________________________________
Bacula-users mailing list
Bacula-users AT lists.sourceforge DOT net
https://lists.sourceforge.net/lists/listinfo/bacula-users