Bacula-users

Re: [Bacula-users] Backup of many many files

2008-09-02 08:00:57
Subject: Re: [Bacula-users] Backup of many many files
From: Christoph Litauer <litauer AT uni-koblenz DOT de>
To: Daniel Betz <dbetz AT df DOT eu>
Date: Tue, 02 Sep 2008 14:00:45 +0200
Daniel Betz schrieb:
> Hi Jose,
> 
>> -----Ursprüngliche Nachricht-----
>> Von: Jose Ildefonso Camargo Tolosa [mailto:ildefonso.camargo AT gmail DOT 
>> com]
>> Gesendet: Dienstag, 2. September 2008 03:11
>> An: Daniel Betz
>> Cc: bacula-users AT lists.sourceforge DOT net
>> Betreff: Re: [Bacula-users] Backup of many many files
>>
>> Hi!
>>
>> On Tue, Sep 2, 2008 at 3:15 AM, Daniel Betz <dbetz AT df DOT eu> wrote:
>>> Hi all,
>>>
>>>
>>>
>>> can you give me some tips for backing up an filesystem with many many
>> small
>>> files on it ?
>>>
>>> The problem is, that i must backup mailservers with about 300 GB and
>> more
>>> than 1-2 million of many small files (Maildir).
>> These are not *that* much files, I got a backup with 1.2M files, and
>> 600GB on it.
>>
> 
> There are some servers with over 6 million of files in there.
> 
>>> The File Table in the bacula database grows up to more than 3GB and
>> the
>>> backups takes more than 30 hours.
>> What database server are you using?  more details on your backup
>> (network speed, backup media, etc...).
>>
>>> Is this an good time, or is there an way to optimize this eg. to run
>> more
>>> cuncurrent jobs than one on the client ?
>>>
>>> When i turn on concurrent jobs must i enable data spooling ?
>>>
>>>
>>>
>>> This makes it impossible to restore single files "quick".
>>>
>>>
>>>
>>> When you need more information, please let me know.
>>>
>> Bacula version, which database (including version), and, off course,
>> your platform.  Any extra info would be good.
>>
> 
> Media Type = Files.
> Bacula Version 2.4.2
> MySQL 5.0.45-7.el5 (latest vom CentOS 5.2)
> CentOS 5.2 Final with Kernel 2.6.18-92.1.10.el5PAE on backupservers and 
> 2.6.18-53.1.14.el5PAE on clients
> 100 Mbit LAN
> backupserver:
> - Celeron 2.8 Ghz
> - 1 GB RAM
> - 4x SATA 500GB in RAID 0
> clients:
> - Quad Xeon 1,6Ghz
> - 4 GB RAM
> - 8x SAS 250 GB in RAID 10
> 
> the speedup is only around 2 MB/s
> 

Do you use compression? I had rates between 2-4 MB/s when using default 
compression. Switching to compression level 1 increased speed a litte. 
No compression should increase very much.

-- 
Regards
Christoph
________________________________________________________________________
Christoph Litauer                  litauer AT uni-koblenz DOT de
Uni Koblenz, Computing Center,     http://www.uni-koblenz.de/~litauer
Postfach 201602, 56016 Koblenz     Fon: +49 261 287-1311, Fax: -100 1311
PGP-Fingerprint: F39C E314 2650 650D 8092 9514 3A56 FBD8 79E3 27B2


-------------------------------------------------------------------------
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/
_______________________________________________
Bacula-users mailing list
Bacula-users AT lists.sourceforge DOT net
https://lists.sourceforge.net/lists/listinfo/bacula-users