Re: [Bacula-users] Backup of many many files
2008-09-02 08:00:57
Daniel Betz schrieb:
> Hi Jose,
>
>> -----Ursprüngliche Nachricht-----
>> Von: Jose Ildefonso Camargo Tolosa [mailto:ildefonso.camargo AT gmail DOT
>> com]
>> Gesendet: Dienstag, 2. September 2008 03:11
>> An: Daniel Betz
>> Cc: bacula-users AT lists.sourceforge DOT net
>> Betreff: Re: [Bacula-users] Backup of many many files
>>
>> Hi!
>>
>> On Tue, Sep 2, 2008 at 3:15 AM, Daniel Betz <dbetz AT df DOT eu> wrote:
>>> Hi all,
>>>
>>>
>>>
>>> can you give me some tips for backing up an filesystem with many many
>> small
>>> files on it ?
>>>
>>> The problem is, that i must backup mailservers with about 300 GB and
>> more
>>> than 1-2 million of many small files (Maildir).
>> These are not *that* much files, I got a backup with 1.2M files, and
>> 600GB on it.
>>
>
> There are some servers with over 6 million of files in there.
>
>>> The File Table in the bacula database grows up to more than 3GB and
>> the
>>> backups takes more than 30 hours.
>> What database server are you using? more details on your backup
>> (network speed, backup media, etc...).
>>
>>> Is this an good time, or is there an way to optimize this eg. to run
>> more
>>> cuncurrent jobs than one on the client ?
>>>
>>> When i turn on concurrent jobs must i enable data spooling ?
>>>
>>>
>>>
>>> This makes it impossible to restore single files "quick".
>>>
>>>
>>>
>>> When you need more information, please let me know.
>>>
>> Bacula version, which database (including version), and, off course,
>> your platform. Any extra info would be good.
>>
>
> Media Type = Files.
> Bacula Version 2.4.2
> MySQL 5.0.45-7.el5 (latest vom CentOS 5.2)
> CentOS 5.2 Final with Kernel 2.6.18-92.1.10.el5PAE on backupservers and
> 2.6.18-53.1.14.el5PAE on clients
> 100 Mbit LAN
> backupserver:
> - Celeron 2.8 Ghz
> - 1 GB RAM
> - 4x SATA 500GB in RAID 0
> clients:
> - Quad Xeon 1,6Ghz
> - 4 GB RAM
> - 8x SAS 250 GB in RAID 10
>
> the speedup is only around 2 MB/s
>
Do you use compression? I had rates between 2-4 MB/s when using default
compression. Switching to compression level 1 increased speed a litte.
No compression should increase very much.
--
Regards
Christoph
________________________________________________________________________
Christoph Litauer litauer AT uni-koblenz DOT de
Uni Koblenz, Computing Center, http://www.uni-koblenz.de/~litauer
Postfach 201602, 56016 Koblenz Fon: +49 261 287-1311, Fax: -100 1311
PGP-Fingerprint: F39C E314 2650 650D 8092 9514 3A56 FBD8 79E3 27B2
-------------------------------------------------------------------------
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/
_______________________________________________
Bacula-users mailing list
Bacula-users AT lists.sourceforge DOT net
https://lists.sourceforge.net/lists/listinfo/bacula-users
|
<Prev in Thread] |
Current Thread |
[Next in Thread>
|
- [Bacula-users] Show Shining, was many many files, (continued)
- [Bacula-users] Show Shining, was many many files, John Huttley
- Re: [Bacula-users] Show Shining, was many many files, Ryan Novosielski
- Re: [Bacula-users] Show Shining, was many many files, Jose Ildefonso Camargo Tolosa
- Re: [Bacula-users] Show Shining, was many many files, John Drescher
- Re: [Bacula-users] Show Shining, was many many files, Arno Lehmann
- Re: [Bacula-users] Show Shining, was many many files, T. Horsnell
- Re: [Bacula-users] Show Shining, was many many files, Arno Lehmann
- Re: [Bacula-users] Show Shining, was many many files, Dan Langille
- Re: [Bacula-users] Backup of many many files, Kjetil Torgrim Homme
- Re: [Bacula-users] Backup of many many files, T. Horsnell
- Re: [Bacula-users] Backup of many many files,
Christoph Litauer <=
- Re: [Bacula-users] Backup of many many files, Daniel Betz
- Re: [Bacula-users] Backup of many many files, Jesper Krogh
Re: [Bacula-users] Backup of many many files, Yuri Timofeev
Re: [Bacula-users] Backup of many many files, Yuri Timofeev
|
|
|