Bacula-users

Re: [Bacula-users] Backup of many many files

2008-09-02 02:41:45
Subject: Re: [Bacula-users] Backup of many many files
From: Daniel Betz <dbetz AT df DOT eu>
To: Jose Ildefonso Camargo Tolosa <ildefonso.camargo AT gmail DOT com>
Date: Tue, 2 Sep 2008 08:41:33 +0200
Hi Jose,

> -----Ursprüngliche Nachricht-----
> Von: Jose Ildefonso Camargo Tolosa [mailto:ildefonso.camargo AT gmail DOT com]
> Gesendet: Dienstag, 2. September 2008 03:11
> An: Daniel Betz
> Cc: bacula-users AT lists.sourceforge DOT net
> Betreff: Re: [Bacula-users] Backup of many many files
>
> Hi!
>
> On Tue, Sep 2, 2008 at 3:15 AM, Daniel Betz <dbetz AT df DOT eu> wrote:
> > Hi all,
> >
> >
> >
> > can you give me some tips for backing up an filesystem with many many
> small
> > files on it ?
> >
> > The problem is, that i must backup mailservers with about 300 GB and
> more
> > than 1-2 million of many small files (Maildir).
>
> These are not *that* much files, I got a backup with 1.2M files, and
> 600GB on it.
>

There are some servers with over 6 million of files in there.

> >
> > The File Table in the bacula database grows up to more than 3GB and
> the
> > backups takes more than 30 hours.
>
> What database server are you using?  more details on your backup
> (network speed, backup media, etc...).
>
> >
> > Is this an good time, or is there an way to optimize this eg. to run
> more
> > cuncurrent jobs than one on the client ?
> >
> > When i turn on concurrent jobs must i enable data spooling ?
> >
> >
> >
> > This makes it impossible to restore single files "quick".
> >
> >
> >
> > When you need more information, please let me know.
> >
>
> Bacula version, which database (including version), and, off course,
> your platform.  Any extra info would be good.
>

Media Type = Files.
Bacula Version 2.4.2
MySQL 5.0.45-7.el5 (latest vom CentOS 5.2)
CentOS 5.2 Final with Kernel 2.6.18-92.1.10.el5PAE on backupservers and 
2.6.18-53.1.14.el5PAE on clients
100 Mbit LAN
backupserver:
- Celeron 2.8 Ghz
- 1 GB RAM
- 4x SATA 500GB in RAID 0
clients:
- Quad Xeon 1,6Ghz
- 4 GB RAM
- 8x SAS 250 GB in RAID 10

the speedup is only around 2 MB/s


-------------------------------------------------------------------------
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/
_______________________________________________
Bacula-users mailing list
Bacula-users AT lists.sourceforge DOT net
https://lists.sourceforge.net/lists/listinfo/bacula-users