Michael Galloway wrote:
> On Tue, Sep 02, 2008 at 07:13:51AM -0400, Michael Galloway wrote:
>> i'm going to jump into the middle of this thread as this is currrently my
>> biggest issue with bacula. my 'problematic' filesyste is this:
>>
>> | 1,249 | birch | 2008-07-27 00:25:05 | B | F | 16,060,382 |
>> 1,090,359,097,266 | T |
>>
>> 16M files at just about 1.1TB. it currently takes me days go get this backup
>> up via nfs mount to
>> a DLT-4 tape drive. the filesystem is on a Netapp, mounted via nfs with the
>> netapp recommened nfs
>> options, 1000Mb/s network. here is the summary from the last full backup:
>>
>> Build OS: x86_64-unknown-linux-gnu redhat
>> JobId: 1414
>> Job: birch.2008-08-24_00.05.44
>> Backup Level: Full
>> Client: "molbio-fd" 2.2.6 (10Nov07)
>> x86_64-unknown-linux-gnu,redhat,
>> FileSet: "Birch Set" 2007-12-22 09:56:56
>> Pool: "Full" (From Run pool override)
>> Storage: "LTO4" (From Job resource)
>> Scheduled time: 24-Aug-2008 00:05:00
>> Start time: 25-Aug-2008 11:32:24
>> End time: 29-Aug-2008 12:45:00
>> Elapsed time: 4 days 1 hour 12 mins 36 secs
>> Priority: 10
>> FD Files Written: 16,236,207
>> SD Files Written: 16,236,207
>> FD Bytes Written: 1,095,742,761,452 (1.095 TB)
>> SD Bytes Written: 1,098,729,651,969 (1.098 TB)
>> Rate: 3131.1 KB/s
>> Software Compression: None
>> VSS: no
>> Encryption: no
>> Volume name(s): 020745L4|020746L4
>> Volume Session Id: 135
>> Volume Session Time: 1217593761
>> Last Volume Bytes: 739,811,100,672 (739.8 GB)
>> Non-fatal FD errors: 0
>> SD Errors: 0
>> FD termination status: OK
>> SD termination status: OK
>> Termination: Backup OK
>>
>> i'm using bacula 2.2.6, postgres 8.2.5, spooling of data and attributes.
>>
>
> for comparison, here is another backup of a different netapp, same nfs
> parameters, more disk
> space involved, but much less files:
>
> Build OS: x86_64-unknown-linux-gnu redhat
> JobId: 1464
> Job: bioinfo.2008-09-02_01.05.15
> Backup Level: Incremental, since=2008-08-23 17:15:42
> Client: "bioinfo-fd" 2.2.6 (10Nov07)
> x86_64-unknown-linux-gnu,redhat,
> FileSet: "Bioinfo Set" 2007-12-10 08:57:04
> Pool: "Inc" (From Run pool override)
> Storage: "LTO4" (From Job resource)
> Scheduled time: 02-Sep-2008 01:05:00
> Start time: 02-Sep-2008 04:16:08
> End time: 02-Sep-2008 18:15:49
> Elapsed time: 13 hours 59 mins 41 secs
> Priority: 10
> FD Files Written: 485,955
> SD Files Written: 485,955
> FD Bytes Written: 1,591,936,914,339 (1.591 TB)
> SD Bytes Written: 1,592,005,510,500 (1.592 TB)
> Rate: 31598.0 KB/s
> Software Compression: None
> VSS: no
> Encryption: no
> Volume name(s): 000296L4|000295L4
> Volume Session Id: 8
> Volume Session Time: 1220276378
> Last Volume Bytes: 1,056,271,813,632 (1.056 TB)
> Non-fatal FD errors: 0
> SD Errors: 0
> FD termination status: OK
> SD termination status: OK
> Termination: Backup OK
That difference strongly suggests to me that a big piece of your performance
problem is inserting attributes into the catalog. I'd suggest you look into
upgrading to 2.4 with the batch insert feature enabled, which should give you
a big performance boost on inserting attributes.
--
Frank Sweetser fs at wpi.edu | For every problem, there is a solution that
WPI Senior Network Engineer | is simple, elegant, and wrong. - HL Mencken
GPG fingerprint = 6174 1257 129E 0D21 D8D4 E8A3 8E39 29E3 E2E8 8CEC
-------------------------------------------------------------------------
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/
_______________________________________________
Bacula-users mailing list
Bacula-users AT lists.sourceforge DOT net
https://lists.sourceforge.net/lists/listinfo/bacula-users
|
