---------- Forwarded message ----------
From: John Drescher <drescherjm AT gmail DOT com>
Date: Thu, Sep 25, 2008 at 7:56 AM
Subject: Re: [Bacula-users] Long despooling time
To: Piotr Komborski <piotr.komborski AT gmail DOT com>
On Thu, Sep 25, 2008 at 7:21 AM, Piotr Komborski
<piotr.komborski AT gmail DOT com> wrote:
> Hello all,
>
> I have problem with long despooling time from spool directory (stripe
> of 2 luns from netapp filer. Write speed ~120MB/s ) to MySQL database.
>
> Despooling of ~80GB of data takes about 3,5 hours when backing up
> 50000 of small files. System with storage daemon runnig is Solaris 10
> with 2 CPUs ( 8 cores ) and 8GB of RAM
>
> 24-Sep 05:37 wros666x-dir JobId 64: BeforeJob: run command
> "/opt/csw/etc/bacula/clearcase_before_backup_job.sh wros666x"
> 24-Sep 05:38 wros666x-dir JobId 64: Start Backup JobId 64,
> Job=vobs_backup_from_wros666x.2008-09-23_22.00.12
> 24-Sep 05:38 wros666x-dir JobId 64: Using Device "IBM-ULTRIUM-TD4-Tape-Drive"
> 24-Sep 05:38 wros666x-sd JobId 64: Spooling data ...
> 24-Sep 06:04 wros666x-sd JobId 64: Job write elapsed time = 00:26:59,
> Transfer rate = 52.66 M bytes/second
> 24-Sep 06:04 wros666x-sd JobId 64: Committing spooled data to Volume
> "000041". Despooling 85,339,842,775 bytes ...
> 24-Sep 06:45 wros666x-sd JobId 64: Despooling elapsed time = 00:40:02,
> Transfer rate = 35.52 M bytes/second
> 24-Sep 10:11 wros666x-sd JobId 64: Sending spooled attrs to the
> Director. Despooling 18,974,268 bytes ...
> 24-Sep 10:12 wros666x-dir JobId 64: Bacula wros666x-dir 2.4.2
> (26Jul08): 24-Sep-2008 10:12:05
> Build OS: i386-pc-solaris2.10 solaris 5.10
> JobId: 64
> Job: vobs_backup_from_wros666x.2008-09-23_22.00.12
> Backup Level: Full
> Client: "wros666x-fd" 2.4.2 (26Jul08)
> i386-pc-solaris2.10,solaris,5.10
> FileSet: "fileset_for_vobs_backup_from_wros666x"
> 2008-09-12 12:31:35
> Pool: "TestPool" (From Job resource)
> Storage: "TapeLibrary" (From Job resource)
> Scheduled time: 23-Sep-2008 22:00:00
> Start time: 24-Sep-2008 05:38:00
> End time: 24-Sep-2008 10:12:05
> Elapsed time: 4 hours 34 mins 5 secs
> Priority: 10
> FD Files Written: 52,356
> SD Files Written: 52,356
> FD Bytes Written: 85,249,865,111 (85.24 GB)
> SD Bytes Written: 85,259,131,763 (85.25 GB)
> Rate: 5183.9 KB/s
> Software Compression: None
> VSS: no
> Storage Encryption: no
> Volume name(s): 000041
> Volume Session Id: 10
> Volume Session Time: 1222091384
> Last Volume Bytes: 534,295,028,736 (534.2 GB)
> Non-fatal FD errors: 0
> SD Errors: 0
> FD termination status: OK
> SD termination status: OK
> Termination: Backup OK
>
>
> Is there any way to speed up despooling ?
> --
Check your system for scsi errors. On mine for some reason at boot up
the domain validation was failing on my scsi card so instead of
running the tape drive at U160 speed it was running it at the lowest
scsi speed available (I believe that was less then 5MB/s). The fix was
to restart the scsi driver after the system booted and I get normal
tape speeds 35 to 55MB/s despooling on a lto2 tape drive.
John
--
John M. Drescher
-------------------------------------------------------------------------
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/
_______________________________________________
Bacula-users mailing list
Bacula-users AT lists.sourceforge DOT net
https://lists.sourceforge.net/lists/listinfo/bacula-users
|
