I think there is no problem with scsi transport. I've checked hba-port
for errors and they are at reasonable level.
root@wros666x ~ # fcinfo hba-port -l
HBA Port WWN: 10000000c9755890
OS Device Name: /dev/cfg/c1
Manufacturer: Emulex
Model: LPe11002
Firmware Version: 2.72a2 (Z3F2.72A2)
FCode/BIOS Version: none
Type: N-port
State: online
Supported Speeds: 1Gb 2Gb 4Gb
Current Speed: 4Gb
Node WWN: 20000000c9755890
Link Error Statistics:
Link Failure Count: 0
Loss of Sync Count: 4
Loss of Signal Count: 1
Primitive Seq Protocol Error Count: 0
Invalid Tx Word Count: 12
Invalid CRC Count: 0
In my opinion problem is somewhere between these two lines :) but i
have no idea where
24-Sep 06:45 wros666x-sd JobId 64: Despooling elapsed time = 00:40:02,
Transfer rate = 35.52 M bytes/second
24-Sep 10:11 wros666x-sd JobId 64: Sending spooled attrs to the
Director. Despooling 18,974,268 bytes ...
best regards
Piotr
2008/9/25 John Drescher <drescherjm AT gmail DOT com>:
> ---------- Forwarded message ----------
> From: John Drescher <drescherjm AT gmail DOT com>
> Date: Thu, Sep 25, 2008 at 7:56 AM
> Subject: Re: [Bacula-users] Long despooling time
> To: Piotr Komborski <piotr.komborski AT gmail DOT com>
>
>
> On Thu, Sep 25, 2008 at 7:21 AM, Piotr Komborski
> <piotr.komborski AT gmail DOT com> wrote:
>> Hello all,
>>
>> I have problem with long despooling time from spool directory (stripe
>> of 2 luns from netapp filer. Write speed ~120MB/s ) to MySQL database.
>>
>> Despooling of ~80GB of data takes about 3,5 hours when backing up
>> 50000 of small files. System with storage daemon runnig is Solaris 10
>> with 2 CPUs ( 8 cores ) and 8GB of RAM
>>
>> 24-Sep 05:37 wros666x-dir JobId 64: BeforeJob: run command
>> "/opt/csw/etc/bacula/clearcase_before_backup_job.sh wros666x"
>> 24-Sep 05:38 wros666x-dir JobId 64: Start Backup JobId 64,
>> Job=vobs_backup_from_wros666x.2008-09-23_22.00.12
>> 24-Sep 05:38 wros666x-dir JobId 64: Using Device "IBM-ULTRIUM-TD4-Tape-Drive"
>> 24-Sep 05:38 wros666x-sd JobId 64: Spooling data ...
>> 24-Sep 06:04 wros666x-sd JobId 64: Job write elapsed time = 00:26:59,
>> Transfer rate = 52.66 M bytes/second
>> 24-Sep 06:04 wros666x-sd JobId 64: Committing spooled data to Volume
>> "000041". Despooling 85,339,842,775 bytes ...
>> 24-Sep 06:45 wros666x-sd JobId 64: Despooling elapsed time = 00:40:02,
>> Transfer rate = 35.52 M bytes/second
>> 24-Sep 10:11 wros666x-sd JobId 64: Sending spooled attrs to the
>> Director. Despooling 18,974,268 bytes ...
>> 24-Sep 10:12 wros666x-dir JobId 64: Bacula wros666x-dir 2.4.2
>> (26Jul08): 24-Sep-2008 10:12:05
>> Build OS: i386-pc-solaris2.10 solaris 5.10
>> JobId: 64
>> Job: vobs_backup_from_wros666x.2008-09-23_22.00.12
>> Backup Level: Full
>> Client: "wros666x-fd" 2.4.2 (26Jul08)
>> i386-pc-solaris2.10,solaris,5.10
>> FileSet: "fileset_for_vobs_backup_from_wros666x"
>> 2008-09-12 12:31:35
>> Pool: "TestPool" (From Job resource)
>> Storage: "TapeLibrary" (From Job resource)
>> Scheduled time: 23-Sep-2008 22:00:00
>> Start time: 24-Sep-2008 05:38:00
>> End time: 24-Sep-2008 10:12:05
>> Elapsed time: 4 hours 34 mins 5 secs
>> Priority: 10
>> FD Files Written: 52,356
>> SD Files Written: 52,356
>> FD Bytes Written: 85,249,865,111 (85.24 GB)
>> SD Bytes Written: 85,259,131,763 (85.25 GB)
>> Rate: 5183.9 KB/s
>> Software Compression: None
>> VSS: no
>> Storage Encryption: no
>> Volume name(s): 000041
>> Volume Session Id: 10
>> Volume Session Time: 1222091384
>> Last Volume Bytes: 534,295,028,736 (534.2 GB)
>> Non-fatal FD errors: 0
>> SD Errors: 0
>> FD termination status: OK
>> SD termination status: OK
>> Termination: Backup OK
>>
>>
>> Is there any way to speed up despooling ?
>> --
> Check your system for scsi errors. On mine for some reason at boot up
> the domain validation was failing on my scsi card so instead of
> running the tape drive at U160 speed it was running it at the lowest
> scsi speed available (I believe that was less then 5MB/s). The fix was
> to restart the scsi driver after the system booted and I get normal
> tape speeds 35 to 55MB/s despooling on a lto2 tape drive.
>
> John
>
>
>
> --
> John M. Drescher
>
> -------------------------------------------------------------------------
> This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
> Build the coolest Linux based applications with Moblin SDK & win great prizes
> Grand prize is a trip for two to an Open Source event anywhere in the world
> http://moblin-contest.org/redirect.php?banner_id=100&url=/
> _______________________________________________
> Bacula-users mailing list
> Bacula-users AT lists.sourceforge DOT net
> https://lists.sourceforge.net/lists/listinfo/bacula-users
>
--
Pozdrawiam
----------------------
Piotr Komborski
-------------------------------------------------------------------------
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/
_______________________________________________
Bacula-users mailing list
Bacula-users AT lists.sourceforge DOT net
https://lists.sourceforge.net/lists/listinfo/bacula-users
|
