Hi Rudolf,
Thanks for the prompt reply. Please scroll down for inline comments.
On Friday, June 02, 2017 09:52:58 AM Cejka Rudolf wrote:
> Ivan Adzhubey wrote (2017/06/01):
> > b) What is the effect of MaximumFileSize option and what would be its
> > optimal value for my IBM LTO-5 SAS drives? I have used 8GB value found in
> > one of the list posts, while the documentation suggests 2GB for LTO-4.
> > But even set at 8GB this would create lots of EOF marks on a 1.5TB tape,
> > do we really need so many?
>
> Hi, I do use 16 GB. Every EOF mark means around 3 seconds delay. So if you
> have over 200 files on the tape using 8 GB, it is around 10 minutes extra
> per tape.
Searching throughout the list, I am seeing widely varying numbers quoted for
working LTO tape configurations. I guess what it means is that the parameter is
not critical. But thanks for the estimate, looks like 10GB value makes sense.
> > c) Should I try increasing the tape block size? Set it to fixed? I know
> > this
> I think that there is no reason to use fixed tape block size. On the other
> side, increasing tape block size would help, there are many discussions
> about that.
Documentation states (rather vaguely, I admit) that you only would want to set
MaximumBlockSize to use fixed block sizes:
"Maximum block size = size-in-bytes On most modern tape drives, you will not
need to specify this directive. If you do so, it will most likely be to use
fixed block sizes (see Minimum block size above)."
http://www.bacula.org/7.0.x-manuals/en/main/Storage_Daemon_Configuratio.html#SECTION001730000000000000000
I am not sure I understand what the documentation is trying to tell us but, as
others have mentioned already, whatever it was it is probably no longer true
for more recent drive models/HBAs and server hardware configurations.
One related question. Default maximum block size is actually specified as
126*512 = 64512. This is not equal neither 64KB (base 1000) nor 64K (base
1024). Do you know why it is short two 512 blocks? Should I reserve the same
amount in my maximum block size setting as well?
> > topic has been rather controversial, so any recent experience from similar
> > drives/system would be appreciated. I plan to use spooling to a dedicated
> > RAID volume, so hopefully hard drives should not be a bottleneck.
>
> Hard drives are potential bottleneck, they can not handle several write
> streams and at the same time one read stream going 150-300 MB/s. Rather
> use SSD drives.
I have seen the SSD argument brought up several times but was never able to
see any supporting benchmarks. Maybe I misunderstand something important but
how RAID volume can be a limiting factor when our 3Ware/LSI SAS RAID
controller easily provides 350 MB/sec sustained read rates (750 MB/sec peak)?
I do not plan to run concurrent spooling/despooling jobs on the same
partition, so any drop in performance due to concurrency is unlikely as well,
even though my benchmarks suggest sustained 150 MB/sec speed for concurrent
read/write on our RAID6 array.
I would love to see any numbers for recent SSD models since we do not have any
installed here and I do not want to shell out large amounts of money on
something I am not sure will give us any significant benefits.
Thanks,
Ivan
--
Ivan Adzhubey, Ph.D.
Instructor
Division of Genetics, Dept of Medicine
Brigham & Women's Hospital
Harvard Medical School
New Research Building, Room 0464C
77 Avenue Louis Pasteur
Boston, MA 02115
tel.: (617) 525-4728
fax: (617) 525-4705
web: http://genetics.bwh.harvard.edu/wiki/sunyaevlab/
The information in this e-mail is intended only for the person to whom it is
addressed. If you believe this e-mail was sent to you in error and the e-mail
contains patient information, please contact the Partners Compliance HelpLine at
http://www.partners.org/complianceline . If the e-mail was sent to you in error
but does not contain patient information, please contact the sender and properly
dispose of the e-mail.
------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
_______________________________________________
Bacula-users mailing list
Bacula-users AT lists.sourceforge DOT net
https://lists.sourceforge.net/lists/listinfo/bacula-users
|
