Zitat von Hans Thueminger <bacula AT ipf.tuwien.ac DOT at>:

> Dear Bacula Users!
>
> I'm a newbie and have been trying to configure a Bacula backup  
> solution for our Institute for two months. I'm excited of this  
> Software (thanks to the developers for that great work) and I  
> absolutely want to use it :-) At the moment, unfortunately I can't  
> use it as I would like.
>
> We have to backup a Fileserver (Windows-Server-2012, Bacula client  
> 5.2.10) with 400TB of Data with an Autochanger (IBM-TS3500) with two  
> Drives (TS1140). We operate a dedicated Backupserver (CentOS 6.4)  
> with Bacula (5.2.13) which is connectetd with a dedicated 1 GBit  
> Interface to the Fileserver. The two drives of the autochanger are  
> directly connected to a QLogic QLE2562 Dual Port Fibre Channel HBA  
> (on the backupserver). To be ensured, the drives are operated in  
> streaming mode, the backupserver has a 35TB spool area. There are  
> several filesystems connected to the fileserver:
> 3x120TB
> 4x40TB

Looks like a decent invest in hardware ;-)

> The first thing we have to do is to split the 3x120TB in 6x60TB  
> since Microsoft does not support VSS for filesystems >(64TB-8GB) not  
> even with the latest release (Server-2012-R2). This is a not  
> documented "design" and we got this information from the Microsoft  
> support team. To re-emphasize this, in Windows-Server-2012 it's not  
> a problem to create and use a filesystem >64TB but it's not possible  
> to make a backup of any file of any size in such a filesystem; not  
> even with the in the operating system included Windows-Server-Backup  
> program :-(

With up to Windows 2008 R2 the supported volume size was 16TB with  
Windows 2012 it is 64TB. Note that their are other constraints with  
VSS when used with volumes containing many files or having heavy load  
while doing snapshots. That said you should always be able to backup  
without VSS, but open files get you in trouble in this case.

> Now I'm glad to make backups and restores of files of our 4x40TB  
> Filesystems with Bacula if they are not too big (< 5TB). That works  
> fine. If they are too big (> 15TB) I always get an error after  
> creating the second or third or sometimes subsequent spoolfile  
> (Error: lib/bsock.c...). Never for the first spoolfile! I've tried  
> several spool sizes (from 500GB to 16TB) and different network  
> settings. As attachment (bacula_mailing_list_some_error_logs.txt)  
> you can find some logs, when the error occurred. What I have also  
> tried:
> - using different Networkinterfaces (at the moment an ethernet cable  
> is directly connected (no switch) between the fileserver and the  
> backupserver and this connection is used for the backups (checked  
> with netstat))
> - heartbeat: enabling on the SD (60 seconds) and  
> net.ipv4.tcp_keepalive_time also set to 60
> - AllowCompression Yes/No
> - many, many hours for trials

So you really have files with 15TB in size? What would be worth a try  
is the following:

- Increase the "maximum file size" for the tape drive. The default is  
1G and it limits how big the "blocks" on tape are between EOF markers.  
Maybe the counter per file is an int and you therefore have trouble  
with 15TB files?

- You should increase the default block size written to tape with  
"maximum block size" set to for example 2M. Warning: You could not  
read already written tapes with non matching block sizes.

- The spool area doesn't need to be that big, but really fast to  
saturate the tape drive and keep them streaming. Recommended is  
something like fast SSD or similar.

> Is there anybody out there who has a similar environment which is  
> working or can point me in the right direction? I'd behappy for  
> anyfurther questions or suggestions since at the moment I'm at a  
> loss...

We are way smaller in file size, so use the suggested as theoretical advice...

Regards

Andreas



------------------------------------------------------------------------------
Shape the Mobile Experience: Free Subscription
Software experts and developers: Be at the forefront of tech innovation.
Intel(R) Software Adrenaline delivers strategic insight and game-changing 
conversations that shape the rapidly evolving mobile landscape. Sign up now. 
http://pubads.g.doubleclick.net/gampad/clk?id=63431311&iu=/4140/ostg.clktrk
_______________________________________________
Bacula-users mailing list
Bacula-users AT lists.sourceforge DOT net
https://lists.sourceforge.net/lists/listinfo/bacula-users