Bacula-users

Re: [Bacula-users] backing up automounted FS

2016-03-31 12:54:06
Subject: Re: [Bacula-users] backing up automounted FS
From: Lloyd Brown <lloyd_brown AT byu DOT edu>
To: bacula-users AT lists.sourceforge DOT net
Date: Thu, 31 Mar 2016 10:51:52 -0600

On 03/31/2016 10:35 AM, Josh Fisher wrote:
> I see your point. Why NFS, then? Rather than hundreds of automount 
> mountpoints, a single iSCSI target could expose the user home 
> directories with a single mountpoint, assuming the NAS device supports 
> iSCSI.

Several reasons.  The problems I've been describing here are only issues
for backups, but the actual filesystems are going to be used by >900
hosts.  I suspect that any kind of block-based export like iSCSI, isn't
going to be viable.  I've seen shared-block filesystems that work for
8-10 hosts at a time, but that's about it.  I could be out-of-date on
this, but that's my last understanding.  But we're already doing NFS to
those same hosts, right now, with our old storage system, and it works
just fine.

Also, in this case, we want to rely on some of the ZFS functionality,
like lightweight snapshots, which I'm not *certain* would be available
for exported blocks.  Other cool features that we're looking at are
volume-based quotas, rather than UID/GID, and the ability to easily and
quickly throw away an entire volume, rather than having to recursively
rm the filesystem.  Some of our users don't seem to understand why
things like 250k files in one directory, or 35m files (average 7kb), are
bad, but those things slow down a recursive rm quite a lot.

I think I've got most of the scripting-based solution working, and I
will probably statically mount (not autofs mount) the volumes in
question via a pre-job script, and unmount them in a post-job script. 
And like I said, I'm happy to share them here once it's done and vetted.

If there are other NFS issues, I have yet to encounter them in my 7+
years of backing up with bacula, but I'd love to know what the concerns are.


-- 
Lloyd Brown
Systems Administrator
Fulton Supercomputing Lab
Brigham Young University
http://marylou.byu.edu


------------------------------------------------------------------------------
Transform Data into Opportunity.
Accelerate data analysis in your applications with
Intel Data Analytics Acceleration Library.
Click to learn more.
http://pubads.g.doubleclick.net/gampad/clk?id=278785471&iu=/4140
_______________________________________________
Bacula-users mailing list
Bacula-users AT lists.sourceforge DOT net
https://lists.sourceforge.net/lists/listinfo/bacula-users