Bacula-users

Re: [Bacula-users] Bacula Windows client using ntfs change log?

2012-08-20 08:17:02
Subject: Re: [Bacula-users] Bacula Windows client using ntfs change log?
From: James Harper <james.harper AT bendigoit.com DOT au>
To: "lst_hoe02 AT kwsoft DOT de" <lst_hoe02 AT kwsoft DOT de>, Bacula-users <bacula-users AT lists.sourceforge DOT net>
Date: Mon, 20 Aug 2012 11:55:26 +0000
> Hello List
> 
> i recently read about the NTFS change journal and its aim to support backups
> in finding files for incremental backups. Are there any plans to maybe include
> such a feature in the windows client? I suspect this would be really helpful 
> on
> bigger sized filesystems with a lot of files. Information about the NTFS
> feature can for example found here:
> http://msdn.microsoft.com/en-us/library/aa363798.aspx
> 

I've implemented this in an unsubmitted patch. The problems I found are:

. takes a bit of memory to hold the data
. it doesn't completely solve the accurate problem for any 'since' date unless 
you keep the complete log in memory rather than 'this file has changed' 
(although it would in the regular since-last-backup case)
. bacula really needs to store the FRN in the catalog, which takes extra space

Another idea I had was to cross reference the MFT vs the accurate file 
information. Enumerating the MFT isn't particularly quick, but it is orders of 
magnitude faster than actually traversing the entire filesystem looking for 
changes. If Bacula recorded the FRN and the last USN then a "is file changes?" 
would be straightforward.

I can send the patch (against 5.2.0 I think) if you would like to use it as a 
starting point.

James


------------------------------------------------------------------------------
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and 
threat landscape has changed and how IT managers can respond. Discussions 
will include endpoint security, mobile security and the latest in malware 
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
_______________________________________________
Bacula-users mailing list
Bacula-users AT lists.sourceforge DOT net
https://lists.sourceforge.net/lists/listinfo/bacula-users