Bacula-users

Re: [Bacula-users] Mail Server Incremental Backup size of full backup

2008-09-05 10:21:40
Subject: Re: [Bacula-users] Mail Server Incremental Backup size of full backup
From: Hemant Shah <hjrrs AT yahoo DOT com>
To: bacula-users AT lists.sourceforge DOT net, Alberto Rial <rial AT ardan DOT es>
Date: Fri, 5 Sep 2008 07:21:27 -0700 (PDT)

--- On Fri, 9/5/08, Alberto Rial <rial AT ardan DOT es> wrote:

> From: Alberto Rial <rial AT ardan DOT es>
> Subject: Re: [Bacula-users] Mail Server Incremental Backup size of full backup
> To: bacula-users AT lists.sourceforge DOT net
> Cc: "Mark Nienberg" <gmane AT tippingmar DOT com>
> Date: Friday, September 5, 2008, 1:58 AM
> <div id=yiv499279374><!DOCTYPE html PUBLIC
> "-//W3C//DTD HTML 4.01 Transitional//EN">
> <html>
> <head>
>   
> </head>
>  
> Hemant Shah escribió:
> <blockquote
>  type="cite">
>   <pre>
> --- On Wed, 9/3/08, Alberto Rial <a
> rel="nofollow"
> class="moz-txt-link-rfc2396E"
> target="_blank"
> href="mailto:rial AT ardan DOT es"><rial AT ardan DOT es></a>
> wrote:
> 
>   </pre>
>   <blockquote type="cite">
>     <pre>From: Alberto Rial <a
> rel="nofollow"
> class="moz-txt-link-rfc2396E"
> target="_blank"
> href="mailto:rial AT ardan DOT es"><rial AT ardan DOT es></a>
> Subject: Re: [Bacula-users] Mail Server Incremental Backup
> size of full backup
> To: "Mark Nienberg" <a
> rel="nofollow"
> class="moz-txt-link-rfc2396E"
> target="_blank"
> href="mailto:gmane AT tippingmar DOT com"><gmane AT tippingmar DOT com></a>
> Cc: <a rel="nofollow"
> class="moz-txt-link-abbreviated"
> target="_blank"
> href="mailto:bacula-users AT lists.sourceforge DOT net">bacula-users AT 
> lists.sourceforge DOT net</a>
> Date: Wednesday, September 3, 2008, 2:13 AM
> Mark Nienberg escribió:
>     </pre>
>     <blockquote type="cite">
>       <pre>Alberto Rial wrote:
>   
>       </pre>
>       <blockquote type="cite">
>         <pre>     I have a mail server running Debian
> 4.0 and
>         </pre>
>       </blockquote>
>     </blockquote>
>     <pre>bacula version  
>     </pre>
>     <blockquote type="cite">
>       <blockquote type="cite">
>         <pre>2.2.8-8~bpo40+1 installed from debian
> backports.
>         </pre>
>       </blockquote>
>     </blockquote>
>     <pre>The mail server runs 
>     </pre>
>     <blockquote type="cite">
>       <blockquote type="cite">
>         <pre>postfix + courier-imap and size of full
> backup
>         </pre>
>       </blockquote>
>     </blockquote>
>     <pre>it´s 108 Gb aprox.
>     </pre>
>     <blockquote type="cite">
>       <blockquote type="cite">
>         <pre>    I´ve got a lot of machines on
> the network who
>         </pre>
>       </blockquote>
>     </blockquote>
>     <pre>are been backed up 
>     </pre>
>     <blockquote type="cite">
>       <blockquote type="cite">
>         <pre>succesfully, but the mail server
> sometimes when
>         </pre>
>       </blockquote>
>     </blockquote>
>     <pre>run a incremental 
>     </pre>
>     <blockquote type="cite">
>       <blockquote type="cite">
>         <pre>backup, it´s seems to be an
> incremental but
>         </pre>
>       </blockquote>
>     </blockquote>
>     <pre>bacula copy all data like in 
>     </pre>
>     <blockquote type="cite">
>       <blockquote type="cite">
>         <pre>a full.
>     
>         </pre>
>       </blockquote>
>       <pre>If you store your mail messages in
> traditional unix
>       </pre>
>     </blockquote>
>     <pre>mbox format then any new messages 
>     </pre>
>     <blockquote type="cite">
>       <pre>or deleted messages for one user will
> change the mbox
>       </pre>
>     </blockquote>
>     <pre>file for that user and the 
>     </pre>
>     <blockquote type="cite">
>       <pre>backup will include all of that user's
> mail (since
>       </pre>
>     </blockquote>
>     <pre>it is all in one file).
>     </pre>
>     <blockquote type="cite">
>       <pre>To get true incremental backups for user
> mailboxes you
>       </pre>
>     </blockquote>
>     <pre>would need to use one of the 
>     </pre>
>     <blockquote type="cite">
>       <pre>formats that stores messages as individual
> files, like
>       </pre>
>     </blockquote>
>     <pre>Maildir.
>     </pre>
>     <blockquote type="cite">
>       <pre>Is that the problem or do you already use
> Maildir
>       </pre>
>     </blockquote>
>     <pre>format?
>     </pre>
>     <blockquote type="cite">
>       <pre>Mark Nienberg
> 
> 
> 
>       </pre>
>     </blockquote>
>    
> <pre>-------------------------------------------------------------------------
>     </pre>
>     <blockquote type="cite">
>       <pre>This SF.Net email is sponsored by the
> Moblin Your Move
>       </pre>
>     </blockquote>
>     <pre>Developer's challenge
>     </pre>
>     <blockquote type="cite">
>       <pre>Build the coolest Linux based applications
> with Moblin
>       </pre>
>     </blockquote>
>     <pre>SDK & win great prizes
>     </pre>
>     <blockquote type="cite">
>       <pre>Grand prize is a trip for two to an Open
> Source event
>       </pre>
>     </blockquote>
>     <pre>anywhere in the world
>     </pre>
>     <pre><a rel="nofollow"
> class="moz-txt-link-freetext"
> target="_blank"
> href="http://moblin-contest.org/redirect.php?banner_id=100&url=/";>http://moblin-contest.org/redirect.php?banner_id=100&url=/</a>
>     </pre>
>     <blockquote type="cite">
>      
> <pre>_______________________________________________
> Bacula-users mailing list
> <a rel="nofollow"
> class="moz-txt-link-abbreviated"
> target="_blank"
> href="mailto:Bacula-users AT lists.sourceforge DOT net">Bacula-users AT 
> lists.sourceforge DOT net</a>
> 
>       </pre>
>     </blockquote>
>     <pre><a rel="nofollow"
> class="moz-txt-link-freetext"
> target="_blank"
> href="https://lists.sourceforge.net/lists/listinfo/bacula-users";>https://lists.sourceforge.net/lists/listinfo/bacula-users</a>
>     </pre>
>     <blockquote type="cite">
>       <pre>  
>       </pre>
>     </blockquote>
>     <pre>I´m aleady using Maildir format... 
> Some of the
> incremental backups runs 
> fine (about 700 Mb of daily changes) while some of them
> (generally 
> sunday night incremental) has the same size that a full
> backup (about 
> 108 gb). If I delete this backup (Incremental with full
> size) next 
> backup size will be 108 gb, if i don´t delete it next
> backup runs fine 
> (about 700 mb).
> 
> Thanks.
> 
> 
> Alberto Rial.
> -------------------------------------------------------------------------
> This SF.Net email is sponsored by the Moblin Your Move
> Developer's challenge
> Build the coolest Linux based applications with Moblin SDK
> & win great prizes
> Grand prize is a trip for two to an Open Source event
> anywhere in the world
> <a rel="nofollow"
> class="moz-txt-link-freetext"
> target="_blank"
> href="http://moblin-contest.org/redirect.php?banner_id=100&url=/_______________________________________________";>http://moblin-contest.org/redirect.php?banner_id=100&url=/_______________________________________________</a>
> Bacula-users mailing list
> <a rel="nofollow"
> class="moz-txt-link-abbreviated"
> target="_blank"
> href="mailto:Bacula-users AT lists.sourceforge DOT net">Bacula-users AT 
> lists.sourceforge DOT net</a>
> <a rel="nofollow"
> class="moz-txt-link-freetext"
> target="_blank"
> href="https://lists.sourceforge.net/lists/listinfo/bacula-users";>https://lists.sourceforge.net/lists/listinfo/bacula-users</a>
>     </pre>
>   </blockquote>
>   <pre>
> It looks like some process that runs on Sunday changes
> ctime of the files. I had similar problem where my old
> backup system (Veritas NetBackup) and bacula were running
> together for few months and Veritas would change ctime of
> the file because it was resetting the atime of the file and
> bacula would back it up even though it did not change. Many
> of my incremental backups were the size of full backup.
> 
> 
> 
> 
> Hemant Shah
> E-mail: <a rel="nofollow"
> class="moz-txt-link-abbreviated"
> target="_blank"
> href="mailto:hjrrs AT yahoo DOT com">hjrrs AT yahoo DOT com</a>
> 
> 
> 
>       
>   </pre>
> </blockquote>
> <br>
> Mmm I was looking if some process changed ctime of files
> but i didnt
> find anything.  I The atime (access time)
> changes  becouse it´s an IMAP
> e-mail server, users access their mail from their desktops
> but it´s
> stored on mail server.  It´s not a procces on
> sunday, becouse it
> happens sometimes, take a look at a resume of backups of
> e-mail server:<br>
> Terminated Jobs:<br>
>  JobId  Level    
> Files        
> Bytes  Status  
> Finished       
> Name<br>
> ======================================================================<br>
>   4187  Incr    695,641
> 107,892,462,347 OK      
> 27-ago-08 07:04 mail<br>
>   4312  Incr    
> 16,515    411,294,291
> OK       27-ago-08 23:20
> mail<br>
>   4421  Incr    
> 17,640    410,300,655
> OK       29-ago-08 00:21
> mail<br>
>   4524  Full    698,476
> 108,204,208,184 OK      
> 31-ago-08 02:34 mail<br>
>   4533  Incr    697,872
> 108,199,519,284 OK      
> 31-ago-08 11:25 mail<br>
>   4542  Incr    187,939
> 13,029,677,742 OK      
> 01-sep-08 00:00 mail<br>
>   4668  Incr    697,746
> 108,169,211,334 OK      
> 02-sep-08 07:17 mail<br>
>   4794  Incr    698,008
> 108,197,912,954 OK      
> 03-sep-08 07:25 mail<br>
>   4919  Incr     
> 8,921    511,619,657
> OK       03-sep-08 23:21
> mail<br>
>   5028  Incr    
> 18,304    530,161,167
> OK       04-sep-08 23:21
> mail<br>
> ====<br>
> <br>
> Sometimes works fine and sometimes not. I´m lost in
> configuration :P<br>
> <br>
> <br>
>  
> </html>
> 
> </div>-------------------------------------------------------------------------
> This SF.Net email is sponsored by the Moblin Your Move
> Developer's challenge
> Build the coolest Linux based applications with Moblin SDK
> & win great prizes
> Grand prize is a trip for two to an Open Source event
> anywhere in the world
> http://moblin-contest.org/redirect.php?banner_id=100&url=/_______________________________________________
> Bacula-users mailing list
> Bacula-users AT lists.sourceforge DOT net
> https://lists.sourceforge.net/lists/listinfo/bacula-users



Which IMAP server are you using?

Do google search on "IMAP ctime" (without quotes) and you will get few
hits where users are complaining about IMAP servers changing ctime.




Hemant Shah
E-mail: hjrrs AT yahoo DOT com


      

-------------------------------------------------------------------------
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/
_______________________________________________
Bacula-users mailing list
Bacula-users AT lists.sourceforge DOT net
https://lists.sourceforge.net/lists/listinfo/bacula-users