Amanda-Users

Re: include problems with Amanda-2.4.4-20030428?

2003-11-25 12:15:09
Subject: Re: include problems with Amanda-2.4.4-20030428?
From: Jean-Francois Malouin <Jean-Francois.Malouin AT bic.mni.mcgill DOT ca>
To: Paul Bijnens <paul.bijnens AT xplanation DOT com>
Date: Tue, 25 Nov 2003 12:12:40 -0500
* Paul Bijnens <paul.bijnens AT xplanation DOT com> [20031125 11:04]:
> Jean-Francois Malouin wrote:
> 
> >different than yours. in /.../assembly I have a few thousands
> >of subdirs, 186 of them starts with a '1'. I just calculated
> >their total combined size: 11286948 KB or a little less than 11GB.
> >
> >OK, now look at this amanda report from last night:
> >
> >---
> >DUMP SUMMARY:
> >                                  DUMPER STATS                  TAPER 
> >                                  STATS  HOSTNAME DISK     L    ORIG-KB     
> > OUT-KB COMP% MMM:SS    KB/s 
> >MMM:SS    KB/s
> >------------------- ------------------------------------------ 
> >--------------
> >bullcalf -/nihpd1 2      44220      44220   --   29:04    25.4   0:10  
> >4308.6
> >bullcalf -embly_0 1     120160     120160   --   22:11    90.3   0:12 
> >10093.6
> >bullcalf -embly_1 0  100460112  100460112   --  277:34  6032.2 277:34  
> >6032.2
> >
> >(brought to you by Amanda version 2.4.4p1-20031120)
> >---
> >
> >I see that /..../assembly_1 was around 98GB which is actually the
> >entire content of /data/nihpd/nihpd1/data/assembly.
> >
> >The disklist for this directory:
> >
> >bullcalf /data/nihpd/nihpd1/data/assembly_1 
> >/data/nihpd/nihpd1/data/assembly {
> >include "./1*"
> >high-tar
> >} 2
> >
> >hmmm, seems to me that the include thing does not behave as intended.
> >Maybe I'm just missing something though.
> >
> >Any comments anyone? I really have to get this working asap!
> 
> 
> I would take a close look at the files in /tmp/amanda.
> There is a sendbackup.timestamp.debug file with the exact commandline
> used to perform the backup.  The gnutar command should also use
> some file "sendbackup._File_Sys.timestamp.{include|exclude}" with the
> the include or exclude list used.

I see the sendbackup._file_sys.timestamp.exclude for the other DLE
with excludes but no .include sendback file...

The relevent sendbackup file for this DLE with include stanza:

sendbackup: debug 1 pid 10655570 ruid 666 euid 666: start at Tue Nov 25 
04:41:51 2003
/opt/amanda/amanda1/libexec/sendbackup: version 2.4.4p1-20031120
  parsed request as: program `GNUTAR'
                     disk `/data/nihpd/nihpd1/data/assembly_1'
                     device `/data/nihpd/nihpd1/data/assembly'
                     level 0
                     since 1970:1:1:0:0:0
                     options `|;auth=bsd;index;'
sendbackup: try_socksize: send buffer size is 65536
sendbackup: time 0.003: stream_server: waiting for connection: 0.0.0.0.16689
sendbackup: time 0.003: stream_server: waiting for connection: 0.0.0.0.16690
sendbackup: time 0.004: stream_server: waiting for connection: 0.0.0.0.16691
sendbackup: time 0.004: waiting for connect on 16689, then 16690, then 16691
sendbackup: time 0.006: stream_accept: connection from 132.206.178.5.16515
sendbackup: time 0.007: stream_accept: connection from 132.206.178.5.16516
sendbackup: time 0.009: stream_accept: connection from 132.206.178.5.16517
sendbackup: time 0.009: got all connections
sendbackup-gnutar: time 0.010: doing level 0 dump as listed-incremental to 
/opt/amanda/amanda1/var/amanda/gnutar-lists/bullcalf_data_nihpd_nihpd1_data_assembly_1_0.new
sendbackup-gnutar: time 0.670: doing level 0 dump from date: 1970-01-01  
0:00:00 GMT
sendbackup: time 0.745: spawning /opt/amanda/amanda1/libexec/runtar in pipeline
sendbackup: argument list: gtar --create --file - --directory 
/data/nihpd/nihpd1/data/assembly --one-file-system --listed-incremental 
/opt/amanda/amanda1/var/amanda/gnutar-lists/bullcalf_data_nihpd_nihpd1_data_assembly_1_0.new
 --sparse --ignore-failed-read --totals .
sendbackup: time 0.749: started index creator: "/usr/freeware/bin/tar -tf - 
2>/dev/null | sed -e 's/^\.//'"
sendbackup-gnutar: time 0.749: /opt/amanda/amanda1/libexec/runtar: pid 10743130
sendbackup: time 16652.384: index created successfully
sendbackup: time 16652.971:  53:    size(|): Total bytes written: 102871152640 
(96GB, 5.9MB/s)
sendbackup: time 16653.951: pid 10655570 finish time Tue Nov 25 09:19:25 2003

> 
> Do they contain the correct command and include/exclude list?

as seen from the above, no.


regards,
jf

> 
> 
> 
> -- 
> Paul Bijnens, Xplanation                            Tel  +32 16 397.511
> Technologielaan 21 bus 2, B-3001 Leuven, BELGIUM    Fax  +32 16 397.512
> http://www.xplanation.com/          email:  Paul.Bijnens AT xplanation DOT com
> ***********************************************************************
> * I think I've got the hang of it now:  exit, ^D, ^C, ^\, ^Z, ^Q, F6, *
> * quit,  ZZ, :q, :q!,  M-Z, ^X^C,  logoff, logout, close, bye,  /bye, *
> * stop, end, F3, ~., ^]c, +++ ATH, disconnect, halt,  abort,  hangup, *
> * PF4, F20, ^X^X, :D::D, KJOB, F14-f-e, F8-e,  kill -1 $$,  shutdown, *
> * kill -9 1,  Alt-F4,  Ctrl-Alt-Del,  AltGr-NumLock,  Stop-A,  ...    *
> * ...  "Are you sure?"  ...   YES   ...   Phew ...   I'm out          *
> ***********************************************************************
> 

-- 
We see in what we think we fear
The clouding of our thoughts made clear