Bacula-users

Re: [Bacula-users] Client backup with compress

2016-03-24 20:24:41
Subject: Re: [Bacula-users] Client backup with compress
From: Randy Katz <rkatz AT simplicityhosting DOT com>
To: Ana Emília M. Arruda <emiliaarruda AT gmail DOT com>, "More, Ankush" <ankush.more AT capgemini DOT com>
Date: Fri, 25 Mar 2016 07:18:56 +0700
Yes, her client compilation confirmed compression for gzip and lzo...so now I would think there is an issue here. I also have one client out of around 40 that is not compressing. Dir and fd compiled from source version 7.4.0.

On March 25, 2016 5:29:20 AM GMT+07:00, "Ana Emília M. Arruda" <emiliaarruda AT gmail DOT com> wrote:
Hello Ankush,

As Heitor said in a previous post, zlib development libraries must also be installed on clients. Have you checked this? Compression is working on your bacula server (and client) for your catalog backup because the zlib development libraries are installed on the bacula director host. Sorry if you have already answered this, but I did not found in previous posts.

Best regards,
Ana

On Thu, Mar 24, 2016 at 5:45 PM, More, Ankush <ankush.more AT capgemini DOT com> wrote:

Hello Randy,

Bacula server(7.x) is installed with Linux RPM package.

Catalog backup on bacula server work with compression = GZIP option.

Job log:

Software Compression:   84.9% 6.6:1

But  clients  does not work  

Job log:

Software Compression:   None

 

 

Thank you,

Ankush More

 

From: Randy Katz [mailto:rkatz AT simplicityhosting DOT com]
Sent: Thursday, March 24, 2016 8:10 PM
To: More, Ankush
Subject: Re: [Bacula-users] Client backup with compress

 

Then the only other thing I could think of is if the director is compiled with
the gzip/lzo libraries, have you recompiled that? Should not be too hard, you don't
need that long configure line, if using mysql all you need is:

./configure --with-mysql


On 3/24/2016 6:54 AM, More, Ankush wrote:

Hi Randy,

 

Backing up are Database files which has very high compression ratio.

I have check same files with  linux command ‘gzip’ on client working fine with good compression ratio.

But Bacula does not work.

 

Thank you,

Ankush More

 

From: Randy Katz [mailto:rkatz AT simplicityhosting DOT com]
Sent: Thursday, March 24, 2016 1:18 PM
To: bacula-users AT lists.sourceforge DOT net
Subject: Re: [Bacula-users] Client backup with compress

 

Hi Ankush, are you sure the files you are backing up can be compressed? You might
want to try a separate backup on the same client of something like /usr/local /etc
just to test, these should definitely compress. Sometimes video, audio and other dense
files do not compress.

On 3/23/2016 11:44 AM, More, Ankush wrote:

Hello,

 

I re-compile client with LZO package.

Compression does not work both GZIP or LZO.

 

   Large file support:      yes

   Bacula conio support:    yes -lncurses

   readline support:        no

   TCP Wrappers support:    no

   TLS support:             yes

   Encryption support:      yes

   ZLIB support:            yes

   LZO support:             yes

   enable-smartalloc:       yes

   enable-lockmgr:          no

   bat support:             no

   client-only:             yes

   build-dird:              no

   build-stored:            no

   Plugin support:          yes

   AFS support:             no

   ACL support:             yes

   XATTR support:           yes

   systemd support:         no

   Batch insert enabled:    None

 

Thank you,

Ankush More

 

From: More, Ankush
Sent: Wednesday, March 23, 2016 8:46 PM
To: 'Heitor Faria'
Cc: compdoc AT hotrodpc DOT com; bacula-users AT lists.sourceforge DOT net
Subject: RE: [Bacula-users] Client backup with compress

 

Hello Faria,

 

Sorry for confusion , please ignore previous mail. I have re-compile the client with source which version 7.x on Linux.

Resending debug –d500 output for same.

 

Which support ZLIB, but still compression is not working.

 

ZLIB support:            yes

 

 

Thank you,

Ankush More

 

From: Heitor Faria [mailto:heitor AT bacula.com DOT br]
Sent: Wednesday, March 23, 2016 8:31 PM
To: More, Ankush
Cc: compdoc AT hotrodpc DOT com; bacula-users AT lists.sourceforge DOT net
Subject: Re: [Bacula-users] Client backup with compress

 

Hello, Akush: according to the debug you sent me this is the FileSet you are using for this job:

 

bacula-fd: job.c:273-415 Executing fileset command.
bacula-fd: job.c:753-415 I
bacula-fd: job.c:753-415 O MZ6
bacula-fd: job.c:753-415 N
bacula-fd: job.c:753-415 O e
bacula-fd: job.c:753-415 WF *.apm
bacula-fd: job.c:781-415 Set state=error or double code.
bacula-fd: job.c:753-415 N
bacula-fd: job.c:753-415 F /oracle
bacula-fd: job.c:753-415 N
bacula-fd: job.c:753-415 N
bacula-fd: job.c:753-415 E
bacula-fd: job.c:753-415 F /var/spool/bacula
bacula-fd: job.c:753-415 F /tmp
bacula-fd: job.c:753-415 F /proc
bacula-fd: job.c:753-415 F /tmp
bacula-fd: job.c:753-415 F /sys
bacula-fd: job.c:753-415 F /.journal
bacula-fd: job.c:753-415 F /.fsck
bacula-fd: job.c:753-415 N

 


From: "More, Ankush" <ankush.more AT capgemini DOT com>
To: "Heitor Faria" <heitor AT bacula.com DOT br>
Cc: compdoc AT hotrodpc DOT com, bacula-users AT lists.sourceforge DOT net
Sent: Wednesday, March 23, 2016 11:57:12 AM
Subject: RE: [Bacula-users] Client backup with compress

Hello Faria,

 

Below is DIR config file.

 

FileSet {

  Name = "chrome02 Set"

  Include {

    Options {

      signature = MD5

        compression = GZIP

    }

 

Not sure what you mean Compression=gzip in all of them.

 

Thank you,

Ankush More

 

From: Heitor Faria [mailto:heitor AT bacula.com DOT br]
Sent: Wednesday, March 23, 2016 8:14 PM
To: More, Ankush
Cc: compdoc AT hotrodpc DOT com; bacula-users AT lists.sourceforge DOT net
Subject: Re: [Bacula-users] Client backup with compress

 

Hello, Ankush:   ZLIB support:            yes

Your client is fine. It must be a FileSet configuration thing, since you seems to have multiple Options sub-resources. Just put Compression=gzip in all of them.

 

Regards,


From: "More, Ankush" <ankush.more AT capgemini DOT com>
To: compdoc AT hotrodpc DOT com, bacula-users AT lists.sourceforge DOT net
Sent: Wednesday, March 23, 2016 11:32:34 AM
Subject: Re: [Bacula-users] Client backup with compress

Hello,

 

Please see below, this is build for bacula client.

 

Configuration on Wed Mar 23 04:37:28 EDT 2016:

 

   Host:                    x86_64-unknown-linux-gnu -- redhat Enterprise release

   Bacula version:          Bacula 7.0.4 (04 June 2014)

   Source code location:    .

   Install binaries:        /usr/sbin

   Install libraries:       /usr/lib64

   Install config files:    /etc/bacula

   Scripts directory:       /usr/libexec/bacula/

   Archive directory:       /tmp

   Working directory:       /var/spool/bacula/

   PID directory:           /var/run

   Subsys directory:        /var/lock/subsys

   Man directory:           ${datarootdir}/man

   Data directory:          /usr/share

   Plugin directory:        /usr/lib64

   C Compiler:              gcc 4.1.2

   C++ Compiler:            /usr/bin/g++ 4.1.2

   Compiler flags:           -g -O2 -Wall -fno-strict-aliasing -fno-exceptions -fno-rtti

   Linker flags:

   Libraries:               -lpthread -ldl -ldl

   Statically Linked Tools: no

   Statically Linked FD:    no

   Statically Linked SD:    no

   Statically Linked DIR:   no

   Statically Linked CONS:  no

   Database backends:       None

   Database port:

   Database name:           bacula

   Database user:           bacula

 

   Job Output Email:        root@localhost

   Traceback Email:         root@localhost

   SMTP Host Address:       localhost

 

   Director Port:           9101

   File daemon Port:        9102

   Storage daemon Port:     9103

 

   Director User:

   Director Group:

   Storage Daemon User:

   Storage DaemonGroup:

   File Daemon User:

   File Daemon Group:

 

   Large file support:      yes

   Bacula conio support:    yes -lncurses

   readline support:        no

   TCP Wrappers support:    no

   TLS support:             yes

   Encryption support:      yes

   ZLIB support:            yes

   LZO support:             no

   enable-smartalloc:       yes

   enable-lockmgr:          no

   bat support:             no

   client-only:             yes

   build-dird:              no

   build-stored:            no

   Plugin support:          yes

   AFS support:             no

   ACL support:             yes

   XATTR support:           yes

   systemd support:         no

   Batch insert enabled:    None

 

Thank you,

Ankush More

 

From: compdoc [mailto:compdoc AT hotrodpc DOT com]
Sent: Wednesday, March 23, 2016 7:48 PM
To: bacula-users AT lists.sourceforge DOT net
Subject: Re: [Bacula-users] Client backup with compress

 

>#./configure --enable-client-only --enable-build-dird=no --enable-build-stored=no --bindir=/usr/bin --sbindir=/usr/sbin --with-scriptdir=/usr/libexec/bacula/ --with-working-dir=/var/spool/bacula/ --with-logdir=/var/log --enable-smartalloc

 

 

 

But where is the output from this configure? It will say if compression is available at the end. Bacula places a file named bacula_config in your scripts directory that contains the output:

 

 

Configuration on Sat Feb 13 16:32:43 MST 2016:

 

   Host:                        x86_64-unknown-linux-gnu -- ubuntu 14.04

   Bacula version:         Bacula 7.4.0 (16 January 2016)

   Source code location:     .

  Install binaries:          /sbin

   Install libraries:          /usr/lib64

   Install config files:     /etc/bacula

   Scripts directory:       /etc/bacula/scripts

   Archive directory:      /tmp

   Working directory:                    /opt/bacula/working

   PID directory:            /var/run

   Subsys directory:      /var/run/subsys

   Man directory:           ${datarootdir}/man

   Data directory:          /usr/share

   Plugin directory:        /usr/lib64

   C Compiler:                              gcc 4.8.4-2ubuntu1~14.04)

   C++ Compiler:           /usr/bin/g++ 4.8.4-2ubuntu1~14.04)

   Compiler flags:          -O2 -g -Wall -x c++ -fno-strict-aliasing -fno-exceptions -fno-rtti

   Linker flags:              

   Libraries:                                  -lpthread -ldl -ldl

   Statically Linked Tools:  no

   Statically Linked FD:     no

   Statically Linked SD:     no

   Statically Linked DIR:    no

   Statically Linked CONS:   no

   Database backends:                MySQL

   Database port:          

   Database name:        bacula

   Database user:          bacula

   Database SSL options:    

 

   Job Output Email:                    compdoc AT domain DOT com

   Traceback Email:       compdoc AT domain DOT com

   SMTP Host Address:                mail.domain.com

 

   Director Port:            9101

   File daemon Port:      9102

   Storage daemon Port:      9103

 

   Director User:           

   Director Group:        

   Storage Daemon User:     

   Storage DaemonGroup:     

   File Daemon User:                   

   File Daemon Group:                

 

   Large file support:                    yes

   Bacula conio support:     no -lreadline -ltinfo

   readline support:       yes

   TCP Wrappers support:     no

   TLS support:             yes

   Encryption support:                  yes

   ZLIB support:            yes

   LZO support:            yes

   enable-smartalloc:                    yes

   enable-lockmgr:        no

   bat support:              no

   client-only:                no

   build-dird:                                yes

   build-stored:             yes

   Plugin support:         yes

   AFS support:            no

   ACL support:            yes

   XATTR support:        yes

   systemd support:      no

   Batch insert enabled:     MySQL

This message contains information that may be privileged or confidential and is the property of the Capgemini Group. It is intended only for the person to whom it is addressed. If you are not the intended recipient, you are not authorized to read, print, retain, copy, disseminate, distribute, or use this message or any part thereof. If you receive this message in error, please notify the sender immediately and delete all copies of this message.


------------------------------------------------------------------------------
Transform Data into Opportunity.
Accelerate data analysis in your applications with
Intel Data Analytics Acceleration Library.
Click to learn more.
http://pubads.g.doubleclick.net/gampad/clk?id=278785351&iu=/4140
_______________________________________________
Bacula-users mailing list
Bacula-users AT lists.sourceforge DOT net
https://lists.sourceforge.net/lists/listinfo/bacula-users

 

--

=======================================================================
Heitor Medrado de Faria  - LPIC-III | ITIL-F |  Bacula Systems Certified Administrator II

Próximas aulas telepresencial ao-vivo - 15 de fevereiro: http://www.bacula.com.br/agenda/

Ministro treinamento e implementação in-company Bacula: http://www.bacula.com.br/in-company/

Ou assista minhas videoaulas on-line: http://www.bacula.com.br/treinamento-bacula-ed/

Site: www.bacula.com.br | Facebook: heitor.faria

========================================================================

 

 

--

=======================================================================
Heitor Medrado de Faria  - LPIC-III | ITIL-F |  Bacula Systems Certified Administrator II

Próximas aulas telepresencial ao-vivo - 15 de fevereiro: http://www.bacula.com.br/agenda/

Ministro treinamento e implementação in-company Bacula: http://www.bacula.com.br/in-company/

Ou assista minhas videoaulas on-line: http://www.bacula.com.br/treinamento-bacula-ed/

Site: www.bacula.com.br | Facebook: heitor.faria

========================================================================





------------------------------------------------------------------------------
Transform Data into Opportunity.
Accelerate data analysis in your applications with
Intel Data Analytics Acceleration Library.
Click to learn more.
http://pubads.g.doubleclick.net/gampad/clk?id=278785351&iu=/4140





_______________________________________________
Bacula-users mailing list
Bacula-users AT lists.sourceforge DOT net
https://lists.sourceforge.net/lists/listinfo/bacula-users

 

 


------------------------------------------------------------------------------
Transform Data into Opportunity.
Accelerate data analysis in your applications with
Intel Data Analytics Acceleration Library.
Click to learn more.
http://pubads.g.doubleclick.net/gampad/clk?id=278785351&iu=/4140
_______________________________________________
Bacula-users mailing list
Bacula-users AT lists.sourceforge DOT net
https://lists.sourceforge.net/lists/listinfo/bacula-users




Transform Data into Opportunity.
Accelerate data analysis in your applications with
Intel Data Analytics Acceleration Library.
Click to learn more.
http://pubads.g.doubleclick.net/gampad/clk?id=278785351&iu=/4140



Bacula-users mailing list
Bacula-users AT lists.sourceforge DOT net
https://lists.sourceforge.net/lists/listinfo/bacula-users

--
Sent from my Android device with K-9 Mail. Please excuse my brevity.
------------------------------------------------------------------------------
Transform Data into Opportunity.
Accelerate data analysis in your applications with
Intel Data Analytics Acceleration Library.
Click to learn more.
http://pubads.g.doubleclick.net/gampad/clk?id=278785351&iu=/4140
_______________________________________________
Bacula-users mailing list
Bacula-users AT lists.sourceforge DOT net
https://lists.sourceforge.net/lists/listinfo/bacula-users