Bacula-users

Re: [Bacula-users] Regression testing - let's get more involved

2017-03-12 11:54:15
Subject: Re: [Bacula-users] Regression testing - let's get more involved
From: Dan Langille <dan AT langille DOT org>
To: Kern Sibbald <kern AT sibbald DOT com>
Date: Sun, 12 Mar 2017 11:53:05 -0400
On Mar 9, 2017, at 11:03 AM, Kern Sibbald <kern AT sibbald DOT com> wrote:

Hello Dan,

Thank you for taking the initiative on this.  Yes, there was a brief period when there was no project defined for regression testing (Dart) after the switch from the old server to the new one.  However, it is up and working.  The project is Bacula-7.4. 

I have jails set up just for this; I just need to upgrade the regress directory and enable the cron jobs.

I would especially appreciate it if someone could test on OpenBSD, where currently there is a seg fault in the new acl-xattr code.  If all goes well, I will shortly have a fix, but I don't have a system to test it on.

I got my first proof-of-concept working with the latest source.  Over the next week, I'll enable the other jails. I'm catching up on mail today.



Best regards,
Kern

On 03/09/2017 03:12 PM, Dan Langille wrote:
Regression testing is important. With it, you can ensure that future releases work with your chosen combination of OS and DB.

Setting up regression testing is not difficult.  Automating it is also easy.  It can be done in any environment and DOES NOT require root privs. It can be run as whatever user you choose.

After a short absence, it appears that http://regress.bacula.org is back, although I'd like to see it available over https as well.

I am not sure the regression testing is configured to accept incoming tests yet.  From last night's logs:

###
The following tests FAILED:
          1 - disk:acl-xattr-test (Failed)
          6 - disk:backup-bacula-test (Failed)
         28 - disk:estimate-test (Failed)
         77 - disk:tls-test (Failed)
Performing coverage
Submit files (using http)
   Using HTTP submit method
   Drop site:http://regress.bacula.org/submit.php?project=bacula
   Submission failed: Not a valid project.
   Uploaded: /usr/home/dan/src/Bacula7RegressionTesting-TRUNK/regress/Testing/20170308-2200/Build.xml
   Submission failed: Not a valid project.
   Uploaded: /usr/home/dan/src/Bacula7RegressionTesting-TRUNK/regress/Testing/20170308-2200/Configure.xml
   Submission failed: Not a valid project.
   Uploaded: /usr/home/dan/src/Bacula7RegressionTesting-TRUNK/regress/Testing/20170308-2200/Test.xml
   Submission failed: Not a valid project.
   Uploaded: /usr/home/dan/src/Bacula7RegressionTesting-TRUNK/regress/Testing/20170308-2200/Update.xml
   Using HTTP trigger method
   Trigger site: http://regress.bacula.org
   Dart server triggered...
   Errors occurred during submission.
End nightly-disk Thu Mar  9 04:06:33 UTC 2017
###

My own regression testing covers MySQL 5.5 and 5.6 & PostgreSQL 9.2-9.6 on FreeBSD 10.3.  I could do similar on FreeBSD 11 but ... time.

Anyone else interested in helping out the devs? This involves a little bit of initial work, but the long-term payback is great.  It is a simple way that anyone can contribute to the project.

-- 
Dan Langille - BSDCan / PGCon
dan AT langille DOT org




------------------------------------------------------------------------------
Announcing the Oxford Dictionaries API! The API offers world-renowned
dictionary content that is easy and intuitive to access. Sign up for an
account today to start using our lexical data to power your apps and
projects. Get started today and enter our developer competition.
http://sdm.link/oxford


_______________________________________________
Bacula-users mailing list
Bacula-users AT lists.sourceforge DOT net
https://lists.sourceforge.net/lists/listinfo/bacula-users


------------------------------------------------------------------------------
Announcing the Oxford Dictionaries API! The API offers world-renowned
dictionary content that is easy and intuitive to access. Sign up for an
account today to start using our lexical data to power your apps and
projects. Get started today and enter our developer competition.
http://sdm.link/oxford_______________________________________________
Bacula-users mailing list
Bacula-users AT lists.sourceforge DOT net
https://lists.sourceforge.net/lists/listinfo/bacula-users

------------------------------------------------------------------------------
Announcing the Oxford Dictionaries API! The API offers world-renowned
dictionary content that is easy and intuitive to access. Sign up for an
account today to start using our lexical data to power your apps and
projects. Get started today and enter our developer competition.
http://sdm.link/oxford
_______________________________________________
Bacula-users mailing list
Bacula-users AT lists.sourceforge DOT net
https://lists.sourceforge.net/lists/listinfo/bacula-users