Setting up regression testing is not difficult.  Automating it is also easy.  It can be done in any environment and DOES NOT require root privs. It can be run as whatever user you choose.

After a short absence, it appears that http://regress.bacula.org is back, although I'd like to see it available over https as well.

I am not sure the regression testing is configured to accept incoming tests yet.  From last night's logs:

###

The following tests FAILED:
          1 - disk:acl-xattr-test (Failed)
          6 - disk:backup-bacula-test (Failed)
         28 - disk:estimate-test (Failed)
         77 - disk:tls-test (Failed)
Performing coverage
Submit files (using http)
   Using HTTP submit method
   Drop site:http://regress.bacula.org/submit.php?project=bacula
   Submission failed: Not a valid project.
   Uploaded: /usr/home/dan/src/Bacula7RegressionTesting-TRUNK/regress/Testing/20170308-2200/Build.xml
   Submission failed: Not a valid project.
   Uploaded: /usr/home/dan/src/Bacula7RegressionTesting-TRUNK/regress/Testing/20170308-2200/Configure.xml
   Submission failed: Not a valid project.
   Uploaded: /usr/home/dan/src/Bacula7RegressionTesting-TRUNK/regress/Testing/20170308-2200/Test.xml
   Submission failed: Not a valid project.
   Uploaded: /usr/home/dan/src/Bacula7RegressionTesting-TRUNK/regress/Testing/20170308-2200/Update.xml
   Using HTTP trigger method
   Trigger site: http://regress.bacula.org
   Dart server triggered...
   Errors occurred during submission.
End nightly-disk Thu Mar  9 04:06:33 UTC 2017
###

My own regression testing covers MySQL 5.5 and 5.6 & PostgreSQL 9.2-9.6 on FreeBSD 10.3.  I could do similar on FreeBSD 11 but ... time.

Anyone else interested in helping out the devs? This involves a little bit of initial work, but the long-term payback is great.  It is a simple way that anyone can contribute to the project.