jregress: open-source test-running framework

So, what is jregress?  It’s my Java-based test-running framework, used to run Open ESB regression tests, and it is now open-source.

History: at Forte we used a C++-based tool, regress, to run regression tests.  I created a Java-based work-alike that Sun uses for running regression tests.  We can run Open ESB  tests using the open-source or closed-source version.  More history at project site.

What does it do? It uses a file naming and directory structure convention to discover, run, and check-the-results-of setup, test, and tear-down scripts or programs.

How? Each test is a monitored process.  Jregress evaluates the test output, or stops the process if the test times-out.

The custom diff command ignores non-deterministic output; multiple developers can easily develop and run portable tests.

Features: Setup, test, and tear-down wrappers are shell or ant scripts, Java or scripting language programs.  Setup/tear-down scripts can start/stop processes.  Tests are independent and can use jUnit, TestNG, Selenium, etc.

Pre-reqs: “Unix” environment: Solaris, Mac OS X, Linux, Cygwin, etc.

Category: jregress

Posted by: Mike Wright on: September 11, 2008

Tags:

Open ESB scalable testing environment

virtualization plan

Working towards JBI Service Engine scalable testing

When checking out different branches from different projects using different tools, it is hard to predict which two or three builds need to run at any given time.   I’ve had to maintain nearly identical setups across multiple physical systems.

Plan: attach granular VirtualBox disks to a particular virtual machine as needed.

The benefits:

  • save energy (powering up fewer physical machines when only running a couple of builds at once)
  • “on demand” scaling (”move” work to additional physical machines by copying a relatively small disk image for each vm)
  • less entropy (cloning disks ensures identical setups)

This makes it easier to distribute test clients and servers across my network and try different WS-Notification publish/subscribe use-cases and configurations.

Category: open-esb, virtualbox

Posted by: Mike Wright on: September 10, 2008

Tags: , ,