The JPetStore Suite: A concise Experiment Setup for Research

Abstract

Viable experiment suites are in high demand by scientists in software engineering and especially for software quality. In particular, easy to understand yet feature rich case studies are needed to assess approaches, methods and tools for software qualities, like performance, usability, privacy and security. Several attempts have been made to create reusable setups. Unfortunately, they focus on the software alone, without or limited documentation, workloads, and prepared deployments, harming reusability and repeatability. This hinders our research. To circumvent these limitations, we created a JPetStore based experiment suite. Our suite includes distributed and single service variants with and without instrumentation, proper workload drivers, and experiment setups. All parts are documented to support scientists creating experiments. Using our suite fosters comparability and reproducibility of research making it more influential. Furthermore, our suite can be used as blue print for more complex suites.