Publication at SETTA 2018

A new publication has been accepted at the SETTA 2018.

Bernhard K. Aichernig, Severin Kann and Richard Schumi: “Statistical Model Checking of Response Times for Different System Deployments“, In Dependable Software Engineering. Theories, Tools, and Applications – 4th International Symposium, SETTA 2018, Beijing, China, Sep. 4-6, 2018.Lecture Notes in Computer Science. Springer, 2018. (PDF)(doi:10.1007/978-3-319-99933-3_11)

The paper was presented at the Symposium on Dependable Software Engineering: Theories, Tools and Applications on Sep. 4-6 2018 in Beijing, China.

Abstract:

Performance testing is becoming increasingly important for interactive systems. Evaluating their performance with respect to user expectations is complex, especially for different system deployments. Various load-testing approaches and performance-simulation methods aim at such analyses.However, these techniques have certain disadvantages, like a high testing effort for load testing, and a questionable model accuracy for simulation methods. Hence, we propose a combination of both techniques. We apply statistical model checking with a learned timed model and evaluate the results on the real system with hypothesis testing. Moreover, we check the established hypotheses of a reference system on various system deployments (configurations), like different hardware or network settings, and analyse the influence on the performance. Our method is realised with a property-based testing tool that is extended with algorithms from statistical model checking. We illustrate the feasibility of our technique with an industrial case study of a web application.