Multi-objective Black-Box Test Case Prioritization Based on Wordnet Distances

Type
Publication
15th Symposium on Search-Based Software Engineering - New Idea and Emerging Results Track (SSBSE-NIER 2023)

Abstract

Test case prioritization techniques have emerged as effective strategies to optimize this process and mitigate the regression testing costs. Commonly, black-box heuristics guide optimal test ordering, leveraging information retrieval (e.g., cosine distance) to measure the test case distance and sort them accordingly. However, a challenge arises when dealing with tests of varying granularity levels, as they may employ distinct vocabularies (e.g., name identifiers). In this paper, we propose to measure the distance between test cases based on the shortest path between their identifiers within the WordNet lexical database. This additional heuristic is combined with the traditional cosine distance to prioritize test cases in a multi-objective fashion. Our preliminary study conducted with two different Java projects shows that test cases prioritized with WordNet achieve larger fault detection capability (APFD) compared to the traditional cosine distance used in the literature.

Annibale Panichella
Annibale Panichella
Associate Professor in Software Engineering

My research interests include software testing, SE for AI, SE for blockchain, and cyber-physical systems