Publications

Antony Bartlett, Cynthia C. S. Liem, Annibale Panichella (2024). Multi-objective differential evolution in the generation of adversarial examples. Science of Computer Programming.

Annibale Panichella, Mitchell Olsthoorn (2024). Higher Fault Detection Through Novel Density Estimators in Unit Test Generation. 16th Symposium on Search-Based Software Engineering (SSBSE 2024).

Aontony Bartlett, Annibale Panichella (2024). Danger is My Middle Lane: Simulations from Real-World Dangerous Roads. 16th Symposium on Search-Based Software Engineering - New Idea and Emerging Results Track (SSBSE-NIER 2024).

Călin Georgescu, Mitchell Olsthoorn, Pouria Derakhshanfar, Marat Akhin, Annibale Panichella (2024). Evolutionary Generative Fuzzing for Differential Testing of the Kotlin Compiler. International Conference on the Foundations of Software Engineering (FSE).

Mitchell Olsthoorn, Dimitri Stallenberg, Annibale Panichella (2024). Syntest-JavaScript: Automated Unit-Level Test Case Generation for JavaScript. The 17th Intl. Workshop on Search-Based and Fuzz Testing (SBFT).

A. Sapozhnikov, M. Olsthoorn, V.V. Kovalenko, A. Panichella, P. Derakhshanfar (2024). TestSpark: IntelliJ IDEA’s Ultimate Test Generation Companion. 45hth International Conference on Software Engineering - Tool Demo Track (ICSE-Demonstration 2024).

Preprint Code Video

C. Cao, S. Schneider, N. Ferreyraa, S. Verwer, A. Panichella, R. Scandariato (2024). CATMA: Conformance Analysis Tool For Microservice Applications. 45hth International Conference on Software Engineering - Tool Demo Track (ICSE-Demonstration 2024).

Imara van Dinten, Pouria Derakhshanfar, Annibale Panichella, Andy Zaidman (2024). The Slow and The Furious? Performance Antipattern Detection in Cyber-Physical Systems. The Journal of Software and Systems (JSS).

Preprint Code Dataset Project

June Sallou, Thomas Durieux, Annibale Panichella (2024). Breaking the Silence: the Threats of Using LLMs in Software Engineering. The 46th IEEE/ACM International Conference on Software Engineering - New Ideas and Emerging Results (ICSE-NIER 2024).

Imara van Dinten, Andy Zaidman, Annibale Panichella (2023). Multi-objective Black-Box Test Case Prioritization Based on Wordnet Distances. 15th Symposium on Search-Based Software Engineering - New Idea and Emerging Results Track (SSBSE-NIER 2023).

Leonhard Applis, Ruben Marang, Annibale Panichella (2023). Searching for Quality: Genetic Algorithms and Metamorphic Testing for Software Engineering ML. The Genetic and Evolutionary Computation Conference (GECCO 2023).

Annibale Panichella, Giuseppe Di Domenico (2023). A Fast Multi-objective Evolutionary Approach for Designing Large-Scale Optical Mode Sorter. The Genetic and Evolutionary Computation Conference (GECCO 2023).

M.C. van Meerten, Burcu Kulahcioglu Ozkan, Annibale Panichella (2023). Evolutionary Approach for Concurrency Testing of Ripple Blockchain Consensus Algorithm. The 45th International Conference on Software Engineering (ICSE 2023) - Software Engineering in Practice (SEIP).

Leonhard Applis, Annibale Panichella (2023). HasBugs - Handpicked Haskell Bugs. Mining Software Repositories (MSR).

Dataset Source Document

Antony Bartlett, Cynthia C. S. Liem, Annibale Panichella (2023). On the Strengths of Pure Evolutionary Algorithms in Generating Adversarial Examples. The 16th Intl. Workshop on Search-Based and Fuzz Testing (SBFT).

Lisette Veldkamp, Mitchell Olsthoorn, Annibale Panichella (2023). Grammar-Based Evolutionary Fuzzing for JSON-RPC APIs. The 16th Intl. Workshop on Search-Based and Fuzz Testing (SBFT).

Xavier Devroey, Alessio Gambi, Juan Pablo Galeotti, René Just, Fitsum Kifetew, Annibale Panichella, Sebastiano Panichella (2022). JUGE: An Infrastructure for Benchmarking Java Unit Test Generators. Software Testing, Verification and Reliability.

Fiorella Zampetti, Damian Tamburri, Sebastiano Panichella, Annibale Panichella, Gerardo Canfora, Massimiliano di Penta (2022). Continuous Integration and Delivery practices for Cyber- Physical systems: An interview-based study. ACM Transaction on Software Engineering and Methodology (TOSEM 2022).

Preprint Project

Pouria Derakhshanfar, Xavier Devroey, Annibale Panichella, Andy Zaidman, Arie van Deursen (2022). Generating Class-Level Integration Tests Using Call Site Information. IEEE Transactions on Software Engineering (TSE 2022).

Dimitri Stallenberg, Mitchell Olsthoorn, Annibale Panichella (2022). Guess What: Test Case Generation for Javascript with Unsupervised Probabilistic Type Inference. 14th Symposium on Search-Based Software Engineering (SSBSE 2022).

Annibale Panichella, Sebastiano Panichella, Gordon Fraser, Anand Ashok Sawant, Vincent Hellendoorn (2022). Test Smells 20 Years Later: Detectability, Validity, and Reliability. Empirical Software Engineering (EMSE 2022).

Mitchell Olsthoorn, Arie van Deursen, Annibale Panichella (2022). Guiding Automated Test Case Generation for Transaction-Reverting Statements in Smart Contracts. The 38th IEEE International Conference on Software Maintenance and Evolution (ICSME 2022).

Christian Birchler, Sajad Khatiri, Pouria Derakhshanfar, Sebastiano Panichella, Annibale Panichella (2022). Single and Multi-objective Test Cases Prioritization for Self-driving Cars in Virtual Environments. ACM Transaction on Software Engineering and Methodology (TOSEM 2022).

Preprint Project

Annibale Panichella (2022). An Improved Pareto Front Modeling Algorithm for Large-scale Many-Objective Optimization. The Genetic and Evolutionary Computation Conference (GECCO 2022).

Preprint Code Dataset

Mitchell Olsthoorn, Dimitri Stallenberg, Arie van Deursen, Annibale Panichella (2022). SynTest-Solidity: Automated Test Case Generation and Fuzzing for Smart Contracts. The 44rd IEEE/ACM International Conference on Software Engineering 2022 - Tool Demonstration (ICSE-DEMO 2022).

Giuseppe Di Domenico, Dror Weisman, Annibale Panichella, Dolev Roitman, Ady Arie (2022). Large scale inverse design of planar on-chip mode sorter. ACS Photonics (2022).

Matthías Páll Gissurarson, Leonhard Applis, Annibale Panichella, Arie van Deursen, David Sands (2022). PropR: Property-Based Automatic Program Repair. The 44th IEEE/ACM International Conference on Software Engineering (ICSE 2022).

Leonhard Applis, Annibale Panichella, Arie van Deursen (2021). Assessing Robustness of ML-Based Program Analysis Tools using Metamorphic Program Transformations. The 36th IEEE/ACM International Conference on Automated Software Engineering - New Ideas and Emerging Results (ASE-NIER 2021).

Dimitri Stallenberg, Mitchell Olsthoorn, Annibale Panichella (2021). Improving Test Case Generation for REST APIs Through Hierarchical Clustering. The 36th IEEE/ACM International Conference on Automated Software Engineering (ASE 2021).

Mitchell Olsthoorn, Annibale Panichella (2021). Multi-objective Test Case Selection Through Linkage Learning-driven Crossover. 13th Symposium on Search-Based Software Engineering.

Mitchell Olsthoorn, Pouria Derakhshanfar, Annibale Panichella (2021). Hybrid Multi-level Crossover for Unit Test Case Generation. 13th Symposium on Search-Based Software Engineering.

Salma Messaoudi, Donghwan Shin, Annibale Panichella, Domenico Bianculli, Lionel Briand (2021). Log-based Slicing for System-level Test Cases. The ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA).

S. Vogl, S. Schweikl, G. Fraser, A. Arcuri, J. Campos, A. Panichella (2021). EvoSuite at the SBST 2021 Tool Competition. The 14th Intl. Workshop on Search-Based Software Testing.

Annibale Panichella, Cynthia C. S. Liem (2021). What Are We Really Testing in Mutation Testing for Machine Learning? A Critical Reflection. The 43rd IEEE/ACM International Conference on Software Engineering 2021 - New Ideas and Emerging Results (ICSE-NIER).

Casper Schroder, A. van der Feltz, Annibale Panichella, Mauricio Aniche (2021). Search-Based Software Re-Modularization: A Case Study at Adyen. The 43rd International Conference on Software Engineering (ICSE 2021) - Software Engineering in Practice (SEIP).

B. Yildiz, H. Hung, J. H. Krijthe, C. C. S. Liem, M. Loog, G. Migut, F. Oliehoek, A. Panichella, P. Paweczak, S. Picek, M. de Weerdt, J. van Gemert (2021). ReproducedPaper.org: Openly teaching and structuring machine learning reproducibility. Third Workshop on Reproducible Research on Pattern Recognition.

Qianqian Zhou, Andy Zaidman, Annibale Panichella (2020). How to Kill Them All: An Exploratory Study on the Impact of Code Observability on Mutation Testing. The Journal of Software and Systems.

Valentina Lenarduzzi, Annibale Panichella (2020). Serverless Testing: Tool Vendors' and Experts' Point of View. IEEE Software.

Annibale Panichella (2020). A Systematic Comparison of Search-Based Approaches for LDA Hyperparameter Tuning. Information and Software Technology.

Annibale Panichella, Sebastiano Panichella, Gordon Fraser, Anand Ashok Sawant, Vincent Hellendoorn (2020). Revisiting Test Smells in Automatically Generated Tests: Limitations, Pitfalls, and Opportunities. The 36th IEEE International Conference on Software Maintenance and Evolution (ICSME 2020).

Devjeet Roy, Ziyi Zhang, Maggie Ma, Venera Arnaoudova, Annibale Panichella, Sebastiano Panichella, Danielle Gonzalez, Mehdi Mirakhorli (2020). DeepTC-Enhancer: Improving the Readability of Automatically Generated Tests. The 35th IEEE/ACM International Conference on Automated Software Engineering (ASE 2020).

Pouria Derakhshanfar, Xavier Devroey, Andy Zaidman, Arie van Deursen, A. Panichella (2020). Good Things Come In Threes: Improving Search-based Crash Reproduction With Helper Objectives. The 35th IEEE/ACM International Conference on Automated Software Engineering (ASE 2020).

Mitchell Olsthoorn, Arie van Deursen, Annibale Panichella (2020). Generating Highly-structured Input Data by Combining Search-based Testing and Grammar-based Fuzzing. The 35th IEEE/ACM International Conference on Automated Software Engineering (ASE) - New Ideas and Emerging Results (NIER) track.

Pouria Derakhshanfar, Xavier Devroey, Annibale Panichella, Andy Zaidman, Arie van Deursen (2020). Botsing, a Search-based Crash Reproduction Framework for Java. The 35th IEEE/ACM International Conference on Automated Software Engineering (ASE) - Tool Demo track.

Pouria Derakhshanfar, Xavier Devroey, Annibale Panichella, Andy Zaidman, Arie van Deursen (2020). Crash Reproduction Using Helper Objectives. The Genetic and Evolutionary Computation Conference (GECCO).

A. Panichella, J. Campos, G. Fraser (2020). EvoSuite at the SBST 2020 Tool Competition. The 13th Intl. Workshop on Search-Based Software Testing.

Raja Ben Abdessalem, Annibale Panichella, Shiva Nejati, Lionel Briand, Thomas Stifter (2020). Automated Repair of Feature Interaction Failures in Automated Driving Systems. The ACM SIGSOFT International Symposium on Software Testing and Analysis.

Preprint Slides Video

Carolin E. Brandt, Annibale Panichella, Andy Zaidman, Moritz Beller (2020). LogChunks: A Data Set for Build Log Analysis. Mining Software Repositories.

Giovanni Grano, Christoph Laaber, Annibale Panichella, Sebastiano Panichella (2019). Testing with Fewer Resources: An Adaptive Approach to Performance-Aware Test Case Generation. IEEE Transactions on Software Engineering.

Dimitri Michel Stallenberg, Annibale Panichella (2019). JCOMIX: A Search-Based Tool to Detect XML Injection Vulnerabilities in Web Applications. The 27th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering.

Maria Kechagia, Xavier Devroey, Annibale Panichella, Georgios Gousios, Arie van Deursen (2019). Effective and Efficient API Misuse Detection via Exception Propagation and Search-based Testing. The ACM SIGSOFT International Symposium on Software Testing and Analysis.

Annibale Panichella (2019). A Systematic Comparison of Search Algorithms for Topic Modelling - A Study on Duplicate Bug Report Identification. 11th Symposium on Search-Based Software Engineering.

Annibale Panichella (2019). An Adaptive Evolutionary Algorithm based on Non-Euclidean Geometry for Many-objective Optimization. The Genetic and Evolutionary Computation Conference.

Preprint Code Dataset Slides

José Campos, Annibale Panichella, Gordon Fraser (2019). EvoSuite at the SBST 2019 Tool Competition. The 12th International Workshop on Search-Based Software Testing.

Annibale Panichella (2019). Beyond Unit-Testing in Search-based Test Case Generation: Challenges and Opportunities. The 12th International Workshop on Search-Based Software Testing.

Sadeeq Jan, Annibale Panichella, Andrea Arcuri, Lionel Briand (2019). Search-based Multi-Vulnerability Testing of XML Injections in Web Applications. Empirical Software Engineering.

Dario Di Nucci, Annibale Panichella, Andy Zaidman, Andrea De Lucia (2018). A Test Case Prioritization Genetic Algorithm guided by the Hypervolume Indicator. IEEE Transactions on Software Engineering.

Annibale Panichella, Fitsum M. Kifetew, Paolo Tonella (2018). A Large Scale Empirical Comparison of State-of-the-art Search-based Test Case Generators. Information and Software Technology.

PDF Code Slides

Fabio Palomba, Dario Di Nucci, Anniable Panichella, Andy Zaidman, Andrea De Lucia (2018). On the Impact of Code Smells on the Energy Consumption of Mobile Applications. Information and Software Technology.

Mozhan Soltani, Annibale Panichella, Arie van Deursen (2018). Search-Based Crash Reproduction and Its Impact on Debugging. IEEE Transactions on Software Engineering.

Preprint PDF Code Dataset Project

Annibale Panichella, Fitsum M. Kifetew, Paolo Tonella (2018). Incremental Control Dependency Frontier Exploration for Many-Criteria Test Case Generation. SSBSE.

Preprint Code Slides

Mozhan Soltani, Pouria Derakhshanfar, Annibale Panichella, Xavier Devroey, Andy Zaidman, Arie van Deursen (2018). Single-objective versus Multi-Objectivized Optimization for Evolutionary Crash Reproduction. SSBSE.

Salma Messaoudi, Annibale Panichella, Domenico Bianculli, Lionel Briand, Raimondas Sasnauskas (2018). A Search-based Approach for Accurate Identification of Log Message Formats. ICPC.

Jeroen Castelein, Mauricio Aniche, Mozhan Soltani, Annibale Panichella, Arie van Deursen (2018). Search-Based Test Data Generation for SQL Queries. ICSE.

Qianqian Zhu, Annibale Panichella, Andy Zaidman (2018). An Investigation of Compression Techniques to Speed up Mutation Testing. ICST.

R. Abdessalem, A. Panichella, S. Nejati, L. Briand, T. Stifter (2018). Testing Autonomous Cars for Feature Interaction Failures using Many-Objective Search. ASE.

Urko R. Molina, Fitsum M. Kifetew, Annibale Panichella (2018). Java Unit Testing Tool Competition - Sixth Round. SBST.

Fabio Palomba, Annibale Panichella, Andy Zaidman, Rocco Oliveto, Andrea De Lucia (2018). The Scent of a Smell: An Extensive Comparison between Textual and Structural Smells. Transactions on Software Engineering.

Moritz Beller, Georgios Gousios, Annibale Panichella, Sebastian Proksch, Sven Amann, Andy Zaidman (2018). Developer Testing in The IDE: Patterns, Beliefs, And Behavior. IEEE Transactions on Software Engineering.

Annibale Panichella, Fitsum M. Kifetew, Paolo Tonella (2018). Automated Test Case Generation as a Many-Objective Optimisation Problem with Dynamic Selection of the Targets. Transactions on Software Engineering.

Sadeeq. Jan, Annibale Panichella, Andrea Arcuri, Lionel Briand (2018). Automatic Generation of Tests to Exploit XML Injection Vulnerabilities in Web Applications. Transaction on Software Engineering.

Q. Zhu, A. Panichella, A. Zaidman (2018). A Systematic Literature Review of How Mutation Testing Supports Quality Assurance Processes. Software Testing, Verification and Reliability.

Dennis Appelt, Cu D. Nguyen, Annibale Panichella, Lionel Briand (2018). A Machine Learning- Driven Evolutionary Approach for Testing Web Application Firewalls. IEEE Transaction of Reliability.