Publications

Antony Bartlett, Cynthia C. S. Liem, Annibale Panichella (2024). Multi-objective differential evolution in the generation of adversarial examples. Science of Computer Programming.

PDF

Annibale Panichella, Mitchell Olsthoorn (2024). Higher Fault Detection Through Novel Density Estimators in Unit Test Generation. 16th Symposium on Search-Based Software Engineering (SSBSE 2024).

PDF

Aontony Bartlett, Annibale Panichella (2024). Danger is My Middle Lane: Simulations from Real-World Dangerous Roads. 16th Symposium on Search-Based Software Engineering - New Idea and Emerging Results Track (SSBSE-NIER 2024).

PDF Project

Călin Georgescu, Mitchell Olsthoorn, Pouria Derakhshanfar, Marat Akhin, Annibale Panichella (2024). Evolutionary Generative Fuzzing for Differential Testing of the Kotlin Compiler. International Conference on the Foundations of Software Engineering (FSE).

Code Dataset

Mitchell Olsthoorn, Dimitri Stallenberg, Annibale Panichella (2024). Syntest-JavaScript: Automated Unit-Level Test Case Generation for JavaScript. The 17th Intl. Workshop on Search-Based and Fuzz Testing (SBFT).

Code

A. Sapozhnikov, M. Olsthoorn, V.V. Kovalenko, A. Panichella, P. Derakhshanfar (2024). TestSpark: IntelliJ IDEA’s Ultimate Test Generation Companion. 45hth International Conference on Software Engineering - Tool Demo Track (ICSE-Demonstration 2024).

Preprint Code Video

C. Cao, S. Schneider, N. Ferreyraa, S. Verwer, A. Panichella, R. Scandariato (2024). CATMA: Conformance Analysis Tool For Microservice Applications. 45hth International Conference on Software Engineering - Tool Demo Track (ICSE-Demonstration 2024).

Imara van Dinten, Pouria Derakhshanfar, Annibale Panichella, Andy Zaidman (2024). The Slow and The Furious? Performance Antipattern Detection in Cyber-Physical Systems. The Journal of Software and Systems (JSS).

Preprint Code Dataset Project

June Sallou, Thomas Durieux, Annibale Panichella (2024). Breaking the Silence: the Threats of Using LLMs in Software Engineering. The 46th IEEE/ACM International Conference on Software Engineering - New Ideas and Emerging Results (ICSE-NIER 2024).

Imara van Dinten, Andy Zaidman, Annibale Panichella (2023). Multi-objective Black-Box Test Case Prioritization Based on Wordnet Distances. 15th Symposium on Search-Based Software Engineering - New Idea and Emerging Results Track (SSBSE-NIER 2023).

PDF Project

Leonhard Applis, Ruben Marang, Annibale Panichella (2023). Searching for Quality: Genetic Algorithms and Metamorphic Testing for Software Engineering ML. The Genetic and Evolutionary Computation Conference (GECCO 2023).

Preprint

Annibale Panichella, Giuseppe Di Domenico (2023). A Fast Multi-objective Evolutionary Approach for Designing Large-Scale Optical Mode Sorter. The Genetic and Evolutionary Computation Conference (GECCO 2023).

Preprint Code

M.C. van Meerten, Burcu Kulahcioglu Ozkan, Annibale Panichella (2023). Evolutionary Approach for Concurrency Testing of Ripple Blockchain Consensus Algorithm. The 45th International Conference on Software Engineering (ICSE 2023) - Software Engineering in Practice (SEIP).

PDF

Leonhard Applis, Annibale Panichella (2023). HasBugs - Handpicked Haskell Bugs. Mining Software Repositories (MSR).

Dataset Source Document

Antony Bartlett, Cynthia C. S. Liem, Annibale Panichella (2023). On the Strengths of Pure Evolutionary Algorithms in Generating Adversarial Examples. The 16th Intl. Workshop on Search-Based and Fuzz Testing (SBFT).

Code

Lisette Veldkamp, Mitchell Olsthoorn, Annibale Panichella (2023). Grammar-Based Evolutionary Fuzzing for JSON-RPC APIs. The 16th Intl. Workshop on Search-Based and Fuzz Testing (SBFT).

Xavier Devroey, Alessio Gambi, Juan Pablo Galeotti, René Just, Fitsum Kifetew, Annibale Panichella, Sebastiano Panichella (2022). JUGE: An Infrastructure for Benchmarking Java Unit Test Generators. Software Testing, Verification and Reliability.

Fiorella Zampetti, Damian Tamburri, Sebastiano Panichella, Annibale Panichella, Gerardo Canfora, Massimiliano di Penta (2022). Continuous Integration and Delivery practices for Cyber- Physical systems: An interview-based study. ACM Transaction on Software Engineering and Methodology (TOSEM 2022).

Preprint Project

Pouria Derakhshanfar, Xavier Devroey, Annibale Panichella, Andy Zaidman, Arie van Deursen (2022). Generating Class-Level Integration Tests Using Call Site Information. IEEE Transactions on Software Engineering (TSE 2022).

Preprint Code

Dimitri Stallenberg, Mitchell Olsthoorn, Annibale Panichella (2022). Guess What: Test Case Generation for Javascript with Unsupervised Probabilistic Type Inference. 14th Symposium on Search-Based Software Engineering (SSBSE 2022).

Annibale Panichella, Sebastiano Panichella, Gordon Fraser, Anand Ashok Sawant, Vincent Hellendoorn (2022). Test Smells 20 Years Later: Detectability, Validity, and Reliability. Empirical Software Engineering (EMSE 2022).

Preprint

Mitchell Olsthoorn, Arie van Deursen, Annibale Panichella (2022). Guiding Automated Test Case Generation for Transaction-Reverting Statements in Smart Contracts. The 38th IEEE International Conference on Software Maintenance and Evolution (ICSME 2022).

Preprint Code

Christian Birchler, Sajad Khatiri, Pouria Derakhshanfar, Sebastiano Panichella, Annibale Panichella (2022). Single and Multi-objective Test Cases Prioritization for Self-driving Cars in Virtual Environments. ACM Transaction on Software Engineering and Methodology (TOSEM 2022).

Preprint Project

Annibale Panichella (2022). An Improved Pareto Front Modeling Algorithm for Large-scale Many-Objective Optimization. The Genetic and Evolutionary Computation Conference (GECCO 2022).

Preprint Code Dataset

Mitchell Olsthoorn, Dimitri Stallenberg, Arie van Deursen, Annibale Panichella (2022). SynTest-Solidity: Automated Test Case Generation and Fuzzing for Smart Contracts. The 44rd IEEE/ACM International Conference on Software Engineering 2022 - Tool Demonstration (ICSE-DEMO 2022).

Preprint Code

Giuseppe Di Domenico, Dror Weisman, Annibale Panichella, Dolev Roitman, Ady Arie (2022). Large scale inverse design of planar on-chip mode sorter. ACS Photonics (2022).

Preprint Code

Matthías Páll Gissurarson, Leonhard Applis, Annibale Panichella, Arie van Deursen, David Sands (2022). PropR: Property-Based Automatic Program Repair. The 44th IEEE/ACM International Conference on Software Engineering (ICSE 2022).

Leonhard Applis, Annibale Panichella, Arie van Deursen (2021). Assessing Robustness of ML-Based Program Analysis Tools using Metamorphic Program Transformations. The 36th IEEE/ACM International Conference on Automated Software Engineering - New Ideas and Emerging Results (ASE-NIER 2021).

Dimitri Stallenberg, Mitchell Olsthoorn, Annibale Panichella (2021). Improving Test Case Generation for REST APIs Through Hierarchical Clustering. The 36th IEEE/ACM International Conference on Automated Software Engineering (ASE 2021).

Mitchell Olsthoorn, Annibale Panichella (2021). Multi-objective Test Case Selection Through Linkage Learning-driven Crossover. 13th Symposium on Search-Based Software Engineering.

Mitchell Olsthoorn, Pouria Derakhshanfar, Annibale Panichella (2021). Hybrid Multi-level Crossover for Unit Test Case Generation. 13th Symposium on Search-Based Software Engineering.

Salma Messaoudi, Donghwan Shin, Annibale Panichella, Domenico Bianculli, Lionel Briand (2021). Log-based Slicing for System-level Test Cases. The ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA).

S. Vogl, S. Schweikl, G. Fraser, A. Arcuri, J. Campos, A. Panichella (2021). EvoSuite at the SBST 2021 Tool Competition. The 14th Intl. Workshop on Search-Based Software Testing.

Code Project

Annibale Panichella, Cynthia C. S. Liem (2021). What Are We Really Testing in Mutation Testing for Machine Learning? A Critical Reflection. The 43rd IEEE/ACM International Conference on Software Engineering 2021 - New Ideas and Emerging Results (ICSE-NIER).

Casper Schroder, A. van der Feltz, Annibale Panichella, Mauricio Aniche (2021). Search-Based Software Re-Modularization: A Case Study at Adyen. The 43rd International Conference on Software Engineering (ICSE 2021) - Software Engineering in Practice (SEIP).

B. Yildiz, H. Hung, J. H. Krijthe, C. C. S. Liem, M. Loog, G. Migut, F. Oliehoek, A. Panichella, P. Paweczak, S. Picek, M. de Weerdt, J. van Gemert (2021). ReproducedPaper.org: Openly teaching and structuring machine learning reproducibility. Third Workshop on Reproducible Research on Pattern Recognition.

Qianqian Zhou, Andy Zaidman, Annibale Panichella (2020). How to Kill Them All: An Exploratory Study on the Impact of Code Observability on Mutation Testing. The Journal of Software and Systems.

Preprint

Valentina Lenarduzzi, Annibale Panichella (2020). Serverless Testing: Tool Vendors' and Experts' Point of View. IEEE Software.

Annibale Panichella (2020). A Systematic Comparison of Search-Based Approaches for LDA Hyperparameter Tuning. Information and Software Technology.

Annibale Panichella, Sebastiano Panichella, Gordon Fraser, Anand Ashok Sawant, Vincent Hellendoorn (2020). Revisiting Test Smells in Automatically Generated Tests: Limitations, Pitfalls, and Opportunities. The 36th IEEE International Conference on Software Maintenance and Evolution (ICSME 2020).

Preprint Code

Devjeet Roy, Ziyi Zhang, Maggie Ma, Venera Arnaoudova, Annibale Panichella, Sebastiano Panichella, Danielle Gonzalez, Mehdi Mirakhorli (2020). DeepTC-Enhancer: Improving the Readability of Automatically Generated Tests. The 35th IEEE/ACM International Conference on Automated Software Engineering (ASE 2020).

Preprint Code

Pouria Derakhshanfar, Xavier Devroey, Andy Zaidman, Arie van Deursen, A. Panichella (2020). Good Things Come In Threes: Improving Search-based Crash Reproduction With Helper Objectives. The 35th IEEE/ACM International Conference on Automated Software Engineering (ASE 2020).

Preprint Code

Mitchell Olsthoorn, Arie van Deursen, Annibale Panichella (2020). Generating Highly-structured Input Data by Combining Search-based Testing and Grammar-based Fuzzing. The 35th IEEE/ACM International Conference on Automated Software Engineering (ASE) - New Ideas and Emerging Results (NIER) track.

Preprint Code

Pouria Derakhshanfar, Xavier Devroey, Annibale Panichella, Andy Zaidman, Arie van Deursen (2020). Botsing, a Search-based Crash Reproduction Framework for Java. The 35th IEEE/ACM International Conference on Automated Software Engineering (ASE) - Tool Demo track.

Code Project Video

Pouria Derakhshanfar, Xavier Devroey, Annibale Panichella, Andy Zaidman, Arie van Deursen (2020). Crash Reproduction Using Helper Objectives. The Genetic and Evolutionary Computation Conference (GECCO).

Project

A. Panichella, J. Campos, G. Fraser (2020). EvoSuite at the SBST 2020 Tool Competition. The 13th Intl. Workshop on Search-Based Software Testing.

Code Project

Raja Ben Abdessalem, Annibale Panichella, Shiva Nejati, Lionel Briand, Thomas Stifter (2020). Automated Repair of Feature Interaction Failures in Automated Driving Systems. The ACM SIGSOFT International Symposium on Software Testing and Analysis.

Preprint Slides Video

Carolin E. Brandt, Annibale Panichella, Andy Zaidman, Moritz Beller (2020). LogChunks: A Data Set for Build Log Analysis. Mining Software Repositories.

PDF Dataset

Cynthia C. S. Liem, Annibale Panichella (2020). Oracle Issues in Machine Learning and Where to Find Them. 8th International Workshop on Realizing Artificial Intelligence Synergies in Software Engineering (RAISE).

Preprint Video

Giovanni Grano, Christoph Laaber, Annibale Panichella, Sebastiano Panichella (2019). Testing with Fewer Resources: An Adaptive Approach to Performance-Aware Test Case Generation. IEEE Transactions on Software Engineering.

Preprint

Dimitri Michel Stallenberg, Annibale Panichella (2019). JCOMIX: A Search-Based Tool to Detect XML Injection Vulnerabilities in Web Applications. The 27th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering.

Code Video

Maria Kechagia, Xavier Devroey, Annibale Panichella, Georgios Gousios, Arie van Deursen (2019). Effective and Efficient API Misuse Detection via Exception Propagation and Search-based Testing. The ACM SIGSOFT International Symposium on Software Testing and Analysis.

Preprint Code

Annibale Panichella (2019). A Systematic Comparison of Search Algorithms for Topic Modelling - A Study on Duplicate Bug Report Identification. 11th Symposium on Search-Based Software Engineering.

Preprint Code

Annibale Panichella (2019). An Adaptive Evolutionary Algorithm based on Non-Euclidean Geometry for Many-objective Optimization. The Genetic and Evolutionary Computation Conference.

Preprint Code Dataset Slides

José Campos, Annibale Panichella, Gordon Fraser (2019). EvoSuite at the SBST 2019 Tool Competition. The 12th International Workshop on Search-Based Software Testing.

Annibale Panichella (2019). Beyond Unit-Testing in Search-based Test Case Generation: Challenges and Opportunities. The 12th International Workshop on Search-Based Software Testing.

Preprint

Sadeeq Jan, Annibale Panichella, Andrea Arcuri, Lionel Briand (2019). Search-based Multi-Vulnerability Testing of XML Injections in Web Applications. Empirical Software Engineering.

Dario Di Nucci, Annibale Panichella, Andy Zaidman, Andrea De Lucia (2018). A Test Case Prioritization Genetic Algorithm guided by the Hypervolume Indicator. IEEE Transactions on Software Engineering.

PDF Dataset

Annibale Panichella, Fitsum M. Kifetew, Paolo Tonella (2018). A Large Scale Empirical Comparison of State-of-the-art Search-based Test Case Generators. Information and Software Technology.

PDF Code Slides

Fabio Palomba, Dario Di Nucci, Anniable Panichella, Andy Zaidman, Andrea De Lucia (2018). On the Impact of Code Smells on the Energy Consumption of Mobile Applications. Information and Software Technology.

Mozhan Soltani, Annibale Panichella, Arie van Deursen (2018). Search-Based Crash Reproduction and Its Impact on Debugging. IEEE Transactions on Software Engineering.

Preprint PDF Code Dataset Project

Annibale Panichella, Fitsum M. Kifetew, Paolo Tonella (2018). Incremental Control Dependency Frontier Exploration for Many-Criteria Test Case Generation. SSBSE.

Preprint Code Slides

Mozhan Soltani, Pouria Derakhshanfar, Annibale Panichella, Xavier Devroey, Andy Zaidman, Arie van Deursen (2018). Single-objective versus Multi-Objectivized Optimization for Evolutionary Crash Reproduction. SSBSE.

Preprint

Salma Messaoudi, Annibale Panichella, Domenico Bianculli, Lionel Briand, Raimondas Sasnauskas (2018). A Search-based Approach for Accurate Identification of Log Message Formats. ICPC.

Jeroen Castelein, Mauricio Aniche, Mozhan Soltani, Annibale Panichella, Arie van Deursen (2018). Search-Based Test Data Generation for SQL Queries. ICSE.

Qianqian Zhu, Annibale Panichella, Andy Zaidman (2018). An Investigation of Compression Techniques to Speed up Mutation Testing. ICST.

R. Abdessalem, A. Panichella, S. Nejati, L. Briand, T. Stifter (2018). Testing Autonomous Cars for Feature Interaction Failures using Many-Objective Search. ASE.

Urko R. Molina, Fitsum M. Kifetew, Annibale Panichella (2018). Java Unit Testing Tool Competition - Sixth Round. SBST.

Fabio Palomba, Annibale Panichella, Andy Zaidman, Rocco Oliveto, Andrea De Lucia (2018). The Scent of a Smell: An Extensive Comparison between Textual and Structural Smells. Transactions on Software Engineering.

Moritz Beller, Georgios Gousios, Annibale Panichella, Sebastian Proksch, Sven Amann, Andy Zaidman (2018). Developer Testing in The IDE: Patterns, Beliefs, And Behavior. IEEE Transactions on Software Engineering.

Annibale Panichella, Fitsum M. Kifetew, Paolo Tonella (2018). Automated Test Case Generation as a Many-Objective Optimisation Problem with Dynamic Selection of the Targets. Transactions on Software Engineering.

Code Dataset

Sadeeq. Jan, Annibale Panichella, Andrea Arcuri, Lionel Briand (2018). Automatic Generation of Tests to Exploit XML Injection Vulnerabilities in Web Applications. Transaction on Software Engineering.

Preprint PDF

Q. Zhu, A. Panichella, A. Zaidman (2018). A Systematic Literature Review of How Mutation Testing Supports Quality Assurance Processes. Software Testing, Verification and Reliability.

Dennis Appelt, Cu D. Nguyen, Annibale Panichella, Lionel Briand (2018). A Machine Learning- Driven Evolutionary Approach for Testing Web Application Firewalls. IEEE Transaction of Reliability.

Dario Di Nucci, Fabio Palomba, Annibale Panichella, Andy Zaidman, Andrea De Lucia (2017). Lightweight Detection of Android-specific Code Smells: the aDoctor Project. 24th IEEE International Conference on Software Analysis, Evolution, and Reengineering.

Preprint PDF

Dario Di Nucci, Fabio Palomba, Andrea Prota, Annibale Panichella, Andy Zaidman, Andrea De Lucia (2017). Software-Based Energy Profiling of Android Apps: Simple, Efficient and Reliable. 24th IEEE International Conference on Software Analysis, Evolution, and Reengineering.

Preprint PDF

Qianqian Zhu, Annibale Panichella, Andy Zaidman (2017). Speeding-Up Mutation Testing via Data Compression and State Infection. 10th International Conference on Software Testing, Verification and Validation Workshops.

Preprint PDF

Annibale Panichella, Urko Molina (2017). Java Unit Testing Tool Competition - Fifth Round. 10th International Workshop on Search-Based Software Testing.

Preprint PDF

Dario Di Nucci, Fabio Palomba, Annibale Panichella, Andy Zaidman, Andrea De Lucia (2017). PETrA: a Software-Based Tool for Estimating the Energy Profile of Android Applications. 39th International Conference on Software Engineering - Companion Volume.

Preprint PDF

Mozhan Soltani, Annibale Panichella, Arie van Deursen (2017). Guided Genetic Algorithm for Automated Crash Reproduction. ICSE.

Code Project

Dennis Appelt, Annibale Panichella, Lionel Briand (2017). Automatically Repairing Web Application Firewalls Based on Successful SQL Injection Attacks. ISSRE.

PDF Slides

Annibale Panichella, Fitsum Kifetew, Paolo Tonella (2017). LIPS vs MOSA: a Replicated Empirical Study on Automated Test Case Generation. 9th International Symposium on Search-Based Software Engineering.

Preprint PDF

Annibale Panichella, Bogdan Dit, Rocco Oliveto, Massimiliano di Penta, Denys Poshyvanyk, Andrea De Lucia (2016). Parameterizing and Assembling IR-based Solutions for Software Engineering Tasks using Genetic Algorithms. 23rd IEEE International Conference on Software Analysis, Evolution, and Reengineering (SNAER).

Fabio Palomba, Dario Di Nucci, Annibale Panichella, Rocco Oliveto, Andrea De Lucia (2016). On the Diffusion of Test Smells in Automatically Generated Test Code: An Empirical Study. 9th International Workshop on Search-Based Software Testing (SBST).

Mozhan Soltani, Annibale Panichella, Arie van Deursen (2016). Evolutionary Testing for Crash Reproduction. 9th International Workshop on Search-Based Software Testing (SBST).

Code Project

M. Beller, I. Levaja, A. Panichella, G. Gousios, A. Zaidman (2016). How to Catch 'Em All: WatchDog, a Family of IDE Plug-Ins to Assess Testing. 3rd International Workshop on Software Engineering Research and Industrial Practice.

Fabio Palomba, Annibale Panichella, Rocco Oliveto, Andy Zaidman, Andrea De Lucia (2016). A Textual-based Technique for Smell Detection. 24th International Conference on Program Comprehension (ICPC).

C. Vassallo, F. Zampetti, D. Romano, M. Beller, A. Panichella, M. Di Penta, A. Zaidman (2016). Continuous Delivery Practices in a Large Financial Organization. 32nd International Conference on Software Maintenance and Evolution (ICSME).

Annibale Panichella, Carol V. Alexandru, Sebastiano Panichella, Alberto Bacchelli, Harald Gall (2016). A Search-based Training Algorithm for Cost-aware Prediction. 18th Genetic and Evolutionary Computation Conference (GECCO).

Code Dataset

Fabio Palomba, Annibale Panichella, Andy Zaidman, Rocco Oliveto, Andrea De Lucia (2016). Automatic Test Case Generation: What If Test Code Quality Matters?. International Symposium on Software Testing and Analysis (ISSTA).

Sebastiano Panichella, Annibale Panichella, Moritz Beller, Andy Zaidman, Harald C. Gall (2016). The impact of test case summaries on bug fixing performance: An empirical investigation. 38th International Conference on Software Engineering (ICSE).

G. Canfora, A. De Lucia, M. Di Penta, R. Oliveto, A. Panichella, S. Panichella (2015). Defect Prediction as a Multi-Objective Optimization Problem. STVR.

Annibale Panichella, Rocco Oliveto, Massimiliano di Penta, Andrea De Lucia (2015). Improving Multi-Objective Search Based Test Suite Optimization through Diversity Injection. TSE.

Andrea De Lucia, Massimiliano di Penta, Rocco Oliveto, Annibale Panichella, Sebastiano Panichella (2014). Labeling Source Code with Information Retrieval Methods: An Empirical Study.. EMSE.

Giovanni Capobianco, Andrea De Lucia, Rocco Oliveto, Annibale Panichella, Sebastiano Panichella (2012). Improving IR-based traceability recovery via noun-based indexing of software artifacts. JSE.

Andrea De Lucia, Massimiliano di Penta, Rocco Oliveto, Annibale Panichella, Sebastiano Panichella (2012). Applying a Smoothing Filter to Improve IR-based Traceability Recovery Processes: An Empirical Investigation.. IST.