Benchmarking of Java verification tools at the software verification competition (SV-COMP)

Cordeiro, Lucas, Kroening, Daniel and Schrammel, Peter (2018) Benchmarking of Java verification tools at the software verification competition (SV-COMP). The 26th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering, Florida, USA, Monday 5 November 2018. Published in: SIGSOFT Engineering Notes. Association for Computing Machinery (Accepted)

[img] PDF - Accepted Version
Restricted to SRO admin only

Download (468kB)

Abstract

Empirical evaluation of verification tools by benchmarking is a common method in software verification research. The Competition on Software Verification (SV-COMP) aims at standardization and reproducibility of benchmarking within the software verification community on an annual basis, through comparative evaluation of fully automatic software verifiers for C programs. Building upon this success, here we describe our proposal to re-use the ecosystem developed around SV-COMP for benchmarking Java verification tools. We provide a detailed description of the rules for benchmark verification tasks, the integration of new tools into SV-COMP's benchmarking framework and also give experimental results of a benchmarking run on three state-of-the-art Java verification tools, JPF-SE, JayHorn and JBMC.

Item Type: Conference Proceedings
Additional Information: This paper is part of the JPF 2018 Java PathFinder Workshop.
Keywords: software verification, Java, benchmarking, competition
Schools and Departments: School of Engineering and Informatics > Informatics
Subjects: Q Science > QA Mathematics > QA0075 Electronic computers. Computer science > QA0076 Computer software
Q Science > QA Mathematics > QA0075 Electronic computers. Computer science
Related URLs:
Depositing User: Peter Schrammel
Date Deposited: 09 Oct 2018 10:39
Last Modified: 09 Oct 2018 10:39
URI: http://srodev.sussex.ac.uk/id/eprint/79258

View download statistics for this item

📧 Request an update