Property-Based Testing in the Wild!

DOI:10.4121/368f63ab-10fc-4603-a15a-bde25e72e778.v1
The DOI displayed above is for this specific version of this dataset, which is currently the latest. Newer versions may be published in the future. For a link that will always point to the latest version, please use
DOI: 10.4121/368f63ab-10fc-4603-a15a-bde25e72e778

Datacite citation style

Derbenwick, Max; Toth, Harald; de Koning, David; Barotsis, Antonios; Zhao, Ye et. al. (2025): Property-Based Testing in the Wild!. Version 1. 4TU.ResearchData. dataset. https://doi.org/10.4121/368f63ab-10fc-4603-a15a-bde25e72e778.v1
Other citation styles (APA, Harvard, MLA, Vancouver, Chicago, IEEE) available at Datacite

Dataset

This repository contains the data and analyses for research on how property-based testing (PBT) is used in open source repositories. Each directory represents a programming language and testing framework combination that was analysed:

  • QuickCheck with Haskell, by Ye Zhao,
  • jqwik with Java, by Harald Toth,
  • Hypothesis with Python, by David de Koning,
  • proptest with Rust, by Antonios Barotsis, and
  • quickcheck with Rust, by Max Derbenwick.

Each directory contains its own README file which explains the dataset in that directory.


The data was collected from open source repositories on GitHub, chosen by a combination of number of downloads and GitHub stars. It contains metadata of each repository analysed, as well as identified characteristics of each examined property-based test, obtained using open coding. The objective of this data is to understand the actual usage of property-based testing in the real world.

History

  • 2025-07-02 first online, published, posted

Publisher

4TU.ResearchData

Format

text/markdown, text/csv, text/tsv, application/vnd.openxmlformats-officedocument.spreadsheetml.sheet

Organizations

TU Delft, Faculty of Electrical Engineering, Mathematics and Computer Science, Department of Software Technology

DATA

Files (5)