Data underlying the paper "Towards Effective Human Intervention in Algorithmic Decision-Making"

DOI:10.4121/8c19bb03-14de-4c85-b781-33eed0cac44a.v1
The DOI displayed above is for this specific version of this dataset, which is currently the latest. Newer versions may be published in the future. For a link that will always point to the latest version, please use
DOI: 10.4121/8c19bb03-14de-4c85-b781-33eed0cac44a
Datacite citation style:
Yurrita Semperena, Mireia ; Verma, Himanshu; Balayn, Agathe; Gadiraju, Ujwal; Pont, Sylvia et. al. (2025): Data underlying the paper "Towards Effective Human Intervention in Algorithmic Decision-Making". Version 1. 4TU.ResearchData. dataset. https://doi.org/10.4121/8c19bb03-14de-4c85-b781-33eed0cac44a.v1
Other citation styles (APA, Harvard, MLA, Vancouver, Chicago, IEEE) available at Datacite

Dataset

This project captures perceptions of ability, benevolence, integrity and fairness towards different decision-maker configurations in algorithmic decision-making for policy enforcement. It consists of two studies. In the first study, we interview 21 participants with experience renting out their properties out as short-term rentals. Through these interviews we identify the main characteristics that interviewees considered when evaluating the appropriateness of decision-maker configurations (i.e., decision-maker profile, model type, data provenance). In the second study, we run a crowdsourced user study in Prolific with 223 participants. They were shown an illegal holiday identification scenario. Each participant was assigned to a scenario with a decision-maker configuration with varying decision-maker profile, different model types, and data provenance. The dataset includes:


  1. The prompts used for running the interviews
  2. The interview protocol
  3. Pre-registration of the crowdsourced study
  4. The materials used for designing the crowdsourced user study
  5. The (anonymized) data from the crowdsourced study
  6. The script used to analyze the crowdsourced data
  7. A document with all the rationales behind the statistical analysis of the crowdsourced data
  8. Analysis of open-ended questions of the crowdsourced study

History

  • 2025-01-24 first online, published, posted

Publisher

4TU.ResearchData

Format

.pdf, .xlsx, .R

Organizations

TU Delft, Faculty of Industrial Design Engineering, Department of Human-Centered Design
TU Delft, Faculty of Industrial Design Engineering, Department of Sustainable Design Engineering
TU Delft, Faculty of Electrical Engineering, Mathematics and Computer Science, Department of Software Technology

DATA

Files (13)