Data underlying the paper "Towards Effective Human Intervention in Algorithmic Decision-Making"
doi: 10.4121/8c19bb03-14de-4c85-b781-33eed0cac44a
This project captures perceptions of ability, benevolence, integrity and fairness towards different decision-maker configurations in algorithmic decision-making for policy enforcement. It consists of two studies. In the first study, we interview 21 participants with experience renting out their properties out as short-term rentals. Through these interviews we identify the main characteristics that interviewees considered when evaluating the appropriateness of decision-maker configurations (i.e., decision-maker profile, model type, data provenance). In the second study, we run a crowdsourced user study in Prolific with 223 participants. They were shown an illegal holiday identification scenario. Each participant was assigned to a scenario with a decision-maker configuration with varying decision-maker profile, different model types, and data provenance. The dataset includes:
- The prompts used for running the interviews
- The interview protocol
- Pre-registration of the crowdsourced study
- The materials used for designing the crowdsourced user study
- The (anonymized) data from the crowdsourced study
- The script used to analyze the crowdsourced data
- A document with all the rationales behind the statistical analysis of the crowdsourced data
- Analysis of open-ended questions of the crowdsourced study
- 2025-01-24 first online, published, posted
TU Delft, Faculty of Industrial Design Engineering, Department of Sustainable Design Engineering
TU Delft, Faculty of Electrical Engineering, Mathematics and Computer Science, Department of Software Technology
DATA
- 3,476 bytesMD5:
052af4b2ea8cf0c08334769507ad6731
README.txt - 923,315 bytesMD5:
98baf87b29aad9599a12a2c204ee18c0
ABI-Fairness.pdf - 204 bytesMD5:
085991e449e6a3fbe59203fdb32eeca6
Analysis-Script.Rproj - 80,977 bytesMD5:
2f07672c150fa77f7d6c8d2e7fc68c17
cleaned_data.xlsx - 669,390 bytesMD5:
2951009d95506e3193039d0caba5196e
Graphics.pdf - 88,196 bytesMD5:
92a9a7bee8d5644e6ff7308ba954af08
InterviewProtocol.pdf - 82,030 bytesMD5:
b527f8e50aca2ffc9c3c101af788537f
Open_Ended_Questions.pdf - 528,882 bytesMD5:
dee984ae83beb780b5d0c9fa4ccb902c
Preregistration.pdf - 408,466 bytesMD5:
d10881ea41dd4ba6688733c9816c3f05
Prompt1-Introduction.pdf - 67,716 bytesMD5:
832e4072e8c4e48beaac20d18597b489
Prompt2-Letter.pdf - 57,870 bytesMD5:
f26fd14c3c0bbf0112385fa25341d836
Prompt3-InformationSheet.pdf - 8,964 bytesMD5:
fcf5ef1564f7a4cc3b3456d2167e88f8
Script.R - 1,605,824 bytesMD5:
f48f72b07417c5994341d4f7833b4c46
Study2_material.pdf -
download all files (zip)
4,525,310 bytes unzipped