TY - DATA T1 - German and Dutch Translations of the Artificial-Social-Agent Questionnaire Instrument for Evaluating Human-Agent Interactions: Final Questionnaires, Data, Analysis Code and Appendix PY - 2024/09/02 AU - Nele Albers AU - Andrea Bönsch AU - Jonathan Ehret AU - Boleslav Khodakov AU - Willem-Paul Brinkman UR - DO - 10.4121/a1457cc7-424a-4bb1-aeac-1288b5178fbe.v2 KW - Artificial social agents KW - Chatbot KW - Conversational agent KW - Robot KW - Translation KW - Evaluation instrument KW - Questionnaire KW - Validation KW - Culture KW - Virtual agents N2 -

This repository contains the Dutch and German translations of the Artificial Social Agent (ASA) Questionnaire, as well as the data, analysis code, and Appendix underlying the paper "German and Dutch Translations of the Artificial-Social-Agent Questionnaire Instrument for Evaluating Human-Agent Interactions" by Nele Albers, Andrea Bönsch, Jonathan Ehret, Boleslav A. Khodakov, and Willem-Paul Brinkman. The original English questionnaire can be found with this DOI: 10.4121/19650846.

Final Dutch and German questionnaires

We provide the final Dutch and German translations of the ASA Questionnaire in the folder "FinalQuestionnaires_Data_and_AnalysisCode/Final_Questionnaires." This includes both the short and the long versions.

Data and analysis code

Studies

After we created the Dutch and German translations through three rounds of committee translations with multiple independent translators per language, synthesized each by a translation coordinator, we performed two summative assessment studies, one per translated questionnaire. Specifically, for each language, 240 participants each rated the English items and their translations for half of the constructs/dimensions. The study for the Dutch assessment was conducted between 10 October and 14 December 2023; the German assessment study was run between 19 June and 2 July 2023. Both studies were run on the online crowdsourcing platform Prolific Academic.

The studies have been pre-registered here: https://doi.org/10.17605/OSF.IO/G3729.

The study was approved by the Human Research Ethics Committee of Delft University of Technology (Letter of Approval number: 3051).

Data

We provide:

the ratings for the English and Dutch/German questionnaire items (including attention check questions),
data on the characteristics of the participants (i.e., age, gender, highest completed education level from their Prolific profiles),
for the participants of the German assessment study, whether they indicated having German as their first language in their Prolific profiles,
free-text responses about participants' previous active and passive encounters with ASAs, and
whether participants recommended using their data for scientific purposes.

A random identifier called "rand_id" can be used to link the data files.

Chart Generators

In the folder "Chart_Generators," we provide code to visualize ASA Questionnaire scores for three different ASAs in English, two different ASAs in German, and one single ASA in Dutch or German.

For more information on the data and analysis code we provide, please refer to the README-file in the "FinalQuestionnaires_Data_and_AnalysisCode"-folder.

Appendix

This repository also contains the Appendix of our paper ("Appendix.pdf").

In case of questions, please contact Nele Albers (n.albers@tudelft.nl) or Willem-Paul Brinkman (w.p.brinkman@tudelft.nl).

----------------------

Changes in v2

In the Appendix, there was a typo in Table A9. Specifically, the mean rating for the AL construct/dimension was erroneously listed as 1.29 for the Dutch sample. It has now been corrected to 0.29.

ER -