Fitrianie, Siska; Merijn Bruijnes; Fengxiang Li; Amal Abdulrahman; Brinkman, Willem-Paul (2022): Data and analysis underlying the research into the Artificial-Social-Agent Questionnaire: Establishing the long and short questionnaire versions. Version 1. 4TU.ResearchData. dataset. https://doi.org/10.4121/19758436.v1

Dataset

x choose version: version 6 - 2024-02-29 (latest) version 5 - 2023-10-11 version 4 - 2023-09-01 version 3 - 2023-09-01 version 2 - 2022-07-26

• Artificial Intelligence and Image Processing

artificial social agent, evaluation instrument, questionnaire, user study

CC BY 4.0

RefWorks, BibTeX, Reference Manager, Endnote, DataCite, NLM, DC, CFF

by Siska Fitrianie , Merijn Bruijnes , Fengxiang Li , Amal Abdulrahman , Willem-Paul Brinkman

We present a technical report, data and analysis underlying the study on establishing the Artificial Social Agent (ASA) Questionnaire. The ASA Questionnaire is an instrument for evaluating human interaction with an ASA, resulted from multi-year efforts involving more than 100 Intelligent Virtual Agent (IVA) researchers worldwide. It has 19 measurement constructs constituted by 90 items, which capture more than 80% of the constructs identified in empirical studies published in the IVA conference 2013-2018.  This paper reports on construct validity analysis, specifically convergent and discriminant validity of initial 131 instrument items that involved 532 crowd-workers who were asked to rate human interaction with 14 different ASAs. The analysis included several factor analysis models, and resulted in the selection of 90 items for inclusion of the long version of the ASA questionnaire. In addition, a representative item of each construct or dimension was select to create a 24-item short version of the ASA questionnaire. Whereas the long version is suitable for a comprehensive evaluation of human-ASA interaction, the short version allows quick analysis and description of the interaction with the ASA. To support reporting ASA questionnaire results, we also put forward an ASA chart. The chart provides a quick overview of agent profile. 

• 2022-07-22 first online, published, posted

4TU.ResearchData

.zip, .html, .png, .xlsx, .R, .pdf, .txt and .csv

The Artificial-Social-Agent Questionnaire: Establishing the long and short questionnaire versions

• The Dutch 4TU - Humans and Technology, Pride and Prejudice project.

Department of Intelligent Systems, Delft University of Technology, Delft, the Netherlands;
Utrecht University School of Governance, Utrecht University, Utrecht, the Netherlands;
Department of Management Science and Engineering, School of Business Administration, Northestern University, Shenyang, China;