The doi above is for this specific version of this dataset, which is currently the latest. Newer versions may be published in the future. For a link that will always point to the latest version, please use
doi: 10.4121/b7a321df-640a-483d-8c32-a18fe21e7204

Chen, Pei-Yu; Tielman, Myrthe; M.B. (Birna) van Riemsdijk; C.M. (Catholijn) Jonker; Heylen, Dirk (2024): Acquiring Semantic Knowledge for User Model Updates via Human-Agent Alignment Dialogues: Scenarios & Dialogues. Version 4. 4TU.ResearchData. dataset. https://doi.org/10.4121/b7a321df-640a-483d-8c32-a18fe21e7204.v4

Dataset

x choose version: version 3 - 2023-04-18 version 2 - 2023-04-17 version 1 - 2023-04-13

• Artificial Intelligence and Image Processing
• Information Systems
• Information and Computing Sciences

Alignment dialogue, Behaviour support technology, Conversational agent, Human-agent alignment, Semantic user model, Values

CC BY 4.0

RefWorks, BibTeX, Reference Manager, Endnote, DataCite, NLM, DC, CFF

by Pei-Yu Chen , Myrthe Tielman , M.B. (Birna) van Riemsdijk , C.M. (Catholijn) Jonker , Dirk Heylen

The data is the scenarios and dialogues used in the focus groups underlying the paper "Acquiring Semantic Knowledge for User Model Updates via Human-Agent Alignment Dialogues: An exploratory focus group study" by Pei-Yu Chen, Myrthe Tielman, Dirk Heylen, Catholijn Jonker, and Birna van Riemsdijk. The goal of this paper is to explore what potential users like or dislike about certain aspects of the dialogues and identify dimensions that are important for designing good alignment dialogues.

Study

We performed an exploratory focus group user study, in which we showed participants six scenarios with different variants of how we envision such alignment dialogues might look like. The scenarios and dialogues are in textual form. After they finished reading, we asked them to discuss and compare the dialogues, and then we moved on to the next scenario and discussion. The process continued until all six scenarios were discussed. For the structure of the discussion, we prepared the following questions to guide the participants:

• Which version of the dialogue do you prefer, or which part of which dialogue do you prefer? Why?
• Is there a certain part of the dialogue that you particularly like/not like? Why? How would you want to do it instead?
• Which dialogue is more ‘intelligent’, as in has more capability in providing support?
• Do you feel one dialogue is more supportive than the other?
• After which dialogue do you think the agent would be more ‘on the same page’ as you?

Data & analysis

We transcribed the focus group sessions and analyzed the transcriptions using inductive thematic analysis with the addition of triangulation with literature.

• 2023-04-13 first online

• 2024-01-23 published, posted

4TU.ResearchData

*.pdf

• Hybrid Intelligence Center (a 10-year programme funded by the Dutch Ministry of Education, Culture and Science through the Netherlands Organisation for Scientific Research).

TU Delft, Faculty of Electrical Engineering, Mathematics and Computer Science, Department of Intelligent Systems