Home / Publications / An Empirical Study of the Effect of Agent Competence on User Performance and Perception

An Empirical Study of the Effect of Agent Competence on User Performance and Perception

TitleAn Empirical Study of the Effect of Agent Competence on User Performance and Perception
Publication TypeConference Paper
Year of Publication2004
AuthorsXiao J, Stasko J, Catrambone R
Conference NameProceedings ofAAMA 2004 Workshop on Embodied Conversational Agents
AbstractWe studied the role of the competence of an interface agent that helped users to learn and use a text editor. Participants in the study made a set of changes to a document with the aid of one of four interface agents. The agent would respond to participants’ spoken questions as well as make proactive suggestions using a synthesized voice. The agents varied in the quality of responses and suggestions. One group of participants could also access a help screen. Results revealed that the perceived utility of the agent was influenced by the types of errors it made, while participants' subjective impressions of the agent related to the perceptions of its embodiment. Additionally, allowing participants to choose their preferred assistance styles improved objective performance. We relate quantitative findings with qualitative interview data and discuss implications for the design and the implementation of systems with interface agents.
Posted by mickwalters on Thursday, 19 February, 2009 /

Photos

www.flickr.com