Workshop "Human-centered design process for AI applications"

The workshop focuses on the process (including but not limited to collaboration principles, methods, and tools) for the design and development of applications and systems with AI-based technology (“AI applications”). The special focus of the workshop is “human-centered AI”, as the application of a human-centered design and development process.

Today, many applications (including industrial and consumer applications, tools, systems, software, embedded systems, firmware) contain AI-based technology. In the context of this workshop, AI-based technology means the use of machine-learning principles. Due to the limited availability of training data, machine-learning based technology introduces an uncertainty regarding the correctness and relevance of results. Moreover, the use of AI-based technologies leads to known challenges: lack of trust, bias, uncertainties, ethics, etc.

In this context, one important question for the AI and human-computer interaction (HCI) community, is whether established principles of a human-centered design (HCD) process (e.g., according to ISO 9241-210) need to be modified and/or emphasized, so that deployed applications with AI-based technology meet established usability quality criteria (e.g., effectiveness, efficiency, satisfaction). The workshop’s intent is to collect evidence from research, as well as from industrial projects, whether the HCD process requires modifications or a different emphasis, and if so, which.


Submit a position paper proposal

Prospective authors should submit their proposal through the Conference Management System

Submit your Proposal

Submit a position paper proposal

Prospective authors should submit their proposal through the Conference Management System

Submit your Proposal

The workshop focuses on the process (including but not limited to collaboration principles, methods, and tools) for the design and development of applications and systems with AI-based technology (“AI applications”). The special focus of the workshop is “human-centered AI”, as the application of a human-centered design and development process.

Today, many applications (including industrial and consumer applications, tools, systems, software, embedded systems, firmware) contain AI-based technology. In the context of this workshop, AI-based technology means the use of machine-learning principles. Due to the limited availability of training data, machine-learning based technology introduces an uncertainty regarding the correctness and relevance of results. Moreover, the use of AI-based technologies leads to known challenges: lack of trust, bias, uncertainties, ethics, etc.

In this context, one important question for the AI and human-computer interaction (HCI) community, is whether established principles of a human-centered design (HCD) process (e.g., according to ISO 9241-210) need to be modified and/or emphasized, so that deployed applications with AI-based technology meet established usability quality criteria (e.g., effectiveness, efficiency, satisfaction). The workshop’s intent is to collect evidence from research, as well as from industrial projects, whether the HCD process requires modifications or a different emphasis, and if so, which.

Guidelines for Authors

Quick Facts

Deadline for submission:
Submission open until 25 May 2021 (extended deadline)

Length of position paper:
4-9 pages as ‘Poster Extended Abstracts’ in the form of short research papers in the Springer CCIS Proceedings to be published after the Conference.
Submissions of 10-20 pages will be included in the LNCS Paper Proceedings to be published after the Conference.

Notification of review outcome:
1 June 2021

Deadline for camera-ready submission and registration: 30 June 2021 (new deadline)

If position paper should not be published in the proceedings: Please clearly add a note at the top of the submission.

This workshop organizers wish to bring together contributions from academia, research, government and industry addressing the following:

  • Based on experience of not applying a (sufficient) human-centered design and development approach for AI applications: research or industrial projects that faced challenges during the design and development process for an application with AI-based technologies, or after application launch. An HCD process (or parts of it) is identified which is envisioned to address the identified challenges (“lessons learned paper”).
  • Based on experience of applying a (sufficient) human-centered design and development approach: research or industrial projects having experienced that the use of human-centered design approach for the design and development (or parts of it) of applications with AI-based technologies have benefited the project and/or its outcome (“evidence paper”).

The submitted position papers should meet the following requirements:

  • The position paper is written in English.
  • The position paper will be peer reviewed.
  • The position paper should answer the following questions:
    • Which (human-centered design) process was applied?
    • What was the reason for selecting that process?
    • For lessons learned papers: Which challenges were faced applying that process? Which of the challenges could be addressed with an HCD process (or parts of it)? Is the envisioned HCD process different from HCD processes applied to traditional, rule-based applications, and if so, what are the differences?
    • For evidence papers: How did the project benefit from using an HCD process? Is the applied HCD process different from HCD processes applied for traditional, rule-based applications, and if so, what are the differences?

Workshop format

This workshop has a duration of 4 hours (two 2-hourly sessions with half an hour break in-between). It will be organized as a remote (on-line) workshop.

Authors are asked to present their position papers during the workshop. The presentation time will be time limited, so that there is sufficient time for discussions. The time slot per presentation is expected to be approximately 15 minutes.

The preliminary agenda of the workshop:

  • Introduction into the workshop topic
  • Presentations & discussions
  • Break
  • Presentations & discussions
  • Concluding session (summary of key learnings)

Workshop participation

Registered Conference participants who do not present a position paper during the workshop are also invited to attend.

Publication

Accepted position papers will be published in the ‘Late Breaking Work’ volumes of the proceedings to appear after the conference. If authors do not wish to have their position paper published, they should clearly add a note at the top of their submitted paper. Accepted papers of 4-9 pages will be included in the Springer CCIS "Late Breaking Work - Posters" volume as ‘Poster Extended Abstracts’ in the form of short research papers. Guidelines for the preparation of camera-ready posters are available.
Accepted papers of 10-20 pages will be included in the "HCII 2021 - Late Breaking Work - Papers" Springer LNCS Proceedings. Guidelines for the preparation of camera-ready papers are available.

Workshop organizers

  • Brian Stanton: Brian (brian.stanton@nist.gov) is a Cognitive Scientist in the Visualization and Usability Group at the National Institute of Standards and Technology where he is the lead researcher on the Artificial Intelligence User Trust project.
  • Giuliana Vitiello: Giuliana is an Associate Professor of computer science at the University of Salerno, and a Senior member of ACM SIGCHI. Her research interests fall mainly in the fields of human-computer interaction and usability engineering.
  • Helmut Degen: Helmut is a user experience specialist, working for Siemens Technology in Princeton, NJ, USA. He focuses his user experience work on design for value, efficiency, and trust.
  • Ming Qian: Ming is a multidisciplinary research scientist, working for Barnstorm Research in Boston, MA, USA.  He focuses on his AI-HCI research on text-based human-machine interactions and collaboration.

Workshop contact

Helmut Degen, helmut.degen@siemens.com

Registration Regulation

For oral presentation of your contribution at the Workshop (and inclusion of your position paper in the "Late Breaking Work" volumes of the Proceedings), you need to be registered for the Conference by 30 June 2021 (new deadline).