From haptic interaction to design insight: An empirical comparison of commercial hand-tracking technology

DS 122: Proceedings of the Design Society: 24th International Conference on Engineering Design (ICED23)

Year: 2023
Editor: Kevin Otto, Boris Eisenbart, Claudia Eckert, Benoit Eynard, Dieter Krause, Josef Oehmen, Nad
Author: Cox, Christopher Michael Jason; Hicks, Ben; Gopsill, James; Snider, Chris
Series: ICED
Institution: University of Bristol
Section: Design Methods
Page(s): 1965-1974
DOI number:


Advancements in prototyping technologies – haptics and extended reality – are creating exciting new environments to enhance stakeholder and user interaction with design concepts. These interactions can now occur earlier in the design process, transforming feedback mechanisms resulting in greater and faster iterations. This is essential for bringing right-first-time products to market as quickly as possible.

While existing feedback tools, such as speak-aloud, surveys and/or questionnaires, are a useful means for capturing user feedback and reflections on interactions, there is a desire to explicitly map user feedback to their physical prototype interaction. Over the past decade, several hand-tracking tools have been developed that can, in principle, capture product user interaction.

In this paper, we explore the capability of the LeapMotion Controller, MediaPipe and Manus Prime X Haptic gloves to capture user interaction with prototypes. A broad perspective of capability is adopted, including accuracy as well as the practical aspects of knowledge, skills, and ease of use. In this study, challenges in accuracy, occlusion and data processing were elicited in the capture and translation of user interaction into design insights.

Keywords: hand tracking, haptic technology, Technology, New product development, Design process

Please sign in to your account

This site uses cookies and other tracking technologies to assist with navigation and your ability to provide feedback, analyse your use of our products and services, assist with our promotional and marketing efforts, and provide content from third parties. Privacy Policy.