2022
Muhammad Raza; Derek Reilly; Joseph Malloch
Active Visualization of Visual Cues on the Hand for Better User Interface Design Generalization in Mixed Reality Proceedings Article
In: Proceedings of the 5th IEEE International Conference on Artificial Intelligence & Virtual Reality (AIVR 2022), Late-Breaking Work, pp. 149–152, IEEE, 2022.
Links | BibTeX | Tags: continuous interaction, embodied interaction, feedforward, mixed reality, natural user interface
@inproceedings{Raza2022,
title = {Active Visualization of Visual Cues on the Hand for Better User Interface Design Generalization in Mixed Reality},
author = {Muhammad Raza and Derek Reilly and Joseph Malloch},
doi = {10.1109/AIVR56993.2022.00030},
year = {2022},
date = {2022-12-12},
urldate = {2022-12-12},
booktitle = {Proceedings of the 5th IEEE International Conference on Artificial Intelligence & Virtual Reality (AIVR 2022), Late-Breaking Work},
pages = {149--152},
publisher = {IEEE},
keywords = {continuous interaction, embodied interaction, feedforward, mixed reality, natural user interface},
pubstate = {published},
tppubtype = {inproceedings}
}
2017
Joseph Malloch; Carla Griggio; Joanna McGrenere; Wendy E. Mackay
Fieldward and Pathward: Dynamic Guides for Defining your own Gestures Conference
Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems (CHI 2017), ACM Denver, USA, 2017.
Abstract | Links | BibTeX | Tags: dynamic guides, feedforward, gesture, mobile, progressive feedforward
@conference{Malloch2017_CHI,
title = {Fieldward and Pathward: Dynamic Guides for Defining your own Gestures},
author = {Joseph Malloch and Carla Griggio and Joanna McGrenere and Wendy E. Mackay},
doi = {10.1145/3025453.3025764},
year = {2017},
date = {2017-05-06},
booktitle = {Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems (CHI 2017)},
address = {Denver, USA},
organization = {ACM},
abstract = {Although users accomplish ever more tasks on touch-enabled mobile devices, gesture-based interaction remains limited and almost never customizable by users. Our goal is to help users create gestures that are both personally memorable and reliably recognized by a touch-enabled mobile device. We address these competing requirements with two dynamic guides that use progressive feedforward to interactively visualize the "negative space" of unused gestures: the Pathward technique suggests four possible completions to the current gesture, and the Fieldward technique uses color gradients to reveal optimal directions for creating recognizable gestures. We ran a two-part experiment in which 27 participants each created 42 personal gesture shortcuts on a smartphone, using Pathward, Fieldward or No Feedforward. The Fieldward technique best supported the most common user strategy, i.e. to create a memorable gesture first and then adapt it to be recognized by the system. Users preferred the Fieldward technique to Pathward or No Feedforward, and remembered gestures more easily when using the technique. Dynamic guides can help developers design novel gesture vocabularies and support users as they design custom gestures for mobile applications.},
keywords = {dynamic guides, feedforward, gesture, mobile, progressive feedforward},
pubstate = {published},
tppubtype = {conference}
}
Although users accomplish ever more tasks on touch-enabled mobile devices, gesture-based interaction remains limited and almost never customizable by users. Our goal is to help users create gestures that are both personally memorable and reliably recognized by a touch-enabled mobile device. We address these competing requirements with two dynamic guides that use progressive feedforward to interactively visualize the "negative space" of unused gestures: the Pathward technique suggests four possible completions to the current gesture, and the Fieldward technique uses color gradients to reveal optimal directions for creating recognizable gestures. We ran a two-part experiment in which 27 participants each created 42 personal gesture shortcuts on a smartphone, using Pathward, Fieldward or No Feedforward. The Fieldward technique best supported the most common user strategy, i.e. to create a memorable gesture first and then adapt it to be recognized by the system. Users preferred the Fieldward technique to Pathward or No Feedforward, and remembered gestures more easily when using the technique. Dynamic guides can help developers design novel gesture vocabularies and support users as they design custom gestures for mobile applications.