Sujin Jang, Wolfgang Stuerzlinger, Satyajit Ambike, Karthik Ramani
Modeling Cumulative Arm Fatigue in Mid-Air Interaction based on Perceived Exertion and Kinetics of Arm Motion
In Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI 2017: 3328-3339), Denver, CO, May 6-11, 2017 (Acceptance Rate: 25%)

Estimating subjective fatigue based on cumulative fatigue model and biomechanical upper limb analysis in mid-air interaction. Left: sketches of mid-air pointing tasks performed in the experiments. Middle: biomechanical model of the upper limb and three-compartment muscle (TCM) model. Right: results of the leave-one-out cross-validation of the TCM model across all subject data (green-upward/downward triangles: upper/lower bound of ground-truth, blue circles: averaged ground-truth, black crosses: TCM estimates, red circles: averaged TCM estimages, orange/purple circles: averaged existing fatigue metric).

Abstract: Quantifying cumulative arm muscle fatigue is a critical factor in understanding, evaluating, and optimizing user experience during prolonged mid-air interaction. A reasonably accurate estimation of fatigue requires an estimate of an individual’s strength. However, there is no easy-to-access method to measure individual strength to accommodate inter-individual differences. Furthermore, fatigue is influenced by both psychological and physiological factors, but no current HCI model provides good estimates of cumulative subjective fatigue. We present a new, simple method to estimate the maximum shoulder torque through a mid-air pointing task, which agrees with direct strength measurements. We then introduce a cumulative fatigue model informed by subjective and biomechanical measures. We evaluate the performance of the model in estimating cumulative subjective fatigue in mid-air interaction by performing multiple cross-validations and a comparison with an existing fatigue metric. Finally, we discuss the potential of our approach for real-time evaluation of subjective fatigue as well as future challenges.

We released the fatigue model implementation and the biomechanical upper limb analysis [GitHub Link].

About Sujin Jang

Sujin Jang received his Ph.D. in August 2017 from the School of Mechanical Engineering at Purdue University. His research work in the C-Design Lab broadly involved human-computer interaction, visual analytics, and machine learning. In particular, the goal of his research aimed (i) to create natural human-computer interaction systems using the human body as an interaction input and (ii) to establish the fundamental principles when designing such novel interaction systems. His past research experience also includes computer vision, robotics, and non-linear control/estimation. He has received the Estus H. and Vashti L. Magoon Award for Teaching Excellence in 2015.  Currently, he is a staff research member at the Motorola-Lenovo Research group. [Personal Website][LinkedIn]

Posted in 2017, Karthik Ramani, Mid-air Interaction, Publications, Recent Publications, Spatial Analytics, Sujin Jang