Computer interaction improvements have included the expanding use of natural motions and gestures to control floating graphical user interfaces. As a result, fatigue from prolonged use of the motions and gestures has become an issue.
Karthik Ramani, the Donald W. Feddersen Professor in the School of Mechanical Engineering, is part of a study to evaluate and quantify arm fatigue in a simplified framework compared to current methods.
â€œIn previous years, all the computer interaction technologies we had included something to support our limbs,â€ Ramani said. â€œBut with newer forms of interaction, there is no support. The question now is what the guidelines are to design new interfaces and interaction for such settings.â€
Technology has created mid-air interaction advancements in gaming, augmented and virtual reality applications and the use of mobile technologies using hands.
â€œPhysical ergonomics is an important design factor for mid-air interaction,â€ Ramani said. â€œIn particular, arm fatigue â€“ the so-called â€˜gorilla arm syndromeâ€™ â€“ is known to negatively impact user experience and hamper prolonged use of mid-air interfaces.â€
Results of the study will be presented Tuesday (May 9) at the Association for Computing Machinery Conference on Human Factors in Computing SystemsÂ in Denver. The event is one in a series of prestigious academic conferences in the field ofÂ humanâ€“computer interactionÂ and one of the top conferences in computer science.Â It is hosted byÂ ACMÂ SIGCHI, theÂ special interest groupÂ on computerâ€“human interaction.
Ramani, who also has a courtesy appointment in the School of Electrical and Computer Engineering, is joined in the research by Sujin Jang, a doctoral student in the School of Mechanical Engineering, and Satyajit Ambike, an assistant professor in the Department of Health and Kinesiology, as well as Wolfgang Stuerzlinger, a professor in the School of Interactive Arts and Technology at Simon Fraser University, Vancouver, Canada.
The study looked at the issue of human-computer interaction in two ways: Determining an individualâ€™s arm strength and estimating cumulative subjective fatigue levels.
Ramani said current methods to examine strength are expensive and invasive and can leave out considerations for rest. To simplify the issue, the study opted for inexpensive depth cameras, which are used in popular home video game systems to sense body motion and hand motion.
According to Jang, 24 participants were asked to grasp a dumbbell (5-pound for 20 males and 3-pound for four females) and hold their arm out horizontally for as long as they could. The camera sensors measured what their hands and arms are doing.
Using shoulder torque and endurance time, researchers were able to determine arm strength with an average error of 8.4 percent, slightly higher than the 6.2 percent recorded by current, higher-priced methods. That difference is negligible given the latterâ€™s accessibility and price tags of tens of thousands of dollars.
â€œWith a simple depth camera and a dumbbell, we are able to do as good measurements as the other methods,â€ Ramani said.
In determining cumulative subjective fatigue, the study once again looked to improve current methods, which usually register an error rate of 35 percent.
Jang said 24 subjects were shown targets on screen and asked to touch the targets as many times as possible with good accuracy for four one-minute segments, with random rest durations of 5-20 seconds between each segment. The screens were placed at shoulder- and waist-level heights for the experiment, and depth cameras were used to examine the bodyâ€™s skeleton.
He pointed out the researchers utilized a biomechanical model that includes the idea of a rest period into their estimate of the subjectâ€™s fatigue. The status of the muscle as it transitioned from rest to activation to fatigue also was considered in estimating the subjectâ€™s fatigue.
In the end, Ramani said the study was able to estimate the cumulating subjective fatigue at an improved 15 percent error rate over traditional methods.
According to Stuerzlinger, an expert on 3-D user interfaces, the â€œgorilla arm syndromeâ€ is already an issue with vertical touchscreens, making it a problem even beyond augmented and virtual reality systems.
â€œThe results of our work enable user interface designers to predict how fatiguing a specific user interface is, even before a new design is built/realized, which enables the designers to make better decisions around new, proposed 3-D user interfaces,â€ he said. â€œThis, in turn, will accelerate and lead to the development of better user interface solutions for virtual and augmented reality systems.â€
For Ambike, the studyâ€™s method of measuring strength and fatigue could have far-reaching implications for the aging population.
â€œOur inexpensive methods will potentially translate to establishing the relation between fatigue/strength and health, as well as into continuous monitoring of fatigue levels in at-risk populations,â€ he said. â€œIn this way, this technology promises to have a significant clinical impact.â€
The C Design lab will present two other papers at the conference: One in computational fabrication (https://engineering.purdue.edu/cdesign/wp/wirefab-mix-dimension-modeling-and-fabrication-for-3d-mesh-models/) and a second in collaborative design ideation (https://engineering.purdue.edu/cdesign/wp/co-3deator-a-team-first-collaborative-3d-design-ideation-tool/).
Writer: Brian L. Huchel, 765-494-2084, firstname.lastname@example.org
Sources: Karthik Ramani, 765-494-5725, email@example.com
Sujin Jang, firstname.lastname@example.org
Satyajit Ambike, 765-496-0567, email@example.com
Wolfgang Stuerzlinger, -778-782-7474, Â firstname.lastname@example.org
Note to Journalists: Purdue researchers are scheduled to present â€œModeling Cumulative Arm Fatigue in Mid-Air Interaction based on Perceived Exertion and Kinetics of Arm Motionâ€ at 4:30 p.m. PST Tuesday (May 9) at the Association for Computing Machineryâ€™s Human Factors in Computing Systems Conference in Denver, Colorado.