Ubi Edge: Authoring Edge-Based Opportunistic Tangible User Interfaces in Augmented Reality

Ubi Edge: Authoring Edge-Based Opportunistic Tangible User Interfaces in Augmented Reality

Fengming He, Xiyun Hu, Jingyu Shi, Xun Qian, Tianyi Wang, Karthik Ramani
In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems

Edges are one of the most ubiquitous geometric features of physical objects. They provide accurate haptic feedback and easy-totrack features for camera systems, making them an ideal basis for Tangible User Interfaces (TUI) in Augmented Reality...

Pose Relation Transformer: Refine Occlusions for Human Pose Estimation

Pose Relation Transformer: Refine Occlusions for Human Pose Estimation

Hyung-gun Chi, Seung-gun Chi, Stanley Chan, Karthik Ramani

Accurately estimating the human pose is an essential task for many applications in robotics. However, existing pose estimation methods suffer from poor performance when occlusion occurs. Recent advances in NLP have been very successful in...

InstruMentAR: Auto-Generation of Augmented Reality Tutorials for Operating Digital Instruments Through Recording Embodied

InstruMentAR: Auto-Generation of Augmented Reality Tutorials for Operating Digital Instruments Through Recording Embodied

Ziyi Liu, Zhengzhe Zhu, Enze Jiang, Feichi Huang, Ana Villanueva, Tianyi Wang, Xun Qian, Karthik Ramani
In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems

Augmented Reality tutorials, which provide necessary context by directly superimposing visual guidance on the physical referent, represent an effective way of scaffolding complex instrument operations. However, current AR tutorial authoring...

LearnIoTVR: An End-to-End Virtual Reality Environment Providing Authentic Learning Experiences for Internet of Things

LearnIoTVR: An End-to-End Virtual Reality Environment Providing Authentic Learning Experiences for Internet of Things

Zhengzhe Zhu, Ziyi Liu, Youyou Zhang, Lijun Zhu, Joey Huang, Ana villanueva, Xun Qian, Kylie Peppler, Karthik Ramani
In the Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems

The rapid growth of Internet-of-Things (IoT) applications has generated interest from many industries and a need for graduates with relevant knowledge. An IoT system is comprised of spatially distributed interactions between humans and various...

Advanced modeling method for quantifying cumulative subjective fatigue in mid-air interaction

Advanced modeling method for quantifying cumulative subjective fatigue in mid-air interaction

Ana Villanueva, Sujin Jang, Wolfgang Stuerzlinger, Satyajit Ambike, Karthik Ramani
International Journal of Human-Computer Studies 169 (2023): 102931

Interaction in mid-air can be fatiguing. A model-based method to quantify cumulative subjective fatigue for such interaction was recently introduced in HCI research. This model separates muscle units into three states: active (MA) fatigued (MF) or...