agentAR: Creating Augmented Reality Applications with Tool-Augmented LLM-based Autonomous Agents

by Chenfei Zhu | Sep 30, 2025 | 2025, Chenfei Zhu, Featured Publications, Jingyu Shi, Karthik Ramani, Recent Publications, Shao-Kang Hsia, Xiyun Hu, Ziyi Liu

Creating Augmented Reality (AR) applications requires expertise in both design and implementation, posing significant barriers to entry for non-expert users. While existing methods reduce some of this burden, they often fall short in flexibility or usability for...

GesPrompt: Leveraging Co-Speech Gestures to Augment LLM-Based Interaction in Virtual Reality

by Xiyun Hu | May 14, 2025 | 2025, Dizhi Ma, Fengming He, Karthik Ramani, Karthik Ramani, Recent Publications, Shao-Kang Hsia, Xiyun Hu, Zhengzhe Zhu, Ziyi Liu

Large Language Model (LLM)-based copilots have shown great potential in Extended Reality (XR) applications. However, the user faces challenges when describing the 3D environments to the copilots due to the complexity of conveying spatial-temporal information through...

Virtual Reality in Manufacturing Education: A Scoping Review Indicating State-of-the-Art, Benefits, and Challenges Across Domains, Levels, and Entities

by Ananya Ipsita | Mar 25, 2025 | 2025, Ananya Ipsita, Karthik Ramani, Runlin Duan, Ziyi Liu

To address the shortage of a skilled workforce in the U.S. manufacturing industry, immersive Virtual Reality (VR)-based training solutions hold promising potential. To effectively utilize VR to meet workforce demands, it is important to understand the role of VR in...

avaTTAR: Table Tennis Stroke Training with On-body and Detached Visualization in Augmented Reality

by Dizhi Ma | Sep 16, 2024 | 2024, Dizhi Ma, Featured Publications, Jingyu Shi, Karthik Ramani, Karthik Ramani, Rahul Jain, Recent Publications, Xiyun Hu, Zhengzhe Zhu, Ziyi Liu

Table tennis stroke training is a critical aspect of player development. We designed a new augmented reality (AR) system, avaTTAR, for table tennis stroke training. The system provides both “on-body” (first-person view) and “detached”...

ClassMeta: Designing Interactive Virtual Classmate to Promote VR Classroom Participation

by Ziyi Liu | May 11, 2024 | 2024, Featured Publications, Karthik Ramani, Karthik Ramani, Publications, Recent Publications, Xiyun Hu, Zhengzhe Zhu, Ziyi Liu

Peer influence plays a crucial role in promoting classroom participation, where behaviors from active students can contribute to a collective classroom learning experience. However, the presence of these active students depends on several conditions and is not...

InstruMentAR: Auto-Generation of Augmented Reality Tutorials for Operating Digital Instruments Through Recording Embodied

by Ziyi Liu | Feb 24, 2023 | 2023, Ana Villanueva, Featured Publications, Karthik Ramani, Publications, Recent Publications, Tianyi Wang, Xun Qian, Zhengzhe Zhu, Ziyi Liu

Augmented Reality tutorials, which provide necessary context by directly superimposing visual guidance on the physical referent, represent an effective way of scaffolding complex instrument operations. However, current AR tutorial authoring processes are not seamless...