agentAR: Creating Augmented Reality Applications with Tool-Augmented LLM-based Autonomous Agents

agentAR: Creating Augmented Reality Applications with Tool-Augmented LLM-based Autonomous Agents

by | Sep 30, 2025 | 2025, Chenfei Zhu, Featured Publications, Jingyu Shi, Karthik Ramani, Recent Publications, Shao-Kang Hsia, Xiyun Hu, Ziyi Liu

Creating Augmented Reality (AR) applications requires expertise in both design and implementation, posing significant barriers to entry for non-expert users. While existing methods reduce some of this burden, they often fall short in flexibility or usability for...
GesPrompt: Leveraging Co-Speech Gestures to Augment LLM-Based Interaction in Virtual Reality

GesPrompt: Leveraging Co-Speech Gestures to Augment LLM-Based Interaction in Virtual Reality

by | May 14, 2025 | 2025, Dizhi Ma, Fengming He, Karthik Ramani, Karthik Ramani, Recent Publications, Shao-Kang Hsia, Xiyun Hu, Zhengzhe Zhu, Ziyi Liu

Large Language Model (LLM)-based copilots have shown great potential in Extended Reality (XR) applications. However, the user faces challenges when describing the 3D environments to the copilots due to the complexity of conveying spatial-temporal information through...