Towards Design Guidelines for Natural-Language-Based Human-Multi-Robot Collaboration in Domestic Environments

Towards Design Guidelines for Natural-Language-Based Human-Multi-Robot Collaboration in Domestic Environments

by | Apr 13, 2026 | 2026, Chenfei Zhu, Shao-Kang Hsia, Xinyi Wang, Xiyun Hu, Zhengzhe Zhu, Ziyi Liu

As domestic robots become prevalent, households will involve multiple robots with different capabilities, requiring people to coordinate and collaborate with several robots daily. This demands understanding key human–multi-robot interaction that shapes human...
agentAR: Creating Augmented Reality Applications with Tool-Augmented LLM-based Autonomous Agents

agentAR: Creating Augmented Reality Applications with Tool-Augmented LLM-based Autonomous Agents

by | Sep 30, 2025 | 2025, Chenfei Zhu, Featured Publications, Jingyu Shi, Karthik Ramani, Recent Publications, Shao-Kang Hsia, Xiyun Hu, Ziyi Liu

Creating Augmented Reality (AR) applications requires expertise in both design and implementation, posing significant barriers to entry for non-expert users. While existing methods reduce some of this burden, they often fall short in flexibility or usability for...
GesPrompt: Leveraging Co-Speech Gestures to Augment LLM-Based Interaction in Virtual Reality

GesPrompt: Leveraging Co-Speech Gestures to Augment LLM-Based Interaction in Virtual Reality

by | May 14, 2025 | 2025, Dizhi Ma, Fengming He, Karthik Ramani, Karthik Ramani, Recent Publications, Shao-Kang Hsia, Xiyun Hu, Zhengzhe Zhu, Ziyi Liu

Large Language Model (LLM)-based copilots have shown great potential in Extended Reality (XR) applications. However, the user faces challenges when describing the 3D environments to the copilots due to the complexity of conveying spatial-temporal information through...