GesPrompt: Leveraging Co-Speech Gestures to Augment LLM-Based Interaction in Virtual Reality

GesPrompt: Leveraging Co-Speech Gestures to Augment LLM-Based Interaction in Virtual Reality

Xiyun Hu, Dizhi Ma, Fengming He, Zhengzhe Zhu, Shao-Kang Hsia, Chenfei Zhu, Ziyi Liu, Karthik Ramani
In Proceedings of the 2025 ACM Designing Interactive Systems Conference

Large Language Model (LLM)-based copilots have shown great potential in Extended Reality (XR) applications. However, the user faces challenges when describing the 3D environments to the copilots due to the complexity of conveying spatial-temporal...

Adopting Backward Design into a Constructionist Curriculum Design for IoT Skill Development in High Schoolers

Adopting Backward Design into a Constructionist Curriculum Design for IoT Skill Development in High Schoolers

Ananya Ipsita, Terrell Kendall Glenn, Disha Ajay Bhagwat, Nielsen Pereira, Kylie A Peppler, Karthik Ramani
In Proceedings of the Extended Abstracts of the CHI Conference on Human Factors in Computing Systems, pp. 1-8. 2025.

Despite the growing demand for experienced Internet of Things (IoT) professionals across industrial establishments, most secondary education institutions do not offer a curriculum to empower students’ knowledge and skills in IoT. Enrichment...

Transparent Barriers: Natural Language Access Control Policies for XR-Enhanced Everyday Objects

Transparent Barriers: Natural Language Access Control Policies for XR-Enhanced Everyday Objects

Kentaro Taninaka, Rahul Jain, Jingyu Shi, Kazunori Takashio, Karthik Ramani
In Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems

Extended Reality (XR)-enabled headsets that overlay digital content onto the physical world, are gradually finding their way into our daily life. This integration raises significant concerns about privacy and access control, especially in shared...

CARING-AI: Towards Authoring Context-aware Augmented Reality INstruction through Generative Artificial Intelligence

CARING-AI: Towards Authoring Context-aware Augmented Reality INstruction through Generative Artificial Intelligence

Jingyu Shi*, Rahul Jain*, Seung-gun Chi*, Hyungjun Doh, Hyung-gun Chi, Alexander J. Quinn and Karthik Ramani
CHI Conference on Human Factors in Computing Systems (CHI ’25)

Context-aware AR instruction enables adaptive and in-situ learning experiences. However, hardware limitations and expertise requirements constrain the creation of such instructions. With recent developments in Generative Artificial Intelligence...

Virtual Reality in Manufacturing Education: A Scoping Review Indicating State-of-the-Art, Benefits, and Challenges Across Domains, Levels, and Entities

Virtual Reality in Manufacturing Education: A Scoping Review Indicating State-of-the-Art, Benefits, and Challenges Across Domains, Levels, and Entities

Ananya Ipsita, Ramesh Kaki, Ziyi Liu, Mayank Patel, Runlin Duan, Lakshmi Deshpande, Lin-Ping Yuan, Victoria Lowell, Ashok Maharaj, Kylie Peppler, Steven Feiner, Karthik Ramani
Preprint submitted to Elsevier

To address the shortage of a skilled workforce in the U.S. manufacturing industry, immersive Virtual Reality (VR)-based training solutions hold promising potential. To effectively utilize VR to meet workforce demands, it is important to understand...

Investigating Creativity in Humans and Generative AI Through Circles Exercises

Investigating Creativity in Humans and Generative AI Through Circles Exercises

Runlin Duan, Shao-Kang Hsia, Yuzhao Chen, Yichen Hu, Ming Yin, Karthik Ramani
Preprint

Generative AI (GenAI) is transforming the creativity process. However, as presented in this paper, GenAI encounters "narrow creativity" barriers. We observe that both humans and GenAI focus on limited subsets of the design space. We investigate...

CATSplat: Context-Aware Transformer with Spatial Guidance for Generalizable 3D Gaussian Splatting from A Single-View Image

CATSplat: Context-Aware Transformer with Spatial Guidance for Generalizable 3D Gaussian Splatting from A Single-View Image

Wonseok Roh, Hwanhee Jung, Jong Wook Kim, Seunggwan Lee, Innfarn Yoo, Andreas Lugmayr, Seunggeun Chi, Karthik Ramani, Sangpil Kim

Recently, generalizable feed-forward methods based on 3D Gaussian Splatting have gained significant attention for their potential to reconstruct 3D scenes using finite resources. These approaches create a 3D radiance field, parameterized by...