GesPrompt: Leveraging Co-Speech Gestures to Augment LLM-Based Interaction in Virtual Reality

GesPrompt: Leveraging Co-Speech Gestures to Augment LLM-Based Interaction in Virtual Reality

Xiyun Hu, Dizhi Ma, Fengming He, Zhengzhe Zhu, Shao-Kang Hsia, Chenfei Zhu, Ziyi Liu, Karthik Ramani
In Proceedings of the 2025 ACM Designing Interactive Systems Conference

Large Language Model (LLM)-based copilots have shown great potential in Extended Reality (XR) applications. However, the user faces challenges when describing the 3D environments to the copilots due to the complexity of conveying spatial-temporal...

Adopting Backward Design into a Constructionist Curriculum Design for IoT Skill Development in High Schoolers

Adopting Backward Design into a Constructionist Curriculum Design for IoT Skill Development in High Schoolers

Ananya Ipsita, Terrell Kendall Glenn, Disha Ajay Bhagwat, Nielsen Pereira, Kylie A Peppler, Karthik Ramani
In Proceedings of the Extended Abstracts of the CHI Conference on Human Factors in Computing Systems, pp. 1-8. 2025.

Despite the growing demand for experienced Internet of Things (IoT) professionals across industrial establishments, most secondary education institutions do not offer a curriculum to empower students’ knowledge and skills in IoT. Enrichment...

Transparent Barriers: Natural Language Access Control Policies for XR-Enhanced Everyday Objects

Transparent Barriers: Natural Language Access Control Policies for XR-Enhanced Everyday Objects

Kentaro Taninaka, Rahul Jain, Jingyu Shi, Kazunori Takashio, Karthik Ramani
In Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems

Extended Reality (XR)-enabled headsets that overlay digital content onto the physical world, are gradually finding their way into our daily life. This integration raises significant concerns about privacy and access control, especially in shared...

CARING-AI: Towards Authoring Context-aware Augmented Reality INstruction through Generative Artificial Intelligence

CARING-AI: Towards Authoring Context-aware Augmented Reality INstruction through Generative Artificial Intelligence

Jingyu Shi*, Rahul Jain*, Seung-gun Chi*, Hyungjun Doh, Hyung-gun Chi, Alexander J. Quinn and Karthik Ramani
CHI Conference on Human Factors in Computing Systems (CHI ’25)

Context-aware AR instruction enables adaptive and in-situ learning experiences. However, hardware limitations and expertise requirements constrain the creation of such instructions. With recent developments in Generative Artificial Intelligence...

Virtual Reality in Manufacturing Education: A Scoping Review Indicating State-of-the-Art, Benefits, and Challenges Across Domains, Levels, and Entities

Virtual Reality in Manufacturing Education: A Scoping Review Indicating State-of-the-Art, Benefits, and Challenges Across Domains, Levels, and Entities

Ananya Ipsita, Ramesh Kaki, Ziyi Liu, Mayank Patel, Runlin Duan, Lakshmi Deshpande, Lin-Ping Yuan, Victoria Lowell, Ashok Maharaj, Kylie Peppler, Steven Feiner, Karthik Ramani
Preprint submitted to Elsevier

To address the shortage of a skilled workforce in the U.S. manufacturing industry, immersive Virtual Reality (VR)-based training solutions hold promising potential. To effectively utilize VR to meet workforce demands, it is important to understand...

Investigating Creativity in Humans and Generative AI Through Circles Exercises

Investigating Creativity in Humans and Generative AI Through Circles Exercises

Runlin Duan, Shao-Kang Hsia, Yuzhao Chen, Yichen Hu, Ming Yin, Karthik Ramani
Preprint

Generative AI (GenAI) is transforming the creativity process. However, as presented in this paper, GenAI encounters "narrow creativity" barriers. We observe that both humans and GenAI focus on limited subsets of the design space. We investigate...

CATSplat: Context-Aware Transformer with Spatial Guidance for Generalizable 3D Gaussian Splatting from A Single-View Image

CATSplat: Context-Aware Transformer with Spatial Guidance for Generalizable 3D Gaussian Splatting from A Single-View Image

Wonseok Roh, Hwanhee Jung, Jong Wook Kim, Seunggwan Lee, Innfarn Yoo, Andreas Lugmayr, Seunggeun Chi, Karthik Ramani, Sangpil Kim

Recently, generalizable feed-forward methods based on 3D Gaussian Splatting have gained significant attention for their potential to reconstruct 3D scenes using finite resources. These approaches create a 3D radiance field, parameterized by...

AnnotateXR: An Extended Reality Workflow for Automating Data Annotation to Support Computer Vision Applications

AnnotateXR: An Extended Reality Workflow for Automating Data Annotation to Support Computer Vision Applications

Subramanian Chidambaram*, Rahul Jain*, Sai Swarup Reddy, Asim Unmesh, Karthik Ramani
J. Comput. Inf. Sci. Eng. Dec 2024, 24(12): 121001 (13 pages)

Computer vision (CV) algorithms require large annotated datasets that are often labor-intensive and expensive to create. We propose AnnotateXR, an extended reality (XR) workflow to collect various high-fidelity data and auto-annotate it in a single...

Multi-Modal Representation Learning with Tactile Data

Multi-Modal Representation Learning with Tactile Data

Hyung-Gun Chi, Jose Barreiros, Jean Mercat, Karthik Ramani, Thomas Kollar
In 2024 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)

Advancements in embodied language models like PALM-E and RT-2 have significantly enhanced language-conditioned robotic manipulation. However, these advances remain predominantly focused on vision and language, often overlooking the pivotal role of...

Estimating Ego-Body Pose from Doubly Sparse Egocentric Video Data, Advances in Neural Information Processing Systems

Estimating Ego-Body Pose from Doubly Sparse Egocentric Video Data, Advances in Neural Information Processing Systems

Seunggeun Chi, Pin-Hao Huang, Enna Sachdeva, Hengbo Ma, Karthik Ramani, Kwonjoon Lee
Conference on Neural Information Processing Systems (NeurIPS 2024)

We study the problem of estimating the body movements of a camera wearer from egocentric videos. Current methods for ego-body pose estimation rely on temporally dense sensor data, such as IMU measurements from spatially sparse body parts like the...

M2D2M: Multi-Motion Generation from Text with Discrete Diffusion Models

M2D2M: Multi-Motion Generation from Text with Discrete Diffusion Models

Seunggeun Chi*, Hyung-gun Chi*, Hengbo Ma, Nakul Agarwal, Faizan Siddiqui, Karthik Ramani, Kwonjoon Lee
In European Conference on Computer Vision, 2024.

We introduce the Multi-Motion Discrete Diffusion Models (M2D2M), a novel approach for human motion generation from textual descriptions of multiple actions, utilizing the strengths of discrete diffusion models. This approach adeptly addresses the...

avaTTAR: Table Tennis Stroke Training with On-body and Detached Visualization in Augmented Reality

avaTTAR: Table Tennis Stroke Training with On-body and Detached Visualization in Augmented Reality

Dizhi Ma*, Xiyun Hu*, Jingyu Shi, Mayank Patel, Rahul Jain, Ziyi Liu, Zhengzhe Zhu, Karthik Ramani
In The 37th Annual ACM Symposium on User Interface Software and Technology (UIST ’24)

Table tennis stroke training is a critical aspect of player development. We designed a new augmented reality (AR) system, avaTTAR, for table tennis stroke training. The system provides both "on-body" (first-person view) and "detached" (third-person...

ClassMeta: Designing Interactive Virtual Classmate to Promote VR Classroom Participation

ClassMeta: Designing Interactive Virtual Classmate to Promote VR Classroom Participation

Ziyi Liu*, Zhengzhe Zhu*, Lijun Zhu, Enze Jiang, Xiyun Hu, Kylie A Peppler, Karthik Ramani
In Proceedings of the CHI Conference on Human Factors in Computing Systems, pp. 1-17. 2024.

Peer influence plays a crucial role in promoting classroom participation, where behaviors from active students can contribute to a collective classroom learning experience. However, the presence of these active students depends on several...

AircraftVerse: A Large-Scale Multimodal Dataset of Aerial Vehicle Designs

AircraftVerse: A Large-Scale Multimodal Dataset of Aerial Vehicle Designs

Adam D. Cobb, Anirban Roy, Daniel Elenius, F. Michael Heim, Brian Swensonk, Sydney Whittingtonk, James D. Walker, Theodore Bapty, Joseph Hite, Karthik Ramani, Christopher McComb, Susmit Jha
Advances in Neural Information Processing Systems 36 (2023)

We present AircraftVerse, a publicly available aerial vehicle design dataset. Aircraft design encompasses different physics domains and, hence, multiple modalities of representation. The evaluation of these cyber-physical system (CPS) designs...

Interacting Objects: A dataset of object-object interactions for richer dynamic scene representations

Interacting Objects: A dataset of object-object interactions for richer dynamic scene representations

Asim Unmesh, Rahul Jain, Jingyu Shi, VK Chaitanya, Hyung-Gun Chi, Subramanian Chidambaram, Alexander Quinn, Karthik Ramani
IEEE Robotics and Automation Letters, vol. 9, no. 1, pp. 451-458, Jan. 2024

Interacting Objects: A dataset of object-object interactions for richer dynamic scene representations Asim Unmesh, Rahul Jain, Jingyu Shi, V. K. Chaithanya Manam, Hyung-Gun Chi, Subramanian Chidambaram, Alexander J. Quinn, Karthik Ramani IEEE...

An HCI-Centric Survey and Taxonomy of Human-Generative-AI Interactions

An HCI-Centric Survey and Taxonomy of Human-Generative-AI Interactions

Jingyu Shi*, Rahul Jain*, Hyungjun Doh, Ryo Suzuki, Karthik Ramani
Submitted to ACM Computing Surveys

Generative AI (GenAI) has shown remarkable capabilities in generating diverse and realistic content across different formats like images, videos, and text. In Generative AI, human involvement is essential, thus HCI literature has investigated how...

Deep Ritz Method with Adaptive Quadrature for Linear Elasticity

Deep Ritz Method with Adaptive Quadrature for Linear Elasticity

Min Liu, Zhiqiang Cai, Karthik Ramani
Computer Methods in Applied Mechanics and Engineering Vol. 415 116229 (2023)

In this paper, we study the deep Ritz method for solving the linear elasticity equation from a numerical analysis perspective. A modified Ritz formulation using the H1/2(ΓD) norm is introduced and analyzed for linear elasticity equation in order to...

AdamsFormer for Spatial Action Localization in the Future

AdamsFormer for Spatial Action Localization in the Future

Hyung-Gun Chi, Kwonjoon Lee, Nakul Agarwal, Yi Xu, Karthik Ramani, Chiho Choi
2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)

Predicting future action locations is vital for applications like human-robot collaboration. While some computer vision tasks have made progress in predicting human actions, accurately localizing these actions in future frames remains an area with...

ImpersonatAR: Using Embodied Authoring and Evaluation to Prototype Multi-Scenario Use cases for Augmented Reality Applications

ImpersonatAR: Using Embodied Authoring and Evaluation to Prototype Multi-Scenario Use cases for Augmented Reality Applications

Meng-Han Wu, Ananya Ipsita, Gaoping Huang, Karthik Ramani, Alexander J Quinn
in ASME. J. Comput. Inf. Sci. Eng.

Prototyping use cases for Augmented Reality (AR) applications can be beneficial to elicit the functional requirements of the features early-on, to drive the subsequent development in a goal-oriented manner. Doing so would require designers to...

The Design of a Virtual Prototyping System for Authoring Interactive Virtual Reality Environments From Real-World Scans

The Design of a Virtual Prototyping System for Authoring Interactive Virtual Reality Environments From Real-World Scans

Ananya Ipsita*, Runlin Duan*, Hao Li*, Subramanian Chidambaram, Yuanzhi Cao, Min Liu, Alex Quinn, Karthik Ramani
in ASME. J. Comput. Inf. Sci. Eng. March 2024

Domain users (DUs) with a knowledge base in specialized fields are frequently excluded from authoring virtual reality (VR)-based applications in corresponding fields. This is largely due to the requirement of VR programming expertise needed to...

Ubi-TOUCH: Ubiquitous Tangible Object Utilization through Consistent Hand-object interaction in Augmented Reality

Ubi-TOUCH: Ubiquitous Tangible Object Utilization through Consistent Hand-object interaction in Augmented Reality

Rahul Jain*, Jingyu Shi*, Runlin Duan, Zhengzhe Zhu, Xun Qian, Karthik Ramani
In Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology (UIST 2023)

Utilizing everyday objects as tangible proxies for Augmented Reality (AR) provides users with haptic feedback while interacting with virtual objects. Yet, existing methods focus on the attributes of the objects, constraining the possible proxies...

Ubi Edge: Authoring Edge-Based Opportunistic Tangible User Interfaces in Augmented Reality

Ubi Edge: Authoring Edge-Based Opportunistic Tangible User Interfaces in Augmented Reality

Fengming He, Xiyun Hu, Jingyu Shi, Xun Qian, Tianyi Wang, Karthik Ramani
In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems

Edges are one of the most ubiquitous geometric features of physical objects. They provide accurate haptic feedback and easy-totrack features for camera systems, making them an ideal basis for Tangible User Interfaces (TUI) in Augmented Reality...

Pose Relation Transformer: Refine Occlusions for Human Pose Estimation

Pose Relation Transformer: Refine Occlusions for Human Pose Estimation

Hyung-gun Chi, Seung-gun Chi, Stanley Chan, Karthik Ramani
In 2023 International Conference on Robotics and Automation (ICRA)

Accurately estimating the human pose is an essential task for many applications in robotics. However, existing pose estimation methods suffer from poor performance when occlusion occurs. Recent advances in NLP have been very successful in...

InstruMentAR: Auto-Generation of Augmented Reality Tutorials for Operating Digital Instruments Through Recording Embodied

InstruMentAR: Auto-Generation of Augmented Reality Tutorials for Operating Digital Instruments Through Recording Embodied

Ziyi Liu, Zhengzhe Zhu, Enze Jiang, Feichi Huang, Ana Villanueva, Tianyi Wang, Xun Qian, Karthik Ramani
In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems

Augmented Reality tutorials, which provide necessary context by directly superimposing visual guidance on the physical referent, represent an effective way of scaffolding complex instrument operations. However, current AR tutorial authoring...

LearnIoTVR: An End-to-End Virtual Reality Environment Providing Authentic Learning Experiences for Internet of Things

LearnIoTVR: An End-to-End Virtual Reality Environment Providing Authentic Learning Experiences for Internet of Things

Zhengzhe Zhu, Ziyi Liu, Youyou Zhang, Lijun Zhu, Joey Huang, Ana villanueva, Xun Qian, Kylie Peppler, Karthik Ramani
In the Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems

The rapid growth of Internet-of-Things (IoT) applications has generated interest from many industries and a need for graduates with relevant knowledge. An IoT system is comprised of spatially distributed interactions between humans and various...

Advanced modeling method for quantifying cumulative subjective fatigue in mid-air interaction

Advanced modeling method for quantifying cumulative subjective fatigue in mid-air interaction

Ana Villanueva, Sujin Jang, Wolfgang Stuerzlinger, Satyajit Ambike, Karthik Ramani
International Journal of Human-Computer Studies 169 (2023): 102931

Interaction in mid-air can be fatiguing. A model-based method to quantify cumulative subjective fatigue for such interaction was recently introduced in HCI research. This model separates muscle units into three states: active (MA) fatigued (MF) or...

MechARspace: An Authoring System Enabling Bidirectional Binding of Augmented Reality with Toys in Real-time

MechARspace: An Authoring System Enabling Bidirectional Binding of Augmented Reality with Toys in Real-time

Zhengzhe Zhu, Ziyi Liu, Tianyi Wang, Youyou Zhang, Xun Qian, Pashin Farsak Raja, Ana Villanueva, Karthik Ramani
In Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology (pp. 1-16).

Augmented Reality (AR), which blends physical and virtual worlds, presents the possibility of enhancing traditional toy design. By leveraging bidirectional virtual-physical interactions between humans and the designed artifact, such AR-enhanced...

ARnnotate: An Augmented Reality Interface for Collecting Custom Dataset of 3D Hand-Object Interaction Pose Estimation

ARnnotate: An Augmented Reality Interface for Collecting Custom Dataset of 3D Hand-Object Interaction Pose Estimation

Xun Qian, Fengming He, Xiyun Hu, Tianyi Wang, Karthik Ramani
In Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology (pp. 1-14)

Vision-based 3D pose estimation has substantial potential in hand-object interaction applications and requires user-specified datasets to achieve robust performance. We propose ARnnotate, an Augmented Reality (AR) interface enabling end-users to...

EditAR: A Digital Twin Authoring Environment for Creation of AR/VR and Video Instructions from a Single Demonstration

EditAR: A Digital Twin Authoring Environment for Creation of AR/VR and Video Instructions from a Single Demonstration

Subramanian Chidambaram, Sai Swarup Reddy, Matthew Rumple, Ananya Ipsita, Ana Villanueva, Thomas Redick, Wolfgang Stuerzlinger, Karthik Ramani
In 2022 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)

Augmented/Virtual reality and video-based media play a vital role in the digital learning revolution to train novices in spatial tasks. However, creating content for these different media requires expertise in several fields. We present EditAR, a...

Advanced modeling method for quantifying cumulative subjective fatigue in mid-air interaction

Advanced modeling method for quantifying cumulative subjective fatigue in mid-air interaction

Ana Villanueva, Sujin Jang, Wolfgang Stuerzlinger, SatyajitAmbike, Karthik Ramani
International Journal of Human-Computer Studies, 102931

Interaction in mid-air can be fatiguing. A model-based method to quantify cumulative subjective fatigue for such interaction was recently introduced in HCI research. This model separates muscle units into three states: active (Ma) fatigued (Mf) or...

StretchAR: Exploiting Touch and Stretch as a Method of Interaction for Smart Glasses Using Wearable Straps

StretchAR: Exploiting Touch and Stretch as a Method of Interaction for Smart Glasses Using Wearable Straps

Luis Paredes, Ananya Ipsita, Juan C. Mesa, Ramses V. Martinez Garrido, Karthik Ramani
Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 6(3), 1-26

Over the past decade, augmented reality (AR) developers have explored a variety of approaches to allow users to interact with the information displayed on smart glasses and head-mounted displays (HMDs). Current interaction modalities such as...

ScalAR: Authoring Semantically Adaptive Augmented Reality Experiences in Virtual Reality

ScalAR: Authoring Semantically Adaptive Augmented Reality Experiences in Virtual Reality

Xun Qian, Fengming He, Xiyun Hu, Tianyi Wang, Ananya Ipsita, and Karthik Ramani
In the Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems

Augmented Reality (AR) experiences tightly associate virtual contents with environmental entities. However, the dissimilarity of different environments limits the adaptive AR content behaviors under large-scale deployment. We propose ScalAR, an...

Towards Modeling of Virtual Reality Welding Simulators to Promote Accessible and Scalable Training

Towards Modeling of Virtual Reality Welding Simulators to Promote Accessible and Scalable Training

Ananya Ipsita, Levi Erickson, Yangzi Dong, Joey Huang, Alexa Bushinski, Sraven Saradhi, Ana Villanueva, Kylie Peppler, Thomas Redick, and Karthik Ramani
In the Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems

The US manufacturing industry is currently facing a welding workforce shortage which is largely due to inadequacy of widespread welding training. To address this challenge, we present a Virtual Reality (VR)-based training system aimed at...

InfoGCN: Representation Learning for Human Skeleton-based Action Recognition

InfoGCN: Representation Learning for Human Skeleton-based Action Recognition

Hyung-gun Chi, Myoung Hoon Ha, Seunggeun Chi, Sang Wan Lee, Qixing Huang, and Karthik Ramani
In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2022

Human skeleton-based action recognition offers a valuable means to understand the intricacies of human behavior because it can handle the complex relationships between physical constraints and intention. Although several studies have focused on...

ColabAR: A Toolkit for Remote Collaboration in Tangible Augmented Reality Laboratories

ColabAR: A Toolkit for Remote Collaboration in Tangible Augmented Reality Laboratories

Ana Villanueva, Zhengzhe Zhu, Ziyi Liu, Feiyang Wang, Subramanian Chidambaram, Karthik Ramani
In the Proceedings of the ACM on Human-Computer Interaction, 6(CSCW1), 1-22

Current times are accelerating new technologies to provide high-quality education for remote collaboration, as well as hands-on learning. This is particularly important in the case of laboratory-based classes, which play an essential role in STEM...

CHIMERA: Supporting Wearables Development across Multidisciplinary Perspectives

CHIMERA: Supporting Wearables Development across Multidisciplinary Perspectives

Luis Paredes, Caroline McMillan, Wan Kyn Chan, Senthil Chandrasegaran, Ramyak Singh, Karthik Ramani, and Danielle Wilde
In the Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies

Wearable technologies draw on a range of disciplines, including fashion, textiles, HCI, and engineering. Due to differences in methodology, wearables researchers can experience gaps or breakdowns in values, goals, and vocabulary when collaborating....

GesturAR: An Authoring System for Creating Freehand Interactive Augmented Reality Applications

GesturAR: An Authoring System for Creating Freehand Interactive Augmented Reality Applications

Tianyi Wang, Xun Qian, Fengming He, Xiyun Hu, Yuanzhi Cao, Karthik Ramani
In The 34th Annual ACM Symposium on User Interface Software and Technology (UIST '21)

Freehand gesture is an essential input modality for modern Augmented Reality (AR) user experiences. However, developing AR applications with customized hand interactions remains a challenge for end-users. Therefore, we propose GesturAR, an...

ProcessAR: An augmented reality-based tool to create in-situ procedural 2D/3D AR Instructions

ProcessAR: An augmented reality-based tool to create in-situ procedural 2D/3D AR Instructions

Subramanian Chidambaram, Hank Huang, Fengming He, Xun Qian, Ana M Villanueva, Thomas S Redick, Wolfgang Stuerzlinger, Karthik Ramani
In Proceedings of the Designing Interactive Systems Conference

Augmented reality (AR) is an efficient form of delivering spatial information and has great potential for training workers. However, AR is still not widely used for such scenarios due to the technical skills and expertise required to create...

FabHandWear : An End-to-End Pipeline from Design to Fabrication of Customized Functional Hand Wearables

FabHandWear : An End-to-End Pipeline from Design to Fabrication of Customized Functional Hand Wearables

Luis Paredes, Sai Swarup Reddy, Subramanian Chidambaram, Devashri Vagholkar, Yunbo Zhang, Bedrich Benes, Karthik Ramani
In Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies

Current hand wearables have limited customizability, they are loose-fit to an individual's hand and lack comfort. The main barrier in customizing hand wearables is the geometric complexity and size variation in hands. Moreover, there are different...

Towards modeling of human skilling for electrical circuitry using augmented reality applications

Towards modeling of human skilling for electrical circuitry using augmented reality applications

Ana Villanueva, Ziyi Liu, Yoshimasa Kitaguchi, Zhengzhe Zhu, Kylie Peppler, Thomas Redick, Karthik Ramani
International Journal of Educational Technology in Higher Education

Augmented reality (AR) is a unique, hands-on tool to deliver information. However, its educational value has been mainly demonstrated empirically so far. In this paper, we present a modeling approach to provide users with mastery of a skill, using...

RobotAR: An Augmented Reality Compatible Teleconsulting Robotics Toolkit for Augmented Makerspace Experiences

RobotAR: An Augmented Reality Compatible Teleconsulting Robotics Toolkit for Augmented Makerspace Experiences

Ana Villanueva, Zhengzhe Zhu, Ziyi Liu, Xin Du, Joey Huang, Kylie Peppler, Karthik Ramani
In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems

Distance learning is facing a critical moment finding a balance between high quality education for remote students and engaging them in hands-on learning. This is particularly relevant for project-based classrooms and makerspaces, which typically...

LightPaintAR: Assist Light Painting Photography with Augmented Reality

LightPaintAR: Assist Light Painting Photography with Augmented Reality

Tianyi Wang, Xun Qian, Fengming He, Karthik Ramani
In Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems

Light painting photos are created by moving light sources in mid-air while taking a long exposure photo. However, it is challenging for novice users to leave accurate light traces without any spatial guidance. Therefore, we present LightPaintAR, a...

AdapTutAR: An Adaptive Tutoring System for Machine Tasks in Augmented Reality

AdapTutAR: An Adaptive Tutoring System for Machine Tasks in Augmented Reality

Gaoping Huang*, Xun Qian*, Tianyi Wang, Fagun Patel, Maitreya Sreeram, Yuanzhi Cao, Karthik Ramani, and Alexander J. Quinn
In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems

Modern manufacturing processes are in a state of flux, as they adapt to increasing demand for flexible and self-configuring production. This poses challenges for training workers to rapidly master new machine operations and processes, i.e. machine...