AdapTutAR: An Adaptive Tutoring System for Machine Tasks in Augmented Reality

by Xun Qian | Jun 6, 2021 | 2021, Featured Publications, Karthik Ramani, Karthik Ramani, Publications, Recent Publications, Tianyi Wang, Xun Qian, Yuanzhi Cao

Modern manufacturing processes are in a state of flux, as they adapt to increasing demand for flexible and self-configuring production. This poses challenges for training workers to rapidly master new machine operations and processes, i.e. machine tasks. Conventional...

VRFromX: From Scanned Reality to Interactive Virtual Experience with Human-in-the-Loop

by Ananya Ipsita | Jun 5, 2021 | 2021, Ananya Ipsita, Karthik Ramani, Karthik Ramani, Min Liu, Publications, Recent Publications, Subramanian Chidambaram, Yuanzhi Cao

There is an increasing trend of Virtual-Reality (VR) applications found in education, entertainment, and industry. Many of them utilize real world tools, environments, and interactions as bases for creation. However, creating such applications is tedious, fragmented,...

CAPturAR: An Augmented Reality Tool for Authoring Human-Involved Context-Aware Applications

by Tianyi Wang | Jul 3, 2020 | 2020, Fengming He, Karthik Ramani, Karthik Ramani, Ke Huo, Publications, Recent Publications, Tianyi Wang, Xun Qian, Yuanzhi Cao

Recognition of human behavior plays an important role in context-aware applications. However, it is still a challenge for end-users to build personalized applications that accurately recognize their own activities. Therefore, we present CAPturAR, an in-situ...

An Exploratory Study of Augmented Reality Presence for Tutoring Machine Tasks

by Yuanzhi Cao | Mar 1, 2020 | 2020, Convergence Accelerator, Featured Publications, Future of Work, Karthik Ramani, Ke Huo, Publications, Recent Publications, Tianyi Wang, Xun Qian, Yuanzhi Cao

Machine tasks in workshops or factories are often a compound sequence of local, spatial, and body-coordinated human-machine interactions. Prior works have shown the merits of video-based and augmented reality (AR) tutoring systems for local tasks. However, due to the...

GhostAR: A Time-space Editor for Embodied Authoring of Human-Robot Collaborative Task with Augmented Reality

by Yuanzhi Cao | Oct 14, 2019 | 2019, Featured Publications, Future of Work, Industrial Innovation and Partnerships, Information and Intelligent Systems, Karthik Ramani, Ke Huo, Pawan Rao, Publications, Recent Publications, Tianyi Wang, Xun Qian, Yuanzhi Cao

We present GhostAR, a time-space editor for authoring and acting Human-Robot-Collaborative (HRC) tasks in-situ. Our system adopts an embodied authoring approach in Augmented Reality (AR), for spatially editing the actions and programming the robots through...

V.Ra: An In-Situ Visual Authoring System for Robot-IoT Task Planning with Augmented Reality

by Convergence Design Lab Admin | Jun 27, 2019 | 2019, Featured Publications, Future of Work, Industrial Innovation and Partnerships, Information and Intelligent Systems, Karthik Ramani, Ke Huo, Publications, Recent Publications, Yuanzhi Cao

We present V.Ra, a visual and spatial programming system for robot-IoT task authoring. In V.Ra, programmable mobile robots serve as binding agents to link the stationary IoTs and perform collaborative tasks. We establish an ecosystem that coherently connects the three...