First-Person View Hand Segmentation of Multi-Modal Hand Activity Video Dataset

First-Person View Hand Segmentation of Multi-Modal Hand Activity Video Dataset

Sangpil Kim, Hyung-gun Chi, Xiao Hu, Anirudh Vegesana, Karthik Ramani
In proceedings of the 31st British Machine Vision Conference (BMVC)

Abstract:  First-person-view videos of hands interacting with tools are widely used in the computer vision industry. However, creating a dataset with pixel-wise segmentation of hands is challenging since most videos are captured with fingertips...

A Large-scale Annotated Mechanical Components Benchmark for Classification and Retrieval Tasks with Deep Neural Networks

A Large-scale Annotated Mechanical Components Benchmark for Classification and Retrieval Tasks with Deep Neural Networks

Sangpil Kim*, Hyung-gun Chi*, Xiao Hu, Qixing Huang, Karthik Ramani
In proceedings of 16th European Conference on Computer Vision (ECCV)

We introduce a large-scale annotated mechanical components benchmark for classification and retrieval tasks named Mechanical Components Benchmark (MCB): a large-scale dataset of 3D objects of mechanical components. The dataset enables data-driven...

CAPturAR: An Augmented Reality Tool for Authoring Human-Involved Context-Aware Applications

CAPturAR: An Augmented Reality Tool for Authoring Human-Involved Context-Aware Applications

Tianyi Wang*, Xun Qian*, Fengming He, Xiyun Hu, Ke Huo, Yuanzhi Cao, Karthik Ramani
In Proceedings of the 2020 UIST 33rd ACM User Interface Software and Technology Symposium

Recognition of human behavior plays an important role in context-aware applications. However, it is still a challenge for end-users to build personalized applications that accurately recognize their own activities. Therefore, we present CAPturAR,...

StoryMakAR: Bringing Stories to Life with an Augmented Reality & Physical Prototyping Toolkit for Youth

StoryMakAR: Bringing Stories to Life with an Augmented Reality & Physical Prototyping Toolkit for Youth

Terrell Glenn, Ananya Ipsita, Caleb Carithers, Kylie Peppler, Karthik Ramani
In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems

Makerspaces can support educational experiences in prototyping for children. Storytelling platforms enable high levels of creativity and expression, but have high barriers of entry. We introduce StoryMakAR, which combines making and storytelling....

Vipo: Spatial-Visual Programming with Functions for Robot-IoT Workflows

Vipo: Spatial-Visual Programming with Functions for Robot-IoT Workflows

Gaoping Huang, Pawan S. Rao, Meng-Han Wu, Xun Qian, Shimon Y. Nof, Karthik Ramani, and Alexander J. Quinn
In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems

Mobile robots and IoT (Internet of Things) devices can increase productivity, but only if they can be programmed by workers who understand the domain. This is especially true in manufacturing. Visual programming in the spatial context of the...

An Exploratory Study of Augmented Reality Presence for Tutoring Machine Tasks

An Exploratory Study of Augmented Reality Presence for Tutoring Machine Tasks

Yuanzhi Cao, Xun Qian, Tianyi Wang, Rachel Lee, Ke Huo, Karthik Ramani
In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems

Machine tasks in workshops or factories are often a compound sequence of local, spatial, and body-coordinated human-machine interactions. Prior works have shown the merits of video-based and augmented reality (AR) tutoring systems for local tasks....

Meta-AR-App: An Authoring Platform for Collaborative Augmented Reality in STEM Classrooms

Meta-AR-App: An Authoring Platform for Collaborative Augmented Reality in STEM Classrooms

Ana Villanueva, Zhengzhe Zhu, Ziyi Liu, Thomas Redick, Kylie Peppler, and Karthik Ramani
In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems

Augmented Reality (AR) has become a valuable tool for education and training processes. Meanwhile, cloud-based technologies can foster collaboration and other interaction modalities to enhance learning. We combine the cloud capabilities with AR...

Autonomous Robotic Exploration and Mapping of Smart Indoor Environments With UWB-IoT Devices

Autonomous Robotic Exploration and Mapping of Smart Indoor Environments With UWB-IoT Devices

Tianyi Wang, Ke Huo, Muzhi Han, Daniel McArthur, Ze An, David Cappeleri, and Karthik Ramani
In Proceedings of AAAI Spring Symposium Series 2020

The emerging simultaneous localization and mapping (SLAM) techniques enable robots with the spatial awareness of the physical world. However, such awareness remains at a geometric level. We propose an approach for quickly constructing a smart...

Using Social Interaction Traced Data and Context to Predict Collaboration Quality and Creative Fluency in Collaborative Design Learning Environments

Using Social Interaction Traced Data and Context to Predict Collaboration Quality and Creative Fluency in Collaborative Design Learning Environments

Ninger Zhou, Lorraine Kisselburgh, Senthil Chandrasegaran, S. Karthik Badam, Niklas Elmqvist, and Karthik Ramani
International Journal of Human-Computer Studies 136 (2020): 102378

Engineering design typically occurs as a collaborative process situated in specific context such as computer-supported environments, however there is limited research examining the dynamics of design collaboration in specific contexts. In this...