MultiSoft: Soft Sensor Enabling Real-Time Multimodal Sensing with Contact Localization and Deformation Classification

MultiSoft: Soft Sensor Enabling Real-Time Multimodal Sensing with Contact Localization and Deformation Classification

Sang Ho Yoon, Luis Paredes, Ke Huo, Karthik Ramani
Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT Volume 2 Issue 3, UbiComp 2018)

Abstract: We introduce MultiSoft, a multilayer soft sensor capable of sensing real-time contact localization, classification of deformation types, and estimation of deformation magnitudes. We propose a multimodal sensing pipeline that carries out...

Scenariot: Spatially Mapping Smart Things Within Augmented Reality Scenes

Scenariot: Spatially Mapping Smart Things Within Augmented Reality Scenes

Ke Huo, Yuanzhi Cao, Sang Ho Yoon, Zhuangying Xu, Guiming Chen, Karthik Ramani
Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, CHI 2018, April 21–26, 2018, Montreal, QC, Canada

The emerging simultaneous localizing and mapping (SLAM) based tracking technique allows the mobile AR device spatial awareness of the physical world. Still, smart things are not fully supported with the spatial awareness in AR. Therefore, we...

iSoft: A Customizable Soft Sensor with Real-time Continuous Contact and Stretching Sensing

iSoft: A Customizable Soft Sensor with Real-time Continuous Contact and Stretching Sensing

Sang Ho Yoon, Ke Huo, Yunbo Zhang, Guiming Chen, Luis Paredes, Subramanian Chidambaram, Karthik Ramani
In Proceedings of the 30th Annual ACM Symposium on User Interface Software & Technology (UIST'17) , Quebec City, Canada, 2017 (Acceptance Rate: 22.5%)

We present iSoft, a single volume soft sensor capable of sensing real-time continuous contact and unidirectional stretching. We propose a low-cost and an easy way to fabricate such piezoresistive elastomer-based soft sensors for instant...

Robust Hand Pose Estimation during the Interaction with an Unknown Object

Robust Hand Pose Estimation during the Interaction with an Unknown Object

Chiho Choi, Sang Ho Yoon, Chin-Ning Chen, Karthik Ramani
Proceedings of the IEEE International Conference on Computer Vision, 3123-3132

Abstract: This paper proposes a robust solution for accurate 3D hand pose estimation in the presence of an external object interacting with hands. Our main insight is that the shape of an object causes a configuration of the hand in the form of a...

BikeGesture: User Elicitation and Performance of Micro Hand Gesture as Input for Cycling

BikeGesture: User Elicitation and Performance of Micro Hand Gesture as Input for Cycling

Yanke Tan, Sang Ho Yoon, Karthik Ramani
In Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA' 17: 2147-2154), Denver, CO, May 6-11, 2017

Abstract: The use of hand gestures has a potential as a promising input metaphor. Wearables like smart textile and data gloves can provide hand gesture recognition to potentially replace, augment or improve existing input methods. Although recent...

TRing: Instant and Customizable Interactions with Objects Using an Embedded Magnet and a Finger-Worn Device

TRing: Instant and Customizable Interactions with Objects Using an Embedded Magnet and a Finger-Worn Device

Sang Ho Yoon, Yunbo Zhang, Ke Huo, Karthik Ramani
In Proceedings of the 29th Annual ACM Symposium on User Interface Software & Technology (UIST'16) , Tokyo, Japan, 2016 (Acceptance Rate: 20.6%)

We present TRing, a finger-worn input device which provides instant and customizable interactions. TRing offers a novel method for making plain objects interactive using an embedded magnet and a finger-worn device. With a particle filter integrated...