Window-Shaping: 3D Design Ideation by Creating on, Borrowing from, and Looking at the Physical World

Window-Shaping: 3D Design Ideation by Creating on, Borrowing from, and Looking at the Physical World

Ke Huo, Vinayak, Karthik Ramani
In Proceedings of the TEI'17: Tenth International Conference on Tangible, Embedded, and Embodied Interaction. ACM. (TEI'17: 37-45) , Yokohama, Japan, Mar., 2017

We present, Window-Shaping, a tangible mixed-reality (MR) interaction metaphor for design ideation that allows for the direct creation of 3D shapes on and around physical objects. Using the sketch-and-inflate scheme, our metaphor enables quick...

Co-3Deator: A Team-First Collaborative 3D Design Ideation Tool

Co-3Deator: A Team-First Collaborative 3D Design Ideation Tool

Cecil Piya, Vinayak, Senthil Chandrasegaran, Niklas Elmqvist, Karthik Ramani
In Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI 2017: 6581-6592), Denver, CO, May 6-11, 2017 (Acceptance Rate: 25%)

We present Co-3Deator, a sketch-based collaborative 3D modeling system based on the notion of "team-first" ideation tools, where the needs and processes of the entire design team come before that of an individual designer. Co-3Deator includes two...

Deconvolving Feedback Loops in Recommender Systems

Deconvolving Feedback Loops in Recommender Systems

Ayan Sinha, David F. Gleich, Karthik Ramani
In Proceedings of the Thirtieth Annual Conference on Neural Information Processing Systems (NIPS'16) , Barcelona, Spain, 2016

Collaborative filtering is a popular technique to infer users' preferences on new content based on the collective information of all users preferences. Recommender systems then use this information to make personalized suggestions to users. When...

TRing: Instant and Customizable Interactions with Objects Using an Embedded Magnet and a Finger-Worn Device

TRing: Instant and Customizable Interactions with Objects Using an Embedded Magnet and a Finger-Worn Device

Sang Ho Yoon, Yunbo Zhang, Ke Huo, Karthik Ramani
In Proceedings of the 29th Annual ACM Symposium on User Interface Software & Technology (UIST'16) , Tokyo, Japan, 2016 (Acceptance Rate: 20.6%)

We present TRing, a finger-worn input device which provides instant and customizable interactions. TRing offers a novel method for making plain objects interactive using an embedded magnet and a finger-worn device. With a particle filter integrated...

Deep Learning 3D Shape Surfaces using Geometry Images

Deep Learning 3D Shape Surfaces using Geometry Images

Ayan SInha, Jing Bai, Karthik Ramani
The 14th European Conference on Computer Vision, October 11-14, 2016, Amsterdam, The Netherlands.

Surfaces serve as a natural parametrization to 3D shapes. Learning surfaces using convolutional neural networks (CNNs) is a challenging task. Current paradigms to tackle this challenge are to either adapt the convolutional filters to operate on...

FEAsy: A Sketch-Based Tool for Finite Element Analysis

FEAsy: A Sketch-Based Tool for Finite Element Analysis

Sundar Murugappan, Cecil Piya, Maria C. Yang, Karthik Ramani
Journal of Computing and Information Science in Engineering, Volume 16, Issue 3, September 2016

Freehand sketching is an integral part of early design process. Recent years have seen an increased interest in supporting sketching in computer-based design systems. In this paper, we present finite element analysis made easy (FEAsy), a...

The intrinsic geometric structure of protein-protein interaction networks for protein interaction prediction

The intrinsic geometric structure of protein-protein interaction networks for protein interaction prediction

Yi Fang, Mengtian Sun, Guoxian Dai, and Karthik Ramani
IEEE/ACM Transactions on Computational Biology and Bioinformatics (TCBB) TCBB Homepage archive Volume 13 Issue 1, January/February 2016 Pages 76-85

Recent developments in high-throughput technologies for measuring protein-protein interaction (PPI) have profoundly advanced our ability to systematically infer protein function and regulation. However, inherently high false positive and false...

Proto-TAI++: Exploring Perceptually Consistent Creation of Planar Shape Assemblies Through Multimodal Tangible Interactions

Proto-TAI++: Exploring Perceptually Consistent Creation of Planar Shape Assemblies Through Multimodal Tangible Interactions

Cecil Piya, Vinayak, Karthik Ramani
Journal of Computing and Information Science in Engineering, Volume 16, Issue 3, September 2016

We explore tangible 3D interactions that allow for geometric and perceptual correspondence between a midair modality and the 3D elements it controls. To demonstrate our approach, we use a concrete application scenario through Proto-TAI++, a...

DeepHand: Robust Hand Pose Estimation by Completing a Matrix Imputed with Deep Features

DeepHand: Robust Hand Pose Estimation by Completing a Matrix Imputed with Deep Features

Ayan Sinha*, Chiho Choi*, and Karthik Ramani (* denotes equal contribution)
In Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2016, Las Vegas, USA.

We propose DeepHand to estimate the 3D pose of a hand using depth data from commercial 3D sensors. We discriminatively train convolutional neural networks to output a low dimensional activation feature given a depth map. This activation feature...

CardBoardiZer: Creatively Customize, Articulate and Fold 3D Mesh Models

CardBoardiZer: Creatively Customize, Articulate and Fold 3D Mesh Models

Yunbo Zhang,Wei Gao, Luis Paredes, Karthik Ramani
Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (pp. 897-907). ACM.

                https://youtu.be/Rnt3OCUTlZs Computer-aided design of flat patterns allows designers to prototype foldable 3D objects made of heterogeneous sheets of material. We found origami designs are...

Cubimorph: Designing Modular Handheld Shape Changing Devices for End-Users

Cubimorph: Designing Modular Handheld Shape Changing Devices for End-Users

Roudaut, Anne and Krusteva, Diana and Karnik, Abhijit Anil and McCoy, Mike and Ramani, Karthik and Subramanian, Sriram
The International Conference on Robotics and Automation (ICRA) 2016, Stockholm, Sweden.

We introduce Cubimorph, a modular interactive device that accommodates touchscreens on each of the six module faces, and that uses a hinge-mounted turntable mechanism to self-reconfigure in the user's hand. Cubimorph contributes toward the vision...

TMotion: Embedded 3D Mobile Input using Magnetic Sensing Technique

TMotion: Embedded 3D Mobile Input using Magnetic Sensing Technique

Sang Ho Yoon, Ke Huo, Karthik Ramani
In Proceedings of the 10th International Conference on Tangible, Embedded, and Embodied Interaction (TEI'16), Eindhoven, Netherlands, 2016 (Acceptance Rate: 27%)

Abstract: We present TMotion, a self-contained 3D input that enables spatial interactions around mobile device using a magnetic sensing technique. We embed a permanent magnet and an inertial measurement unit (IMU) in a stylus. When the stylus moves...

MobiSweep: Exploring Spatial Design Ideation Using a Smartphone as a Hand-held Reference Plane

MobiSweep: Exploring Spatial Design Ideation Using a Smartphone as a Hand-held Reference Plane

Vinayak, Devarajan Ramanujan, Cecil Piya, Karthik Ramani
In Proceedings of the Tenth International Conference on Tangible, Embedded, and Embodied Interaction, Netherlands, 2016

In this paper, we explore quick 3D shape composition during early-phase spatial design ideation. Our approach is to re-purpose a smartphone as a hand-held reference plane for creating, modifying, and manipulating 3D sweep surfaces. We implemented...

Extracting Hand Grasp & Motion for Intent Expression in Mid-Air Shape Deformation: A Concrete & Iterative Exploration through a Virtual Pottery Application

Extracting Hand Grasp & Motion for Intent Expression in Mid-Air Shape Deformation: A Concrete & Iterative Exploration through a Virtual Pottery Application

Vinayak and Karthik Ramani
Computers & Graphics, Volume 55, April 2016, Pages 143-156, ISSN 0097-8493, (http://dx.doi.org/10.1016/j.cag.2015.10.012.)

We describe the iterative design and evaluation of a geometric interaction technique for bare-hand mid-air virtual pottery. We model the shaping of a pot as a gradual and progressive convergence of the pot-profile to the shape of the user's hand...

A Collaborative Filtering Approach to Real-Time Hand Pose Estimation

A Collaborative Filtering Approach to Real-Time Hand Pose Estimation

Chiho Choi, Ayan Sinha, Joon Hee Choi, Sujin Jang, and Karthik Ramani
In Proc. IEEE International Conference on Computer Vision (ICCV) 2015, Santiago, Chile.

Collaborative filtering aims to predict unknown user ratings in a recommender system by collectively assessing known user preferences. In this paper, we first draw analogies between collaborative filtering and the pose estimation problem....

Empirical Studies of Functional Decomposition in Early Design

Empirical Studies of Functional Decomposition in Early Design

Joran W. Booth, Ahbinav Bhasin, Tahira Reid, and Karthik Ramani
Proceedings of the ASME 2015 International Design Engineering Technical Conferences & Computers and Information in Engineering Conference, IDETC/CIE 2015 August 2-5, 2015, Boston, Massachusetts, USA

This paper explores functional decomposition in early design. In the first part of this study, we explore how the three most common methods (top-down, energy-flow, enumeration) affect concept generation for novice design teams (n=25). We found that...

Mutually coordinated visualization of product and supply chain metadata for sustainable design

Mutually coordinated visualization of product and supply chain metadata for sustainable design

William Z. Bernstein, Devarajan Ramanujan, Devadatta M. Kulkarni, Jeffrey Tew, Niklas Elmqvist, Fu Zhao and Karthik Ramani
Journal of Mechanical Design

Abstract: In this paper, we present a novel visualization framework for product and supply chain metadata in the context of redesign-related decision scenarios. Our framework is based on the idea of overlaying product-related metadata onto...

Sketcholution: Interaction Histories for Sketching

Sketcholution: Interaction Histories for Sketching

International Journal of Human-Computer Studies, 82 (2015) 11–20

Abstract: We present Sketcholution, a method for automatically creating visual histories of hand-drawn sketches. Such visual histories are useful for a designer to reflect on a sketch, communicate ideas to others, and fork from or revert to an...

Informing Early Design Via Crowd-based Co-creation

Informing Early Design Via Crowd-based Co-creation

Abstract: Customer inputs in the early stages of design can potentially lead to completely new outlooks in concept generation. We propose crowd-based co-creation as a means to this end. Our main idea is to think of the customer as a source of...

HandiMate: Create and Animate using everyday objects

HandiMate: Create and Animate using everyday objects

Abstract: The combination of technological progress and a growing interest in design has promoted the prevalence of DIY (Do It Yourself) and craft activities. In a similar spirit, we introduce HandiMate, a platform that makes it easier to fabricate...

BendID: Flexible Interface for Localized Deformation Recognition

BendID: Flexible Interface for Localized Deformation Recognition

Abstract: We present BendID, a bendable input device that recognizes the location, magnitude and direction of its deformation. We use BendID to provide users with a tactile metaphor for pressure based input. The device is constructed by layering an...

KINETOGAMI, A Reconfigurable and Printable Sheet Folding

KINETOGAMI, A Reconfigurable and Printable Sheet Folding

Abstract: As an ancient paper craft originating from Japan, origami has been naturally embedded and contextualized in a variety of applications in the fields of mathematics, engineering, food packaging, and biological design. The computational and...

Collaborative Sketching with skWiki: A Case Study

Collaborative Sketching with skWiki: A Case Study

Abstract: Sketching for conceptual design has traditionally been performed on paper. Recent computational tools for conceptual design have leveraged the availability of hand-held computing devices and web-based collaborative platforms. Further,...

ViSER: Visualizing supply chains for eco-conscious redesign

ViSER: Visualizing supply chains for eco-conscious redesign

Abstract: In this paper, we present ViSER, an interactive visual analytics platform that visualizes supply chain data for enabling eco-conscious redesign. ViSER provides a visualization dashboard consisting of multiple mutually coordinated views...

ChiroBot: Modular-Robotic Manipulation via Spatial Hand Gestures.

ChiroBot: Modular-Robotic Manipulation via Spatial Hand Gestures.

Abstract: We introduce ChiroBot, a cyber-physical construction kit that allows users to create custom robots out of craft material, easily assemble the robots using joint modules and control them using hand gestures. These hand-crafted robots are...