Recent Publications


Integrating Visual Analytics Support for Grounded Theory Practice in Qualitative Text Analysis

Senthil Chandrasegaran, Sriram Karthik Badam, Lorraine Kisselburgh, Karthik Ramani, Niklas Elmqvist
In Proceedings of Eurographics Conference on Visualization (EuroVis) 2017

Merging Sketches for Creative Design Exploration: An Evaluation of Physical and Cognitive Operations

Senthil Chandrasegaran, Sriram Karthik Badam, Ninger Zhou, Zhenpeng Zhao, Lorraine Kisselburgh, Kylie Peppler, Niklas Elmqvist, Karthik Ramani
In proceedings of the 2017 Graphics Interface Conference.
ninger pic

The Influence of Toy Design Activities on Middle School Students’ Understanding of the Engineering Design Processes

Ninger Zhou, Nielsen L. Pereira, Tarun Thomas George, Jeffrey Alperovich, Joran Booth, Senthil Chandrasegaran, Jeffrey David Tew, Devadatta M. Kulkarni, Karthik Ramani
Journal of Science Education and Technology (2017): 1-13.

SurfNet: Generating 3D shape surfaces using deep residual networks

Sinha, A., Unmesh, A., Huang, Q., and Ramani, K
Sinha, A., Unmesh, A., Huang, Q., and Ramani, K., 'SurfNet: Generating 3D shape surfaces using deep residual networks', In proceedings of CVPR, 2017.

BikeGesture: User Elicitation and Performance of Micro Hand Gesture as Input for Cycling

Yanke Tan, Sang Ho Yoon, Karthik Ramani
In Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA' 17: 2147-2154), Denver, CO, May 6-11, 2017

VizScribe: A visual analytics approach to understand designer behavior

Chandrasegaran, S., Badam, S. K., Kisselburgh, L., Peppler, K., Elmqvist, N., and Ramani, K.
International Journal of Human-Computer Studies, 100, April 2017, pp. 66 -- 80.

Modeling Cumulative Arm Fatigue in Mid-Air Interaction based on Perceived Exertion and Kinetics of Arm Motion

Sujin Jang, Wolfgang Stuerzlinger, Satyajit Ambike, Karthik Ramani
In Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI 2017: 3328-3339), Denver, CO, May 6-11, 2017 (Acceptance Rate: 25%)

WireFab: Mix-Dimension Modeling and Fabrication for 3D Mesh Models

Min Liu, Yunbo Zhang, Jing Bai, Yuanzhi Cao, Jeffrey Alperovich, Karthik Ramani
In Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI 2017: 965-976), Denver, CO, May 6-11, 2017 (Acceptance Rate: 25%)

Window-Shaping: 3D Design Ideation by Creating on, Borrowing from, and Looking at the Physical World

Ke Huo, Vinayak, Karthik Ramani
In Proceedings of the TEI'17: Tenth International Conference on Tangible, Embedded, and Embodied Interaction. ACM. (TEI'17: 37-45) , Yokohama, Japan, Mar., 2017

Co-3Deator: A Team-First Collaborative 3D Design Ideation Tool

Cecil Piya, Vinayak, Senthil Chandrasegaran, Niklas Elmqvist, Karthik Ramani
In Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI 2017: 6581-6592), Denver, CO, May 6-11, 2017 (Acceptance Rate: 25%)

Deconvolving Feedback Loops in Recommender Systems

Ayan Sinha, David F. Gleich, Karthik Ramani
In Proceedings of the Thirtieth Annual Conference on Neural Information Processing Systems (NIPS'16) , Barcelona, Spain, 2016

TRing: Instant and Customizable Interactions with Objects Using an Embedded Magnet and a Finger-Worn Device

Sang Ho Yoon, Yunbo Zhang, Ke Huo, Karthik Ramani
In Proceedings of the 29th Annual ACM Symposium on User Interface Software & Technology (UIST'16) , Tokyo, Japan, 2016 (Acceptance Rate: 20.6%)

Deep Learning 3D Shape Surfaces using Geometry Images

Ayan SInha, Jing Bai, Karthik Ramani
The 14th European Conference on Computer Vision, October 11-14, 2016, Amsterdam, The Netherlands.

FEASY: A Sketch-based Tool for Finite Element Analysis

Sundar Murugappan, Cecil Piya, Maria C. Yang, Karthik Ramani
Journal of Computing and Information Science in Engineering, Volume 16, Issue 3, September 2016

The intrinsic geometric structure of protein-protein interaction networks for protein interaction prediction

Yi Fang, Mengtian Sun, Guoxian Dai, and Karthik Ramani
IEEE/ACM Transactions on Computational Biology and Bioinformatics (TCBB) TCBB Homepage archive Volume 13 Issue 1, January/February 2016 Pages 76-85

Proto-TAI++: Exploring perceptually consistent creation of planar shape assemblies through multi-modal tangible interactions

Cecil Piya, Vinayak, Karthik Ramani
Journal of Computing and Information Science in Engineering, Volume 16, Issue 3, September 2016

DeepHand: Robust Hand Pose Estimation by Completing a Matrix Imputed with Deep Features

Ayan Sinha*, Chiho Choi*, and Karthik Ramani (* denotes equal contribution)
In Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2016, Las Vegas, USA.

RealFusion: An Interactive Workflow for Repurposing Real-World Objects towards Early-stage Creative Ideation

Cecil Piya, Vinayak, Yunbo Zhang, Karthik Ramani
In Proceedings of Graphics Interface 2016, Victoria, BC, Canada

CardBoardiZer: Creatively Customize, Articulate and Fold 3D Mesh Models

Yunbo Zhang,Wei Gao, Luis Paredes, Karthik Ramani
Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (pp. 897-907). ACM.

Wearable Textile Input Device with Multimodal Sensing for Eyes-Free Mobile Interaction during Daily Activities

Sang Ho Yoon, Ke Huo, Karthik Ramani
Pervasive and Mobile Computing (2016), 33, 17-31

Cubimorph: Designing Modular Handheld Shape Changing Devices for End-Users

Roudaut, Anne and Krusteva, Diana and Karnik, Abhijit Anil and McCoy, Mike and Ramani, Karthik and Subramanian, Sriram
The International Conference on Robotics and Automation (ICRA) 2016, Stockholm, Sweden.

TMotion: Embedded 3D Mobile Input using Magnetic Sensing Technique

Sang Ho Yoon, Ke Huo, Karthik Ramani
In Proceedings of the 10th International Conference on Tangible, Embedded, and Embodied Interaction (TEI'16), Eindhoven, Netherlands, 2016 (Acceptance Rate: 27%)

MobiSweep: Exploring Spatial Design Ideation Using a Smartphone as a Hand-held Reference Plane

Vinayak, Devarajan Ramanujan, Cecil Piya, Karthik Ramani
In Proceedings of the Tenth International Conference on Tangible, Embedded, and Embodied Interaction, Netherlands, 2016

Extracting Hand Grasp & Motion for Intent Expression in Mid-Air Shape Deformation: A Concrete & Iterative Exploration through a Virtual Pottery Application

Vinayak and Karthik Ramani
Computers & Graphics, Volume 55, April 2016, Pages 143-156, ISSN 0097-8493, (

A Collaborative Filtering Approach to Real-Time Hand Pose Estimation

Chiho Choi, Ayan Sinha, Joon Hee Choi, Sujin Jang, and Karthik Ramani
In Proc. IEEE International Conference on Computer Vision (ICCV) 2015, Santiago, Chile.

Empirical Studies of Functional Decomposition in Early Design

Joran W. Booth, Ahbinav Bhasin, Tahira Reid, and Karthik Ramani
Proceedings of the ASME 2015 International Design Engineering Technical Conferences & Computers and Information in Engineering Conference, IDETC/CIE 2015 August 2-5, 2015, Boston, Massachusetts, USA

RevoMaker: Enabling Multi-directional and Functionally-embedded 3D Printing using a Rotational Cuboidal Platform

Wei Gao*, Yunbo Zhang*, Diogo C. Nazzetta, Karthik Ramani, Raymond J. Cipra
Continue reading...
MotionFlow for pattern analysis of human motion data. (a) Pose tree: a simplified representation of multiple motion sequences
aggregating the same transitions into a tree diagram. (b) A window dedicated to show a subtree structure based on a query. (c)
Space-filling treemap representation of the motion sequence data using slice-and-dice layout. (d) Node-link diagram of pose
clusters (nodes) and transitions (links) between them. This view supports interactive partition-based pose clustering. (e) Multi-tab
interface for storing unique motion patterns. (f) Animations of single or multiple selected human motions.

MotionFlow: Visual Abstraction and Aggregation of Sequential Patterns in Human Motion Tracking Data

Abstract: Pattern analysis of human motions, which is useful in many research areas, requires understanding and comparison of different styles of motion patterns. However, working… Continue reading...

A framework for visualization-driven eco-conscious design exploration

Abstract: A large portion of design activity involves reuse of previous knowledge in order to solve new problems. Therefore, facilitating eco-conscious exploration of archived designs… Continue reading...

Mutually coordinated visualization of product and supply chain metadata for sustainable design

William Z. Bernstein, Devarajan Ramanujan, Devadatta M. Kulkarni, Jeffrey Tew, Niklas Elmqvist, Fu Zhao and Karthik Ramani
Journal of Mechanical Design

HandiMate: Exploring a Modular Robotics kit for Animating Crafted Toys

Abstract: Building from our previous work we explore HandiMate, a robotics kit which enables users to construct and animate their toys using everyday craft materials.… Continue reading...

The Status, Challenges, and Future of Additive Manufacturing in Engineering

Abstract: Additive manufacturing (AM) is poised to bring about a revolution in the way products are designed, manufactured, and distributed to end users. This technology… Continue reading...

Hand Grasp and Motion for Intent Expression in Mid-Air Virtual Pottery

Abstract: We describe the design and evaluation of a geometric interaction technique for bare-hand mid-air virtual pottery. We model the shaping of a pot as… Continue reading...
Proximal Persistence

A Gesture-free Geometric Approach for Mid-Air Expression of Design Intent

Abstract: The advent of depth cameras has enabled mid-air interactions for shape modeling with bare hands. Typically, these interactions employ a finite set of pre-defined… Continue reading...

Sketcholution: Interaction Histories for Sketching

International Journal of Human-Computer Studies, 82 (2015) 11–20
Abstract: We present Sketcholution, a method for automatically creating visual histories of hand-drawn sketches. Such visual histories are useful for a designer to reflect on… Continue reading...

Informing Early Design Via Crowd-based Co-creation

Abstract: Customer inputs in the early stages of design can potentially lead to completely new outlooks in concept generation. We propose crowd-based co-creation as a… Continue reading...

HandiMate: Create and Animate using everyday objects

Abstract: The combination of technological progress and a growing interest in design has promoted the prevalence of DIY (Do It Yourself) and craft activities. In… Continue reading...

Heat-Passing Framework for Robust Interpretation of Data in Networks

Abstract: Researchers are regularly interested in interpreting the multipartite structure of data entities according to their functional relationships. Data is often heterogeneous with intricately hidden… Continue reading...

TIMMi: Finger-worn Textile Input Device with Multimodal Sensing in Mobile Interaction

Abstract: We introduce TIMMi, a textile input device for mobile interactions. TIMMi is worn on the index finger to provide a multimodal sensing input metaphor.… Continue reading...

SOFTii: Soft Tangible Interface for Continuous Control of Virtual Objects with Pressure-based Input

Abstract: We present SOFTii, a flexible input system for topography design and continuous control via external force. Our intent is to provide a tactile metaphor… Continue reading...

GestureAnalyzer: Visual Analytics for Pattern Analysis of Mid-Air Hand Gestures

Abstract: Understanding the intent behind human gestures is a critical  problem in the design of gestural interactions. A common method to observe and understand how… Continue reading...

Plex: Finger-Worn Textile Sensor for Mobile Interaction during Activities

Abstract: We present Plex, a finger-worn textile sensor for eyes-free mobile interaction during daily activities. Although existing products like a data glove possess multiple sensing… Continue reading...

BendID: Flexible Interface for Localized Deformation Recognition

Abstract: We present BendID, a bendable input device that recognizes the location, magnitude and direction of its deformation. We use BendID to provide users with… Continue reading...

Art Meets Engineering Design: An Approach for Reducing Sketch Inhibition in Engineers During the Design Process

Abstract: While much prior work has been done regarding sketching and its impact on design and a few on how to train engineers to sketch,… Continue reading...

Evaluating the Bottom-Up Method for Functional Decomposition in Product Dissection Tasks

Abstract: The purpose of this study is to continue to explore which function identification methods work best for specific design tasks. Prior literature describes the… Continue reading...

Prioritizing Design for Environment Strategies Using a Stochastic Analytic Hierarchy Process

Abstract: This paper describes a framework for applying design for environment (DfE) within an industry setting. Our aim is to couple implicit design knowledge such… Continue reading...

KINETOGAMI, A Reconfigurable and Printable Sheet Folding

Abstract: As an ancient paper craft originating from Japan, origami has been naturally embedded and contextualized in a variety of applications in the fields of… Continue reading...

Contextualizing Environmental Sustainability in Design Engineering Curricula

Abstract: Consideration of environmental sustainability is significantly altering the nature of the mechanical design process. This necessitates integration of sustainability related learning content in design… Continue reading...

PROTO-TAI: Quick Design Prototyping using Tangible Assisted Interfaces

Abstract: In the real world, we use our innate manual dexterity to create and manipulate 3D objects. Conventional virtual design tools largely neglect this skill… Continue reading...
Lateral and vertical transformations observed in the study. Lateral transformations can occur through modification of an existing sketch, or through the creation of a new sketch inspired from an existing sketch, to create a new idea. Vertical transformations can occur through adding details such as dimensions,  annotations, or features to an existing sketch, or through a new sketch showing a different detail, to develop an existing idea.

Collaborative Sketching with skWiki: A Case Study

Abstract: Sketching for conceptual design has traditionally been performed on paper. Recent computational tools for conceptual design have leveraged the availability of hand-held computing devices… Continue reading...