Recent Publications

Ayan

SurfNet: Generating 3D shape surfaces using deep residual networks

Sinha, A., Unmesh, A., Huang, Q., and Ramani, K
Continue reading...
BikeGesture

BikeGesture: User Elicitation and Performance of Micro Hand Gesture as Input for Cycling

Yanke Tan, Sang Ho Yoon, Karthik Ramani
In Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA' 17), Denver, CO, May 6-11, 2017
viz

VizScribe: A visual analytics approach to understand designer behavior

Chandrasegaran, S., Badam, S. K., Kisselburgh, L., Peppler, K., Elmqvist, N., and Ramani, K.
International Journal of Human-Computer Studies, 100, April 2017, pp. 66 -- 80.
PDF
CumulativeFatigue_CHI17_Thumbnail

Modeling Cumulative Arm Fatigue in Mid-Air Interaction based on Perceived Exertion and Kinetics of Arm Motion

Sujin Jang, Wolfgang Stuerzlinger, Satyajit Ambike, Karthik Ramani
In Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI), Denver, CO, May 6-11, 2017 (Acceptance Rate: 25%)
wire-fig-12-30

WireFab: Mix-Dimension Modeling and Fabrication for 3D Mesh Models

Min Liu, Yunbo Zhang, Jing Bai, Yuanzhi Cao, Jeffrey Alperovich, Karthik Ramani
We propose WireFab, a rapid modeling and prototyping system that uses bent metal wires as the structure framework. WireFab approximates both the skeletal articulation and… Continue reading...
window-shaping-sui

Window-Shaping: 3D Design Ideation by Creating on, Borrowing from, and Looking at the Physical World

Ke Huo, Vinayak, Karthik Ramani
In Proceedings of the TEI'17: Tenth International Conference on Tangible, Embedded, and Embodied Interaction. ACM. (TEI'17) , Yokohama, Japan, Mar., 2017
PDF PDF
banner_v2

Co-3Deator: A Team-First Collaborative 3D Design Ideation Tool

Cecil Piya, Vinayak, Senthil Chandrasegaran, Niklas Elmqvist, Karthik Ramani
In Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI 2017), Denver, CO, May 6-11, 2017 (Acceptance Rate: 25%)
deconvolving

Deconvolving Feedback Loops in Recommender Systems

Ayan Sinha, David F. Gleich, Karthik Ramani
In Proceedings of the Thirtieth Annual Conference on Neural Information Processing Systems (NIPS'16) , Barcelona, Spain, 2016
PDF
TRing2_UIST

TRing: Instant and Customizable Interactions with Objects Using an Embedded Magnet and a Finger-Worn Device

Sang Ho Yoon, Yunbo Zhang, Ke Huo, Karthik Ramani
In Proceedings of the 29th Annual ACM Symposium on User Interface Software & Technology (UIST'16) , Tokyo, Japan, 2016 (Acceptance Rate: 20.6%)
PDF PDF
img_eccv

Deep Learning 3D Shape Surfaces using Geometry Images

Ayan SInha, Jing Bai, Karthik Ramani
The 14th European Conference on Computer Vision, October 11-14, 2016, Amsterdam, The Netherlands.
PDF
Banner

FEASY: A Sketch-based Tool for Finite Element Analysis

Sundar Murugappan, Cecil Piya, Maria C. Yang, Karthik Ramani
Journal of Computing and Information Science in Engineering, Volume 16, Issue 3, September 2016
PDF PDF
TCBB

The intrinsic geometric structure of protein-protein interaction networks for protein interaction prediction

Yi Fang, Mengtian Sun, Guoxian Dai, and Karthik Ramani
IEEE/ACM Transactions on Computational Biology and Bioinformatics (TCBB) TCBB Homepage archive Volume 13 Issue 1, January/February 2016 Pages 76-85
PDF
thumbnail

Proto-TAI++: Exploring perceptually consistent creation of planar shape assemblies through multi-modal tangible interactions

Cecil Piya, Vinayak, Karthik Ramani
Journal of Computing and Information Science in Engineering, Volume 16, Issue 3, September 2016
PDF PDF
Picture5

DeepHand: Robust Hand Pose Estimation by Completing a Matrix Imputed with Deep Features

Ayan Sinha*, Chiho Choi*, and Karthik Ramani (* denotes equal contribution)
In Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2016, Las Vegas, USA.
PDF PDF
main_figure1

RealFusion: An Interactive Workflow for Repurposing Real-World Objects towards Early-stage Creative Ideation

Cecil Piya, Vinayak, Yunbo Zhang, Karthik Ramani
In Proceedings of Graphics Interface 2016, Victoria, BC, Canada
PDF PDF
CardBoardiZer

CardBoardiZer: Creatively Customize, Articulate and Fold 3D Mesh Models

Yunbo Zhang,Wei Gao, Luis Paredes, Karthik Ramani
Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (pp. 897-907). ACM.
PDF PDF
PMC_Thumnail

Wearable Textile Input Device with Multimodal Sensing for Eyes-Free Mobile Interaction during Daily Activities

Sang Ho Yoon, Ke Huo, Karthik Ramani
Pervasive and Mobile Computing (2016), 33, 17-31
PDF PDF
cubimorph

Cubimorph: Designing Modular Handheld Shape Changing Devices for End-Users

Roudaut, Anne and Krusteva, Diana and Karnik, Abhijit Anil and McCoy, Mike and Ramani, Karthik and Subramanian, Sriram
The International Conference on Robotics and Automation (ICRA) 2016, Stockholm, Sweden.
PDF PDF
TMotion

TMotion: Embedded 3D Mobile Input using Magnetic Sensing Technique

Sang Ho Yoon, Ke Huo, Karthik Ramani
In Proceedings of the 10th International Conference on Tangible, Embedded, and Embodied Interaction (TEI'16), Eindhoven, Netherlands, 2016 (Acceptance Rate: 27%)
PDF PDF
MobiSweep_FeatureImg

MobiSweep: Exploring Spatial Design Ideation Using a Smartphone as a Hand-held Reference Plane

Vinayak, Devarajan Ramanujan, Cecil Piya, Karthik Ramani
In Proceedings of the Tenth International Conference on Tangible, Embedded, and Embodied Interaction, Netherlands, 2016
PDF PDF
CAG2015

Extracting Hand Grasp & Motion for Intent Expression in Mid-Air Shape Deformation: A Concrete & Iterative Exploration through a Virtual Pottery Application

Vinayak and Karthik Ramani
Computers & Graphics, Volume 55, April 2016, Pages 143-156, ISSN 0097-8493, (http://dx.doi.org/10.1016/j.cag.2015.10.012.)
PDF PDF
fig

A Collaborative Filtering Approach to Real-Time Hand Pose Estimation

Chiho Choi, Ayan Sinha, Joon Hee Choi, Sujin Jang, and Karthik Ramani
In Proc. IEEE International Conference on Computer Vision (ICCV) 2015, Santiago, Chile.
PDF PDF
Picture2

Empirical Studies of Functional Decomposition in Early Design

Joran W. Booth, Ahbinav Bhasin, Tahira Reid, and Karthik Ramani
Proceedings of the ASME 2015 International Design Engineering Technical Conferences & Computers and Information in Engineering Conference, IDETC/CIE 2015 August 2-5, 2015, Boston, Massachusetts, USA
PDF
RevoMaker

RevoMaker: Enabling Multi-directional and Functionally-embedded 3D Printing using a Rotational Cuboidal Platform

Wei Gao*, Yunbo Zhang*, Diogo C. Nazzetta, Karthik Ramani, Raymond J. Cipra
Continue reading...
MotionFlow for pattern analysis of human motion data. (a) Pose tree: a simplified representation of multiple motion sequences
aggregating the same transitions into a tree diagram. (b) A window dedicated to show a subtree structure based on a query. (c)
Space-filling treemap representation of the motion sequence data using slice-and-dice layout. (d) Node-link diagram of pose
clusters (nodes) and transitions (links) between them. This view supports interactive partition-based pose clustering. (e) Multi-tab
interface for storing unique motion patterns. (f) Animations of single or multiple selected human motions.

MotionFlow: Visual Abstraction and Aggregation of Sequential Patterns in Human Motion Tracking Data

Abstract: Pattern analysis of human motions, which is useful in many research areas, requires understanding and comparison of different styles of motion patterns. However, working… Continue reading...
screenShot4

A framework for visualization-driven eco-conscious design exploration

Abstract: A large portion of design activity involves reuse of previous knowledge in order to solve new problems. Therefore, facilitating eco-conscious exploration of archived designs… Continue reading...
ViSER_screenshot

Mutually coordinated visualization of product and supply chain metadata for sustainable design

William Z. Bernstein, Devarajan Ramanujan, Devadatta M. Kulkarni, Jeffrey Tew, Niklas Elmqvist, Fu Zhao and Karthik Ramani
Journal of Mechanical Design
Handimate_IDC

HandiMate: Exploring a Modular Robotics kit for Animating Crafted Toys

Abstract: Building from our previous work we explore HandiMate, a robotics kit which enables users to construct and animate their toys using everyday craft materials.… Continue reading...
FrontFig

The Status, Challenges, and Future of Additive Manufacturing in Engineering

Abstract: Additive manufacturing (AM) is poised to bring about a revolution in the way products are designed, manufactured, and distributed to end users. This technology… Continue reading...
gi2015

Hand Grasp and Motion for Intent Expression in Mid-Air Virtual Pottery

Abstract: We describe the design and evaluation of a geometric interaction technique for bare-hand mid-air virtual pottery. We model the shaping of a pot as… Continue reading...
Proximal Persistence

A Gesture-free Geometric Approach for Mid-Air Expression of Design Intent

Abstract: The advent of depth cameras has enabled mid-air interactions for shape modeling with bare hands. Typically, these interactions employ a finite set of pre-defined… Continue reading...
sketcholution

Sketcholution: Interaction Histories for Sketching

International Journal of Human-Computer Studies, 82 (2015) 11–20
Abstract: We present Sketcholution, a method for automatically creating visual histories of hand-drawn sketches. Such visual histories are useful for a designer to reflect on… Continue reading...
interface_v2

Informing Early Design Via Crowd-based Co-creation

Abstract: Customer inputs in the early stages of design can potentially lead to completely new outlooks in concept generation. We propose crowd-based co-creation as a… Continue reading...
Handimate_Teaser

HandiMate: Create and Animate using everyday objects

Abstract: The combination of technological progress and a growing interest in design has promoted the prevalence of DIY (Do It Yourself) and craft activities. In… Continue reading...
ponejournal

Heat-Passing Framework for Robust Interpretation of Data in Networks

Abstract: Researchers are regularly interested in interpreting the multipartite structure of data entities according to their functional relationships. Data is often heterogeneous with intricately hidden… Continue reading...
file148-2

TIMMi: Finger-worn Textile Input Device with Multimodal Sensing in Mobile Interaction

Abstract: We introduce TIMMi, a textile input device for mobile interactions. TIMMi is worn on the index finger to provide a multimodal sensing input metaphor.… Continue reading...
Softii

SOFTii: Soft Tangible Interface for Continuous Control of Virtual Objects with Pressure-based Input

Abstract: We present SOFTii, a flexible input system for topography design and continuous control via external force. Our intent is to provide a tactile metaphor… Continue reading...
thumnail

GestureAnalyzer: Visual Analytics for Pattern Analysis of Mid-Air Hand Gestures

Abstract: Understanding the intent behind human gestures is a critical  problem in the design of gestural interactions. A common method to observe and understand how… Continue reading...
Plex

Plex: Finger-Worn Textile Sensor for Mobile Interaction during Activities

Abstract: We present Plex, a finger-worn textile sensor for eyes-free mobile interaction during daily activities. Although existing products like a data glove possess multiple sensing… Continue reading...
BendID

BendID: Flexible Interface for Localized Deformation Recognition

Abstract: We present BendID, a bendable input device that recognizes the location, magnitude and direction of its deformation. We use BendID to provide users with… Continue reading...
100_2888

Art Meets Engineering Design: An Approach for Reducing Sketch Inhibition in Engineers During the Design Process

Abstract: While much prior work has been done regarding sketching and its impact on design and a few on how to train engineers to sketch,… Continue reading...
IMG_0737

Evaluating the Bottom-Up Method for Functional Decomposition in Product Dissection Tasks

Abstract: The purpose of this study is to continue to explore which function identification methods work best for specific design tasks. Prior literature describes the… Continue reading...
AHP_pipeline

Prioritizing Design for Environment Strategies Using a Stochastic Analytic Hierarchy Process

Abstract: This paper describes a framework for applying design for environment (DfE) within an industry setting. Our aim is to couple implicit design knowledge such… Continue reading...
4

KINETOGAMI, A Reconfigurable and Printable Sheet Folding

Abstract: As an ancient paper craft originating from Japan, origami has been naturally embedded and contextualized in a variety of applications in the fields of… Continue reading...
thumbs

Contextualizing Environmental Sustainability in Design Engineering Curricula

Abstract: Consideration of environmental sustainability is significantly altering the nature of the mechanical design process. This necessitates integration of sustainability related learning content in design… Continue reading...
graphical_abstract

PROTO-TAI: Quick Design Prototyping using Tangible Assisted Interfaces

Abstract: In the real world, we use our innate manual dexterity to create and manipulate 3D objects. Conventional virtual design tools largely neglect this skill… Continue reading...
Lateral and vertical transformations observed in the study. Lateral transformations can occur through modification of an existing sketch, or through the creation of a new sketch inspired from an existing sketch, to create a new idea. Vertical transformations can occur through adding details such as dimensions,  annotations, or features to an existing sketch, or through a new sketch showing a different detail, to develop an existing idea.

Collaborative Sketching with skWiki: A Case Study

Abstract: Sketching for conceptual design has traditionally been performed on paper. Recent computational tools for conceptual design have leveraged the availability of hand-held computing devices… Continue reading...
We present a screenshot of the ViSER tool. The supply chain shown is representative of the peripheral computer equipment industry. Each callout points to a specific feature of the ViSER platform and are described as follows: (A) a directed graph that represents the supply chain network as the edges connected to the selected nodes are shown in red, (B) a representation fo the product system graph oriented by a combination of force directed physics and user manipulation, (C) change propagation results for selected nodes of interest, (D) a comparison chart of impact categories for selected nodes of interest, (E) sparklines for each criterion with outliers shown in red and (F) the profile of selected node attributes, e.g.\ time and smog. A video demonstration of ViSER can be found here: \href{http://youtu.be/pDJAqW9H3ME}{\textcolor{blue}{http://youtu.be/pDJAqW9H3ME}}.

ViSER: Visualizing supply chains for eco-conscious redesign

Abstract: In this paper, we present ViSER, an interactive visual analytics platform that visualizes supply chain data for enabling eco-conscious redesign. ViSER provides a visualization… Continue reading...
jcp_2014

Remanufacturing of Turbine Blades by Laser Direct Deposition with Its Energy and Environmental Impact Analysis

Abstract: Laser direct deposition provides an attractive and cost effective means for repairing or remanufacturing high value engineering components. This study demonstrates the successful repair… Continue reading...
3

HexaMorph: A Reconfigurable and Foldable Hexapod Robot Inspired by Origami

Abstract: Origami affords the creation of diverse 3D objects through explicit folding processes from 2D sheets of material. Originally as a paper craft from 17th… Continue reading...