Rapid advances in production systems’ models and technology continually challenge manufacturers preparing for the factories of the future. To address the complexity issues typically coupled with the improvements, we have developed a brain-inspired...
V.Ra: An In-Situ Visual Authoring System for Robot-IoT Task Planning with Augmented Reality
We present V.Ra, a visual and spatial programming system for robot-IoT task authoring. In V.Ra, programmable mobile robots serve as binding agents to link the stationary IoTs and perform collaborative tasks. We establish an ecosystem that...
V.Ra: An In-Situ Visual Authoring System for Robot-IoT Task Planning with Augmented Reality
We present V.Ra, a visual and spatial programming system for robot-IoT task authoring. In V.Ra, programmable mobile robots serve as binding agents to link the stationary IoTs and perform collaborative tasks. We establish an ecosystem that...
Big data driven jobs remaining time prediction in discrete manufacturing system: a deep learning-based approach
Implementing advanced big data (BD) analytic is significant for successful incorporation of artificial intelligence in manufacturing. With the widespread deployment of smart sensors and internet of things (IOT) in the job shop, there is an...
Shape Structuralizer: Design, Fabrication, and User-driven Iterative Refinement of 3D Mesh Models
Current Computer-Aided Design (CAD) tools lack proper support for guiding novice users towards designs ready for fabrication. We propose Shape Structuralizer (SS), an interactive design support system that repurposes surface models into structural...
Deep Learning 3D Shapes Using ALT-AZ Anisotropic 2-Sphere Convolution
The ground-breaking performance obtained by deep convolutional neural networks (CNNs) for image processing tasks is inspiring research efforts attempting to extend it for 3D geometric tasks. One of the main challenge in applying CNNs to 3D shape...
SynchronizAR: Instant Synchronization for Spontaneous and Spatial Collaborations in Augmented Reality
We present SynchronizAR, an approach to spatially register multiple SLAM devices together without sharing maps or involving external tracking infrastructures. SynchronizAR employs a distance based indirect registration which resolves the...
Integrating environmental sustainability in undergraduate mechanical engineering courses using guided discovery instruction
MultiSoft: Soft Sensor Enabling Real-Time Multimodal Sensing with Contact Localization and Deformation Classification
Abstract: We introduce MultiSoft, a multilayer soft sensor capable of sensing real-time contact localization, classification of deformation types, and estimation of deformation magnitudes. We propose a multimodal sensing pipeline that carries out...
Gauss’s law for networks directly reveals community boundaries
The study of network topology provides insight into the function and behavior of physical, social, and biological systems. A natural step towards discovering the organizing principles of these complex topologies is to identify a reduced network...
Toying With Design: Experiencing Design for Rapid Prototyping Using Mini-Fabrication Exercises
This study explores the use of mini-fabrication exercises for helping students learn design for rapid prototyping in computeraided design and prototyping courses in engineering curricula. To this end, we conducted mini-fabrication exercises in...
Plain2Fun: Augmenting Ordinary Objects with Interactive Functions by Auto-Fabricating Surface Painted Circuits
The growing makers’ community demands better supports for designing and fabricating interactive functional objects. Most of the current approaches focus on embedding desired functions within new objects. Instead, we advocate repurposing the...
Scenariot: Spatially Mapping Smart Things Within Augmented Reality Scenes
The emerging simultaneous localizing and mapping (SLAM) based tracking technique allows the mobile AR device spatial awareness of the physical world. Still, smart things are not fully supported with the spatial awareness in AR. Therefore, we...
Plain2Fun: Augmenting Ordinary Objects with Interactive Functions by Auto-Fabricating Surface Painted Circuits
The growing makers’ community demands better supports for designing and fabricating interactive functional objects. Most of the current approaches focus on embedding desired functions within new objects. Instead, we advocate re-purposing the...
Ani-Bot: A Modular Robotics System Supporting Creation, Tweaking, and Usage with Mixed-Reality Interactions
3D Object Classification via Spherical Projections
In this paper, we introduce a new method for classifying 3D objects. Our main idea is to project a 3D object onto a spherical domain centered around its barycenter and develop neural network to classify the spherical projection. We introduce two...
Ani-Bot: A Mixed-Reality Ready Modular Robotics System
iSoft: A Customizable Soft Sensor with Real-time Continuous Contact and Stretching Sensing
We present iSoft, a single volume soft sensor capable of sensing real-time continuous contact and unidirectional stretching. We propose a low-cost and an easy way to fabricate such piezoresistive elastomer-based soft sensors for instant...
Robust Hand Pose Estimation during the Interaction with an Unknown Object
Abstract: This paper proposes a robust solution for accurate 3D hand pose estimation in the presence of an external object interacting with hands. Our main insight is that the shape of an object causes a configuration of the hand in the form of a...
Learning Hand Articulations by Hallucinating Heat Distribution
We propose a robust hand pose estimation method by learning hand articulations from depth features and auxiliary modality features. As an additional modality to depth data, we present a function of geometric properties on the surface of the hand...
Design Patterns for Visualization-Based Tools in Sustainable Product Design
Most design activities involve exploring and comparing existing designs. Thus, adopting an eco-conscious approach in the design exploration process can aid environmentally sustainable product design (SPD). One approach for supporting exploration in...
Visual Analytics Tools for Sustainable Lifecycle Design: Current Status, Challenges, and Future Opportunities.
The rapid rise in technologies for data collection has created an unmatched opportunity to advance the use of data-rich tools for lifecycle decision-making. However, the usefulness of these technologies is limited by the ability to translate...
The Design for Additive Manufacturing Worksheet (Conference)
Additive manufacturing (AM) technologies have become integral to the modern manufacturing process. These roles are filled both in prototyping and production. Many studies have been conducted and lists been written on guidelines for AM. While these...
The Design for Additive Manufacturing Worksheet
Additive manufacturing (AM) technologies have become integral to modern prototyping and manufacturing. Therefore, guidelines for using AM are necessary to help users new to the technology. Many others have proposed useful guidelines, but these are...
Secure Collaboration in Engineering Systems Design
The goal in this paper is to enable collaboration in the co-design of engineering artifacts when participants are reluctant to share their design-related confidential and proprietary information with other co-designers, even though such information...
Integrating Visual Analytics Support for Grounded Theory Practice in Qualitative Text Analysis
We present an argument for using visual analytics to aid Grounded Theory methodologies in qualitative data analysis. Grounded theory methods involve the inductive analysis of data to generate novel insights and theoretical constructs. Making sense...
Merging Sketches for Creative Design Exploration: An Evaluation of Physical and Cognitive Operations
Despite its grounding in creativity techniques, merging multiple source sketches to create new ideas has received scant attention in design literature. In this paper, we identify the physical operations that in merging sketch components. We also...
The Influence of Toy Design Activities on Middle School Students Understanding of the Engineering Design Processes
The societal demand for inspiring and engaging science, technology, engineering, and mathematics (STEM) students and preparing our workforce for the emerging creative economy has necessitated developing students self-efficacy and understanding of...
SurfNet: Generating 3D shape surfaces using deep residual networks
3D shape models are naturally parameterized using vertices and faces, i.e., composed of polygons forming a surface. However, current 3D learning paradigms for predictive and generative tasks using convolutional neural networks focus on a...
Product personalization enabled by assembly architecture and cyber physical systems
Personalization is an emerging manufacturing paradigm towards meeting diversified customer needs. This paper proposes a framework for producing personalized products efficiently. An approach for optimal mix of different module types is proposed in...
BikeGesture: User Elicitation and Performance of Micro Hand Gesture as Input for Cycling
Abstract: The use of hand gestures has a potential as a promising input metaphor. Wearables like smart textile and data gloves can provide hand gesture recognition to potentially replace, augment or improve existing input methods. Although recent...
VizScribe: A visual analytics approach to understand designer behavior
Design protocol analysis is a technique to understand designers’ cognitive processes by analyzing sequences of observations on their behavior. These observations typically use audio, video, and transcript data in order to gain insights into the...
Modeling Cumulative Arm Fatigue in Mid-Air Interaction based on Perceived Exertion and Kinetics of Arm Motion
Quantifying cumulative arm muscle fatigue is a critical factor in understanding, evaluating, and optimizing user experience during prolonged mid-air interaction. A reasonably accurate estimation of fatigue requires an estimate of an individual's...
WireFab: Mix-Dimensional Modeling and Fabrication for 3D Mesh Models
We propose WireFab, a rapid modeling and prototyping system that uses bent metal wires as the structure framework. WireFab approximates both the skeletal articulation and the skin appearance of the corresponding virtual skin meshes, and it allows...
Window-Shaping: 3D Design Ideation by Creating on, Borrowing from, and Looking at the Physical World
We present, Window-Shaping, a tangible mixed-reality (MR) interaction metaphor for design ideation that allows for the direct creation of 3D shapes on and around physical objects. Using the sketch-and-inflate scheme, our metaphor enables quick...
Co-3Deator: A Team-First Collaborative 3D Design Ideation Tool
We present Co-3Deator, a sketch-based collaborative 3D modeling system based on the notion of "team-first" ideation tools, where the needs and processes of the entire design team come before that of an individual designer. Co-3Deator includes two...
Deconvolving Feedback Loops in Recommender Systems
Collaborative filtering is a popular technique to infer users' preferences on new content based on the collective information of all users preferences. Recommender systems then use this information to make personalized suggestions to users. When...
Window-Shaping: 3D Design Ideation in Mixed Reality
We present, Window-Shaping, a mobile, markerless, mixed-reality (MR) interface for creative design ideation that allows for the direct creation of 3D shapes on and around physical objects. Using the sketch-and-inflate scheme, we present a design...
TRing: Instant and Customizable Interactions with Objects Using an Embedded Magnet and a Finger-Worn Device
We present TRing, a finger-worn input device which provides instant and customizable interactions. TRing offers a novel method for making plain objects interactive using an embedded magnet and a finger-worn device. With a particle filter integrated...
Developing Middle School Students’ Engineering Design Concepts through Toy Design Workshop
In this study, we structured a toy design workshop to provide hands on and engaging design activities for middle school students, to help them develop self-efficacy beliefs in design, model and scaffold engineering design mindsets, and apply design...
Deep Learning 3D Shape Surfaces using Geometry Images
Surfaces serve as a natural parametrization to 3D shapes. Learning surfaces using convolutional neural networks (CNNs) is a challenging task. Current paradigms to tackle this challenge are to either adapt the convolutional filters to operate on...
shapeSIFT: Evaluating InfoVis Tools for Eco-Conscious Design
In this paper, we present the methodology and results from the evaluation of shapeSIFT: a multi-dimensional visualization tool for exploring part repositories in the context of eco-conscious design. The goals of this work are twofold, to create a...
FEAsy: A Sketch-Based Tool for Finite Element Analysis
Freehand sketching is an integral part of early design process. Recent years have seen an increased interest in supporting sketching in computer-based design systems. In this paper, we present finite element analysis made easy (FEAsy), a...
The intrinsic geometric structure of protein-protein interaction networks for protein interaction prediction
Recent developments in high-throughput technologies for measuring protein-protein interaction (PPI) have profoundly advanced our ability to systematically infer protein function and regulation. However, inherently high false positive and false...
Proto-TAI++: Exploring Perceptually Consistent Creation of Planar Shape Assemblies Through Multimodal Tangible Interactions
We explore tangible 3D interactions that allow for geometric and perceptual correspondence between a midair modality and the 3D elements it controls. To demonstrate our approach, we use a concrete application scenario through Proto-TAI++, a...
DeepHand: Robust Hand Pose Estimation by Completing a Matrix Imputed with Deep Features
We propose DeepHand to estimate the 3D pose of a hand using depth data from commercial 3D sensors. We discriminatively train convolutional neural networks to output a low dimensional activation feature given a depth map. This activation feature...
The Design For Additive Manufacturing Worksheet
Abstract: Additive manufacturing (AM) technologies have become integral to the modern manufacturing process. These roles are filled both in prototyping and production. Many studies have been conducted and lists been written on guidelines for AM....
RealFusion: An Interactive Workflow for Repurposing Real-World Objects towards Early-stage Creative Ideation
We present RealFusion, an interactive workflow that supports early stage design ideation in a digital 3D medium. RealFusion is inspired by the practice of found-object-art, wherein new representations are created by composing existing objects. The...
CardBoardiZer: Creatively Customize, Articulate and Fold 3D Mesh Models
Wearable Textile Input Device with Multimodal Sensing for Eyes-Free Mobile Interaction during Daily Activities
As pervasive computing is widely available during daily activities, wearable input devices which promote an eyes-free interaction are needed for easy access and safety. We propose a textile wearable device which enables a multimodal sensing input...