In the real world, we use our innate manual dexterity to createÂ and manipulate 3D objects. Conventional virtual design toolsÂ largely neglect this skill by imposing non-intuitive 2D controlÂ mechanisms for interacting with 3D design models. Their usageÂ is thus cumbersome, time consuming and requires training. WeÂ propose a novel design paradigm that combines usersâ€™ manualÂ dexterity with the physical affordances of non-instrumented andÂ ordinary objects to support virtual 3D design constructions. WeÂ demonstrate this paradigm through Proto-TAI, a quick prototypingÂ application where 2D shapes are assembled into 3D representationsÂ of ideated design concepts. Here, users can create 2DÂ shapes in a pen-based sketch medium and use expressive handheldÂ movements of a planar proxy to configure the shapes in 3DÂ space. The proxy provides a metaphorical means for possessingÂ and controlling the shapes. Here, a depth sensor and computerÂ vision algorithms track the proxyâ€™s spatial movement. The 3D designÂ prototype constructed in our system can be fabricated usingÂ a laser cutter and physically assembled on-the-fly. Our systemÂ has vast implications in many design and assembly contexts, andÂ we demonstrate its usability and efficacy through user studiesÂ and evaluations.
Link To PDF:Â DETC2014-35442