We explore tangible 3D interactions that allow for geometric and perceptual correspondence between a mid-airÂ modality and the 3D elements it controls. To demonstrate our approach, we use a concrete application scenarioÂ through Proto-TAI++, a multi-modal system using pen-based drawing of planar shapes and their subsequent midairÂ assembly via a hand-held planar proxy. The planarity of the proxy is a key element that physically embodiesÂ virtual planar shapes during 3D manipulation. We also investigate advanced operations such as patterning andÂ blending using asymmetric bimanual interactions that augment mid-air motion with multi-touch gestures. We describeÂ a three-stage user evaluation with our system wherein our goal is to (a) study the effectiveness of the planarÂ proxy as a tangible 3D modality, (b) contrast key features of our approach with a GUI-based planar shape assemblyÂ system, and (c) evaluate user experience and performance in creative tasks using Proto-TAI++.
Cecil Piya, Vinayak, Karthik Ramani
Proto-TAI++: Exploring perceptually consistent creation of planar shape assemblies through multi-modal tangible interactions
Journal of Computing and Information Science in Engineering, Volume 16, Issue 3, September 2016