We explore tangible 3D interactions that allow for geometric and perceptual correspondence between a mid-air modality and the 3D elements it controls. To demonstrate our approach, we use a concrete application scenario through Proto-TAI++, a multi-modal system using pen-based drawing of planar shapes and their subsequent midair assembly via a hand-held planar proxy. The planarity of the proxy is a key element that physically embodies virtual planar shapes during 3D manipulation. We also investigate advanced operations such as patterning and blending using asymmetric bimanual interactions that augment mid-air motion with multi-touch gestures. We describe a three-stage user evaluation with our system wherein our goal is to (a) study the effectiveness of the planar proxy as a tangible 3D modality, (b) contrast key features of our approach with a GUI-based planar shape assembly system, and (c) evaluate user experience and performance in creative tasks using Proto-TAI++.
Cecil Piya, Vinayak, Karthik Ramani
Proto-TAI++: Exploring perceptually consistent creation of planar shape assemblies through multi-modal tangible interactions
Journal of Computing and Information Science in Engineering, Volume 16, Issue 3, September 2016