This work demonstrates the adaptation of an industrial robotic system to an affordable and accessible open platform for education and research through rapid prototyping techniques. The ABB YuMi collaborative robot is adapted using a low-cost 3D printed gripper extension for surgical tools. The robot is controlled using an intuitive virtual…
Humans are able to understand meaning intuitively and generalize from a single observation, as opposed to machines which require several examples to learn and recognize a new physical expression. This trait is one of the main roadblocks in natural human-machine interaction. Particularly, in the area of gestures which are an…
Dr. Juan Pablo Wachs and the ISAT Lab welcomed Mr. Atilio Berardi, Consul General of Argentina, and his team last week during a visit to Purdue University. ISAT students impressively presented their robots and research to the visitors: Natalia Sanchez Tamayo, visiting scholar, showed a virtual reality interface to control the…
A paper related to zero shot learning for gesture recognition was accepted for poster presentation at 19th ACM International Conference on Multimodal Interaction held at Glasgow, Scotland, UK. ISAT’s member, Mr. Naveen Madapana presented the poster at the conference. Brief Description: Humans tend to create the gestures on the fly and…
The ISAT lab members had substantial presence in the IEEE International Conference for Face and Gesture Recognition in Washington DC. Maru Cabrera was accepted to participate in the Doctoral Consortium, as well as presenting a Poster on a conference accepted paper on neural signatures involved in gesture perception.…
The System for Telementoring with Augmented Reality (STAR) project is a multi-institution project sponsored by the Office of the Assistant Secretary of Defense for Health Affairs. Link to STAR project website. The primary objective of this project is to research, develop, and validate an augmented reality system that would improve the…
Maria Eugenia Cabrera, IE PhD student, has received the best three minute presentation award at the recent AAAI (Association for the Advancement of Artificial Intelligence) Conference. With the help of Dr. Juan Wachs, Maria is studying the possibility of switching from joystick interfaces to touchless ones to control the…
Abstract An innovative 3D joystick was developed to enable quadriplegics due to spinal cord injuries (SCIs) to more independently and efficiently operate a robotic arm as an assistive device. The 3D joystick was compared to two different manual input modalities, a keyboard control and a traditional joystick, in performing experimental…
Abstract An integrated, computer vision-based system was developed to operate a commercial wheelchair-mounted robotic manipulator (WMRM). In this paper, a gesture recognition interface system developed specifically for individuals with upper-level spinal cord injuries (SCIs) was combined with object tracking and face recognition systems to be an efficient, hands free WMRM controller. In this test system,…
Currently there is no suitable substitute technology to enable blind or visually impaired (BVI) people to interpret visual scientific data commonly generated during lab experimentation in real time, such as performing light microscopy, spectrometry, and observing chemical reactions. This reliance upon visual interpretation of scientific data certainly impedes students and…