Description: Current teleoperated robot-assisted surgery requires surgeons to manipulate joystick-like controllers in a master console, and robotic arms will mimic those motions on the patient’s side. It is becoming more popular compared to traditional minimally invasive surgery due to its dexterity, precision and accurate motion planning capabilities. However, one major…
Description: US hospitals are facing great shortage of registered nurses, which could lead to an increment in mortality rate. One solution to this challenge is to bring Robotic Scrub Nurse (RSN) into the Operating Room (OR) to free nurses from mundane and repetitive tasks such as instrument delivery and retrieval.…
This work demonstrates the adaptation of an industrial robotic system to an affordable and accessible open platform for education and research through rapid prototyping techniques. The ABB YuMi collaborative robot is adapted using a low-cost 3D printed gripper extension for surgical tools. The robot is controlled using an intuitive virtual…
Humans are able to understand meaning intuitively and generalize from a single observation, as opposed to machines which require several examples to learn and recognize a new physical expression. This trait is one of the main roadblocks in natural human-machine interaction. Particularly, in the area of gestures which are an…
A paper related to zero shot learning for gesture recognition was accepted for poster presentation at 19th ACM International Conference on Multimodal Interaction held at Glasgow, Scotland, UK. ISAT’s member, Mr. Naveen Madapana presented the poster at the conference. Brief Description: Humans tend to create the gestures on the fly and…
The System for Telementoring with Augmented Reality (STAR) project is a multi-institution project sponsored by the Office of the Assistant Secretary of Defense for Health Affairs. Link to STAR project website. The primary objective of this project is to research, develop, and validate an augmented reality system that would improve the…
Abstract An innovative 3D joystick was developed to enable quadriplegics due to spinal cord injuries (SCIs) to more independently and efficiently operate a robotic arm as an assistive device. The 3D joystick was compared to two different manual input modalities, a keyboard control and a traditional joystick, in performing experimental…
Abstract An integrated, computer vision-based system was developed to operate a commercial wheelchair-mounted robotic manipulator (WMRM). In this paper, a gesture recognition interface system developed specifically for individuals with upper-level spinal cord injuries (SCIs) was combined with object tracking and face recognition systems to be an efficient, hands free WMRM controller. In this test system,…
Currently there is no suitable substitute technology to enable blind or visually impaired (BVI) people to interpret visual scientific data commonly generated during lab experimentation in real time, such as performing light microscopy, spectrometry, and observing chemical reactions. This reliance upon visual interpretation of scientific data certainly impedes students and…