Telerobotic Surgery with Free Hand Gestures

Description:  Current teleoperated robot-assisted surgery requires surgeons to manipulate joystick-like controllers in a master console, and robotic arms will mimic those motions on the patient’s side. It is becoming more popular compared to traditional minimally invasive surgery due to its dexterity, precision and accurate motion planning capabilities. However, one major…

Continue reading

Paper accepted at ICMI 2017

A paper related to zero shot learning for gesture recognition was accepted for poster presentation at 19th ACM International Conference on Multimodal Interaction held at Glasgow, Scotland, UK. ISAT’s member, Mr. Naveen Madapana presented the poster at the conference. Brief Description: Humans tend to create the gestures on the fly and…

Continue reading

Integrated Vision-Based Robotic Arm Interface for Operators with Upper Limb Mobility Impairments

Abstract An integrated, computer vision-based system was developed to operate a commercial wheelchair-mounted robotic manipulator (WMRM). In this paper, a gesture recognition interface system developed specifically for individuals with upper-level spinal cord injuries (SCIs) was combined with object tracking and face recognition systems to be an efficient, hands free WMRM controller. In this test system,…

Continue reading

Multimodal Image Perception System for Blind or Visually Impaired People

Currently there is no suitable substitute technology to enable blind or visually impaired (BVI) people to interpret visual scientific data commonly generated during lab experimentation in real time, such as performing light microscopy, spectrometry, and observing chemical reactions. This reliance upon visual interpretation of scientific data certainly impedes students and…

Continue reading