Robotic surgery is an emerging technology that is useful in complicated medical procedures and operations. Doctors need access to large number of tools, which are handed out to them during critical operations. Usually, a nurse or the doctor himself must reach out for the tools. Here in this project, a robot which will assist the doctors by providing the tools at crucial times by analyzing the voice input request given by the doctor. We develop this robot using ROS, Turtlebot with RGB-D Camera and a microphone mounted on it. These two sensors will act as eyes and ears of the robot. The robot would map the environment and orient itself next to tools table autonomously. The RGB-D camera would capture the image of the tools on the table and use a robotic arm to provide the tool to the surgeon. Currently the simulation of the task is completed. After completing this phase the future goal is to upgrade the robot to perform some tasks in the surgery also.
Files
Surgery Tool Pick Simulation.mp4
This video shows the simulation of how the robot will pick up a tool when commanded.
Gmapping video, i.e. robot makes the map of the surrounding area and can move in that video on its own by detecting the obstacles. Just have to give the destination.