Medical robotics and Image Guided Therapy (IGT) Bogdan M. Maris, PhD Temporary Assistant Professor

Similar documents
Medical Robotics. Part II: SURGICAL ROBOTICS

Computer Assisted Medical Interventions

Haptic Feedback in Laparoscopic and Robotic Surgery

Robots in the Field of Medicine

Surgical robot simulation with BBZ console

Surgical Assist Devices & Systems aka Surgical Robots

Medical Robots. Healing and Helping. Monika and Wen

SMart wearable Robotic Teleoperated surgery

da Vinci Skills Simulator

Novel machine interface for scaled telesurgery

Small Occupancy Robotic Mechanisms for Endoscopic Surgery

Chapter 1. Introduction

Using Simulation to Design Control Strategies for Robotic No-Scar Surgery

Robotics, telepresence and minimal access surgery - A short and selective history

Evaluation of Haptic Virtual Fixtures in Psychomotor Skill Development for Robotic Surgical Training

Robotics for Telesurgery

1 May Telesurgery with haptic sensation: The future of surgery. Michael Stark The New European Surgical Academy (NESA)

Robotic System Simulation and Modeling Stefan Jörg Robotic and Mechatronic Center

TREND OF SURGICAL ROBOT TECHNOLOGY AND ITS INDUSTRIAL OUTLOOK

2D, 3D CT Intervention, and CT Fluoroscopy

Scopis Hybrid Navigation with Augmented Reality

Robots for Medicine and Personal Assistance. Guest lecturer: Ron Alterovitz

RENDERING MEDICAL INTERVENTIONS VIRTUAL AND ROBOT

Open surgery SIMULATION

Transforming Surgical Robotics. 34 th Annual J.P. Morgan Healthcare Conference January 14, 2016

An Inexpensive Experimental Setup for Teaching The Concepts of Da Vinci Surgical Robot

Haptic Feedback in Robot Assisted Minimal Invasive Surgery

Autonomous Surgical Robotics

Computer Assisted Abdominal

Creating an Infrastructure to Address HCMDSS Challenges Introduction Enabling Technologies for Future Medical Devices

FALL 2014, Issue No. 32 ROBOTICS AT OUR FINGERTIPS

Università di Roma La Sapienza. Medical Robotics. A Teleoperation System for Research in MIRS. Marilena Vendittelli

HUMAN Robot Cooperation Techniques in Surgery

Telemanipulation and Telestration for Microsurgery Summary

Óbuda University (OU) European Robotics Forum 2016 Ljubljana, Slovenia

Application of Force Feedback in Robot Assisted Minimally Invasive Surgery

VIABILITY OF TELEMEDICAL REMOTE ROBOTIC SYSTEMS. University of Stellenbosch University, South Africa

Medical Robotics LBR Med

DEVELOPING SENSORS FOR SURGERY SUPPORT ROBOTS Mona Kudo

Digital Reality TM changes everything

Job Description. Commitment: Must be available to work full-time hours, M-F for weeks beginning Summer of 2018.

Current Status and Future of Medical Virtual Reality

ERC: Engineering Research Center for Computer- Integrated Surgical Systems and Technology (NSF Grant # )

AC : MEDICAL ROBOTICS LABORATORY FOR BIOMEDICAL ENGINEERS

Proposal for Robot Assistance for Neurosurgery

Virtual and Augmented Reality Applications

Virtual and Augmented Reality techniques embedded and based on a Operative Microscope. Training for Neurosurgery.

MARGE Project: Design, Modeling, and Control of Assistive Devices for Minimally Invasive Surgery

Wearable Haptic Feedback Actuators for Training in Robotic Surgery

Force Feedback Mechatronics in Medecine, Healthcare and Rehabilitation

BodyViz fact sheet. BodyViz 2321 North Loop Drive, Suite 110 Ames, IA x555 www. bodyviz.com

ehealth : Tools & Methods Dr. Asif Zafar

Methods for Haptic Feedback in Teleoperated Robotic Surgery

MECHANICAL DESIGN LEARNING ENVIRONMENTS BASED ON VIRTUAL REALITY TECHNOLOGIES

A Virtual Framework for Semi-Autonomous Robotic Surgery using Real-Time Spatial Mapping

GYN / US. VITOM A Unique Visualization System for Vaginal Hysterectomy in the Operating Room

Model Based Design Of Medical Devices

What could be driving the Lab of the future and is the Smart Lab really a thing?

Balancing Safety and Cost in Robotically Assisted Surgery

Force feedback interfaces & applications

Jane Li. Assistant Professor Mechanical Engineering Department, Robotic Engineering Program Worcester Polytechnic Institute

Haptics Technologies: Bringing Touch to Multimedia

KINECT CONTROLLED HUMANOID AND HELICOPTER

Industry 4.0. Advanced and integrated SAFETY tools for tecnhical plants

Term Paper Augmented Reality in surgery

INDIRECT FEEDBACK OF HAPTIC INFORMATION FOR ROBOT-ASSISTED TELEMANIPULATION. by Masaya Kitagawa. Baltimore, Maryland September, 2003

Stereoscopic Augmented Reality System for Computer Assisted Surgery

Robots in Image-Guided Interventions

TRENDS IN SURGICAL ROBOTICS

Robotic Surgery Robotic Surgery. Dept of Electronics M. E. S College Marampally

Using Web-Based Computer Graphics to Teach Surgery

Cutaneous Feedback of Fingertip Deformation and Vibration for Palpation in Robotic Surgery

Measurements of the Level of Surgical Expertise Using Flight Path Analysis from da Vinci Robotic Surgical System

Towards robotic heart surgery: Introduction of autonomous procedures into an experimental surgical telemanipulator system

Les apports de la robotique collaborative en santé

Enhancing Shipboard Maintenance with Augmented Reality

Tactile Interactions During Robot Assisted Surgical Interventions. Lakmal Seneviratne

Distributed Robotics: Building an environment for digital cooperation. Artificial Intelligence series

Epona Medical simulation products catalog Version 1.0

VOLISTA. Setting the standard for operating rooms. This document is intended to provide information to an international audience outside of the US

Surgical Robot Competition Introducing Engineering in Medicine to Pre-college Students

Summer Engineering Research Internship for US Students (SERIUS) Department of Biomedical Engineering. (

Advanced Augmented Reality Telestration Techniques With Applications In Laparoscopic And Robotic Surgery

Control and User Interface Design for Compact Manipulators in Minimally-Invasive Surgery

Advanced Robotics Trends in Medical Application

Medical Robotics in Computer-Integrated Surgery

University of California, Santa Barbara. CS189 Fall 17 Capstone. VR Telemedicine. Product Requirement Documentation

Harvard BioRobotics Laboratory Technical Report

Advancing the Art of Endoscopy

Haptic Feedback. A literature study on the present-day use of haptic feedback in medical robotics. A.F. Rovers September 2002 DCT Report nr

Virtual Reality in Neuro- Rehabilitation and Beyond

Wireless Master-Slave Embedded Controller for a Teleoperated Anthropomorphic Robotic Arm with Gripping Force Sensing

A VR Training System with Haptic Force Feedback for the Robotic Endovascular Surge

Robust Haptic Teleoperation of a Mobile Manipulation Platform

Minimally invasive surgical skills evaluation in the field of otolaryngology

Haptic Virtual Fixtures for Robot-Assisted Manipulation

The Role of Service Robots and Robotic Systems in the Treatment of Patients in Medical Institutions

ISMCR2004. Abstract. 2. The mechanism of the master-slave arm of Telesar II. 1. Introduction. D21-Page 1

Available theses in industrial robotics (October 2016) Prof. Paolo Rocco Prof. Andrea Maria Zanchettin

Why A CPRL-4 will be better than a VATS Lobectomy

Transcription:

Medical robotics and Image Guided Therapy (IGT) Bogdan M. Maris, PhD Temporary Assistant Professor E-mail bogdan.maris@univr.it

Medical Robotics History, current and future applications

Robots are Accurate and precise; untiring Smaller or larger than people (as needed) Remotely operated (as needed) Connected to computers, which gives them access to information Not always able to operate autonomously in highly complex, unvertain environments => need for human interaction

Overview Introduction Application of Medical Robotics Design of Robotic Telesurgery Historic Companies and Systems Existing surgical systems Strengths and Limitations Ethical and Safety Considerations On-going research projects in Verona Challenges, Future and Conclusion

Introduction(1) Definition: Robotic systems for surgery There are computer-assisted surgery (CAS) systems first, and medical robots second. The robot itself is just one element of a larger system designed to assist a surgeon in carrying out a surgical procedure.. [Taylor, 2003] Computer-assisted surgery is an interdisciplinary research field that builds a bridge between surgery and computer science. It represents a set of methods which use computer technology to support preoperative planning, the actual surgery, and postoperative assessment.

Introduction(2) CAS Intervention 1 CT scan 2 3 Patient Specific models Mental Model Information flow in CAS Diagnosis

Introduction(3) Ideal CAS Robotic execution 1 CT scan Image registration 2 Intervention planning 3 3D virtual models and phantoms Training 3D interactive virtual reality Information flow in CAS

Introduction(4) MIS Minimally invasive surgery uses techniques of surgical access and exposure that significantly reduce trauma to the body compared to traditional incisions.

Introduction(5) Motivation: Started with the weaknesses and strengths of minimally invasive surgery (MIS) Smaller incisions, shorter post-operative time, reduced infection, faster rehabilitation, lesser pain, better cosmetics,... Eye-hand coordination, difficulty in moving arms, degree of motion

Application of Medical Robotics(1) Telemedicine and Teleconsultation Telecommunciation channels to communicate with other physicians/patients Control an external camera which in turn controls an endoscopic camera used to share images with a remote surgeon

Application of Medical Robotics(2) Surgical Training Robots used as surgical training simulators Used for medical resident students Residents lack expertise and this helps in avoiding legal, social and economic problems Actaeon Robotic Surgery Training Console Actaeon Console is the answer to what is currently missing in Robotic Surgery education: an easy trasportable and easy setup console which perfectly simulate the feedback of a da Vinci console. With it you can trasform your standard computer classroom into an hi-tech robotics surgery training classroom, where every student can find his space to train and practice on this exciting Surgery field.

Application of Medical Robotics(3) Rehabilitation Assistive robots Wheelchair with intelligent navigational control system

Application of Medical Robotics(4) Telesurgery Surgeon sits at a console Has controls to move the robotic arms Does not operate on the patient directly Mainly used in minimally invasive surgeries New York Strasbourg Lindbergh operation was a complete tele-surgical operation carried out by a team of French surgeons located in New York on a patient in Strasbourg, France (over a distance of several thousand miles) using telecommunications solutions based on high-speed services and sophisticated Zeus surgical robot. The operation was performed successfully on September 7, 2001 by Professor Jacques Marescaux

Application of Medical Robotics(5) Laparoscopic Surgery Traditional laparoscope instruments have limitations Has 4 DOFs - Arbitrary orientation of instrument tip not possible Reduction in dexterity Reduction in motion reversal due to fulcrum at entry point Friction at air tight trocar reduction in force feedback Lack of tactile sensing

Design of Robotic Telesurgery(1) Minimally Invasive Surgery Surgery performed by making small incisions < 10mm dia Reduces post-operative pain and hospital stays Form of telemanipulation Instruments have a camera attached to transmit inside image to the surgeon

Design of Robotic Telesurgery(2) The Concept Telesurgical system concept

Design of Robotic Telesurgery(3) Considerations: Human-Machine Interface Video system used to capture images inside the patient Backlash-loss of motion between a set of movable parts Choose the appropriate mechanism for the required transmission Choose passive gravity balance over active gravity balance

Design of Robotic Telesurgery(4) Haptic Feedback Sensation of touch lost in robotic surgery Receiving haptic information and using it to control the robotic manipulators Needed to achieve high fidelity Types Force (kinesthetic) feedback Tactile (cutaneous) feedback

Historic Companies and Systems(1) First Robotic assisted surgery 1988 PUMA 560 Light duty industrial robotic arm to guide laser/needle for sterotactic brain surgery

Historic Companies and Systems(2) First Robotic urological surgery 1992 PROBOT-assisted TURP in Guy s Hospital in London

Historic Companies and Systems(3) First commercially available robotic system, 1992 ROBODOC for orthopaedic hip surgery

Historic Companies and Systems(4) AESOP (Computer Motion), 1994 Automated Endoscopic System for Optimal Positioning a voice-activated robotic arm for camera holder First approved surgical robotic system by FDA ZEUS (Computer Motion) Marketed in 1998 ZEUS Altair Robotics Lab, Verona

Existing surgical systems(1) Da Vinci (Intuitive Surgical) Initially developed by US Department of Defence in 1991 Intuitive Surgical acquired the prototype and commercialized the system Approved by FDA in July 2000 DaVinci Research Kit (DVRK), Altair Robotics Lab (Verona)

Existing surgical systems(2) da Vinci Xi Product Development da Vinci Si 2009 Collaborative surgery Full HD vision Better Ergonomicity Modifiable Architecture da Vinci S 2006 HD Vision (720P) Input video Multi-Quadrant Access Better set-up da Vinci Standard VISIONE 3D 4 th arm introduction 1998

Existing surgical systems(3) Robot davinci - components Patient System Vision System Surgical Consolle Second Consolle

Existing surgical systems(4) davinci Master Station Visor 3D HD 2 independant optical channels Master Operator input with tremor filtering Pedals Management of vision and tools Ergonomic settings

Existing surgical systems(5) davinci Slave Station Camera Arm 3D optics installed on the arm; no tremor and stable vision Instrument Arm - Hard Remote Center of Compliance - Endowrist Instruments

Existing surgical systems(6) Advantages of Da Vinci Surgical : Technically Patented Endowrist: 6 degrees of movement 3-D vision (Dual channel endoscopy) and magnified view (x12) Tremor suppression and scaling of movement Surgeon Ergonomic advantage Shorter learning curve Patient Better outcome

Existing surgical systems(7) Advantages: A surgical robot combines the small instrument size of laparoscopic surgery, with the hand dexterity and visual perception of open surgery. These features allowed a significant improvement in surgical performance especially where laparascopic technique was not too high.

Existing surgical systems(8) 6 degree movements

Existing surgical systems(9) Da Vinci surgical system in a general procedure setting

Existing surgical systems(10)

Existing surgical systems(11)

Strengths and Limitations(1) Strengths: Physical separation Wrist action Tremor elimination Optional motion scaling Three-dimensional stereoscopic image Electronic information transfer (Telesurgery)

Strengths and Limitations(2) Limitation Reluctance to accept this technology (trust) Additional training Fail proof? Most of the sensors use IR transmission Highly efficient visual instruments are needed Cannot be pre-programmed Task-specific robots are required Latency in transmission of mechanical movements by the surgeon Longer operating time

Strengths and Limitations(3) Limitation Cost for the Da Vinci system: The average base cost of a System is $1.5 million Approximately $ 160,000 maintenance cost a year Operating room cost, $150 per hour Hospital stay cost, $600 per day Time away from work, $120 per day

Ethical and Safety Considerations When there is a marginal benefit from using robots, is it ethical to impose financial burden on patients or medical systems? If a robot-assisted surgery fails because of technical problems, is it the surgeon who is responsible or others?

On-going research projects in Verona (1) The MURAB project has the ambition to drastically improve precision of diagnostic biopsies and effectiveness of the workflow, reducing the usage of expensive Magnetic Resonance Imaging (MRI) to a minimum and at the same time yield the same precision during samples targeting due to a novel MRI-Ultrasound (US) registration.

On-going research projects in Verona (2) SARAS - Smart Autonomous Robotic Assistant Surgeon The goal of SARAS is to develop the next-generation of surgical robotic systems that will allow a single surgeon to execute Robotic Minimally Invasive Surgery (R-MIS) without the need of an expert assistant surgeon, thereby increasing the social and economic efficiency of a hospital while guaranteeing the same level of safety for patients.

On-going research projects in Verona (3) The ARS project aims at making the scientific advances that will enable the autonomous execution of complete procedures in uncertain and partially unknown environments.

Challenges, Future and Conclusion Haptic feedback A safe, easy sterilizable, accurate, cheap and compact robot Reliable telesurgical capabilities Compatibility with available medical equipment and standardizing Autonomous robot surgeons

Challenges, Future and Conclusion Automation: The ability to carry out a task repetitively, without human intervention. Tasks are well defined, actions are governed by a set of well defined rules, the environment is well known and structured. Adaptation is bounded and pre-programmed. Autonomoy: The ability to carry out a task without human intervention and to make cognitive decisions about the task. Tasks are defined in general terms, actions are are governed by learning and adapting previous knowledge to current situations, the environment can be changing, uncertain and not predictable a priori. Adaptive actions are not pre-programmed.