Balancing Safety and Cost in Robotically Assisted Surgery

Similar documents
SMart wearable Robotic Teleoperated surgery

Medical robotics and Image Guided Therapy (IGT) Bogdan M. Maris, PhD Temporary Assistant Professor

Small Occupancy Robotic Mechanisms for Endoscopic Surgery

HUMAN Robot Cooperation Techniques in Surgery

Università di Roma La Sapienza. Medical Robotics. A Teleoperation System for Research in MIRS. Marilena Vendittelli

Computer Assisted Medical Interventions

Robots in the Field of Medicine

Robotic System Simulation and Modeling Stefan Jörg Robotic and Mechatronic Center

Easy Robot Software. And the MoveIt! Setup Assistant 2.0. Dave Coleman, PhD davetcoleman

Medical Robotics. Part II: SURGICAL ROBOTICS

Autonomous Surgical Robotics

Cutaneous Feedback of Fingertip Deformation and Vibration for Palpation in Robotic Surgery

Evaluation of Haptic Virtual Fixtures in Psychomotor Skill Development for Robotic Surgical Training

BodyViz fact sheet. BodyViz 2321 North Loop Drive, Suite 110 Ames, IA x555 www. bodyviz.com

Real-time Adaptive Robot Motion Planning in Unknown and Unpredictable Environments

Differences in Fitts Law Task Performance Based on Environment Scaling

Scopis Hybrid Navigation with Augmented Reality

Current Status and Future of Medical Virtual Reality

Stereoscopic Augmented Reality System for Computer Assisted Surgery

Communication Requirements of VR & Telemedicine

CS277 - Experimental Haptics Lecture 1. Introduction to Haptics

Towards robotic heart surgery: Introduction of autonomous procedures into an experimental surgical telemanipulator system

Force feedback interfaces & applications

Peter Berkelman. ACHI/DigitalWorld

2. Introduction to Computer Haptics

Frequently Asked Question on Isolated Power Supply(IPS)

Novel machine interface for scaled telesurgery

Maneesh Dewan. Prepared on: April 11, 2007

Computer Haptics and Applications

Image Guided Robotic Assisted Surgical Training System using LabVIEW and CompactRIO

Application of Force Feedback in Robot Assisted Minimally Invasive Surgery

Jane Li. Assistant Professor Mechanical Engineering Department, Robotic Engineering Program Worcester Polytechnic Institute

Wednesday, October 29, :00-04:00pm EB: 3546D. TELEOPERATION OF MOBILE MANIPULATORS By Yunyi Jia Advisor: Prof.

Haptic Feedback in Laparoscopic and Robotic Surgery

Virtual Co-Location for Crime Scene Investigation and Going Beyond

Surgical robot simulation with BBZ console

5HDO 7LPH 6XUJLFDO 6LPXODWLRQ ZLWK +DSWLF 6HQVDWLRQ DV &ROODERUDWHG :RUNV EHWZHHQ -DSDQ DQG *HUPDQ\

Transforming Surgical Robotics. 34 th Annual J.P. Morgan Healthcare Conference January 14, 2016

3D Ultrasound-Guided Motion Compensation System for Beating Heart Mitral Valve Repair

Haptic Reproduction and Interactive Visualization of a Beating Heart Based on Cardiac Morphology

Improving Depth Perception in Medical AR

A Feasibility Study of Time-Domain Passivity Approach for Bilateral Teleoperation of Mobile Manipulator

HeroX - Untethered VR Training in Sync'ed Physical Spaces

Digital Reality TM changes everything

Methods for Haptic Feedback in Teleoperated Robotic Surgery

Planning and Real Time Control of a Minimally Invasive Robotic Surgery System

Parallax-Free Long Bone X-ray Image Stitching

Can technological solutions support user experience, learning, and operation outcome in robotic surgery?

Haptic Virtual Fixtures for Robot-Assisted Manipulation

Job Description. Commitment: Must be available to work full-time hours, M-F for weeks beginning Summer of 2018.

Development of a Master Slave Combined Manipulator for Laparoscopic Surgery

New Structure for IGT Tracking Devices: Simple Integration in External Projects

Virtual and Augmented Reality techniques embedded and based on a Operative Microscope. Training for Neurosurgery.

International Journal of Advanced Research in Computer Science and Software Engineering

Measurements of the Level of Surgical Expertise Using Flight Path Analysis from da Vinci Robotic Surgical System

Right Angle Screwdriver

An Augmented Reality Application for the Enhancement of Surgical Decisions

Virtual Reality as Human Interface and its application to Medical Ultrasonic diagnosis

2D, 3D CT Intervention, and CT Fluoroscopy

CS277 - Experimental Haptics Lecture 2. Haptic Rendering

Computer Assisted Abdominal

Jane Li. Assistant Professor Mechanical Engineering Department, Robotic Engineering Program Worcester Polytechnic Institute

DEVELOPING SENSORS FOR SURGERY SUPPORT ROBOTS Mona Kudo

Haptics Technologies: Bringing Touch to Multimedia

Robot assisted craniofacial surgery: first clinical evaluation

Touch Feedback in a Head-Mounted Display Virtual Reality through a Kinesthetic Haptic Device

VR-OOS System Architecture Workshop zu interaktiven VR-Technologien für On-Orbit Servicing

Capability for Collision Avoidance of Different User Avatars in Virtual Reality

RENDERING MEDICAL INTERVENTIONS VIRTUAL AND ROBOT

FALL 2014, Issue No. 32 ROBOTICS AT OUR FINGERTIPS

Maximum Performance, Minimum Space

TREND OF SURGICAL ROBOT TECHNOLOGY AND ITS INDUSTRIAL OUTLOOK

Information and Program

Medical Robots. Healing and Helping. Monika and Wen

Health Care Analytics: Driving Innovation

Surgical Assist Devices & Systems aka Surgical Robots

Realistic Force Reflection in the Spine Biopsy Simulator

ience e Schoo School of Computer Science Bangor University

FORCE FEEDBACK. Roope Raisamo

Overview of current developments in haptic APIs

Testing is More Than Checking

VR for Microsurgery. Design Document. Team: May1702 Client: Dr. Ben-Shlomo Advisor: Dr. Keren Website:

Legged Capsule Robots In Medicine

23270: AUGMENTED REALITY FOR NAVIGATION AND INFORMATIONAL ADAS. Sergii Bykov Technical Lead Machine Learning 12 Oct 2017

Creating an Infrastructure to Address HCMDSS Challenges Introduction Enabling Technologies for Future Medical Devices

Ubiquitous Computing Summer Episode 16: HCI. Hannes Frey and Peter Sturm University of Trier. Hannes Frey and Peter Sturm, University of Trier 1

Lessons Learned in Integrating Risk Management and Process Validation

Lecture 1 Introduction to Computer Vision. Lin ZHANG, PhD School of Software Engineering, Tongji University Spring 2014

Using Web-Based Computer Graphics to Teach Surgery

Chapter 2 Introduction to Haptics 2.1 Definition of Haptics

Control and confidence all around. Philips EP cockpit people focused solutions for heart rhythm care

LOOKING AHEAD: UE4 VR Roadmap. Nick Whiting Technical Director VR / AR

ISPFILMQATM STATE-OF-THE-ART RADIOTHERAPY VERIFICATION SOFTWARE. Supports all major radiotherapy technologies! FilmQA TM

Haptics CS327A

INTERIOUR DESIGN USING AUGMENTED REALITY

Bayesian Positioning in Wireless Networks using Angle of Arrival

Computer Systems Research: Past and Future

The Holographic Human for surgical navigation using Microsoft HoloLens

NeuroSim - The Prototype of a Neurosurgical Training Simulator

The Effect of Haptic Degrees of Freedom on Task Performance in Virtual Surgical Environments

Transcription:

Balancing Safety and Cost in Robotically Assisted Surgery IROS 2011 LOUAI ADHAMI, PHD LADHAMI@SIMQUEST.COM

Thank yous 2 ChIR & XirTek INRIA Intuitive Surgical France & USA HEGP & A. Carpentier The RNTS, RNRT SimQuest

Outline 3 Motivation Quick Outline of XirTek Safety vs. Cost: XirTek step-by-step Safety vs. Cost: Further examples from Immersion Medical and SimQuest Conclusion

Motivation 4 Example 1: Who knows CPR? $90-5 hrs Available everywhere Example 2: The dilemma: Humans as absolute value vs. What it takes to save/help someone

Chir/XirTek What is was 5 Perception Port Placement Robot Positionning Validation Simulation Transfer Monitoring Analysis

Xirtek: How does it increase safety? 6 Prepare through Planning Port placement Pose planning Prevent through V & V Formal verification Result validation Practice through Simulation Pre-empt during Monitoring

Xirtek What it became 7 Project Chir went in a one year evaluation to assess Xirtek s feasibility The conclusion was that is was too soon for Xirtek Why too soon? All the technology was available Enough customers were identified Why; really? Final bottom line after the whole chain was negative (at least at the time)

Chir: Port Placement 8 Problem Statement: Compute optimal incision sites based on surgeon requirements and robot specs All ports must be admissible No internal collisions Triplet optimization based on: Surgeon s requirements Robot limit (max dexterity)

Chir: Port Placement Cost 9 CT scans Complete torso Injected and synchronized heart image Coronarography (optional) Segmentation Automatic Manual UI Selecting the targets Choosing solution

Chir: Pose Planning 10 Problem statement Position a robot in a way to achieve a collision free path g(t) such that: Incision points @ remote centers Maximize a clearance measure F Active Passive 4 6 3 DOFs 12 9 9 4 Contraints 12 9 3 x-y- 6 passive 4 active

Chir: Transfer 11 Incision sites Robot pose

Chir: Transfer & Monitoring Cost Registration of pre / intra operative models 3d reconstruction Port placement Robot as pointing device Robot pose matching GUI Required setup Robot API 1-2 laptops Stereo system 12

Chir: Verification Cost 13 Algorithmic Verification Took 1 post-doc 3 months to formally verify 1 collision detection function (using Coq) Formal Verification Intra-operative steps were validated using XEVE

Further Examples: IMMR LapVR Handles 14 Handle electrocuted a client Redesigned the wiring Cost = Law suit Handles were burning the clients Changed the enclosing to plastic Cost = Loosing clients Handles were burning out Removed the haptics despite their recognized benefits Cost = COGS + less repairs

Further Examples: SimQuest s BurrHole 15 Requirements Deliver very high forces (20N) Low cost without compromising Reliability or Safety Solution Used custom made version of commercially available Novint devices (2 Falcons) Close coordination with Novint was needed

Conclusion 16 Should not idealize safety yet should not lower our standards Work with a given or reasonable cost mind to achieve an explicit level of safety Neglecting the cost could kill your project/product this doesn t mean it s an excuse to neglect safety

References Publications 17 L. Adhami and È. Coste-Manière. A versatile system for computer integrated mini-invasive robotic surgery. In Medical Image Computing and Computer Assisted Intervention (MICCAI'02), Tokyo, Japan, Oct. 2002. L. Adhami and È. Coste-Manière. Optimal planning for minimally invasive surgical robots. IEEE Transactions on Robotics and Automation: Special Issue on Medical Robotics, 19(5): 854-863, 2003. È. Coste-Manière, L. Adhami, F. Mourgues, and A. Carpentier. Planning, simulation, and augmented reality for robotic cardiac procedures: The stars system of the chir team. Seminars in Thoracic and Cardiovascular Surgery, 15(2), April 2003. Coste-maniere, E. Adhami, L. Boissonnat, J.-D. Carpentier, A. Guthart, G. Methods and Apparatus for Surgical Planning. US Patent 20070293734. Intuitive Surgical Inc & INRIA Roquencourt Adhami, L. Falk, R. Ullrich, C. Bi-Directional Communication of Simulation Information. US Patent 20090202972. Immersion Cooporation. Sites www.simquest.com/simulation.html www.cae.com/en/healthcare/home.asp www-sop.inria.fr/chir (frozen)