Proposal for Robot Assistance for Neurosurgery

Similar documents
Robots in Image-Guided Interventions

Creating an Infrastructure to Address HCMDSS Challenges Introduction Enabling Technologies for Future Medical Devices

Computer Assisted Medical Interventions

Robots for Medicine and Personal Assistance. Guest lecturer: Ron Alterovitz

Robot assisted craniofacial surgery: first clinical evaluation

Stereoscopic Augmented Reality System for Computer Assisted Surgery

Robots in the Field of Medicine

HUMAN Robot Cooperation Techniques in Surgery

Feasibility of photoacoustic image guidance for telerobotic endonasal transsphenoidal surgery

ERC: Engineering Research Center for Computer- Integrated Surgical Systems and Technology (NSF Grant # )

Virtual and Augmented Reality techniques embedded and based on a Operative Microscope. Training for Neurosurgery.

Medical robotics and Image Guided Therapy (IGT) Bogdan M. Maris, PhD Temporary Assistant Professor

Telemanipulation and Telestration for Microsurgery Summary

Current Status and Future of Medical Virtual Reality

Computer Assisted Abdominal

Scopis Hybrid Navigation with Augmented Reality

THE USE OF OPEN REDUCtion

Surgical Robot Competition Introducing Engineering in Medicine to Pre-college Students

NeuroSim - The Prototype of a Neurosurgical Training Simulator

Surgical Assist Devices & Systems aka Surgical Robots

TREND OF SURGICAL ROBOT TECHNOLOGY AND ITS INDUSTRIAL OUTLOOK

Author Manuscript Int J Comput Assist Radiol Surg. Author manuscript; available in PMC 2016 March 01.

Image Guided Robotic Assisted Surgical Training System using LabVIEW and CompactRIO

3D Slicer Based Surgical Robot Console System Release 0.00

Cutaneous Feedback of Fingertip Deformation and Vibration for Palpation in Robotic Surgery

Control design issues for a microinvasive neurosurgery teleoperator system

Università di Roma La Sapienza. Medical Robotics. A Teleoperation System for Research in MIRS. Marilena Vendittelli

Haptic Feedback in Laparoscopic and Robotic Surgery

FALL 2014, Issue No. 32 ROBOTICS AT OUR FINGERTIPS

BodyViz fact sheet. BodyViz 2321 North Loop Drive, Suite 110 Ames, IA x555 www. bodyviz.com

Chapter 1. Introduction

Harvard BioRobotics Laboratory Technical Report

Job Description. Commitment: Must be available to work full-time hours, M-F for weeks beginning Summer of 2018.

Robone: Next Generation Orthopedic Surgical Device Final Report

DART-FIRE. Small Screw System SURGICAL TECHNIQUE

5HDO 7LPH 6XUJLFDO 6LPXODWLRQ ZLWK +DSWLF 6HQVDWLRQ DV &ROODERUDWHG :RUNV EHWZHHQ -DSDQ DQG *HUPDQ\

CETRA ANTERIOR CERVICAL PLATE

The Trend of Medical Image Work Station

Medical Robotics Overview of the course

Distributed Modular Computer-Integrated Surgical Robotic Systems:

Open surgery SIMULATION

Augmented Reality in Medicine

DEVELOPING SENSORS FOR SURGERY SUPPORT ROBOTS Mona Kudo

Robotic System Simulation and Modeling Stefan Jörg Robotic and Mechatronic Center

Methods for Haptic Feedback in Teleoperated Robotic Surgery

NIH Public Access Author Manuscript Int J Comput Assist Radiol Surg. Author manuscript; available in PMC 2010 August 23.

Two decades after the first reported robotic surgical

Maneesh Dewan. Prepared on: April 11, 2007

OsteoBridge IKA Intramedullary Knee Arthrodesis Fixation System. From the «BioBall Company» OsteoBridge Family

Fracture fixation providing absolute or relative stability, as required by the personality of the fracture, the patient, and the injury.

MEDIALMAX System SURGICAL TECHNIQUE

Using virtual reality for medical diagnosis, training and education

Novel machine interface for scaled telesurgery

A Virtual Interactive Navigation System for Orthopaedic Surgical Interventions

Haptic Virtual Fixtures for Robot-Assisted Manipulation

From the «BioBall Company» OsteoBridge Family. OsteoBridge Knee Arthrodesis. The modular system for the fusion of the knee joint

SpeedTip CCS 5.0, 7.0

Aesculap Bone Flap Fixation

DART-FIRE. Small Screw System SURGIC A L T ECHNIQUE

Summer Engineering Research Internship for US Students (SERIUS) Department of Biomedical Engineering. (

EnFocus Your Upgrade Path to High Performance Intrasurgical OCT

Using Web-Based Computer Graphics to Teach Surgery

Guide to the Records of Think Surgical, Inc.

Medical Robotics in Computer-Integrated Surgery

Arthrex. Bio-Compression. Screw System. Knee OCD. Hand, Wrist & Elbow. Foot & Ankle

TO EXPLORE THE POSSIBILITIES OF VIRTUAL REALITY (VR) & AUGMENTED REALITY (AR)

DART-FIRE. Small Screw System SURGICAL TECHNIQUE

ACTIVE, A PLATFORM FOR BUILDING INTELLIGENT OPERATING ROOMS

THE SMITH AND NEPHEW ANNUAL LECTURE. ROBOTIC SURGERY: FROM AUTONOMOUS SYSTEMS TO INTELLIGENT TOOLS. PROFESSOR BRIAN DAVIES. IMPERIAL COLLEGE LONDON.

Through the range of motion with NAVIO Instructional course

Surgical robot simulation with BBZ console

MatrixMANDIBLE Preformed Reconstruction Plates. Preshaped to the mandibular anatomy.

Reflex Hybrid System Overview

5th Metatarsal Fracture System Surgical Technique

Reflex TM Surgical Technique. Anterior Cervical Plate

Surgical navigation display system using volume rendering of intraoperatively scanned CT images

Cerclage Passer. For minimally invasive application of cerclage cables.

Cooperative Robot Assistant for Retinal Microsurgery

Bio-Compression. Arthrex. Screw System

SMart wearable Robotic Teleoperated surgery

WHITE PAPER 3D PRINTED SURGICAL INSTRUMENTS

Haptic Technology- Comprehensive Review Study with its Applications

Tactile Interactions During Robot Assisted Surgical Interventions. Lakmal Seneviratne

Medical Robotics. Part II: SURGICAL ROBOTICS

An Augmented Reality Application for the Enhancement of Surgical Decisions

Virage OCT Spinal Fixation System

da Vinci Skills Simulator

Introducing the LumiCoil Platinum Fiducial Marker. Features of LumiCoil Platinum Fiducial Markers. Expanding Innovation in EUS

Implants for surgery Orthopaedic joint prosthesis. Part 1: Procedure for producing parametric 3D bone models from CT data of the knee

Haptic and Visual Simulation of a Material Cutting Process A Study Focused on Bone Surgery and the Use of Simulators for Education and Training

MED-LIFE: A DIAGNOSTIC AID FOR MEDICAL IMAGERY

A haptic enabled multimodal interface for the planning of hip arthroplasty

Shared Investment. Shared Success. ReMAP Call for Proposals by Expression of Interest

Medical Images Analysis and Processing

The Reality in Virtual Reality: A Conversation with Practitioners at MIT Enterprise Forum of NYC

RASim Prototype User Manual

Scottish Health and Life Sciences Innovation Workshop. The Industrial Strategy Challenge Fund

The Use of Localizers, Robots and Synergistic Devices in CAS. Jocelyne Troccaz* Michael Peshkin** Brian Davies***

MIVS Tel:

ECSEL Smart Health Project Portfolio and Strategic Agenda. Patrick Vandenberghe Programme Officer

Transcription:

Proposal for Robot Assistance for Neurosurgery Peter Kazanzides Assistant Research Professor of Computer Science Johns Hopkins University December 13, 2007

Funding History Active funding for development of open source software for (medical) robotics: NSF CISST ERC infrastructure ERC Supplement for Surgical Assistant Workstation (with Intuitive Surgical) NSF Major Research Instrumentation (MRI) for sensing, modeling, and manipulation ERC provided seed funding for preliminary work in neurosurgery. SPL contributed resources. Targeting PAR-07-249 (Collaborations with NCBC): due Jan 17, 2008

Preliminary Work Use robot assistance to improve safety of skull base drilling: Define safe zone (virtual fixture) in CT Register CT, patient, and robot Robot holds cutting tool Cooperative control: responds to surgeon s forces Virtual fixtures: prevent excursion outside safe zone

Prior Work Acrobot Robot for knee surgery Brian Davies, Imperial College, London Virtual fixtures for sinus surgery Li & Taylor, JHU Other robots for skull base surgery Bumm et al., Germany Federspil et al., Germany NeuRobot (Sim et al.), Singapore

System Architecture Real Time OS (RTAI)

Software Architecture

Cadaver Experiment

Results Phantom experiments with foam blocks to measure accuracy Cadaver experiments to assess clinical feasibility and accuracy

Issues Encountered Stability of Slicer 3.0 IGT code Slicer CT coords Stealthstation CT coords Need rastoijk matrix from xml file Interface between robot and Slicer (SPLOT) negatively affected PC performance 2D view does not show tool or VF model Stealthstation showed tool

Issues Encountered Created standalone VTK program to simplify VF and remove section to allow cutter access Too many screens to look at: Robot, Slicer, Stealthstation, endoscope (sometimes) Accuracy could be better (about 1.5 mm)

Proposal Goals (1) Preoperative planning Multimodal image fusion (CT, MRI) MRI useful when tool must avoid nerves/vessels that are tethered to skull base Create 3D model of virtual fixture Accounts for cutter radius Simplified for better real-time performance Maybe offset for registration uncertainty?

Proposal Goals (2) Intraoperative control Integrate Robot GUI within Slicer Use middleware between Slicer and robot controller (RTOS) Maybe update registration? Intraoperative visualization Dynamically construct and display model of area that has been cut Automatically show surgeon best view Integrate endoscope video Simple interface via pendant (or foot pedal)

Proposal Goals (3) Postoperative validation Perform cadaver experiments Align postoperative and preoperative CT Quantify performance of system Key metric is bone overcut Can use DSC (Dice Similarity Coeff), etc. to compare dynamically constructed cut model to postop CT

Where are we going? This technology (constrained control with virtual fixtures) is good for bone. Would like to extend to soft tissue (e.g., endoscopic removal of deep brain tumors) Preop virtual fixtures lose relevance Local sensor feedback (OCT, US) can show critical structures around tumor Dynamically construct VF from local sensor feedback? Deform preop VF based on local sensor feedback (including video)?

Acknowledgments JHU BWH Tian Xia Clint Baird George Jallo Iulian Iordachita Nobuhiko Hata Kathryn Hayes Nobuyuki Nakajima Haiying Liu NSF EEC 9731748 NIH 1U41RR019703-01A2, NIH P41 RR13218 NIH U54 EB005419