RENDERING MEDICAL INTERVENTIONS VIRTUAL AND ROBOT

Similar documents
Medical Robotics. Part II: SURGICAL ROBOTICS

Medical robotics and Image Guided Therapy (IGT) Bogdan M. Maris, PhD Temporary Assistant Professor

Robots in the Field of Medicine

Computer Assisted Medical Interventions

HUMAN Robot Cooperation Techniques in Surgery

Virtual and Augmented Reality Applications

Current Status and Future of Medical Virtual Reality

Scopis Hybrid Navigation with Augmented Reality

Using Web-Based Computer Graphics to Teach Surgery

Intelligent interaction

Robots for Medicine and Personal Assistance. Guest lecturer: Ron Alterovitz

Haptic Feedback in Laparoscopic and Robotic Surgery

Virtual and Augmented Reality techniques embedded and based on a Operative Microscope. Training for Neurosurgery.

Surgical robot simulation with BBZ console

Novel machine interface for scaled telesurgery

ARMY RDT&E BUDGET ITEM JUSTIFICATION (R2 Exhibit)

FALL 2014, Issue No. 32 ROBOTICS AT OUR FINGERTIPS

Computer Assisted Abdominal

BodyViz fact sheet. BodyViz 2321 North Loop Drive, Suite 110 Ames, IA x555 www. bodyviz.com

Jim Mangione June, 2017

DEVELOPING SENSORS FOR SURGERY SUPPORT ROBOTS Mona Kudo

Medical Robots. Healing and Helping. Monika and Wen

Stereoscopic Augmented Reality System for Computer Assisted Surgery

Patient information. Your options for cataract treatment Enjoy clear vision at all distances with multifocal IOLs

TREND OF SURGICAL ROBOT TECHNOLOGY AND ITS INDUSTRIAL OUTLOOK

R (2) Controlling System Application with hands by identifying movements through Camera

NeuroSim - The Prototype of a Neurosurgical Training Simulator

Job Description. Commitment: Must be available to work full-time hours, M-F for weeks beginning Summer of 2018.

VR based HCI Techniques & Application. November 29, 2002

SMart wearable Robotic Teleoperated surgery

these systems has increased, regardless of the environmental conditions of the systems.

INTRODUCING THE VIRTUAL REALITY FLIGHT SIMULATOR FOR SURGEONS

Immersive Training. David Lafferty President of Scientific Technical Services And ARC Associate

Enhancing Shipboard Maintenance with Augmented Reality

Digital Reality TM changes everything

EMPOWERING THE CONNECTED FIELD FORCE WORKER WITH ADVANCED ANALYTICS MATTHEW SHORT ACCENTURE LABS

2D, 3D CT Intervention, and CT Fluoroscopy

ARTIFICIAL INTELLIGENCE - ROBOTICS

da Vinci Skills Simulator

Creating an Infrastructure to Address HCMDSS Challenges Introduction Enabling Technologies for Future Medical Devices

& Medical Tourism. DIHTF - Dubai 20 th -21 st Feb 2018 V S Venkatesh -India

CO 2 Laser. AcuPulse. with SurgiTouch. Automation System. An Evolution in Automated Laser Surgery. Surgical: AcuPulse CO 2 Laser

The Holographic Human for surgical navigation using Microsoft HoloLens

VIRTUAL REALITY Introduction. Emil M. Petriu SITE, University of Ottawa

Rediscover quality of life thanks to vision correction with technology from Carl Zeiss. Patient Information

COPYRIGHTED MATERIAL. Overview

WHY EDOF INTRAOCULAR LENSES? FOR EXCELLENT VISION QUALITY TO SUPPORT AN ACTIVE LIFESTYLE PATIENT INFORMATION. Cataract treatment

COPYRIGHTED MATERIAL OVERVIEW 1

ience e Schoo School of Computer Science Bangor University

Autonomous Surgical Robotics

LASIK & Refractive Surgery

used to diagnose and treat medical conditions. State the precautions necessary when X ray machines and CT scanners are used.

Concerning the Potential of Using Game-Based Virtual Environment in Children Therapy

Haptic Feedback in Robot Assisted Minimal Invasive Surgery

Simply visionary. Flexible Sensor Endoscopes. for ENDOCAM Logic HD

Abstract. Keywords: virtual worlds; robots; robotics; standards; communication and interaction.

Università di Roma La Sapienza. Medical Robotics. A Teleoperation System for Research in MIRS. Marilena Vendittelli

Virtual Reality as Human Interface and its application to Medical Ultrasonic diagnosis

Image Guided Robotic Assisted Surgical Training System using LabVIEW and CompactRIO

Surgical Assist Devices & Systems aka Surgical Robots

Force Feedback Mechatronics in Medecine, Healthcare and Rehabilitation

ECSEL Smart Health Project Portfolio and Strategic Agenda. Patrick Vandenberghe Programme Officer

virtual reality SANJAY SINGH B.TECH (EC)

MEDICAL & LIFE SCIENCES

Minimally invasive surgical skills evaluation in the field of otolaryngology

Health Care Analytics: Driving Innovation

AQA P3 Topic 1. Medical applications of Physics

An Inexpensive Experimental Setup for Teaching The Concepts of Da Vinci Surgical Robot

MSMS Software for VR Simulations of Neural Prostheses and Patient Training and Rehabilitation

- Basics of informatics - Computer network - Software engineering - Intelligent media processing - Human interface. Professor. Professor.

Haptics Technologies: Bringing Touch to Multimedia

Trends Toward Laparoscopy for Prostate Cancer

Model Based Design Of Medical Devices

GYN / US. VITOM A Unique Visualization System for Vaginal Hysterectomy in the Operating Room

KINECT CONTROLLED HUMANOID AND HELICOPTER

Acoustic Rendering as Support for Sustained Attention during Biomedical Procedures

Small Occupancy Robotic Mechanisms for Endoscopic Surgery

Medtronic Payer Solutions

SIMULATION MODELING WITH ARTIFICIAL REALITY TECHNOLOGY (SMART): AN INTEGRATION OF VIRTUAL REALITY AND SIMULATION MODELING

International Journal of Informative & Futuristic Research ISSN:

International Journal of Advanced Research in Computer Science and Software Engineering

Medical Images Analysis and Processing

The Trend of Medical Image Work Station

Fracture fixation providing absolute or relative stability, as required by the personality of the fracture, the patient, and the injury.

5HDO 7LPH 6XUJLFDO 6LPXODWLRQ ZLWK +DSWLF 6HQVDWLRQ DV &ROODERUDWHG :RUNV EHWZHHQ -DSDQ DQG *HUPDQ\

Summer Engineering Research Internship for US Students (SERIUS) Department of Biomedical Engineering. (

Using Simulation to Design Control Strategies for Robotic No-Scar Surgery

Imagine your future lab. Designed using Virtual Reality and Computer Simulation

The Application of Virtual Reality in Art Design: A New Approach CHEN Dalei 1, a

Augmented Navigation Patricia Sazama, Xuetong Sun, Derek Juba, and Amitabh Varshney

INFORMATION SYSTEMS IN LEPROSY

Acquisition of MST Medical Surgery Technologies Ltd:

Haptics in Military Applications. Lauri Immonen

The First True Color Confocal Scanner on the Market

VR for Microsurgery. Design Document. Team: May1702 Client: Dr. Ben-Shlomo Advisor: Dr. Keren Website:

Interactive Simulation: UCF EIN5255. VR Software. Audio Output. Page 4-1

1 May Telesurgery with haptic sensation: The future of surgery. Michael Stark The New European Surgical Academy (NESA)

Robot assisted craniofacial surgery: first clinical evaluation

Applications of Virtual Reality Dhruv Pahuja, Dipti Bhardwaj, Manohar Kumar

Virtual Reality in Neuro- Rehabilitation and Beyond

Transcription:

RENDERING MEDICAL INTERVENTIONS VIRTUAL AND ROBOT Lavinia Ioana Săbăilă Doina Mortoiu Theoharis Babanatsas Aurel Vlaicu Arad University, e-mail: lavyy_99@yahoo.com Aurel Vlaicu Arad University, e mail: doina.mortoiu@gmail.com Aurel Vlaicu Arad University, e-mail: babgr@rdslink.ro Key words: virtual reality, medical robots, pain reduction, efficiency Summary: Medical virtual simulation represents the present and future of medicine development. Development of computer assisted training system, in the anatomic pathological virtual environment allows navigation and interaction with this environment, as wanted and in real time frame. For an efficient simulation, the following objectives should be integrated: the geometric model graphic representation, the physical model (elasto-dynamic), the model user interaction (handling). The world has always been fascinated by robots. People dreamed of building, using, and enjoying their advantages. If in the beginning they were only present in our imagination, in books, today they are real. 1. ROBOT SYSTEMS Surgery benefited relatively late of the advantages of this technology. Initial use of robots in surgery started at the end of the 80s when an industrial robot was used to sustain instruments for stereo tactic biopsy in neurosurgery. At the end of the 80s IBM built the first robot used in clinical practice, named Robo-doc. The first use of a robot in human surgery was a transurethral resection of the prostate. In 1993 Computer Motion, Inc., introduced a voiced controlled arm, AESOP (Automated Endoscopic System for Optimal Positioning), used for sustaining instruments, of the optic in laparoscopic surgery. Nowadays, the most complex and efficient robot used is the DaVinci system developed by Intuitive Surgical Inc. (Sunnyvale, CA, USA) in 1995. With the DaVinci system in 1998, Carpentier achieved in Paris the first robot assisted cardiac intervention, a mitral valve replacement. In recent years, we witnessed a spectacular development of medical technique, in the direction of gradually replacing classical, conventional methods with minimum invasive surgery and then with computer assisted surgery. Advanced technologies already implemented in diagnosis procedures, now successfully used in surgery employ artificial intelligence. The concept of telerobotic surgery was developed by the US Defense Department, in order to provide overspecialized medical assistance to severe cases, even directly on the battlefield. The first prototype was completed in California, at SRI International, by Phil Green. The system included two high performing video cameras, fitted on a surgery table located in the battlefield, which transmitted the image of the operating room (open surgery) and of the patient at a remote computer, from where a surgeon controlled the arms of a telerobot which was operating on the patient. Currently robots offer surgeons the possibility to make gestures they cannot make with instruments used in minimum invasive surgery. 955 1

The first generation of surgical robots has already been installed in various operating rooms around the world. In the USA alone there are over 3.5 million surgeries each year completed by means of robots. Nevertheless, these robots have no autonomy, they do not work alone, but still need human control, they need to be guided by a surgeon from the tele-system or through voice control. Currently there are three types of surgical robot systems: AESOP, the DaVinci system and the ZEUS system. Surgical robots play an important role in increasing safety of interventions because they prevent and eliminate human errors (they reduce the range of involuntary movements, they prevent erroneous gestures etc.). Robot systems were created exactly to improve interaction between surgeons and the technical environment, thus optimizing system performance. If in traditional surgery there is direct interaction between anatomic structures and surgeons, mediated by classic standardized instruments, in minimum invasive techniques tissues are handled only by surgical instruments, and direct hand-tissue interaction is replaced by intuition. Robot surgery tries to partially solve the issue by gesture accuracy and threedimensional vision. Systems that could offer sensing data on organs and which could be sent to the surgeons fingers are being studied. The experience so far has proved that robots manage to reduce the intervention duration, the inter-surgery incidents are less rare, the post-surgery pain and morbidity are lower. If so far surgery developed the most, new relevant technology and equipment allow a higher degree of implementation in various medical fields. In this view, the medical field certainly represents the field where simulation needs require a beneficial use. 2. COMPUTER AIDED SURGERY. VIRTUAL REALITY Computer aided surgery is the term used to describe one of the most recent research fields in medicine, which covers both the latest surgical processes and the technology which makes them possible. In the simplest sense, Computer Aided Surgery (CAS) is a boundary field between informatics, medicine and robotics. CAS represents the use of computers, robotics, optics and virtual reality to obtain the best surgical result in minimum period of time. In other words this research field will allow a surgeon to operate on a patient, in another room or perhaps in another city, with micron accuracy. This can be achieved by using by the surgeon of robots and hydraulic and pneumatic handlers, controlled by means of special equipment: gloves connected through wires to various terminals and for 3D environment, all these being performed under the strict surveillance of computers. The CAS concept is related to many of the most revolutionary recent approaches in surgery. One example might be the so called minimally invasive surgery (Minimally Invasive Surgery - MIS). The surgery is completed with instruments provided with video equipment, by very small painless incisions and with short healing time. 956 2 Operating rooms for robot surgery

Aided surgery is also a simulation method of a virtual surgery, completed on three-dimensional models of human organs, rebuilt from data taken from various scanning systems. Thus, a complex intervention which is imminent for a patient can be carefully planned, before starting to actually dissect live tissue. CAS is currently used: To design innovative treatment methods for diseases which require a surgical approach. To improve treatment technology. New revolutionary instruments as laser, microsurgery instruments, equipment with robot systems, can be first tested by virtual simulations and approved with regard to safety and compatibility of use in the human body. CAS programs can monitor post-surgery patient behavior, administering medication and recovery of affected tissues, by simulations with accelerated time. In surgical preparation (training) programs. By using punctual simulation and sensor reaction transducers (force feedback), such C.A.S. modules provide a virtual environment close to reality, where practicing surgeons can learn classic procedures or can experiment others new. For teaching purposes currently are used: a) Medical simulators. Use of simulators justifies its efficiency by: the possibility to reproduce a high number of situations when reality of particular conditions and conceiving of a high number of imaginary situations can be simulated; saving important material or even human resources by acting in a virtual environment; initiation, training and perfecting the use of equipment and methods without their actual use being necessary; monitoring in time the failures in use and concluding many aspects which require corrections, improvements or even fundamental changes; Fast recovery of investments in such virtual systems. a.1. LAPSIM simulator The use of video feed-back, based on monitors or other types of outer units render laparoscopy adequate for learning and training in computer based systems. LAPSIM Software consists of 3 components: - Lapsim Basic Skills ver.3.0 basic software 957 3

- Lapsim Dissection - add-on - Lapsin Gyn - add-on a.2. DENTSIM dental simulator Dentsim is a revolutionary dental system for learning, training and qualification in dental methods. Using the newest graphical techniques and simulation technologies, the system provides the most authentic way of training currently in the world. b) Computer aided surgery b.1. IGI system - Image Guided Implantology At first a virtual implant is added on the CT image (Computer Scan) by means of work instruments of the IGI system. 958 4

During the surgical procedure, the surgeon is assisted for an accurate positioning of the implant. b.2. TempoSurg average ear surgery The system with feedback possibilities simulates surgeries of the average ear: implants, operation on tumors and other treatments being unique by the constant stereoscopic three-dimensional visualization by means of 3D shutter glasses. c) Virtual treatment of pain c.1. Virtual Reality Analgesia: the illusion of entering virtual reality is created. During the introspection in the imaginary world, the patient senses a reduction of pain. The device facilitates research of the human brain in order to discover the phenomena which generate pain reduction. c.2. Water-Friendly Virtual Reality. Hunter Hoffman created and Jeff Magula built an optical fiber VR with the role of distracting the burnt patients attention from the physical pain. The patient is placed in a water tub and by means of VR accessories the virtual world gets the patient s attention, resulting in reduction of the activity of the attention centers by accelerating the centers for vision and focus. Thus pain which usually accompanied change of bandages is much diminished. 9595

c.3. Virtual reality at the dentist: Who has not dreamt of a dental intervention which passed very quickly and without pain or fear of the dental equipment? Now this is possible with the help of virtual reality. By means of special devices, the child can play while the doctor completes the intervention. Although it is still at the beginning, rendering medical interventions virtual and robot, will allow dissemination of knowledge and operator skills in the entire medical community. The main advantages of aided surgery are: General availability of difficult surgical techniques; Creation of new surgical procedures; A new market of CAS applications and reduction of social costs an intervention implies (reduced hospital time, more efficient medication). Upon applying the concept of surgical robots, or completely automatic surgeries, the following should be considered: Patient security. If in the industrial environment application of robots is possible, the possibility of malfunctioning, which could jeopardize human lives, would make it impossible to place robots in the operating room; The unexpected robots are perfectly adapted to repetitive, boring and dull actions, especially those hazardous for a human operator. In surgery very few operations are similar to others, and the unexpected can occur anytime; Decision making robots did not develop so much that they are able to make complex decisions in complex situations. 3. CONCLUSIONS The purpose of this paper is informative and the aim was the general presentation of results for robot implementation and the virtual world in a very sensitive filed medicine. The main conclusion of the paper is that visual simulations have a higher degree of teaching application; taken images can be transferred into multimedia formats, as mpg, and further used in educational and planning steps of the treatment. 4. BIBLIOGRAPHY Debunne G, Desbrun M si colab. - Adaptive simulation of soft bodies in real-time, in Computer Animation 2000. Dounes M, Cavusoglu M si colab. - Virtual Environments for Training Critical Skills in Laparoscopic Surgery, Medicine Meets Virtual Reality 1998, San Diego, California, January 28-31, 1998 Heiss R, Neyret F, Senegas F - Realistic rendering of an organ surface in real-time for laparoscopic surgery, 2001 Thurfjell L, Lundin A, McLaughlin J - A Medical Platform for the Simulation of Surgical Procedures", Medicine Meets Virtual Reality 2001, Newport Beach, California, January 23-27, 2001 960 6