Realistic Force Reflection in the Spine Biopsy Simulator
|
|
- Matthew Lindsey
- 5 years ago
- Views:
Transcription
1 Realistic Force Reflection in the Spine Biopsy Simulator Dong-Soo Kwon*, Ki-uk Kyung*, Sung Min Kwon**, Jong Beom Ra**, Hyun Wook Park** Heung Sik Kang***, Jianchao Zeng****, and Kevin R Cleary**** * Dept. of Mech. Eng. KAIST (Tel : ; Fax : ; kwonds@me.kaist.ac.kr) ** Dept. of Elec. Eng & Computer Science. KAIST (Tel : ; jbra@ee.kaist.ac.kr) *** Dept. of Diagnostic Radiology, Seoul National University College of Medicine ( kanghs@radcom.snu.ac.kr) **** ISIS of Georgetown Univ. (Tel : ; Fax : ; cleary@isis.imac.georgetown.edu) Abstract This paper proposes a scheme to produce realistic force reflection in a needle insertion problem. The target system is the spine needle biopsy simulator for tumor inspection by needle insertion. Simulated force is calculated using the 3D human tissue model, the orientation and position of the needle, and this force is produced through the PHANToM TM device. To generate realistic force reflection, the directional force of the needle has been generated by related tissue model, and the other rotational force is generated using a pivot to keep the needle in the initial inserted direction after puncturing the skin. Since the haptic device has limitation for generating high stiffness and large damping, scale downed model and digital filter are used to stabilize the system. 1. Introduction Medical engineering technology has kept a pace with remarkable development of the computer hardware. Such development of medical technology has introduced many changes on the public well fare and on the medical education environment. Especially there is long stride in medical simulators that help acquiring medical skill and knowledge. The major change comparing with the previous simulator is haptic feedback. Watson et al. developed stereoscopic-haptic virtual environments [1]. Karl et al. studied real-time visually and haptically accurate surgical simulation. In this study, they implemented an algorithm to feel the surgical cutting [2]. The application area of force feedback is getting larger and larger. Many basic researches have been also performed. Heimenz and Maaβ experimented to find physical characteristics of different tissues [3,4]. Hopkins analyzed biomechanical characteristics of muscle and bone [5]. Margaret developed a 3 DOF (degree of freedom) joystick that provides force feedback. Kwon studied a 6 DOF haptic controller for telerobot system [6]. Massie developed a PHANToM TM device that has 6 degree of freedom and could make 3 DOF force [9]. Immersion Corporation developed Laparoscopic Impulse Engine [10]. These PHANToM TM and Laparoscopic Impulse Engine are commercialized and used in many medical simulators. In this paper, we propose a method to generate realistic force reflection during needle insertion into a hollow dummy in the spine biopsy simulator. A spine needle biopsy is a useful non-invasive operation to detect and verify a spine tumor. For this operation, a tissue is extracted from the spine of a living body using a hollow needle. However, since there are many critical organs near the spine, the spine needle biopsy operation requires complicated and accurate procedures. Hence, a lot of training is essential for reliable operations. Sunil and Popa measured the force from the needle during a needle biopsy and they tried to generate a same force reflection in the needle biopsy simulation [7,8]. Kevin applied PHANToM TM device to a 2D spine needle biopsy simulator [11]. The rest of the paper is organized as follows. We briefly introduce a surgical simulator for spine needle biopsy in Section 2. In Section 3, we present implementation details for force reflection. Finally, we present result and state our conclusions in Section Spine Needle Biopsy Simulator In this session, we introduce a spine needle biopsy simulator that provides realistic visual and force feedback to a trainee in the PC environment [12]. This system is composed of four parts: a 3D human model, a visual feedback part, a force feedback part, and an evaluation part D Human Model A 3D human model plays an important role in the spine needle biopsy simulator because most parts of this system use this model. Therefore all kinds of data should be included. The 3D human model has two types of data. The one data type is common data. All voxels have common data such as CT density data, segmentation data, gradient data, and normal vector data. These common data are used by the visual feedback part, but especially segmentation data is used by force feedback part also. The other data type is individual data that depends on a kind of organ. Each organ has special characteristics such as 3D rendering parameters (color, opacity), and force generation parameter (spring constant). The 3D model uses 335 XCT slices having an intraslice resolution of 0.7mm and an inter-slice resolution of 1mm. This data set is given by Seoul National University Hospital. In order to get segmented 3D organ models based on these CT slices, a homemade semiautomatic segmentation tool is used. The target organs are selected as organs that should be needed in the procedure of simulating
2 Figure 1. The Spine Needle Biopsy Simulator spine needle biopsy. Doctors in the department of diagnostic radiology decide these organs. For the lumbar vertebra region, bone, lung, esophagus, artery, skin, muscle, and fat are selected as the target. For the thoracic vertebra region, vein and kidney are chosen additionally. Therefore total 9 organs are modeled in our 3D human model. 2.2 Visual Feedback Part Visual feedback includes all the GUI (graphic user interface) of the simulation system. Through the GUI of whole procedure, a trainee has a visual experience. In our simulator, there are two types of visual feedback. The one is 2D virtual CT console and the other is 3D view. The 2D virtual CT console box mimics the GUI and functions of a real CT system. In the 2D virtual CT console, a trainee can select a lesion that is a candidate for spine tumor. Then he simulates scanning CT images around the lesion. Many kinds of analysis tool are provided to the trainee in this console, such as finding a distance between two points, measuring an angle between two lines, zooming a specific CT image, etc. The second visual feedback part is 3D view. In this visual feedback part, 3D path planning tool is provided for the needle path from the skin to the lesion. Unlike previous 2D simulators, it supports realistic 3D volume rendering views interactively for 3D path planning. It provides axial, sagittal, coronal and 3D visualization images around the region also. Especially for the 3D visualization image, a trainee selects one image among color volume rendering result, gray volume rendering result, MIP (maximum intensity projection), and summed voxel projection. For the fast 3D volume rendering, a block-based technique is adopted for the efficient handling of large amounts of data and for the easy control of rendering parameters such as opacity [15]. 2.3 Force Feedback Part Force feedback increases the reality in the simulation system. The PHANToM TM haptic device of SensAble Technologies, Inc. is used and the spine biopsy needle replaces a stylus pen in order to implement directional and rotational force without any additional mechanical calculation. A haptic device is used to provide the force feedback to a trainee through the biopsy needle during simulation. For proper force feedback generation, the 3D human model data that contain force feedback parameters of organs near the spine is used and the haptic device is kept operating in 1kHz. A mock operation table that has same height as a real one is constructed and a dummy is laid down on the table. After that, a trainee is supposed to insert the spine biopsy needle into the hollow dummy on the table to feel the force in realistic environment. We explain more details in section Simulation This system is implemented by attaching a 3 DOF PHANToM TM device to a PC that has 600MHz Pentium III Dual CPUs and 512Mbyte RAM. A trainee simulates taking CT images of a patient and selects a lesion that is candidate for spine tumor in the 2D virtual CT console. In the 3D view, the 256x256x256 3D human model is rendered so that the trainee could plan the appropriate needle path from the skin to the lesion not to touch the other critical organs. After planning, he operates a needle biopsy virtually using haptic device. When he moves the needle, the haptic device captures the movements of the needle and these captured movements are rendered over the 3D human model. According to the position of the needle, the trainee feels different force reflection. For a 256x256x256 XCT abdomen volume data set, if he moves the spine needle only, it provides an update-rate over 25 Hz for visual-feedback and over 1kHz for force-feedback. When he touches the lesion with the needle tip, this simulation is over. Figure 2. The physical user interface of the developed spine biopsy simulator.
3 a correction force to keep the needle along the direction of movement( F ); and 3) an ambient force to compensate for C gravity( F ). This section explains how to calculate these G forces. Figure 3. Graphic user interface 2.5 Evaluation Part The evaluation part provides a full performance analysis to the trainee after simulation. This part includes information regarding the final position of needle tip, a list of punctured critical organs, a maximum deviation from the planned path, the number of trials, and the total time spent. 3. Implementation of Force Reflection Figure 5 illustrates force reflection mechanism for a needle biopsy simulator. F = F + F + F (1) R C Equation (1) shows the total force( F ) has three components: 1) the force required to penetrate tissue( F ); 2) R G 3.1 Tissue Penetration Resistive Force This force is simulated from the initial skin puncture until bone is touched. Since the maximum force that can be generated using PHANToM TM is 8.5N, the device has limited ability to simulate stiff bone[7]. In addition, since soft tissue, muscle and fat have nonlinear stiffness and damping properties, experiments and analysis are required for accurate modeling. Maaβ developed a model after measuring their elastic properties using ultrasonic wave[3]. However, the needle biopsy has not only an elastic process, but also a tissue fracture process. Also, the resistive force depends on the needle insertion speed[4]. In our simulator, experimental data were used to develop a tissue model. Sunil showed experimental results for needle punctures and developed an interactive lumbar puncture simulator with tactile feedback[7],[8]. The direction of the tissue penetration resistive force depends on the needle direction. The upper limit of this force is set to 6N because the PHANToM can only generate 8.5N as a peak force. Figure 6 shows Sunil s experimental data which were collected by a needle insertion with constant velocity, 1cm/sec[3]. We modeled each tissue as a spring without damping. Since position resolution at a needle tip is low and damping display of a haptic device is poor[9], damping is not considered. To simulate a realistic force profile, stiffness varies with the depth of inserted needle and the image segmentation value. Figure 4. Evaluation reports Figure 5. Force Reflection Mechanism
4 Figure 6. Needle Puncturing Resistive Force [7] Figure 8. Simulated Resistive Force the model is similar to the experimental data of Figure 6. Figure 7. Force Generation Algorithm Although the image segmentation classifies tissues as air, skin, muscle, lung, vein, artery, kidney and bone, the simulated force is derived from only air, skin, fat and bone because these are the tissues penetrated by the needle in most spine biopsies. If the biopsy path touches a lung or a kidney, the force falls to zero and a red warning sign appears on the screen. Figure 7 shows the algorithm used to calculate the tissue penetration force. Xr is a reference position to calculate force and this point is located on the needle. And Xp is a its tip position. k is stiffness of the tissue and vel is a speed and d is a depth of the needle insertion. Xr is determined with the inserted needle direction and the tissue that is punctured by needle. Variables, Xd, Xd2 are used to decide the time to change Xr. It is assumed that the skin is punctured when the needle is inserted into some desired depth. Figure 8 shows simulation results of the resistive force. Note the result of 3.2 Correction Force to Simulate Tissue Constraint In real needle biopsy, the motion of the needle is constrainted after insertion by the internal tissue. Moving the needle along the direction of the motion is not difficult, but it is very difficult to move to an orthogonal direction. Since the PHANToM(ver1.5) can only generate haptic translational forces (and not torques), an additional force is required to constrain the needle once it is inserted into the dummy. To solve this problem we make a hole at the surface of a dummy which is used as a pivot point to create rotational forces to constrain the needle along the inserted direction. At first, the direction vector of the needle is computed after the skin puncture. For calculation of the correction force, we assumed the following: The needle is touching only muscle or fat. The skin punctured position is a point and does not change. The rotational angle is much smaller than 1 radian. The first assumption is reasonable because the skin is very thin and there is only muscle and fat between the skin and the bone. The second assumption is trivial. Since the side surface of the needle is not sharp like tip and its motion is constrainted by internal tissues except the movement of inserted direction, the third one is acceptable. Using these assumptions, the correction force is calculated using the torque derived from the force at the needle tip. Figure 5 shows the initial needle direction vector Vi and the current needle direction vector Vc. Vi is derived by multiplying the needle inserted unit vector with the needle length. Vc is derived from the current tip point and the gimbal point of the needle. The correction force Fc can then be derived from the difference of these two vectors. The upper limit of this force is 2N since the haptic device can only generate 8.5N and the limit of the tissue penetration force is 6N. Since the tissues between skin and bone are muscle and fat, the stiffness for
5 Figure 9. Conversion of Correction Force correction force is determined from muscle and fat and this force is calculated by multiplying the correction vector by a stiffness and a constant. From experimental results, we verified that this correction force helps to keep the needle along the initial inserted direction can confirm that correction help to keep needle in initial inserted direction. Figure 9 shows the simulated force that must be applied by the haptic device. Fc_sim is derived as follows: Figure 10. Puncture Resistive Force over Time ll Fc _ sim = Fc (2) l Compensation of Stiffness only Model and Stabilization for hard contact to bone Since the spring model is applied to virtual tissue, the needle jumps out when user releases it during insertion. And user even feels the pushed force during pulling needle out. Figure 7 shows the algorithm to simulate the cut feeling after the tissue puncture. The velocity value is used to detect current moving direction, and puling out and inserting is distinguished from this value. Using these, the resistive force falls to zero as the needle is pulled out. For more realistic modeling, it is required viscosity or viscoelastic tissue model. Vibration occurs when the needle contact to the bone. There are two reasons for this. First, mixed volume data with low resolution and abruptly changing stiffness can cause force discontinuities near the bone. This problem has been solved by using a digital filter. Second, the haptic interface has a limited ability to simulate high stiffness. Since the stiffness of the bone is high, it is not typically penetrated by needle puncture alone. As Colgate suggested passivity condition to guarantee stability[13], stiffness is scale downed to satisfy the stability condition. Figure 10 and Figure 11 show the tissue penetration resistive force and inserted depth of the needle over time. The system is stable when it touches the bone. The resistive force falls to zero as the needle is pulled out. 4. Summary The simulated force is calculated from the relationship between volume image data and the orientation and orientation and position of the needle. For more realistic force reflection in the spine needle biopsy simulator, the directional force of the needle has been generated by a tissue model. The rotational force is generated using a pivot to Figure 11. Inserted depth of needle keep the needle in the initial inserted direction after puncturing the skin. Since the haptic device employed has limited ability to generate high stiffness and large damping, a scale downed stiffness model and digital filter are used to stabilize the system. For more realistic simulator, tissue modeling based on biomechanics is required. And the device and controller to generate high stiffness and damping with stability is necessary. Acknowledgement This research was supported by the Korean Ministry of Information and Communication as a international joint project with ISIS Center at Georgetown University Medical Center, USA. REFERENCES [1] Watson K. et al., Development of stereoscopic-haptic virtual environments, 12th IEEE Symposium on Computer-based medical systems, pp , [2] Karl D. Reinig et al., Real-time Visually and Haptically Accurate surgical simulation, [3] Maaß H.and Kuhnapfel U., Noninvasive Measurement of Elastic Properties of Living Tissue, 13th
6 International. Congress on Computer Assisted Radiology and Surgery (CARS '99), Paris, France, June 23-26, pp , [4] Heimenz L. and Litsky A., Puncture Mechanics for the Insertion of an Epidual Needle, Americal Society of Biomechanics 21th Annual Meeting, [5] David A. Hopkins, Musculoskeletal Biomechanics Research, dahsite/dahsite.htm, [6] Dong-Soo Kwon, Ki Young Woo, and Hyung Suck Cho, Haptic Control of the Master Hand Controller for a Microsurgical Telerobot System, Proc. of the IEEE Int. Conf. on Robotics and Automation, pp. 1722~1727, [7] Sunil K. Singh and Mikael Bostrom, Design an Interactive lumbar Puncture Simulator with Tactile Feedback, IEEE International Workshop on Robot and Human Communication, [8] Dan O. Popa et al., Creating Realistic Force Sensations in a Virtual Environment: Experimental System, Fundamental issues and Results, Proc. of the IEEE International Conference on Robotics and Automation, [9] Thomas Massie, Design of a Force Reflecting Fingertip Stimulator, Bachelor s Thesis, Department of Electrical Engineering and Computer Science, MIT, [10] Immersion Co., Products and Technologies, [11] Kevin Cleary and Robert Greco, Development and Evaluation of a Spine Biopsy Simulator, Proceeding of Medicine Meets Virtual Reality, vol. 50, pp , [12] J. Kim et al, Development of a Spine Needle Biopsy Simulator with Visual and Force Feedback, Proceeding of Congress on Computer Assisted Radiology and Surgery (CARS) 99, pp. 1052, Paris, France, June 23-26, [13] Edward J. Colgate and Gerd G. Schenkel, Passivity of a Class of Sampled-Data Systems: Application to Haptic Interface, American Control Conference, Baltimore, pp , [14] Paul Gorman, Thomas Krummel et al, A Prototype Haptic Lumbar Puncture Simulator, Proceeding of Medicine Meets Virtual Reality 2000, IOS Press, vol. 70, pp , [15] S. M. Kwon, J. K. Kim, and J. B. Ra, A Block-Based Volume Rendering Scheme for the Spine Biopsy Simulator, Proc. IEEE ICIP 1999, vol. 2, pp , Kobe, Japan, 1999.
Realistic Force Reflection in a Spine Biopsy Simulator
Proceedings of the 2001 IEEE International Conference on Robotics & Automation Seoul, Korea May 21-26, 2001 Realistic Force Reflection in a Spine Biopsy Simulator Dong-Soo Kwon*, Ki-Uk Kyung*, Sung Min
More informationAHAPTIC interface is a kinesthetic link between a human
IEEE TRANSACTIONS ON CONTROL SYSTEMS TECHNOLOGY, VOL. 13, NO. 5, SEPTEMBER 2005 737 Time Domain Passivity Control With Reference Energy Following Jee-Hwan Ryu, Carsten Preusche, Blake Hannaford, and Gerd
More informationForce feedback interfaces & applications
Force feedback interfaces & applications Roope Raisamo Tampere Unit for Computer-Human Interaction (TAUCHI) School of Information Sciences University of Tampere, Finland Based on material by Jukka Raisamo,
More informationA NEW APPROACH FOR ONLINE TRAINING ASSESSMENT FOR BONE MARROW HARVEST WHEN PATIENTS HAVE BONES DETERIORATED BY DISEASE
A NEW APPROACH FOR ONLINE TRAINING ASSESSMENT FOR BONE MARROW HARVEST WHEN PATIENTS HAVE BONES DETERIORATED BY DISEASE Ronei Marcos de Moraes 1, Liliane dos Santos Machado 2 Abstract Training systems based
More informationMethods for Haptic Feedback in Teleoperated Robotic Surgery
Young Group 5 1 Methods for Haptic Feedback in Teleoperated Robotic Surgery Paper Review Jessie Young Group 5: Haptic Interface for Surgical Manipulator System March 12, 2012 Paper Selection: A. M. Okamura.
More informationA Feasibility Study of Time-Domain Passivity Approach for Bilateral Teleoperation of Mobile Manipulator
International Conference on Control, Automation and Systems 2008 Oct. 14-17, 2008 in COEX, Seoul, Korea A Feasibility Study of Time-Domain Passivity Approach for Bilateral Teleoperation of Mobile Manipulator
More informationDiscrimination of Virtual Haptic Textures Rendered with Different Update Rates
Discrimination of Virtual Haptic Textures Rendered with Different Update Rates Seungmoon Choi and Hong Z. Tan Haptic Interface Research Laboratory Purdue University 465 Northwestern Avenue West Lafayette,
More informationIntegrating PhysX and OpenHaptics: Efficient Force Feedback Generation Using Physics Engine and Haptic Devices
This is the Pre-Published Version. Integrating PhysX and Opens: Efficient Force Feedback Generation Using Physics Engine and Devices 1 Leon Sze-Ho Chan 1, Kup-Sze Choi 1 School of Nursing, Hong Kong Polytechnic
More informationFORCE FEEDBACK. Roope Raisamo
FORCE FEEDBACK Roope Raisamo Multimodal Interaction Research Group Tampere Unit for Computer Human Interaction Department of Computer Sciences University of Tampere, Finland Outline Force feedback interfaces
More information5HDO 7LPH 6XUJLFDO 6LPXODWLRQ ZLWK +DSWLF 6HQVDWLRQ DV &ROODERUDWHG :RUNV EHWZHHQ -DSDQ DQG *HUPDQ\
nsuzuki@jikei.ac.jp 1016 N. Suzuki et al. 1). The system should provide a design for the user and determine surgical procedures based on 3D model reconstructed from the patient's data. 2). The system must
More informationHaptic Reproduction and Interactive Visualization of a Beating Heart Based on Cardiac Morphology
MEDINFO 2001 V. Patel et al. (Eds) Amsterdam: IOS Press 2001 IMIA. All rights reserved Haptic Reproduction and Interactive Visualization of a Beating Heart Based on Cardiac Morphology Megumi Nakao a, Masaru
More informationVirtual Reality as Human Interface and its application to Medical Ultrasonic diagnosis
14 INTERNATIONAL JOURNAL OF APPLIED BIOMEDICAL ENGINEERING VOL.1, NO.1 2008 Virtual Reality as Human Interface and its application to Medical Ultrasonic diagnosis Kazuhiko Hamamoto, ABSTRACT Virtual reality
More informationTitolo presentazione sottotitolo
Integration of a Virtual Reality Environment for Percutaneous Renal Puncture in the Routine Clinical Practice of a Tertiary Department of Interventional Urology: A Feasibility Study Titolo presentazione
More informationGaussian Naive Bayes for Online Training Assessment in Virtual Reality-Based Simulators
Mathware & Soft Computing 16 (2009), 123-132 Gaussian Naive Bayes for Online Training Assessment in Virtual Reality-Based Simulators Ronei Marcos de Moraes, 1, Liliane dos Santos Machado 2 1 Department
More informationComputer Haptics and Applications
Computer Haptics and Applications EURON Summer School 2003 Cagatay Basdogan, Ph.D. College of Engineering Koc University, Istanbul, 80910 (http://network.ku.edu.tr/~cbasdogan) Resources: EURON Summer School
More informationHaptic Virtual Fixtures for Robot-Assisted Manipulation
Haptic Virtual Fixtures for Robot-Assisted Manipulation Jake J. Abbott, Panadda Marayong, and Allison M. Okamura Department of Mechanical Engineering, The Johns Hopkins University {jake.abbott, pmarayong,
More informationForce display using a hybrid haptic device composed of motors and brakes
Mechatronics 16 (26) 249 257 Force display using a hybrid haptic device composed of motors and brakes Tae-Bum Kwon, Jae-Bok Song * Department of Mechanical Engineering, Korea University, 5, Anam-Dong,
More informationRobust Haptic Teleoperation of a Mobile Manipulation Platform
Robust Haptic Teleoperation of a Mobile Manipulation Platform Jaeheung Park and Oussama Khatib Stanford AI Laboratory Stanford University http://robotics.stanford.edu Abstract. This paper presents a new
More informationCutaneous Feedback of Fingertip Deformation and Vibration for Palpation in Robotic Surgery
Cutaneous Feedback of Fingertip Deformation and Vibration for Palpation in Robotic Surgery Claudio Pacchierotti Domenico Prattichizzo Katherine J. Kuchenbecker Motivation Despite its expected clinical
More informationBodyViz fact sheet. BodyViz 2321 North Loop Drive, Suite 110 Ames, IA x555 www. bodyviz.com
BodyViz fact sheet BodyViz, the company, was established in 2007 at the Iowa State University Research Park in Ames, Iowa. It was created by ISU s Virtual Reality Applications Center Director James Oliver,
More informationPROPRIOCEPTION AND FORCE FEEDBACK
PROPRIOCEPTION AND FORCE FEEDBACK Roope Raisamo and Jukka Raisamo Multimodal Interaction Research Group Tampere Unit for Computer Human Interaction Department of Computer Sciences University of Tampere,
More informationThe Haptic Impendance Control through Virtual Environment Force Compensation
The Haptic Impendance Control through Virtual Environment Force Compensation OCTAVIAN MELINTE Robotics and Mechatronics Department Institute of Solid Mechanicsof the Romanian Academy ROMANIA octavian.melinte@yahoo.com
More informationMotion Control of Excavator with Tele-Operated System
26th International Symposium on Automation and Robotics in Construction (ISARC 2009) Motion Control of Excavator with Tele-Operated System Dongnam Kim 1, Kyeong Won Oh 2, Daehie Hong 3#, Yoon Ki Kim 4
More informationUsing Simulation to Design Control Strategies for Robotic No-Scar Surgery
Using Simulation to Design Control Strategies for Robotic No-Scar Surgery Antonio DE DONNO 1, Florent NAGEOTTE, Philippe ZANNE, Laurent GOFFIN and Michel de MATHELIN LSIIT, University of Strasbourg/CNRS,
More informationHaptic interaction. Ruth Aylett
Haptic interaction Ruth Aylett Contents Haptic definition Haptic model Haptic devices Measuring forces Haptic Technologies Haptics refers to manual interactions with environments, such as sensorial exploration
More informationDesign and Implementation of a Haptic Device for Training in Urological Operations
IEEE TRANSACTIONS ON ROBOTICS AND AUTOMATION, VOL. 19, NO. 5, OCTOBER 2003 801 Design and Implementation of a Haptic Device for Training in Urological Operations Kostas Vlachos, Evangelos Papadopoulos,
More informationHaptic Control of the Master Hand Controller for a Microsurgical Telerobot System
Proceedings of the 1999 IEEE International Conference on Robotics & Automation Detroit, Michigan May 1999 Haptic Control of the Master Hand Controller for a Microsurgical Telerobot System Dong-Soo Kwonl,
More informationUsing Simple Force Feedback Mechanisms as Haptic Visualization Tools.
Using Simple Force Feedback Mechanisms as Haptic Visualization Tools. Anders J Johansson, Joakim Linde Teiresias Research Group (www.bigfoot.com/~teiresias) Abstract Force feedback (FF) is a technology
More informationVR based HCI Techniques & Application. November 29, 2002
VR based HCI Techniques & Application November 29, 2002 stefan.seipel@hci.uu.se What is Virtual Reality? Coates (1992): Virtual Reality is electronic simulations of environments experienced via head mounted
More informationUsing Web-Based Computer Graphics to Teach Surgery
Using Web-Based Computer Graphics to Teach Surgery Ken Brodlie Nuha El-Khalili Ying Li School of Computer Studies University of Leeds Position Paper for GVE99, Coimbra, Portugal Surgical Training Surgical
More informationControl design issues for a microinvasive neurosurgery teleoperator system
Control design issues for a microinvasive neurosurgery teleoperator system Jacopo Semmoloni, Rudy Manganelli, Alessandro Formaglio and Domenico Prattichizzo Abstract This paper deals with controller design
More informationience e Schoo School of Computer Science Bangor University
ience e Schoo ol of Com mpute er Sc Visual Computing in Medicine The Bangor Perspective School of Computer Science Bangor University Pryn hwn da Croeso y RIVIC am Prifysgol Abertawe Siarad Cymraeg? Schoo
More informationParallax-Free Long Bone X-ray Image Stitching
Parallax-Free Long Bone X-ray Image Stitching Lejing Wang 1,JoergTraub 1, Simon Weidert 2, Sandro Michael Heining 2, Ekkehard Euler 2, and Nassir Navab 1 1 Chair for Computer Aided Medical Procedures (CAMP),
More informationHaptic Rendering CPSC / Sonny Chan University of Calgary
Haptic Rendering CPSC 599.86 / 601.86 Sonny Chan University of Calgary Today s Outline Announcements Human haptic perception Anatomy of a visual-haptic simulation Virtual wall and potential field rendering
More informationPrecise Analytical Solution for the Peak Gain of LLC Resonant Converters
680 Journal of Power Electronics, Vol. 0, No. 6, November 200 JPE 0-6-4 Precise Analytical Solution for the Peak Gain of LLC Resonant Converters Sung-Soo Hong, Sang-Ho Cho, Chung-Wook Roh, and Sang-Kyoo
More informationCurrent Status and Future of Medical Virtual Reality
2011.08.16 Medical VR Current Status and Future of Medical Virtual Reality Naoto KUME, Ph.D. Assistant Professor of Kyoto University Hospital 1. History of Medical Virtual Reality Virtual reality (VR)
More informationSmall Occupancy Robotic Mechanisms for Endoscopic Surgery
Small Occupancy Robotic Mechanisms for Endoscopic Surgery Yuki Kobayashi, Shingo Chiyoda, Kouichi Watabe, Masafumi Okada, and Yoshihiko Nakamura Department of Mechano-Informatics, The University of Tokyo,
More informationOverview of current developments in haptic APIs
Central European Seminar on Computer Graphics for students, 2011 AUTHOR: Petr Kadleček SUPERVISOR: Petr Kmoch Overview of current developments in haptic APIs Presentation Haptics Haptic programming Haptic
More informationPerformance Issues in Collaborative Haptic Training
27 IEEE International Conference on Robotics and Automation Roma, Italy, 1-14 April 27 FrA4.4 Performance Issues in Collaborative Haptic Training Behzad Khademian and Keyvan Hashtrudi-Zaad Abstract This
More informationCS277 - Experimental Haptics Lecture 2. Haptic Rendering
CS277 - Experimental Haptics Lecture 2 Haptic Rendering Outline Announcements Human haptic perception Anatomy of a visual-haptic simulation Virtual wall and potential field rendering A note on timing...
More informationThe Virtual Haptic Back (VHB): a Virtual Reality Simulation of the Human Back for Palpatory Diagnostic Training
Paper Offer #: 5DHM- The Virtual Haptic Back (VHB): a Virtual Reality Simulation of the Human Back for Palpatory Diagnostic Training John N. Howell Interdisciplinary Institute for Neuromusculoskeletal
More informationA Kickball Game for Ankle Rehabilitation by JAVA, JNI and VRML
A Kickball Game for Ankle Rehabilitation by JAVA, JNI and VRML a a b Hyungjeen Choi, Jeha Ryu, and Chansu Lee a Human Machine Computer Interface Lab, Kwangju Institute of Science and Technology, Kwangju,
More informationPhantom-Based Haptic Interaction
Phantom-Based Haptic Interaction Aimee Potts University of Minnesota, Morris 801 Nevada Ave. Apt. 7 Morris, MN 56267 (320) 589-0170 pottsal@cda.mrs.umn.edu ABSTRACT Haptic interaction is a new field of
More informationHaptic Rendering and Volumetric Visualization with SenSitus
Haptic Rendering and Volumetric Visualization with SenSitus Stefan Birmanns, Ph.D. Department of Molecular Biology The Scripps Research Institute 10550 N. Torrey Pines Road, Mail TPC6 La Jolla, California,
More informationElements of Haptic Interfaces
Elements of Haptic Interfaces Katherine J. Kuchenbecker Department of Mechanical Engineering and Applied Mechanics University of Pennsylvania kuchenbe@seas.upenn.edu Course Notes for MEAM 625, University
More informationANOTHER APPROACH FOR FUZZY NAIVE BAYES APPLIED ON ONLINE TRAINING ASSESSMENT IN VIRTUAL REALITY SIMULATORS
ANOTHER APPROACH FOR FUZZY NAIVE BAYES APPLIED ON ONLINE TRAINING ASSESSMENT IN VIRTUAL REALITY SIMULATORS Ronei Marcos de Moraes 1, Liliane dos Santos Machado 2 Abstract Training systems based on virtual
More informationNovel machine interface for scaled telesurgery
Novel machine interface for scaled telesurgery S. Clanton, D. Wang, Y. Matsuoka, D. Shelton, G. Stetten SPIE Medical Imaging, vol. 5367, pp. 697-704. San Diego, Feb. 2004. A Novel Machine Interface for
More informationMulti-Rate Multi-Range Dynamic Simulation for Haptic Interaction
Multi-Rate Multi-Range Dynamic Simulation for Haptic Interaction Ikumi Susa Makoto Sato Shoichi Hasegawa Tokyo Institute of Technology ABSTRACT In this paper, we propose a technique for a high quality
More informationImage Guided Robotic Assisted Surgical Training System using LabVIEW and CompactRIO
Image Guided Robotic Assisted Surgical Training System using LabVIEW and CompactRIO Weimin Huang 1, Tao Yang 1, Liang Jing Yang 2, Chee Kong Chui 2, Jimmy Liu 1, Jiayin Zhou 1, Jing Zhang 1, Yi Su 3, Stephen
More informationUngrounded Kinesthetic Pen for Haptic Interaction with Virtual Environments
The 18th IEEE International Symposium on Robot and Human Interactive Communication Toyama, Japan, Sept. 27-Oct. 2, 2009 WeIAH.2 Ungrounded Kinesthetic Pen for Haptic Interaction with Virtual Environments
More informationPosition and Force Control of Teleoperation System Based on PHANTOM Omni Robots
International Journal of Mechanical Engineering and Robotics Research Vol. 5, No., January 6 Position and Force Control of Teleoperation System Based on PHANTOM Omni Robots Rong Kong, Xiucheng Dong, and
More informationISMCR2004. Abstract. 2. The mechanism of the master-slave arm of Telesar II. 1. Introduction. D21-Page 1
Development of Multi-D.O.F. Master-Slave Arm with Bilateral Impedance Control for Telexistence Riichiro Tadakuma, Kiyohiro Sogen, Hiroyuki Kajimoto, Naoki Kawakami, and Susumu Tachi 7-3-1 Hongo, Bunkyo-ku,
More informationOn Observer-based Passive Robust Impedance Control of a Robot Manipulator
Journal of Mechanics Engineering and Automation 7 (2017) 71-78 doi: 10.17265/2159-5275/2017.02.003 D DAVID PUBLISHING On Observer-based Passive Robust Impedance Control of a Robot Manipulator CAO Sheng,
More informationNetworked haptic cooperation using remote dynamic proxies
29 Second International Conferences on Advances in Computer-Human Interactions Networked haptic cooperation using remote dynamic proxies Zhi Li Department of Mechanical Engineering University of Victoria
More informationPeter Berkelman. ACHI/DigitalWorld
Magnetic Levitation Haptic Peter Berkelman ACHI/DigitalWorld February 25, 2013 Outline: Haptics - Force Feedback Sample devices: Phantoms, Novint Falcon, Force Dimension Inertia, friction, hysteresis/backlash
More informationHaptic presentation of 3D objects in virtual reality for the visually disabled
Haptic presentation of 3D objects in virtual reality for the visually disabled M Moranski, A Materka Institute of Electronics, Technical University of Lodz, Wolczanska 211/215, Lodz, POLAND marcin.moranski@p.lodz.pl,
More informationReal Time Deconvolution of In-Vivo Ultrasound Images
Paper presented at the IEEE International Ultrasonics Symposium, Prague, Czech Republic, 3: Real Time Deconvolution of In-Vivo Ultrasound Images Jørgen Arendt Jensen Center for Fast Ultrasound Imaging,
More informationIN virtual reality (VR) technology, haptic interface
1 Real-time Adaptive Prediction Method for Smooth Haptic Rendering Xiyuan Hou, Olga Sourina, arxiv:1603.06674v1 [cs.hc] 22 Mar 2016 Abstract In this paper, we propose a real-time adaptive prediction method
More informationModeling and Experimental Studies of a Novel 6DOF Haptic Device
Proceedings of The Canadian Society for Mechanical Engineering Forum 2010 CSME FORUM 2010 June 7-9, 2010, Victoria, British Columbia, Canada Modeling and Experimental Studies of a Novel DOF Haptic Device
More informationWearable haptic-based multi-modal interaction for tangible interface
Wearable haptic-based multi-modal interaction for tangible interface Sungchul Kang, Seung-kook Yun, Chang-Soon Hwang, Laehyun Kim, Yoha Hwang, Munsang Kim, Sehyung Park, Sungdo Ha Intelligent Robotics
More informationRobotic System Simulation and Modeling Stefan Jörg Robotic and Mechatronic Center
Robotic System Simulation and ing Stefan Jörg Robotic and Mechatronic Center Outline Introduction The SAFROS Robotic System Simulator Robotic System ing Conclusions Folie 2 DLR s Mirosurge: A versatile
More informationDevelopment of a Walking Support Robot with Velocity-based Mechanical Safety Devices*
2013 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) November 3-7, 2013. Tokyo, Japan Development of a Walking Support Robot with Velocity-based Mechanical Safety Devices* Yoshihiro
More informationReality-Based Models for Vibration Feedback in Virtual Environments
IEEE/ASME TRANSACTIONS ON MECHATRONICS, VOL. 6, NO. 3, SEPTEMBER 2001 245 Reality-Based Models for Vibration Feedback in Virtual Environments Allison M. Okamura, Associate Member, IEEE, Mark R. Cutkosky,
More informationExpression of 2DOF Fingertip Traction with 1DOF Lateral Skin Stretch
Expression of 2DOF Fingertip Traction with 1DOF Lateral Skin Stretch Vibol Yem 1, Mai Shibahara 2, Katsunari Sato 2, Hiroyuki Kajimoto 1 1 The University of Electro-Communications, Tokyo, Japan 2 Nara
More informationHaptic Feedback in Laparoscopic and Robotic Surgery
Haptic Feedback in Laparoscopic and Robotic Surgery Dr. Warren Grundfest Professor Bioengineering, Electrical Engineering & Surgery UCLA, Los Angeles, California Acknowledgment This Presentation & Research
More informationForce Feedback Mechatronics in Medecine, Healthcare and Rehabilitation
Force Feedback Mechatronics in Medecine, Healthcare and Rehabilitation J.P. Friconneau 1, P. Garrec 1, F. Gosselin 1, A. Riwan 1, 1 CEA-LIST DTSI/SRSI, CEN/FAR BP6, 92265 Fontenay-aux-Roses, France jean-pierre.friconneau@cea.fr
More informationDESIGN OF HYBRID TISSUE MODEL IN VIRTUAL TISSUE CUTTING
DESIGN OF HYBRID TISSUE 8 MODEL IN VIRTUAL TISSUE CUTTING M. Manivannan a and S. P. Rajasekar b Biomedical Engineering Group, Department of Applied Mechanics, Indian Institute of Technology Madras, Chennai-600036,
More informationMedical robotics and Image Guided Therapy (IGT) Bogdan M. Maris, PhD Temporary Assistant Professor
Medical robotics and Image Guided Therapy (IGT) Bogdan M. Maris, PhD Temporary Assistant Professor E-mail bogdan.maris@univr.it Medical Robotics History, current and future applications Robots are Accurate
More informationRASim Prototype User Manual
7 th Framework Programme This project has received funding from the European Union s Seventh Framework Programme for research, technological development and demonstration under grant agreement no 610425
More informationSteady-Hand Teleoperation with Virtual Fixtures
Steady-Hand Teleoperation with Virtual Fixtures Jake J. Abbott 1, Gregory D. Hager 2, and Allison M. Okamura 1 1 Department of Mechanical Engineering 2 Department of Computer Science The Johns Hopkins
More informationImage Interpretation System for Informed Consent to Patients by Use of a Skeletal Tracking
Image Interpretation System for Informed Consent to Patients by Use of a Skeletal Tracking Naoki Kamiya 1, Hiroki Osaki 2, Jun Kondo 2, Huayue Chen 3, and Hiroshi Fujita 4 1 Department of Information and
More informationChapter 2 Introduction to Haptics 2.1 Definition of Haptics
Chapter 2 Introduction to Haptics 2.1 Definition of Haptics The word haptic originates from the Greek verb hapto to touch and therefore refers to the ability to touch and manipulate objects. The haptic
More informationA Movement Based Method for Haptic Interaction
Spring 2014 Haptics Class Project Paper presented at the University of South Florida, April 30, 2014 A Movement Based Method for Haptic Interaction Matthew Clevenger Abstract An abundance of haptic rendering
More informationMedical Robotics. Part II: SURGICAL ROBOTICS
5 Medical Robotics Part II: SURGICAL ROBOTICS In the last decade, surgery and robotics have reached a maturity that has allowed them to be safely assimilated to create a new kind of operating room. This
More informationVibration Feedback Models for Virtual Environments
Presented at the 1998 IEEE International Conference on Robotics and Automation May 16-2, 1998, Leuven, Belgium Vibration Feedback Models for Virtual Environments Allison M. Okamura, 1,2 Jack T. Dennerlein
More informationIOSR Journal of Engineering (IOSRJEN) e-issn: , p-issn: , Volume 2, Issue 11 (November 2012), PP 37-43
IOSR Journal of Engineering (IOSRJEN) e-issn: 2250-3021, p-issn: 2278-8719, Volume 2, Issue 11 (November 2012), PP 37-43 Operative Precept of robotic arm expending Haptic Virtual System Arnab Das 1, Swagat
More informationReflex TM Surgical Technique. Anterior Cervical Plate
Reflex TM Surgical Technique Anterior Cervical Plate Surgical Technique Acknowledgement: Stryker Spine extends their thanks to the following surgeons for their participation in the development of the Reflex
More informationDevelopment Scheme of JewelSense: Haptic-based Sculpting Tool for Jewelry Design
Development Scheme of JewelSense: Haptic-based Sculpting Tool for Jewelry Design S. Wannarumon Kielarova Department of Industrial Engineering, Naresuan University, Phitsanulok 65000 * Corresponding Author
More informationA Training Simulator for the Angioplasty Intervention with a Web Portal for the Virtual Environment Searching
A Training Simulator for the Angioplasty Intervention with a Web Portal for the Virtual Environment Searching GIOVANNI ALOISIO, LUCIO T. DE PAOLIS, LUCIANA PROVENZANO Department of Innovation Engineering
More informationSelective Stimulation to Skin Receptors by Suction Pressure Control
Selective Stimulation to Skin Receptors by Suction Pressure Control Yasutoshi MAKINO 1 and Hiroyuki SHINODA 1 1 Department of Information Physics and Computing, Graduate School of Information Science and
More informationVirtual Sculpting and Multi-axis Polyhedral Machining Planning Methodology with 5-DOF Haptic Interface
Virtual Sculpting and Multi-axis Polyhedral Machining Planning Methodology with 5-DOF Haptic Interface Weihang Zhu and Yuan-Shin Lee* Department of Industrial Engineering North Carolina State University,
More informationHaptic interaction. Ruth Aylett
Haptic interaction Ruth Aylett Contents Haptic definition Haptic model Haptic devices Measuring forces Haptic Technologies Haptics refers to manual interactions with environments, such as sensorial exploration
More informationBenefits of using haptic devices in textile architecture
28 September 2 October 2009, Universidad Politecnica de Valencia, Spain Alberto DOMINGO and Carlos LAZARO (eds.) Benefits of using haptic devices in textile architecture Javier SANCHEZ *, Joan SAVALL a
More informationIncreasing the Impedance Range of a Haptic Display by Adding Electrical Damping
Increasing the Impedance Range of a Haptic Display by Adding Electrical Damping Joshua S. Mehling * J. Edward Colgate Michael A. Peshkin (*)NASA Johnson Space Center, USA ( )Department of Mechanical Engineering,
More informationDepartment of Robotics Ritsumeikan University
Department of Robotics Ritsumeikan University Shinichi Hirai Dept. Robotics Ritsumeikan Univ. Hanoi Institute of Technology Hanoi, Vietnam, Dec. 20, 2008 http://www.ritsumei.ac.jp/se/rm/robo/index-e.htm
More informationDevelopment of K-Touch TM Haptic API for Various Datasets
Development of K-Touch TM Haptic API for Various Datasets Beom-Chan Lee 1 Jong-Phil Kim 2 Jongeun Cha 3 Jeha Ryu 4 ABSTRACT This paper presents development of a new haptic API (Application Programming
More informationHAPTIC DEVICES FOR DESKTOP VIRTUAL PROTOTYPING APPLICATIONS
The 3rd International Conference on Computational Mechanics and Virtual Engineering COMEC 2009 29 30 OCTOBER 2009, Brasov, Romania HAPTIC DEVICES FOR DESKTOP VIRTUAL PROTOTYPING APPLICATIONS A. Fratu 1,
More informationAutonomous Stair Climbing Algorithm for a Small Four-Tracked Robot
Autonomous Stair Climbing Algorithm for a Small Four-Tracked Robot Quy-Hung Vu, Byeong-Sang Kim, Jae-Bok Song Korea University 1 Anam-dong, Seongbuk-gu, Seoul, Korea vuquyhungbk@yahoo.com, lovidia@korea.ac.kr,
More informationTeleoperation with Sensor/Actuator Asymmetry: Task Performance with Partial Force Feedback
Teleoperation with Sensor/Actuator Asymmetry: Task Performance with Partial Force Wagahta Semere, Masaya Kitagawa and Allison M. Okamura Department of Mechanical Engineering The Johns Hopkins University
More informationThe Effect of Haptic Degrees of Freedom on Task Performance in Virtual Surgical Environments
The Effect of Haptic Degrees of Freedom on Task Performance in Virtual Surgical Environments Jonas FORSSLUND a,1, Sonny CHAN a,1, Joshua SELESNICK b, Kenneth SALISBURY a,c, Rebeka G. SILVA d, and Nikolas
More information2. Introduction to Computer Haptics
2. Introduction to Computer Haptics Seungmoon Choi, Ph.D. Assistant Professor Dept. of Computer Science and Engineering POSTECH Outline Basics of Force-Feedback Haptic Interfaces Introduction to Computer
More informationA Study on the control Method of 3-Dimensional Space Application using KINECT System Jong-wook Kang, Dong-jun Seo, and Dong-seok Jung,
IJCSNS International Journal of Computer Science and Network Security, VOL.11 No.9, September 2011 55 A Study on the control Method of 3-Dimensional Space Application using KINECT System Jong-wook Kang,
More informationFPGA Based Time Domain Passivity Observer and Passivity Controller
9 IEEE/ASME International Conference on Advanced Intelligent Mechatronics Suntec Convention and Exhibition Center Singapore, July 14-17, 9 FPGA Based Time Domain Passivity Observer and Passivity Controller
More informationA Study of Optimal Spatial Partition Size and Field of View in Massively Multiplayer Online Game Server
A Study of Optimal Spatial Partition Size and Field of View in Massively Multiplayer Online Game Server Youngsik Kim * * Department of Game and Multimedia Engineering, Korea Polytechnic University, Republic
More informationMultirate Simulation for High Fidelity Haptic Interaction with Deformable Objects in Virtual Environments
Proceedings of the 2000 IEEE International Conference on Robotics & Automation San Francisco, CA April 2000 Multirate Simulation for High Fidelity Haptic Interaction with Deformable Objects in Virtual
More informationDevelopment of wearable haptic interfaces for impact detection on UAV wing structures
Development of wearable haptic interfaces for impact detection on UAV wing structures * Myung Jun Lee 1) Hwee Kwon Jung 2) and Gyuhae Park 3) 1), 2), 3) School of Mechanical Engineering,Chonnam National
More informationToward an Augmented Reality System for Violin Learning Support
Toward an Augmented Reality System for Violin Learning Support Hiroyuki Shiino, François de Sorbier, and Hideo Saito Graduate School of Science and Technology, Keio University, Yokohama, Japan {shiino,fdesorbi,saito}@hvrl.ics.keio.ac.jp
More informationCancer Detection by means of Mechanical Palpation
Cancer Detection by means of Mechanical Palpation Design Team Paige Burke, Robert Eley Spencer Heyl, Margaret McGuire, Alan Radcliffe Design Advisor Prof. Kai Tak Wan Sponsor Massachusetts General Hospital
More informationHUMAN Robot Cooperation Techniques in Surgery
HUMAN Robot Cooperation Techniques in Surgery Alícia Casals Institute for Bioengineering of Catalonia (IBEC), Universitat Politècnica de Catalunya (UPC), Barcelona, Spain alicia.casals@upc.edu Keywords:
More informationUniversità di Roma La Sapienza. Medical Robotics. A Teleoperation System for Research in MIRS. Marilena Vendittelli
Università di Roma La Sapienza Medical Robotics A Teleoperation System for Research in MIRS Marilena Vendittelli the DLR teleoperation system slave three versatile robots MIRO light-weight: weight < 10
More information