Proceeding of the IEEE International Conference on Automation and Logistics Zhengzhou, China, August 2012 Internet-based Robotic Catheter Surgery System System Design and Performance Evaluation Nan Xiao 1,Shuxiang Guo 1,2, Baofeng Gao 1, Xu Ma 1 1. Faculty of Engineering, Kagawa University 2217-20, Hayashi-cho, Takamatsu, Kagawa, Japan 2. Tianjin University of Technology No. 263 Hongqi Nalu Road, Nankai District, Tianjin, China Email: {xiao, guo, gao}@eng.kagawa-u.ac.jp Takashi Tamiya 3 and Masahiko Kawanishi 3 3. Faculty of Medicine,Kagawa University, Japan 1750-1 Ikenobe, Miki-cho Kida-gun, Kagawa Email: {tamiya,mk}@med.kagawa-u.ac.jp Abstract Endovascular intervention is expected to become increasingly popular in medical practice, both for diagnosis and for surgery. Accordingly, researches of robotic systems for endovascular surgery assistant have been carried out widely. Robotic system takes advantages of higher precision, can be controlled remotely etc. In this paper a novel robotic catheter manipulation system is presented. The developed system consists of two parts, one is the surgeon console and the other one is the catheter manipulator. The surgeon s console is designed to simulate the surgeon s operating procedure, and the catheter manipulator takes the same movement motion with the controller. In the paper, the mechanism of the system is introduced in detail. Controllers are designed for both two parts. A internet based communication between the controller and the catheter manipulator has been build. A server client structure is employed to realize the communication. Two-way remote control experiments are carried out between China and Japan. The dynamic performance of the system is discussed in the paper. I. INTRODUCTION Endovascular intervention is expected to become increasingly popular in medical practice, both for diagnosis and for surgery. However, as a new technology, it requires a lot of skills in operation. In addition, the operation is carried out inside the body, it is impossible to monitor it directly. Much more skills and experience are required for doctors to insert the catheter. In the operation, for example the catheter is inserted through patients blood vessel. Any mistakes would hurt patients and cause damages. An experienced neurosurgery doctor can achieve a precision about 2mm in the surgery. However, the contact force between the blood vessel and the catheter cannot be sensed. During the operation an X-ray camera is used, and long time operation will cause damage to the patient. Although doctors wear protecting suits, it is very difficult to protect doctors hands and faces from the radiation of the X-ray. There are dangers of mingling or breaking the blood vessels. To overcome these challenges, we need better technique and mechanisms to help and train doctors. Robotic system takes many advantages of higher precision, can be controlled remotely etc. However, compared with hands of human being, none of a robotic system could satisfy all of the requirements of an endovascular intervention. Not only because the machine is not as flexible as hands of human being but also lacks of touch. In any case, robotic catheter manipulation system could provide assistant to surgeons in the operation, but it has a long way to go to replace human being. A lot of products and researches are reported in this area. One of the popular products is a robotic catheter placement system called Sensei Robotic Catheter System supplied by Hansen Medical[1-3]. The Sensei system provides the physician with more stability and more force in catheter placement with the Artisan sheath compared to manual techniques, allows for more precise manipulation with less radiation exposure to the doctor, and is commensurate with higher procedural complications to the patient. Because of the sheath s multiple degrees of freedom, force detection at the distal tip is very hard. Catheter Robotics Inc. has developed a remote catheter system called Amigo [4]. This system has a robotic sheath to steer catheter which is controlled at a nearby work station, in a manner similar to the Sensei system. The first human trail of this system was in April 2010 in Leicester UK, where it was used to ablate atrial flutter. Magnatecs Inc. produced their Catheter Guidance Control and Imaging (CGCI) system [5]. This system has 4 large magnets placed around the table, with customised catheters containing magnets in the tip. The catheter is moved by the magnetic fields and is controlled at a nearby work station The Stereotaxis Inc. developed a magnetic navigation system: the Stereotaxis Niobe [6]. The system facilitates precise vector based navigation of magnetically-enabled guide wires for percutaneous coronary intervention (PCI) by using two permanent magnets located on opposite sides of the patient table to produce a controllable magnetic field. Yogesh Thakur et al. [7] developed a kind of remote cahter navigation system. This system allowed the user to operate a catheter manipular with a real catheter. So surgeon s operative skills could be applied in this case. The disadvantage of this system is lack of mechanical feedback. T. Fukuda et al.[8] at Nagoya University proposed a custom linear stepping mechanism, 978-1-4673-2237-9/12/$31.00 2012 IEEE 645
which simulates the surgeon s hand movement. Regarding these products and researches, most concerns are still the safety. Force information of the catheter during the operation is very important to ensure the safety of the surgery. However, measurement of the force on catheters is very hard to solve in these systems. A potential problem with a remote catheter control system is the lack of mechanical feedback that one would receive from manually controlling a catheter [1, 10-15]. In the past, we developed a robotic catheter manipulating system(rcms)[16], which takes advantages of good operability and precision. The system consists of two parts, one is the console for surgeons and the other parts is the catheter manipulator. In this paper, the controller of the system is introduced in detail and five action motion cases are discussed. An internet based remote control method is developed for the developed robotic catheter manipulating system. The paper is organized as following. In the next section, the mechanical system of the remote catheter manipulator will be described. The third section presents the surgeon s console. The fourth section shows the design of controller both master and slave side. In section V experiments are given. The last part is the conclusions and future work. II. REMOTE CATHETER MANIPULATOR The system is designed with the structure of master and slave, as shown in Fig. 1. The surgeon s console is the master side and the catheter manipulator is the slave side of the system. Moving mode of the catheter manipulator is designed as well as the controller. The movable parts of controller and manipulator keep the same displacement, speed and rotation angle, therefore, the surgeon could operate the system smoothly and easily. Each of controller side and catheter manipulator side employs a DSP as their control unit. A internet based communication is build between the controller and the catheter manipulator, the sketch map of the communication is shown in Fig. 2. The controller side sends axial displacement and rotation angle of the handle to the catheter manipulator. At the same time the catheter manipulator sends force information to the controller side. Serial communication is adopted between PC and control unit of the mechanism. The baud rate of the serial is set to 19200. Fig. 3 shows the mechanism of the catheter manipulator which is the slave part of the whole system. This part is placed at the patient side. The catheter is inserted by using this mechanism. This part contains two DOFs, one is axial movement alone the frame, and the other one is radial movement. Two graspers are placed at this part. The surgeon can drive the catheter to move along both axial and radial when the catheter is clamped by grasper 1. The catheter keeps its position and the catheter driven part can move freely when the catheter is clamped by grasper 2. Inserting motion of the Fig. 1: Robotic Catheter Manipulating System Fig. 2: Schematic Diagram of the System catheter is as shown in Fig. 4. To realize axial movement, all catheter driven part are placed and fixed on a movement stage(the green plate under motor 1 in Fig. 3). The movement stage is driven by a screw which is driven by a stepping motor (motor 2 in Fig.3 ). On the other hand, a DC motor (motor 1 in Fig. 3 ) is employed to realize the radial movement of the catheter. The DC motor is coupled to the catheter frame by two pulleys which are coupled by a belt with teeth. The catheter is driven to rotating by motor 1 when the catheter is fix on the frame by grasper 1. Fig. 3: Catheter Manipulator 646
Fig. 4: Insertion Process Fig. 5: Surgeon s Console TABLE I: Evaluation of the precision III. SURGEONS CONSOLE The surgeon s console is the master side of the whole system as shown in Fig. 5. Surgeons carry out operations by using the console. The switch which is placed on the left handle is used to control these two graspers at the slave side; only one switch is enough because the catheter is clamped by one grasper at the same time. Operators s action is detected by using the right handle. The movement part of catheter manipulator keeps the same motion with the right handle of the controller. The right handle can measure two actions of the surgeon s hand, one is axial movement and the other one is radial movement. The handle is sustained by a bearing, and is linked to a loadcell; a pulley is fixed on the handle. An dc motor (Motor 1) with encoder is applied to generate torque feedback. A pulley which is couple to the upper one is fixed to the axle of the motor. All these parts are placed on a movement stage driven by a stepping motor (Motor 2). Measurement of the axial movement is realized as following. A pulling/pushing force is measured by the loadcell when the operator pull or push the handle, according to this pulling force, the movement output displacement to keep the handle following the surgeon s hand. Force feedback can be displaced by adjusting moving speed of the movement stage. The displacement and speed of the movement stage are sent to the catheter manipulator side, then the catheter manipulator keep synchronization with the controller.when the operator rotates the handle, the rotation angle is measured by an encoder installed on the dc motor. The dc motor is working at the current control mode to generate the damping to the surgeon. The damping is calculated by the torque information from the catheter manipulator side. The structure of the controller is as well as the catheter manipulator; it means that the catheter manipulator could keep the same motion with the operator s hand. The operation will become visualized and easy to begin. On the other hand, this structure can realize the mechanical feedback to the surgeon. The precision and accuracy of the system was evaluated by [16], the result was listed as Following. A. Master Part Master precision accuracy axial (unit:mm) 0.35 0.025 radial (unit:deg) 3.1 2.1 Slave axial (unit:mm) 0.23 0.04 radial (unit:deg) 2.2 3.0 IV. CONTROL The surgeon s console is the master part of the whole system. Surgeons input their control command with the master machine. The operation of endovascular intervention needs very sensitive actions, therefore, to make the operation more submissive is very important. On the other hand, the master system can be seen as a haptic interface. To implement haptic interaction with remote slave system(or virtual environment)motion and force of the master should be controlled between user and the device. In the axial direction, the handle follows the surgeon s hand. Fig. 6 shows the control control scheme of the master side in axial, an admittance controller [17]is employed. The pulling and pushing force measured by the loadcell is defined as F h, feedback from slave side(or from a virtual environment) is define as F r. The speed and displacement (ẋ m and x m ) of the handle could be measured by the encoder coupling with stepping motor. Fig. 6: Control System of the Master (Axial) The object dynamics in Fig. 6 is a dynamic model to describe the performance of the target system. For example, the master side is to simulate a real catheter which is being used in slave side then we can build a catheter dynamic model 647
to be the object dynamic. F r is the force measured by slave system or from a virtual environment. In this paper, we define the model as real catheter which is used in slave side, as defined by eq. 1. In the paper a PD controller is employed as the motion controller and given by eq. 2. M c ẍ c + B c ẋ c = F h (1) In the paper a PD controller is employed as the motion controller and given by eq. 2. τ m = K d (ẋ m ẋ r ) + K p (x m x r ) (2) Sometimes, the loadcell is too sensitive to keep the stability of the handle,so these two threshold values are set to improve the stability of this system. On the other hand, these two threshold values could adjust the operating sensitivity. B. Slave Part ẋ m = 0, if (ẋ m < ẋ 0, F h (t) < F 0 ) The slave part is the catheter manipulator; the movement of the slave part should keep same displacement, angles and speed with the master part. As an execution system, precision, accuracy and response speed are very important. A selfturning fuzzy PID controller was designed for the movement stage in axial direction[17]. The structure of the controller is shown in Fig. 7. d r and v r are the reference displacement and speed which received from the master side. A regular PD controller is designed for the radial movement in the slave side. The reference rotation angle is from the master side. And the performance of the radial rotation has been discussed in [16, 18]. Fig. 7: Controller of the Axial Movement of Slave Side V. EXPERIMENTS A. Performance Evaluation of the Surgeon s Console Experiments are carried out to evaluate the performance of the whole system. We have analyzed the precision and accuracy of the system in [16]. In this paper, the dynamic performance will be discussed. In this experiment, the surgeon console and the catheter manipulator were placed in a same room, but a local net work communication was used, and the lag is below 10ms. Five kinds of action of axial movement are assumed during the operation, uniform motion (high and low speed), fast start /stop, suddenly stop and slow forward/fast back. Each surgical procedure consists of these basic actions. A 50cm-length silicone tube was employed, we drove a catheter go through the silicone tube from a start point to an end point under these five cases. The displacement and speed of the movement stage were kept as shown in Fig. 8, the red line is the displacement of the movement stage in the master side, the black point is the displacement of the slave side, the blue dash line is the pull/push force carried on the handle in master side. Fig. 9 shows the velocity trajectory, the red solid line is the velocity of the movement stage of the master side, the black point is the data of slave side. Fig. 8 shows five cases of the local control experiments. Fig. 8 (a) shows the high speed uniform motion movement and (b) shows the low speed uniform motion movement. Compare with the fast movement, the slow one shows the small errors. It can be found that the large error appears when the direction is alternated. Fig. 8 (c) shows the case of fast start/stop, rapid alternating operation was carried out in this case. Fig. 8 (d) shows the suddenly stop case, this case may happens when dangers happen. Fig. 8 (e) shows a slow forward and fast backward case, this is a very frequent action in our system. The insertion action always needs very careful attentions, therefore, the forward action becomes more slow then the backward. At the same time, because of the structure of the system, it requires several reciprocating to insert the catheter to the target, fast backward movements are away demanded. Therefore, we did the experiment for the special process. From Fig. 8(d) it can be find the catheter manipulator could follow the master side very well. These five cases could be distinguished by the pull/push force changing rate. Another experiment was carried out to show the relationship between the force change rate and the average error of the displacement between the master and slave. We set the master input a force, the amplitude of which follows sinusoid curve. B. Tele-operating The tele-operating experiments were carried out between Takamatsu, Japan and Beijing, China and the lag was around 300ms. There two case contained in this part. Fig. 10 shows the configuration first case, the surgeon console (master) was placed in Takamatsu, Japan, and the catheter manipulator(slave) was placed in Beijing, China. The server of the communication was build in the master side (Japan). The user could see the position of the catheter from the screen. In this experiment, our target was to insert the catheter to a goal position. The displacement of the controller and the catheter manipulator are kept. Fig. 11 shows the position tracking trajectory of the axial direction. Fig. 12 shows the second case of the tele-operating experiment. The catheter manipulator of the system (slave) is placed 648
(a) Uniform Movement (Fast) (a) Uniform Movement (Fast) (b) Uniform Movement (Slow) (b) Uniform Movement (Slow) (c) Fast Start/Stop (c) Fast Start/Stop (d) Suddenly Stop (d) Suddenly Stop (e) Slow Forward/Fast Backward Fig. 8: Axial Displacement of both Side in Takamatsu, Japan, and the controller(master) is placed in Beijing,China. In this experiment, a human body model called EVE simulator was used. The target was inserted the catheter from the leg to the brain with the developed system. As same as the last experiment, the server was built in Takamatsu, Japan, and the lag was about 300ms. Fig. 13 shows the position tracking trajectory of the axial direction. VI. CONCLUSIONS We proposed a robotic catheter robotic manipulator. The system contains two parts, the surgeon s console and the (e) Slow Forward/Fast Backward Fig. 9: Axial Velocity of both Side catheter manipulator. These two parts have the same movement motion. With this kind of design, the operating procedure becomes visualized. The operating motion is similar to the actual motion of the surgeon s hand. At the same time, with this structure, mechanical feedback could be realized. A internet based communication system was built between the controller and the catheter manipulator. Both control data and image could be transmitted by the communication system. Controller were designed separately. The dynamic performance were evaluated by experiments. Five basic ac- 649
Fig. 13: Tracking trajectory of the axial direction R EFERENCES [1] Prapa Kanagaratnam, Michael Koa-Wing, Daniel T. Wallace, Alex S. Goldenberg, Nicholas S. Peters, D, Wyn Davies. Experience of robotic catheter ablation in humans using a novel remotely steerable catheter sheath, Journal of Interventional Cardiac Electrophysiology, Vol. 21, pp. 19-26, 2008. [2] Chun, J. K., Ernst, S., Matthews, S., Schmidt, B., Bansch, D., Boczor, S., et al, Remote-controlled catheter ablation of accessory pathways: results from the magnetic laboratory. European Heart Journal, Vol. 28, No. 2, pp. 190-195, 2007. [3] Carlo Pappone, Gabriele Vicedomini, Francesco Manguso, Filippo Gugliotta, Patrizio Mazzone, Simone Gulletta, Nicoleta Sora, Simone Sala, Alessandra Marzi, Giuseppe Augello, Laura Livolsi, Andreina Santagostino, Vincenzo Santinelli, Robotic Magnetic Navigation for Atrial Fibrillation Ablation, Journal of the American College of Cardiology, Vol. 47, pp. 1390-1400, 2006. [4] http://www.stargen.eu/products/niobe/. [5] http://catheterrobotics.com/crus-main.htm [6] http://www.magnetecs.com/ [7] Yogesh Thakui, Jeffrey S. Bax, David W. Holdsworth and Maria Drangova, Design and Performance Evaluation of a Remote Catheter Navigation System, IEEE Transactions on biomedical engineering, Vol.56, No. 7, pp. 1901-1908, 2009. [8] Arai F, Fuji R, Fukuda T., New catheter driving method using linear stepping mechanism for Intravascular neurosurgery[a]. Proceedings of the 2002 IEEE International Conference on Robotics and Automation, Vol. 3, pp. 2944-2949, 2002. [9] Willems S, Steven D, Servatius H, Hoffmann BA, Drewitz I, Mullerleile K, Aydin MA, Wegscheider K, Salukhe TV, Meinertz T, Rostock T,Persistence of Pulmonary Vein Isolation After Robotic RemoteNavigated Ablation for Atrial Fibrillation and its Relation to Clinical Outcome, Journal of Interventional Cardiac Electrophysiology, Vol. 21, pp. 1079-1084, 2010. [10] Walid Saliba, Vivek Y. Reddy, Oussama Wazni, Jennifer E. Cummings, et.al, Atrial Fibrillation Ablation Using a Robotic Catheter Remote Control System: Initial Human Experience and Long-Term Follow-Up Results, Journal of the American College of Cardiology, Vol. 51, pp. 2407-2411, 2008. [11] M. Tanimoto, F. Arai, T. Fukuda, and M. Negoro, Augmentation of Safety in Teleoperation System for Intravascular Neurosurgery, IEEE International Conference on Robotics and Automation, pp. 2890-2895, 1998. [12] Carsten Preusche, Tobias Ortmaier, Gerd Hirzinger, Teleoperation concepts in minimal invasive surgery. Control Engineering Practice, Vol. 10, pp. 1245-1250, 2002. [13] S. Ikeda, F. Arai, T. Fukuda, M. Negoro, K.Irie, and I. Takahashi, et. al., In Vitro Patient-Tailored Anatomaical Model of Cerebral Artery for Evaluating Medical Robots and Systems for Intravascular Neurosurgery, IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 1558-1563, 2005. [14] Fumihito Arai, Ryo Fujimura, Toshio Fukuda, and Makoto Negoro, New Catheter Driving Method Using Linear Stepping Mechanism for Intravascular Neurosurgery, Proceedings of the 2002 IEEE International Conference on Robotics and Automation, pp. 2944-2949, 2002. [15] Jan Peirs, Joeri Clijnen, Dominiek Reynaerts, Hendrik Van Brussel, Paul Herijgers, Brecht Corteville, et. al., A micro optical force sensor Fig. 10: Experimental System Fig. 11: Tracking trajectory of the axial direction tion were discussed. Two remote control experiment were carried out. Two-way remote control were realized between China and Japan. Experimental results indicated that the slave can follow the controller very well. In the future, communication algorithm will be developed to reduce the tracking error between controller and the catheter manipulator when using internet based remote control. And a danger avoid system based on the sensor installed on the catheter will be realized. Fig. 12: EVE Simulator 650
for force feedback during minimally invasive robotic surgery, Sensors and Actuators A : Physical, Vol.115, pp. 447-455, 2004. [16] Nan Xiao, Shuxiang Guo, Jian Guo, Xufeng, Xiao, Takashi Tamiya, Development of a Kind of Robotic Catheter Manipulation System, Proceedings of IEEE International Conference on Robotics and Biomimetics, pp. 32-37, 2011. [17] Marc Ueberle, Martin Buss, Control of Kinesthetic Haptic Interfaces, in Proc. IEEE/RSJ Int. Conf. Intell. Robots Syst. Workshop Touch Haptics, pp. 147-151, 2004. [18] Xu Ma, Shuxiang Guo, Nan Xiao, Jian Guo, Xufeng Xiao, Shunichi Yoshida, Development of a PID Controller for a Novel Robotic Catheter System, Proceedings of the 2011 IEEE/ICME International Conference on Complex Medical Engineering, pp. 64-68, Harbin, China, May 22-25, 2011. [19] Xiaonan. Wang, Max Meng, Perspective of Active Capsule Endoscope: Actuation and Localization, International Journal of Mechatronics and Automation, Vol.1, No.1, pp. 38-45, 2011. [20] Shahab Abdulla, Peng Wen, Robust Internal Model Control for Depth of Anaesthesia, International Journal of Mechatronics and Automation, Vol.1, No.1, pp. 1-8, 2011. [21] Y.C. Wu and J.S. Chen, Toward the Identification of EMG-Signal and Its Bio-Feedback Application, International Journal of Mechatronics and Automation, Vol.1, No.2, pp. 112-120, 2011. 651