Neonatal Intubation Simulation with Virtual Reality and Haptic Feedback

Transcription

1 Neonatal Intubation Simulation with Virtual Reality and Haptic Feedback Advisor: Professor Beth Meyerand Clients: Dr. Ryan McAdams Dr. Brandon Tomlin

2 Team Members Team Leader- Carter Griest Communicator- Isaac Hale BSAC- Sara Martin BWIG- Joey Campagna BPAG- Jessi Kelley From Left To Right: Isaac Hale, Joey Campagna, Carter Griest, Sara Martin, Jessi Kelley

3 Overview Neonatal Intubation - Global Need Intubation Procedural Background Current Training Methods PDS Summary Development platforms 3DSlicer Blender Unity Existing technology Potential Problems Future Work

4 Neonatal Intubation - Global Need 7% of term-newborns undergo respiratory distress1 Increases substantially in premature infants In 2005, nearly 10% of births were premature2 Highest rates in North America and third world countries Estimated that prevalence increased since 2005 Anywhere from 30-70% of intubation attempts are successful3-5

5 Intubation Procedural Background Intubation may be necessary if the neonate is under respiratory distress Procedural steps: Insert endotracheal blade Scoop and lift tongue to visualize vocal cords Insert endotracheal tube through vocal cords Once successful, secure tube Procedure must be done gently, quickly and precisely6 Tongue Vocal cords Trachea Larynx

6 Current Training Methods Video instruction: While useful, without practicing an intubation first-hand, one cannot hope to perform the procedure correctly under stress7 Neonatal Mannequins: The primary neonatal intubation training method is via the use of expensive mannequins Mannequins fail to accurately mimic neonate anatomy and other physical properties Unnatural texture and movements Easily identifiable vocal cords8

7 PDS Summary Function: Client desires virtual simulation of the neonatal intubation procedure Includes haptic feedback Requires environment which accurately emulates procedure Performance Requirements: Must be accurate to 0.02mm to compete with current haptic feedback systems Virtual environment must be detailed and load in real time without buffering Ergonomics: Should feel similar to real procedure in regards to tools used and actions performed Cost: Should cost under $6000

8 Development Platforms: 3DSlicer 3DSlicer is a free, open source image processing and visualization system9 Reconstruct CT scans of a neonate to create an.stl file Once in 3DSlicer, segment regions of interest (ROIs) Refine ROIs to create more precise model Larynx Trachea Larynx Trachea

9 Development Platforms: Blender Meshing Turns 3D images into 3D objects Rigging Create bones/joints for manipulating motion of objects Texturing Giving the 3D objects realistic appearance

10 Development Platforms: Unity The world's leading real-time gaming/development engine10 Used to create half of the world's games10 We will use it to combine 3D models made in Blender with functionality of haptic devices

11 Existing Technology: Haptic Devices Produced by 3DSystems, the Phantom Touch provides force-feedback to physically emulate virtual objects11 Used to represent surgical implement position in real time, by tracking translational and rotational movement Dual haptic devices used to emulate multiple surgical implements

12 Potential Problems Required processing power limits how detailed the environment can be Software/hardware compatibility Accurate emulation of tissue-like properties in virtual reality Somatosensory properties Destructive VR Unnatural movements of haptic device

13 Conclusion and Future Work Create 3D models for tools used during the procedure Improve the VR environment to resemble a neonatal operating room Integrate realistic models of newborn mouth and throat into Unity Incorporate VR headset into design Reach out to existing companies such as Arch Virtual

14 Acknowledgements Many thanks to: Our clients, Dr. Ryan McAdams and Dr. Brandon Tomlin, for working with us to lay out design constraints and requirements Our advisor, Prof. Beth Meyerand, for guiding us throughout the preliminary design process The BME Department, for providing us with the opportunity to work on this project

15 References Reuter, S., Moser, C. and Baack, M. (2014). Respiratory Distress in the Newborn. Pediatrics in Review, 35(10), pp Beck, S., Wojdyla, D., Say, L., Pilar Bertran, A., Meraldi, M., Harris Requejo, J., Rubens, C., Menon, R. and Van Look, P. (2010). The worldwide incidence of preterm birth: a systematic review of maternal mortality and morbidity. Bulletin of the World Health Organization, 88(1), pp Kumar, A. and Vishnu Bhat, B. (1996). Epidemiology of respiratory distress of newborns. The Indian Journal of Pediatrics, 63(1), pp Haubner, L., Barry, J., Johnston, L., Soghier, L., Tatum, P., Kessler, D., Downes, K. and Auerbach, M. (2013). Neonatal intubation performance: Room for improvement in tertiary neonatal intensive care units. Resuscitation, 84(10), pp O'Donnell, C. (2006). Endotracheal Intubation Attempts During Neonatal Resuscitation: Success Rates, Duration, and Adverse Effects. PEDIATRICS, 117(1), pp.e16-e21. OPENPediatrics (2016). "Neonatal Tracheal Intubation" by Lindsay Johnston for OPENPediatrics. [video] Available at: [Accessed 31 Jan. 2018]. O'Shea, J., Thio, M., Kamlin, C., McGrory, L., Wong, C., John, J., Roberts, C., Kuschel, C. and Davis, P. (2018). Videolaryngoscopy to Teach Neonatal Intubation: A Randomized Trial. [online] Available at: [Accessed 10 Feb. 2018]. Kresge, N. (2018). Improving neonatal intubation training to boost clinical competency Children's National. [online] Innovation District. Available at: ncy/ [Accessed 10 Feb. 2018]. 3D Slicer. [Online]. Available: [Accessed: 30-Sep-2018]. Products, Unity. [Online]. Available: [Accessed: 30-Sep-2018]. OpenHaptics, 3D Systems. [Online]. Available: [Accessed: 30-Sep-2018].

16 References Slide 3 Top Figure: Amazon.ca. (2018). Amazon. [online] Available at: [Accessed 21 Feb. 2018]. Slide 3 Bottom Figure: J. Whitelaw, Clinical Guidelines, The Royal Children's Hospital Melbourne. [Online]. Available: on_the_butterfly_ward/. [Accessed: 30-Sep-2018]. Slide 5 Top Figure: OPENPediatrics (2016). "Neonatal Tracheal Intubation" by Lindsay Johnston for OPENPediatrics. [video] Available at: [Accessed 31 Jan. 2018]. Slide 5 Bottom Figure: Pinterest. (2018). Intubation. [online] Available at: [Accessed 2 Mar. 2018]. Slide 6 Figure: Pinterest. (2018). School & Educational Supplies. [online] Available at: [Accessed 2 Mar. 2018]. Slide 7 Figure: 3D Systems. (2018). OpenHaptics 3D Systems. [online] Available at: [Accessed 30 Sep. 2018]. Slide 8 Bottom Right Figure: Trachea, Assignment Point, 07-Aug [Online]. Available: [Accessed: 30-Sep-2018]. Slide 9 Center Figure: Rig, M. (2018). Master Bone to Move Entire Rig. [online] Blender Stack Exchange. Available at: [Accessed 30 Sep. 2018]. Slide 11 Upper Figure: 3D Systems. (2018). Touch 3D Systems. [online] Available at: [Accessed 26 Feb. 2018]. Slide 11 Lower Figure: 3D Systems. (2018). OpenHaptics 3D Systems. [online] Available at: [Accessed 30 Sep. 2018]. Slide 13 Left Figure: Novamed-usa.com. (2018). NOVALITE Laryngoscopes NOVAMED USA. [online] Available at: [Accessed 28 Feb. 2018]. Slide 13 Middle Figure: Imgflip.com. (2018). surprised baby Blank Template - Imgflip. [online] Available at: [Accessed 28 Feb. 2018]. Slide 13 Right Figure: Comstocksmag.com. (2018). Opportunity of a Lifetime Comstock's magazine. [online] Available at: [Accessed 28 Feb. 2018].

17 Questions?