VR Headset for Endoscopy and Microsurgery

Transcription

1 VR Headset for Endoscopy and Microsurgery Client: Dr. Azam Ahmed Advisor: Mr. Willis Tompkins, Dr. John Puccinelli Team Members: Tom Geissler Team Co-Leader Sam Team Co-Leader Sam Simon Communicator Sam Schini BSAC Jake Cohn BPAG Josh Niesen BWIG Reporting Period: October 5th through October 11th, 2018 Problem Statement: Endoscopic surgeries have become increasingly prevalent in the operating room along with the visualization techniques used to perform them. Traditionally, large monitors have been used to display the images from the surgical tools, however, these are bulky and don t provide as immersive of an experience as other methods do. This problem has been partially addressed by using virtual reality headsets. One major limitation of these however, is that they do not allow the surgeon to see anything outside of the operative view. This is a problem as the surgeon will have to remove the headset everytime he or she has to change instruments, or perform macroscopically. The goal of this project is to design a VR headset that would allow the surgeon to transition from the operative view to normal view without the use of the surgeon s hands. Summary of Team Role Accomplishments: - Team: Completed Design Matrix and prepared a preliminary presentation. - Leaders: Delegated tasks for preliminary report. Touched base with sophomores to ensure they understand the current stage in the design process. Additionally acquired and contacted resources to help us with our project - Communicator: Scheduled a meeting with Professor Ponto to meet at the Discovery building to discuss his experience with VR and his suggestions for the project. Also, currently establishing a meeting with Dr. Ahmed to discuss the results of our preliminary presentation and get approval to move forward with the HTC Vive. - BWIG: The project page was updated with team s presentation in both the google slides format and the pdf format. - BPAG: Again, been given an open ended budget by the client. Looked into prices of possible products and outlining a tentative budget for the project. Planning to talk with the client to see which price route he prefers. I am attending the BPAG Meeting this upcoming Friday. - BSAC: Prepared to attend and contribute opinion regarding O-chem lab at this week s BSAC meetings

2 Design Accomplishments: From our design matrix, we crafted a preliminary presentation outlining our designs to our peers and completed a more in depth preliminary report. After completing this work, we decided to proceed with the HTC Vive option because of its immersiveness, mechanical simplicity, and ease of use. Before purchasing the headset, we will work on it in the MakerSpace and learn more about the different feed switching mechanisms from our contact, Taylor Waddell, an expert in VR who works there. We will be confirming the design with our client within the week. We have tried to set this meeting up, but Dr. Ahmed has been very busy with his job. We hope to get feedback on our report from last week that supports our decision to move forward with the Vive. Activities: Date Name Task Time (hours) Weekly Total Semester Total 10/5/2018 Team Preliminary Design Presentation /7/2018 Team Finishing the Preliminary Report and Labarchives Submission (Tom: Intro, Shini: Preliminary Designs, : Matrix and Future Work, Jake: Intro and Designs, Josh: Background, Simon: Background and Formatting) 10/10/2018 Team Meeting with Professor Ponto and Makerspace Resource /7/2018 Sam Schini Edited Personal LabArchives Folder /7/2018 Sam Simon Additions and Edits to My Labarchives Folder (Design Ideas, Green Card, Video Assignments) /8/2018 Sam 10/10/2018 Sam 10/8/2018 Sam Worked on Design Section of prelim report Downloaded Unity and tinkered with it Updated LabArchives /8/2018 Josh Worked on background section for the preliminary report due on Wednesday /11/2018 Josh Worked on progress report updates and

3 updating website 10/8/18 Tom Lab archives reorganizing and updating /8/18 Jake Lab archives formatting Statement of Team Goals: Now that we have decided upon the HTC Vive, we intend to meet with the client to get his approval and move forward with purchasing. When the headset is on its way to the ECB, our group will return to the research phase to build off of some of the keywords and design software that came up during our discussion with Professor Kevin Ponto. As opposed to connecting the endoscopic output directly to the monitor, he suggested using a webcam to stream an image of the monitor to a website, which we could then link to the headset for viewing. Our lack of familiarity with this new technology as well as with the design platforms Unity, ffmpng, and CVstream will require our attention. We expect each member to feel comfortable navigating these softwares by our next advisor meeting. Individual Goals: - Sam Simon: As a leader, I d like to be more on top of course deadlines for assignments. It seems like there has been a lot of confusion in our group as to when assignments are due and as a junior that responsibility falls harder on me. Tom and my meeting with Kevin Ponto revealed a plethora of steps that our group will need to go through in order to achieve our final result. I will spend the next week becoming familiar with unity, ffmpng, coaxial analog output, and how we may use a webcam to avoid having to use an analog-to-digital converter. - Sam Schini: Next week, I will proceed with research on the HTC Vive regarding how we could modify the software to make a hands-free perspective transition for our client. Additionally, we will evaluate the HTC Vive again in person at the Makerspace. - Sam : Next week I would like to run the software that I ve been developing on a VR Headset in the Makerspace. I ve currently been tinkering around in Unity, but I would like to see how it translates over to the physical headset. - Tom Geissler: Now that we have decided which design we have elected, once we get the approval from Dr. Ahmed, I will start figuring out what components we need to order and continue research on how to accomplish the goals we have set forth for the design. This includes what programming language/platform, as well as talking with experts at the makerspace. - Jake Cohn: Next week, we will hopefully find a time to meet with our client to get the final go-ahead to start with our elected preliminary design. I want to continue to look at possible weight balancing solutions for the Vive and also gauge the magnitude of the problem in Dr. Ahmed s eyes. - Josh Niesen: We plan to meet with our client, Dr. Ahmed, next week to get the final go ahead on the design. When this is complete, I will begin working with the team to begin determining the coding steps that need to take place to devise a group-oriented plan. On Wednesday next week I also plan to go to the Makerspace to speak with our contact Taylor about the HTC Vive headset

4 and the steps we need to take for our code to work. While at the Makerspace I also plan to try on the Dell Visor and begin feeling and recording the ergonomic feeling in more detail. Last, I will contact Ethan York about the uploads issues I have been having with the uploads section of the website. Difficulties: This week we did not encounter many difficulties. One thing we have been trying to do for a while is meet again with our client to discuss our design options and the choice we think is best to move forward with. Now that the Google Daydream is out of the picture, that will not present any more difficulties. The same can be said for the powered mechanical approach to the Dell Visor as long as our client agrees with our product selection. Project Schedule/Timeline: Task September October November December Project R & D Current Products X X X Scope Based Surgery X X X X Virtual Reality X X X X Mechanical Solutions X X X Materials X Cost Estimation Prototyping Documentation Progress Reports X X X X Preliminary Presentation X X X Preliminary Deliverables X X Final Poster

5 Final Deliverables Meetings Team X X X X X Client X Advisor X X X X X Website Update X X X X X Filled boxes = Projected timeline X = Task was worked on or completed Expenses: We have not incurred any expenses yet.