My project is based on How museum installations could be combined with gesture technologies to make them more interactive.

Transcription

1 Project Summary My project is based on How museum installations could be combined with gesture technologies to make them more interactive. Research Topics Interactive gesture technology. How it has developed. User Experience of a Museum Environment. Technologies currently used in museums. Results Which Gesture technologies suit the museum environment; How to use them. Display to use; sound, visual, projection, screen, how can it be interactive. HCI of and the opinions of virtual reality being introduced. Make a working modern installation using a gesture technology.

2 Project Environment Museum; Generally Quiet. Different types of Museums. Experience Revolves around Learning. Items tend to be fragile. Audience constantly changing. Displays types vary. Interaction is limited. Giving audince independence. Gesture Communication & Grammar.

3 Methodology Methodology Organise Interviews. Fly-On-The-Wall, People watching. Design Thinking workshops. Research papers, videos, articles, web pages. Prototyping. (Paper -> High Fidelity) Software Testing. Visiting museums and installations. Test out; Leap Motion, Xbox Kinect. Upcoming tech; WiSee and the AllSee.

4 Literature Review Takes away the need for traditional interfaces; keyboards, sliders, buttons etc. Using middleware allows for direct, natural non-invasive interaction with an artefact. (Hantrakul,Kaczmarek. 2014) The user experience ranges from age, how much people want to interact, why they are in the museum, to different levels of education. You don t want to distract or bore. (Petrelli, Ciolfi, Dijk, Hornecker, Not, Schmidt. 2013) It should provide a personalised experience where the user is surrounded by information. This can be narrated in various ways; gamification, storytelling, visual, audio, animations. (Pietroni, Adami. 2014) Participation is key for learning. The users must engage with the information given to them. (Fosh, Benford, Reeves, Koleva.2014) The opportunity to develop a tool for staff is there to help them communicate ideas. (Petrelli, Ciolfi, Dijk, Hornecker, Not, Schmidt. 2013) A 3D reconstruction of an artefact or space isn t enough, Can illuminate what is illegible, but you still have to learn how to properly communicate the concept to the user. (Pietroni, Adami. 2014) Currently most experiences are for single users. People aren t given the opportunity to interact physically with the installation; audio in headphones, small screens. (Petrelli, Ciolfi, Dijk, Hornecker, Not, Schmidt. 2013)

5 Literature Review Users are excited to work with gesture technologies. It has been reported to increase attention independence and motivation. Brings a task to life. (Hantrakul,Kaczmarek. 2014) Gesture Technology is becoming portable. Mobile Phones, Laptops and other devices have built in sensors to allow for this type of quicker Human to computer interaction. (Pu, Gupta, Gollakota, Patel. 2014) Gesture technology makes sense in any environment. It reduces the need to have a lot of environmental sensors and wearable technology which can be disruptive, an inconvenience and hard to learn in a short period of time. (Hantrakul,Kaczmarek. 2014) Technology is progressing, not-line-of-sight Wi-Fi signals are now being developed to monitor and track gesture movements, using the Doppler Effect, within the Wi-Fi area with multiple users at the one time. (Pu, Gupta, Gollakota, Patel. 2014) The leap motion tracks each hand and fingers independently. It has a wide 150 field of view, allowing users to interact with their computer via familiar hand gestures like pinching or swiping. (Hantrakul,Kaczmarek. 2014)

6 Work To Date Visited The Hunt Museum. Installed and tested Kinetic software on Windows 8 and Windows 7 platforms. Researched and Purchased a Leap Motion sensor. Looked into different display & interaction methods; 3D representations (Agisoft Photoscan, Unity 3D), Projection on glass, gamification etc. Literature Review

7

8

9 Project Plan Continue to read research papers. Understand the user experience. Understand the environment. See if the proposed technology is feasible. Conduct user interviews. Visit different installations. Decide on the final product. Decide on the display type.

10 Project Plan Semester 1 First Semester Week: Dec + Research; Papers User Research Display Research Interviews SoHware tesing Prototyping with Gesture Tech Visit Gallaries Decide on Finished Topic Semester 2 Second Semester Week: Protype Development Tes@ng Interviews Debugging Write- Up Finished Product

11 References Eva Pietroni and Andrea Adami Interacting with Virtual Reconstructions in Museums: The Etruscanning Project. J. Comput. Cult. Herit. 7, 2, Article 9 (June 2014), 29 pages. Daniela Petrelli, Luigina Ciolfi, Dick van Dijk, Eva Hornecker, Elena Not, and Albrecht Schmidt Integrating material and digital: a new way for cultural heritage. interactions 20, 4 (July 2013), Lesley Fosh, Steve Benford, Stuart Reeves, and Boriana Koleva Gifting personal interpretations in galleries. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '14). ACM, New York, NY, USA, DOI= / Peter Tolmie, Steve Benford, Chris Greenhalgh, Tom Rodden, and Stuart Reeves Supporting group interactions in museum visiting. In Proceedings of the 17th ACM conference on Computer supported cooperative work & social computing (CSCW '14). NY, USA, Hantrakul, Kaczmarek, Implementations of the Leap Motion device in sound synthesis and interactive live performance. [Online]. MOCO '14, Jun 16-17, Paris, France, Available at: [Accessed 08 October 2014]. Pu, Gupta, Gollakota, Patel Whole-Home Gesture Recognition Using Wireless Signals. [Online]. Pages Available at: [Accessed 12 October 2014].