AR-View: an Augmented Reality Device for Digital Reconstruction of Yuangmingyuan

Size: px

Start display at page:

Download "AR-View: an Augmented Reality Device for Digital Reconstruction of Yuangmingyuan"

Kathlyn Byrd
5 years ago
Views:

AR-View: an Augmented Reality Device for Digital Reconstruction of Yuangmingyuan Yetao Huang Yue Liu Yongtian Wang Beijing Institute of Technology Beijing Institute of Technology Beijing Institute of

Unfortunately, it was looted and burnt down by the Anglo-French forces in 1860 and suffered from continual damages later on.

1 AR-View: an Augmented Reality Device for Digital Reconstruction of Yuangmingyuan Yetao Huang Yue Liu Yongtian Wang Beijing Institute of Technology Beijing Institute of Technology Beijing Institute of Technology ABSTRACT Yuanmingyuan was a vast and magnificent royal garden built continuously by several emperors of the Qing Dynasty. Unfortunately, it was looted and burnt down by the Anglo-French forces in 1860 and suffered from continual damages later on. Because of its special significance in the Chinese history, the reconstruction of Yuanmingyuan has been argued for a long time and visitors could only imagine its fabled charms. With the help of Augmented Reality (AR) technology, we have digitally reconstructed Yuanmingyuan by designing and manufacturing a fixed-position device AR-View to provide a combined real and virtual image of Dashuifa (Great waterworks), a symbol of Yuanmingyuan. With the help of AR-view, the original exquisite architectures and fountains are superimposed upon the current ruins. The key technologies of mechanical tracking for registration and dual-channel eyepieces for stereo display are discussed. To solve the problems exposed during public trials, improvements of software and hardware for public use are also illustrated in this paper. Ergonomics and industrial design are involved to ameliorate the functions and appearance of the latest version of AR-View, making it more stable and convenient for public use. As the first application of Augmented Reality technology on a Chinese historical site, AR-View opens the door to the practical use of Augmented Reality in the area of digital reconstruction of historical sites in China. but interconnected gardens: Yuanmingyuan, Changchunyuan (Garden of Eternal Spring) and Qichunyuan (Garden of Blossoming Spring). Dashuifa, a group of fountains with a shrineshaped structure in the background as shown in Figure 1, which is located in the Palaces of Changchunyuan, is regarded as the symbol of the Yuanmingyuan. Because of its fabled charms and significance in Chinese recent history, Yuanmingyuan is renowned throughout the world. KEYWORDS: Case studies, interactivity and interaction, social media and AR/MR, education and training. INDEX TERMS: H.5.1 [Information Interfaces and Presentation]: Multimedia Information Systems Artificial, Augmented, and virtual realities; I.4.5 [Computing Methodologies]: Image Processing and Computer Vision Applications. 1 INTRODUCTION 1.1 History Yuanmingyuan was an imperial summer resort in recent China which was painstakingly built and repeatedly expanded under the personal supervision of five emperors of the Qing Dynasty since It was extolled as the Versailles of the East before it was looted and burnt down by Anglo-French forces in Yuanmingyuan is composed of three comparatively independent 6666@bit.edu.cn liuyue@bit.edu.cn wyt@bit.edu.cn IEEE International Symposium on Mixed and Augmented Reality 2009 Arts, Media and Humanities Proceedings October, Orlando, Florida, USA /09/$ IEEE Figure 1. Drypoint printing of Dashuifa around 1759, Photographs of Dashuifa from Duke University by Mr. Sidney D Gamble around Digital reconstruction Today, Yuanmingyuan is defined as a historic park, and an administrative office was set up for it by Chinese government. Many people claim that the royal garden should be restored, while many others insist that the garden be kept as ruins to respect the history. At last, only 10% architectures on the ground are allowed to be reconstructed according to the regulations from Beijing municipal government. Visitors from all over the world could only imagine the original beauty of this summer resort on the current debris. AR [1] is one of the most perspective technologies which could combine real and virtual world to show the combination of ancient and current view of the historic site [2]. Compared to the ordinary 3

instructions like static images, videos, sand table etc., AR can provide visitors with an intuitive and visual experience by digital reconstruction of the ruins.

are presented in this paper. 2 RELATED WORK AND DESIGN DECISION Much work has been carried on in the area of digital reconstruction by AR. The following is a very short overview of some related work.

Pompeii AR navigation system was similar, which allowed its users to walk around to see the virtual architecture overlaid on the real site. T.

2 instructions like static images, videos, sand table etc., AR can provide visitors with an intuitive and visual experience by digital reconstruction of the ruins. Under the support of fund from Beijing municipal government and Yuanmingyuan administrative office, in recent years we focus on the digital reconstruction of Dashuifa and our research achievements are presented in this paper. 2 RELATED WORK AND DESIGN DECISION Much work has been carried on in the area of digital reconstruction by AR. The following is a very short overview of some related work. Vassilios Vlahakis presented the ancient Greek Parthenon [3] AR navigation system working on a wearable computer with head mounted display (HMD) under the support of European Union. Pompeii AR navigation system was similar, which allowed its users to walk around to see the virtual architecture overlaid on the real site. T. Miyashita [4] presented AR museum guide system on mobile devices for public use. Claus Brenner described its work as Geoscope[5]. The proposed device was a revolving table which could be rotated in two directions and located in a fixed position. Users could see the AR view on the screen at the top of the device. Moreover, Trivisio has designed a product with the name of AR-Telescope from which a user could see the AR view through monocular telescope. Yuanmingyuan is a famous place of interest. Everyday thousands of tourists flocked to it. Since it is not suitable and safe to provide such a large number of inexperienced public users with mobile devices or wearable computers, a fixed-position telescope is much more practical. From an initial sketch to a final product, we design AR-View as a telescope with binoculars for stereo image of Dashuifa. Because the proposed device is intended to be used for public, it must be convenient and easy to be operated. 3 OUR WORK 3.1 System description As shown in Figure 2, AR-View mainly consists of optoelectronic imaging system, orientation tracking system and image processing system. The purpose of the imaging system is to capture and display the stereo image. Mechanical tracking is adopted for orientation tracking system, and all the rendering work is carried on the image processing system. Figure 2. Overview of the System, optoelectronic imaging system Both optoelectronic imaging system and orientation tracking system are installed on a revolving table, while imaging processing system is in a server cabinet. A coin box on the revolving table is used for commercial operation. 3.2 Tracking In order to superimpose the virtual objects on the right position of the real world in its user's view, registration in three dimensions (3D) is an important issue in an AR system. The environment of historical site like Yuanmingyuan is complex and forbidden from any change, which makes the outdoor tracking more difficult. However, AR-View is a fixed-position telescope, its position could be determined before the installation. As the orientations which are to be tracked are mechanical movements, welldeveloped mechanical tracking approach could be employed. When the telescope rotates, the angles of pitch and heading will change, while the angle of roll is unaltered. Therefore, only the pitch and heading angles are needed to be tracked. The photoelectric encoder is a kind of mechanical tracking device to record the angle of an axis attached. Two Koyo TRD NA2048- NW rotary encoders are installed on the heading and pitch axes to measure rotation angle. After the measurement of heading and pitch, the registration in three dimensions for camera can be achieved. 3.3 Stereo display Because the image displayed is directly related to the effect of the entire system, stereo display is another key point of AR system. A binocular telescope which could provide a stereo image with the stereo image capture unit and stereo image display unit is designed. The capture unit is composed of two Honeywell GC- 655P-G CCD cameras. Two 3.5-inch LCD screens (Resolution 640*480) together with dual-channel optical eyepieces are used in the display unit. Virtools is a commercial development platform which is widely used for virtual reality applications, video games, as well as for other highly interactive 3D experiences. Virtools supports real camera image importing and processing and could also be used to build the virtual world and manage the combined real and virtual content. 3.4 Modeling During the process of modeling, we try to gather all available references of Dashuifa with the help of Yuanmingyuan administrative office. The virtual model is created based on the architecture data and drypoint images from Yuanmingyuan 4

archives. We have also consulted the experts on historic building from Tsinghua University.

4 TRIAL AND EVALUATION With the permission from Yuanmingyuan administrative office, AR-View is placed on a temporary viewing platform behind the shrubs in front of Dashuifa for experiments and

After inserting a coin, with the handle on the sides of the telescope, a user could rotate 270 degree on heading direction and 30 degree on pitch direction to observe the stereo virtual Dashuifa

Compared to the current site with crowded visitors, its users could now clearly and intuitively see what it was like 250 years ago in the same place and enjoy the fountains of Dashuifa like an

3 archives. We have also consulted the experts on historic building from Tsinghua University. To make the model vivid, virtual dynamic fountains and waterfalls are created with the particle effect from Virtools. 4 TRIAL AND EVALUATION With the permission from Yuanmingyuan administrative office, AR-View is placed on a temporary viewing platform behind the shrubs in front of Dashuifa for experiments and evaluations as shown in Figure 3. After inserting a coin, with the handle on the sides of the telescope, a user could rotate 270 degree on heading direction and 30 degree on pitch direction to observe the stereo virtual Dashuifa superimposed on the real site. Compared to the current site with crowded visitors, its users could now clearly and intuitively see what it was like 250 years ago in the same place and enjoy the fountains of Dashuifa like an emperor. At that moment, the history and present are jointed together with the help of AR technology. The results of questionnaires are shown in Table Will you use it if you should pay some money for use? 8. Do you think the device is helpful for you to understand the historical site? 9. Do you think many other sites should have this kind of device to? Public use Value Value Table 2: Questionnaire for AR-View Question Yes, Yes Not No Very much really 1 89% 11% 0% 0% 2 16% 41% 29% 14% 3 27% 52% 18% 3% 4 32% 34% 27% 7% 5 36% 33% 20% 11% 6 22% 44% 20% 14% 7 40% 48% 11% 1% 8 49% 45% 6% 0% 9 47% 39% 12% 2% Figure 3. Public trial, Augmented view of Dashuifa Table 1: Questionnaire for AR-View Question 1. Do you think it is novel for digital reconstruction on the historical site? 2. Do you think the appearance is good? 3. Is it easy and convenient for you to use? 4. Can you adapt yourself quickly to the stereo display? 5. Are you able to use the device without the instruction? 6. Do you think the device can be used for public? Aim Novel First impression Public use Figure 4. Results for questionnaire 5

The results of the answers of the questionnaire and interview show that all visitors thought that AR-View was an interesting and novel device for digital reconstruction they never used before.

However, 43% thought the appearance of the device should be improved. 21% responded negatively to question 3. 31% answered negatively to question 5. They considered it not easy to use.

For question 6, 66% answered positively. For question 9, 86% responded positively. The results encouraged us to go on ameliorating the device for widely practical use.

5 AMELIORATION As an integrated design, we put the imaging processing systems in the belly of the device along with imaging system and orientation tracking system at the top of the device.

Ergonomics and industrial design are involved in the new design to ameliorate the functions and appearance.

Considering the need of children and women who might be short, the height of the device is designed to be only 1550 millimeter and the actual eyepieces will be less than 1500 millimeter.

New design of AR-View Figure 6. Structure of new design, Section plan of new design Figure 6 shows the structure and section plan of new design.

4 The results of the answers of the questionnaire and interview show that all visitors thought that AR-View was an interesting and novel device for digital reconstruction they never used before. For question 8, 94% thought it was helpful for their understanding of Yuanmingyuan in contrast with the present site. It can be seen from question 2 to 5 that most users answered Yes. However, 43% thought the appearance of the device should be improved. 21% responded negatively to question 3. 31% answered negatively to question 5. They considered it not easy to use. By interview, visitors stated that the device should be shorter, paying more attention to children and women. It should be easier to rotate the revolving table. For question 6, 66% answered positively. For question 9, 86% responded positively. The results encouraged us to go on ameliorating the device for widely practical use. 88% thought they would pay money to use it. It meant that public people accepted this kind of reconstruction, and there was a large demand for potentially commercial use. 5 AMELIORATION As an integrated design, we put the imaging processing systems in the belly of the device along with imaging system and orientation tracking system at the top of the device. Coin box, UPS and circular distributor ring are also in it, so that it could be easily rotated for 360 degree in heading direction. Ergonomics and industrial design are involved in the new design to ameliorate the functions and appearance. As illustrated in Figure 5 the new design looks like a fashionable machine in the future. Considering the need of children and women who might be short, the height of the device is designed to be only 1550 millimeter and the actual eyepieces will be less than 1500 millimeter. On the sides of the device, two more handles are added for younger children. For tall people, the plane of the eyepiece is declivous for getting close more comfortably. Figure 5. New design of AR-View Figure 6. Structure of new design, Section plan of new design Figure 6 shows the structure and section plan of new design. In optoelectronic imaging system, a DV (Digital Video) Sony HDR- HC52E is used instead of CCD camera as image capture unit in order to obtain a better image. Image display unit is also redesigned to be smaller with a higher resolution (800*600). The revolving table contains a UPS (Uninterruptible Power Supply) SANTAK C1KS to provide stable power supply. HP DC7900 is chosen to be the computer for image processing system. Koyo TRD NA2048-NW rotary encoder is still used in the new design. A control plate is made for data connection. All the hardware is presented in Figure 7. Figure 7. System hardware 6

5 6 CONCLUSIONS We have presented the design of an AR device for digital reconstruction of Dashuifa in Yuanmingyuan. With sophisticated tracking and display technologies, the fixed-position binoculars telescope is used to show the stereo AR view. Furthermore, the system is improved for widespread use by ergonomics and industrial design. Experiments on the site of Yuanmingyuan and trials by public were conducted, the results of questionnaire show that visitors accepted it and enjoyed using AR-View to see the combined real and virtual Dashuifa. Most of the users thought it was a good way for helping them to understand historical site better. Although the device should be ameliorated further, AR- View opens the door to widely public use of AR technology in the area of digital reconstruction in China. 7 ACKNOWLEDGEMENT This work was supported by the National High Technology Research and Development Program of China (Grant No. 2008AA01Z303, 2009AA01Z308), National Natural Science Foundation of China (Grant No , ) and the Innovation Team Development Program of the Chinese Ministry of Education (Grant No. IRT0606). REFERENCES [1] Azuma Recent advances in augmented reality, In: Computer Graphics and Applications, IEEE Volume: 21 page(s): [2] F. Fritz, A. Susperregui and M.T.L., Enhancing Cultural Tourism experiences with Augmented Reality Technologies, In The 6 th International Symposium on Virtual Reality, Archaeology and Cultural Heritage VAST, [3] Vassilios Vlahakis, N.I., John Karigiannis, Manolis Tsotros, Michael Gounaris, Virtual Reality and Information Technology for Archaeological site promotion. In: 5th International Conference on Business Information Systems, [4] Miyashita, T.; Meier, P.; Tachikawa, T.; Orlic, S.; An Augmented Reality Museum Guide, In Proceedings of ISMAR 2008 Pages: , 2008 [5] Claus Brenner, V.P., Jan Haunert, Nora Ripperda, The Geoscope-A Mixed-reality system for planning and public participation, In: 25th Urban data management symposium

preface Motivation Figure 1. Reality-virtuality continuum (Milgram & Kishino, 1994) Mixed.Reality Augmented. Virtuality Real...

preface Motivation Figure 1. Reality-virtuality continuum (Milgram & Kishino, 1994) Mixed.Reality Augmented. Virtuality Real... v preface Motivation Augmented reality (AR) research aims to develop technologies that allow the real-time fusion of computer-generated digital content with the real world. Unlike virtual reality (VR)