Install simple system for playing environmental animation in the stereo display

Similar documents
Low-cost virtual reality visualization for SMEs

CSE 190: 3D User Interaction

Design Principles of Virtual Exhibits in Museums based on Virtual Reality Technology

CSC Stereography Course I. What is Stereoscopic Photography?... 3 A. Binocular Vision Depth perception due to stereopsis

Construction of visualization system for scientific experiments

Exhibition Strategy of Digital 3D Data of Object in Archives using Digitally Mediated Technologies for High User Experience

Virtual Reality I. Visual Imaging in the Electronic Age. Donald P. Greenberg November 9, 2017 Lecture #21

CSE 190: Virtual Reality Technologies LECTURE #7: VR DISPLAYS

HOW TO SIMULATE AND REALIZE A DISAPPEARED CITY AND CITY LIFE?

- Modifying the histogram by changing the frequency of occurrence of each gray scale value may improve the image quality and enhance the contrast.

Real Estate Marketing

EnSight in Virtual and Mixed Reality Environments

CSC 170 Introduction to Computers and Their Applications. Lecture #3 Digital Graphics and Video Basics. Bitmap Basics

Capturing Omni-Directional Stereoscopic Spherical Projections with a Single Camera

Chapter 1 Virtual World Fundamentals

What is Virtual Reality? Burdea,1993. Virtual Reality Triangle Triangle I 3 I 3. Virtual Reality in Product Development. Virtual Reality Technology

The Use of Digital Technologies to Enhance User Experience at Gansu Provincial Museum

VR-programming. Fish Tank VR. To drive enhanced virtual reality display setups like. Monitor-based systems Use i.e.

Realistic Visual Environment for Immersive Projection Display System

CS 450: COMPUTER GRAPHICS REVIEW: RASTER IMAGES SPRING 2016 DR. MICHAEL J. REALE

Application of 3D Terrain Representation System for Highway Landscape Design

Introduction to Virtual Reality (based on a talk by Bill Mark)

Output Devices - Visual

HeroX - Untethered VR Training in Sync'ed Physical Spaces

- applications on same or different network node of the workstation - portability of application software - multiple displays - open architecture

Reviews of Virtual Reality and Computer World

Regan Mandryk. Depth and Space Perception

The Application of Virtual Reality in Art Design: A New Approach CHEN Dalei 1, a

Omni-Directional Catadioptric Acquisition System

Technical Specifications: tog VR

Velvet Highest possible Projection Quality. ZEISS VELVET 1600 Sim Digital Video Projector. Issue:

Realtime 3D Computer Graphics Virtual Reality

FRAUNHOFER INSTITUTE FOR OPEN COMMUNICATION SYSTEMS FOKUS COMPETENCE CENTER VISCOM

COPYRIGHTED MATERIAL

What is an image? Images and Displays. Representative display technologies. An image is:

The Science Seeing of process Digital Media. The Science of Digital Media Introduction

Topic 3: Output Devices

One Week to Better Photography

E-520. Built-in image stabiliser for all lenses. Comfortable Live View thanks to high speed contrast AF** 100% D-SLR quality

Visual Imaging in the Electronic Age An Interdisciplinary Course Bridging Art, Architecture, Computer Science, and Engineering Offered in Fall 2016

One Size Doesn't Fit All Aligning VR Environments to Workflows

VIRTUAL REALITY Introduction. Emil M. Petriu SITE, University of Ottawa

Configuring Multiscreen Displays With Existing Computer Equipment

4/23/16. Virtual Reality. Virtual reality. Virtual reality is a hot topic today. Virtual reality

REPORT ON THE CURRENT STATE OF FOR DESIGN. XL: Experiments in Landscape and Urbanism

VR based HCI Techniques & Application. November 29, 2002

Virtual Reality in E-Learning Redefining the Learning Experience

INTERACTIVE 3D VIRTUAL HYDRAULICS Using virtual reality environments in teaching and research of fluid power systems and components

Virtual Environments. CSCI 420 Computer Graphics Lecture 25. History of Virtual Reality Flight Simulators Immersion, Interaction, Real-time Haptics

a marriage between Film and Video Viper FilmStream Camera: A Technical Overview Abstract Introduction

Partner sought to develop a Free Viewpoint Video capture system for virtual and mixed reality applications

Virtual Environments. Virtual Reality. History of Virtual Reality. Virtual Reality. Cinerama. Cinerama

1/22/13. Virtual Environments. Virtual Reality. History of Virtual Reality. Virtual Reality. Cinerama. Cinerama

Real World / Virtual Presentations: Comparing Different Web-based 4D Presentation Techniques of the Built Environment

COURSES. Summary and Outlook. James Tompkin

HMD based VR Service Framework. July Web3D Consortium Kwan-Hee Yoo Chungbuk National University

MOVING IMAGE - DSLR CAMERA BASICS

Name Digital Imaging I Chapters 9 12 Review Material

Laser Scanning for Surface Analysis of Transparent Samples - An Experimental Feasibility Study

Video Games and Interfaces: Past, Present and Future Class #2: Intro to Video Game User Interfaces

Virtual Environments. Ruth Aylett

Sky Italia & Immersive Media Experience Age. Geneve - Jan18th, 2017

Introducing Twirling720 VR Audio Recorder

A Multimodal Locomotion User Interface for Immersive Geospatial Information Systems

Panoramic imaging. Ixyzϕθλt. 45 degrees FOV (normal view)

Image Representations, Colors, & Morphing. Stephen J. Guy Comp 575

f= mm, mm (35mm format equivalent) Full-aperture F1.8 (Wide) - F4.9 (Telephoto) Constitution

interactive laboratory

Adding Depth. Introduction. PTViewer3D. Helmut Dersch. May 20, 2016

COLLABORATION SUPPORT SYSTEM FOR CITY PLANS OR COMMUNITY DESIGNS BASED ON VR/CG TECHNOLOGY

/ Impact of Human Factors for Mixed Reality contents: / # How to improve QoS and QoE? #

Research on Application of Virtual Reality Technology in Architectural Space Design

CS148: Introduction to Computer Graphics and Imaging. Displays. Topics. Spatial resolution Temporal resolution Tone mapping. Display technologies

PSSA Calibration and Colour Management

THE DIFFERENCE MAKER COMPARISON GUIDE

La photographie numérique. Frank NIELSEN Lundi 7 Juin 2010

Exploring 3D in Flash

Synthetic Stereoscopic Panoramic Images

Raster Images and Displays

The browser must have the proper plugin installed

ADVANCED WHACK A MOLE VR

LOOKING AHEAD: UE4 VR Roadmap. Nick Whiting Technical Director VR / AR

Images and Displays. Lecture Steve Marschner 1

Proposal for the Object Oriented Display : The Design and Implementation of the MEDIA 3

TAKING GREAT PICTURES. A Modest Introduction

Waves Nx VIRTUAL REALITY AUDIO

USER-ORIENTED INTERACTIVE BUILDING DESIGN *

Paper on: Optical Camouflage

Working with Wide Color Gamut and High Dynamic Range in Final Cut Pro X. New Workflows for Editing

Optical camouflage technology

Professor Aljosa Smolic SFI Research Professor of Creative Technologies

A BEGINNER S GUIDE TO PHOTOGRAPHY CHEATSHEET

Photographing Art By Mark Pemberton March 26, 2009

Analysis of retinal images for retinal projection type super multiview 3D head-mounted display

Active Stereo Vision. COMP 4102A Winter 2014 Gerhard Roth Version 1

Transforming Industries with Enlighten

Virtual Reality as Innovative Approach to the Interior Designing

Why learn about photography in this course?

lecture 24 image capture - photography: model of image formation - image blur - camera settings (f-number, shutter speed) - exposure - camera response

Data Sheet SMX-160 Series USB2.0 Cameras

Transcription:

Install simple system for playing environmental animation in the stereo display Chien-Hung SHIH Graduate Institute of Architecture National Chiao Tung University, 1001 Ta Hsueh Road, Hsinchu, 30050, Taiwan jerry@arch.nctu..edu.tw Abstract: Today, motion pictures are a major form of entertainment. Traditionally, to achieve the immersive effect and lifelike sensation that big-screen movies afford it was necessary to show them in large theatres built for the purpose. The cost of the stereo display devices (e.g. RGB projectors) and the theatres to house them is considerable. This paper intends to explain how, by applying the devices and software that architects have at their disposal nowadays, it is possible to develop a stereo display system, which costs only the same as a traditional CRT (Cathode Ray Tube) monitor as hardware, making a dedicated dark room unnecessary. Designers thus can apply this equipment to study the entire environment in a light display hall and show much convincible and vivid presentation anywhere. Key words: stereovision, stereo display, motion pictures 1. Introduction In the field of environmental analysis, animation is extreme a common way for the presentation in the media. Following the progress in software technique, professional architectural simulation animation can reach a level of commercial film. While in the domain of virtual reality, the application of stereovision has a long development history. Whatever using HMD (Head Mounted Displays) (fig.1) for the presentation and tracking user s l ocati o [1] or using two projectors and VR CAVE (Cave Automatic Virtual Environment) (fig.2) system equipped with passive polarized glasses [2], user can deeply immerse in an experience in a wonderful space. With the effect of stereo display, viewers will enter a space filled with 3D and immersive perception. Because of the stereo perception is more fit the characteristic of human beens, so that they can get the deep impression from architecture space. Fig.1 HMD (Head Mounted Displays) Fig.2 VR CAVE simulation

The stereo display could completely simulate real space, and would have the dual benefit of aiding research and giving entertainment. To install such a system without incurring the huge expense of specialized architecture has long been a dream of computer engineers (fig.3). Today, with the popularity of high display frequency CRT monitors and stereo display plug-ins for Java Applets (fig.4), it is possible to adapt a family-use monitor to a stereo display device. The author will demonstrate the media-utilizing steps to this end in this paper. The finished product will make the presentation of architects more lifelike as it will have enhanced immersive perception. After that, this simple stereo display system can be adapted widely because the possibilities for its use are endless. Fig.3 Expensive stereo projector Fig.4 Economic CRT monitor 2. Media Review: Stereo Display Generally speaking, the stereo image is a picture that has depth of field and 3D space perception. Because there is a small distance (about 5cm) between the human right and left eye when we look at something, the angle of view of both the eyes will be slightly different. The brain combines the individual view of each eye, and gives us the stereovision effect that is notable for its space perception (fig.5). The perception of space allows us to measure the relative distance between viewed objects and ourselves [3]. There were stereo glasses to view 3D movies during the 60 s [4]. The principle uses dual images to simulate the vision of both eyes, and force the eyes to see individual pictures. In other words, make the right eye see the right view images, and the left eye see left view images, by using red & green filter stereo glasses. The stereovision helmet will apply dual LCD shutters to display individual images in parallax. The other stereo glasses place vertical and horizontal polarized lenses in front of to the left and right eye individually. The display type will use dual projectors to project overlapping images that also allow both eyes to see different view points. Because of the development of virtual reality even to the argument reality domain recently, just to use two LCD shutters or projectors simply which could achieve the stereo space simulation (fig.6). Therefore, the stereo display system not only be researched a lot in academy domain [5], but also be a main trend in entertainment industry from ten years ago. Fig.5 The parallax of brain Fig.6 Use dual projectors to simulate

2.1 Active page-flipping mode Page-flipping is to display the image of the left and right eye on the screen by turn, and match its screen redrawing frequency with crystal stereo glasses (fig.7). Because it needs to cache two images of the right and left eye at the same time, page-flipping always requires a higher level of hardware. To overcome the glare of the page-flipping display, 60 frames per second for both eyes is necessary, so the screen scan frequency needs 120HZ or higher. Because the page-flipping display involves the hardware frame buffer (fig.8), it always needs a specific display card. The page-flipping also supplies the full-screen resolution quality, and the resulting visual effect is the best of all modes. Fig.7 Crystal stereo glasses Fig.8 The stereo image of CRT Monitor 3. Exploration From the Media Review we could know, it has a long history to appreciate the stable stereo images with simply optical or specific glasses, and every stereo display device also has the limitation of quality and hardware ability. However, in the technology development times, if designers want a device which could display stereo animation today, the small architecture studio are hard to afford using the hardware whatever on the space and cost. In order to meet economic benefits, disregarding stereo animation that can make audience well involved in the environment projector or big size TV is still used to play traditional architectural simulation animation. However, as the mentioned as Media Review, in the development of hardware nowadays, utilize the monitor active display page-flipping stereo movie will get more saturate and sharp images than projection mode, and the120 HZ high screen frequency will make the fluent display effect. Therefore, the objective of this research is to study how to use software and hardware got from the market to build small size active stereo display system with simpler and economical ways. So the architect could follow this workflow, install the stereo display system fast, and make it be a powerful tool for animation playback and presentation efficiency. 4. Media Steps 4.1 Upgrade hardware limitation General Nvidia Geforce series display cards couldn t attain the page-flipping effect of 120Hz per second. So the author suggested using the overclock freeware Rivatuner from web hackers to upgrade the Geforce graphic chip to the high quality Quadro series (fig.9). Due to the high performance of the Quadro series, Designers could call up the stereo display API (Advanced Programmers Interface) buffer with a specific driver (fig.10), which will

achieve high quality stereo animation by page-flipping and play fluently in high resolution. Then the traditional CRT screen can be upgraded to a professional screen at the speed of 800*600 resolution with 120HZ scanning to control the page-flipping frequency of stereo glasses. Fig.9 The overclock tool RivaTuner Fig.10 The stereo API of Nvidia Quadro 4.2 Install Java stereo driver After rebuilding the hardware component of the stereo display in the last step, the author should apply the unique stereo display driver plug-in of Java 3D to be a menu in the stereo animation playback and support a high scan frequency CRT monitor and crystal stereo glasses. Go to Sunsoft to free download Java web browser 2.2 first (fig.11), then designers can continue installing the Java 3D as mentioned. After installing the stereo plug-in, designers can divide the scanning frequency at 120 times per second into a flipping display at 60 times per second in the left and right side (fig.12). The designers can attain the objective of stereo display from the left to right eye frame by frame at 120HZ to match the 3D stereo glasses and match the presentation of the stereo animation player with the rebuild CRT monitor. Fig.11 Java web browser 2.2 Fig.12 The Java 3D stereo plug-in interface 4.3 Software playback Use the function of the flipping display in the software 3 D co mbi ne to c ombi ne both an i mat i ons for t he r i gh and left eyes as a.avi file with Adobe AfterEffect. In the settings of AfterEffect, in order to play at 120HZ and not to lose frames, designers need to set the fps (frames per second) of the combined animation to 60 fps (fig.13), then the 3D combine can play stereo animation at a display frequency of 120HZ (fig.14). For this step, the researchers use rebuild hardware, upgraded drivers and a specific software playback (Table1.). Viewers need only put on the stereo glasses to see the stereo display CRT monitor, which directly produces page-flipping at 120 HZ, to appreciate the really high quality stereo animation.

Table1. The category of Media Steps Fig.13 Synthesize dual eye s images by AE Fig.14 Play stereo animation by 3Dcombine Media Steps A. Upgrade hardware limitation B. Install Java stereo driver C. Software playback Software Hardware Objective time budget RivaTuner, Nvidia Stereo API Java web browser 2.2, Java 3D plug-in Adobe AfterEffect, 3Dcombine Nvidia Quadro display card Update the display frequency to 120Hz Traditional CRT monitor Make the CRT monitor to stereo display Active page-flipping Play the combined stereo crystal stereo glasses animation 60 mins No 30 mins $180 60 mins $70 5. Result & Application This research paper is a total workflow that attempts to help architects to present more vivid and convinced works in design and presentation period. According to the Media Steps and simple equipments. The authors rendered the scene of left and right eye s camera individually in 3D graphic software, such as 3D Studio MAX. Then use the mentioned workflow before to play animations in stereo display, and make it become the main tool in design representation and competition. Because of the truly lifelike perceptions played in stereo animation is very different with traditional animation in flat 2D projection, the presentation got lots of applause in the competition. And it also demonstrates that the research and methods are reachable and high quality stereo animation that designers have never seen. In a presentation case showing in the exhibition center, the rebuilt stereo display device and CRT monitor is not the same as a projector that needs a dark space to show clearly. So architects could place it in the lighted entrance of an exhibition hall. At an exhibition Virtual Asia, the author, set up three stereo display monitors and several pairs of crystal stereo glasses (fig.15). They gave a presentation about the lives of ancient nobles and historic Chinese relics by using multimedia stereo animation (fig.16). Due to the unique stereo perception effect, it attracted most of the visitors to see it and it shouldered the responsibility of explaining the exhibition contents before they entered the hall. It made a deep impression on the audience. Fig.15 The stereo display device with users Fig.16 The stereo animation of nobles life

In addition, the system will not only be a stereo animation player in its application. The author utilizes two DV's to simulate both the eyes of a human being, and film the site environment of the design building at the same time (fig.17). After that, use Abobe AfterEffect to combine these two movies in the same way and play the combined movie in 3Dcombine. The real filmed stereo movie can also produce the immersive effects of stereo animation. In Project: ITRIS 2010, the author applied the camera-matching technique from the movie industry to synthesize a digital model with these two real movies for the stereo display in advance (fig.18) [6], and presented the same high quality of synthesized animation as one would expect from a Hollywood movie (fig.19). It also increases the application value of this system. Fig.17 Real site film Fig.18 Synthesized model by Camera-Matching Fig.19 The combined animation by AE (right & left eye s view 6. Significance & future study This research attempts by starting with the study of media to develop a total solution that could easily produce a high quality stereo display. The author s knowledge about software and hardware with assistance from the computer science domain in processing a workflow could produce a system that architects could follow and apply at their convenience without any problem. The stereo display technique as media can easily be produced, because it uses the simplest hardware (e.g. a CRT monitor), so there is no limit to its application. Beyond the architecture designers, we could use stereo movies or animation to enhance viewersu physical sensations, and it would be very easy to adapt the device for many other purposes. Designers just need a large size CRT monitor; they can easily install the now expensive VR CAVE and track sensor programs economically, and use it for flight simulation training. Further more, by using multi-monitors and camera-matching techniques, designers could built a 360 degree panorama stereo environment that combines physical and virtual space, just like Disney Land.

However, there are limitations to this device. Although the traditional CRT monitor has the advantage of economy and high screen frequency, it also has space and size limits, so it is not suitable for multi-viewers. Because this research aims at users on a limited budget, the author suggests using CRT monitors to replace projectors as a stereo display device. Its other restriction, the slow display speed, must wait for hardware researchers to come up with a solution. The main significance of this research is to provide the current environmental animation with a more realistic presentation. The author, in order to install the stereo movie player rebuilt from a traditional CRT monitor, tried to get hardware, firmware, and software to interact and combine to produce a unique installation method. By the present hardware such as CRT monitor and freeware, to replace previous display effect presented with huge equipment in dark space. Hence, architects can conveniently present their design works with vivid stereo effect in a light presentation hall anytime anywhere. Further study could orient to the developing of real-time feedback on the interactive space simulation technique. To lead the standstill situation of environment simulation presentation technique in the design domain forward to the much more augment reality and rituality combination standard. Reference 1. Pausch R. Proffitt D. Williams G.: Quantify immersion in virtual reality, Siggraph 97, 13-18(1995). 2. Tang SK: A digital reconstruction procedure for a disappeared city space and its activities, ECAADE 2002, 598-603(2002). 3. Paul E.: Modeling and rendering architecture from photographs, Siggraph 96, 11-30(1996). 4. Edward H.: Introduction Modern Photography, John Wesley & Sons, New Jersey, (2001). 5. Gobbetti E. Balaguer J.: An integrated environment to visually construct 3D animations, Siggraph 95, 395-398(1995). 6. Shih CH: Dynamic environment design with new hardware/software intelligent technique, CADDRIA 2003(2003).

This document was created with Win2PDF available at http://www.daneprairie.com. The unregistered version of Win2PDF is for evaluation or non-commercial use only.