Enabling Mobile Virtual Reality ARM 助力移动 VR 产业腾飞 Nathan Li Ecosystem Manager Mobile Compute Business Line Shenzhen, China May 20, 2016
3 Photograph: Mark Zuckerberg Facebook https://www.facebook.com/photo.php?fbid=10102665120179591&set=pcb.10102665126861201&type=3&theater
Virtual Reality is Not New VR is not new but it never quite took off: Hardware was expensive and bulky Available technology offered limited graphics capabilities User experience was unpleasant and ineffective VR is now accessible: Emergence of low-cost hardware based on existing platforms Mobile platforms offering console-like performance and display resolution VR is now a huge industry movement: New applications, use-cases and content are emerging every day Rich ecosystem developing rapidly 4
VR Use Cases Games Experiences Training 5 Education TV/Film Advertising
Introducing ARM CPUs and GPUs designed by ARM Around 15bn ARM based SoCs shipped in 2015 6 Integrated into SoCs of numerous partners ARM powers smartphones, DTVs, automotive, VR devices ARM is in everything from sensors to servers! >85% of all mobile computing is based on ARM
How Long Until Desktop GPU Compute Is In Mobile? Current mobile compute capability very near console PS4 PS3 Progress of Desktop Xbox 360 XboxOne Progress of Mobile Mobile Today 7
Building a Great VR Experience Brings Console-class Gaming Experience to Your Pocket High performance, multi-core ARM Cortex CPU as the basis of the system ARM big.little providing balance of power and performance VR requires more pixels, more detail, higher frame rates, multiple camera angles, lower latency VR driving demand for extreme graphics performance 8 High performance interconnect and VR specific extension to meet high demands of VR High performance, energy-efficient ARM Mali GPUs provide rich graphics
Mali Leading the Mobile VR Experience The road to becoming the World s #1 Shipping Graphics Processor June 2008: Mali-400 launched becoming the world s most successful mobile GPU 2008 Onwards: ARM builds broad network of partnerships with key members of graphics ecosystem 2015: First Mali based VR product launched on Exynos 5433 Many Mali based VR products launched on RK3288 in China 2013: Mali-T760 launches, pushing boundaries on performance, power and features End products on the market in <12 months 2016: VR ecosystem fully mobilized VR standard requirement of high end mobile ARM Mali #1shipping GPU Rockchip RK3399 Release 9 2010: Mali-T600 series launches supporting the advanced OpenGL ES 3 standard & setting the scene for VR 2012: ARM begins partnership with Samsung and Oculus ARM develops early thought leadership in VR
Mali Benefits For Virtual Reality Example: Reduced latency Front buffer rendering: Front buffer rendering bypasses offscreen buffers to render directly to the front buffer Timewarp: Effectively predicts the changes required to update the view Context_priority: Extension available on Mali GPUs which allows prompt task scheduling on the GPU And many more VR targeted enhancements & extensions 10
What Does Mali Bring to Virtual Reality? Wide range of benefits for VR High graphics performance Support for higher pixel counts (left + right eye camera views) Support for higher resolution and frame rate Support for more complex content and latest APIs OpenGL ES and EGL latency reducing extensions Front buffer rendering reduce buffer swaps Timewarp motion compensation Context priority enhanced task scheduling System bandwidth reductions ARM Frame Buffer Compression (AFBC) ASTC (texture compression) 11
Enlighten Real-time Global Illumination Leading Lighting Technology Why go real-time? Lights and materials move and change at runtime Efficient in-editor workflow High quality interactivity Enlighten scales from PC to mobile to VR ARM is the leader in mobile technology and the Enlighten team are lighting gurus! CPU-based Independent of render frame rate Enlighten emissive materials light scenes for free 12 Photos Enlighten in UE4 on PC and mobile
Mali - Enabling the VR Ecosystem ARM working with silicon partners, OEMs, OS and content developers to deliver a compelling VR experience on Mali GPUs Mali GPUs provide features and performance to optimize VR applications and workloads Deliver advanced VR experiences to the market 13
Mali Graphics Demos 14
Thank you! Email: Nathan.Li@arm.com The trademarks featured in this presentation are registered and/or unregistered trademarks of ARM Limited (or its subsidiaries) in the EU and/or elsewhere. All rights reserved. All other marks featured may be trademarks of their respective owners. Copyright 2016 ARM Limited