5G Video Experience VR/AR Live Streaming
UHD Video Streaming 5G Video Experience 360 Immersive Media VR and AR Social Experience Sharing 2
Immersive Experience Immersive Content ü 4K, 8K, 12K, 24K ü 60fps, 90fps, 120fps ü HDR, panoramic, 360 ü Stereoscopic, light field, volumetric, etc. Network Access ü High throughput ü Extreme capacity ü Ultra low latency ü Quality of Experience(QoE) Devices ü Intelligent on-device tracking ü High resoluqon/frame-rate, FoV, PPI ü Power, thermal, cost, etc. 3
Virtual cinema/movie theater Enhanced personal points of view Entertainment Interac2ve gaming, explora2on, shopping, etc. Live music concerts, sports, fashion shows Services Retail Healthcare Real estate Military Educa2on Engineering video. VR. AR. Communica4ons Social event sharing Immersive storytelling VR conferencing & telepresence Personal or professional experience sharing 4
VR Related SDOs and SIGs 5
InterDigital Virtual Reality/Augmented Reality InterDigital Technologies Real-&me live video acquisi&on Real-&me &led-based HEVC video encoding Viewport adap&ve technology to improve network bandwidth usage efficiency Augmented reality inside 360 video to enhance the live streaming experience Hybrid RTMP and DASH live streaming server/client to support low latency VR experience Compliant with the latest MPEG immersive standard (OMAF) Targets & Objec=ves Showcase state-of-the-art AR/VR technologies Seek partners and/or customers for further development towards immersive AR/VR applica&ons 6
InterDigital VR/AR Live Streaming Pla5orm Real-Time 4K VR 360 Acquisi5on Tiled HEVC Encoding Tile0, high quality OMAF Viewport Adap5ve DASH Streaming Tile0, low quality Tile1, high quality Tile1, low quality Tiled 360 Video Encoding 360 Camera Tile2, high quality Tile2, low quality OMAF Live Streaming Server Viewport extrac5on User Interac5ve AR/VR Rendering AR/VR Rendering AR HEVC Decoder and Viewport Extrac5on DASH Streaming Client View Orienta=on Tracking AR/VR Rendering AR HEVC Decoder and Composi5on OMAF VR/AR Client 7
5G Video Experience Enhanced via MulC-Access Edge CompuCng
Mul$-Access Edge Compu$ng 5G Enabler Public Cloud Distant Cloud Private Cloud CDN Edge Cloud Small Cell Network Far Edge Cloud Vehicle Edge MEC embeds application resources closer to end-users and devices Macro Cell MEC Pool Personal Edge Foundational technology to realize 5G services and application verticals: Low latency, network and app efficiency, adaptability, and context awareness Mini Data Center MEC AR/VR media, mission critical automation, automotive, gaming, massive IoT, etc. Core Network MEC Pool Wi-Fi Network MEC Vehicle Edge With virtualization, edge resources extend across the network: Far Edge of the network small cells, Wi-Fi networks, vehicles, etc. Edge Cloud 3 rd Party Provider Far Edge Cloud 3 rd party edge providers offering resources into the 5G system 9
Edge-Enabled 5G Video Experience Live AR/VR Stadium Use Case Localized Video for the Olympics FLIPS Drones Overhead View Athlete Live Streaming Venue AR Content Alternate Views Row 1 View Near Key Event User in Stands Play-Level View MEC AR Proxy App 360 Video Edge Server 10 Simultaneous acaviaes spread across the venue; not all events visible from any one seaang locaaon Venue offers fans a 5G Video Experience with live 360 VR viewing from several locaaons throughout the venue AR supplements the user experience with content provided by the venue and independent 3rd paraes (such as other fans or even athletes)
Edge-Enabled 5G Video Experience Live AR/VR Stadium Use Case Localized Video for the Olympics FLIPS Drones Overhead View Athlete Live Streaming Venue AR Content 1. Efficient Network U;liza;on Alternate Views Row 1 Seat View Near Key Event User in Stands Edge video processing server reduces video bandwidth throughout the network 2. Low Latency Play-Level View MEC AR Proxy App 360 Video Edge Server 11 Localized AR/VR video processing highlights key MEC aspects Live video required latency within human delay tolerance 3. MEC Edge Services MEC interconnects VR and AR content sources
Edge-Enabled 5G Video Experience Live AR/VR Stadium Use Case Localized Video for the Olympics InterDigital s AdvantEDGE Pla-orm provides an emulated edge network InterDigital s VR/AR Live Streaming Pla-orm deployed at the Edge via AdvantEDGE Pla>orm 360 camera for live video content AR/VR Clients: Goggles and display Emulated terminals providing AR content Drag and drop the AR/VR clients into various locajon zones An edge service matches AR content with 360 VR video, depending on locajon zone 12
Edge-Enabled 5G Video Experience VR/AR MEC App Deployment via Mobile Edge Emula<on Pla>orm, AdvantEDGE Video Pla1orm MEC App Hosted on External Node AR UE VR Clients Hosted on External Nodes Live Video MEC App Four PoA s one PoA per MEC Location Zone AR Proxy MEC App MEC Service Edge Host Bridge MEC Edge Node PoA #1 PoA #2 AR UE VR Client VR Clients TransiFon Across MEC LocaFon Zones Based on PoA IP Camera UE Hosted on an External Node 360 IP Camera PoA #4 PoA #3 VR Client 13