OPTIMIZED SAMPLING FOR VIEW INTERPOLATION IN LIGHT FIELDS WITH OVERLAPPING PATCHES

Size: px
Start display at page:

Download "OPTIMIZED SAMPLING FOR VIEW INTERPOLATION IN LIGHT FIELDS WITH OVERLAPPING PATCHES"

Transcription

1 OPTIMIZED SAMPLING FOR VIEW INTERPOLATION IN LIGHT FIELDS WITH OVERLAPPING PATCHES D. C. Schedl 1 and O. Bimber 1 1 Institute of Computer Graphics, david.schedl@jku.at and oliver.bimber@jku.at

2 MOTIVATION dense (225 samples) uniform sparse (64 samples) [ours] coded sparse (225 from 64 samples) D. C. Schedl & O. Bimber / Optimized Sampling for View Interpolation in Light Fields with Overlapping Patches 2

3 RELATED WORK Coded sampling with local dictionaries [Schedl et al., ICCP 2015] [Schedl et al., CVIU 2017] D. C. Schedl & O. Bimber / Optimized Sampling for View Interpolation in Light Fields with Overlapping Patches 3

4 RELATED WORK Coded sampling with local dictionaries Compressed Sensing [Marwah et al., TOG 2013] [Cao et al., Opt. Express 2014] D. C. Schedl & O. Bimber / Optimized Sampling for View Interpolation in Light Fields with Overlapping Patches 4

5 RELATED WORK Coded sampling with local dictionaries Compressed Sensing Depth-based view interpolation Learning-based methods [Kalantari et al., TOG 2016] D. C. Schedl & O. Bimber / Optimized Sampling for View Interpolation in Light Fields with Overlapping Patches 5

6 RELATED WORK Coded sampling with local dictionaries Compressed Sensing Depth-based view interpolation Learning-based methods Other [Shi et al., TOG 2014] [Vagharshakyan et al., PAMI 2015] D. C. Schedl & O. Bimber / Optimized Sampling for View Interpolation in Light Fields with Overlapping Patches 6

7 CONTRIBUTIONS New sampling quality metric A reduced search space for sampling mask estimation An enhanced upsampling technique supporting maximal patch overlaps D. C. Schedl & O. Bimber / Optimized Sampling for View Interpolation in Light Fields with Overlapping Patches 7

8 minimum distance SAMPLING QUALITY METRIC D. C. Schedl & O. Bimber / Optimized Sampling for View Interpolation in Light Fields with Overlapping Patches 8

9 minimum distance SAMPLING QUALITY METRIC interpolation extrap. D. C. Schedl & O. Bimber / Optimized Sampling for View Interpolation in Light Fields with Overlapping Patches 9

10 ours SAMPLING QUALITY METRIC interpolation extrap. D. C. Schedl & O. Bimber / Optimized Sampling for View Interpolation in Light Fields with Overlapping Patches 10

11 SAMPLING QUALITY METRIC D. C. Schedl & O. Bimber / Optimized Sampling for View Interpolation in Light Fields with Overlapping Patches 11

12 SAMPLING QUALITY METRIC sampling mask D. C. Schedl & O. Bimber / Optimized Sampling for View Interpolation in Light Fields with Overlapping Patches 12

13 SAMPLING PATTERN ESTIMATION Constraints: regular symmetric sampling mask (64 samples; 15x15 grid) D. C. Schedl & O. Bimber / Optimized Sampling for View Interpolation in Light Fields with Overlapping Patches 13

14 SAMPLING PATTERN ESTIMATION basis grid permutations sampling mask (only guidance) D. C. Schedl & O. Bimber / Optimized Sampling for View Interpolation in Light Fields with Overlapping Patches 14

15 SAMPLING PATTERN ESTIMATION E: basis grid permutations D. C. Schedl & O. Bimber / Optimized Sampling for View Interpolation in Light Fields with Overlapping Patches 15

16 SAMPLING PATTERN ESTIMATION E: basis grid permutations final sampling mask D. C. Schedl & O. Bimber / Optimized Sampling for View Interpolation in Light Fields with Overlapping Patches 16

17 RECONSTRUCTION sampling mask dictionary D. C. Schedl & O. Bimber / Optimized Sampling for View Interpolation in Light Fields with Overlapping Patches 17

18 RECONSTRUCTION sub-sampled light-field sampling mask reconstructed light-field D. C. Schedl & O. Bimber / Optimized Sampling for View Interpolation in Light Fields with Overlapping Patches 18

19 RECONSTRUCTION sampling mask D. C. Schedl & O. Bimber / Optimized Sampling for View Interpolation in Light Fields with Overlapping Patches 19

20 RECONSTRUCTION reconstructed light-field D. C. Schedl & O. Bimber / Optimized Sampling for View Interpolation in Light Fields with Overlapping Patches 20

21 Schedl 15 Schedl 17 Ours RESULTS: SAMPLING MASKS high (bad) low (good) unsupported unsupported unsupported D. C. Schedl & O. Bimber / Optimized Sampling for View Interpolation in Light Fields with Overlapping Patches 21

22 RESULTS Scenes (N) Marwah '13 Shi '14 Schedl '15 Kalantari '16 Schedl '17 Ours Table Amethyst (64) 37.77dB dB 41.86dB 42.08dB Lego (64) 28.79dB dB 35.63dB 37.26dB Lego (48) dB 35.75dB Cave (64) 26.51dB dB 38.57dB 41.08dB Alley (64) 36.58dB dB 43.83dB 44.35dB Amethyst (72) dB dB 42.55dB Tarot (72) dB dB 39.20dB Amethyst (69) dB dB 42.43dB Tarot (69) dB dB 39.04dB Tarot (48) dB 37.54dB Cave (69) dB dB 41.41dB Alley (69) dB dB 45.20dB D. C. Schedl & O. Bimber / Optimized Sampling for View Interpolation in Light Fields with Overlapping Patches 22

23 Lego: Schedl 17 (64) Ours (64) Reference (225) D. C. Schedl & O. Bimber / Optimized Sampling for View Interpolation in Light Fields with Overlapping Patches 23

24 Cave: Kalantari 16 (64) Ours (64) Reference (225) D. C. Schedl & O. Bimber / Optimized Sampling for View Interpolation in Light Fields with Overlapping Patches 24

25 Tarot: Schedl 15 (69) Ours (69) Reference (225) D. C. Schedl & O. Bimber / Optimized Sampling for View Interpolation in Light Fields with Overlapping Patches 25

26 Amethyst: Shi '14 (72) Ours (72) Reference (225) D. C. Schedl & O. Bimber / Optimized Sampling for View Interpolation in Light Fields with Overlapping Patches 26

27 Alley: Marwah 13 (64) Ours (64) Reference (225) D. C. Schedl & O. Bimber / Optimized Sampling for View Interpolation in Light Fields with Overlapping Patches 27

28 LIMITATIONS / FUTURE WORK Time: 40h 5 days on NVIDIA Tesla V100 GPU D. C. Schedl & O. Bimber / Optimized Sampling for View Interpolation in Light Fields with Overlapping Patches 29

29 LIMITATIONS / FUTURE WORK Time: 40h 5 days on NVIDIA Tesla V100 GPU Other light-field camera designs D. C. Schedl & O. Bimber / Optimized Sampling for View Interpolation in Light Fields with Overlapping Patches 30

30 LIMITATIONS / FUTURE WORK Time: 40h 5 days on NVIDIA Tesla V100 GPU Other light-field camera designs Other fields (e.g. image-based relighting) D. C. Schedl & O. Bimber / Optimized Sampling for View Interpolation in Light Fields with Overlapping Patches 31

31 Schedl 17 (64) Ours (64) Reference (225) Kalantari 16 (64) Ours (64) Reference (225) More information: Contact: and This project was funded by FWF (P N33) JOHANNES KEPLER UNIVERSITY LINZ Altenberger Str Linz, Austria

Coded Exposure HDR Light-Field Video Recording

Coded Exposure HDR Light-Field Video Recording Coded Exposure HDR Light-Field Video Recording David C. Schedl, Clemens Birklbauer, and Oliver Bimber* Johannes Kepler University Linz *firstname.lastname@jku.at Exposure Sequence long exposed short HDR

More information

IMAGE RESTORATION WITH NEURAL NETWORKS. Orazio Gallo Work with Hang Zhao, Iuri Frosio, Jan Kautz

IMAGE RESTORATION WITH NEURAL NETWORKS. Orazio Gallo Work with Hang Zhao, Iuri Frosio, Jan Kautz IMAGE RESTORATION WITH NEURAL NETWORKS Orazio Gallo Work with Hang Zhao, Iuri Frosio, Jan Kautz MOTIVATION The long path of images Bad Pixel Correction Black Level AF/AE Demosaic Denoise Lens Correction

More information

Modeling the calibration pipeline of the Lytro camera for high quality light-field image reconstruction

Modeling the calibration pipeline of the Lytro camera for high quality light-field image reconstruction 2013 IEEE International Conference on Computer Vision Modeling the calibration pipeline of the Lytro camera for high quality light-field image reconstruction Donghyeon Cho Minhaeng Lee Sunyeong Kim Yu-Wing

More information

Liu Yang, Bong-Joo Jang, Sanghun Lim, Ki-Chang Kwon, Suk-Hwan Lee, Ki-Ryong Kwon 1. INTRODUCTION

Liu Yang, Bong-Joo Jang, Sanghun Lim, Ki-Chang Kwon, Suk-Hwan Lee, Ki-Ryong Kwon 1. INTRODUCTION Liu Yang, Bong-Joo Jang, Sanghun Lim, Ki-Chang Kwon, Suk-Hwan Lee, Ki-Ryong Kwon 1. INTRODUCTION 2. RELATED WORKS 3. PROPOSED WEATHER RADAR IMAGING BASED ON CUDA 3.1 Weather radar image format and generation

More information

Super resolution with Epitomes

Super resolution with Epitomes Super resolution with Epitomes Aaron Brown University of Wisconsin Madison, WI Abstract Techniques exist for aligning and stitching photos of a scene and for interpolating image data to generate higher

More information

360 Panorama Super-resolution using Deep Convolutional Networks

360 Panorama Super-resolution using Deep Convolutional Networks 360 Panorama Super-resolution using Deep Convolutional Networks Vida Fakour-Sevom 1,2, Esin Guldogan 1 and Joni-Kristian Kämäräinen 2 1 Nokia Technologies, Finland 2 Laboratory of Signal Processing, Tampere

More information

DEEP LEARNING ON RF DATA. Adam Thompson Senior Solutions Architect March 29, 2018

DEEP LEARNING ON RF DATA. Adam Thompson Senior Solutions Architect March 29, 2018 DEEP LEARNING ON RF DATA Adam Thompson Senior Solutions Architect March 29, 2018 Background Information Signal Processing and Deep Learning Radio Frequency Data Nuances AGENDA Complex Domain Representations

More information

LEGO car course topics

LEGO car course topics LEGO car course topics Xiebing Wang, Xiang Gao, Biao Hu, Kai Huang Chair of Robotics and Embedded Systems Department of Informatiks Technische Universität München Xiebing Wang, Xiang Gao, Biao Hu, Kai

More information

Image Enhancement for Astronomical Scenes. Jacob Lucas The Boeing Company Brandoch Calef The Boeing Company Keith Knox Air Force Research Laboratory

Image Enhancement for Astronomical Scenes. Jacob Lucas The Boeing Company Brandoch Calef The Boeing Company Keith Knox Air Force Research Laboratory Image Enhancement for Astronomical Scenes Jacob Lucas The Boeing Company Brandoch Calef The Boeing Company Keith Knox Air Force Research Laboratory ABSTRACT Telescope images of astronomical objects and

More information

Dictionary Learning based Color Demosaicing for Plenoptic Cameras

Dictionary Learning based Color Demosaicing for Plenoptic Cameras Dictionary Learning based Color Demosaicing for Plenoptic Cameras Xiang Huang Northwestern University Evanston, IL, USA xianghuang@gmail.com Oliver Cossairt Northwestern University Evanston, IL, USA ollie@eecs.northwestern.edu

More information

Compressive Coded Aperture Superresolution Image Reconstruction

Compressive Coded Aperture Superresolution Image Reconstruction Compressive Coded Aperture Superresolution Image Reconstruction Roummel F. Marcia and Rebecca M. Willett Department of Electrical and Computer Engineering Duke University Research supported by DARPA and

More information

Filters. Materials from Prof. Klaus Mueller

Filters. Materials from Prof. Klaus Mueller Filters Materials from Prof. Klaus Mueller Think More about Pixels What exactly a pixel is in an image or on the screen? Solid square? This cannot be implemented A dot? Yes, but size matters Pixel Dots

More information

Coded Aperture for Projector and Camera for Robust 3D measurement

Coded Aperture for Projector and Camera for Robust 3D measurement Coded Aperture for Projector and Camera for Robust 3D measurement Yuuki Horita Yuuki Matugano Hiroki Morinaga Hiroshi Kawasaki Satoshi Ono Makoto Kimura Yasuo Takane Abstract General active 3D measurement

More information

Optimized Quality and Structure Using Adaptive Total Variation and MM Algorithm for Single Image Super-Resolution

Optimized Quality and Structure Using Adaptive Total Variation and MM Algorithm for Single Image Super-Resolution Optimized Quality and Structure Using Adaptive Total Variation and MM Algorithm for Single Image Super-Resolution 1 Shanta Patel, 2 Sanket Choudhary 1 Mtech. Scholar, 2 Assistant Professor, 1 Department

More information

IIL Imaging Model, Grating-Based Analysis and Optimization

IIL Imaging Model, Grating-Based Analysis and Optimization UNM MURI REVIEW 2002 IIL Imaging Model, Grating-Based Analysis and Optimization Balu Santhanam Dept. of EECE, University of New Mexico Email: bsanthan@eece.unm.edu Overview of Activities Optimization for

More information

Image Enhancement for Astronomical Scenes. Jacob Lucas The Boeing Company Brandoch Calef The Boeing Company Keith Knox Air Force Research Laboratory

Image Enhancement for Astronomical Scenes. Jacob Lucas The Boeing Company Brandoch Calef The Boeing Company Keith Knox Air Force Research Laboratory Image Enhancement for Astronomical Scenes Jacob Lucas The Boeing Company Brandoch Calef The Boeing Company Keith Knox Air Force Research Laboratory ABSTRACT Telescope images of astronomical objects and

More information

fast blur removal for wearable QR code scanners

fast blur removal for wearable QR code scanners fast blur removal for wearable QR code scanners Gábor Sörös, Stephan Semmler, Luc Humair, Otmar Hilliges ISWC 2015, Osaka, Japan traditional barcode scanning next generation barcode scanning ubiquitous

More information

DYNAMIC CONVOLUTIONAL NEURAL NETWORK FOR IMAGE SUPER- RESOLUTION

DYNAMIC CONVOLUTIONAL NEURAL NETWORK FOR IMAGE SUPER- RESOLUTION Journal of Advanced College of Engineering and Management, Vol. 3, 2017 DYNAMIC CONVOLUTIONAL NEURAL NETWORK FOR IMAGE SUPER- RESOLUTION Anil Bhujel 1, Dibakar Raj Pant 2 1 Ministry of Information and

More information

Computer Vision. Howie Choset Introduction to Robotics

Computer Vision. Howie Choset   Introduction to Robotics Computer Vision Howie Choset http://www.cs.cmu.edu.edu/~choset Introduction to Robotics http://generalrobotics.org What is vision? What is computer vision? Edge Detection Edge Detection Interest points

More information

Sampling Rate = Resolution Quantization Level = Color Depth = Bit Depth = Number of Colors

Sampling Rate = Resolution Quantization Level = Color Depth = Bit Depth = Number of Colors ITEC2110 FALL 2011 TEST 2 REVIEW Chapters 2-3: Images I. Concepts Graphics A. Bitmaps and Vector Representations Logical vs. Physical Pixels - Images are modeled internally as an array of pixel values

More information

CP-JKU SUBMISSIONS FOR DCASE-2016: A HYBRID APPROACH USING BINAURAL I-VECTORS AND DEEP CONVOLUTIONAL NEURAL NETWORKS

CP-JKU SUBMISSIONS FOR DCASE-2016: A HYBRID APPROACH USING BINAURAL I-VECTORS AND DEEP CONVOLUTIONAL NEURAL NETWORKS CP-JKU SUBMISSIONS FOR DCASE-2016: A HYBRID APPROACH USING BINAURAL I-VECTORS AND DEEP CONVOLUTIONAL NEURAL NETWORKS Hamid Eghbal-Zadeh Bernhard Lehner Matthias Dorfer Gerhard Widmer Department of Computational

More information

Efficient Diversity Technique for Hybrid Narrowband-Powerline/Wireless Smart Grid Communications

Efficient Diversity Technique for Hybrid Narrowband-Powerline/Wireless Smart Grid Communications Efficient Diversity Technique for Hybrid Narrowband-Powerline/Wireless Smart Grid Communications Mostafa Sayed, and Naofal Al-Dhahir University of Texas at Dallas Ghadi Sebaali, and Brian L. Evans, University

More information

Hot Electron Injection Field Effect Transistor

Hot Electron Injection Field Effect Transistor Hot Electron Injection Field Effect Transistor E. Kolmhofer, K. Luebke, H. Thim Microelectronics Institute, Johannes-Kepler-Universität, Altenbergerstraße 69, 44 Linz, Austria A new device geometry for

More information

Modeling and Synthesis of Aperture Effects in Cameras

Modeling and Synthesis of Aperture Effects in Cameras Modeling and Synthesis of Aperture Effects in Cameras Douglas Lanman, Ramesh Raskar, and Gabriel Taubin Computational Aesthetics 2008 20 June, 2008 1 Outline Introduction and Related Work Modeling Vignetting

More information

Dynamic Scene Deblurring Using Spatially Variant Recurrent Neural Networks

Dynamic Scene Deblurring Using Spatially Variant Recurrent Neural Networks Dynamic Scene Deblurring Using Spatially Variant Recurrent Neural Networks Jiawei Zhang 1,2 Jinshan Pan 3 Jimmy Ren 2 Yibing Song 4 Linchao Bao 4 Rynson W.H. Lau 1 Ming-Hsuan Yang 5 1 Department of Computer

More information

An evaluation of debayering algorithms on GPU for real-time panoramic video recording

An evaluation of debayering algorithms on GPU for real-time panoramic video recording An evaluation of debayering algorithms on GPU for real-time panoramic video recording Ragnar Langseth, Vamsidhar Reddy Gaddam, Håkon Kvale Stensland, Carsten Griwodz, Pål Halvorsen University of Oslo /

More information

multiframe visual-inertial blur estimation and removal for unmodified smartphones

multiframe visual-inertial blur estimation and removal for unmodified smartphones multiframe visual-inertial blur estimation and removal for unmodified smartphones, Severin Münger, Carlo Beltrame, Luc Humair WSCG 2015, Plzen, Czech Republic images taken by non-professional photographers

More information

Computational Sensors

Computational Sensors Computational Sensors Suren Jayasuriya Postdoctoral Fellow, The Robotics Institute, Carnegie Mellon University Class Announcements 1) Vote on this poll about project checkpoint date on Piazza: https://piazza.com/class/j6dobp76al46ao?cid=126

More information

Comp Computational Photography Spatially Varying White Balance. Megha Pandey. Sept. 16, 2008

Comp Computational Photography Spatially Varying White Balance. Megha Pandey. Sept. 16, 2008 Comp 790 - Computational Photography Spatially Varying White Balance Megha Pandey Sept. 16, 2008 Color Constancy Color Constancy interpretation of material colors independent of surrounding illumination.

More information

Measurement of Texture Loss for JPEG 2000 Compression Peter D. Burns and Don Williams* Burns Digital Imaging and *Image Science Associates

Measurement of Texture Loss for JPEG 2000 Compression Peter D. Burns and Don Williams* Burns Digital Imaging and *Image Science Associates Copyright SPIE Measurement of Texture Loss for JPEG Compression Peter D. Burns and Don Williams* Burns Digital Imaging and *Image Science Associates ABSTRACT The capture and retention of image detail are

More information

arxiv: v1 [physics.data-an] 3 Mar 2016

arxiv: v1 [physics.data-an] 3 Mar 2016 PHOTOGRAPHIC DATASET: RANDOM PEPPERCORNS TEEMU HELENIUS AND SAMULI SILTANEN July 2, 2018 arxiv:1603.01046v1 [physics.data-an] 3 Mar 2016 Abstract. This is a photographic dataset collected for testing image

More information

Compressive Wireless Pulse Sensing

Compressive Wireless Pulse Sensing Compressive Wireless Pulse Sensing CTS 205 Internet of Things Harvard University Kevin Chen Harnek Gulati HT Kung Surat Teerapittayanon Tracking reliable pulse waves for long term health diagnostics Motivation

More information

Image Processing & Projective geometry

Image Processing & Projective geometry Image Processing & Projective geometry Arunkumar Byravan Partial slides borrowed from Jianbo Shi & Steve Seitz Color spaces RGB Red, Green, Blue HSV Hue, Saturation, Value Why HSV? HSV separates luma,

More information

Random Coded Sampling for High-Speed HDR Video

Random Coded Sampling for High-Speed HDR Video Random Coded Sampling for High-Speed HDR Video Travis Portz Li Zhang Hongrui Jiang University of Wisconsin Madison http://pages.cs.wisc.edu/~lizhang/projects/hs-hdr/ Abstract We propose a novel method

More information

Coding & Signal Processing for Holographic Data Storage. Vijayakumar Bhagavatula

Coding & Signal Processing for Holographic Data Storage. Vijayakumar Bhagavatula Coding & Signal Processing for Holographic Data Storage Vijayakumar Bhagavatula Acknowledgements Venkatesh Vadde Mehmet Keskinoz Sheida Nabavi Lakshmi Ramamoorthy Kevin Curtis, Adrian Hill & Mark Ayres

More information

Continuously Variable Bandwidth Sharp FIR Filters with Low Complexity

Continuously Variable Bandwidth Sharp FIR Filters with Low Complexity Journal of Signal and Information Processing, 2012, 3, 308-315 http://dx.doi.org/10.4236/sip.2012.33040 Published Online August 2012 (http://www.scirp.org/ournal/sip) Continuously Variable Bandwidth Sharp

More information

Snapshot Hyperspectral Light Field Imaging

Snapshot Hyperspectral Light Field Imaging Snapshot Hyperspectral Light Field Imaging Zhiwei Xiong 1 Lizhi Wang 2 Huiqun Li 1 Dong Liu 1 Feng Wu 1 1 University of Science and Technology of China 2 Beijing Institute of Technology Abstract This paper

More information

LWIR NUC Using an Uncooled Microbolometer Camera

LWIR NUC Using an Uncooled Microbolometer Camera LWIR NUC Using an Uncooled Microbolometer Camera Joe LaVeigne a, Greg Franks a, Kevin Sparkman a, Marcus Prewarski a, Brian Nehring a, Steve McHugh a a Santa Barbara Infrared, Inc., 30 S. Calle Cesar Chavez,

More information

High Dynamic Range Imaging

High Dynamic Range Imaging High Dynamic Range Imaging IMAGE BASED RENDERING, PART 1 Mihai Aldén mihal915@student.liu.se Fredrik Salomonsson fresa516@student.liu.se Tuesday 7th September, 2010 Abstract This report describes the implementation

More information

Compressive Imaging. Aswin Sankaranarayanan (Computational Photography Fall 2017)

Compressive Imaging. Aswin Sankaranarayanan (Computational Photography Fall 2017) Compressive Imaging Aswin Sankaranarayanan (Computational Photography Fall 2017) Traditional Models for Sensing Linear (for the most part) Take as many measurements as unknowns sample Traditional Models

More information

Compressive Through-focus Imaging

Compressive Through-focus Imaging PIERS ONLINE, VOL. 6, NO. 8, 788 Compressive Through-focus Imaging Oren Mangoubi and Edwin A. Marengo Yale University, USA Northeastern University, USA Abstract Optical sensing and imaging applications

More information

Double resolution from a set of aliased images

Double resolution from a set of aliased images Double resolution from a set of aliased images Patrick Vandewalle 1,SabineSüsstrunk 1 and Martin Vetterli 1,2 1 LCAV - School of Computer and Communication Sciences Ecole Polytechnique Fédérale delausanne(epfl)

More information

Thermal Image Enhancement Using Convolutional Neural Network

Thermal Image Enhancement Using Convolutional Neural Network SEOUL Oct.7, 2016 Thermal Image Enhancement Using Convolutional Neural Network Visual Perception for Autonomous Driving During Day and Night Yukyung Choi Soonmin Hwang Namil Kim Jongchan Park In So Kweon

More information

Multispectral Image Dense Matching

Multispectral Image Dense Matching Multispectral Image Dense Matching Xiaoyong Shen Li Xu Qi Zhang Jiaya Jia The Chinese University of Hong Kong Image & Visual Computing Lab, Lenovo R&T 1 Multispectral Dense Matching Dataset We build a

More information

Learning Sensor Multiplexing Design through Back-propagation

Learning Sensor Multiplexing Design through Back-propagation Learning Sensor Multiplexing Design through Back-propagation Ayan Chakrabarti Toyota Technological Institute at Chicago 6045 S. Kenwood Ave., Chicago, IL ayanc@ttic.edu Abstract Recent progress on many

More information

1. Describe how a graphic would be stored in memory using a bit-mapped graphics package.

1. Describe how a graphic would be stored in memory using a bit-mapped graphics package. HIGHER COMPUTING COMPUTER SYSTEMS DATA REPRESENTATION GRAPHICS SUCCESS CRITERIA I can describe the bit map method of graphic representation using examples of colour or greyscale bit maps. I can describe

More information

A Novel Differential Microstrip Patch Antenna and Array at 79 GHz #Z. Tong 1, A. Stelzer 1,2, C. Wagner 2, R. Feger 2, E.

A Novel Differential Microstrip Patch Antenna and Array at 79 GHz #Z. Tong 1, A. Stelzer 1,2, C. Wagner 2, R. Feger 2, E. A Novel Differential Microstrip Patch Antenna and Array at 79 GHz #Z. Tong 1, A. Stelzer 1,2, C. Wagner 2, R. Feger 2, E. Kolmhofer 3 1 Institute for Communications & Information Engineering, Johannes

More information

Create a 3D Model from Photos with Free and Open Source Software (FOSS)

Create a 3D Model from Photos with Free and Open Source Software (FOSS) Create a 3D Model from Photos with Free and Open Source Software (FOSS) [Regard3D to MeshLab to Sketchfab] Hafizur Rahaman UNESCO Research Fellow School of Media, culture and Creative Arts Curtin University,

More information

Space-Time-Brightness Sampling Using an Adaptive Pixel-Wise Coded Exposure

Space-Time-Brightness Sampling Using an Adaptive Pixel-Wise Coded Exposure Space-Time-Brightness Sampling Using an Adaptive Pixel-Wise Coded Exposure Hajime Nagahara Osaka University 2-8, Yamadaoka, Suita, Osaka, Japan nagahara@ids.osaka-u.ac.jp Dengyu Liu Intel Corporation 2200

More information

Short-course Compressive Sensing of Videos

Short-course Compressive Sensing of Videos Short-course Compressive Sensing of Videos Venue CVPR 2012, Providence, RI, USA June 16, 2012 Richard G. Baraniuk Mohit Gupta Aswin C. Sankaranarayanan Ashok Veeraraghavan Tutorial Outline Time Presenter

More information

Coding and Modulation in Cameras

Coding and Modulation in Cameras Coding and Modulation in Cameras Amit Agrawal June 2010 Mitsubishi Electric Research Labs (MERL) Cambridge, MA, USA Coded Computational Imaging Agrawal, Veeraraghavan, Narasimhan & Mohan Schedule Introduction

More information

Components for virtual environments Michael Haller, Roland Holm, Markus Priglinger, Jens Volkert, and Roland Wagner Johannes Kepler University of Linz

Components for virtual environments Michael Haller, Roland Holm, Markus Priglinger, Jens Volkert, and Roland Wagner Johannes Kepler University of Linz Components for virtual environments Michael Haller, Roland Holm, Markus Priglinger, Jens Volkert, and Roland Wagner Johannes Kepler University of Linz Altenbergerstr 69 A-4040 Linz (AUSTRIA) [mhallerjrwagner]@f

More information

Audio Imputation Using the Non-negative Hidden Markov Model

Audio Imputation Using the Non-negative Hidden Markov Model Audio Imputation Using the Non-negative Hidden Markov Model Jinyu Han 1,, Gautham J. Mysore 2, and Bryan Pardo 1 1 EECS Department, Northwestern University 2 Advanced Technology Labs, Adobe Systems Inc.

More information

DodgeCmd Image Dodging Algorithm A Technical White Paper

DodgeCmd Image Dodging Algorithm A Technical White Paper DodgeCmd Image Dodging Algorithm A Technical White Paper July 2008 Intergraph ZI Imaging 170 Graphics Drive Madison, AL 35758 USA www.intergraph.com Table of Contents ABSTRACT...1 1. INTRODUCTION...2 2.

More information

image Scanner, digital camera, media, brushes,

image Scanner, digital camera, media, brushes, 118 Also known as rasterr graphics Record a value for every pixel in the image Often created from an external source Scanner, digital camera, Painting P i programs allow direct creation of images with

More information

Lecture 5: Sinusoidal Modeling

Lecture 5: Sinusoidal Modeling ELEN E4896 MUSIC SIGNAL PROCESSING Lecture 5: Sinusoidal Modeling 1. Sinusoidal Modeling 2. Sinusoidal Analysis 3. Sinusoidal Synthesis & Modification 4. Noise Residual Dan Ellis Dept. Electrical Engineering,

More information

VQ Source Models: Perceptual & Phase Issues

VQ Source Models: Perceptual & Phase Issues VQ Source Models: Perceptual & Phase Issues Dan Ellis & Ron Weiss Laboratory for Recognition and Organization of Speech and Audio Dept. Electrical Eng., Columbia Univ., NY USA {dpwe,ronw}@ee.columbia.edu

More information

ESE 531: Digital Signal Processing

ESE 531: Digital Signal Processing ESE 531: Digital Signal Processing Lec 10: February 15th, 2018 Practical and Non-integer Sampling, Multirate Sampling Signals and Systems Review 3 Lecture Outline! Review: Downsampling/Upsampling! Non-integer

More information

High Fidelity 3D Reconstruction

High Fidelity 3D Reconstruction High Fidelity 3D Reconstruction Adnan Ansar, California Institute of Technology KISS Workshop: Gazing at the Solar System June 17, 2014 Copyright 2014 California Institute of Technology. U.S. Government

More information

Project Title: Sparse Image Reconstruction with Trainable Image priors

Project Title: Sparse Image Reconstruction with Trainable Image priors Project Title: Sparse Image Reconstruction with Trainable Image priors Project Supervisor(s) and affiliation(s): Stamatis Lefkimmiatis, Skolkovo Institute of Science and Technology (Email: s.lefkimmiatis@skoltech.ru)

More information

Computational Approaches to Cameras

Computational Approaches to Cameras Computational Approaches to Cameras 11/16/17 Magritte, The False Mirror (1935) Computational Photography Derek Hoiem, University of Illinois Announcements Final project proposal due Monday (see links on

More information

Project 4 Results http://www.cs.brown.edu/courses/cs129/results/proj4/jcmace/ http://www.cs.brown.edu/courses/cs129/results/proj4/damoreno/ http://www.cs.brown.edu/courses/csci1290/results/proj4/huag/

More information

Image Scaling. This image is too big to fit on the screen. How can we reduce it? How to generate a halfsized

Image Scaling. This image is too big to fit on the screen. How can we reduce it? How to generate a halfsized Resampling Image Scaling This image is too big to fit on the screen. How can we reduce it? How to generate a halfsized version? Image sub-sampling 1/8 1/4 Throw away every other row and column to create

More information

Reverse Engineering the Human Vision System

Reverse Engineering the Human Vision System Reverse Engineering the Human Vision System Reverse Engineering the Human Vision System Biologically Inspired Computer Vision Approaches Maria Petrou Imperial College London Overview of the Human Visual

More information

Convolution Pyramids. Zeev Farbman, Raanan Fattal and Dani Lischinski SIGGRAPH Asia Conference (2011) Julian Steil. Prof. Dr.

Convolution Pyramids. Zeev Farbman, Raanan Fattal and Dani Lischinski SIGGRAPH Asia Conference (2011) Julian Steil. Prof. Dr. Zeev Farbman, Raanan Fattal and Dani Lischinski SIGGRAPH Asia Conference (2011) presented by: Julian Steil supervisor: Prof. Dr. Joachim Weickert Fig. 1.1: Gradient integration example Seminar - Milestones

More information

Color Imaging Conference 16, Portland OR 11/14/2008

Color Imaging Conference 16, Portland OR 11/14/2008 Overview, contrast and the perception of visual metadata Maureen Stone and Lyn Bartram StoneSoup Consulting, Woodinville, WA School of Interactive Art and Technology (SIAT) Simon Fraser University, Surrey

More information

Creating Intelligence at the Edge

Creating Intelligence at the Edge Creating Intelligence at the Edge Vladimir Stojanović E3S Retreat September 8, 2017 The growing importance of machine learning Page 2 Applications exploding in the cloud Huge interest to move to the edge

More information

Sampling and Pyramids

Sampling and Pyramids Sampling and Pyramids 15-463: Rendering and Image Processing Alexei Efros with lots of slides from Steve Seitz Today Sampling Nyquist Rate Antialiasing Gaussian and Laplacian Pyramids 1 Fourier transform

More information

Supplementary Material of

Supplementary Material of Supplementary Material of Efficient and Robust Color Consistency for Community Photo Collections Jaesik Park Intel Labs Yu-Wing Tai SenseTime Sudipta N. Sinha Microsoft Research In So Kweon KAIST In the

More information

16nm with 193nm Immersion Lithography and Double Exposure

16nm with 193nm Immersion Lithography and Double Exposure 16nm with 193nm Immersion Lithography and Double Exposure Valery Axelrad, Sequoia Design Systems, Inc. (United States) Michael C. Smayling, Tela Innovations, Inc. (United States) ABSTRACT Gridded Design

More information

RF Radar Systems. C. G. Diskus 1, A. Stelzer 2. Altenberger Straße 69, 4040 Linz, Austria

RF Radar Systems. C. G. Diskus 1, A. Stelzer 2. Altenberger Straße 69, 4040 Linz, Austria RF Radar Systems C. G. Diskus 1, A. Stelzer 2 1 Microelectronics Institute, Johannes Kepler University, Altenberger Straße 69, 4040 Linz, Austria 2 Institute for Communications and Information Engineering

More information

Course Overview. Dr. Edmund Lam. Department of Electrical and Electronic Engineering The University of Hong Kong

Course Overview. Dr. Edmund Lam. Department of Electrical and Electronic Engineering The University of Hong Kong Course Dr. Edmund Lam Department of Electrical and Electronic Engineering The University of Hong Kong ELEC8601: Advanced Topics in Image Processing (Second Semester, 2013 14) http://www.eee.hku.hk/ work8601

More information

Performance Evaluation of H.264 AVC Using CABAC Entropy Coding For Image Compression

Performance Evaluation of H.264 AVC Using CABAC Entropy Coding For Image Compression Conference on Advances in Communication and Control Systems 2013 (CAC2S 2013) Performance Evaluation of H.264 AVC Using CABAC Entropy Coding For Image Compression Mr.P.S.Jagadeesh Kumar Associate Professor,

More information

CS448f: Image Processing For Photography and Vision. Fast Filtering Continued

CS448f: Image Processing For Photography and Vision. Fast Filtering Continued CS448f: Image Processing For Photography and Vision Fast Filtering Continued Filtering by Resampling This looks like we just zoomed a small image Can we filter by downsampling then upsampling? Filtering

More information

High Resolution Spectral Video Capture & Computational Photography Xun Cao ( 曹汛 )

High Resolution Spectral Video Capture & Computational Photography Xun Cao ( 曹汛 ) High Resolution Spectral Video Capture & Computational Photography Xun Cao ( 曹汛 ) School of Electronic Science & Engineering Nanjing University caoxun@nju.edu.cn Dec 30th, 2015 Computational Photography

More information

A survey of Super resolution Techniques

A survey of Super resolution Techniques A survey of resolution Techniques Krupali Ramavat 1, Prof. Mahasweta Joshi 2, Prof. Prashant B. Swadas 3 1. P. G. Student, Dept. of Computer Engineering, Birla Vishwakarma Mahavidyalaya, Gujarat,India

More information

Learning Pixel-Distribution Prior with Wider Convolution for Image Denoising

Learning Pixel-Distribution Prior with Wider Convolution for Image Denoising Learning Pixel-Distribution Prior with Wider Convolution for Image Denoising Peng Liu University of Florida pliu1@ufl.edu Ruogu Fang University of Florida ruogu.fang@bme.ufl.edu arxiv:177.9135v1 [cs.cv]

More information

Light-Field Microscopy: A Review

Light-Field Microscopy: A Review (2019) 4(1): 1-6 www.jneurology.com Neuromedicine www.jneurology.com Review Article Open Access Light-Field Microscopy: A Review Oliver Bimber* and David C. Schedl Faculty of Engineering and Natural Sciences,

More information

Research on Hand Gesture Recognition Using Convolutional Neural Network

Research on Hand Gesture Recognition Using Convolutional Neural Network Research on Hand Gesture Recognition Using Convolutional Neural Network Tian Zhaoyang a, Cheng Lee Lung b a Department of Electronic Engineering, City University of Hong Kong, Hong Kong, China E-mail address:

More information

Depth Estimation Algorithm for Color Coded Aperture Camera

Depth Estimation Algorithm for Color Coded Aperture Camera Depth Estimation Algorithm for Color Coded Aperture Camera Ivan Panchenko, Vladimir Paramonov and Victor Bucha; Samsung R&D Institute Russia; Moscow, Russia Abstract In this paper we present an algorithm

More information

Aliasing and Antialiasing. What is Aliasing? What is Aliasing? What is Aliasing?

Aliasing and Antialiasing. What is Aliasing? What is Aliasing? What is Aliasing? What is Aliasing? Errors and Artifacts arising during rendering, due to the conversion from a continuously defined illumination field to a discrete raster grid of pixels 1 2 What is Aliasing? What is Aliasing?

More information

arxiv: v1 [cs.cv] 24 Nov 2017

arxiv: v1 [cs.cv] 24 Nov 2017 End-to-End Deep HDR Imaging with Large Foreground Motions Shangzhe Wu Jiarui Xu Yu-Wing Tai Chi-Keung Tang Hong Kong University of Science and Technology Tencent Youtu arxiv:1711.08937v1 [cs.cv] 24 Nov

More information

Antialiasing and Related Issues

Antialiasing and Related Issues Antialiasing and Related Issues OUTLINE: Antialiasing Prefiltering, Supersampling, Stochastic Sampling Rastering and Reconstruction Gamma Correction Antialiasing Methods To reduce aliasing, either: 1.

More information

Image Based Subpixel Techniques for Movement and Vibration Tracking

Image Based Subpixel Techniques for Movement and Vibration Tracking 11th European Conference on Non-Destructive Testing (ECNDT 2014), October 6-10, 2014, Prague, Czech Republic Image Based Subpixel Techniques for Movement and Vibration Tracking More Info at Open Access

More information

Computational Efficiency of the GF and the RMF Transforms for Quaternary Logic Functions on CPUs and GPUs

Computational Efficiency of the GF and the RMF Transforms for Quaternary Logic Functions on CPUs and GPUs 5 th International Conference on Logic and Application LAP 2016 Dubrovnik, Croatia, September 19-23, 2016 Computational Efficiency of the GF and the RMF Transforms for Quaternary Logic Functions on CPUs

More information

General MIMO Framework for Multipath Exploitation in Through-the-Wall Radar Imaging

General MIMO Framework for Multipath Exploitation in Through-the-Wall Radar Imaging General MIMO Framework for Multipath Exploitation in Through-the-Wall Radar Imaging Michael Leigsnering, Technische Universität Darmstadt Fauzia Ahmad, Villanova University Moeness G. Amin, Villanova University

More information

Blind Single-Image Super Resolution Reconstruction with Defocus Blur

Blind Single-Image Super Resolution Reconstruction with Defocus Blur Sensors & Transducers 2014 by IFSA Publishing, S. L. http://www.sensorsportal.com Blind Single-Image Super Resolution Reconstruction with Defocus Blur Fengqing Qin, Lihong Zhu, Lilan Cao, Wanan Yang Institute

More information

Dual-fisheye Lens Stitching for 360-degree Imaging & Video. Tuan Ho, PhD. Student Electrical Engineering Dept., UT Arlington

Dual-fisheye Lens Stitching for 360-degree Imaging & Video. Tuan Ho, PhD. Student Electrical Engineering Dept., UT Arlington Dual-fisheye Lens Stitching for 360-degree Imaging & Video Tuan Ho, PhD. Student Electrical Engineering Dept., UT Arlington Introduction 360-degree imaging: the process of taking multiple photographs and

More information

Chapter IV THEORY OF CELP CODING

Chapter IV THEORY OF CELP CODING Chapter IV THEORY OF CELP CODING CHAPTER IV THEORY OF CELP CODING 4.1 Introduction Wavefonn coders fail to produce high quality speech at bit rate lower than 16 kbps. Source coders, such as LPC vocoders,

More information

Ben Baker. Sponsored by:

Ben Baker. Sponsored by: Ben Baker Sponsored by: Background Agenda GPU Computing Digital Image Processing at FamilySearch Potential GPU based solutions Performance Testing Results Conclusions and Future Work 2 CPU vs. GPU Architecture

More information

Constrained Channel Estimation Methods in Underwater Acoustics

Constrained Channel Estimation Methods in Underwater Acoustics University of Iowa Honors Theses University of Iowa Honors Program Spring 2017 Constrained Channel Estimation Methods in Underwater Acoustics Emma Hawk Follow this and additional works at: http://ir.uiowa.edu/honors_theses

More information

Infocommunication. Sampling, Quantization. - Bálint TÓTH, BME TMIT -

Infocommunication. Sampling, Quantization. - Bálint TÓTH, BME TMIT - Infocommunication Sampling, Quantization - Bálint TÓTH, BME TMIT - Overview PPT is for demonstration, not for learning! Analog signals problem: noise, distortion Digital signals what are the benefits?

More information

Technical Specifications: tog VR

Technical Specifications: tog VR s: BILLBOARDING ENCODED HEADS FULL FREEDOM AUGMENTED REALITY : Real-time 3d virtual reality sets from RT Software Virtual reality sets are increasingly being used to enhance the audience experience and

More information

Computational Photography

Computational Photography Computational photography Computational Photography Digital Visual Effects Yung-Yu Chuang wikipedia: Computational photography h refers broadly to computational imaging techniques that enhance or extend

More information

Analysis and Synthesis of Texture

Analysis and Synthesis of Texture Analysis and Synthesis of Texture CMPE 264: Image Analysis and Computer Vision Hai Tao Extracting image structure by filter banks Represent image textures using the responses of a collection of filters

More information

Pairwise Optimization of Modulation Constellations for Non-Uniform Sources

Pairwise Optimization of Modulation Constellations for Non-Uniform Sources Pairwise Optimization of Modulation Constellations for Non-Uniform Sources by Brendan F.D. Moore A thesis submitted to the Department of Mathematics and Statistics in conformity with the requirements for

More information

Blind Correction of Optical Aberrations

Blind Correction of Optical Aberrations Blind Correction of Optical Aberrations Christian J. Schuler, Michael Hirsch, Stefan Harmeling, and Bernhard Schölkopf Max Planck Institute for Intelligent Systems, Tübingen, Germany {cschuler,mhirsch,harmeling,bs}@tuebingen.mpg.de

More information

신경망기반자동번역기술. Konkuk University Computational Intelligence Lab. 김강일

신경망기반자동번역기술. Konkuk University Computational Intelligence Lab.  김강일 신경망기반자동번역기술 Konkuk University Computational Intelligence Lab. http://ci.konkuk.ac.kr kikim01@kunkuk.ac.kr 김강일 Index Issues in AI and Deep Learning Overview of Machine Translation Advanced Techniques in

More information

PARALLEL ALGORITHMS FOR HISTOGRAM-BASED IMAGE REGISTRATION. Benjamin Guthier, Stephan Kopf, Matthias Wichtlhuber, Wolfgang Effelsberg

PARALLEL ALGORITHMS FOR HISTOGRAM-BASED IMAGE REGISTRATION. Benjamin Guthier, Stephan Kopf, Matthias Wichtlhuber, Wolfgang Effelsberg This is a preliminary version of an article published by Benjamin Guthier, Stephan Kopf, Matthias Wichtlhuber, and Wolfgang Effelsberg. Parallel algorithms for histogram-based image registration. Proc.

More information

A Single Image Haze Removal Algorithm Using Color Attenuation Prior

A Single Image Haze Removal Algorithm Using Color Attenuation Prior International Journal of Scientific and Research Publications, Volume 6, Issue 6, June 2016 291 A Single Image Haze Removal Algorithm Using Color Attenuation Prior Manjunath.V *, Revanasiddappa Phatate

More information