IEEE 3D Human Factor WG & P June 3, Chair: Sanghoon Lee

Transcription

1 IEEE 3D Human Factor WG & P June 3, 2014 Chair: Sanghoon Lee

2 3D Human Factor Working Group 2

3 Working Group History IEEE-SA PAR submission: Feb. 18, 2011 IEEE-SA CAG approval: Mar. 7 8, 2011 IEEE-SASB approval: Mar , 2011 WG call for participation: May. 27, 2011 Type of ballot : Entity Individual Previous Entity members: LG Electronics, Korea Telecom (KT), Korea Electronics Association (KEA), Huawei, Mitsubishi Electronic, Electronics and Telecommunications Research Institute (ETRI) Current individual members: 17 nations and 54 members 3

4 Working Group Members Rosters: 17 nations and 54 members Name Nation Affiliation Maria G. Martini Patrick Le Callet England France Kingston University London Polytech'Nantes Université An Ping China Shanghai University Ricky Christanto Taiwan Chung Yuan University Min Zhang Japan Kyoto University Aldo Badano USA FDA Phillippe Hanhart Swithland EPEL University Ettore Giannuzzi Italy Sysvel Technology Brian FG Katz France LIMSI-CNRS Manoranjan Paul Sumohana Channappayya Sarang Thombre Australia India Finland Charles Sturt University Indian Institute of Technology Tampere University of Technology Name Nation Affiliation Şerban-Nicolae MEZA Zoran Ivanovski Diane Tang Hsun-Hsien Chang Romania Macedonia USA USA Technical Univ. of Cluj-Napoca University Ss Cyril and Methodius Johns Hopkins University Harvard University and MIT Andrew Woods Australia Curtin University Ahmad Tajuddin Samsudin Peshala Pahalawatta Malaysia USA TMR&D (Company) Dynamic Digital Depth (company) Andrea de Polo Italy Alinari (Company) Salah Al-Majeed Tasos Dagiuklas Chaker LARABI Kazakhstan Greece France Nazarbayev University Hellenic Open University Université de Poitiers

5 Working Group History PAR Request new PAR: Jan. 25 th, 2013 Approved new PAR: Mar. 6 th, 2013 Type of Ballot : Entity Individual Previous Title: Standard for the Quality Assessment of Three Dimensional (3D) Displays, 3D Contents and 3D Devices based on Human Factors Title: Standard for the Quality Assessment of Three Dimensional (3D) Contents based on Psychophysical Studies Request new PAR: Nov. 06th, 2013 Approved new and revised PAR: Mar. 27th, 2014 Scope separation: P & P

6 Scope Separation of P P Standard for the Quality of Experience (QoE) and Visual Comfort Assessments of Three Dimensional (3D) Contents based on Psychophysical Studies Visual saliency prediction method Visual contents analysis method Spatial characteristics of 3D contents Temporal characteristics of 3D contents Subjective assessment method Continuous assessment methodology Paired comparison methodology P Standard for the Perceptual Quality Assessment of Three Dimensional (3D) Contents based on Physiological Mechanisms Saliency variation according to the 3D distortions Quality assessment based on stereopsis, binocular rivalry and suppression 6

7 Liaison & Collaboration for P IEEE-SA P Real-Time Mobile Video Communications Study Group Collaboration Quality of Experience (QoE)-human visual perception based QoE metrics Network-adaptive video encoding and decoding algorithms Real-time feedback control mechanisms for end-to-end video QoE IEEE-SA P3333 and ISO/IEC JTC 1/SC 29/WG 11 - (Nov. 7) Establishment of Category C Liaison Video Quality Expert Group (VQEG): Nov. 11, 2011 ISO-TC 159 WG12 3D Quality Assessment ITU-T SG9 Subjective assessment methods for 3D video quality 7

8 Patent Issues Patten Issue optional selection from the two conditions RAND (Reasonable and Non-discriminatory) MPEG, 802.series, LTE Royalty-Free most standards, and patent on the subsidiary apparatus, submit LOA for the declaration of royalty-free 8

9 Meeting history for P (C/SAB/3DHF_WG) No. Date Place Main items <Entity-based Project> 1 st June 14, nd Sep. 6, rd Dec. 19, 2011 Seoul (Palace hotel) Call for participation, Liaison, IEEE Sponsorship computer society, Pattern issue 4 th April 10, 2012 Seoul Stereo image database 5 th July 27, 2012 Daejeon (ETRI) Stereo video database 6 th Oct. 10, 2012 Goyang (Kintex) 7 th Jan. 11, 2013 Seoul (Siliconfile) <Individual-based Project> Subjective assessment methodology (MICSQ) 8 th April 4, 2013 Seoul (MasterImage3D) Stereo image database 9 th June 11, 2013 Seoul (Yonsei university) Objective visual discomfort model evaluation (visual discomfort) 10 th Oct. 1, 2013 Seoul (KEA) Stereo image analysis 11 th Dec. 17, 2013 Seoul Stereo video analysis, PAR separation 12 th April 16, 2014 (KT office building) Overview of 3D perceptual quality assessment (P ) 9

10 Roadmap (C/SAB/P3333.1_WG) Mar Jun Sep Dec Mar Jun Sep Dec Mar Jun Sep Dec P Subjective 3D test methodolog y Mod. PAR WD v1.0 3D Discomfort Assessment of Stereo Images 3D Discomfort Assessment of Stereo Videos CfP WD v2.0 Objective Visual Discomfort Model Evaluation using IEEE-SA Stereo Image Database (Visual Discomfort) CfP CfP WD v3.0 Objective Visual Discomfort Model Evaluation using IEEE-SA Stereo Video Database I (Visual Discomfort) SB AP MT P D Perceptual Quality Assessment PAR WD v1.0 WD v2.0 CfP CfP 10 CfP Objective Perceptual Quality Model Evaluation Using IEEE-SA Stereo Video Database II (Perceptual Distortion) SB AP * WD : Working Draft SB : Sponsor Ballot Request AP : IEEE-SASB(RevCom) Approval MT : Standards Maintenance CfP : Call for Proposal

11 Working draft of P P /D1 Draft Standard for Quality of Experience (QoE) and Visual Comfort Assessments of Three Dimensional (3D) Contents based on Psychophysical Studies 11

12 Major Revision of Working Draft Considerations Human Visual System Visual Contents Analysis Subjective Assessment Methodology Ergonomic Requirements and Recommendations Human Visual System Visual Contents Analysis Subjective Assessment Methodology Conformance Human Visual System Visual Contents Analysis Subjective Assessment Methodology Ergonomic Requirements and Recommendations Visual Saliency Detection Visual Contents Analysis Subjective Assessment Methodology Visual Saliency Prediction Method Human Visual System Visual Saliency Prediction Visual Contents Analysis Method Human Visual System Spatial Characteristic of 3D Temporal Characteristic of 3D Subjective Assessment Methodology Display Device Continuous Assessment Methodology Paired Comparison Methodology

13 Contents Visual saliency prediction method General Human visual system Saliency prediction method Visual contents analysis method General Human visual system Spatial characteristics of 3D contents Temporal characteristics of 3D contents Subjective assessment method General Display device for subjective assessment Continuous assessment methodology Paired comparison methodology 13

14 Minor Revision of Working Draft Minor comments IEEE P > IEEE P Definitions 3.1 Definitions Abbreviations and acronyms New keywords related to HVS foveation, accommodation and vergence conflict Color figures -> Black and White figures Format modification Equations Usage of the verbs shall should / may /can -> shall Add or modify references 14

15 Visual Saliency Prediction Method Saliency region detection on stereoscopic videos Original Sequence car_2 Eye-Tracker Result Saliency Detection Original Sequence University_2 Eye-Tracker Result Saliency Detection 15

16 Visual Contents Analysis Method Spatial characteristics of 3D contents 16

17 Visual Contents Analysis Method Temporal characteristics of 3D contents High complexity or variation of disparity and motion Difficult to simultaneously percept (fuse) the depth Increased neural metabolic rates Visual discomfort For example, Low Spatiotemporal Complexity High Spatiotemporal Complexity 17

18 Subjective Assessment Method Multimodal Interactive Continuous Scoring of Quality (MICSQ) 18

19 3D Video Database Construction Shooting Equipment Rig-based Video Camera Half-mirror method Sony HDCP1 Rig: Redrover RD500 Lens: Fujinon f1.8, 9-144mm 19

20 3D Video Database Construction Database Server Please click on the Stereoscopic (3- D imaging) Database link. 20

21 3D Video Database Construction Examples of 3D Database Library_computer Indoor scene No salient object with forward camera motion High depth motion / Middle depth distribution Length of sequence : 10 sec. Left 21 Right

22 Overview of P Standard for the Perceptual Quality Assessment of Three Dimensional (3D) Contents based on Physiological Mechanisms 22

23 3D Perceptual Quality Assessment Research Topics of 3D QA 3D human perception Original multi-view Encoding Transmission View synthesis Assess various types of 3D distortion Consider 3D human visual system 3D visual attention, stereopsis, binocular rivalry and suppression, binocular fusion... Relation with visual discomfort 23

24 Thank you 24