ECE 4400:693 - Information Theory

Size: px
Start display at page:

Download "ECE 4400:693 - Information Theory"

Transcription

1 ECE 4400:693 - Information Theory Dr. Nghi Tran Lecture 1: Introduction & Overview Dr. Nghi Tran (ECE-University of Akron) ECE 4400:693 Information Theory 1 / 26

2 Outline 1 Course Information 2 Course Overview 3 Topics Covered 4 Research Project Dr. Nghi Tran (ECE-University of Akron) ECE 4400:693 Information Theory 2 / 26

3 Outline 1 Course Information 2 Course Overview 3 Topics Covered 4 Research Project Dr. Nghi Tran (ECE-University of Akron) ECE 4400:693 Information Theory 2 / 26

4 Outline 1 Course Information 2 Course Overview 3 Topics Covered 4 Research Project Dr. Nghi Tran (ECE-University of Akron) ECE 4400:693 Information Theory 2 / 26

5 Outline 1 Course Information 2 Course Overview 3 Topics Covered 4 Research Project Dr. Nghi Tran (ECE-University of Akron) ECE 4400:693 Information Theory 2 / 26

6 Outline Course Information 1 Course Information 2 Course Overview 3 Topics Covered 4 Research Project Dr. Nghi Tran (ECE-University of Akron) ECE 4400:693 Information Theory 3 / 26

7 Administrivia Course Information Hours and Location Lectures TuTh 9:30-10:45 ASEC 511 (North Tower) Course Webpage: Instructor Information Name: Dr. Nghi Tran Office: ASEC 352 Phone: x Webpage: Office Hours TuF 10:45-11:45 and (or) by appointment. Teaching Assistant: N/A Dr. Nghi Tran (ECE-University of Akron) ECE 4400:693 Information Theory 4 / 26

8 Course Information Logistics References: Though not required, the following references are highly recommended T. Cover and J. Thomas, Elements of Information Theory, Second Edition, John Wiley & Sons, Inc., D. Tse and P. Viswanath, Fundamentals of Wireless Communication, Cambridge University Press, 2005 Homework: Bi-weekly, with in total of 6 or 7 Research Project: In-depth study, or original research topic Assessment: 30% Homework, 25% Project, and 45% Final Exam Final Exam: Open-book Dr. Nghi Tran (ECE-University of Akron) ECE 4400:693 Information Theory 5 / 26

9 Outline Course Overview 1 Course Information 2 Course Overview 3 Topics Covered 4 Research Project Dr. Nghi Tran (ECE-University of Akron) ECE 4400:693 Information Theory 6 / 26

10 Course Overview What is Information Theory? Dr. Nghi Tran (ECE-University of Akron) ECE 4400:693 Information Theory 7 / 26

11 Course Overview What is Communication? The fundamental problem of communication is that of reproducing at one point either exactly or approximately a message selected at another point. (Claude Shannon 1948) Dr. Nghi Tran (ECE-University of Akron) ECE 4400:693 Information Theory 8 / 26

12 Course Overview Communication System Dr. Nghi Tran (ECE-University of Akron) ECE 4400:693 Information Theory 9 / 26

13 Course Overview Encoder: Source Coding Source Coding is the process of compressing the data using fewer bits to remove redundancy. Shannon s source coding theorem establishes the limits to possible data compression: Entropy. Dr. Nghi Tran (ECE-University of Akron) ECE 4400:693 Information Theory 10 / 26

14 Course Overview Encoder: Channel Coding Channel coding adds controlled redundancy to protect against channel errors. The Shannon limit or Shannon capacity of a communications channel is the theoretical maximum information transfer rate of the channel, for a particular noise level. Dr. Nghi Tran (ECE-University of Akron) ECE 4400:693 Information Theory 11 / 26

15 Course Overview Decoder Channel decoding: Decode signals, detect/correct errors. Source decoding: Decompress and restore source. Dr. Nghi Tran (ECE-University of Akron) ECE 4400:693 Information Theory 12 / 26

16 Channel Definition Course Overview X p( X/ Y) Y A communication channel is a system in which the output Y depends probabilistically on its input X: Probabilistic relationship between input and output The channel is characterized by a probability transition p(y/x) Dr. Nghi Tran (ECE-University of Akron) ECE 4400:693 Information Theory 13 / 26

17 Course Overview Channel Examples Noiseless binary channel: Input is reproduced exactly at output Binary symmetric channel: Cross probability p 1 p 0 0 p p p Gaussian channel with Gaussian noise N: Y = X + N Dr. Nghi Tran (ECE-University of Akron) ECE 4400:693 Information Theory 14 / 26

18 Course Overview Information Theory Claude E. Shannon, A Mathematical Theory of Communication. Bell System Technical Journal, 27, & , A new filed of Information Theory was developed in 1948, motivated by Fundamental Limits in Communication Theory What are these limits? Dr. Nghi Tran (ECE-University of Akron) ECE 4400:693 Information Theory 15 / 26

19 Course Overview Information Theory Motivated by Communication Theory, Information Theory addresses two fundamental questions: Source Coding: Is there a limit to how much data can be compressed? The answer is Entropy Channel Coding: Over a noisy channel, what is the minimum redundancy rate required to achieve a reliable communication, e.g.,the bit error probability can be made as low as desired? The answer is Channel Capacity Dr. Nghi Tran (ECE-University of Akron) ECE 4400:693 Information Theory 16 / 26

20 Course Overview Information Theory Motivated by Communication Theory, Information Theory addresses two fundamental questions: Source Coding: Is there a limit to how much data can be compressed? The answer is Entropy Channel Coding: Over a noisy channel, what is the minimum redundancy rate required to achieve a reliable communication, e.g.,the bit error probability can be made as low as desired? The answer is Channel Capacity Dr. Nghi Tran (ECE-University of Akron) ECE 4400:693 Information Theory 16 / 26

21 Course Overview Two Main Topics in Information Theory Main Topic 1 - Source Coding: How can we reduce the bit rate at the output of source encoding? What is the minimum bit rate required to recover the data at the receiver for two cases: 1) Distortion is NOT allowed; 2) distortion is allowed Main Topic 2: Channel Coding and Capacity How can we reduce the bit error probability by intelligently adding the redundancy for channel coding? What is the Capacity? Joint source and channel coding indeed needed? For single TX-RC channel: source and channel coding should be done separately Dr. Nghi Tran (ECE-University of Akron) ECE 4400:693 Information Theory 17 / 26

22 Course Overview Two Main Topics in Information Theory Main Topic 1 - Source Coding: How can we reduce the bit rate at the output of source encoding? What is the minimum bit rate required to recover the data at the receiver for two cases: 1) Distortion is NOT allowed; 2) distortion is allowed Main Topic 2: Channel Coding and Capacity How can we reduce the bit error probability by intelligently adding the redundancy for channel coding? What is the Capacity? Joint source and channel coding indeed needed? For single TX-RC channel: source and channel coding should be done separately Dr. Nghi Tran (ECE-University of Akron) ECE 4400:693 Information Theory 17 / 26

23 Course Overview What Else in Information Theory Information Theory also finds applications in other disciplines Electrical Engineering - Communication Theory Mathematics Computer Science Physics Economics Others Dr. Nghi Tran (ECE-University of Akron) ECE 4400:693 Information Theory 18 / 26

24 Course Overview Why We Need Information Theory? Understand communications systems well enough to engineer Make a fundamental comparison among different schemes System benchmark to design Dr. Nghi Tran (ECE-University of Akron) ECE 4400:693 Information Theory 19 / 26

25 Outline Topics Covered 1 Course Information 2 Course Overview 3 Topics Covered 4 Research Project Dr. Nghi Tran (ECE-University of Akron) ECE 4400:693 Information Theory 20 / 26

26 Topic Covered Topics Covered Some Mathematical Tools and Probability Theory Information Theory Basis Entropy, mutual information, AEP,... Data Compression Channel Capacity and Random Coding Bound Dr. Nghi Tran (ECE-University of Akron) ECE 4400:693 Information Theory 21 / 26

27 Topics Covered Topic Covered (Continued) Differential Entropy Single-User Gaussian Channel AWGN Fading with CSI, CDI MIMO Practical Coding Schemes Block Codes, Convolutional Codes, Turbo Codes Network Information Theory MAC and Broadcast Channels Interference and Relay Channels (if time permits) Dr. Nghi Tran (ECE-University of Akron) ECE 4400:693 Information Theory 22 / 26

28 Outline Research Project 1 Course Information 2 Course Overview 3 Topics Covered 4 Research Project Dr. Nghi Tran (ECE-University of Akron) ECE 4400:693 Information Theory 23 / 26

29 Research Project Research Project Main goal: get exposed to some interesting topics in Information Theory and its related applications It is your choice to select the topic. You can also pick up from the list of suggested topics The project can either be your original research, or a high quality survey of a relevant topic, or a review of some papers Dr. Nghi Tran (ECE-University of Akron) ECE 4400:693 Information Theory 24 / 26

30 Research Project Research Project - Time Line 1-page proposal: Due Nov. 14 Project report: Due Dec. 9 Project presentation in the end of the term Dr. Nghi Tran (ECE-University of Akron) ECE 4400:693 Information Theory 25 / 26

31 Research Project Thank you! Dr. Nghi Tran (ECE-University of Akron) ECE 4400:693 Information Theory 26 / 26

Multiuser Information Theory and Wireless Communications. Professor in Charge: Toby Berger Principal Lecturer: Jun Chen

Multiuser Information Theory and Wireless Communications. Professor in Charge: Toby Berger Principal Lecturer: Jun Chen Multiuser Information Theory and Wireless Communications Professor in Charge: Toby Berger Principal Lecturer: Jun Chen Where and When? 1 Good News No homework. No exam. 2 Credits:1-2 One credit: submit

More information

Computing and Communications 2. Information Theory -Channel Capacity

Computing and Communications 2. Information Theory -Channel Capacity 1896 1920 1987 2006 Computing and Communications 2. Information Theory -Channel Capacity Ying Cui Department of Electronic Engineering Shanghai Jiao Tong University, China 2017, Autumn 1 Outline Communication

More information

ECE 8771, Information Theory & Coding for Digital Communications Summer 2010 Syllabus & Outline (Draft 1 - May 12, 2010)

ECE 8771, Information Theory & Coding for Digital Communications Summer 2010 Syllabus & Outline (Draft 1 - May 12, 2010) ECE 8771, Information Theory & Coding for Digital Communications Summer 2010 Syllabus & Outline (Draft 1 - May 12, 2010) Instructor: Kevin Buckley, Tolentine 433a, 610-519-5658 (W), 610-519-4436 (F), buckley@ece.vill.edu,

More information

Course Developer: Ranjan Bose, IIT Delhi

Course Developer: Ranjan Bose, IIT Delhi Course Title: Coding Theory Course Developer: Ranjan Bose, IIT Delhi Part I Information Theory and Source Coding 1. Source Coding 1.1. Introduction to Information Theory 1.2. Uncertainty and Information

More information

Information & Communication

Information & Communication Information & Communication Bachelor Informatica 2014/15 January 2015 Some of these slides are copied from or heavily inspired by the University of Illinois at Chicago, ECE 534: Elements of Information

More information

ENSC327/328 Communication Systems Course Information. Paul Ho Professor School of Engineering Science Simon Fraser University

ENSC327/328 Communication Systems Course Information. Paul Ho Professor School of Engineering Science Simon Fraser University ENSC327/328 Communication Systems Course Information Paul Ho Professor School of Engineering Science Simon Fraser University 1 Schedule & Instructor Class Schedule: Mon 2:30 4:20pm AQ 3159 Wed 1:30 2:20pm

More information

Lecture 1 Introduction

Lecture 1 Introduction Lecture 1 Introduction I-Hsiang Wang Department of Electrical Engineering National Taiwan University ihwang@ntu.edu.tw September 22, 2015 1 / 46 I-Hsiang Wang IT Lecture 1 Information Theory Information

More information

Detection and Estimation of Signals in Noise. Dr. Robert Schober Department of Electrical and Computer Engineering University of British Columbia

Detection and Estimation of Signals in Noise. Dr. Robert Schober Department of Electrical and Computer Engineering University of British Columbia Detection and Estimation of Signals in Noise Dr. Robert Schober Department of Electrical and Computer Engineering University of British Columbia Vancouver, August 24, 2010 2 Contents 1 Basic Elements

More information

COMMUNICATION SYSTEMS

COMMUNICATION SYSTEMS COMMUNICATION SYSTEMS 4TH EDITION Simon Hayhin McMaster University JOHN WILEY & SONS, INC. Ш.! [ BACKGROUND AND PREVIEW 1. The Communication Process 1 2. Primary Communication Resources 3 3. Sources of

More information

Error Control Coding. Aaron Gulliver Dept. of Electrical and Computer Engineering University of Victoria

Error Control Coding. Aaron Gulliver Dept. of Electrical and Computer Engineering University of Victoria Error Control Coding Aaron Gulliver Dept. of Electrical and Computer Engineering University of Victoria Topics Introduction The Channel Coding Problem Linear Block Codes Cyclic Codes BCH and Reed-Solomon

More information

Lecture 1: Tue Jan 8, Lecture introduction and motivation

Lecture 1: Tue Jan 8, Lecture introduction and motivation Lecture 1: Tue Jan 8, 2019 Lecture introduction and motivation 1 ECE 6602: Digital Communications GEORGIA INSTITUTE OF TECHNOLOGY, SPRING 2019 PREREQUISITE: ECE 6601. Strong background in probability is

More information

COPYRIGHTED MATERIAL. Introduction. 1.1 Communication Systems

COPYRIGHTED MATERIAL. Introduction. 1.1 Communication Systems 1 Introduction The reliable transmission of information over noisy channels is one of the basic requirements of digital information and communication systems. Here, transmission is understood both as transmission

More information

A Bit of network information theory

A Bit of network information theory Š#/,% 0/,94%#(.)15% A Bit of network information theory Suhas Diggavi 1 Email: suhas.diggavi@epfl.ch URL: http://licos.epfl.ch Parts of talk are joint work with S. Avestimehr 2, S. Mohajer 1, C. Tian 3,

More information

Language of Instruction Course Level Short Cycle ( ) First Cycle (x) Second Cycle ( ) Third Cycle ( ) Term Local Credit ECTS Credit Fall 3 5

Language of Instruction Course Level Short Cycle ( ) First Cycle (x) Second Cycle ( ) Third Cycle ( ) Term Local Credit ECTS Credit Fall 3 5 Course Details Course Name Telecommunications II Language of Instruction English Course Level Short Cycle ( ) First Cycle (x) Second Cycle ( ) Third Cycle ( ) Course Type Course Code Compulsory (x) Elective

More information

Simulink Modeling of Convolutional Encoders

Simulink Modeling of Convolutional Encoders Simulink Modeling of Convolutional Encoders * Ahiara Wilson C and ** Iroegbu Chbuisi, *Department of Computer Engineering, Michael Okpara University of Agriculture, Umudike, Abia State, Nigeria **Department

More information

EELE 6333: Wireless Commuications

EELE 6333: Wireless Commuications EELE 6333: Wireless Commuications Chapter # 4 : Capacity of Wireless Channels Spring, 2012/2013 EELE 6333: Wireless Commuications - Ch.4 Dr. Musbah Shaat 1 / 18 Outline 1 Capacity in AWGN 2 Capacity of

More information

Coding for MIMO Communication Systems

Coding for MIMO Communication Systems Coding for MIMO Communication Systems Tolga M. Duman Arizona State University, USA Ali Ghrayeb Concordia University, Canada BICINTINNIAL BICENTENNIAL John Wiley & Sons, Ltd Contents About the Authors Preface

More information

The Wireless Data Crunch: Motivating Research in Wireless Communications

The Wireless Data Crunch: Motivating Research in Wireless Communications The Wireless Data Crunch: Motivating Research in Wireless Communications Stephen Hanly CSIRO-Macquarie University Chair in Wireless Communications stephen.hanly@mq.edu.au Wireless Growth Rate Cooper s

More information

DEGRADED broadcast channels were first studied by

DEGRADED broadcast channels were first studied by 4296 IEEE TRANSACTIONS ON INFORMATION THEORY, VOL 54, NO 9, SEPTEMBER 2008 Optimal Transmission Strategy Explicit Capacity Region for Broadcast Z Channels Bike Xie, Student Member, IEEE, Miguel Griot,

More information

EE303: Communication Systems

EE303: Communication Systems EE303: Communication Systems Professor A. Manikas Chair of Communications and Array Processing Imperial College London An Overview of Fundamentals: Channels, Criteria and Limits Prof. A. Manikas (Imperial

More information

Chapter 1 INTRODUCTION TO SOURCE CODING AND CHANNEL CODING. Whether a source is analog or digital, a digital communication

Chapter 1 INTRODUCTION TO SOURCE CODING AND CHANNEL CODING. Whether a source is analog or digital, a digital communication 1 Chapter 1 INTRODUCTION TO SOURCE CODING AND CHANNEL CODING 1.1 SOURCE CODING Whether a source is analog or digital, a digital communication system is designed to transmit information in digital form.

More information

Information flow over wireless networks: a deterministic approach

Information flow over wireless networks: a deterministic approach Information flow over wireless networks: a deterministic approach alman Avestimehr In collaboration with uhas iggavi (EPFL) and avid Tse (UC Berkeley) Overview Point-to-point channel Information theory

More information

EENG 444 / ENAS 944 Digital Communication Systems

EENG 444 / ENAS 944 Digital Communication Systems EENG 444 / ENAS 944 Digital Communication Systems Introduction!! Wenjun Hu Communication Systems What s the first thing that comes to your mind? Communication Systems What s the first thing that comes

More information

The Z Channel. Nihar Jindal Department of Electrical Engineering Stanford University, Stanford, CA

The Z Channel. Nihar Jindal Department of Electrical Engineering Stanford University, Stanford, CA The Z Channel Sriram Vishwanath Dept. of Elec. and Computer Engg. Univ. of Texas at Austin, Austin, TX E-mail : sriram@ece.utexas.edu Nihar Jindal Department of Electrical Engineering Stanford University,

More information

Convolutional Coding Using Booth Algorithm For Application in Wireless Communication

Convolutional Coding Using Booth Algorithm For Application in Wireless Communication Available online at www.interscience.in Convolutional Coding Using Booth Algorithm For Application in Wireless Communication Sishir Kalita, Parismita Gogoi & Kandarpa Kumar Sarma Department of Electronics

More information

BER Analysis of BPSK for Block Codes and Convolution Codes Over AWGN Channel

BER Analysis of BPSK for Block Codes and Convolution Codes Over AWGN Channel International Journal of Pure and Applied Mathematics Volume 114 No. 11 2017, 221-230 ISSN: 1311-8080 (printed version); ISSN: 1314-3395 (on-line version) url: http://www.ijpam.eu ijpam.eu BER Analysis

More information

A Brief Introduction to Information Theory and Lossless Coding

A Brief Introduction to Information Theory and Lossless Coding A Brief Introduction to Information Theory and Lossless Coding 1 INTRODUCTION This document is intended as a guide to students studying 4C8 who have had no prior exposure to information theory. All of

More information

ENGR 4323/5323 Digital and Analog Communication

ENGR 4323/5323 Digital and Analog Communication ENGR 4323/5323 Digital and Analog Communication Chapter 1 Introduction Engineering and Physics University of Central Oklahoma Dr. Mohamed Bingabr Course Materials Textbook: Modern Digital and Analog Communication,

More information

Multiple Antennas. Mats Bengtsson, Björn Ottersten. Basic Transmission Schemes 1 September 8, Presentation Outline

Multiple Antennas. Mats Bengtsson, Björn Ottersten. Basic Transmission Schemes 1 September 8, Presentation Outline Multiple Antennas Capacity and Basic Transmission Schemes Mats Bengtsson, Björn Ottersten Basic Transmission Schemes 1 September 8, 2005 Presentation Outline Channel capacity Some fine details and misconceptions

More information

BANDWIDTH-PERFORMANCE TRADEOFFS FOR A TRANSMISSION WITH CONCURRENT SIGNALS

BANDWIDTH-PERFORMANCE TRADEOFFS FOR A TRANSMISSION WITH CONCURRENT SIGNALS BANDWIDTH-PERFORMANCE TRADEOFFS FOR A TRANSMISSION WITH CONCURRENT SIGNALS Aminata A. Garba Dept. of Electrical and Computer Engineering, Carnegie Mellon University aminata@ece.cmu.edu ABSTRACT We consider

More information

S Coding Methods (5 cr) P. Prerequisites. Literature (1) Contents

S Coding Methods (5 cr) P. Prerequisites. Literature (1) Contents S-72.3410 Introduction 1 S-72.3410 Introduction 3 S-72.3410 Coding Methods (5 cr) P Lectures: Mondays 9 12, room E110, and Wednesdays 9 12, hall S4 (on January 30th this lecture will be held in E111!)

More information

On Fading Broadcast Channels with Partial Channel State Information at the Transmitter

On Fading Broadcast Channels with Partial Channel State Information at the Transmitter On Fading Broadcast Channels with Partial Channel State Information at the Transmitter Ravi Tandon 1, ohammad Ali addah-ali, Antonia Tulino, H. Vincent Poor 1, and Shlomo Shamai 3 1 Dept. of Electrical

More information

EDI042 Error Control Coding (Kodningsteknik)

EDI042 Error Control Coding (Kodningsteknik) EDI042 Error Control Coding (Kodningsteknik) Chapter 1: Introduction Michael Lentmaier November 3, 2014 Michael Lentmaier, Fall 2014 EDI042 Error Control Coding: Chapter 1 1 / 26 Course overview I Lectures:

More information

Interference: An Information Theoretic View

Interference: An Information Theoretic View Interference: An Information Theoretic View David Tse Wireless Foundations U.C. Berkeley ISIT 2009 Tutorial June 28 Thanks: Changho Suh. Context Two central phenomena in wireless communications: Fading

More information

On the Achievable Diversity-vs-Multiplexing Tradeoff in Cooperative Channels

On the Achievable Diversity-vs-Multiplexing Tradeoff in Cooperative Channels On the Achievable Diversity-vs-Multiplexing Tradeoff in Cooperative Channels Kambiz Azarian, Hesham El Gamal, and Philip Schniter Dept of Electrical Engineering, The Ohio State University Columbus, OH

More information

IEEE C /02R1. IEEE Mobile Broadband Wireless Access <http://grouper.ieee.org/groups/802/mbwa>

IEEE C /02R1. IEEE Mobile Broadband Wireless Access <http://grouper.ieee.org/groups/802/mbwa> 23--29 IEEE C82.2-3/2R Project Title Date Submitted IEEE 82.2 Mobile Broadband Wireless Access Soft Iterative Decoding for Mobile Wireless Communications 23--29

More information

Basics of Error Correcting Codes

Basics of Error Correcting Codes Basics of Error Correcting Codes Drawing from the book Information Theory, Inference, and Learning Algorithms Downloadable or purchasable: http://www.inference.phy.cam.ac.uk/mackay/itila/book.html CSE

More information

SIGNALS AND SYSTEMS LABORATORY 13: Digital Communication

SIGNALS AND SYSTEMS LABORATORY 13: Digital Communication SIGNALS AND SYSTEMS LABORATORY 13: Digital Communication INTRODUCTION Digital Communication refers to the transmission of binary, or digital, information over analog channels. In this laboratory you will

More information

EE107 Communication Systems. Introduction

EE107 Communication Systems. Introduction EE107 Communication Systems Introduction Mai Vu 5 September 2017 What is communication? Overview Exchanging/imparting of information What is a communication system? A system facilitating communication

More information

ECEn 665: Antennas and Propagation for Wireless Communications 131. s(t) = A c [1 + αm(t)] cos (ω c t) (9.27)

ECEn 665: Antennas and Propagation for Wireless Communications 131. s(t) = A c [1 + αm(t)] cos (ω c t) (9.27) ECEn 665: Antennas and Propagation for Wireless Communications 131 9. Modulation Modulation is a way to vary the amplitude and phase of a sinusoidal carrier waveform in order to transmit information. When

More information

Lecture #2. EE 471C / EE 381K-17 Wireless Communication Lab. Professor Robert W. Heath Jr.

Lecture #2. EE 471C / EE 381K-17 Wireless Communication Lab. Professor Robert W. Heath Jr. Lecture #2 EE 471C / EE 381K-17 Wireless Communication Lab Professor Robert W. Heath Jr. Preview of today s lecture u Introduction to digital communication u Components of a digital communication system

More information

Optimal Power Allocation over Fading Channels with Stringent Delay Constraints

Optimal Power Allocation over Fading Channels with Stringent Delay Constraints 1 Optimal Power Allocation over Fading Channels with Stringent Delay Constraints Xiangheng Liu Andrea Goldsmith Dept. of Electrical Engineering, Stanford University Email: liuxh,andrea@wsl.stanford.edu

More information

Course Specifications

Course Specifications Development Cluster Computer and Networking Engineering (CNE) Cluster Lead Developer Amir Asif Module Names Module 1: Baseband and Bandpass Communications (40 characters or less Module 2: Channel Coding

More information

Multicasting over Multiple-Access Networks

Multicasting over Multiple-Access Networks ing oding apacity onclusions ing Department of Electrical Engineering and omputer Sciences University of alifornia, Berkeley May 9, 2006 EE 228A Outline ing oding apacity onclusions 1 2 3 4 oding 5 apacity

More information

Information Theory: the Day after Yesterday

Information Theory: the Day after Yesterday : the Day after Yesterday Department of Electrical Engineering and Computer Science Chicago s Shannon Centennial Event September 23, 2016 : the Day after Yesterday IT today Outline The birth of information

More information

Part A: Question & Answers UNIT I AMPLITUDE MODULATION

Part A: Question & Answers UNIT I AMPLITUDE MODULATION PANDIAN SARASWATHI YADAV ENGINEERING COLLEGE DEPARTMENT OF ELECTRONICS & COMMUNICATON ENGG. Branch: ECE EC6402 COMMUNICATION THEORY Semester: IV Part A: Question & Answers UNIT I AMPLITUDE MODULATION 1.

More information

ISSN: International Journal of Innovative Research in Science, Engineering and Technology

ISSN: International Journal of Innovative Research in Science, Engineering and Technology ISSN: 39-8753 Volume 3, Issue 7, July 4 Graphical User Interface for Simulating Convolutional Coding with Viterbi Decoding in Digital Communication Systems using Matlab Ezeofor C. J., Ndinechi M.C. Lecturer,

More information

Adaptive Digital Video Transmission with STBC over Rayleigh Fading Channels

Adaptive Digital Video Transmission with STBC over Rayleigh Fading Channels 2012 7th International ICST Conference on Communications and Networking in China (CHINACOM) Adaptive Digital Video Transmission with STBC over Rayleigh Fading Channels Jia-Chyi Wu Dept. of Communications,

More information

Variations on the Index Coding Problem: Pliable Index Coding and Caching

Variations on the Index Coding Problem: Pliable Index Coding and Caching Variations on the Index Coding Problem: Pliable Index Coding and Caching T. Liu K. Wan D. Tuninetti University of Illinois at Chicago Shannon s Centennial, Chicago, September 23rd 2016 D. Tuninetti (UIC)

More information

Information Theory and Huffman Coding

Information Theory and Huffman Coding Information Theory and Huffman Coding Consider a typical Digital Communication System: A/D Conversion Sampling and Quantization D/A Conversion Source Encoder Source Decoder bit stream bit stream Channel

More information

Bell Labs celebrates 50 years of Information Theory

Bell Labs celebrates 50 years of Information Theory 1 Bell Labs celebrates 50 years of Information Theory An Overview of Information Theory Humans are symbol-making creatures. We communicate by symbols -- growls and grunts, hand signals, and drawings painted

More information

Breaking Spectrum Gridlock With Cognitive Radios: An Information Theoretic Perspective

Breaking Spectrum Gridlock With Cognitive Radios: An Information Theoretic Perspective Breaking Spectrum Gridlock With Cognitive Radios: An Information Theoretic Perspective Naroa Zurutuza - EE360 Winter 2014 Introduction Cognitive Radio: Wireless communication system that intelligently

More information

IDMA Technology and Comparison survey of Interleavers

IDMA Technology and Comparison survey of Interleavers International Journal of Scientific and Research Publications, Volume 3, Issue 9, September 2013 1 IDMA Technology and Comparison survey of Interleavers Neelam Kumari 1, A.K.Singh 2 1 (Department of Electronics

More information

Communication Theory II

Communication Theory II Communication Theory II Lecture 13: Information Theory (cont d) Ahmed Elnakib, PhD Assistant Professor, Mansoura University, Egypt March 22 th, 2015 1 o Source Code Generation Lecture Outlines Source Coding

More information

Massive MIMO: Signal Structure, Efficient Processing, and Open Problems I

Massive MIMO: Signal Structure, Efficient Processing, and Open Problems I Massive MIMO: Signal Structure, Efficient Processing, and Open Problems I Saeid Haghighatshoar Communications and Information Theory Group (CommIT) Technische Universität Berlin CoSIP Winter Retreat Berlin,

More information

Chapter 1 Coding for Reliable Digital Transmission and Storage

Chapter 1 Coding for Reliable Digital Transmission and Storage Wireless Information Transmission System Lab. Chapter 1 Coding for Reliable Digital Transmission and Storage Institute of Communications Engineering National Sun Yat-sen University 1.1 Introduction A major

More information

Communications Overhead as the Cost of Constraints

Communications Overhead as the Cost of Constraints Communications Overhead as the Cost of Constraints J. Nicholas Laneman and Brian. Dunn Department of Electrical Engineering University of Notre Dame Email: {jnl,bdunn}@nd.edu Abstract This paper speculates

More information

EECS 473 Advanced Embedded Systems. Lecture 14 Wireless in the real world

EECS 473 Advanced Embedded Systems. Lecture 14 Wireless in the real world EECS 473 Advanced Embedded Systems Lecture 14 Wireless in the real world Team status updates Team Alert (Home Alert) Team Fitness (Fitness watch) Team Glasses Team Mouse (Control in hand) Team WiFi (WiFi

More information

Communication Theory II

Communication Theory II Communication Theory II Lecture 14: Information Theory (cont d) Ahmed Elnakib, PhD Assistant Professor, Mansoura University, Egypt March 25 th, 2015 1 Previous Lecture: Source Code Generation: Lossless

More information

Performance Evaluation and Comparative Analysis of Various Concatenated Error Correcting Codes Using BPSK Modulation for AWGN Channel

Performance Evaluation and Comparative Analysis of Various Concatenated Error Correcting Codes Using BPSK Modulation for AWGN Channel International Journal of Electronics and Communication Engineering. ISSN 0974-2166 Volume 5, Number 3 (2012), pp. 235-244 International Research Publication House http://www.irphouse.com Performance Evaluation

More information

Approaching the Capacity of the Multi-Pair Bidirectional Relay Network via a Divide and Conquer Strategy

Approaching the Capacity of the Multi-Pair Bidirectional Relay Network via a Divide and Conquer Strategy Approaching the Capacity of the Multi-Pair Bidirectional elay Network via a Divide and Conquer Strategy Salman Avestimehr Cornell In collaboration with: Amin Khajehnejad (Caltech), Aydin Sezgin (UC Irvine)

More information

PROJECT 5: DESIGNING A VOICE MODEM. Instructor: Amir Asif

PROJECT 5: DESIGNING A VOICE MODEM. Instructor: Amir Asif PROJECT 5: DESIGNING A VOICE MODEM Instructor: Amir Asif CSE4214: Digital Communications (Fall 2012) Computer Science and Engineering, York University 1. PURPOSE In this laboratory project, you will design

More information

TSKS01 Digital Communication Lecture 1

TSKS01 Digital Communication Lecture 1 TSKS01 Digital Communication Lecture 1 Introduction, Repetition, Channels as Filters, Complex-baseband representation Emil Björnson Department of Electrical Engineering (ISY) Division of Communication

More information

EECS 473 Advanced Embedded Systems. Lecture 13 Start on Wireless

EECS 473 Advanced Embedded Systems. Lecture 13 Start on Wireless EECS 473 Advanced Embedded Systems Lecture 13 Start on Wireless Team status updates Losing track of who went last. Cyberspeaker VisibleLight Elevate Checkout SmartHaus Upcoming Last lecture this Thursday

More information

SPECTRUM SHARING IN CRN USING ARP PROTOCOL- ANALYSIS OF HIGH DATA RATE

SPECTRUM SHARING IN CRN USING ARP PROTOCOL- ANALYSIS OF HIGH DATA RATE Int. J. Chem. Sci.: 14(S3), 2016, 794-800 ISSN 0972-768X www.sadgurupublications.com SPECTRUM SHARING IN CRN USING ARP PROTOCOL- ANALYSIS OF HIGH DATA RATE ADITYA SAI *, ARSHEYA AFRAN and PRIYANKA Information

More information

Physical Layer: Outline

Physical Layer: Outline 18-345: Introduction to Telecommunication Networks Lectures 3: Physical Layer Peter Steenkiste Spring 2015 www.cs.cmu.edu/~prs/nets-ece Physical Layer: Outline Digital networking Modulation Characterization

More information

Information Theory: A Lighthouse for Understanding Modern Communication Systems. Ajit Kumar Chaturvedi Department of EE IIT Kanpur

Information Theory: A Lighthouse for Understanding Modern Communication Systems. Ajit Kumar Chaturvedi Department of EE IIT Kanpur Information Theory: A Lighthouse for Understanding Modern Communication Systems Ajit Kumar Chaturvedi Department of EE IIT Kanpur akc@iitk.ac.in References Fundamentals of Digital Communication by Upamanyu

More information

About Homework. The rest parts of the course: focus on popular standards like GSM, WCDMA, etc.

About Homework. The rest parts of the course: focus on popular standards like GSM, WCDMA, etc. About Homework The rest parts of the course: focus on popular standards like GSM, WCDMA, etc. Good news: No complicated mathematics and calculations! Concepts: Understanding and remember! Homework: review

More information

Study of Turbo Coded OFDM over Fading Channel

Study of Turbo Coded OFDM over Fading Channel International Journal of Engineering Research and Development e-issn: 2278-067X, p-issn: 2278-800X, www.ijerd.com Volume 3, Issue 2 (August 2012), PP. 54-58 Study of Turbo Coded OFDM over Fading Channel

More information

Power Efficiency of LDPC Codes under Hard and Soft Decision QAM Modulated OFDM

Power Efficiency of LDPC Codes under Hard and Soft Decision QAM Modulated OFDM Advance in Electronic and Electric Engineering. ISSN 2231-1297, Volume 4, Number 5 (2014), pp. 463-468 Research India Publications http://www.ripublication.com/aeee.htm Power Efficiency of LDPC Codes under

More information

Capacity of Middleton Class-A Impulsive Noise Channel with Binary Input

Capacity of Middleton Class-A Impulsive Noise Channel with Binary Input Appl. Math. Inf. Sci. 9, No. 3, 1291-1298 (2015) 1291 Applied Mathematics & Information Sciences An International Journal http://dx.doi.org/10.12785/amis/090323 Capacity of Middleton Class-A Impulsive

More information

Empirical Rate-Distortion Study of Compressive Sensing-based Joint Source-Channel Coding

Empirical Rate-Distortion Study of Compressive Sensing-based Joint Source-Channel Coding Empirical -Distortion Study of Compressive Sensing-based Joint Source-Channel Coding Muriel L. Rambeloarison, Soheil Feizi, Georgios Angelopoulos, and Muriel Médard Research Laboratory of Electronics Massachusetts

More information

Power and Bandwidth Allocation in Cooperative Dirty Paper Coding

Power and Bandwidth Allocation in Cooperative Dirty Paper Coding Power and Bandwidth Allocation in Cooperative Dirty Paper Coding Chris T. K. Ng 1, Nihar Jindal 2 Andrea J. Goldsmith 3, Urbashi Mitra 4 1 Stanford University/MIT, 2 Univeristy of Minnesota 3 Stanford

More information

Degrees of Freedom of the MIMO X Channel

Degrees of Freedom of the MIMO X Channel Degrees of Freedom of the MIMO X Channel Syed A. Jafar Electrical Engineering and Computer Science University of California Irvine Irvine California 9697 USA Email: syed@uci.edu Shlomo Shamai (Shitz) Department

More information

TCET3202 Analog and digital Communications II

TCET3202 Analog and digital Communications II NEW YORK CITY COLLEGE OF TECHNOLOGY The City University of New York DEPARTMENT: SUBJECT CODE AND TITLE: COURSE DESCRIPTION: REQUIRED COURSE Electrical and Telecommunications Engineering Technology TCET3202

More information

Capacity and Cooperation in Wireless Networks

Capacity and Cooperation in Wireless Networks Capacity and Cooperation in Wireless Networks Chris T. K. Ng and Andrea J. Goldsmith Stanford University Abstract We consider fundamental capacity limits in wireless networks where nodes can cooperate

More information

An Iterative Noncoherent Relay Receiver for the Two-way Relay Channel

An Iterative Noncoherent Relay Receiver for the Two-way Relay Channel An Iterative Noncoherent Relay Receiver for the Two-way Relay Channel Terry Ferrett 1 Matthew Valenti 1 Don Torrieri 2 1 West Virginia University 2 U.S. Army Research Laboratory June 12th, 2013 1 / 26

More information

LECTURE VI: LOSSLESS COMPRESSION ALGORITHMS DR. OUIEM BCHIR

LECTURE VI: LOSSLESS COMPRESSION ALGORITHMS DR. OUIEM BCHIR 1 LECTURE VI: LOSSLESS COMPRESSION ALGORITHMS DR. OUIEM BCHIR 2 STORAGE SPACE Uncompressed graphics, audio, and video data require substantial storage capacity. Storing uncompressed video is not possible

More information

International Journal of Scientific & Engineering Research Volume 9, Issue 3, March ISSN

International Journal of Scientific & Engineering Research Volume 9, Issue 3, March ISSN International Journal of Scientific & Engineering Research Volume 9, Issue 3, March-2018 1605 FPGA Design and Implementation of Convolution Encoder and Viterbi Decoder Mr.J.Anuj Sai 1, Mr.P.Kiran Kumar

More information

State-Dependent Relay Channel: Achievable Rate and Capacity of a Semideterministic Class

State-Dependent Relay Channel: Achievable Rate and Capacity of a Semideterministic Class IEEE TRANSACTIONS ON INFORMATION THEORY, VOL. 59, NO. 5, MAY 2013 2629 State-Dependent Relay Channel: Achievable Rate and Capacity of a Semideterministic Class Majid Nasiri Khormuji, Member, IEEE, Abbas

More information

SHANNON showed that feedback does not increase the capacity

SHANNON showed that feedback does not increase the capacity IEEE TRANSACTIONS ON INFORMATION THEORY, VOL. 57, NO. 5, MAY 2011 2667 Feedback Capacity of the Gaussian Interference Channel to Within 2 Bits Changho Suh, Student Member, IEEE, and David N. C. Tse, Fellow,

More information

Lecture 4: Wireless Physical Layer: Channel Coding. Mythili Vutukuru CS 653 Spring 2014 Jan 16, Thursday

Lecture 4: Wireless Physical Layer: Channel Coding. Mythili Vutukuru CS 653 Spring 2014 Jan 16, Thursday Lecture 4: Wireless Physical Layer: Channel Coding Mythili Vutukuru CS 653 Spring 2014 Jan 16, Thursday Channel Coding Modulated waveforms disrupted by signal propagation through wireless channel leads

More information

Rab Nawaz. Prof. Zhang Wenyi

Rab Nawaz. Prof. Zhang Wenyi Rab Nawaz PhD Scholar (BL16006002) School of Information Science and Technology University of Science and Technology of China, Hefei Email: rabnawaz@mail.ustc.edu.cn Submitted to Prof. Zhang Wenyi wenyizha@ustc.edu.cn

More information

Coding for the Slepian-Wolf Problem With Turbo Codes

Coding for the Slepian-Wolf Problem With Turbo Codes Coding for the Slepian-Wolf Problem With Turbo Codes Jan Bajcsy and Patrick Mitran Department of Electrical and Computer Engineering, McGill University Montréal, Québec, HA A7, Email: {jbajcsy, pmitran}@tsp.ece.mcgill.ca

More information

Multi-user Two-way Deterministic Modulo 2 Adder Channels When Adaptation Is Useless

Multi-user Two-way Deterministic Modulo 2 Adder Channels When Adaptation Is Useless Forty-Ninth Annual Allerton Conference Allerton House, UIUC, Illinois, USA September 28-30, 2011 Multi-user Two-way Deterministic Modulo 2 Adder Channels When Adaptation Is Useless Zhiyu Cheng, Natasha

More information

Soft Channel Encoding; A Comparison of Algorithms for Soft Information Relaying

Soft Channel Encoding; A Comparison of Algorithms for Soft Information Relaying IWSSIP, -3 April, Vienna, Austria ISBN 978-3--38-4 Soft Channel Encoding; A Comparison of Algorithms for Soft Information Relaying Mehdi Mortazawi Molu Institute of Telecommunications Vienna University

More information

IMPERIAL COLLEGE of SCIENCE, TECHNOLOGY and MEDICINE, DEPARTMENT of ELECTRICAL and ELECTRONIC ENGINEERING.

IMPERIAL COLLEGE of SCIENCE, TECHNOLOGY and MEDICINE, DEPARTMENT of ELECTRICAL and ELECTRONIC ENGINEERING. IMPERIAL COLLEGE of SCIENCE, TECHNOLOGY and MEDICINE, DEPARTMENT of ELECTRICAL and ELECTRONIC ENGINEERING. COMPACT LECTURE NOTES on COMMUNICATION THEORY. Prof. Athanassios Manikas, version Spring 22 Digital

More information

Symmetric Decentralized Interference Channels with Noisy Feedback

Symmetric Decentralized Interference Channels with Noisy Feedback 4 IEEE International Symposium on Information Theory Symmetric Decentralized Interference Channels with Noisy Feedback Samir M. Perlaza Ravi Tandon and H. Vincent Poor Institut National de Recherche en

More information

Entropy, Coding and Data Compression

Entropy, Coding and Data Compression Entropy, Coding and Data Compression Data vs. Information yes, not, yes, yes, not not In ASCII, each item is 3 8 = 24 bits of data But if the only possible answers are yes and not, there is only one bit

More information

OPTIMAL POWER ALLOCATION FOR MULTIPLE ACCESS CHANNEL

OPTIMAL POWER ALLOCATION FOR MULTIPLE ACCESS CHANNEL International Journal of Wireless & Mobile Networks (IJWMN) Vol. 8, No. 6, December 06 OPTIMAL POWER ALLOCATION FOR MULTIPLE ACCESS CHANNEL Zouhair Al-qudah Communication Engineering Department, AL-Hussein

More information

Notes 15: Concatenated Codes, Turbo Codes and Iterative Processing

Notes 15: Concatenated Codes, Turbo Codes and Iterative Processing 16.548 Notes 15: Concatenated Codes, Turbo Codes and Iterative Processing Outline! Introduction " Pushing the Bounds on Channel Capacity " Theory of Iterative Decoding " Recursive Convolutional Coding

More information

Implementation of Different Interleaving Techniques for Performance Evaluation of CDMA System

Implementation of Different Interleaving Techniques for Performance Evaluation of CDMA System Implementation of Different Interleaving Techniques for Performance Evaluation of CDMA System Anshu Aggarwal 1 and Vikas Mittal 2 1 Anshu Aggarwal is student of M.Tech. in the Department of Electronics

More information

ENERGY EFFICIENT RELAY SELECTION SCHEMES FOR COOPERATIVE UNIFORMLY DISTRIBUTED WIRELESS SENSOR NETWORKS

ENERGY EFFICIENT RELAY SELECTION SCHEMES FOR COOPERATIVE UNIFORMLY DISTRIBUTED WIRELESS SENSOR NETWORKS ENERGY EFFICIENT RELAY SELECTION SCHEMES FOR COOPERATIVE UNIFORMLY DISTRIBUTED WIRELESS SENSOR NETWORKS WAFIC W. ALAMEDDINE A THESIS IN THE DEPARTMENT OF ELECTRICAL AND COMPUTER ENGINEERING PRESENTED IN

More information

Joint Relaying and Network Coding in Wireless Networks

Joint Relaying and Network Coding in Wireless Networks Joint Relaying and Network Coding in Wireless Networks Sachin Katti Ivana Marić Andrea Goldsmith Dina Katabi Muriel Médard MIT Stanford Stanford MIT MIT Abstract Relaying is a fundamental building block

More information

MAS.160 / MAS.510 / MAS.511 Signals, Systems and Information for Media Technology Fall 2007

MAS.160 / MAS.510 / MAS.511 Signals, Systems and Information for Media Technology Fall 2007 MIT OpenCourseWare http://ocw.mit.edu MAS.160 / MAS.510 / MAS.511 Signals, Systems and Information for Media Technology Fall 2007 For information about citing these materials or our Terms of Use, visit:

More information

Wireless Communication: Concepts, Techniques, and Models. Hongwei Zhang

Wireless Communication: Concepts, Techniques, and Models. Hongwei Zhang Wireless Communication: Concepts, Techniques, and Models Hongwei Zhang http://www.cs.wayne.edu/~hzhang Outline Digital communication over radio channels Channel capacity MIMO: diversity and parallel channels

More information

Introduction to Coding Theory

Introduction to Coding Theory Coding Theory Massoud Malek Introduction to Coding Theory Introduction. Coding theory originated with the advent of computers. Early computers were huge mechanical monsters whose reliability was low compared

More information

ELEC E7210: Communication Theory. Lecture 11: MIMO Systems and Space-time Communications

ELEC E7210: Communication Theory. Lecture 11: MIMO Systems and Space-time Communications ELEC E7210: Communication Theory Lecture 11: MIMO Systems and Space-time Communications Overview of the last lecture MIMO systems -parallel decomposition; - beamforming; - MIMO channel capacity MIMO Key

More information

A rate one half code for approaching the Shannon limit by 0.1dB

A rate one half code for approaching the Shannon limit by 0.1dB 100 A rate one half code for approaching the Shannon limit by 0.1dB (IEE Electronics Letters, vol. 36, no. 15, pp. 1293 1294, July 2000) Stephan ten Brink S. ten Brink is with the Institute of Telecommunications,

More information

MAS160: Signals, Systems & Information for Media Technology. Problem Set 4. DUE: October 20, 2003

MAS160: Signals, Systems & Information for Media Technology. Problem Set 4. DUE: October 20, 2003 MAS160: Signals, Systems & Information for Media Technology Problem Set 4 DUE: October 20, 2003 Instructors: V. Michael Bove, Jr. and Rosalind Picard T.A. Jim McBride Problem 1: Simple Psychoacoustic Masking

More information