ECE 4400:693 - Information Theory
|
|
- Osborn Robertson
- 5 years ago
- Views:
Transcription
1 ECE 4400:693 - Information Theory Dr. Nghi Tran Lecture 1: Introduction & Overview Dr. Nghi Tran (ECE-University of Akron) ECE 4400:693 Information Theory 1 / 26
2 Outline 1 Course Information 2 Course Overview 3 Topics Covered 4 Research Project Dr. Nghi Tran (ECE-University of Akron) ECE 4400:693 Information Theory 2 / 26
3 Outline 1 Course Information 2 Course Overview 3 Topics Covered 4 Research Project Dr. Nghi Tran (ECE-University of Akron) ECE 4400:693 Information Theory 2 / 26
4 Outline 1 Course Information 2 Course Overview 3 Topics Covered 4 Research Project Dr. Nghi Tran (ECE-University of Akron) ECE 4400:693 Information Theory 2 / 26
5 Outline 1 Course Information 2 Course Overview 3 Topics Covered 4 Research Project Dr. Nghi Tran (ECE-University of Akron) ECE 4400:693 Information Theory 2 / 26
6 Outline Course Information 1 Course Information 2 Course Overview 3 Topics Covered 4 Research Project Dr. Nghi Tran (ECE-University of Akron) ECE 4400:693 Information Theory 3 / 26
7 Administrivia Course Information Hours and Location Lectures TuTh 9:30-10:45 ASEC 511 (North Tower) Course Webpage: Instructor Information Name: Dr. Nghi Tran Office: ASEC 352 Phone: x Webpage: Office Hours TuF 10:45-11:45 and (or) by appointment. Teaching Assistant: N/A Dr. Nghi Tran (ECE-University of Akron) ECE 4400:693 Information Theory 4 / 26
8 Course Information Logistics References: Though not required, the following references are highly recommended T. Cover and J. Thomas, Elements of Information Theory, Second Edition, John Wiley & Sons, Inc., D. Tse and P. Viswanath, Fundamentals of Wireless Communication, Cambridge University Press, 2005 Homework: Bi-weekly, with in total of 6 or 7 Research Project: In-depth study, or original research topic Assessment: 30% Homework, 25% Project, and 45% Final Exam Final Exam: Open-book Dr. Nghi Tran (ECE-University of Akron) ECE 4400:693 Information Theory 5 / 26
9 Outline Course Overview 1 Course Information 2 Course Overview 3 Topics Covered 4 Research Project Dr. Nghi Tran (ECE-University of Akron) ECE 4400:693 Information Theory 6 / 26
10 Course Overview What is Information Theory? Dr. Nghi Tran (ECE-University of Akron) ECE 4400:693 Information Theory 7 / 26
11 Course Overview What is Communication? The fundamental problem of communication is that of reproducing at one point either exactly or approximately a message selected at another point. (Claude Shannon 1948) Dr. Nghi Tran (ECE-University of Akron) ECE 4400:693 Information Theory 8 / 26
12 Course Overview Communication System Dr. Nghi Tran (ECE-University of Akron) ECE 4400:693 Information Theory 9 / 26
13 Course Overview Encoder: Source Coding Source Coding is the process of compressing the data using fewer bits to remove redundancy. Shannon s source coding theorem establishes the limits to possible data compression: Entropy. Dr. Nghi Tran (ECE-University of Akron) ECE 4400:693 Information Theory 10 / 26
14 Course Overview Encoder: Channel Coding Channel coding adds controlled redundancy to protect against channel errors. The Shannon limit or Shannon capacity of a communications channel is the theoretical maximum information transfer rate of the channel, for a particular noise level. Dr. Nghi Tran (ECE-University of Akron) ECE 4400:693 Information Theory 11 / 26
15 Course Overview Decoder Channel decoding: Decode signals, detect/correct errors. Source decoding: Decompress and restore source. Dr. Nghi Tran (ECE-University of Akron) ECE 4400:693 Information Theory 12 / 26
16 Channel Definition Course Overview X p( X/ Y) Y A communication channel is a system in which the output Y depends probabilistically on its input X: Probabilistic relationship between input and output The channel is characterized by a probability transition p(y/x) Dr. Nghi Tran (ECE-University of Akron) ECE 4400:693 Information Theory 13 / 26
17 Course Overview Channel Examples Noiseless binary channel: Input is reproduced exactly at output Binary symmetric channel: Cross probability p 1 p 0 0 p p p Gaussian channel with Gaussian noise N: Y = X + N Dr. Nghi Tran (ECE-University of Akron) ECE 4400:693 Information Theory 14 / 26
18 Course Overview Information Theory Claude E. Shannon, A Mathematical Theory of Communication. Bell System Technical Journal, 27, & , A new filed of Information Theory was developed in 1948, motivated by Fundamental Limits in Communication Theory What are these limits? Dr. Nghi Tran (ECE-University of Akron) ECE 4400:693 Information Theory 15 / 26
19 Course Overview Information Theory Motivated by Communication Theory, Information Theory addresses two fundamental questions: Source Coding: Is there a limit to how much data can be compressed? The answer is Entropy Channel Coding: Over a noisy channel, what is the minimum redundancy rate required to achieve a reliable communication, e.g.,the bit error probability can be made as low as desired? The answer is Channel Capacity Dr. Nghi Tran (ECE-University of Akron) ECE 4400:693 Information Theory 16 / 26
20 Course Overview Information Theory Motivated by Communication Theory, Information Theory addresses two fundamental questions: Source Coding: Is there a limit to how much data can be compressed? The answer is Entropy Channel Coding: Over a noisy channel, what is the minimum redundancy rate required to achieve a reliable communication, e.g.,the bit error probability can be made as low as desired? The answer is Channel Capacity Dr. Nghi Tran (ECE-University of Akron) ECE 4400:693 Information Theory 16 / 26
21 Course Overview Two Main Topics in Information Theory Main Topic 1 - Source Coding: How can we reduce the bit rate at the output of source encoding? What is the minimum bit rate required to recover the data at the receiver for two cases: 1) Distortion is NOT allowed; 2) distortion is allowed Main Topic 2: Channel Coding and Capacity How can we reduce the bit error probability by intelligently adding the redundancy for channel coding? What is the Capacity? Joint source and channel coding indeed needed? For single TX-RC channel: source and channel coding should be done separately Dr. Nghi Tran (ECE-University of Akron) ECE 4400:693 Information Theory 17 / 26
22 Course Overview Two Main Topics in Information Theory Main Topic 1 - Source Coding: How can we reduce the bit rate at the output of source encoding? What is the minimum bit rate required to recover the data at the receiver for two cases: 1) Distortion is NOT allowed; 2) distortion is allowed Main Topic 2: Channel Coding and Capacity How can we reduce the bit error probability by intelligently adding the redundancy for channel coding? What is the Capacity? Joint source and channel coding indeed needed? For single TX-RC channel: source and channel coding should be done separately Dr. Nghi Tran (ECE-University of Akron) ECE 4400:693 Information Theory 17 / 26
23 Course Overview What Else in Information Theory Information Theory also finds applications in other disciplines Electrical Engineering - Communication Theory Mathematics Computer Science Physics Economics Others Dr. Nghi Tran (ECE-University of Akron) ECE 4400:693 Information Theory 18 / 26
24 Course Overview Why We Need Information Theory? Understand communications systems well enough to engineer Make a fundamental comparison among different schemes System benchmark to design Dr. Nghi Tran (ECE-University of Akron) ECE 4400:693 Information Theory 19 / 26
25 Outline Topics Covered 1 Course Information 2 Course Overview 3 Topics Covered 4 Research Project Dr. Nghi Tran (ECE-University of Akron) ECE 4400:693 Information Theory 20 / 26
26 Topic Covered Topics Covered Some Mathematical Tools and Probability Theory Information Theory Basis Entropy, mutual information, AEP,... Data Compression Channel Capacity and Random Coding Bound Dr. Nghi Tran (ECE-University of Akron) ECE 4400:693 Information Theory 21 / 26
27 Topics Covered Topic Covered (Continued) Differential Entropy Single-User Gaussian Channel AWGN Fading with CSI, CDI MIMO Practical Coding Schemes Block Codes, Convolutional Codes, Turbo Codes Network Information Theory MAC and Broadcast Channels Interference and Relay Channels (if time permits) Dr. Nghi Tran (ECE-University of Akron) ECE 4400:693 Information Theory 22 / 26
28 Outline Research Project 1 Course Information 2 Course Overview 3 Topics Covered 4 Research Project Dr. Nghi Tran (ECE-University of Akron) ECE 4400:693 Information Theory 23 / 26
29 Research Project Research Project Main goal: get exposed to some interesting topics in Information Theory and its related applications It is your choice to select the topic. You can also pick up from the list of suggested topics The project can either be your original research, or a high quality survey of a relevant topic, or a review of some papers Dr. Nghi Tran (ECE-University of Akron) ECE 4400:693 Information Theory 24 / 26
30 Research Project Research Project - Time Line 1-page proposal: Due Nov. 14 Project report: Due Dec. 9 Project presentation in the end of the term Dr. Nghi Tran (ECE-University of Akron) ECE 4400:693 Information Theory 25 / 26
31 Research Project Thank you! Dr. Nghi Tran (ECE-University of Akron) ECE 4400:693 Information Theory 26 / 26
Multiuser Information Theory and Wireless Communications. Professor in Charge: Toby Berger Principal Lecturer: Jun Chen
Multiuser Information Theory and Wireless Communications Professor in Charge: Toby Berger Principal Lecturer: Jun Chen Where and When? 1 Good News No homework. No exam. 2 Credits:1-2 One credit: submit
More informationComputing and Communications 2. Information Theory -Channel Capacity
1896 1920 1987 2006 Computing and Communications 2. Information Theory -Channel Capacity Ying Cui Department of Electronic Engineering Shanghai Jiao Tong University, China 2017, Autumn 1 Outline Communication
More informationECE 8771, Information Theory & Coding for Digital Communications Summer 2010 Syllabus & Outline (Draft 1 - May 12, 2010)
ECE 8771, Information Theory & Coding for Digital Communications Summer 2010 Syllabus & Outline (Draft 1 - May 12, 2010) Instructor: Kevin Buckley, Tolentine 433a, 610-519-5658 (W), 610-519-4436 (F), buckley@ece.vill.edu,
More informationCourse Developer: Ranjan Bose, IIT Delhi
Course Title: Coding Theory Course Developer: Ranjan Bose, IIT Delhi Part I Information Theory and Source Coding 1. Source Coding 1.1. Introduction to Information Theory 1.2. Uncertainty and Information
More informationInformation & Communication
Information & Communication Bachelor Informatica 2014/15 January 2015 Some of these slides are copied from or heavily inspired by the University of Illinois at Chicago, ECE 534: Elements of Information
More informationENSC327/328 Communication Systems Course Information. Paul Ho Professor School of Engineering Science Simon Fraser University
ENSC327/328 Communication Systems Course Information Paul Ho Professor School of Engineering Science Simon Fraser University 1 Schedule & Instructor Class Schedule: Mon 2:30 4:20pm AQ 3159 Wed 1:30 2:20pm
More informationLecture 1 Introduction
Lecture 1 Introduction I-Hsiang Wang Department of Electrical Engineering National Taiwan University ihwang@ntu.edu.tw September 22, 2015 1 / 46 I-Hsiang Wang IT Lecture 1 Information Theory Information
More informationDetection and Estimation of Signals in Noise. Dr. Robert Schober Department of Electrical and Computer Engineering University of British Columbia
Detection and Estimation of Signals in Noise Dr. Robert Schober Department of Electrical and Computer Engineering University of British Columbia Vancouver, August 24, 2010 2 Contents 1 Basic Elements
More informationCOMMUNICATION SYSTEMS
COMMUNICATION SYSTEMS 4TH EDITION Simon Hayhin McMaster University JOHN WILEY & SONS, INC. Ш.! [ BACKGROUND AND PREVIEW 1. The Communication Process 1 2. Primary Communication Resources 3 3. Sources of
More informationError Control Coding. Aaron Gulliver Dept. of Electrical and Computer Engineering University of Victoria
Error Control Coding Aaron Gulliver Dept. of Electrical and Computer Engineering University of Victoria Topics Introduction The Channel Coding Problem Linear Block Codes Cyclic Codes BCH and Reed-Solomon
More informationLecture 1: Tue Jan 8, Lecture introduction and motivation
Lecture 1: Tue Jan 8, 2019 Lecture introduction and motivation 1 ECE 6602: Digital Communications GEORGIA INSTITUTE OF TECHNOLOGY, SPRING 2019 PREREQUISITE: ECE 6601. Strong background in probability is
More informationCOPYRIGHTED MATERIAL. Introduction. 1.1 Communication Systems
1 Introduction The reliable transmission of information over noisy channels is one of the basic requirements of digital information and communication systems. Here, transmission is understood both as transmission
More informationA Bit of network information theory
Š#/,% 0/,94%#(.)15% A Bit of network information theory Suhas Diggavi 1 Email: suhas.diggavi@epfl.ch URL: http://licos.epfl.ch Parts of talk are joint work with S. Avestimehr 2, S. Mohajer 1, C. Tian 3,
More informationLanguage of Instruction Course Level Short Cycle ( ) First Cycle (x) Second Cycle ( ) Third Cycle ( ) Term Local Credit ECTS Credit Fall 3 5
Course Details Course Name Telecommunications II Language of Instruction English Course Level Short Cycle ( ) First Cycle (x) Second Cycle ( ) Third Cycle ( ) Course Type Course Code Compulsory (x) Elective
More informationSimulink Modeling of Convolutional Encoders
Simulink Modeling of Convolutional Encoders * Ahiara Wilson C and ** Iroegbu Chbuisi, *Department of Computer Engineering, Michael Okpara University of Agriculture, Umudike, Abia State, Nigeria **Department
More informationEELE 6333: Wireless Commuications
EELE 6333: Wireless Commuications Chapter # 4 : Capacity of Wireless Channels Spring, 2012/2013 EELE 6333: Wireless Commuications - Ch.4 Dr. Musbah Shaat 1 / 18 Outline 1 Capacity in AWGN 2 Capacity of
More informationCoding for MIMO Communication Systems
Coding for MIMO Communication Systems Tolga M. Duman Arizona State University, USA Ali Ghrayeb Concordia University, Canada BICINTINNIAL BICENTENNIAL John Wiley & Sons, Ltd Contents About the Authors Preface
More informationThe Wireless Data Crunch: Motivating Research in Wireless Communications
The Wireless Data Crunch: Motivating Research in Wireless Communications Stephen Hanly CSIRO-Macquarie University Chair in Wireless Communications stephen.hanly@mq.edu.au Wireless Growth Rate Cooper s
More informationDEGRADED broadcast channels were first studied by
4296 IEEE TRANSACTIONS ON INFORMATION THEORY, VOL 54, NO 9, SEPTEMBER 2008 Optimal Transmission Strategy Explicit Capacity Region for Broadcast Z Channels Bike Xie, Student Member, IEEE, Miguel Griot,
More informationEE303: Communication Systems
EE303: Communication Systems Professor A. Manikas Chair of Communications and Array Processing Imperial College London An Overview of Fundamentals: Channels, Criteria and Limits Prof. A. Manikas (Imperial
More informationChapter 1 INTRODUCTION TO SOURCE CODING AND CHANNEL CODING. Whether a source is analog or digital, a digital communication
1 Chapter 1 INTRODUCTION TO SOURCE CODING AND CHANNEL CODING 1.1 SOURCE CODING Whether a source is analog or digital, a digital communication system is designed to transmit information in digital form.
More informationInformation flow over wireless networks: a deterministic approach
Information flow over wireless networks: a deterministic approach alman Avestimehr In collaboration with uhas iggavi (EPFL) and avid Tse (UC Berkeley) Overview Point-to-point channel Information theory
More informationEENG 444 / ENAS 944 Digital Communication Systems
EENG 444 / ENAS 944 Digital Communication Systems Introduction!! Wenjun Hu Communication Systems What s the first thing that comes to your mind? Communication Systems What s the first thing that comes
More informationThe Z Channel. Nihar Jindal Department of Electrical Engineering Stanford University, Stanford, CA
The Z Channel Sriram Vishwanath Dept. of Elec. and Computer Engg. Univ. of Texas at Austin, Austin, TX E-mail : sriram@ece.utexas.edu Nihar Jindal Department of Electrical Engineering Stanford University,
More informationConvolutional Coding Using Booth Algorithm For Application in Wireless Communication
Available online at www.interscience.in Convolutional Coding Using Booth Algorithm For Application in Wireless Communication Sishir Kalita, Parismita Gogoi & Kandarpa Kumar Sarma Department of Electronics
More informationBER Analysis of BPSK for Block Codes and Convolution Codes Over AWGN Channel
International Journal of Pure and Applied Mathematics Volume 114 No. 11 2017, 221-230 ISSN: 1311-8080 (printed version); ISSN: 1314-3395 (on-line version) url: http://www.ijpam.eu ijpam.eu BER Analysis
More informationA Brief Introduction to Information Theory and Lossless Coding
A Brief Introduction to Information Theory and Lossless Coding 1 INTRODUCTION This document is intended as a guide to students studying 4C8 who have had no prior exposure to information theory. All of
More informationENGR 4323/5323 Digital and Analog Communication
ENGR 4323/5323 Digital and Analog Communication Chapter 1 Introduction Engineering and Physics University of Central Oklahoma Dr. Mohamed Bingabr Course Materials Textbook: Modern Digital and Analog Communication,
More informationMultiple Antennas. Mats Bengtsson, Björn Ottersten. Basic Transmission Schemes 1 September 8, Presentation Outline
Multiple Antennas Capacity and Basic Transmission Schemes Mats Bengtsson, Björn Ottersten Basic Transmission Schemes 1 September 8, 2005 Presentation Outline Channel capacity Some fine details and misconceptions
More informationBANDWIDTH-PERFORMANCE TRADEOFFS FOR A TRANSMISSION WITH CONCURRENT SIGNALS
BANDWIDTH-PERFORMANCE TRADEOFFS FOR A TRANSMISSION WITH CONCURRENT SIGNALS Aminata A. Garba Dept. of Electrical and Computer Engineering, Carnegie Mellon University aminata@ece.cmu.edu ABSTRACT We consider
More informationS Coding Methods (5 cr) P. Prerequisites. Literature (1) Contents
S-72.3410 Introduction 1 S-72.3410 Introduction 3 S-72.3410 Coding Methods (5 cr) P Lectures: Mondays 9 12, room E110, and Wednesdays 9 12, hall S4 (on January 30th this lecture will be held in E111!)
More informationOn Fading Broadcast Channels with Partial Channel State Information at the Transmitter
On Fading Broadcast Channels with Partial Channel State Information at the Transmitter Ravi Tandon 1, ohammad Ali addah-ali, Antonia Tulino, H. Vincent Poor 1, and Shlomo Shamai 3 1 Dept. of Electrical
More informationEDI042 Error Control Coding (Kodningsteknik)
EDI042 Error Control Coding (Kodningsteknik) Chapter 1: Introduction Michael Lentmaier November 3, 2014 Michael Lentmaier, Fall 2014 EDI042 Error Control Coding: Chapter 1 1 / 26 Course overview I Lectures:
More informationInterference: An Information Theoretic View
Interference: An Information Theoretic View David Tse Wireless Foundations U.C. Berkeley ISIT 2009 Tutorial June 28 Thanks: Changho Suh. Context Two central phenomena in wireless communications: Fading
More informationOn the Achievable Diversity-vs-Multiplexing Tradeoff in Cooperative Channels
On the Achievable Diversity-vs-Multiplexing Tradeoff in Cooperative Channels Kambiz Azarian, Hesham El Gamal, and Philip Schniter Dept of Electrical Engineering, The Ohio State University Columbus, OH
More informationIEEE C /02R1. IEEE Mobile Broadband Wireless Access <http://grouper.ieee.org/groups/802/mbwa>
23--29 IEEE C82.2-3/2R Project Title Date Submitted IEEE 82.2 Mobile Broadband Wireless Access Soft Iterative Decoding for Mobile Wireless Communications 23--29
More informationBasics of Error Correcting Codes
Basics of Error Correcting Codes Drawing from the book Information Theory, Inference, and Learning Algorithms Downloadable or purchasable: http://www.inference.phy.cam.ac.uk/mackay/itila/book.html CSE
More informationSIGNALS AND SYSTEMS LABORATORY 13: Digital Communication
SIGNALS AND SYSTEMS LABORATORY 13: Digital Communication INTRODUCTION Digital Communication refers to the transmission of binary, or digital, information over analog channels. In this laboratory you will
More informationEE107 Communication Systems. Introduction
EE107 Communication Systems Introduction Mai Vu 5 September 2017 What is communication? Overview Exchanging/imparting of information What is a communication system? A system facilitating communication
More informationECEn 665: Antennas and Propagation for Wireless Communications 131. s(t) = A c [1 + αm(t)] cos (ω c t) (9.27)
ECEn 665: Antennas and Propagation for Wireless Communications 131 9. Modulation Modulation is a way to vary the amplitude and phase of a sinusoidal carrier waveform in order to transmit information. When
More informationLecture #2. EE 471C / EE 381K-17 Wireless Communication Lab. Professor Robert W. Heath Jr.
Lecture #2 EE 471C / EE 381K-17 Wireless Communication Lab Professor Robert W. Heath Jr. Preview of today s lecture u Introduction to digital communication u Components of a digital communication system
More informationOptimal Power Allocation over Fading Channels with Stringent Delay Constraints
1 Optimal Power Allocation over Fading Channels with Stringent Delay Constraints Xiangheng Liu Andrea Goldsmith Dept. of Electrical Engineering, Stanford University Email: liuxh,andrea@wsl.stanford.edu
More informationCourse Specifications
Development Cluster Computer and Networking Engineering (CNE) Cluster Lead Developer Amir Asif Module Names Module 1: Baseband and Bandpass Communications (40 characters or less Module 2: Channel Coding
More informationMulticasting over Multiple-Access Networks
ing oding apacity onclusions ing Department of Electrical Engineering and omputer Sciences University of alifornia, Berkeley May 9, 2006 EE 228A Outline ing oding apacity onclusions 1 2 3 4 oding 5 apacity
More informationInformation Theory: the Day after Yesterday
: the Day after Yesterday Department of Electrical Engineering and Computer Science Chicago s Shannon Centennial Event September 23, 2016 : the Day after Yesterday IT today Outline The birth of information
More informationPart A: Question & Answers UNIT I AMPLITUDE MODULATION
PANDIAN SARASWATHI YADAV ENGINEERING COLLEGE DEPARTMENT OF ELECTRONICS & COMMUNICATON ENGG. Branch: ECE EC6402 COMMUNICATION THEORY Semester: IV Part A: Question & Answers UNIT I AMPLITUDE MODULATION 1.
More informationISSN: International Journal of Innovative Research in Science, Engineering and Technology
ISSN: 39-8753 Volume 3, Issue 7, July 4 Graphical User Interface for Simulating Convolutional Coding with Viterbi Decoding in Digital Communication Systems using Matlab Ezeofor C. J., Ndinechi M.C. Lecturer,
More informationAdaptive Digital Video Transmission with STBC over Rayleigh Fading Channels
2012 7th International ICST Conference on Communications and Networking in China (CHINACOM) Adaptive Digital Video Transmission with STBC over Rayleigh Fading Channels Jia-Chyi Wu Dept. of Communications,
More informationVariations on the Index Coding Problem: Pliable Index Coding and Caching
Variations on the Index Coding Problem: Pliable Index Coding and Caching T. Liu K. Wan D. Tuninetti University of Illinois at Chicago Shannon s Centennial, Chicago, September 23rd 2016 D. Tuninetti (UIC)
More informationInformation Theory and Huffman Coding
Information Theory and Huffman Coding Consider a typical Digital Communication System: A/D Conversion Sampling and Quantization D/A Conversion Source Encoder Source Decoder bit stream bit stream Channel
More informationBell Labs celebrates 50 years of Information Theory
1 Bell Labs celebrates 50 years of Information Theory An Overview of Information Theory Humans are symbol-making creatures. We communicate by symbols -- growls and grunts, hand signals, and drawings painted
More informationBreaking Spectrum Gridlock With Cognitive Radios: An Information Theoretic Perspective
Breaking Spectrum Gridlock With Cognitive Radios: An Information Theoretic Perspective Naroa Zurutuza - EE360 Winter 2014 Introduction Cognitive Radio: Wireless communication system that intelligently
More informationIDMA Technology and Comparison survey of Interleavers
International Journal of Scientific and Research Publications, Volume 3, Issue 9, September 2013 1 IDMA Technology and Comparison survey of Interleavers Neelam Kumari 1, A.K.Singh 2 1 (Department of Electronics
More informationCommunication Theory II
Communication Theory II Lecture 13: Information Theory (cont d) Ahmed Elnakib, PhD Assistant Professor, Mansoura University, Egypt March 22 th, 2015 1 o Source Code Generation Lecture Outlines Source Coding
More informationMassive MIMO: Signal Structure, Efficient Processing, and Open Problems I
Massive MIMO: Signal Structure, Efficient Processing, and Open Problems I Saeid Haghighatshoar Communications and Information Theory Group (CommIT) Technische Universität Berlin CoSIP Winter Retreat Berlin,
More informationChapter 1 Coding for Reliable Digital Transmission and Storage
Wireless Information Transmission System Lab. Chapter 1 Coding for Reliable Digital Transmission and Storage Institute of Communications Engineering National Sun Yat-sen University 1.1 Introduction A major
More informationCommunications Overhead as the Cost of Constraints
Communications Overhead as the Cost of Constraints J. Nicholas Laneman and Brian. Dunn Department of Electrical Engineering University of Notre Dame Email: {jnl,bdunn}@nd.edu Abstract This paper speculates
More informationEECS 473 Advanced Embedded Systems. Lecture 14 Wireless in the real world
EECS 473 Advanced Embedded Systems Lecture 14 Wireless in the real world Team status updates Team Alert (Home Alert) Team Fitness (Fitness watch) Team Glasses Team Mouse (Control in hand) Team WiFi (WiFi
More informationCommunication Theory II
Communication Theory II Lecture 14: Information Theory (cont d) Ahmed Elnakib, PhD Assistant Professor, Mansoura University, Egypt March 25 th, 2015 1 Previous Lecture: Source Code Generation: Lossless
More informationPerformance Evaluation and Comparative Analysis of Various Concatenated Error Correcting Codes Using BPSK Modulation for AWGN Channel
International Journal of Electronics and Communication Engineering. ISSN 0974-2166 Volume 5, Number 3 (2012), pp. 235-244 International Research Publication House http://www.irphouse.com Performance Evaluation
More informationApproaching the Capacity of the Multi-Pair Bidirectional Relay Network via a Divide and Conquer Strategy
Approaching the Capacity of the Multi-Pair Bidirectional elay Network via a Divide and Conquer Strategy Salman Avestimehr Cornell In collaboration with: Amin Khajehnejad (Caltech), Aydin Sezgin (UC Irvine)
More informationPROJECT 5: DESIGNING A VOICE MODEM. Instructor: Amir Asif
PROJECT 5: DESIGNING A VOICE MODEM Instructor: Amir Asif CSE4214: Digital Communications (Fall 2012) Computer Science and Engineering, York University 1. PURPOSE In this laboratory project, you will design
More informationTSKS01 Digital Communication Lecture 1
TSKS01 Digital Communication Lecture 1 Introduction, Repetition, Channels as Filters, Complex-baseband representation Emil Björnson Department of Electrical Engineering (ISY) Division of Communication
More informationEECS 473 Advanced Embedded Systems. Lecture 13 Start on Wireless
EECS 473 Advanced Embedded Systems Lecture 13 Start on Wireless Team status updates Losing track of who went last. Cyberspeaker VisibleLight Elevate Checkout SmartHaus Upcoming Last lecture this Thursday
More informationSPECTRUM SHARING IN CRN USING ARP PROTOCOL- ANALYSIS OF HIGH DATA RATE
Int. J. Chem. Sci.: 14(S3), 2016, 794-800 ISSN 0972-768X www.sadgurupublications.com SPECTRUM SHARING IN CRN USING ARP PROTOCOL- ANALYSIS OF HIGH DATA RATE ADITYA SAI *, ARSHEYA AFRAN and PRIYANKA Information
More informationPhysical Layer: Outline
18-345: Introduction to Telecommunication Networks Lectures 3: Physical Layer Peter Steenkiste Spring 2015 www.cs.cmu.edu/~prs/nets-ece Physical Layer: Outline Digital networking Modulation Characterization
More informationInformation Theory: A Lighthouse for Understanding Modern Communication Systems. Ajit Kumar Chaturvedi Department of EE IIT Kanpur
Information Theory: A Lighthouse for Understanding Modern Communication Systems Ajit Kumar Chaturvedi Department of EE IIT Kanpur akc@iitk.ac.in References Fundamentals of Digital Communication by Upamanyu
More informationAbout Homework. The rest parts of the course: focus on popular standards like GSM, WCDMA, etc.
About Homework The rest parts of the course: focus on popular standards like GSM, WCDMA, etc. Good news: No complicated mathematics and calculations! Concepts: Understanding and remember! Homework: review
More informationStudy of Turbo Coded OFDM over Fading Channel
International Journal of Engineering Research and Development e-issn: 2278-067X, p-issn: 2278-800X, www.ijerd.com Volume 3, Issue 2 (August 2012), PP. 54-58 Study of Turbo Coded OFDM over Fading Channel
More informationPower Efficiency of LDPC Codes under Hard and Soft Decision QAM Modulated OFDM
Advance in Electronic and Electric Engineering. ISSN 2231-1297, Volume 4, Number 5 (2014), pp. 463-468 Research India Publications http://www.ripublication.com/aeee.htm Power Efficiency of LDPC Codes under
More informationCapacity of Middleton Class-A Impulsive Noise Channel with Binary Input
Appl. Math. Inf. Sci. 9, No. 3, 1291-1298 (2015) 1291 Applied Mathematics & Information Sciences An International Journal http://dx.doi.org/10.12785/amis/090323 Capacity of Middleton Class-A Impulsive
More informationEmpirical Rate-Distortion Study of Compressive Sensing-based Joint Source-Channel Coding
Empirical -Distortion Study of Compressive Sensing-based Joint Source-Channel Coding Muriel L. Rambeloarison, Soheil Feizi, Georgios Angelopoulos, and Muriel Médard Research Laboratory of Electronics Massachusetts
More informationPower and Bandwidth Allocation in Cooperative Dirty Paper Coding
Power and Bandwidth Allocation in Cooperative Dirty Paper Coding Chris T. K. Ng 1, Nihar Jindal 2 Andrea J. Goldsmith 3, Urbashi Mitra 4 1 Stanford University/MIT, 2 Univeristy of Minnesota 3 Stanford
More informationDegrees of Freedom of the MIMO X Channel
Degrees of Freedom of the MIMO X Channel Syed A. Jafar Electrical Engineering and Computer Science University of California Irvine Irvine California 9697 USA Email: syed@uci.edu Shlomo Shamai (Shitz) Department
More informationTCET3202 Analog and digital Communications II
NEW YORK CITY COLLEGE OF TECHNOLOGY The City University of New York DEPARTMENT: SUBJECT CODE AND TITLE: COURSE DESCRIPTION: REQUIRED COURSE Electrical and Telecommunications Engineering Technology TCET3202
More informationCapacity and Cooperation in Wireless Networks
Capacity and Cooperation in Wireless Networks Chris T. K. Ng and Andrea J. Goldsmith Stanford University Abstract We consider fundamental capacity limits in wireless networks where nodes can cooperate
More informationAn Iterative Noncoherent Relay Receiver for the Two-way Relay Channel
An Iterative Noncoherent Relay Receiver for the Two-way Relay Channel Terry Ferrett 1 Matthew Valenti 1 Don Torrieri 2 1 West Virginia University 2 U.S. Army Research Laboratory June 12th, 2013 1 / 26
More informationLECTURE VI: LOSSLESS COMPRESSION ALGORITHMS DR. OUIEM BCHIR
1 LECTURE VI: LOSSLESS COMPRESSION ALGORITHMS DR. OUIEM BCHIR 2 STORAGE SPACE Uncompressed graphics, audio, and video data require substantial storage capacity. Storing uncompressed video is not possible
More informationInternational Journal of Scientific & Engineering Research Volume 9, Issue 3, March ISSN
International Journal of Scientific & Engineering Research Volume 9, Issue 3, March-2018 1605 FPGA Design and Implementation of Convolution Encoder and Viterbi Decoder Mr.J.Anuj Sai 1, Mr.P.Kiran Kumar
More informationState-Dependent Relay Channel: Achievable Rate and Capacity of a Semideterministic Class
IEEE TRANSACTIONS ON INFORMATION THEORY, VOL. 59, NO. 5, MAY 2013 2629 State-Dependent Relay Channel: Achievable Rate and Capacity of a Semideterministic Class Majid Nasiri Khormuji, Member, IEEE, Abbas
More informationSHANNON showed that feedback does not increase the capacity
IEEE TRANSACTIONS ON INFORMATION THEORY, VOL. 57, NO. 5, MAY 2011 2667 Feedback Capacity of the Gaussian Interference Channel to Within 2 Bits Changho Suh, Student Member, IEEE, and David N. C. Tse, Fellow,
More informationLecture 4: Wireless Physical Layer: Channel Coding. Mythili Vutukuru CS 653 Spring 2014 Jan 16, Thursday
Lecture 4: Wireless Physical Layer: Channel Coding Mythili Vutukuru CS 653 Spring 2014 Jan 16, Thursday Channel Coding Modulated waveforms disrupted by signal propagation through wireless channel leads
More informationRab Nawaz. Prof. Zhang Wenyi
Rab Nawaz PhD Scholar (BL16006002) School of Information Science and Technology University of Science and Technology of China, Hefei Email: rabnawaz@mail.ustc.edu.cn Submitted to Prof. Zhang Wenyi wenyizha@ustc.edu.cn
More informationCoding for the Slepian-Wolf Problem With Turbo Codes
Coding for the Slepian-Wolf Problem With Turbo Codes Jan Bajcsy and Patrick Mitran Department of Electrical and Computer Engineering, McGill University Montréal, Québec, HA A7, Email: {jbajcsy, pmitran}@tsp.ece.mcgill.ca
More informationMulti-user Two-way Deterministic Modulo 2 Adder Channels When Adaptation Is Useless
Forty-Ninth Annual Allerton Conference Allerton House, UIUC, Illinois, USA September 28-30, 2011 Multi-user Two-way Deterministic Modulo 2 Adder Channels When Adaptation Is Useless Zhiyu Cheng, Natasha
More informationSoft Channel Encoding; A Comparison of Algorithms for Soft Information Relaying
IWSSIP, -3 April, Vienna, Austria ISBN 978-3--38-4 Soft Channel Encoding; A Comparison of Algorithms for Soft Information Relaying Mehdi Mortazawi Molu Institute of Telecommunications Vienna University
More informationIMPERIAL COLLEGE of SCIENCE, TECHNOLOGY and MEDICINE, DEPARTMENT of ELECTRICAL and ELECTRONIC ENGINEERING.
IMPERIAL COLLEGE of SCIENCE, TECHNOLOGY and MEDICINE, DEPARTMENT of ELECTRICAL and ELECTRONIC ENGINEERING. COMPACT LECTURE NOTES on COMMUNICATION THEORY. Prof. Athanassios Manikas, version Spring 22 Digital
More informationSymmetric Decentralized Interference Channels with Noisy Feedback
4 IEEE International Symposium on Information Theory Symmetric Decentralized Interference Channels with Noisy Feedback Samir M. Perlaza Ravi Tandon and H. Vincent Poor Institut National de Recherche en
More informationEntropy, Coding and Data Compression
Entropy, Coding and Data Compression Data vs. Information yes, not, yes, yes, not not In ASCII, each item is 3 8 = 24 bits of data But if the only possible answers are yes and not, there is only one bit
More informationOPTIMAL POWER ALLOCATION FOR MULTIPLE ACCESS CHANNEL
International Journal of Wireless & Mobile Networks (IJWMN) Vol. 8, No. 6, December 06 OPTIMAL POWER ALLOCATION FOR MULTIPLE ACCESS CHANNEL Zouhair Al-qudah Communication Engineering Department, AL-Hussein
More informationNotes 15: Concatenated Codes, Turbo Codes and Iterative Processing
16.548 Notes 15: Concatenated Codes, Turbo Codes and Iterative Processing Outline! Introduction " Pushing the Bounds on Channel Capacity " Theory of Iterative Decoding " Recursive Convolutional Coding
More informationImplementation of Different Interleaving Techniques for Performance Evaluation of CDMA System
Implementation of Different Interleaving Techniques for Performance Evaluation of CDMA System Anshu Aggarwal 1 and Vikas Mittal 2 1 Anshu Aggarwal is student of M.Tech. in the Department of Electronics
More informationENERGY EFFICIENT RELAY SELECTION SCHEMES FOR COOPERATIVE UNIFORMLY DISTRIBUTED WIRELESS SENSOR NETWORKS
ENERGY EFFICIENT RELAY SELECTION SCHEMES FOR COOPERATIVE UNIFORMLY DISTRIBUTED WIRELESS SENSOR NETWORKS WAFIC W. ALAMEDDINE A THESIS IN THE DEPARTMENT OF ELECTRICAL AND COMPUTER ENGINEERING PRESENTED IN
More informationJoint Relaying and Network Coding in Wireless Networks
Joint Relaying and Network Coding in Wireless Networks Sachin Katti Ivana Marić Andrea Goldsmith Dina Katabi Muriel Médard MIT Stanford Stanford MIT MIT Abstract Relaying is a fundamental building block
More informationMAS.160 / MAS.510 / MAS.511 Signals, Systems and Information for Media Technology Fall 2007
MIT OpenCourseWare http://ocw.mit.edu MAS.160 / MAS.510 / MAS.511 Signals, Systems and Information for Media Technology Fall 2007 For information about citing these materials or our Terms of Use, visit:
More informationWireless Communication: Concepts, Techniques, and Models. Hongwei Zhang
Wireless Communication: Concepts, Techniques, and Models Hongwei Zhang http://www.cs.wayne.edu/~hzhang Outline Digital communication over radio channels Channel capacity MIMO: diversity and parallel channels
More informationIntroduction to Coding Theory
Coding Theory Massoud Malek Introduction to Coding Theory Introduction. Coding theory originated with the advent of computers. Early computers were huge mechanical monsters whose reliability was low compared
More informationELEC E7210: Communication Theory. Lecture 11: MIMO Systems and Space-time Communications
ELEC E7210: Communication Theory Lecture 11: MIMO Systems and Space-time Communications Overview of the last lecture MIMO systems -parallel decomposition; - beamforming; - MIMO channel capacity MIMO Key
More informationA rate one half code for approaching the Shannon limit by 0.1dB
100 A rate one half code for approaching the Shannon limit by 0.1dB (IEE Electronics Letters, vol. 36, no. 15, pp. 1293 1294, July 2000) Stephan ten Brink S. ten Brink is with the Institute of Telecommunications,
More informationMAS160: Signals, Systems & Information for Media Technology. Problem Set 4. DUE: October 20, 2003
MAS160: Signals, Systems & Information for Media Technology Problem Set 4 DUE: October 20, 2003 Instructors: V. Michael Bove, Jr. and Rosalind Picard T.A. Jim McBride Problem 1: Simple Psychoacoustic Masking
More information