Information Theory: the Day after Yesterday
|
|
- Kristopher Townsend
- 5 years ago
- Views:
Transcription
1 : the Day after Yesterday Department of Electrical Engineering and Computer Science Chicago s Shannon Centennial Event September 23, 2016
2 : the Day after Yesterday IT today
3 Outline The birth of information theory; Applications; The theory today; An outlook.
4 Outline The birth of information theory; Applications; The theory today; An outlook.
5 Outline The birth of information theory; Applications; The theory today; An outlook.
6 Outline The birth of information theory; Applications; The theory today; An outlook.
7 Communication systems existing in mid 20th century telegraph (1830s) Morse code: A. _ B _... C _. _ telephone (Bell 1876) wireless telegraph (Marconi, 1887) AM radio (early 1900s) television ( ) frequency modulation (FM) (Armstrong, 1936) pulse-coded modulation (PCM) (Reeves, ) vocoder (Dudley, 1939) spread spectrum (1940s) Known techniques: efficient encoding of text, understanding of bandwidth, digital vs. continuous-time signaling, tradeoff between fidelity and bandwidth.
8 Communication systems existing in mid 20th century telegraph (1830s) Morse code: A. _ B _... C _. _ telephone (Bell 1876) wireless telegraph (Marconi, 1887) AM radio (early 1900s) television ( ) frequency modulation (FM) (Armstrong, 1936) pulse-coded modulation (PCM) (Reeves, ) vocoder (Dudley, 1939) spread spectrum (1940s) Known techniques: efficient encoding of text, understanding of bandwidth, digital vs. continuous-time signaling, tradeoff between fidelity and bandwidth.
9 Communication systems existing in mid 20th century telegraph (1830s) Morse code: A. _ B _... C _. _ telephone (Bell 1876) wireless telegraph (Marconi, 1887) AM radio (early 1900s) television ( ) frequency modulation (FM) (Armstrong, 1936) pulse-coded modulation (PCM) (Reeves, ) vocoder (Dudley, 1939) spread spectrum (1940s) Known techniques: efficient encoding of text, understanding of bandwidth, digital vs. continuous-time signaling, tradeoff between fidelity and bandwidth.
10 Communication systems existing in mid 20th century telegraph (1830s) Morse code: A. _ B _... C _. _ telephone (Bell 1876) wireless telegraph (Marconi, 1887) AM radio (early 1900s) television ( ) frequency modulation (FM) (Armstrong, 1936) pulse-coded modulation (PCM) (Reeves, ) vocoder (Dudley, 1939) spread spectrum (1940s) Known techniques: efficient encoding of text, understanding of bandwidth, digital vs. continuous-time signaling, tradeoff between fidelity and bandwidth.
11 Communication systems existing in mid 20th century telegraph (1830s) Morse code: A. _ B _... C _. _ telephone (Bell 1876) wireless telegraph (Marconi, 1887) AM radio (early 1900s) television ( ) frequency modulation (FM) (Armstrong, 1936) pulse-coded modulation (PCM) (Reeves, ) vocoder (Dudley, 1939) spread spectrum (1940s) Known techniques: efficient encoding of text, understanding of bandwidth, digital vs. continuous-time signaling, tradeoff between fidelity and bandwidth.
12 Communication systems existing in mid 20th century telegraph (1830s) Morse code: A. _ B _... C _. _ telephone (Bell 1876) wireless telegraph (Marconi, 1887) AM radio (early 1900s) television ( ) frequency modulation (FM) (Armstrong, 1936) pulse-coded modulation (PCM) (Reeves, ) vocoder (Dudley, 1939) spread spectrum (1940s) Known techniques: efficient encoding of text, understanding of bandwidth, digital vs. continuous-time signaling, tradeoff between fidelity and bandwidth.
13 Communication systems existing in mid 20th century telegraph (1830s) Morse code: A. _ B _... C _. _ telephone (Bell 1876) wireless telegraph (Marconi, 1887) AM radio (early 1900s) television ( ) frequency modulation (FM) (Armstrong, 1936) pulse-coded modulation (PCM) (Reeves, ) vocoder (Dudley, 1939) spread spectrum (1940s) Known techniques: efficient encoding of text, understanding of bandwidth, digital vs. continuous-time signaling, tradeoff between fidelity and bandwidth.
14 Communication systems existing in mid 20th century telegraph (1830s) Morse code: A. _ B _... C _. _ telephone (Bell 1876) wireless telegraph (Marconi, 1887) AM radio (early 1900s) television ( ) frequency modulation (FM) (Armstrong, 1936) pulse-coded modulation (PCM) (Reeves, ) vocoder (Dudley, 1939) spread spectrum (1940s) Known techniques: efficient encoding of text, understanding of bandwidth, digital vs. continuous-time signaling, tradeoff between fidelity and bandwidth.
15 Communication systems existing in mid 20th century telegraph (1830s) Morse code: A. _ B _... C _. _ telephone (Bell 1876) wireless telegraph (Marconi, 1887) AM radio (early 1900s) television ( ) frequency modulation (FM) (Armstrong, 1936) pulse-coded modulation (PCM) (Reeves, ) vocoder (Dudley, 1939) spread spectrum (1940s) Known techniques: efficient encoding of text, understanding of bandwidth, digital vs. continuous-time signaling, tradeoff between fidelity and bandwidth.
16 Communication systems existing in mid 20th century telegraph (1830s) Morse code: A. _ B _... C _. _ telephone (Bell 1876) wireless telegraph (Marconi, 1887) AM radio (early 1900s) television ( ) frequency modulation (FM) (Armstrong, 1936) pulse-coded modulation (PCM) (Reeves, ) vocoder (Dudley, 1939) spread spectrum (1940s) Known techniques: efficient encoding of text, understanding of bandwidth, digital vs. continuous-time signaling, tradeoff between fidelity and bandwidth.
17 Communication systems existing in mid 20th century telegraph (1830s) Morse code: A. _ B _... C _. _ telephone (Bell 1876) wireless telegraph (Marconi, 1887) AM radio (early 1900s) television ( ) frequency modulation (FM) (Armstrong, 1936) pulse-coded modulation (PCM) (Reeves, ) vocoder (Dudley, 1939) spread spectrum (1940s) Known techniques: efficient encoding of text, understanding of bandwidth, digital vs. continuous-time signaling, tradeoff between fidelity and bandwidth.
18 Fundamental questions Nyquist, Certain factors affecting telegraph speed, W log(the number of signal levels) How much improvement in telegraphy trasmission rate could be achieved by replacing the Morse code by an optimum code? Hartley, Transmission of information, The capacity of a channel is proportional to its bandwith. What is the maximum telegraph signaling speed sustainable by bandlimited linear systems? Answered by the sampling theorem (Küpfmüller 1924, Nyquist 1928, Kotelnikov 1933, J. Whittaker 1915)
19 Fundamental questions Nyquist, Certain factors affecting telegraph speed, W log(the number of signal levels) How much improvement in telegraphy trasmission rate could be achieved by replacing the Morse code by an optimum code? Hartley, Transmission of information, The capacity of a channel is proportional to its bandwith. What is the maximum telegraph signaling speed sustainable by bandlimited linear systems? Answered by the sampling theorem (Küpfmüller 1924, Nyquist 1928, Kotelnikov 1933, J. Whittaker 1915)
20 Fundamental questions Nyquist, Certain factors affecting telegraph speed, W log(the number of signal levels) How much improvement in telegraphy trasmission rate could be achieved by replacing the Morse code by an optimum code? Hartley, Transmission of information, The capacity of a channel is proportional to its bandwith. What is the maximum telegraph signaling speed sustainable by bandlimited linear systems? Answered by the sampling theorem (Küpfmüller 1924, Nyquist 1928, Kotelnikov 1933, J. Whittaker 1915)
21 Inception of a unifying theory Excerpt of a letter from Claude Shannon to Vannevar Bush on Feb. 16, 1939 [Library of Congress]:
22 Inception of a unifying theory Excerpt of a letter from Claude Shannon to Vannevar Bush on Feb. 16, 1939 [Library of Congress]:
23 The Bell System Technical Journal Vol. XXVII July, 194S No. 3 THE A Mathematical Theory of Communication By C. E. SHANNON Introduction recent development of various methods of modulation such as PCM and PPM which exchange bandwidth for signal-to-noise ratio has intensified the interest in a general theory of communication. A basis for such a theory is contained in the important papers of Nyquist 1 and Hartley 2 on this subject. In the present paper we will extend the theory to include a number of new factors, in particular the effect of noise in the channel, and the savings possible due to the statistical structure of the original message and due to the nature of the final destination of the information. The fundamental problem of communication is that of reproducing at one point either exactly or approximately a message selected at another point. Frequently the messages have meaning; that is they refer to or are correlated according to some system with certain physical or conceptual entities. These semantic aspects of communication are irrelevant to the engineering problem. The significant aspect is that the actual message is one selected from a set of possible messages. The system must be designed to operate for each possible selection, not just the one which will actually be chosen since this is unknown at the time of design. If the number of messages in the set is finite then this number or any monotonic function of this number can be regarded as a measure of the inis chosen from the set, all choices
24 2. A transmitter which operates on the message in some way to produce a Outline Yesterday Today: applications Today: theory Outlook signal suitable for transmission over the channel. In telephony this operation consists merely of changing sound pressure into a proportional electrical current. Shannon s abstraction In telegraphy we have an encoding operation which produces a sequence of dots, dashes and spaces on the channel corresponding to the message. In a multiplex PCM system the different speech functions must be sampled, compressed, quantized and encoded, and finally interleaved INFORMATION SOURCE TRANSMITTER RECEIVER DESTINATION MESSAGE SIGNAL O RECEIVED SIGNAL NOISE SOURCE Fig. 1 Schematic diagram of a general communication system. properly to construct the signal. Vocoder systems, television, and frequency modulation are other examples of complex operations applied Source as random process (Shannon worked on cryptography); the message to obtain the signal. Channel 3. Themodeled channel is merely as a the random medium transformation; used to transmit the signal from Related transmitter work: to receiver. It may be a pair of wires, a coaxial cable, a band of radio frequencies, a beam of light, etc. N. Wiener, Extrapolation, interpolation, and smoothing of 4. The receiver ordinarily performs the inverse operation of that done by thestationary transmitter, reconstructing time series, the1949; message from the signal. 5. The destination is person (or thing) for whom the message in- S. O. Rice, Mathematical analysis of random noise, tended. We wish to consider certain general problems involving communication systems. To do this it is first necessary to represent the various elements
25 2. A transmitter which operates on the message in some way to produce a Outline Yesterday Today: applications Today: theory Outlook signal suitable for transmission over the channel. In telephony this operation consists merely of changing sound pressure into a proportional electrical current. Shannon s abstraction In telegraphy we have an encoding operation which produces a sequence of dots, dashes and spaces on the channel corresponding to the message. In a multiplex PCM system the different speech functions must be sampled, compressed, quantized and encoded, and finally interleaved INFORMATION SOURCE TRANSMITTER RECEIVER DESTINATION MESSAGE SIGNAL O RECEIVED SIGNAL NOISE SOURCE Fig. 1 Schematic diagram of a general communication system. properly to construct the signal. Vocoder systems, television, and frequency modulation are other examples of complex operations applied Source as random process (Shannon worked on cryptography); the message to obtain the signal. Channel 3. Themodeled channel is merely as a the random medium transformation; used to transmit the signal from Related transmitter work: to receiver. It may be a pair of wires, a coaxial cable, a band of radio frequencies, a beam of light, etc. N. Wiener, Extrapolation, interpolation, and smoothing of 4. The receiver ordinarily performs the inverse operation of that done by thestationary transmitter, reconstructing time series, the1949; message from the signal. 5. The destination is person (or thing) for whom the message in- S. O. Rice, Mathematical analysis of random noise, tended. We wish to consider certain general problems involving communication systems. To do this it is first necessary to represent the various elements
26 2. A transmitter which operates on the message in some way to produce a Outline Yesterday Today: applications Today: theory Outlook signal suitable for transmission over the channel. In telephony this operation consists merely of changing sound pressure into a proportional electrical current. Shannon s abstraction In telegraphy we have an encoding operation which produces a sequence of dots, dashes and spaces on the channel corresponding to the message. In a multiplex PCM system the different speech functions must be sampled, compressed, quantized and encoded, and finally interleaved INFORMATION SOURCE TRANSMITTER RECEIVER DESTINATION MESSAGE SIGNAL O RECEIVED SIGNAL NOISE SOURCE Fig. 1 Schematic diagram of a general communication system. properly to construct the signal. Vocoder systems, television, and frequency modulation are other examples of complex operations applied Source as random process (Shannon worked on cryptography); the message to obtain the signal. Channel 3. Themodeled channel is merely as a the random medium transformation; used to transmit the signal from Related transmitter work: to receiver. It may be a pair of wires, a coaxial cable, a band of radio frequencies, a beam of light, etc. N. Wiener, Extrapolation, interpolation, and smoothing of 4. The receiver ordinarily performs the inverse operation of that done by thestationary transmitter, reconstructing time series, the1949; message from the signal. 5. The destination is person (or thing) for whom the message in- S. O. Rice, Mathematical analysis of random noise, tended. We wish to consider certain general problems involving communication systems. To do this it is first necessary to represent the various elements
27 2. A transmitter which operates on the message in some way to produce a Outline Yesterday Today: applications Today: theory Outlook signal suitable for transmission over the channel. In telephony this operation consists merely of changing sound pressure into a proportional electrical current. Shannon s abstraction In telegraphy we have an encoding operation which produces a sequence of dots, dashes and spaces on the channel corresponding to the message. In a multiplex PCM system the different speech functions must be sampled, compressed, quantized and encoded, and finally interleaved INFORMATION SOURCE TRANSMITTER RECEIVER DESTINATION MESSAGE SIGNAL O RECEIVED SIGNAL NOISE SOURCE Fig. 1 Schematic diagram of a general communication system. properly to construct the signal. Vocoder systems, television, and frequency modulation are other examples of complex operations applied Source as random process (Shannon worked on cryptography); the message to obtain the signal. Channel 3. Themodeled channel is merely as a the random medium transformation; used to transmit the signal from Related transmitter work: to receiver. It may be a pair of wires, a coaxial cable, a band of radio frequencies, a beam of light, etc. N. Wiener, Extrapolation, interpolation, and smoothing of 4. The receiver ordinarily performs the inverse operation of that done by thestationary transmitter, reconstructing time series, the1949; message from the signal. 5. The destination is person (or thing) for whom the message in- S. O. Rice, Mathematical analysis of random noise, tended. We wish to consider certain general problems involving communication systems. To do this it is first necessary to represent the various elements
28 2. A transmitter which operates on the message in some way to produce a Outline Yesterday Today: applications Today: theory Outlook signal suitable for transmission over the channel. In telephony this operation consists merely of changing sound pressure into a proportional electrical current. Shannon s abstraction In telegraphy we have an encoding operation which produces a sequence of dots, dashes and spaces on the channel corresponding to the message. In a multiplex PCM system the different speech functions must be sampled, compressed, quantized and encoded, and finally interleaved INFORMATION SOURCE TRANSMITTER RECEIVER DESTINATION MESSAGE SIGNAL O RECEIVED SIGNAL NOISE SOURCE Fig. 1 Schematic diagram of a general communication system. properly to construct the signal. Vocoder systems, television, and frequency modulation are other examples of complex operations applied Source as random process (Shannon worked on cryptography); the message to obtain the signal. Channel 3. Themodeled channel is merely as a the random medium transformation; used to transmit the signal from Related transmitter work: to receiver. It may be a pair of wires, a coaxial cable, a band of radio frequencies, a beam of light, etc. N. Wiener, Extrapolation, interpolation, and smoothing of 4. The receiver ordinarily performs the inverse operation of that done by thestationary transmitter, reconstructing time series, the1949; message from the signal. 5. The destination is person (or thing) for whom the message in- S. O. Rice, Mathematical analysis of random noise, tended. We wish to consider certain general problems involving communication systems. To do this it is first necessary to represent the various elements
29 Shannon s theorems Theorem (Lossless source coding) H < R Theorem (Channel coding) R < C Theorem (Source channel separation) H < C
30 Shannon s theorems Theorem (Lossless source coding) H < R Theorem (Channel coding) R < C Theorem (Source channel separation) H < C
31 Shannon s theorems Theorem (Lossless source coding) H < R Theorem (Channel coding) R < C Theorem (Source channel separation) H < C
32 Roles played by IT since 1948 IT predicts the fundamental limits lossless data compression lossy data compression channel coding network coding signal processing statistical inference complexity theory portfolio theory IT as a design driver IT as a foundation of sciences and engineering
33 Roles played by IT since 1948 IT predicts the fundamental limits lossless data compression lossy data compression channel coding network coding signal processing statistical inference complexity theory portfolio theory IT as a design driver IT as a foundation of sciences and engineering
34 Roles played by IT since 1948 IT predicts the fundamental limits lossless data compression lossy data compression channel coding network coding signal processing statistical inference complexity theory portfolio theory IT as a design driver IT as a foundation of sciences and engineering
35 Roles played by IT since 1948 IT predicts the fundamental limits lossless data compression lossy data compression channel coding network coding signal processing statistical inference complexity theory portfolio theory IT as a design driver IT as a foundation of sciences and engineering
36 Roles played by IT since 1948 IT predicts the fundamental limits lossless data compression lossy data compression channel coding network coding signal processing statistical inference complexity theory portfolio theory IT as a design driver IT as a foundation of sciences and engineering
37 Roles played by IT since 1948 IT predicts the fundamental limits lossless data compression lossy data compression channel coding network coding signal processing statistical inference complexity theory portfolio theory IT as a design driver IT as a foundation of sciences and engineering
38 Roles played by IT since 1948 IT predicts the fundamental limits lossless data compression lossy data compression channel coding network coding signal processing statistical inference complexity theory portfolio theory IT as a design driver IT as a foundation of sciences and engineering
39 Roles played by IT since 1948 IT predicts the fundamental limits lossless data compression lossy data compression channel coding network coding signal processing statistical inference complexity theory portfolio theory IT as a design driver IT as a foundation of sciences and engineering
40 Roles played by IT since 1948 IT predicts the fundamental limits lossless data compression lossy data compression channel coding network coding signal processing statistical inference complexity theory portfolio theory IT as a design driver IT as a foundation of sciences and engineering
41 Roles played by IT since 1948 IT predicts the fundamental limits lossless data compression lossy data compression channel coding network coding signal processing statistical inference complexity theory portfolio theory IT as a design driver IT as a foundation of sciences and engineering
42 Roles played by IT since 1948 IT predicts the fundamental limits lossless data compression lossy data compression channel coding network coding signal processing statistical inference complexity theory portfolio theory IT as a design driver IT as a foundation of sciences and engineering
43 Lossless data compression Huffman coding (a component in JPEG, MP3, MPEG-4)
44 Universal lossless data compression Softwares based on the Lempel-Ziv algorithm:
45 Lossy data compression Examples: mp3, JPEG, MPEG-4.
46 Channel coding: deep-space communication Over 100 million km away.
47 Channel coding: modem Example: trellis codes Also, CRC for the internet
48 Channel coding: Compact Disk (CD) Reed-Solomon codes
49 Channel capacity: WiFi and multiple antennas Also, space-time codes.
50 Source and channel coding: cellular networks Vocoder (speech bit stream); modem (bit stream waveform); Also, MIMO, OFDM, CDMA, multiuser detection.
51 What is IT? theorems about the fundamental limits algorithms for achieving/approaching those limits people who call themselves information theorists and develop those theorems and algorithms
52 Editorial areas: coding techniques coding theory communications communication networks complexity cryptography detection and estimation machine learning probability and statistics quantum information theory sequences Shannon theory signal processing source coding statistical learning
53 Editorial areas: coding techniques coding theory communications communication networks complexity cryptography detection and estimation machine learning probability and statistics quantum information theory sequences Shannon theory signal processing source coding statistical learning
54 Editorial areas: coding techniques coding theory communications communication networks complexity cryptography detection and estimation machine learning probability and statistics quantum information theory sequences Shannon theory signal processing source coding statistical learning
55 Single-user information theory Efficient lossless/lossy codes for ergodic sources; Efficient capacity-achieving codes for ergodic channels; Capacity of Gaussian MIMO channels generally known; Capacity of certain quantum channels known;...
56 Single-user information theory Efficient lossless/lossy codes for ergodic sources; Efficient capacity-achieving codes for ergodic channels; Capacity of Gaussian MIMO channels generally known; Capacity of certain quantum channels known;...
57 Single-user information theory Efficient lossless/lossy codes for ergodic sources; Efficient capacity-achieving codes for ergodic channels; Capacity of Gaussian MIMO channels generally known; Capacity of certain quantum channels known;...
58 Single-user information theory Efficient lossless/lossy codes for ergodic sources; Efficient capacity-achieving codes for ergodic channels; Capacity of Gaussian MIMO channels generally known; Capacity of certain quantum channels known;...
59 Single-user information theory Efficient lossless/lossy codes for ergodic sources; Efficient capacity-achieving codes for ergodic channels; Capacity of Gaussian MIMO channels generally known; Capacity of certain quantum channels known;...
60 Finite-blocklength channel coding rate 2328 IEEE TRANSACTIONS ON INFORMATION THEORY, VOL. 56, NO. 5, MAY 2010 Fig. 7. Bounds for the AWGN channel, SNR =20dB, =10. R(n, ɛ) = C n 1 V Q 1 (ɛ) + O(n 1 log n). asymptotic expansion of. In Figs. 6 and 7 we can maximal probability of error, whereas the RCU bound requires see that the bound is also quite competitive for finite. further manipulation (e.g., Appendix A). Comparing the bound and the classical bounds of Feinstein and Gallager, we see that, as expected, the bound is uniformly better than Feinstein s bound. In the setup of Fig. 6, the We turn to the asymptotic analysis of the maximum achiev- IV. NORMAL APPROXIMATION bound is a significant improvement over Gallager s bound, able rate for a given blocklength. In this section, our goal is coming very close to the Shannon bound as well as the con- to show a normal-approximation refinement of the coding the-
61 Almost lossless analog compression I.i.d. (analog) source X 1,..., X n, with Renyi information dimension d(x). Encoder Decoder Minimum ɛ-achievable rate linear Borel R (ɛ) = d(x) continuous continuous R 0 (ɛ) = 0 Borel Lipschitz R(ɛ) = d(x)
62 Almost lossless analog compression I.i.d. (analog) source X 1,..., X n, with Renyi information dimension d(x). Encoder Decoder Minimum ɛ-achievable rate linear Borel R (ɛ) = d(x) continuous continuous R 0 (ɛ) = 0 Borel Lipschitz R(ɛ) = d(x) Compressed sensing exploits the sparsity of natural signals.
63 Multi-user information theory extension of Shannon s basic theorems to networks with multiple sources and receivers; new ingredients: interference, cooperation, side information; multiaccess channel capacity known; degraded broadcast channel capacity known; capacity of Gaussian MIMO broadcast channel known; capacity of Gaussian interference channel well approximated; lossy compression of correlated sources partially solved; degrees of freedom of MIMO interference channels known; fundamental limits of caching;...
64 Multi-user information theory extension of Shannon s basic theorems to networks with multiple sources and receivers; new ingredients: interference, cooperation, side information; multiaccess channel capacity known; degraded broadcast channel capacity known; capacity of Gaussian MIMO broadcast channel known; capacity of Gaussian interference channel well approximated; lossy compression of correlated sources partially solved; degrees of freedom of MIMO interference channels known; fundamental limits of caching;...
65 Multi-user information theory extension of Shannon s basic theorems to networks with multiple sources and receivers; new ingredients: interference, cooperation, side information; multiaccess channel capacity known; degraded broadcast channel capacity known; capacity of Gaussian MIMO broadcast channel known; capacity of Gaussian interference channel well approximated; lossy compression of correlated sources partially solved; degrees of freedom of MIMO interference channels known; fundamental limits of caching;...
66 Multi-user information theory extension of Shannon s basic theorems to networks with multiple sources and receivers; new ingredients: interference, cooperation, side information; multiaccess channel capacity known; degraded broadcast channel capacity known; capacity of Gaussian MIMO broadcast channel known; capacity of Gaussian interference channel well approximated; lossy compression of correlated sources partially solved; degrees of freedom of MIMO interference channels known; fundamental limits of caching;...
67 Multi-user information theory extension of Shannon s basic theorems to networks with multiple sources and receivers; new ingredients: interference, cooperation, side information; multiaccess channel capacity known; degraded broadcast channel capacity known; capacity of Gaussian MIMO broadcast channel known; capacity of Gaussian interference channel well approximated; lossy compression of correlated sources partially solved; degrees of freedom of MIMO interference channels known; fundamental limits of caching;...
68 Multi-user information theory extension of Shannon s basic theorems to networks with multiple sources and receivers; new ingredients: interference, cooperation, side information; multiaccess channel capacity known; degraded broadcast channel capacity known; capacity of Gaussian MIMO broadcast channel known; capacity of Gaussian interference channel well approximated; lossy compression of correlated sources partially solved; degrees of freedom of MIMO interference channels known; fundamental limits of caching;...
69 Multi-user information theory extension of Shannon s basic theorems to networks with multiple sources and receivers; new ingredients: interference, cooperation, side information; multiaccess channel capacity known; degraded broadcast channel capacity known; capacity of Gaussian MIMO broadcast channel known; capacity of Gaussian interference channel well approximated; lossy compression of correlated sources partially solved; degrees of freedom of MIMO interference channels known; fundamental limits of caching;...
70 Multi-user information theory extension of Shannon s basic theorems to networks with multiple sources and receivers; new ingredients: interference, cooperation, side information; multiaccess channel capacity known; degraded broadcast channel capacity known; capacity of Gaussian MIMO broadcast channel known; capacity of Gaussian interference channel well approximated; lossy compression of correlated sources partially solved; degrees of freedom of MIMO interference channels known; fundamental limits of caching;...
71 Multi-user information theory extension of Shannon s basic theorems to networks with multiple sources and receivers; new ingredients: interference, cooperation, side information; multiaccess channel capacity known; degraded broadcast channel capacity known; capacity of Gaussian MIMO broadcast channel known; capacity of Gaussian interference channel well approximated; lossy compression of correlated sources partially solved; degrees of freedom of MIMO interference channels known; fundamental limits of caching;...
72 Multi-user information theory extension of Shannon s basic theorems to networks with multiple sources and receivers; new ingredients: interference, cooperation, side information; multiaccess channel capacity known; degraded broadcast channel capacity known; capacity of Gaussian MIMO broadcast channel known; capacity of Gaussian interference channel well approximated; lossy compression of correlated sources partially solved; degrees of freedom of MIMO interference channels known; fundamental limits of caching;...
73 The new many-user regime k = 1, n classical single-user IT k fixed, n multiuser IT k after n Large-system analysis k, n many-user IT (with application to the IoT)
74 Foundation for thermal physics?
75 Foundation for evolution, neuroscience? Examples: evolution and information acquisition; understanding neural spikes.
76 Foundation for evolution, neuroscience? Examples: evolution and information acquisition; understanding neural spikes.
77 Outline Yesterday Today: applications Today: theory Outlook Foundation for economics?
78 Use of entropy, mutual information, relative entropy probability and statistics complexity theory computational theory biostatistics machine learning physics chemistry economics neuroscience...
79 Use of entropy, mutual information, relative entropy probability and statistics complexity theory computational theory biostatistics machine learning physics chemistry economics neuroscience...
80 Use of entropy, mutual information, relative entropy probability and statistics complexity theory computational theory biostatistics machine learning physics chemistry economics neuroscience...
81 Use of entropy, mutual information, relative entropy probability and statistics complexity theory computational theory biostatistics machine learning physics chemistry economics neuroscience...
82 Use of entropy, mutual information, relative entropy probability and statistics complexity theory computational theory biostatistics machine learning physics chemistry economics neuroscience...
83 Use of entropy, mutual information, relative entropy probability and statistics complexity theory computational theory biostatistics machine learning physics chemistry economics neuroscience...
84 Use of entropy, mutual information, relative entropy probability and statistics complexity theory computational theory biostatistics machine learning physics chemistry economics neuroscience...
85 Use of entropy, mutual information, relative entropy probability and statistics complexity theory computational theory biostatistics machine learning physics chemistry economics neuroscience...
86 Use of entropy, mutual information, relative entropy probability and statistics complexity theory computational theory biostatistics machine learning physics chemistry economics neuroscience...
87 Use of entropy, mutual information, relative entropy probability and statistics complexity theory computational theory biostatistics machine learning physics chemistry economics neuroscience...
88 Open problems: single-user exact throughput-delay-reliability trade-off (non-asymptotics); the channel reliability function; capacity of channels with memory; deletions, insertions, synchronization; joint source-channel coding;...
89 Open problems: single-user exact throughput-delay-reliability trade-off (non-asymptotics); the channel reliability function; capacity of channels with memory; deletions, insertions, synchronization; joint source-channel coding;...
90 Open problems: single-user exact throughput-delay-reliability trade-off (non-asymptotics); the channel reliability function; capacity of channels with memory; deletions, insertions, synchronization; joint source-channel coding;...
91 Open problems: single-user exact throughput-delay-reliability trade-off (non-asymptotics); the channel reliability function; capacity of channels with memory; deletions, insertions, synchronization; joint source-channel coding;...
92 Open problems: single-user exact throughput-delay-reliability trade-off (non-asymptotics); the channel reliability function; capacity of channels with memory; deletions, insertions, synchronization; joint source-channel coding;...
93 Open problems: single-user exact throughput-delay-reliability trade-off (non-asymptotics); the channel reliability function; capacity of channels with memory; deletions, insertions, synchronization; joint source-channel coding;...
94 Open problems: multiuser problems multiple description of sources; broadcast channel capacity; interference channel capacity; two-way channel capacity; relay channel capacity; capacity of multiuser channels with feedback;...
95 Open problems: multiuser problems multiple description of sources; broadcast channel capacity; interference channel capacity; two-way channel capacity; relay channel capacity; capacity of multiuser channels with feedback;...
96 Open problems: multiuser problems multiple description of sources; broadcast channel capacity; interference channel capacity; two-way channel capacity; relay channel capacity; capacity of multiuser channels with feedback;...
97 Open problems: multiuser problems multiple description of sources; broadcast channel capacity; interference channel capacity; two-way channel capacity; relay channel capacity; capacity of multiuser channels with feedback;...
98 Open problems: multiuser problems multiple description of sources; broadcast channel capacity; interference channel capacity; two-way channel capacity; relay channel capacity; capacity of multiuser channels with feedback;...
99 Open problems: multiuser problems multiple description of sources; broadcast channel capacity; interference channel capacity; two-way channel capacity; relay channel capacity; capacity of multiuser channels with feedback;...
100 Open problems: multiuser problems multiple description of sources; broadcast channel capacity; interference channel capacity; two-way channel capacity; relay channel capacity; capacity of multiuser channels with feedback;...
101 Match Overview Open problem: mobile ad hoc networks One node per network serves as a gateway Collaboration takes place over internet-like infrastructure connected to the gateway (models realistic internets) DARPA Spectrum Collaboration Challenge ( ) Team 1 Team 2 Team 3 Team 4 Team 5 IP Traffic Ensemble of up to 5 teams placed in arena Incumbent Each node is given IP traffic Sources and destinations are contained in the same network Traffic will emulate multiple canonical types Arena may also contain other Non-Collaborative Radios (NCR): Incumbents Jammers Radio environment emulated in real-time: Large-scale path loss Multipath & Doppler Channel correlation Motion questions to darpa-baa-16-48@darpa.mil Distribution A. Approved for public release 27
102 IT is a way of thinking Like Shannon, we should always question what are the fundamental limits; We then invent schemes to achieve those limits; New progress is often made when we challenge existing constraints and assumptions (network coding, full duplex,...).
103 IT is a way of thinking Like Shannon, we should always question what are the fundamental limits; We then invent schemes to achieve those limits; New progress is often made when we challenge existing constraints and assumptions (network coding, full duplex,...).
104 IT is a way of thinking Like Shannon, we should always question what are the fundamental limits; We then invent schemes to achieve those limits; New progress is often made when we challenge existing constraints and assumptions (network coding, full duplex,...).
105 What about Shannon s premises? The fundamental problem of communication is that of reproducing at one point either exactly or approximately a message selected at another point. Frequently the messages have meaning; that is they refer to or are correlated according to some system with certain physical or conceptual entities. These semantic aspects of communication are irrelevant to the engineering problem. The significant aspect is that the actual message is one selected from a set of possible messages. The system must be designed to operate for each possible selection, not just the one which will actually be chosen since this is unknown at the time of design.
106
COMMUNICATION SYSTEMS
COMMUNICATION SYSTEMS 4TH EDITION Simon Hayhin McMaster University JOHN WILEY & SONS, INC. Ш.! [ BACKGROUND AND PREVIEW 1. The Communication Process 1 2. Primary Communication Resources 3 3. Sources of
More informationFundamentals of Digital Communication
Fundamentals of Digital Communication Network Infrastructures A.A. 2017/18 Digital communication system Analog Digital Input Signal Analog/ Digital Low Pass Filter Sampler Quantizer Source Encoder Channel
More informationPhysical Layer: Outline
18-345: Introduction to Telecommunication Networks Lectures 3: Physical Layer Peter Steenkiste Spring 2015 www.cs.cmu.edu/~prs/nets-ece Physical Layer: Outline Digital networking Modulation Characterization
More informationInformation Theory at the Extremes
Information Theory at the Extremes David Tse Department of EECS, U.C. Berkeley September 5, 2002 Wireless Networks Workshop at Cornell Information Theory in Wireless Wireless communication is an old subject.
More informationELEC 7073 Digital Communication III
ELEC 7073 Digital Communication III Lecturers: Dr. S. D. Ma and Dr. Y. Q. Zhou (sdma@eee.hku.hk; yqzhou@eee.hku.hk) Date & Time: Tuesday: 7:00-9:30pm Place: CYC Lecture Room A Notes can be obtained from:
More informationOptimal Power Allocation over Fading Channels with Stringent Delay Constraints
1 Optimal Power Allocation over Fading Channels with Stringent Delay Constraints Xiangheng Liu Andrea Goldsmith Dept. of Electrical Engineering, Stanford University Email: liuxh,andrea@wsl.stanford.edu
More informationCourse Developer: Ranjan Bose, IIT Delhi
Course Title: Coding Theory Course Developer: Ranjan Bose, IIT Delhi Part I Information Theory and Source Coding 1. Source Coding 1.1. Introduction to Information Theory 1.2. Uncertainty and Information
More informationLecture #2. EE 471C / EE 381K-17 Wireless Communication Lab. Professor Robert W. Heath Jr.
Lecture #2 EE 471C / EE 381K-17 Wireless Communication Lab Professor Robert W. Heath Jr. Preview of today s lecture u Introduction to digital communication u Components of a digital communication system
More informationEITF25 Internet Techniques and Applications L2: Physical layer. Stefan Höst
EITF25 Internet Techniques and Applications L2: Physical layer Stefan Höst Data vs signal Data: Static representation of information For storage Signal: Dynamic representation of information For transmission
More informationDigital Communications
Digital Communications Chapter 1. Introduction Po-Ning Chen, Professor Institute of Communications Engineering National Chiao-Tung University, Taiwan Digital Communications: Chapter 1 Ver. 2015.10.19 Po-Ning
More informationChapter 10. User Cooperative Communications
Chapter 10 User Cooperative Communications 1 Outline Introduction Relay Channels User-Cooperation in Wireless Networks Multi-Hop Relay Channel Summary 2 Introduction User cooperative communication is a
More informationCommunications IB Paper 6 Handout 1: Introduction, Signals and Channels
Communications IB Paper 6 Handout 1: Introduction, Signals and Channels Jossy Sayir Signal Processing and Communications Lab Department of Engineering University of Cambridge jossy.sayir@eng.cam.ac.uk
More informationCommunications II. Mohammad Fathi Text book: J.G. Proakis and M. Salehi, Communication System Engineering (2 nd Ed) Syllabus
Communications II Mohammad Fathi mfathi@uok.ac.ir Course information Text book: J.G. Proakis and M. Salehi, Communication System Engineering (2 nd Ed) Syllabus Introduction: [1.1, 1.2, 1.3, and 1.4] Review
More informationAdvanced Communication Systems -Wireless Communication Technology
Advanced Communication Systems -Wireless Communication Technology Dr. Junwei Lu The School of Microelectronic Engineering Faculty of Engineering and Information Technology Outline Introduction to Wireless
More informationEE107 Communication Systems. Introduction
EE107 Communication Systems Introduction Mai Vu 5 September 2017 What is communication? Overview Exchanging/imparting of information What is a communication system? A system facilitating communication
More informationDownloaded from 1
VII SEMESTER FINAL EXAMINATION-2004 Attempt ALL questions. Q. [1] How does Digital communication System differ from Analog systems? Draw functional block diagram of DCS and explain the significance of
More information2. LITERATURE REVIEW
2. LITERATURE REVIEW In this section, a brief review of literature on Performance of Antenna Diversity Techniques, Alamouti Coding Scheme, WiMAX Broadband Wireless Access Technology, Mobile WiMAX Technology,
More informationOverview of Digital Mobile Communications
Overview of Digital Mobile Communications Dong In Kim (dikim@ece.skku.ac.kr) Wireless Communications Lab 1 Outline Digital Communications Multiple Access Techniques Power Control for CDMA IMT-2000 System
More informationAdoption of this document as basis for broadband wireless access PHY
Project Title Date Submitted IEEE 802.16 Broadband Wireless Access Working Group Proposal on modulation methods for PHY of FWA 1999-10-29 Source Jay Bao and Partha De Mitsubishi Electric ITA 571 Central
More informationSIGNALS AND SYSTEMS LABORATORY 13: Digital Communication
SIGNALS AND SYSTEMS LABORATORY 13: Digital Communication INTRODUCTION Digital Communication refers to the transmission of binary, or digital, information over analog channels. In this laboratory you will
More informationThe world s first collaborative machine-intelligence competition to overcome spectrum scarcity
The world s first collaborative machine-intelligence competition to overcome spectrum scarcity Paul Tilghman Program Manager, DARPA/MTO 8/11/16 1 This slide intentionally left blank 2 This slide intentionally
More informationOptimizing future wireless communication systems
Optimizing future wireless communication systems "Optimization and Engineering" symposium Louvain-la-Neuve, May 24 th 2006 Jonathan Duplicy (www.tele.ucl.ac.be/digicom/duplicy) 1 Outline History Challenges
More informationIntroduction to the Communication Process. Digital Transmission MEEC
Introduction to the Communication Process Digital Transmission MEEC José Manuel Bioucas Dias Instituto Superior Técnico, 2014 Outline 1. The communication process 2. Elements of a communication system
More informationWaveform Encoding - PCM. BY: Dr.AHMED ALKHAYYAT. Chapter Two
Chapter Two Layout: 1. Introduction. 2. Pulse Code Modulation (PCM). 3. Differential Pulse Code Modulation (DPCM). 4. Delta modulation. 5. Adaptive delta modulation. 6. Sigma Delta Modulation (SDM). 7.
More informationWireless Communication: Concepts, Techniques, and Models. Hongwei Zhang
Wireless Communication: Concepts, Techniques, and Models Hongwei Zhang http://www.cs.wayne.edu/~hzhang Outline Digital communication over radio channels Channel capacity MIMO: diversity and parallel channels
More information3432 IEEE TRANSACTIONS ON INFORMATION THEORY, VOL. 53, NO. 10, OCTOBER 2007
3432 IEEE TRANSACTIONS ON INFORMATION THEORY, VOL 53, NO 10, OCTOBER 2007 Resource Allocation for Wireless Fading Relay Channels: Max-Min Solution Yingbin Liang, Member, IEEE, Venugopal V Veeravalli, Fellow,
More informationChapter 1 INTRODUCTION TO SOURCE CODING AND CHANNEL CODING. Whether a source is analog or digital, a digital communication
1 Chapter 1 INTRODUCTION TO SOURCE CODING AND CHANNEL CODING 1.1 SOURCE CODING Whether a source is analog or digital, a digital communication system is designed to transmit information in digital form.
More informationDigital Audio. Lecture-6
Digital Audio Lecture-6 Topics today Digitization of sound PCM Lossless predictive coding 2 Sound Sound is a pressure wave, taking continuous values Increase / decrease in pressure can be measured in amplitude,
More informationChapter 1 Acknowledgment:
Chapter 1 Acknowledgment: This material is based on the slides formatted by Dr Sunilkumar S. Manvi and Dr Mahabaleshwar S. Kakkasageri, the authors of the textbook: Wireless and Mobile Networks, concepts
More informationMultiple Input Multiple Output (MIMO) Operation Principles
Afriyie Abraham Kwabena Multiple Input Multiple Output (MIMO) Operation Principles Helsinki Metropolia University of Applied Sciences Bachlor of Engineering Information Technology Thesis June 0 Abstract
More informationChapter 3 Digital Transmission Fundamentals
Chapter 3 Digital Transmission Fundamentals Digital Representation of Information Why Digital Communications? Digital Representation of Analog Signals Characterization of Communication Channels Fundamental
More informationDepartment of Electronics and Communication Engineering 1
UNIT I SAMPLING AND QUANTIZATION Pulse Modulation 1. Explain in detail the generation of PWM and PPM signals (16) (M/J 2011) 2. Explain in detail the concept of PWM and PAM (16) (N/D 2012) 3. What is the
More informationtechniques are means of reducing the bandwidth needed to represent the human voice. In mobile
8 2. LITERATURE SURVEY The available radio spectrum for the wireless radio communication is very limited hence to accommodate maximum number of users the speech is compressed. The speech compression techniques
More informationETSF15 Physical layer communication. Stefan Höst
ETSF15 Physical layer communication Stefan Höst Physical layer Analog vs digital (Previous lecture) Transmission media Modulation Represent digital data in a continuous world Disturbances, Noise and distortion
More informationProfessor Paulraj and Bringing MIMO to Practice
Professor Paulraj and Bringing MIMO to Practice Michael P. Fitz UnWiReD Laboratory-UCLA http://www.unwired.ee.ucla.edu/ April 21, 24 UnWiReD Lab A Little Reminiscence PhD in 1989 First research area after
More informationDigital modulation techniques
Outline Introduction Signal, random variable, random process and spectra Analog modulation Analog to digital conversion Digital transmission through baseband channels Signal space representation Optimal
More informationCommunications I (ELCN 306)
Communications I (ELCN 306) c Samy S. Soliman Electronics and Electrical Communications Engineering Department Cairo University, Egypt Email: samy.soliman@cu.edu.eg Website: http://scholar.cu.edu.eg/samysoliman
More informationAnalysis and Improvements of Linear Multi-user user MIMO Precoding Techniques
1 Analysis and Improvements of Linear Multi-user user MIMO Precoding Techniques Bin Song and Martin Haardt Outline 2 Multi-user user MIMO System (main topic in phase I and phase II) critical problem Downlink
More informationChapter-1: Introduction
Chapter-1: Introduction The purpose of a Communication System is to transport an information bearing signal from a source to a user destination via a communication channel. MODEL OF A COMMUNICATION SYSTEM
More informationAPPLICATIONS OF DSP OBJECTIVES
APPLICATIONS OF DSP OBJECTIVES This lecture will discuss the following: Introduce analog and digital waveform coding Introduce Pulse Coded Modulation Consider speech-coding principles Introduce the channel
More informationDistributed Source Coding: A New Paradigm for Wireless Video?
Distributed Source Coding: A New Paradigm for Wireless Video? Christine Guillemot, IRISA/INRIA, Campus universitaire de Beaulieu, 35042 Rennes Cédex, FRANCE Christine.Guillemot@irisa.fr The distributed
More informationInformation theory II. Fisica dell Energia - a.a. 2017/2018
Information theory II Fisica dell Energia - a.a. 2017/2018 Transfer of information Communication Communication is the transfer of information from one place to another. This should be done as efficiently
More informationREVIEW OF COOPERATIVE SCHEMES BASED ON DISTRIBUTED CODING STRATEGY
INTERNATIONAL JOURNAL OF RESEARCH IN COMPUTER APPLICATIONS AND ROBOTICS ISSN 2320-7345 REVIEW OF COOPERATIVE SCHEMES BASED ON DISTRIBUTED CODING STRATEGY P. Suresh Kumar 1, A. Deepika 2 1 Assistant Professor,
More informationMODULATION AND MULTIPLE ACCESS TECHNIQUES
1 MODULATION AND MULTIPLE ACCESS TECHNIQUES Networks and Communication Department Dr. Marwah Ahmed Outlines 2 Introduction Digital Transmission Digital Modulation Digital Transmission of Analog Signal
More informationUNIT-1. Basic signal processing operations in digital communication
UNIT-1 Lecture-1 Basic signal processing operations in digital communication The three basic elements of every communication systems are Transmitter, Receiver and Channel. The Overall purpose of this system
More informationOFDM and MC-CDMA A Primer
OFDM and MC-CDMA A Primer L. Hanzo University of Southampton, UK T. Keller Analog Devices Ltd., Cambridge, UK IEEE PRESS IEEE Communications Society, Sponsor John Wiley & Sons, Ltd Contents About the Authors
More informationMasters of Engineering in Electrical Engineering Course Syllabi ( ) City University of New York--College of Staten Island
City University of New York--College of Staten Island Masters of Engineering in Electrical Engineering Course Syllabi (2017-2018) Required Core Courses ELE 600/ MTH 6XX Probability Theory and Stochastic
More informationCSCD 433 Network Programming Fall Lecture 5 Physical Layer Continued
CSCD 433 Network Programming Fall 2016 Lecture 5 Physical Layer Continued 1 Topics Definitions Analog Transmission of Digital Data Digital Transmission of Analog Data Multiplexing 2 Different Types of
More informationINTRODUCTION TO COMMUNICATION SYSTEMS AND TRANSMISSION MEDIA
COMM.ENG INTRODUCTION TO COMMUNICATION SYSTEMS AND TRANSMISSION MEDIA 9/9/2017 LECTURES 1 Objectives To give a background on Communication system components and channels (media) A distinction between analogue
More informationCooperative versus Full-Duplex Communication in Cellular Networks: A Comparison of the Total Degrees of Freedom. Amr El-Keyi and Halim Yanikomeroglu
Cooperative versus Full-Duplex Communication in Cellular Networks: A Comparison of the Total Degrees of Freedom Amr El-Keyi and Halim Yanikomeroglu Outline Introduction Full-duplex system Cooperative system
More informationData Communication. Chapter 3 Data Transmission
Data Communication Chapter 3 Data Transmission ١ Terminology (1) Transmitter Receiver Medium Guided medium e.g. twisted pair, coaxial cable, optical fiber Unguided medium e.g. air, water, vacuum ٢ Terminology
More informationCHAPTER 4. PULSE MODULATION Part 2
CHAPTER 4 PULSE MODULATION Part 2 Pulse Modulation Analog pulse modulation: Sampling, i.e., information is transmitted only at discrete time instants. e.g. PAM, PPM and PDM Digital pulse modulation: Sampling
More informationAdaptive Wireless. Communications. gl CAMBRIDGE UNIVERSITY PRESS. MIMO Channels and Networks SIDDHARTAN GOVJNDASAMY DANIEL W.
Adaptive Wireless Communications MIMO Channels and Networks DANIEL W. BLISS Arizona State University SIDDHARTAN GOVJNDASAMY Franklin W. Olin College of Engineering, Massachusetts gl CAMBRIDGE UNIVERSITY
More informationLecture 1 Introduction
Lecture 1 Introduction I-Hsiang Wang Department of Electrical Engineering National Taiwan University ihwang@ntu.edu.tw September 22, 2015 1 / 46 I-Hsiang Wang IT Lecture 1 Information Theory Information
More informationOpportunistic Communication in Wireless Networks
Opportunistic Communication in Wireless Networks David Tse Department of EECS, U.C. Berkeley October 10, 2001 Networking, Communications and DSP Seminar Communication over Wireless Channels Fundamental
More informationThe Physical Layer Outline
The Physical Layer Outline Theoretical Basis for Data Communications Digital Modulation and Multiplexing Guided Transmission Media (copper and fiber) Public Switched Telephone Network and DSLbased Broadband
More informationChannel Capacity Estimation in MIMO Systems Based on Water-Filling Algorithm
Channel Capacity Estimation in MIMO Systems Based on Water-Filling Algorithm 1 Ch.Srikanth, 2 B.Rajanna 1 PG SCHOLAR, 2 Assistant Professor Vaagdevi college of engineering. (warangal) ABSTRACT power than
More informationEECS 380: Wireless Technologies Week 7-8
EECS 380: Wireless Technologies Week 7-8 Michael L. Honig Northwestern University May 2018 Outline Diversity, MIMO Multiple Access techniques FDMA, TDMA OFDMA (LTE) CDMA (3G, 802.11b, Bluetooth) Random
More informationEXPERIMENT WISE VIVA QUESTIONS
EXPERIMENT WISE VIVA QUESTIONS Pulse Code Modulation: 1. Draw the block diagram of basic digital communication system. How it is different from analog communication system. 2. What are the advantages of
More informationCSCD 433 Network Programming Fall Lecture 5 Physical Layer Continued
CSCD 433 Network Programming Fall 2016 Lecture 5 Physical Layer Continued 1 Topics Definitions Analog Transmission of Digital Data Digital Transmission of Analog Data Multiplexing 2 Different Types of
More informationCross-Layer Design and CR
EE360: Lecture 11 Outline Cross-Layer Design and CR Announcements HW 1 posted, due Feb. 24 at 5pm Progress reports due Feb. 29 at midnight (not Feb. 27) Interference alignment Beyond capacity: consummating
More informationEEE 309 Communication Theory
EEE 309 Communication Theory Semester: January 2016 Dr. Md. Farhad Hossain Associate Professor Department of EEE, BUET Email: mfarhadhossain@eee.buet.ac.bd Office: ECE 331, ECE Building Part 05 Pulse Code
More informationPerformance Analysis of Cooperative Communication System with a SISO system in Flat Fading Rayleigh channel
Performance Analysis of Cooperative Communication System with a SISO system in Flat Fading Rayleigh channel Sara Viqar 1, Shoab Ahmed 2, Zaka ul Mustafa 3 and Waleed Ejaz 4 1, 2, 3 National University
More informationLecture 12: Summary Advanced Digital Communications (EQ2410) 1
: Advanced Digital Communications (EQ2410) 1 Monday, Mar. 7, 2016 15:00-17:00, B23 1 Textbook: U. Madhow, Fundamentals of Digital Communications, 2008 1 / 15 Overview 1 2 3 4 2 / 15 Equalization Maximum
More informationECE 4400:693 - Information Theory
ECE 4400:693 - Information Theory Dr. Nghi Tran Lecture 1: Introduction & Overview Dr. Nghi Tran (ECE-University of Akron) ECE 4400:693 Information Theory 1 / 26 Outline 1 Course Information 2 Course Overview
More informationChapter 2 Channel Equalization
Chapter 2 Channel Equalization 2.1 Introduction In wireless communication systems signal experiences distortion due to fading [17]. As signal propagates, it follows multiple paths between transmitter and
More informationMultiple Antennas. Mats Bengtsson, Björn Ottersten. Basic Transmission Schemes 1 September 8, Presentation Outline
Multiple Antennas Capacity and Basic Transmission Schemes Mats Bengtsson, Björn Ottersten Basic Transmission Schemes 1 September 8, 2005 Presentation Outline Channel capacity Some fine details and misconceptions
More informationSPECTRUM SHARING IN CRN USING ARP PROTOCOL- ANALYSIS OF HIGH DATA RATE
Int. J. Chem. Sci.: 14(S3), 2016, 794-800 ISSN 0972-768X www.sadgurupublications.com SPECTRUM SHARING IN CRN USING ARP PROTOCOL- ANALYSIS OF HIGH DATA RATE ADITYA SAI *, ARSHEYA AFRAN and PRIYANKA Information
More informationCHAPTER 5 DIVERSITY. Xijun Wang
CHAPTER 5 DIVERSITY Xijun Wang WEEKLY READING 1. Goldsmith, Wireless Communications, Chapters 7 2. Tse, Fundamentals of Wireless Communication, Chapter 3 2 FADING HURTS THE RELIABILITY n The detection
More informationJoint Relaying and Network Coding in Wireless Networks
Joint Relaying and Network Coding in Wireless Networks Sachin Katti Ivana Marić Andrea Goldsmith Dina Katabi Muriel Médard MIT Stanford Stanford MIT MIT Abstract Relaying is a fundamental building block
More informationEE4601 Communication Systems
EE4601 Communication Systems Week 1 Introduction to Digital Communications Channel Capacity 0 c 2015, Georgia Institute of Technology (lect1 1) Contact Information Office: Centergy 5138 Phone: 404 894
More informationDigital Image Processing Introduction
Digital Processing Introduction Dr. Hatem Elaydi Electrical Engineering Department Islamic University of Gaza Fall 2015 Sep. 7, 2015 Digital Processing manipulation data might experience none-ideal acquisition,
More informationLecture LTE (4G) -Technologies used in 4G and 5G. Spread Spectrum Communications
COMM 907: Spread Spectrum Communications Lecture 10 - LTE (4G) -Technologies used in 4G and 5G The Need for LTE Long Term Evolution (LTE) With the growth of mobile data and mobile users, it becomes essential
More informationCommunication Theory II
Communication Theory II Lecture 13: Information Theory (cont d) Ahmed Elnakib, PhD Assistant Professor, Mansoura University, Egypt March 22 th, 2015 1 o Source Code Generation Lecture Outlines Source Coding
More informationWireless Systems Laboratory Stanford University Pontifical Catholic University Rio de Janiero Oct. 13, 2011
Andrea Goldsmith Wireless Systems Laboratory Stanford University Pontifical Catholic University Rio de Janiero Oct. 13, 2011 Future Wireless Networks Ubiquitous Communication Among People and Devices Next-generation
More informationSirindhorn International Institute of Technology Thammasat University
Name...ID... Section...Seat No... Sirindhorn International Institute of Technology Thammasat University Midterm Examination: Semester 1/2009 Course Title Instructor : ITS323 Introduction to Data Communications
More informationSOME PHYSICAL LAYER ISSUES. Lecture Notes 2A
SOME PHYSICAL LAYER ISSUES Lecture Notes 2A Delays in networks Propagation time or propagation delay, t prop Time required for a signal or waveform to propagate (or move) from one point to another point.
More informationITM 1010 Computer and Communication Technologies
ITM 1010 Computer and Communication Technologies Lecture #14 Part II Introduction to Communication Technologies: Digital Signals: Digital modulation, channel sharing 2003 香港中文大學, 電子工程學系 (Prof. H.K.Tsang)
More informationNotes 15: Concatenated Codes, Turbo Codes and Iterative Processing
16.548 Notes 15: Concatenated Codes, Turbo Codes and Iterative Processing Outline! Introduction " Pushing the Bounds on Channel Capacity " Theory of Iterative Decoding " Recursive Convolutional Coding
More informationEE442 Introduction An overview of modern communications EE 442 Analog & Digital Communication Systems Lecture 1
EE442 Introduction An overview of modern communications EE 442 Analog & Digital Communication Systems Lecture 1 ES 442 Lecture 1 1 The Telegraph Revolution Near instantaneous communication Adopted worldwide
More information6 Multiuser capacity and
CHAPTER 6 Multiuser capacity and opportunistic communication In Chapter 4, we studied several specific multiple access techniques (TDMA/FDMA, CDMA, OFDM) designed to share the channel among several users.
More informationError Control Coding. Aaron Gulliver Dept. of Electrical and Computer Engineering University of Victoria
Error Control Coding Aaron Gulliver Dept. of Electrical and Computer Engineering University of Victoria Topics Introduction The Channel Coding Problem Linear Block Codes Cyclic Codes BCH and Reed-Solomon
More informationModulation and Coding Tradeoffs
0 Modulation and Coding Tradeoffs Contents 1 1. Design Goals 2. Error Probability Plane 3. Nyquist Minimum Bandwidth 4. Shannon Hartley Capacity Theorem 5. Bandwidth Efficiency Plane 6. Modulation and
More information2. TELECOMMUNICATIONS BASICS
2. TELECOMMUNICATIONS BASICS The purpose of any telecommunications system is to transfer information from the sender to the receiver by a means of a communication channel. The information is carried by
More informationTime division multiplexing The block diagram for TDM is illustrated as shown in the figure
CHAPTER 2 Syllabus: 1) Pulse amplitude modulation 2) TDM 3) Wave form coding techniques 4) PCM 5) Quantization noise and SNR 6) Robust quantization Pulse amplitude modulation In pulse amplitude modulation,
More informationEngineering Scope and Sequence Student Outcomes (Objectives Skills/Verbs)
The World of Modern Engineering What do Scientists and Engineers do? What is the difference between analog and digital devices? How do Engineers organize their designs? Introduction to LabView software
More informationOutline / Wireless Networks and Applications Lecture 3: Physical Layer Signals, Modulation, Multiplexing. Cartoon View 1 A Wave of Energy
Outline 18-452/18-750 Wireless Networks and Applications Lecture 3: Physical Layer Signals, Modulation, Multiplexing Peter Steenkiste Carnegie Mellon University Spring Semester 2017 http://www.cs.cmu.edu/~prs/wirelesss17/
More informationCooperation in Wireless Networks
Cooperation in Wireless Networks Ivana Marić and Ron Dabora Stanford 15 September 2008 Ivana Marić and Ron Dabora Cooperation in Wireless Networks 1 Objectives The case for cooperation Types of cooperation
More informationBook Review. Dobri Atanassov Batovski
A Conceptual Review of Digital Communication Systems (Author: Simon Haykin, 2014) Haykin, S. 2014. Digital Communication Systems. John Wiley & Sons, Inc., Hoboken, NJ, USA. Available: .
More informationCT111 Introduction to Communication Systems Lecture 9: Digital Communications
CT111 Introduction to Communication Systems Lecture 9: Digital Communications Yash M. Vasavada Associate Professor, DA-IICT, Gandhinagar 31st January 2018 Yash M. Vasavada (DA-IICT) CT111: Intro to Comm.
More informationSimple Algorithm in (older) Selection Diversity. Receiver Diversity Can we Do Better? Receiver Diversity Optimization.
18-452/18-750 Wireless Networks and Applications Lecture 6: Physical Layer Diversity and Coding Peter Steenkiste Carnegie Mellon University Spring Semester 2017 http://www.cs.cmu.edu/~prs/wirelesss17/
More informationDIGITAL COMMUNICATION
DEPARTMENT OF ELECTRICAL &ELECTRONICS ENGINEERING DIGITAL COMMUNICATION Spring 00 Yrd. Doç. Dr. Burak Kelleci OUTLINE Quantization Pulse-Code Modulation THE QUANTIZATION PROCESS A continuous signal has
More informationInterference Alignment. Extensions. Basic Premise. Capacity and Feedback. EE360: Lecture 11 Outline Cross-Layer Design and CR. Feedback in Networks
EE360: Lecture 11 Outline Cross- Design and Announcements HW 1 posted, due Feb. 24 at 5pm Progress reports due Feb. 29 at midnight (not Feb. 27) Interference alignment Beyond capacity: consummating unions
More informationECE 457 Communication Systems. Selin Aviyente Assistant Professor Electrical & Computer Engineering
ECE 457 Communication Systems Selin Aviyente Assistant Professor Electrical & Computer Engineering Announcements Class Web Page: http://www.egr.msu.edu/~aviyente/ece 457.htm M, W, F 10:20-11:10 a.m. Office
More informationMassive MIMO Full-duplex: Theory and Experiments
Massive MIMO Full-duplex: Theory and Experiments Ashu Sabharwal Joint work with Evan Everett, Clay Shepard and Prof. Lin Zhong Data Rate Through Generations Gains from Spectrum, Densification & Spectral
More informationECM3501: Principles of Communication Engineering
ECM3501: Principles of Communication Engineering Po-Ning Chen, Professor Dept. of Communications Eng. National Chiao Tung University Background and Preview To give you a basic understanding of communications
More informationMsc Engineering Physics (6th academic year) Royal Institute of Technology, Stockholm August December 2003
Msc Engineering Physics (6th academic year) Royal Institute of Technology, Stockholm August 2002 - December 2003 1 2E1511 - Radio Communication (6 ECTS) The course provides basic knowledge about models
More informationIntroduction to Digital Communications. Vitaly Skachek
MTAT.05.128 Vitaly Skachek Administration information Instructor: Vitaly Skachek Office: J. Liivi 2-216 Email: vitaly.skachek@ut.ee Phone: 737 6418 https://courses.cs.ut.ee/2016/digicomm/spring Related
More informationEE359 Discussion Session 8 Beamforming, Diversity-multiplexing tradeoff, MIMO receiver design, Multicarrier modulation
EE359 Discussion Session 8 Beamforming, Diversity-multiplexing tradeoff, MIMO receiver design, Multicarrier modulation November 29, 2017 EE359 Discussion 8 November 29, 2017 1 / 33 Outline 1 MIMO concepts
More informationB SCITEQ. Transceiver and System Design for Digital Communications. Scott R. Bullock, P.E. Third Edition. SciTech Publishing, Inc.
Transceiver and System Design for Digital Communications Scott R. Bullock, P.E. Third Edition B SCITEQ PUBLISHtN^INC. SciTech Publishing, Inc. Raleigh, NC Contents Preface xvii About the Author xxiii Transceiver
More information