Incremental Redundancy and Feedback at Finite Blocklengths

Transcription

1 Incremental Redundancy and Feedbac at Finite Bloclengths Richard Wesel, Kasra Vailinia, Adam Williamson Munich Worshop on Coding and Modulation, July 30-31,

2 Lower Bound on Benefit of Feedbac BI-AWGN Channel, SNR = 2dB, Capacity= =96 =192 =288 Expected Throughput (R t ) Random Coding and Stop Feedbac =32 Frame error rate 10-3 Polyansiy, Poor, and Verdu 2011 =64 NoFeedbac Polyansiy, Poor, and Verdu 2010 BI-AWGN capacity VLF random coding lower bound Max. rate for fixed length code, no feedbac =16 R =/ =16, 32, 64, 96, 192, 288 t Average Bloclength ( ) 2

3 How well can a non-binary LDPC code do? Rate-0.8 protograph Rate-0.75 protograph We will lift these protographs to produce GF(256) LDPC codes for 96 (rate-0.8), 192 and 288 (rate-0.75) input bits. 3

4 VERY incremental redundancy 1. Send the initial NB-LDPC codeword 2. If the CRC checs, we are done 3. If not, request a transmission of a specific bit that helps the least reliable variable node. 4. Go to step 3 4

5 Observation: NB-LDPC decoder never visits two wrong codewords. α State%1% Decoder' converges' to'wrong' codeword' State%2% Decoder' does'not' converge' State%3% Decoder' converges'to' correct' codeword' γ β α + β + γ = 1 5

6 Choose CRC length to Guarantee FER=10-3. inf L crc inf L crc Information Bloc 00 0 Information Bloc CRC Divisor CRC L crc L crc +1 N 0 NB-LDPC Encoded Message α 2 L CRC <

7 NB-LDPC with single-bit increments performs as well as random coding lower bound, in a fair comparison BI-AWGN Channel, SNR = 2dB, Capacity= =89 =185 =281 Expected Throughput (R t ) =32 =16 =64 BI-AWGN capacity VLF random coding lower bound Max. rate for fixed#length code, no feedbac R t =/ =16, 32, 64, 89, 185, 281 VLF CRC m= NB-LDPC Average Bloclength ( )

8 But what if I don t want to send feedbac after every bit? Suppose my communication system can only tolerate rounds of feedbac. m How many bits should I transmit in each increment? Can m incremental transmissions get close to the performance of an infinite number of single-bit increments? 8

9 How many bits does it tae to decode successfully? Probability Density Function p.d.f of bloclength until the decoder converges to the correct codeword VLFT Simulation Inv Gaussian Approx Bloclength (N S ) From simulation of = 96 system with 120-bit (rate-0.8) NB-LDPC code. N S is the number of bits transmitted until the first successful decoding. R S = N S is the instantaneous rate at the first successful decoding. 9

10 Rate histogram follows a Gaussian. Probability Density Function f RS p.d.f. of rate until the decoder converges to the correct codeword ( r) = VLFT Simulation Gaussian Approx πσ e S r µ S Rate (R ) S Histogram of R S, the highest rate supporting successful decoding. Polyansiy s normal approximation is a practical reality! In this example µ S = 0.63 and 2 = Note that capacity is C = > µ S. 10

11 m Transmissions: The Accumulation Cycle m Let a maximum of accumulation cycle. transmissions form an Performance depends on the cumulative bloclengths: N 1, N 2,!, N m. Note that since we end with a finite bloclength there will be some probability that the communication does not conclude. When that happens, the received transmissions are forgotten and we start over. 11

12 Computing probability of initial success Probability Density Function p.d.f of bloclength until the decoder converges to the correct codeword VLFT Simulation Inv Gaussian Approx Bloclength (N S ) f NS ( n) = n 2 2π 2 e n µ S Suppose N 1, the initial bloclength, is 140 bits. The probability P( n = N 1 ) of successful decoding is shown above. 12

13 is easier using the rate histogram. Probability Density Function p.d.f. of rate until the decoder converges to the correct codeword VLFT Simulation Gaussian Approx Rate (R ) S P( n = N 1 ) is shown can also be seen on the rate histogram. ( ) = Q P n = N 1 N 1. 13

14 Expected bloclength E[ N ] Probability Density Function p.d.f. of rate until the decoder converges to the correct codeword VLFT Simulation Gaussian Approx. Also N 5 N 5 2 N 4 N 3 N 2 N Rate (R ) S E[ N ] = N 1 Q N 1 µ N S µ m + N i Q i N S Q i 1 + N m 1 Q i=2 N m 14

15 Expected throughput per bloc E[ K ] E[K] = Q N m since we will always choose large enough that the probability N m of a lost accumulation cycle is small. 15

16 Optimizing the throughput rate R T R T = E K E N [ ] [ ] E[ N ] So we just need to choose to minimize E[ N ]. N 1, N 2,!, N m 16

17 Lets tae some derivatives E[ N ] N 1 = Q N 1 + ( N 1 N 2 )Q' N 1 Setting E [ N ] = 0... N 1 N 2 = Q N 1 Q' + N 1 Q' µ N S 1 N 1 17

18 For i > 2 E[ N ] N i 1 = Q N i 1 + ( N i 1 N i )Q' N i 1 Q N i 2 18

19 The sweet spot de[n]/dn Second Bloclength N N i 2 N i 1 N i 19

20 We actually choose N i to mae N i-1 optimal de[n]/dn Second Bloclength N N i 2 N i 1 N i 20

21 For i > 2 E[ N ] N i 1 = Q N i 1 + ( N i 1 N i )Q' N i 1 Q N i 2 Setting E [ N ] = 0... N i 1 N i = Q N i 1 + N i 1 Q' Q' N 1 µ N S i 1 σ S Q N i 2 21

22 Sequential Differential Approximation So, for each choice of the remaining bloclengths can be selected so that E[ N ] N i This gives the same set of bloclengths as exhaustive search (within one bit) and essentially the same optimal throughputs. It is easy to chec the set of interesting N 1 values. 22 N 1 = 0 for i { 1,,m 1}

23 Loos lie 10 (maybe 20) = VLFT λ for various values of m VLFT λ m= VLFT λ for m=2,3,...,20 λ R T m VLFT R T for various values of m VLFT R T m= VLFT R T for m=2,3,..., m 23

24 CRC-based Feedbac with Non-binary LDPC Code BI-AWGN Channel, SNR = 2dB, Capacity= =89 =185 =281 Expected Throughput (R t ) =32 =16 =64 BI-AWGN capacity VLF random coding lower bound Max. rate for fixed#length code, no feedbac R t =/ =16, 32, 64, 89, 185, 281 VLF CRC m= NB-LDPC VLF CRC m=5 NB-LDPC Average Bloclength ( ) 24

25 Some two-phase feedbac schemes Expected Throughput (R t ) =32 =16 BI-AWGN Channel, SNR = 2dB, Capacity= =89 =64 =96 =192 =288 =185 =281 BI-AWGN capacity VLF random coding lower bound Max. rate for fixed#length code, no feedbac R t =/ =16, 32, 64, 96, 192, 288 VLF CRC m= NB-LDPC VLF CRC m=5 NB-LDPC VLF Two-phase m=5 NB-LDPC VLF Two-phase m= CC VLF Two-phase m=5 64-CC Average Bloclength ( )

26 Percentage of Capacity Perspective 100 VLF BI AWGN Channel, SNR = 2dB, Capacity= % Throughput of BI AWGN Capacity VLF Lower bound VLF CRC m= NB LDPC VLF Two phase m=5 NB LDPC VLF CRC m=5 NB LDPC VLF Two phase m=5 64 CC Expected Latency (λ) 26

27 Conclusions Sequential Differential Approximation (SDA) is a general tool that can find the optimal incremental transmission sizes for a wide class of incremental redundancy feedbac schemes. Today we used it to show that short NB-LDPC codes with a CRC and incremental redundancy can achieve 89% of capacity with 5 transmissions. (94% with infinite transmissions). We expect a significant portion of that gap to be closed by using 10 transmissions. 27