An improved method is described for coding input strings to improve reliability of partial response channels. This method comprises encoding an input string into an intermediate string using a binary convolutional code, and encoding the intermediate string using a nonlinear inner code that repeats and...http://www.google.com/patents/US4888775?utm_source=gb-gplus-sharePatent US4888775 - Trellis codes for partial response channels

An improved method is described for coding input strings to improve reliability of partial response channels. This method comprises encoding an input string into an intermediate string using a binary convolutional code, and encoding the intermediate string using a nonlinear inner code that repeats and inverts selected bits of the intermediate string. The inner code has a coding rate of less than one. As specifically illustrated, this method provides coding gains for partial response channels of at least 4.8 dB.

3. A method according to claim 1, wherein coding gain is at least 4.8 dB and maximum zero run length (ZRL) does not exceed 3.

4. A method according to claim 1, wherein both the inner code and the channels are interleaved.

5. A method according to claim 1, including the step of employing a channel transfer polynomial of (1-DN).

6. A method according to claim 5, wherein N is 2.

7. A method according to claim 1, including the step of employing a channel transfer polynomial of (1+DN).

8. A method according to claim 1, including concatenating an inner code of rate 1/2 on a (1±D) channel with rate 1 convolutional code to provide a combined code with rate 1/2 and a maximum zero run length (ZRL) of 1.

9. A method according to claim 1, including concatenating an inner code of rate 2/3 on a (1±D) channel with rate 3/4 convolutional code to provide a combined code with rate 3/6 and maximum zero run length (ZRL) of 2.

10. A method according to claim 1, including concatenating an inner code of rate 3/4 on a (1±D) channel with rate 2/3 convolutional code to provide a combined code with rate 2/4 and maximum zero run length (ZRL) of 3.

11. A method according to claim 1, including concatenating an inner code of rate 5/8 on a (1±D) channel with rate 4/5 convolutional code to provide a combined code with rate 4/8 and maximum zero run length (ZRL) of 3.

12. A method according to claim 1, including concatenating the inner code with a convolutional code to provide a combined code rate of less than 1/2.

13. A method according to claim 1, including steps of:

interleaving the inner code; and employing a channel transfer polynomial of (1+D-D2 -D3).

14. A method according to claim 1, wherein the inner code rate is one-half.

15. A method according to claim 1, including concatenating an inner code of rate 1/2 on a (1-D)(1+D)2 channel with optimal rate 1 code to provide an interleaved biphase rate 2/4 code with a coding gain of at least 4.8 dB.

Description

CROSS REFERENCE TO RELATED APPLICATIONS

U.S. applications Ser. Nos. 07/169,918 and 07/169,919, filed concurrently with this application, disclose other techniques for improving coding gain on partial response channels and different most probable sequence calculations for the outputs.

Partial response signalling with maximum likelihood sequence detection in digital data communication and recording applications is a known technique. References [A], [B], [C] Supra, described trellis coding techniques to provide coding gain required in noisy or otherwise degraded channels. These techniques apply to channels described by channel transfer polynomials of the form (1±DN), for N≧1, and which are precisely those obtained by interleaving N times a channel with transfer polynomial (1±D).

References [A], [B] and [C] utilize a binary convolutional code with specified rate and Hamming distance properties as the trellis code. The coding gain of these trellis codes is determined by the free Euclidean distance of the channel outputs which is lower bounded by (the lowest even number greater than or equal to) the free Hamming distance of the convolutional code. The number of consecutive zeros in the output signal must be limited for purposes of timing and gain control. In order to control the maximum run of zero samples in the channel output signal, or "zero run-length" (ZRL), the encoded data is modified by adding (modulo 2) a fixed binary sequence, called a "coset vector", to the encoder output.

In addition, Reference [A]'s approach requires an inverse channel precoder to make nonzero output samples correspond to ones in the channel input, and conversely. However, the approaches in References [B] and [C] do not require a precoder; instead they invert the original code (termed the "magnitude code") and convert it into convolutional code (termed the "sign code"), which is then used as the actual trellis code. References [A], [B] and [C] each specify the underlying convolutional code to be one with maximum Hamming distance dH.

The conventional biphase code described in Reference [C] shows that the approaches of References [A], [B] and [C] do not always produce, for a given code rate and coding gain, the code with minimum detector complexity and/or minimum zero sample run-length constraint.

The techniques heretofore disclosed (e.g., in References [A], [B] and [C]) do not produce any codes for the extended class of suitable partial response channels described in Reference [D], which describes a class of channels with transfer polynomials of the form (1-D)(1+D)N, where N≧2.

There is a need for techniques which can provide codes which improve upon those found in the prior art by enabling significantly enhanced coding gains.

SUMMARY OF THE INVENTION

Toward this end and according to the invention, an improved method is described for coding input strings to improve reliability of partial response channels. This method comprises encoding an input string into an intermediate string using a binary convolutional code, and encoding the intermediate string using a nonlinear inner code that repeats and inverts selected bits of the intermediate string. The inner code has a coding rate of less than one.

According to one embodiment, the inner code and the channels are interleaved and the channel transfer polynomial is (1-DN), with N preferably 2, and an inner code rate of at least one-half and less than one.

According to another embodiment, involving so-called "extended" class 4 partial response channels, the inner code is interleaved, the channel transfer polynomial is (1+D-D2 -D3), and the inner code rate is preferably one-half.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram depicting a trellis coding technique according to the invention; and

FIG. 2 is a trellis diagram, according to one specific embodiment of the invention, for interleaved biphase code used with "extended" class 4 partial response channels.

DESCRIPTION OF PREFERRED EMBODIMENTS GENERAL

According to the invention, improved trellis coding techniques are described for reliable data transmission over noisy partial response channels with:

(a) Transfer polynomials (1±DN), which are interleaved dicode and interleaved class 1 channels, and also

These novel techniques are depicted in FIG. 1, wherein a binary convolutional code C is used in conjunction with an inner code, IC.

In the Appendix hereto, applicants show how they derived Equations (A2) and (A13) which specify the novel precise relationship between the Euclidean distance of two channel output sequences and the Hamming distance of their corresponding binary channel inputs, with specific attention to the interleaved (1-D) channels and the (1-D)(1+D)2 channel. These Equations (A2) and (A13) validate applicants' concatenated coding technique described by FIG. 1. This technique can make use of inner codes of any rate; however, the trellis codes which provide rates and coding gains of present interest are achieved with inner codes with rates greater than or equal to 1/2. Specifically, four inner codes, denoted IC1, IC2, IC3 and IC4 are described with rates 1/2, 2/3, 3/4 and 5/8, respectively. The codes for use with (1-D) are systematic block codes:

IC1: x1 →x1 x1

IC2: x1 x2 →x1 x2 x2

IC3: x1 x2 x3 →x1 x2 x2 x3

IC4: x1 x2 x3 x4 x5 →x1 x2 x2 x3 x4 x4 x5 x5

These codes can be interleaved N times for use on the interleaved dicode channel with transfer polynomial (1-DN). Alternatively, they may be interleaved twice for use on channels with polynomial (1-D)(1+D)N.

The bounds on the free Euclidean distance, dfree2, as a function of the free Hamming distance, dfreeH, of the code C for IC1 and IC2 are as follows, proofs being given in the Appendix:

IC1: dfree2 ≧4dfreeH +2 (1)

IC2: dfree2 ≧2dfreeH (2)

The bounds in Equations (1) and (2) apply to the interleaved trellis codes as used on the interleaved channel.

For a convolutional code C with free Hamming distance, dfreeH, the free Euclidean distance of the interleaved IC1 concatenated scheme, dfree2, when applied to the (1-D)(1+D)2 channel, satisfies

dfree2 ≧min{8dfreeH +4, 4dfreeH +8}(3)

While it is not possible to formulate useful bounds for IC3 and IC4, these inner codes are included because they also produced concatenated codes of potential interest.

APPLICATIONS OF IC1, IC2, IC3 AND IC4

For each of these inner codes, the technique for obtaining concatenated code rates equal to one-half will now be explained.

By concatenating an IC1 on a (1-D) channel with the optimal rate 1 code, a combined code rate of 1/2 is achieved. This is a block code with a large free Euclidean distance dfree2 =6 and maximum zero run length (ZRL) of 1, as noted in Reference [C].

By concatenating an IC2 of rate 2/3 on a (1-D) channel with rate 3/4 binary convolutional codes, a family of combined codes is obtained with rate 3/6 and maximum ZRL of 2.

By concatenating an IC3 of rate 3/4 on a (1-D) channel with rate 2/3 binary convolutional codes, a family of combined codes with rate 2/4 and maximum ZRL of 3 is obtained.

By concatenating an IC4 of rate 5/8 on a (1-D) channel with rate 4/5 binary convolutional codes, a family of combined codes with rate 4/8 and maximum ZRL of 3 is obtained.

By concatenating an interleaved IC1 code of rate 1/2 used on a (1-D)(1+D)2 channel with the optimal rate 1 code, a rate 2/4 code is obtained, which is an "interleaved biphase" code that provides large free Euclidean distance dfree2 =12 , corresponding to a coding gain of 4.8 dB. The maximum zero sample run length in the output is 1.

Table 1 specifies codes derived for inner codes IC1 and IC2 using the techniques just described. The 2-state code is the only rate 1/2 code; it is the "biphase code" obtained from IC1. All the others are rate 3/6 codes obtained using IC2. The underlying rate 3/4 binary convolutional codes for the IC2 codes are defined by means of a generator matrix G(D). The polynomial entries in the matrix are presented in octal notation with low degree terms at the left, e.g. 62=110 010 represents 1+D+D4. These convolutional codes per se are optimal with respect to Hamming distance and form no part of the present invention; however, the novelty resides in applicants' combination of these convolutional codes with their inner codes.

In connection with Table 1, the actual free distance was found by path-to-path distance calculation using the Viterbi algorithm on a trellis with the square of the number of states of the decoder, whenever this was computationally feasible (no more than 16 decoder states). In other cases, a lower bound based on subset distances was computed using a trellis with the same number of states as the decoder.

Tables 2 and 3 give some of the codes found using the inner codes IC3 and IC4. These rate 2/4 and rate 4/8 trellis codes may be preferable to rate 3/6 codes in byte-oriented data processing systems.

Selected Concatenated Convolutional Codes and Inner Codes with Combined Rate Less than 1/2

In this section, inner code IC1 is used to construct trellis codes for (1-D), for selected combined rates less than 1/2. Note that several of the codes exhibit very large coding gains at moderate complexity for rates between 1/3 and 1/2.

EXAMPLE 1

If IC1 is concatenated with a rate 4/5 convolutional code, with constraint length ν=3, and free Hamming distance dfreeH =3, a rate 4/10 code is obtained, with a 16-state decoder, ZRL 1, and free Euclidean distance dfree2 ≧14. This corresponds to an 8.5 dB coding gain over the uncoded channel, unnormalized for rate.

EXAMPLE 2

If IC1 is concatenated with rate 3/4 codes, a family of rate 3/8 is obtained, as described in Table 4. Note that the values of dfree2 shown are lower bounds, and that coding gains ranging from 7 dB to 11.1 dB are achieved.

If IC1 is concatenated with rate 2/3 codes, a family of rate 2/6 is obtained, as described in Table 5. The values of dfree2 shown are lower bounds. At this lower rate, coding gains ranging from 10.4 dB to 12.3 dB are achieved with the number of decoder states ranging from 32 to 256.

Channels with transfer polynomial (1-DN) have been discussed in connection with interleaved channels. However, it will be understood by those skilled in the art that the resulting codes can be modified for use on a (1+DN) channel, by converting a code for the (1-D) channel to a code with the same coding gain for a (1+D) channel by adding the vector 01010101 . . . or 10101010 . . . .

This section addresses the issue of Viterbi decoder implementation and compares the required hardware complexity of the new codes to that of previously proposed codes with comparable coding gain. The computational and storage requirements are estimated for decoding a rate k/n code based upon a trellis structure with s states.

Assume a parallel architecture for the Viterbi decoder similar to that commonly used. The decoder comprises two sections. The first section generates the survivor sequences and consists of a subunit that computes branch metrics, along with Add-Compare-Select (ACS) subprocessors replicated and interconnected to reflect the trellis structure.

The branch metric calculation, with appropriate use of ROM, requires approximately n additions per edge in the trellis. The ACS subprocessor performs 2k two-way additions to generate the extended path metrics, a 2k -way comparison to determine the minimum metric, and a 2k -way multiplexing operation to select the corresponding sequence and updated metric. The ACS block is replicated s times, once for each state. Assuming that an adder has complexity α, a 2k -way comparator has complexity β2k and that a 2k -to-1 multiplexer has complexity γ2k, then an approximate measure of the complexity of the first section, normalized to a "per decoded bit" basis, is

V1 =(αn+β+γ)s2k

The second section is the trellis paths history, which stores survivor sequences for each trellis state to a depth adequate to ensure a high probability of path merging. It stores the survivor sequences in a set of s shift registers, each of length approximately five times the constraint length of the code, to ensure path merging. The registers are interconnected by a series of 2k -way multiplexers inserted after every n shift register stages. These enable the correct updating of survivor sequences. If the complexity of a single shift register stage (usually a flip-flop) is δ, the required hardware complexity is approximately given by the quantity

V2 =(δn+γ2k)slog2 s

When these complexity measures are computed for the rate 1/2 codes in the Prior Art and applicants' new rate 1/2 and rate 3/6 codes in Table 1, the results favor the new codes by substantial margins, as shown in Table 6.

While the complexity measures for the rate 2/4 code with 16-state decoder and coding gain of 6 dB shown in Table 2 has not been here calculated, it compares favorably with the complexity measures for the corresponding rate 1/2 code.

If these prior art rate 1/2 codes are blocked for use as rate 2/4, 3/6 or 4/8 codes to achieve possible speed advantages of block processing in Viterbi decoding, applicants' codes provide further significant reductions in the hardware requirements, as illustrated in Table 7 for the rate 1/2 and rate 3/6 codes.

In this section, a difference metric Viterbi decoding algorithm is derived for interleaved biphase (IB) code on the EPR4 channel with transfer polynomial (1-D)(1+D)2. Bounds are given on the size of the difference metrics at step n. These bounds lead to a decoder implementation that does not require renormalization.

FIG. 2 depicts the four-state trellis upon which the Viterbi decoding algorithm operates. The state names represent the contents of the channel memory (3 bits) and the edge labels are

x1 x2 x1 x2 /c1 c2 c3 c4

where x1 x2 x1 x2 is the IB codeword and c1 c2 c3 c4 is the corresponding channel output sequence. Note that the channel input equals the code output.

To determine the optimal path extensions, it suffices to keep track of three difference survivor metrics, DJn (2,1), DJn (3,1) and DJn (4,1). These path extensions, as well as the corresponding difference metric conditions which govern their selection are shown in Table 8 below. The conditions take the form of inequalities involving the three quantities

an =DJn1 (2,1)=2yn1 =2yn2

bn =DJn-1 (3,1)=4yn1 -2yn2 -2yn3

cn =DJn-1 (4,1)=6yn1 -2yn3

which depend only on the difference metric values DJn-1 (2,1), DNn-1 (3,1) and DJn-1 (4,1) at step n-1 and the channel output samples yn1, yn2, yn3, yn4 at time n.

Table 8 is broken into four subtables, 8a-d, each describing the algorithm for generating the survivor for one of the trellis states at time n.

The difference metric updates are easily computed once the path extensions have been made. To compute DJn (s,t), the following technique is used. Assume that the time n survivor sequences for s and t are obtained by extending the time n-1 survivor sequences for u and v, respectively. If z1,z2,z3,z4 are the ideal EPR4 output samples which label the edge from u to s, and w1,w2,w3,w4 are the ideal EPR4 output samples which label the edge from v to t, then ##EQU1##

As mentioned above, only the difference metrics DJn (2,1), DJn (3,1) and DJn (4,1) need be updated. Any quantities DJn-1 (u,v) required in the update process can be obtained from a linear combination of DJn-1 (2,1), DJn-1 (3,1) and DJn-1 (4,1).

With the output sample normalization chosen such that ideal EPR4 sample values are in [-2,2], it can be assumed that the digitized signal samples fall in a range [-A,A]. The following bounds on the quantities DJn (2,1) and DJn (3,1) can then be computed as

-12A-2≦DJn (2,1)≦12A+8

-8A≦DJn (3,1)≦8A+6

-8A-6≦DJn (4,1)≦8A+6

For example, taking A=4, the bounds show that DJn (2,1)ε[-50,56], DJn (3,1)ε[-32,38] and DJn (4,1)ε[-38,38]. If there are L=2r quantitization levels between ideal sample values, then, at most, 6+r magnitude bits and 1 sign bit are required to store the difference metrics.

It will now be seen that the coding techniques according to the invention provide coding gains of at least 4.8 dB with reduced hardware complexity, representing a significant improvement over prior art techniques. As illustrated, the improved coding gains range from 4.8 dB for two states to 12.3 dB for 256 states. The improved trellis codes provide reliable data transmission over noisy partial response channels with transfer polynomials (1±DN) and also with transfer polynomial (1-D)(1+D)2 EPR4 channels.

It will also be seen that the concatenated codes with combined rate 1/2 obtained using the techniques and method embodying the invention for inner codes IC1, IC2, IC3 and IC4 and coding gains ranging from 4.8 dB to 7.8 dB typically require significantly fewer decoder states (by factors of 2 to 4) than the previously known codes. Also, significant reductions in decoder hardware are achieved compared with previously known codes, and the ZRL constraints are substantially improved in all cases.

Moreover, it is to be understood that while only codes with combined rates of at least 1/2 have been disclosed, codes of lesser rate may be achieved by repeating, for example, the IC1 codes to provide a modified code IC1' wherein x1 x2 →x1 x2 x2 x1 x2 x2 and thereby achieve a combined code rate of 1/3. In similar fashion, IC3, if similarly modified, would provide a IC3' with a combined rate of 3/8; and IC4, if similarly modified, would provide a IC4' with a combined rate of 5/16.

Also, the inner code could be repeated more than once. For example, if IC1 were repeated twice, then a modified code would be provided wherein x1 →x1 x1 x1 x1 x1 x1 and the combined code rate would thus be 1/6.

Finally, it will be seen that in applicants' novel technique, the combined code rate is the product of the convolutional code rate and inner code rate, that the combined code rate can be changed as desired by modifying either to affect said product, and that by either approach significantly higher coding gains can be obtained than heretofore achieved.

APPENDIXI. General Description of Euclidean Distance Equations for Interleaved Channels

Let x=(xi) and x'=(x1') be binary input sequences to the (1-D) channel, with symbols in {0,1}. Denote the corresponding output sequences by y and y', with

Yi= xi -xi-1

Y1'= xi'-xi-1'

The squared Euclidean distance between y and y' can be written as: ##EQU2## The first two terms in Equation (A1) each contribute 1 to the Euclidean distance for each component in which x and x' differ. Therefore,

Σ(xi -xi')2 +Σ(xi-1 -xi-1')2 =2dH (x,x'),

where dH denotes Hamming distance. The last term in Equation (A1) contributes to dE2 in the following way: ##EQU3##

Equation (A1) can therefore be rewritten as: ##EQU4##

Equation (A2) suggests that an inner code which combines bit repetition and inversion appropriately could generate large Euclidean distance, both by increasing the dH term and by contributing via the dG term.

II. Derivation of Bound on dfree2 for IC1

First, examine the rate 1/2 inner code denoted IC1, defined by

x→xx

This is the conventional biphase modulation code, used here in a new context.

Let x and x' denote inputs to the IC1 encoder, and let u and u' denote the corresponding outputs. Then,

dH (u,u')=2dH (x,x')

and

dG (u,u')-dB (u,u')≧1, if dH (u,u')<∞

with the inequality arising from the fact that any contribution to dB is bracketed by contributions to dG on either side.

From Equation (A1), it follows that if x is generated by a rate k/n convolutional code with free Hamming distance dfreeH, then the inner code IC1 will yield a rate k/2n trellis code with free Euclidean distance dfree2 bounded by:

By examining the possible bit patterns for ##EQU5## it is noted that within this window, the contributions ΔG to dG (u,u'), ΔB to dB (u,u'), and ΔH to dH (u,u')-dH (x,x') satisfy

ΔH +ΔG -ΔB ≧0 (A3)

implying that

(dH (u,u')-dH (x,x'))+dG (u,u')-dB (u,u')≧0

From Equation (A1) the bound on dfree2 for IC2 is derived, as stated in Equation (2) of the specification.

dfree2 ≧2dfreeH (A 4)

By examining the minimum distance patterns of the underlying convolutional codes C to determine the presence or absence of patterns for which Equation (A3) is an equality, namely ##EQU6## it is possible to explain the discrepancies between the actual dfree2 and the bound Equation (A4), such as those found in Table 1 for the 16 state and 64 state, rate 3/6 codes. A similar analysis explains the discrepancy in the 8-state, rate 3/6 code derived from the variant of inner code IC2.

IV. General Derivation of Euclidean Distance Equation for EPR4 Channel

First develop an expression for the squared Euclidean distance between two output sequences of the EPR4 channel, analogous to the derivation for the (1-D) channel above. Let x=(xi) and x'=(xi') be binary input sequences, with symbols in {0,1}, for the EPR4 channel, with channel polynomial (1+D-D2 -D3). Denote the corresponding output sequences by y and y', with

yi =xi +xi-1 -xi-2 -xi-3

yi' =xi' +xi-1' -xi-2' -xi-3'

The squared Euclidean distance between y and y' can be written as: ##EQU7## The four terms in Equation (A5) each contribute 1 to the Euclidean distance for each component in which x and x' differ. Therefore, the total contribution from Equation (A5) is

4dH (x,x') (A9)

The next three terms in Equation (A6) contribute to dE2 in the following way: ##EQU8## Equation (A6) can therefore be rewritten as

-2(dG.sup.(1) (x,x')-dB.sup.(1) (x,x')) (A10)

where ##EQU9## Similarly, the contribution from Equation (A3) can be expressed as

Equation (A13) suggests that an inner code which combines bit repetition and inversion in even and odd substrings might generate large Euclidean distance, both by increasing the dH term and by contributing via the dG.sup.(2) term.

V. Derivation of Bound for dfree2 of Interleaved Biphase Code with EPR4 Channel

Examine the rate 1/2 inner code which has been denoted IB, defined by

x1 x2 →x1 x2 x1 x2

Let x and e denote inputs to the IB encoder, and let u and u' denote the corresponding outputs. Use subscripts "e" and "o" to denote even and odd substrings respectively. To prove the bound stated in Equation (4) of the specification, consider two cases.

Case 1: (dG.sup.(1) -dB.sup.(1))=(dG.sup.(3) -dB.sup.(3))=0

If x≠x', then either dH (ue,ue')≠0 or dH (uo,uo')≠0. Without loss of generality, assume dH (ue,ue')≠0. Then, since IB acts like the biphase code on xe and xe', the argument in Section I hereof shows that

dG.sup.(2) (u,u')-dB.sup.(2) (u,u')≧1

so

dfree2 (y,y')≧4dH (u,u')+4=8dH (x,x')+4

If both dH (ee,ue') and dH (uo,uo') are nonzero, then

dG.sup.(2) (u,u')-dB.sup.(2) (u,u')≧2

implying

dfree2 (y,y')≧8dH (xe,xe')+4+8dH (xo,xo')+4=8dH (x,x')+8

Case 2: (dG.sup.(1) -dB.sup.(1))≠0 or (dG.sup.(3) -dB.sup.(3))≠0

The assumption forces dH (ue,ue') and dH (uo,uo') to be nonzero, so use the remark at the end of case 1 to get

dG.sup.(2) (u,u')-dB.sup.(2) (u,u')≧2

Since the combined contributions of d.sup.(1) and d.sup.(3) can be at worst -4 for each position which contributes to dH (x,x'), it can be concluded