Coding apparatus, coding method and recording medium having coded program recorded therein, and decoding apparatus, decoding method and recording medium having decoded program recorded therein

[0001] 1. Field of the Invention

[0002] The present invention relates to a coding apparatus for carrying out serial concatenated trellis coded modulation, a coding method and a recording medium having a coded program recorded therein, and a decoding apparatus for decoding data subjected to serial concatenated trellis coded modulation, a decoding method and a recording medium having a decoded program recorded therein.

[0003] 2. Description of Related Art

[0004] Lately, the study on, for example, a communication field such as a mobile communication and a deep space communication, a broadcasting field such as terrestrial wave or satellite digital broadcasting, and a magnetic, light or photo-electro recording field has been progressed materially, but with this, the study on a code theory for the purpose of making error correction coding and decoding efficient has been carried out actively.

[0005] As a theoretical limit of code performance, a Shannon limit implied by a so-called Shannon's channel coding theorem is known.

[0006] As the coding method indicative of the performance close to the Shannon limit, there is known a coding method by serially concatenated convolutional codes described in, for example, [S. Benedetto, G. Montorsi, D. Divsalar, F. Pollara, “Serial Concatenation of Interleaved Codes: Performance Analysis, Design, and Iterative Decoding”, TDA Progress 42–126, Jet Propulsion Laboratory, Pasadens, Calif., Aug. 15, 1996].

[0007] The coding by the serially concatenated convolutional codes is carried out by an apparatus having two convolutional coders and an interleaver serially concatenated. The decoding by the serially concatenated convolutional codes is carried out by an apparatus having two decoding circuits for outputting a soft-output serially concatenated, and information is transferred between the two decoding circuits to obtain the final decoded result.

[0008] Further, as an application of the coding by the serially concatenated convolutional codes, there is also known a serial concatenated trellis coded modulation, which is hereinafter referred to as SCTCM, described in, for example, [D. Divsalar, F. Pollars, “Serial and Hybrid Concatenation Codes with Applications”, in Proc., Int. Symp. On Turbo Codes and Related Topics, Brest, France, pp. 80–87, September 1997]. The SCTCM system comprises a combination of the coding by the serially concatenated convolutional codes and a multi-value modulation, which collectively considers an arrangement of a signal point of a modulation signal and the decoding feature of an error correction code.

[0009] In this reference, the coding apparatus for carrying out coding according to the SCTCM system, when input data of 4-bit is input, carries out convolutional operation whose code rate is “⅘” as coding of a first code (hereinafter referred to an outer code) by a convolutional coder with respect to input data, applies interleave to coded data of 5-bit as the operation result, after which, carries out convolutional operation whose coded rate is “⅚” as coding of a second code (hereinafter referred to an inner code) by a convolutional coder with respect to input data, mapping coded data of 6-bit as the operation result to a transmission symbol of a predetermined modulation system, and outputs the produced transmission symbol the outside every coded transmission symbol. That is, this coding apparatus carries out convolutional operation whose code rate is “⅘” as coding of an outer code, and carries out convolutional operation whose code rate is “⅚” as coding of an inner code, whereby carrying out the serial concatenated convolutional operation whose code rate is “(⅘)×(⅚)= 4/6=⅔” as a whole. On the other hand, the decoding apparatus for carrying out decoding of codes of the SCTCM system by the coding apparatus, when a reception word is received, iteratively carries out decoding operation between two soft-output decoding circuits, for example, by the predetermined number of times such as several times to scores of times, and outputs decode data on the basis of exterinsic information of soft-output obtained as a result of the predetermined number of times of the decoding operation.

[0010] As the coding apparatus for carrying out coding according to th SCTCM system and the decoding apparatus for carrying out decoding according to th SCTCM system, apparatuses shown below have been also proposed. In the following, the coding apparatus for carrying out coding according to th SCTCM system and the decoding apparatus for carrying out decoding according to th SCTCM system will be explained. In the following description, a contemplation is made of a case in which as shown in FIG. 1, digital information is subjected to serially concatenated convolutional coding by a coder 201 provided on a transmission device not shown, which output is input into a receiver not shown through a memoryless channel 202 with noises, which is decoded by a decoder 203 provided on the receiver.

[0011] As the coding apparatus 201 for carrying out coding according to th SCTCM system, there has been proposed an apparatus comprising a convolutional coder 210 for carrying out coding of a first code (hereinafter referred to as an outer code), an interleaver 220 for rearranging order of data input, a convolutional coder 230 for carrying out coding of a second code (hereinafter referred to as an inner code), and a multi-value modulation mapping circuit 240 for carrying out mapping of a signal point on the basis of a predetermined modulation system, as shown in FIG. 2. The coding apparatus 201 carries out serially concatenated convolutional operation whose code rate is “⅔” with respect to input data D201 of 2-bit input, which is converted to code data D204 of 3-bit and subjected to mapping to, for example, a transmission symbol of a 8 PSK (8-Phase Shift Keying) modulation system to output it as a code transmission symbol D205 of 3-bit.

[0012] The convolutional coder 210, when input data D201 of 2-bit is input, carries out convolutional operation with respect to the input data D201, and outputs the operation result to an interleaver 220 in the later stage as code data D202 of 3-bit. That is, the convolutional coder 210 carries out convolutional operation whose code rate is “⅔” as coding of an outer code, and outputs the code data D202 to the interleaver 220 in the later stage.

[0013] The interleaver 220 inputs the code data D202 comprising three bit series output from the convolutional coder 210, rearranges order of bits constituting the code data D202, and outputs the produced interleave data D203 to a convolutional coder 230 in the later stage.

[0014] The convolutional coder 230, when the interleave data D203 of 3-bit is input, carries out convolutional operation with respect to the interleave data D203, and outputs the operation result to a multi-value modulation mapping circuit 240 in the later stage as code data D204 of 3-bit. That is, the convolutional coder 230 carries out convolutional operation whose code rate is “ 3/3=1” as coding of an inner code and outputs the code data D204 to the multi-value modulation mapping circuit 240 in the later stage.

[0015] The multi-value modulation mapping circuit 240 causes the code data D204 output from the convolutional coder 230 to synchronize with a clock to map it to a transmission symbol of a 8PSK modulation system, for example. Since a signal point of one transmission symbol in the 8SPSK modulation system is data of 3-bit, the multi-value modulation mapping circuit 240 maps the code data D204 of 3-bit output from the convolutional coder 230 as one transmission symbol to produce one code transmission symbol D205. The multi-value modulation mapping circuit 240 outputs the produced code transmission symbol D205 outside.

[0016] As described above, the coding apparatus 201 carries out convolutional operation whose code rate is “⅔” as coding of an outer code by the convolutional coder 210, and convolutional operation whose code rate is “1” as coding of an inner code is carried out by the convolutional coder 230 to thereby carry out the serially concatenated convolution operation whose code rate is “(⅔)×1=⅔” as a whole. Data code and modulated by the coding apparatus 201 is output to the receiver through the memoryless channel 202.

[0017] On the other hand, as the decoding apparatus 203 for carrying out decoding of codes of the SCTCM system by the coding apparatus 201, there has been proposed an apparatus comprising a soft-output decoding circuit 250 for carrying out decoding of an inner code, a deinterleaver 260 for returning order of data input to the original, an interleaver 270 for rearranging order of data input, and a soft-output decoding circuit 280 for carrying out decoding of an outer code, as shown in FIG. 3, for example. The decoding apparatus 203 takes an analog value due to the influence of noises generated on the memoryless channel 202, and presumes the input data D201 in the coding apparatus 201 from the reception word D206 to be a soft-input to output it as decode data D211.

[0018] The soft-output decoding circuit 250 is provided corresponding to the convolutional coder 230 in the coding apparatus 201 to carry out MAP (Maximum A Posteriori probability) decoding based on the so-called BCJR (Bahl, Cocke, Jelinek and Raviv) algorithm. The soft-output decoding circuit 250 inputs the soft-input reception word D206 received by the receiver, inputs priori probability information D207 with respect to soft-input information bits supplied from the interleaver 270, and carries out soft-output decoding of an inner code using these reception word 206 and priori probability information D207. The soft-output decoding circuit 250 produces exterinsic information D208 with respect to the information bits obtained under the constraint conditions of codes, and outputs the exterinsic information D208 to the deinterleaver 260 in the later stage as a soft-output. The exterinsic information D208 corresponds to the interleave data D203 interleaved by the interleaver 220 in the coding apparatus 201.

[0019] The deinterleaver 260 applies the deinterleave to the soft-input exterinsic information D208 output from the soft-output decoding circuit 250 so that a bit array of the interleave data D203 interleaved by the interleaver 220 in the coding apparatus 201 is returned to a bit array of the original code data D202. The interleaver 260 outputs data obtained by interleaving as the priori probability information D209 with respect to signal bits in the soft-output decoding circuit 280 in the later stage.

[0020] The interleaver 270 applies the interleave based on the same exchange position information as the interleaver 220 in the coding apparatus 201 with respect to the exterinsic information D210 relative to the soft-input code bit output from the soft-output decoding circuit 280. The interleaver 270 outputs data obtained by interleaving as the priori probability information D207 with respect to information bits in the soft-output decoding circuit 250.

[0021] The soft-output decoding circuit 280 is provided corresponding to the convolutional coder 210 in the coding apparatus 201 to carry out the MAP decoding and SOVA decoding based on the BCJR algorithm described above, similarly to the soft-output decoding circuit 250. The soft-output decoding circuit 280 inputs priori probability information D209 with respect to the soft-input code bit output from the deinterleaver 260, inputs priori probability information whose value is “0”, though not shown, and carries out soft-output decoding of an outer code using the priori probability information. The soft-output decoding circuit 280 produces exterinsic information D210 with respect to the code bit obtained under the constraint condition of codes, and outputs the exterinsic information D210 as a soft-output to the interleaver 270. Further, the soft-output decoding circuit 280 produces exterinsic information with respect to information bit obtained under the constraint condition of codes, and outputs decode data D211 of hard-output on the basis of the exterinsic information.

[0022] The decoding apparatus 203 as described above, when the reception word is received, iteratively carries out decoding operation of the soft-output decoding circuit 250 to the soft-output decoding circuit 280 by the number of predetermined times, for example, such as several times to scores of times to output the decode data D211 on the basis of the soft-output exterinsic information obtained as a result of the number of predetermined times of decoding operation.

[0023] As described above, in the system constituted by the coding apparatus 201 and the coding apparatus 203, the coding according to the SCTCM system and the decoding according to the SCTCM system can be carried out.

[0024] Incidentally, the conventional actual conditions were that in the system comprising the aforementioned coding apparatus 201 and the decoding apparatus 203, the error correction coding and decoding according to the SCTCM system can be carried out under the high coding rate, but there remains room of improvement in terms of the performance.

[0025] The present invention has been accomplished in view of the actual conditions as noted above. It is an object of the present invention to provide a coding apparatus capable of carrying out coding and decoding under the high performance, a coding method and a recording medium having a code program recorded therein, and a decoding apparatus, a decoding method and a recording medium having a decode program recorded therein.

[0026] A coding apparatus according to the present invention for achieving the aforementioned object is a coding apparatus for carrying out serially concatenated code modulation with respect to data input comprising: a first coding means for carrying out coding whose code rate is k/(k+1) with respect to data of k-bit input; a first interleaving means for interleaving order of bits constituting data comprising a bit series of (k+1) bits coded by the first coding means; at least one or more second coding means serially concatenated with the later stage away from the first interleaving means to carry out coding whose code rate is 1 with respect to data of (k+1) bit input; at least one or more second interleaving means serially concatenated with the respective ones of the at least one or more second coding means to interleave order of bits constituting data comprising a bit series of (k+1) bits coded by the second coding means in the first stage; a third coding means serially concatenated with the second interleaving means in the final stage to carry out coding whose code rate is 1 with respect to data of (k+1) bit input; and a mapping means for mapping data of (k+1) bit coded by the third coding means to a transmission symbol of a predetermined modulation.

[0027] Further, a coding method according to the present invention for achieving the aforementioned object is a coding method for carrying out serially concatenated code modulation with respect to data input comprising: a first coding step for carrying out coding whose code rate is k/(k+1) with respect to data of k-bit input; a first interleaving step for interleaving order of bits constituting data comprising a bit series of (k+1) bits coded by the first coding step; a coding processing step for carrying out at least one or more processes including a second coding step for carrying out coding whose code rate is 1 with respect to data of (k+1) bit input; and a second interleaving step for interleaving order of bits constituting data comprising a bit series of (k+1) bits coded by the second coding step; a third coding step for carrying out coding whose code rate is 1 with respect to data of (k+1) bit processed by the coding processing step; a mapping step for mapping data of (k+1) bit code by the third coding step to a transmission symbol of a predetermined modulation.

[0028] Furthermore, a decoding apparatus according to the present invention for achieving the aforementioned object is a decoding apparatus for carrying out decoding of codes subjected to serially concatenated code modulation by coding equipment comprising: a first coding means for carrying out coding whose code rate is k/(k+1) with respect to data of k-bit input; a first interleaving means for interleaving order of bits constituting data comprising a bit series of (k+1) bits coded by the first coding means; at least one or more second coding means serially concatenated with the later stage away from said first interleaving means to carry out coding whose code rate is 1 with respect to data of (k+1) bit input; at least one or more second interleaving means serially concatenated with the respective ones of said at least one or more second coding means to interleave order of bits constituting data comprising a bit series of (k+1) bits coded by the second coding means in the first stage; a third coding means serially concatenated with the second interleaving means in the final stage to carry out coding whose code rate is 1 with respect to data of (k+1) bit input; and a mapping means for mapping data of (k+1) bit coded by the third coding means to a transmission symbol of a predetermined modulation, the decoding apparatus comprising: a first soft-output decoding means provided corresponding to the third coding means to carry out soft-output decoding using a reception word which is a soft-input input, and priori probability information with respect to information bits of (k+1) bits which is a soft-input input; at least one or more first deinterleaving means serially concatenated with the later stage away from the first soft-output decoding means to rearrange data of (k+1) bits of a soft-input input so that a bit array of data of (k+1) bits rearranged by the second interleaving means is returned to a bit array of data of (k+1) bits coded by the second coding means; at least one or more second soft-output decoding means provided corresponding to the respective ones of the at least one or more second coding means and serially concatenated with the respective ones of the at least one or more first deinterleaving means to carry out soft-output decoding using priori probability information with respect to code bits of (k+1) bits which are a soft-input output from the first deinterleaving means, and priori probability information with respect to information bits of (k+1) bits which are a soft-input input; one or more third interleaving means for interleaving order of bits constituting data comprising a bit series of (k+1) pieces of a soft-input output from the respective ones of the at least one or more second soft-output decoding means on the basis of the same exchange position information as that of the second interleaving means; a second deinterleaving means serially concatenated with the second soft-output decoding means in the final stage to rearrange data of (k+1) bits of a soft-input input so that a bit array of data of (k+1) bits rearranged by the first interleaving means is returned to a bit array of data of (k+1) bits coded by the first coding means; a third soft-output decoding means provided corresponding to the first coding means and serially concatenated with the second deinterleaving means to carry out soft-output decoding using priori probability information with respect to code bits of (k+1) bits which are a soft-input output from the second deinterleaving means, and priori probability information with respect to information bits of (k+1) bits which are a soft-input input; and a fourth interleaving means for interleaving order of bits constituting data comprising a bit series of (k+1) pieces of a soft-input output from the third soft-output decoding means on the basis of the same exchange position information as that of the first interleaving means.

[0029] Further, the decoding method according to the present invention for achieving the aforementioned object is a decoding method for carrying out decoding of codes subjected to serially concatenated code modulation by a coding method comprising: a first coding step for carrying out coding whose code rate is k/(k+1) with respect to data of k-bit input; a first interleaving step for interleaving order of bits constituting data comprising a bit series of (k+1) pieces coded by the first coding step; a coding processing step for carrying out at least one or more processes including a second coding step for carrying out coding whose code rate is 1 with respect to data of (k+1) bit input; and a second interleaving step for interleaving order of bits constituting a bit series of (k+1) pieces coded by the second coding step; a third coding step for carrying out coding whose code rate is 1 with respect to data of (k+1) bit processed by the coding processing step and input; and a mapping step for mapping data of (k+1) bits coded by the third coding step to a transmission symbol of a predetermined modulation; the decoding method comprising: a first soft-output decoding step provided corresponding to the third coding step to carry out soft-output decoding using a reception word which is a soft-input input, and priori probability information with respect to information bits of (k+1) bits which is a soft-input input; a decoding processing step for carrying out at least one or more processes including a first deinterleaving step, a second soft-output decoding step and a third interleaving step with respect to data of (k+1) bits of a soft-input input; a second deinterleaving step for rearranging data of (k+1) bits of a soft-input processed by the decoding processing step input so that a bit array of data of (k+1) bits rearranged by the first interleaving step is returned to a bit array of data of (k+1) bits coded by the first coding step; a third soft-output decoding step provided corresponding to the first coding step to carry out soft-output decoding using priori probability information with respect to code bits of (k+1) bits which are a soft-input rearranged by said second deinterleaving step, and priori probability information with respect to information bits of (k+1) bits which are a soft-input input; and a fourth interleaving step for interleaving order of bits constituting data comprising a bit series of (k+1) pieces of a soft-input output produced by said third soft-output decoding step on the basis of the same exchange position information as that of the first interleaving step; the first deinterleaving step rearranging data of (k+1) bits of a soft-input input so that a bit array of data of (k+1) bits rearranged by the second interleaving step is returned to a bit array of data of (k+1) bits coded by the second coding step; the second soft-output decoding step being provided corresponding to the respective ones of at least one or more second coding steps to carry out soft-output decoding using priori probability information with respect to code bits of (k+1) bits which are a soft-input output rearranged by the first deinterleaving step, and priori probability information with respect to information bits of (k+1) bits which are a soft-input input; and the third interleaving step for interleaving order of bits constituting data comprising a bit series of (k+1) pieces of a soft-input produced by the respective ones of at least one or more second soft-output decoding steps on the basis of the same exchange position information as that of the second interleaving step.

[0045] Preferred embodiments to which is applied the present invention will be described in detail with reference to the accompanying drawings.

[0046] This embodiment is concerned with a data transmit-receive system applied to a communication model in which as shown in FIG. 4, digital information is coded by a coding apparatus 1 provided on a communication apparatus not shown, output of which is input into a receiving apparatus not shown through a memoryless channel 2 with noises, and the output is decoded by a decoding apparatus 3 provided on the receiving apparatus.

[0047] In the data transmit-receive system, the coding apparatus 1 carries out coding according to a serial concatenated trellis code modulation, which is hereinafter referred to as SCTCM, system, in which at least three or more coders are serially concatenated through interleavers. Further, the decoding apparatus 3 carries out decoding of codes code according to the SCTCM system by the coding apparatus 1, in which at least three or more decoding circuits depending on the constitution of the coding apparatus 1 are serially concatenated.

[0048] As shown in FIG. 5, the coding apparatus 1 comprises three convolutional coders 10, 30 and 50 for carrying out convolutional operation which are a first coding means, a second coding means, a third coding means; two interleavers 20 and 40 which are a first interleaving means and a second interleaving means for rearranging order of data input; and a multi-value modulation mapping circuit 60 which is a mapping means for carrying out mapping of a signal point on the basis of a predetermined modulation system. The coding apparatus carries out serial concatenated convolutional operation whose code rate is “⅔” with respect to input data D1 of 2 bits input to convert the former into code data D6 of 3 bits, which is subjected, for example, to mapping to a transmission symbol of a 8 PSK (8-phase Shift Keying) modulation system to output it as one code transmission symbol D7 of 3 bits.

[0049] The convolutional coder 10 comprises three exclusive-OR circuits 11, 13, and 15, and two shift registers 12 and 14, as shown in FIG. 6.

[0050] The exclusive logic sum circuits 11 carries out exclusive-OR operation using input data D1₁ and D1₂ of 2 bits to supply the operation result to the shift register 12.

[0051] The shift register 12 continues to supply data of 1 bit being held to the exclusive-OR circuit 13. The shift register 12 newly holds data of 1 bit supplied from the exclusive-OR circuit 11 by being synchronized with a clock, and newly supplies the data to the exclusive-OR circuit 13.

[0052] The exclusive-OR circuit 13 uses data supplied from the shift register 12 and input data D1₁ of 1 bit out of input data D1 of 2 bits to carry out exclusive-OR operation to supply the operation result to the shift register 14.

[0053] The shift register 14 continues to supply data of 1 bit being held to the exclusive-OR circuit 15. The shift register 14 newly holds data of 1 bit supplied from the exclusive-OR circuit 13 by being synchronized with a clock, and newly supplies the data to the exclusive-OR circuit 15.

[0054] The exclusive-OR circuit 15 uses data supplied from the shift register 14 and input data D1₁ and D1₂ to carry out exclusive-OR operation to output the operation result to the interleaver 20 in the later stage as code data D2₃ of 1 bit out of code d at D2 of 3 bits.

[0055] The convolutional coder 10, when input data D1₁ and D1₂ of 2 bits are input, carries out convolutional operation with respect to the D1₁ and D1₂ to output the operation result to the interleaver 20 in the later stage as code data D1₁, D1₂ and D2₃ of 3 bits. That is, the convolutional coder 10 carries out convolutional operation whose code rate is “⅔” as coding of a first code (hereinafter referred to as an exterinsic code) to output code data D2 to the interleaver 20 in the later stage.

[0056] As shown in FIG. 7, the interleaver 20 comprises an input data holding memory 21 for holding data input, a data exchange circuit 22 for carrying out rearrangement (exchange) of data input, an exchange data ROM (Read Only Memory) for storing exchange position information of data, and an output data holding memory 24 for holding data output.

[0057] The input data holding memory 21 holds code data D2 comprising three bit series output from the convolutional coder 10 to supply the code data D2 to the data exchange circuit 22 at a predetermined timing.

[0058] The data exchange circuit 22 rearranges order of the code data D2 supplied from the input data holding memory 21 on the basis of the exchange position information of data being stored in the exchange data ROM 23. The data exchange circuit 22 supplies the rearranged data to the output data holding memory 24.

[0059] The exchange ROM 23 stores exchange position information of data decided, for example, on the basis of random number generated. The interleaver 20 is constituted as a random interleaver for carrying out interleave of data on the basis of the exchange position information. The exchange position information stored in the exchange data ROM is read by the data exchange circuit 22 as occasion calls.

[0060] The output data holding memory 24 holds data supplied from the data exchange circuit 22, and outputs these data to the convolutional coder 30 at a predetermined timing as interleave data D3 comprising three bit series.

[0061] The interleaver 20 applies interleave to the code data D2 output from the convolutional coder 10 to output it to the convolutional coder 30 in the later stage.

[0062] More specifically, the input data holding memory 21 sequentially inputs and holds the respective ones of code data D2 comprising three bit series output from the convolutional coder 1. The input data holding memory 21 sequentially holds, for example, bits constituting respective ones of code data D2 at a predetermined timing, and supplies the data being held to the data exchange circuit 22 at a timing produced by three bit series comprising N bits (N is suitable natural number).

[0063] Continuously, the data exchange circuit 22 rearranges order of bits of N×3 pieces constituting three bit series supplied from the input holding memory 21 on the basis of exchange information stored in the exchange data ROM 23. The data exchange circuit 22 supplies three new bit series obtained by the rearrangement to the output data holding memory 24.

[0064] The output data holding memory 24 holds bits constituting three bit series supplied from the data exchange circuit 22, and outputs the data held to the convolutional coder 30 in the later stage at a predetermined timing, as the interleave data D3.

[0065] As described above, the interleaver 20 inputs the code data D2 comprising three bit series output from the convolutional coder 10, and rearrange order of bits constituting the code data D2 on the basis of exchange position information pre-stored to produce the interleave data D3.

[0066] As shown in FIG. 8, the convolutional coder 30 comprises an exclusive-OR circuit 31 and a shift register 32.

[0067] The exclusive-OR circuit 31 carries out exclusive-OR operation using interleave data D3₁, D3₂ and D3₃ of 3 bits to output the operation result to an interleaver 40 in the later stage as code data D4₃ of 1 bit out of code data D4 of 3 bits and supply them to the shift register 32.

[0068] The shift register 3 continues to supply data of 1 bit being held to the exclusive-OR circuit 31. The shift register 32 newly holds data of 1 bit supplied from the exclusive-OR circuit 31 by being synchronized with a clock, and newly supplies the data to the exclusive-OR circuit 31.

[0069] As described above, the convolutional coder 30, when the interleave data D3₁, D3₂ and D3₃ of 3 bits are input, carries out recursive system convolutional operation with respect to these interleave data D3₁, D3₂ and D3₃ to output the operation result to the interleaver 40 in the later stage as code data D3₁, D3₂ and D3₃ of 3 bits. That is, the convolutional coder 30 carries out recursive system convolutional operation whose code rate is “ 3/3=1” as coding of a second code (hereinafter referred to as a middle code) to output code data D4 to the interleaver 40.

[0070] The interleaver 40 comprises the constitution similar to that of the interleaver 20. That is, as shown in FIG. 9, the interleaver 40 comprises an input data holding memory 41 for holding data input, a data exchange circuit for rearranging order of data input, an exchange data ROM 43 for storing exchange position information of data, and an output data holding memory 44 for holding data output.

[0071] The interleaver 40 as described above inputs code data D4 comprising three bit series output from the convolutional coder 30, and rearranges order of bits constituting the code data D4 on the basis of exchange position information pre-stored to produce interleave data D5. The interleaver 40 outputs the produced interleave data D5 to a convolutional coder 50 in the later stage.

[0072] It is noted that exchange position information of data stored in an exchange data ROM 43 in the interleaver 40 may be the same as or different from exchange position information of data stored in the exchange data ROM 23 in the interleaver 20.

[0073] A convolutional coder 50 comprises the constitution similar to that of the convolutional coder 30. That is, the convolutional coder 50 comprises an exclusive-OR circuit 51 and a shift register 52, as shown in FIG. 10.

[0074] The convolutional coder 50 as described above, when the interleave data D5₁, D5₂ and D5₃ of 3 bits are input, carries out recursive system convolutional operation with respect to these interleave data D5₁, D5₂ and D5₃ to output the operation result to a multi-value modulation mapping circuit 60 in the later stage as code data D6₁, D6₂ and D6₃ of 3 bits. That is, the convolutional coder 50 carries out recursive systematic convolutional operation whose code rate is “ 3/3=1” as coding of a third code (hereinafter referred to as an internal code) to output code data D6 to the multi-value modulation mapping circuit 60 in the later stage.

[0075] The multi-value modulation mapping circuit 60 causes the code data to synchronize with a clock to map to a transmission symbol of an 8PSK modulation system, for example. That is, the multi-value modulation mapping circuit 60 maps the code data D6 of 3 bits output from the convolutional coder 50 to produce one code transmission symbol D7. The multi-value modulation mapping circuit 60 outputs the produced code transmission symbol D7 outside.

[0076] The coding apparatus 1 as described above carries out convolutional operation whose code rate is “⅔” as coding of an outer code by the convolutional coder 10, carries out convolutional operation whose code rate is “1” as coding of a middle code by the convolutional coder 30, and carries out convolutional operation whose code rate is “1” as coding of an inner code by the convolutional coder 50 whereby the serial concatenated convolutional operation whose code rate is “(⅔)×1×1=⅔” can be carried out as a whole. Data code and modulated by the coding apparatus are output to the receiving apparatus through the memoryless channel 2.

[0077] On the other hand, the decoding apparatus 3 comprises, as shown in FIG. 11, three soft-output decoding circuits 70, 100 and 130 which are a first soft-output decoding means, a second soft-output decoding means, and a third soft-output decoding means for carrying out soft-output decoding, two deinterleavers 80 and 110 which are a first deinterleaving means and a second deinterleaving means for returning order of data input to the original, two interleavers 90 and 120 which are a third interleaving means and a fourth interleaving means for rearranging order of data input, and a binary circuit 140 which is a binary means for forming data input into a form of a binary. The decoding apparatus 3 takes an analog value due to the influence of noises generated on the memoryless channel 2 and presumes input data D1 in the coding apparatus 1 from a reception word D8 to be a soft-input to output it as decode data D18.

[0078] The soft-output decoding circuit 70 is provided corresponding to the convolutional coder 50 in the coding apparatus 1. The soft-output decoding circuit 70 comprises, as shown in FIG. 12, a MAP decoder 71 for carrying out a maximum a posteriori probability, which is hereinafter referred to as MAP, decoding on the basis of a so-called BCJR (Bahl, Cocke, Jelinek and Raviv) algorithm, and three differentiators 72, 73 and 74.

[0079] The MAP decoder 71 inputs a reception word D8 which is a soft-output, and priori probability information D9₁, D9₂ and D9₃ with respect to information bit of 3 bits which are a soft-input supplied from the interleaver 90, and carries out MAP decoding based on the BCJR algorithm to produce posteriori probability information D20₁, D20₂ and D20₃ with respect to information bit of 3 bits on the basis of the reception word D8. The MAP decoder 71 supplies the produced posteriori probability information D20, to the differentiator 72, supplies the produced posteriori probability information D20₂ to the differentiator 73, and supplies the produced posteriori probability information D20₃ to the differentiator 74.

[0080] The differentiator 72 obtains a differential value between the produced posteriori probability information D20₁ and the priori probability information D9_1, and outputs the differential value to the deinterleaver 80 as a soft-output, as the extrinsic information D10₁ of 1 bit out of the extrinsic information D10 with respect to information bit of 3 bits obtained according to the constraint condition of codes.

[0081] The differentiator 73 obtains a differential value between the posteriori probability information D20₂ to be a soft-output and the priori probability information D20₂, and outputs the differential value to the deinterleaver 80 in the later stage as a soft-output, as the extrinsic information D20₂ of 1 bit out of the extrinsic information D10 with respect to information bit of 3 bits.

[0082] The differentiator 74 obtains a differential value between the posteriori probability information D20₃ to be a soft-output and the priori probability information D20₃ and outputs the differential value to the deinterleaver 80 in the later stage as a soft-output, as the extrinsic information D20₃ of 1 bit out of the extrinsic information D10 with respect to information bit of 3 bits The soft-output decoding circuit 70 as described above inputs the reception word D8 of a soft-input received by the receiving apparatus, inputs the priori probability information D9 with respect to information bit of a soft-input supplied from the interleaver 90, and carries out MAP decoding based on the BCJR algorithm using these reception word D8 and the priori probability information D9 and carries out soft-output decoding of inner codes. The soft-output decoding circuit 70 produces the extrinsic information D10 obtained according to the constraint condition of codes, and outputs extrinsic information D10 to the deinterleaver 80 in the latter stage as a soft-output.

[0083] Specifically explaining, let u be the information bit, c the code bit, and y the reception word D8, then the soft-output decoding circuit 70 causes priori probability information D9 (L(u)) expressed in the following Equation (1) to input into the MAP decoder 71 along with the reception word D8 (y): $\begin{array}{cc}L\left(u\right)=\log \frac{P\left(u=1\right)}{P\left(u=0\right)}& \left(1\right)\end{array}$

[0084] That is, the soft-output decoding circuit 70 causes the reception word D8 (y) and priori probability information D9 (L(u)) free from the constraint condition of codes expressed by the natural logarithm which is the ratio between the probability P(u—1) whose information bit u is “1” and the probability P(u=0) whose information bit u is “0” to input into the MAP decoder 71.

[0085] Continuously, the soft-output decoding circuit 70 carries out MAP decoding on the basis of BCJR algorithm by the MAP decoder 71 to produce posteriori probability information D20 (L*(u)) expressed by the following Equation (2): $\begin{array}{cc}{L}^{*}\left(u\right)=\log \frac{P(u=1y)}{P(u=0y)}& \left(2\right)\end{array}$

[0086] That is, the soft-output decoding circuit 70 produces posteriori probability information D20 (L*(u)) on the basis of the constraint condition of codes expressed by the natural logarithm which is the ratio between the probability P (u=1|y) whose information bit u is “1” when received the reception word D8 (y) and the probability P (u=0|y) whose information bit u is “0” when received the reception word D8 (y). The posteriori probability information D20 (L*(u)) is also called the log likelihood ratio, and here, it shows the likelihood of the information bit u when received the reception word D8 (y).

[0087] The soft-output decoding circuit 70 obtains extrinsic information D10 (Le(u)) which is a differential value between the posteriori probability information D20 (L*(u)) and the priori probability D9 (L(u)), as expressed by the following Equation (3) by the differentiators 72, 73 and 74.
L_e(u)=L*(u)−L(u)  (3)

[0088] The soft-output decoding circuit 70 produces the extrinsic information D 10 as in the manner as described above, and outputs the extrinsic information D10 to the deinterleaver 80 in the later stage as a soft-output. The extrinsic information D10 corresponds to the interleave data D5 interleaved by the interleaver 40 in the coding apparatus 1.

[0089] The deinterleaver 80 applies the interleave to the exterinsic information D10 of a soft-input output from the soft-output decoding circuit 70 so that a bit array of the interleave data D5 interleaved by the interleaver 40 is returned to a bit array of the original code data D4. The deinterleaver 80 outputs the data obtained by being interleaved as priori probability information D11 with respect to the code bit in the soft-output decoding circuit 100 in the latter stage.

[0090] The interleaver 90 applies the interleave based on the same exchange position information as the interleaver 40 in the coding apparatus 1 to the exttrinsic information D14 with respect to the code bit which is a soft-output output from the soft-output decoding circuit 100. The interleaver 90 outputs the data obtained by being interleaved as the priori probability information D9 with respect to the signal bit in the soft-output decoding circuit 70.

[0091] A soft-output decoding circuit 100 is provided corresponding to the convolutional decoder 30 in the coding apparatus 1. The soft-output decoding circuit 100 comprises, as shown in FIG. 13, a MAP decoder 101 for carrying out MAP decoding based on the BCJR algorithm described above, and six differentiators 102, 103, 104, 105, 106 and 107.

[0092] A MAP decoder 101 inputs priori probability information D11₁, D11₂ and D11₃ with respect to the code bit of 3 bits which is a soft-output output from the deinterleaver 80, and posterori probability information D12₁, D12₂ and D12₃ with respect to the information bit of 3 bits which is a soft-input supplied from the interleaver 120, and carries out MAP decoding based on the BCJR algorithm to produce posterori probability information D21₁, D21₂ and D21₃ with respect to the information bit of 3 bits and produce posterori probability information D22₁, D22₂ and D22₃ with respect to the information bit of 3 bits. The MAP 101 supplies the produced posterori probability information D21, to the differentiator 102, supplies the produced posterori probability information D2₂ to the differentiator 103, and supplies the produced posterori probability information D21₃ to the differentiator 104. Further, The MAP 101 supplies the produced posterori probability information D22₁ to the differentiator 105, supplies the produced posterori probability information D22₂ to the differentiator 105, and supplies the produced posterori probability information D22₃ to the differentiator 106.

[0093] The differentiator 102 obtains a differential value between the posterori probability information D21₁ to be a soft-input and the priori probability information D12₁ to be a soft-input to output the differential value to the deinterleaver 110 in the later stage as a soft-output, as the extrinsic information D13₁ of 1 bit out of the extrinsic information D13 with respect to information bit of 3 bits obtained according to the constraint condition of codes.

[0094] The differentiator 103 obtains a differential value between the posterori probability information D21₂ to be a soft-input and the priori probability information D12₂ to be a soft-input to output the differential value to the deinterleaver 110 in the later stage as a soft-output, as the extrinsic information D13₂ of 1 bit out of the extrinsic information D13 with respect to information bit of 3 bits.

[0095] The differentiator 104 obtains a differential value between the posterori probability information D21₃ to be a soft-input and the priori probability information D123 to be a soft-input to output the differential value to the deinterleaver 110 in the later stage as a soft-output, as the extrinsic information D133 of 1 bit out of the extrinsic information D13 with respect to information bit of 3 bits.

[0096] The differentiator 105 obtains a differential value between the posterori probability information D22₁ to be a soft-input and the priori probability information D11₁ to be a soft-input to output the differential value to the interleaver 90 as a soft-output, as the extrinsic information D14₁ of 1 bit out of the extrinsic information D14 with respect to information bit of 3 bits.

[0097] The differentiator 106 obtains a differential value between the posterori probability information D22₂ to be a soft-input and the priori probability information D11₂ to be a soft-input to output the differential value to the interleaver 90 as a soft-output, as the extrinic information D14₂ of 1 bit out of the exttrinsic information D14 with respect to information bit of 3 bits.

[0098] The differentiator 107 obtains a differential value between the posterori probability information D22₃ to be a soft-input and the priori probability information D11₃ to be a soft-input to output the differential value to the interleaver 90 as a soft-output, as the extrinsic information D14₃ of 1 bit out of the extrinsic information D14 with respect to information bit of 3 bits.

[0099] The soft-output decoding circuit 100 as described above inputs the priori probability information D11 with respcet to the code bit of a soft-input output from the deinterleaver 80, and inputs the priori probability information D 12 with respect to the information bit of a soft-input supplied from the interleaver 120, and uses these priori probability information D11 and D12 to carry out MAP decoding based on the BCJR algorithm and carry out soft-output decoding of middle codes. The soft-output decoding circuit 100 produces the extrinsic information D13 and D14 obtained according to the constraint condition of codes, and outputs the extrinsic information D13 to the deinterleaver 110 in the later stage as a soft-output, and outputs the extrinsic information D14 to the interleaver 90 as a soft-output.

[0100] Specifically explaining, let u be the information bit and c the code bit, then the soft-output decoding circuit 100 causes priori probability information D12 (L(u)) expressed in the following Equation (4) and priori probability information D11 (L(c)) expressed in the following Equation (5) to input into the MAP decoder 101: $\begin{array}{cc}L\left(u\right)=\log \frac{P\left(u=1\right)}{P\left(u=0\right)}& \left(4\right)\\ L\left(c\right)=\log \frac{P\left(c=1\right)}{P\left(c=0\right)}& \left(5\right)\end{array}$

[0101] That is, the soft-output decoding circuit 100 causes the priori probability information D12 (L(u)) on the basis of the constraint condition of codes expressed by the natural logarithm which is the ratio between the probability P(u=1) whose information bit u is “1” and the probability P (u=0) whose information bit u is “0”, and the priori probability information D11 (L(c)) on the basis of the constraint condition of codes expressed by the natural logarithm which is the ratio between the probability P(c=1) whose code bit c is “1” and the probability P (c=0) whose code bit c is “0” to input into the MAP decoder 101.

[0102] Continuously, the soft-output decoding circuit 100 carries out MAP decoding on the basis of BCJR algorithm by the MAP decoder 101 to produce posteriori probability information D21 (L*(u)) expressed by the following Equation (6) and posteriori probability information D22 (L*(c)) expressed by the following Equation (7): $\begin{array}{cc}{L}^{*}\left(u\right)=\log \frac{P\left(u=1\right)}{P\left(u=0\right)}& \left(6\right)\\ L^{*}\left(c\right)=\log \frac{P\left(c=1\right)}{P\left(c=0\right)}& \left(7\right)\end{array}$

[0103] That is, the soft-output decoding circuit 100 produces posteriori probability information D21 (L*(u)) on the basis of the constraint condition of codes expressed by the natural logarithm which is the ratio between the probability P (u−1) whose information bit u is “1” and the posteriori probability P (u=0) whose information bit u is “0”, and posterior probability information D22 (L*(c)) on the basis of the constraint condition of codes expressed by the natural logarithm which is the ratio between the probability P (C=1) whose code bit c is “1” and the probability P(c=0) whose code bit c is “0”. It is noted that the constraint conditions of codes described on the right side of the Equations (6) and (7) are omitted here. The posteriori probability information D21 (L*(u)) and the posteriori probability information D22 (L*(c)) are also called the log likelihood ratio, and here, it shows the likelihood of the information bit u and the likelihood of the code bit c.

[0104] The soft-output decoding circuit 100 obtains extrinsic information D113 (Le(u)) which is a differential value between the posteriori probability information D21 (L*(u)) and the priori probability D 12 (L(u)), as expressed by the following Equation (8) by the differentiators 102, 103 and 104; and obtains extrinsic information D14 (Le(c)) which is a differential value between the posteriori probability information D22 (L*(c)) and the priori probability D11 (L(c)), as expressed by the following Equation (9) by the differentiators 105, 106 and 107.
L_e(u)=L*(u)−L(u)  (8)
L_e(c)=L*(c)−L(c)  (9)

[0105] The soft-output decoding circuit 100 produces the extrinsic information D13 and D14 in the manner as described above, outputs the extrinsic information D13 to the deinterleaver 110 in the later stage as a soft-output and outputs the extrinsic information D14 to the deinterleaver 90 as a soft-output. The extrinsic information D13 corresponds to the interleave data D3 interleaved by the interleaver 20.

[0106] The deinterleaver 110 applies the deinterleave to the extrinsic information D13 of a soft-input output from the soft-output decoding circuit 100 so that a bit array of the interleave data D3 interleaved by the interleaver 20 is returned to a bit array of the original code data D2. The deinterleaver 100 outputs the data obtained by being interleaved as priori probability information D115 with respect to the code bit in the soft-output decoding circuit 130 in the latter stage.

[0107] The interleaver 120 applies the interleave based on the same exchange position information as the interleaver 20 in the coding apparatus 1 to the extrinsic information D18 with respect to the code bit which is a soft-output output from the soft-output decoding circuit 130. The interleaver 120 outputs the data obtained by being interleaved as the priori probability information D12 with respect to the information bit in the soft-output decoding circuit 100.

[0108] A soft-output decoding circuit 130 is provided corresponding to the convolutional decoder 10 in the coding apparatus 1. The soft-output decoding circuit 130 comprises, as shown in FIG. 14, a MAP decoder 131 for carrying out MAP decoding based on the BCJR algorithm described above, and five differentiators 132, 133, 134, 135, and 136.

[0109] A MAP decoder 131 inputs priori probability information D15₁, D15₂ and D15₃ with respect to the code bit of 3 bits which is a soft-output output from the deinterleaver 110, and posterori probability information D16₁ and D16₂ with respect to the information bit of 2 bits whose value is “0”, and carries out MAP decoding based on the BCJR algorithm to produce posterori probability information D21₁, D21₂ and D21₃ with respect to the information bit of 3 bits and produce posterori probability information D23₁ and D23₂ with respect to the information bit of 3 bits and produce posterori probability information D24₁, D24₂ and D24₃ with respect to the code bit of 3 bits. The MAP 131 supplies the produced posterori probability information D23₁ to the differentiator 132, and supplies the produced posterori probability information D23₂ to the differentiator 133. Further, the MAP 131 supplies the produced posterori probability information D24₁ to the differentiator 134, supplies the produced posterori probability information D24₂ to the differentiator 135, and supplies the produced posterori probability information D24₃ to the differentiator 136.

[0110] The differentiator 132 outputs a differential value between the posterori probability information D23, to be a soft-input and the priori probability information D16₁ whose value is “0”, that is, the priori probability information D23₁ to the binary circuit 140 as a soft-output, as the extrinsic information D17, of 1 bit out of the extrinsic information D17 with respect to information bit of 2 bits obtained according to the constraint condition of codes.

[0111] The differentiator 133 outputs a differential value between the posterori probability information D23₂ to be a soft-input and the priori probability information D16₂ whose value is “0”, that is, the posterori probability information D23₂ to the binary circuit 140 in the later stage as a soft-output, as the extrinsic information D 172 of 1 bit out of the extrinsic information D17 with respect to information bit of 2 bits.

[0112] The differentiator 134 obtains a differential value between the posterori probability information D24₁ to be a soft-input and the priori probability information D15₁ to be a soft-input to output the differential value to the interleaver 120 as a soft-output, as the extrinsic information D18₁ of 1 bit out of the extrinsic information D18 with respect to code bit of 3 bits.

[0113] The differentiator 135 obtains a differential value between the posterori probability information D24₂ to be a soft-input and the priori probability information D15₂ to be a soft-input to output the differential value to the interleaver 120 as a soft-output, as the extrinsic information D18₂ of 1 bit out of the extrinsic information D18 with respect to the code bit of 3 bits.

[0114] The differentiator 136 obtains a differential value between the posterori probability information D24₃ to be a soft-input and the priori probability information D15₃ to be a soft-input to output the differential value to the interleaver 120 as the extrinsic information D18₃ of 1 bit out of the extrinsic information D18 with respect to the information bit of 3 bits.

[0115] The soft-output decoding circuit 130 as described above inputs the priori probability information D15 with respect to the code bit of a soft-input output from the deinterleaver 110, and inputs the priori probability information D16 with respect to the information bit whose value is “1”, and uses these priori probability information D15 and D16 to carry out MAP decoding based on the BCJR algorithm and carry out soft-output decoding of outer codes. The soft-output decoding circuit 130 produces the extrinsic information D17 and D18 obtained according to the constraint condition of codes, and outputs the extrinsic information D17 to the binary circuit 140 in the later stage as a soft-output, and outputs the extrinsic information D18 to the interleaver 120 as a soft-output.

[0116] Specifically explaining, let u be the information bit and c the code bit, as described above, then the soft-output decoding circuit 130 causes priori probability information D16 (L(u)) expressed in the above Equation (4) and priori probability information D15 (L(c)) expressed in the above Equation (5) to input into the MAP decoder 131. It is noted here that priori probability information D16 (L(u)) is “0” because the probability whether the information bit u is “0” or “1” is ½.

[0117] Continuously, the soft-output decoding circuit 130 carries out MAP decoding on the basis of BCJR algorithm by the MAP decoder 131 to produce posteriori probability information D23 (L*(u)) expressed by the above Equation (6) and posteriori probability information D22 (L*(c)) expressed by the above Equation (7). That is, the soft-output decoding circuit 130 produces the posteriori probability information D23 (L*(u)) on the basis of the constraint condition of codes expressed by the natural logarithm of the ratio between the probability P (u=1) whose information bit u is “1” and the probability P (u=0) whose information bit u is “0” and the posteriori probability information D24 (L*(c)) on the basis of the constraint condition of codes expressed by the natural logarithm of the ratio between the probability P (c=1) whose code bit c is “1” and the probability P (c=0) whose code bit c is “0”. It is noted that these posteriori probability information D23 (L*(u)) and posteriori probability information D24 (L*(c)) are also called the log likelihood ratio, and here, it shows the likelihood of the information bit u and the likelihood of the code bit c.

[0118] The soft-output decoding circuit 130 obtains extrinsic information D17 (Le(u)) which is a differential value between the posteriori probability information D23 (L*(u)) and the priori probability D16 (L(u)), as expressed by the above Equation (8) by the differentiators 132 and 133; and obtains extrinsic information D18 (Le(c)) which is a differential value between the posteriori probability information D24 (L*(c)) and the priori probability D15 (L(c)), as expressed by the above Equation (9) by the differentiators 134, 135, and 136.

[0119] The soft-output decoding circuit 130 produces the extrinsic information D17 and D18 in the manner as described above, outputs the extrinsic information D17 to the binary circuit 140 in the later stage as a soft-output and outputs the extrinsic1 information D18 to the deinterleaver 120 as a soft-output.

[0120] The soft-output decoding circuit 130 need not always be provided with the differentiators 132 and 133 since the priori probability information D16 with respect to the information bit is “0”.

[0121] The binary circuit 140 forms extrinsic information D17 of soft-output produced by the soft-output decoding circuit 130, that is, extrinsic information D17 supplied from the soft-output decoding circuit 130 in a form of binary on the basis of the posterori probability information D23 to output it as decode data D18 of hard-output.

[0122] The decoding apparatus 3 as described above is provided with soft-output decoding circuits 70, 100 and 130 corresponding to the convolutional coders 50, 30 and 10, respectively, in the coding apparatus 1 whereby codes of high decoding complicatedness can be decomposed into elements of small complicatedness, and the characteristics can be successively enhanced by mutual action between the soft-output decoding circuits 70, 100 and 130. The decoding apparatus 3, when inputting the reception word D8, carries out decoding operation of the soft-output decoding circuits 70 to 130 iteratively by the predetermined number of times, for example, such as several times and scores of times, and outputs decode data D19 on the basis of the extrinsic information D17 of soft-output obtained as a result of the predetermined number of times of the decoding operation, that is, on the basis of the posterori probability information D23.

[0123] As explained above, in the data transmit-receive system constituted using the coding apparatus 1 and the decoding apparatus 3, the decoding apparatus 3 has the convolutional coders 10, 30 and 50 serially concatenated to carry out convolutional operation whose code rate is expressed by “k/(k+1)” (k is arbitrary natural number more than 2) as coding of outer codes, after which carries out convolutional operation whose code rate is “1” as coding of middle codes and inner codes, whereby the whole code rate can be maintained at a high value, “k/(k+1)”. Further, the coding apparatus 1 carries out the convolutional operation iteratively to carry out coding of high performance under the high code rate. In the decoding apparatus 3, are provided to be concatenated with the soft-output decoding circuits 70, 100, and 130 each corresponding to the convolutional coders 50, 30 and 10 in the coding apparatus 1 whereby decoding of high precision can be carried out. That is, the data transmit-receive system constituted using these coding apparatus 1 and decoding apparatus 3 is to realize coding and decoding according to the SCTCM system with high performance to enable provision of high reliance for a user.

[0124] The present invention is not limited to the above-described embodiments. For example, the convolutional coder for carrying out coding of middle codes in the coding apparatus need not be a single but two or more of them may be used. It is of course that as the whole coding apparatus, four or more convolutional coders may be provided. Needless to say, in this case, an interleaver is provided between a plurality of convolutional coders for carrying out coding of middle codes.

[0125] Further, as the coding apparatus, those other than that carries out coding by the convolutional operation will suffice, and the present invention can be applied even if the convolutional coders shown in the above-described embodiments are replaced by coders other than the convolutional operation.

[0126] While in the aforementioned embodiments, a description has been made of a case in which coding whose code rate is “⅔” is carried out as coding of outer codes, and coding whose code rate is “1” is carried out as coding of middle codes and inner codes, it is noted that the present invention is not adherred thereto but the present invention may be also applied to the case in which coding is carried out at least once whose code rate is “1” or more, for example, such that code rate of outer codes is “ 2/4=½”, code rate of middle codes is “ 4/3”, and code rate of inner codes is “1”, and the code rate is “k/(k+1) (=⅔)” as a whole.

[0127] Further, while in the above-described embodiments, a description has been made applying the 8PSK modulation system as multi-value modulation, it is to be noted that the present invention can be also applied to other multi-value modulation systems such that, for example, the code rate in the coding apparatus is “¾” as a whole, and mapping is made to a transmission symbol of a 16 QAM (16-quadrature amplitude modulation) modulation system.

[0128] Further, while in the above-described embodiments, a description has been made of a soft-output decoding circuit in the decoding apparatus in which MAP decoding based on the BCJR logarithm is carried out, it is to be noted that the present invention can be also applied to other soft-output decodings, for example, such that decoding according to a so-called SOVA (Soft Output Viterbi Logarithm).

[0129] Further, while in the above-described embodiments, a description has been made of a case where the coding apparatus and the decoding apparatus are applied to the transmission apparatus and the receiving apparatus in the data transmit-receive system, the present invention can be also applied, for example, to a recording and or a reproducing apparatus for carrying out recording and or reproducing with respect to recording media such as a magnetic, optical or optical magnetic disk or the like such as a floppy disk, CD-ROM or MO (Magneto Optical). In this case, data coded by the coding apparatus are recorded in a recording medium equivalent to a memoryless channel, and decode and reproduced by the decoding apparatus.

[0130] Furthermore, while in the above-described embodiments, a description has been made of a case in which both coding apparatus and decoding apparatus comprise an apparatus constituted of hardware, it is to be noted that both the coding apparatus and decoding apparatus can be realized as softwares capable of being executed in a computer apparatus, for example, such as a work station or a personal computer. This embodiment will be described hereinafter with reference to FIG. 15.

[0131] A computer apparatus 150 comprises, as shown in FIG. 15, a CPU (Central Processing Unit) 151 for collectively controlling various parts, a ROM 152 exclusive use for reading for storing information including various programs, a RAM (Random Access Memory) 153 which functions as a work area, a HDD (Hard Disk Drive) 154 for carrying out recording and/or reproducing of various programs, data and so on, a bus 155 for connecting these CPU 151, ROM 152, RAM 153, and HDD 154, an input/output interface 156 for carrying out inputting and outputting between the CPU 151, ROM 152, RAM 153, and HDD 154, and a display section 157, an input section 153, a communication section 159, and a drive 160 which will be described later, a display section 157 for displaying various information, an input section 158 for receiving user's operation, a communication section 159 for carrying out communication with the outside, and a drive 160 for carrying out recording and or reproducing of various information with respect to a detachable recording medium 170.

[0132] The CPU 151 is connected through the bus 155 to ROM 152, RAM 153, and HDD 154 to control these ROM 152, RAM 153, and HDD 154. The CPU 151 is further connected through the bus 155 to the input/output interface 156 to control the display section 257, the input section 158, the communication section 159, and the drive 160 connected to the input/output interface 156. The CPU 151 further executes various programs recorded in the recording medium 170 mounted on the ROM 151, ROM152, HDD154 or the drive 160.

[0133] The ROM 152 stores information including various programs therein. Information stored in the ROM152 is read under the control of CPU 151.

[0134] The RAM 153 functions as a work area when CPU 151 executes various programs to temporarily store various data under the control of CPU 151.

[0135] The HDD 154 carries out recording and or reproducing of various programs, data and so on with respect to the hard disk under the control of CPU 151.

[0136] The bus 155 transmits various data read out of ROM 152, RAM 153, and HDD 154 under the control of CPU 151, and transmits various data to be recorded in RAM 153, and HDD 154.

[0137] The input/output interface 156 has an interface for displaying various information in the display section 157 under the control of CPU 151, an interface for transmitting a control signal indicative of contents operated through the input section 158 by a user to CPU 151, an interface for inputting and outputting data with respect to the outside through the communication section 159 under the control of CPU 151, and an interface for carrying out recording and or reproducing of various information with respect to the recording medium 170 mounted on the drive 160 to output data from CPU 151, ROM 152, RAM 153, and HDD 154 to the display section 157, the input section 158, the communication section 159 and the drive 160, or inputs data from the display section 157, the input section 158, the communication section 159 and the drive 160 into CPU 151, ROM 152, RAM 153, and HDD 154.

[0138] The display section 157 comprises, for example, LCD (Liquid Crystal Display), to display various information such as data recorded, for example, in the HDD 154 under the control of CPU 151.

[0139] The input section 158 receives, for example, operation of a keyboard or a mouse by a user to output a control signal indicative of contents of operation to CPU 151.

[0140] The communication section 150 functions as an interface for carrying out, for example, communication with the outside by a network circuit, a satellite circuit or the like under the control of CPU 151.

[0141] The drive 160 mounts or dismounts the recording medium 170 such as a magnetic, light or photo electromagnetic disk, for example, such as a floppy disk, CD-ROM or MO, and carries out recording and or reproducing of various information with respect to the recording medium 170 mounted under the control of CPU 151.

[0142] The computer apparatus 150 realizes coding process in the above-described coding apparatus and or decoding process in the decoding apparatus 3 by CPU 151 which executes programs.

[0143] First, the coding process in the computer apparatus 150 will be described. The computer apparatus 150, when for example, a user carries out predetermined operation for executing a code program, supplies a control signal indicative of contents of operation to CPU 150 by th input section 158. In response thereto, the computer apparatus 150 loads a code program to RAM 153 to execute it, and outputs a code transmission symbol obtained by coding to the outside through the communication section 159, and displays the processed results or the like on the display section 157 as necessary.

[0144] As used herein, the code program is provided, for example, by the recording medium 170, and may be read directly from the recording medium 170 under the control of CPU 151, or one recorded in the hard disk once may be read. The code program may be stored in advance in ROM 152. Further, data subjected to coding is recorded in the hard disk here. This data corresponds to the aforementioned input data D1.

[0145] Concretely, the computer apparatus 150, when a code program is executed by CPU150, reads the desired data stored in the hard disk under the control of CPU 151, and carries out convolutional operation whose code rate is “⅔” as coding of outer codes with respect to the data to produce code data corresponding to the aforementioned code data D2.

[0146] Continuously, the computer apparatus 150 applies interleave to the produced code data under the control of CPU 151 to produce interleave data corresponding to the aforementioned inerleave data D3.

[0147] Continuously, the computer apparatus 150 carries out convolutional operation whose code rate is “ 3/3=1” as coding of middle codes with respect to the produced interleave data under the control of CPU 151 to produce code data corresponding to the aforementioned code data D4.

[0148] Continuously, the computer apparatus 150 applies interleave to the produced code data under the control of CPU 151 to produce interleave data corresponding to the aforementioned inerleave data D5.

[0149] Continuously, the computer apparatus 150 carries out convolutional operation whose code rate is “ 3/3=1” as coding of inner codes with respect to the produced interleave data under the control of CPU 151 to produce code data corresponding to the aforementioned code data D6.

[0150] Then, the computer apparatus 150 applies mapping to a transmission symbol of a 8PSK with respect to the produced code data under the control of CPU 151 to produce code transmission symbol corresponding to the aforementioned code data D7.

[0151] The computer apparatus 150 records the produced code transmission symbol in the hard disk or the like once, under the control of CPU 151, after which reads the code transmission symbol at the desired timing to output it outside through the communication section 159, and display the result of process on the display section 157 as necessary. It is noted that the produced code transmission symbol can be also recorded on the recording medium 170 or the like.

[0152] As described above, the computer apparatus 150 is able to realize the code process in the aforementioned coding apparatus 1 by executing the code program.

[0153] Next, decoding process in the computer apparatus 150 will be described. In the computer apparatus 150, for example, when a user carries out predetermined operation for executing a decode program, a control signal indicative of contents of operation is supplied to CPU 151 by the input section 158. In response theereto, the computer apparatus 150 loads a decode program to RAM 153 to execute it by CPU 151, receives the program from the outside through the communication section 159 to decode a reception word corresponding to the aforementioned reception word D8 and being recorded in the hard disk or the like and display the result of process or the like on the display section 157 as necessary.

[0154] The decoded program is also provided, for example, by the recording medium 170, similar to the code program, and may be read directly from the recording medium 170 under the control of CPU 151, or one recorded in the hard disk once may be read. The code program may be stored in advance in ROM 152.

[0155] Concretely, the computer apparatus 150, when a code program is executed by CPU150, carries out MAP decoding, for example, based on the BCJR logarithm with respect to a reception word read out of the hard disk, or a reception word received through the communication section 159, under the control of CPU 151, to thereby carry out soft-output decoding of inner codes to produce extrinsic information corresponding to the aforementioned extrinsic information D10.

[0156] Continuously, the computer apparatus 150 applies a deinterleave to the produced extrinsic information under the control of CPU 151 to produce priori probability information corresponding to the aforementioned extrinsic information D11.

[0157] Continuously, the computer apparatus 150 carries out MAP decoding based, for example, on the BCJR logarithm with respect to the produced priori probability information under the control of CPU 151 to thereby carry out soft-output decoding of middle codes to produce extrinsic information corresponding to the aforementioned extrinsic information D13 and D14.

[0158] Continuously, the computer apparatus 150 applies deinterleave to extrinsic information corresponding to the aforementioned extrinsic information D13 under the control of CPU151 to produce priori probability information corresponding to the aforementioned priori probability information D15, and applies interleave to extrinsic information corresponding to the aforementioned extrinsic information D14 to produce priori probability information corresponding to the aforementioned priori probability information D9.

[0159] Continuously, the computer apparatus 150 carries out, for example, MAP decoding based on the BCJR logarithm with respect to priori probability information corresponding to the aforementioned priori probability information D15 to thereby carry out soft-output decoding of outer codes to produce extrinsic information corresponding to the aforementioned extrinsic information D18, and applies interleve to the extrinsic information to produce priori probability information corresponding to the aforementioned priori probability information D12.

[0160] Then, the computer apparatus 150 carries out such a decoding operation as described above iteratively by the predetermined number of times, for example, such as several times or scores of times, and outputs decoding data of hard-output on the basis of extrinsic information of soft-output obtained as a result of the predetermined number of times of decoding operation corresponding to the aforementioned extrinsic information D17.

[0161] The computer apparatus 150 records the obtained decode data in the hard disk or the like under the control of CPU 151, and displays the result of process or the like on the display section 157. The obtained decode data can be also recorded in the recording medium 170 or the like.

[0162] As described above, the computer apparatus 150 is able to realize the decoding process in the aforementioned decoding apparatus 3 by executing the decode program.

[0163] It is noted of course that the present invention can be changed suitably within the scope not departing from the gist thereof.

[0164] As described above in detail, coding apparatus according to the present invention, a first coding means carries out coding whose code rate is k/(k+1) with respect to data of k-bit input; a first interleaving means interleaves order of bits constituting data comprising a bit series of (k+1) bits coded by the first coding means; at least one or more second coding means and second interleaving means carry out coding whose code rate is 1 with respect to data of (k+1) bit input and interleave order of bits constituting data comprising a bit series of (k+1) bits code; a third coding means carries out coding whose code rate is 1 with respect to data of (k+1) bit input; and a mapping means maps data of (k+1) bit coded by the third coding means to a transmission symbol of a predetermined modulation.

[0165] Further, in the coding method or coded program thereof according to the present invention, a first coding step carries out coding whose code rate is k/(k+1) with respect to data of k-bit input; a first interleaving step interleaves and rearranges order of bits constituting data comprising a bit series of (k+1) bits coded by the first coding step; a coding processing step carries out at least one or more processes including a second coding step for carrying out coding whose code rate is 1 with respect to data of (k+1) bit input; and a second interleaving step interleaves order of bits constituting data comprising a bit series of (k+1) bits coded by the second coding step; a third coding step carries out coding whose code rate is 1 with respect to data of (k+1) bit processed by the coding processing step; a mapping step maps data of (k+1) bit code by the third coding step to a transmission symbol of a predetermined modulation.

[0166] Furthermore, in the decoding apparatus according to the present invention, a first soft-output decoding means carries out soft-output decoding using a reception word which is a soft-input input, and priori probability information with respect to information bits of (k+1) bits which is a soft-input input; at least one or more first deinterleaving means, second soft-output decoding means and third deinterleaving means rearranges data of(k+1) bit of a soft-input input, carry out soft-output decoding using priori probability information with respect to code bits of (k+1) bits which are a soft-input output from the first deinterleaving means, and priori probability information with respect to information bits of(k+1) bits which are a soft-input input, and interleave order of bits constituting data comprising a bit series of (k+1) pieces of a soft-input output from the respective ones of the at least one or more second soft-output decoding means on the basis of the same exchange position information as that of the second interleaving means; a second deinterleaving means rearranges data of (k+1) bits of a soft-input input; a third soft-output decoding means carries out soft-output decoding using priori probability information with respect to code bits of (k+1) bits which are a soft-input output from the second deinterleaving means, and priori probability information with respect to information bits of (k+1) bits which are a soft-input input; and a fourth interleaving means interleaves order of bits constituting data comprising a bit series of (k+1) pieces of a soft-input output from the third soft-output decoding means on the basis of the same exchange position information as that of the first interleaving means.

[0167] Further, in the decoding method or coded program thereof according to the present invention as described above, a first soft-output decoding step carries out soft-output decoding using a reception word which is a soft-input input, and priori probability information with respect to information bits of (k+1) bits which is a soft-input input; a second deinterleaving step rearranges data of (k+1) bits of a soft-input processed by the decoding processing step; a third soft-output decoding step carries out soft-output decoding using priori probability information with respect to code bits of (k+1) bits which are a soft-input output rearranged by the second deinterleaving step, and priori probability information with respect to information bits of (k+1) bits which are a soft-input input; and a fourth interleaving step interleaves order of bits constituting data comprising a bit series of (k+1) pieces of a soft-input output from the third soft-output decoding step on the basis of the same exchange position information as that of the first interleaving step.