Method and circuit for converting the image format of three-dimensional electronic images produced with line polarization

[0002] 1. Field of the Invention

[0003] The present invention relates to a method and circuit for converting the image format of n-line, three-dimensional electronic images produced with line polarization into m-line images whose respective, immediately neighboring two lines are respectively polarized in alternation into first and second directions upon viewing, wherein all lines polarized in the first direction are employed for the presentation of a first sub-image and all lines polarized in the second direction are employed for the presentation of a second sub-image.

[0004] 2. Description of the Prior Art

[0005] The line polarization method utilizes the interlace method in televisions transmissions. In the interlace method, a first and a second field are always transmitted in alternation, these being combined in a comb-like fashion to form an image.

[0006] Two images, one for each of the eyes of the person, are needed in three-dimensional viewing, these being offset relative to one another in conformity with the respectively different viewing angle of each eye relative to the motive. The two fields in the television transmission can respectively present one of these images, whereby one field is polarized in a first direction and the other field is polarized in a second direction. This, for example, can be achieved with a polarization filter on the field pane of the image presentation device that polarizes the individual lines into the one and other direction in alternation. When this is the case, one can view three-dimensionally with corresponding eyeglasses that filter out the one image for the one eye and the other image for the other eye.

[0007] The different resolution standards in which images are transmitted represent a current problem. Known resolution standards are, for example, 625 lines in the PAL transmission method, 1250 lines in the HDTV transmission method and 575 lines in the PAL plus transmission method. When an electronic image presentation device is designed for one of these standards and this same image presentation device is also prepared to polarize the individual presentation lines into the one and other direction in alternation for three-dimensional image presentation, a three-dimensional image transmitted in a different resolution standard can no longer be presented. The reason for this is because allocation of polarized lines of the image presentation device and the transmitted fields no longer coincides.

[0008] The publication by Jügen Ost, “Bildfernsprechen, kompatibel mit der Fernsehrundfunknorm,” In Radio Mentos Elektronik, 1975, No. 5, pages 194-196, discloses a method for converting the image format of 313-line electronic images into 625-line images by repeating every line. No measures are addressed in order to be able to produce three-dimensional images in the conversion with line polarization.

[0009] German patent document DE 32 34 557 C2 describes a “1250/100/4:1 standard” that is intended to enable HDTV and 3D reproduction. This standard is based on the fact that frames are respectively composed of four sub-images that are written on a color television screen in mutually offset grids with a sub-image frequency corresponding to twice the power supply frequency.

[0010] It is therefore an object of the invention to specify a method and circuit arrangements for the conversion of the image format of three-dimensional electronic images produced with line polarization.

[0011] Accordingly, pursuant to the method and circuit of the present invention, a correct allocation of transmitted fields to the polarized lines of the image presentation device is always established regardless of the resolution standard with which the images are transmitted and displayed. Missing lines are supplemented. Too many lines are skipped. The correct allocation of the transmitted image lines to the respective, polarized presentation lines, finally is obtained by a line transposition when necessary.

[0012] Accordingly, in an embodiment of the present invention, a method is provided for converting an image format of n-line, three-dimensional electronic images produced with line polarization into m-line images whose respective, immediately neighboring two lines are respectively polarized in alternation into a first and second direction upon viewing, wherein all lines polarized in the first direction are employed for the presentation of a first sub-image and all lines polarized in the second direction are employed for the presentation of a second sub-image, given that the first and second sub-images are needed for three-dimensional viewing, the method including the steps of: abbreviating as a whole number a fraction formed of the values n and m having the form m/n to form m′/n′; dividing the lines of the image to be converted into first groups having a respective line plurality n′; combining two of the first groups which abut one another to respective second groups, wherein a last first group remaining by itself is combined with an imaginary dummy group of the same size having nothing but dummy lines to form a last second group; determining |p| lines to be inserted, if m′>n′, twice per respective second group in the conversion according to an equation |p|=|m′−n′|; determining |p| lines to be skipped, if m′<n′, twice per respective second group in the conversion according to the equation |p|=|m′−n′|; inserting |p| lines, if m′>n′, twice in each of the second group wherein two successive lines are always affected by an insertion and, given an odd-numbered |p|, the last line not yet affected by an insertion is affected by an insertion in the one first group in a meeting area of the first groups abutting one another in a respective second group, and the first line not yet affected by an insertion is affected by an insertion in the other group; inserting |p| lines, if m′>n′, twice in each of the second group wherein two successive lines are always affected by a skipping and, given an odd-numbered |p|, the last line not yet affected by a skipping is affected by a skipping in the one first group in a meeting area of the first groups abutting one another in a respective second group, and the first line not yet affected by a skipping is affected by a skipping in the other group; and transposing with one another in sequence the two inward lines of the four-line groups respectively arising after an addition of lines to two successive lines of the second group.

[0013] In an embodiment of the method, the inserted lines are copied from preceding or following lines.

[0014] In an embodiment of the method, the inserted lines are interpolated from preceding and succeeding lines.

[0015] In an embodiment of the method, the lines within a second group affected by an insertion or a skipping are selected uniformly distributed within the respective second group.

[0016] In an embodiment of the method, the lines polarized in the one direction are shifted relative to one another in a plane compared to the lines polarized in the other direction.

[0017] In an embodiment, the method further includes the step of setting a mode, wherein each even-numbered or odd-numbered line is overwritten with the content of a preceding line, for switching from a three-dimensional image to a two-dimensional image.

[0018] In a further embodiment of the present invention, a circuit is provided for presenting a three-dimensional image electronically generated upon application of a line polarization method from a video signal adjacent an input, the circuit including: a frequency converter having a set frequency which defines a plurality of presented lines; at least one parallel delay line exhibiting an independent delay value and having a controlled switch for activating or deactivating the respective delay line provided for the image presentation; and control electronics for controlling switches, wherein image lines are transposed as warranted and controls for the switches of the delay lines are provided.

[0019] In yet another a further embodiment of the present invention, a circuit is provided for presenting a three-dimensional image electronically generated upon application of a line polarization method from a video signal adjacent an input, the circuit including: a digital write-read memory for simultaneously storing at least one three-dimensional image in digital form; and a controller circuit, the controller circuit for fetching the stored images at a rate dependent on the storing, wherein stored lines are read out in a different sequence and forwarded for image presentation.

[0020] Additional features and advantages of the present invention are described in, and will be apparent from, the Detailed Description of the Preferred Embodiments and the Drawing.

[0021] FIG. 1 shows a first table with the indication of line allocations for the presentation of a three-dimensional image with a maximum image resolution;

[0022] FIG. 2 shows a second table with the indication of line allocations according to the present invention given a change of the image resolution from a PAL system to a HDTV system;

[0023] FIG. 3 shows a third table with the indication of line allocations according to the present invention given a change of the image resolution from a HDTV system to a PAL system;

[0024] FIG. 4 shows a fourth table with the indication of line allocations according to the present invention given a change of the image resolution from a PAL plus system to a PAL system;

[0025] FIG. 5 shows a fifth table with the indication of line allocations according to the present invention given a change of the image resolution from a system having 500 lines to a system having 800 lines;

[0026] FIG. 6 shows a sixth table with the indication of line allocations given a change from a three-dimensional image to a two-dimensional image;

[0027] FIG. 7 shows a table with the indication of line allocations and line beginnings for setting a three-dimensional viewing effect given a three-dimensional image;

[0028] FIG. 8 shows a schematic circuit diagram for an analog resolution conversion of electronically generated images according to the present invention; and

[0029] FIG. 9 shows a schematic circuit diagram for a digital resolution conversion of electronically generated images of the present invention.

[0030] FIG. 1 shows two two-dimensional fields 2D-Field 1 and 2D-Field 2. Each of these fields exhibits the same line resolution of Zn lines. The line resolution of Zn lines corresponds to the line resolution of the electronic image presentation device that respectively two-dimensional fashion, displays as one of these fields. What is thereby to be understood as an electronic image presentation device is, for example, a picture tube device or a LCD flat picture screen device. Only a picture screen shall be mentioned below.

[0031] When one of these fields is displayed on a picture screen, this field appears in the full picture screen resolution because all lines of the respective field are displayed. The two fields 2D-Field 1 and 2D-Field 2 shown in FIG. 1 thus do not differ in this respect from images of a two-dimensional film. In order to enable three-dimensional viewing, the lines of the picture screen must be line-polarized. One possibility of line polarization is to polarize the lines with odd line numbers in the one direction and the lines with even line numbers in the other direction. This can be achieved, for example, with a corresponding polarization film that is applied on the picture screen. When a viewer has a second filter, for example polarization eyeglasses with a first polarized glass corresponding to the polarization direction of the one of the polarization directions of the polarization film of the picture screen and having a second polarized glass corresponding to the polarization direction of the other of the two polarization directions of the polarization film of the picture screen, he can view three-dimensionally. Fields for the one eye are respectively presented on the picture screen on the one polarized lines and fields for the other eye are displayed of the other polarized lines.

[0032] The line polarization method seems to halve the picture screen resolution. In fact, the eye of a person hardly notices this difference when, for producing, three-dimensional image 3D-image, two fields having the same resolution as the 3D picture screen are employed, whereby the odd lines of the one field, for example of the 2D-Field 1, are employed for the left eye for the three-dimensional presentation and the even-numbered lines of the other field, for example of the 2D-Field 2, are employed for the right eye.

[0033] FIG. 1 presents this situation [], whereby, for example, a 3D-image derives whose first line Z1 represents the first line of the 2D-Field 1, namely B1Z1, whose second line Z2 represents the second line of the 2D-Field 2, namely B2Z2, whose third line Z3 represents the third line of the 2B-Field 1, namely B1Z3, whose fourth line Z4 represents the fourth line of the 2D-Field 2, namely B2Z2, etc., until the penultimate line Zn-1 that represents the penultimate line of the 2D-Field 1, namely B1Zn-1, and last line Zn that represents the last line of the 2D-Field 2, namely B2Zn.

[0034] A current problem is represented by the fact that video pictures are no longer transmitted and presented in only a single standard. On the contrary, there are currently several standards for transmission and presentation, and extensive use is currently made of these different standards. In order to be compatible with the various standards, it is necessary to be able to adapt. When, for example, images are transmitted in the one standard but are to be presented in the other standard, a corresponding conversion of the images is necessary.

[0035] FIG. 2 shows an example of a conversion of three-dimensional images that are transmitted in what is referred to as the PAL system and that are presented with a picture screen suitable for what is referred to as a HDTV presentation. Other Figures show other examples of conversions. In the PAL system, the fields are transmitted with a resolution of 625 lines, whereas a picture screen with HDTV resolution displays the fields with 1250 lines. It is assumed—and this is also valid for the other converging [sic] examples—that two fields for the respectively one and the other eye are contained in every transmitted, three-dimensional image. The field for the one eye is thereby transmitted in the lines of the one line polarization and the field for the other eye is transmitted in the lines having the other line polarization.

[0036] The various line polarizations are identified in FIG. 2, as well as in the other appertaining Figures, with two letters H and V. The letters H and V stand for horizontal and vertical. Horizontal means that these lines are to be horizontally polarized. Vertical means that the lines [sic] are to be vertically polarized. It is critical that two successive lines are always polarized in alternation in the one and other direction.

[0037] FIG. 2 shows a number of columns that are differently labeled. A first column is labeled “group allocation”, a second is labeled “PAL lines”, a third is labeled “PAL lines, line polarity”, a fourth is labeled “inserted PAL lines”, and fifth is labeled “inserted PAL lines, line polarity”, a sixth is labeled “HDTV lines”, a seventh is labeled “HDTV lines, line polarity”, an eighth is labeled “PAL lines overall, after line transposition”, and a ninth is labeled “PAL lines, line polarity following line transposition”. This column division is analogously employed in the following exemplary embodiments.

[0038] Columns 2 and 3 refer to that system from which the conversion is to be implemented. Columns 6 and 7 refer to that system into which the conversion is to be implemented. The line numbers and the respectively appertaining polarization directions are respectively indicated. Columns 4 and 5 indicate what lines with which polarization direction are to be inserted.

[0039] Only one column is indicated in FIG. 3 at this location, for which reason the following columns exhibit a number lower by one compared to the other Figures. In detail, this means that columns 6 and 7 in FIG. 3 are columns 5 and 6. It is important to consider this detail given a comparison of the various Figures with one another.

[0040] Compared to the other Figures, it is also not indicated in column 4 of FIG. 3 what lines are to be inserted. What is indicated, instead, is what lines are to be skipped. FIG. 3 is not a matter of a line expansion but of a line reduction. Since FIG. 3 is a matter of a line reduction, the new system already results from the remaining lines of the initial system. Columns 8 and 9, which would be columns 7 and 8 in FIG. 3, are therefore omitted from FIG. 3.

[0041] As already mentioned, FIG. 2 is based on the conversion from a PAL system to an HDTV system. Lines 1 through 625 having H and V polarized lines in alternation are therefore to be converted into lines 1 through 1250 which likewise have lines polarized H and V in alternation. The initial system thus includes n lines, whereas the destination system includes m lines.

[0042] For accomplishing the conversion, it is necessary to combine the n initial lines into first groups g. The size of the first groups g is determined by the number n′ that proceeds from the quotient m′/n′, whereby the quotient m′/n′, in turn, proceeds from the maximally abbreviated quotient m/n.

[0043] The following allocation therefore applies in the exemplary embodiment according to FIG. 2: m/n=1250/625. The fraction m′/n′ abbreviated with 625=2/1, it follows therefrom that n′ is equal to 1.

[0044] The first group g therefore respectively includes one line.

[0045] In a further method step, respectively two successive, first groups g are combined to a respective second group G. With an initial line number of 625 and respective two-line, second groups G, the last first groups g remains without a second first group g. In order to be able to form a second group G with this first group g, it is necessary to temporarily introduce an imaginary first group f that includes a line plurality corresponding to a regular first group g but respectively without content. The lines of the imaginary group f are what are referred to as dummy lines L, i.e., these lines do not serve for a transmission of image information but only serve the purpose of being able to apply the general conversion method in every method stage. As the present exemplary embodiment shows, special rules would otherwise have to be adhered to in some instances in order to ultimately arrive at the final result.

[0046] How many lines [six] must be inserted or, respectively, skipped in the conversion must now be checked no later than after the initial lines have been divided into second groups G. Lines must be inserted when a conversion is to occur toward a greater plurality of lines. Lines must be skipped when a conversion is to occur to a smaller plurality of lines.

[0047] The relationship |p|=m′−n′ indicates how many lines must be inserted or, respectively, skipped by halves per second groups G. “By halves” means that 2*|p| must be inserted or, respectively, skipped per second group G in the exemplary embodiment of FIG. 2 as 2*1=2 lines. The operational sign of the difference m′−n′ thereby indicates whether lines must be inserted or skipped. Lines are to be inserted given a positive difference and lines are to be skipped given a negative difference.

[0048] In the exemplary embodiment of FIG. 2, |p|=1 and m′−n′=+1 applied, i.e., two lines must be inserted per second group G. Independently of the plurality of lines to be inserted or, respectively, to be skipped per second groups G, two successive lines must be respectively affected by an insertion or, a skipping. According to FIG. 2, only two lines are contained in the second groups G and respectively two lines must be inserted, so that respectively every line is affected by an insertion in every second group G.

[0049] FIG. 4 shows an example according to which four lines are to be inserted in every second group G. The second groups G are thereby respectively composed of two first groups g that cover 23 lines.

[0050] FIG. 5 shows an example according to which six lines are to be inserted into every second group G. The second groups are thereby respectively composed of two first groups g that respectively cover five lines.

[0051] However, an insertion or a skipping of lines nonetheless respectively covers two successive lines. It is to be noted that, given an odd-numbered |p|, the pair of lines to be inserted or, respectively, to be skipped determined by 2*|p| is divided in such a way that, in the meeting area of the two first groups g abutting one another within a second group G, the last line not yet affected by an insertion or, respectively, a skipping is affected in the one first group g on the one hand and the first line not yet affected by an insertion or, respectively, a skipping in the other first group g on the other hand is affected by an insertion or, respectively, a skipping. Otherwise, the paired lines within the second group G can be arbitrarily selected.

[0052] As already mentioned, each line within a second group G is affected by an insertion in the exemplary embodiment according to FIG. 2. This is indicated in columns 4 and 5, whereby the inserted lines are referenced 1′ through 625′. The polarization direction on which the respective, inserted line is based is respectively indicated next to this. In detail, the PAL line 1′ having the polarization direction H is inserted following the PAL line 1 having the polarization direction H, etc., until the last PAL line 625 having the polarization direction H after which the PAL line 625′ having the polarization direction H is inserted.

[0053] According to an advantageous development of the present invention, the inserted lines can be a matter either of a copy of a respectively preceding line or of a line interpolated from a preceding and a following line. The polarization corresponds to the copied or to the preceding line.

[0054] After lines have been inserted, a conversion is, in fact, established in terms of the plurality of lines but not in terms of the alternating polarization.

[0055] In order to obtain the correct, alternating polarization, the two inward lines of four-line groups that are composed of the two lines affected by an insertion and of the two inserted lines must be respectively mutually interposed in their sequence as a final step. In FIG. 2, as in FIGS. 4 and 5, this can be seen from the last columns 8 and 9. The lines respectively affected by a transposition are thereby identified by underlining.

[0056] The conversion has been ended after the line transposition method. As a result of the conversion method, a dummy line has been derived as in [ . . . ] the last line in FIG. 2, but this is hardly felt in reality. The dummy line derives from the appended, imaginary first group f that connects to the picture screen presentation area. The end of the picture screen presentation area is marked by a double line. Due to the necessary line transposition over the boundary of the picture screen presentation area, the dummy line L entered into the picture screen presentation area. By contrast thereto, the last inserted line 625′ has dropped out of the picture screen presentation area. However, the transposition of the lines is necessary in order to obtain the correct polarization line in the picture screen presentation area.

[0057] FIG. 4 and FIG. 5 correspond to FIG. 2, with the difference that a conversion from a PAL plus image having 575 lines onto a PAL image having 625 lines is assumed by way of example in FIG. 4, and a conversion from an image having 500 lines assumed by way of example onto an image having 800 lines assumed by way of example is implemented in FIG. 5. In FIG. 4, the first groups g therefore include 23 lines and includes 5 lines in FIG. 5. An imaginary group f is, in fact, to be assumed at the end of the picture screen presentation area in FIG. 4 but this has no influence. Such an imaginary group is not necessary in FIG. 5 since the plurality of first groups g is even-numbered. Imaginary groups are therefore needed only in reality when the plurality of first group g and |p| are respectively odd-numbered. In this sense, FIG. 4 is an example for an odd-numbered plurality of first groups and an even-numbered |p|. FIG. 5, by contrast, is an example of an even-numbered plurality of first groups and an odd-numbered |p|.

[0058] The special characteristic given an odd-numbered |p| is the fact that, given line insertion within a second group G, the last line of the first group g belonging to the appertaining second group G that was not yet affected by an insertion or by a skipping of a line, and the first line of the other first group g belonging to the appertaining second group G that was likewise not yet affected by an insertion or skipping of a line, is affected by insertion or, respectively, a skipping in any case.

[0059] What is thus important here is the fact that, in the line insertion—which, of course, must always occur doubly—-, the one line insertion is to occur in the one first group g and the other line insertion is to occur in the other first group g of a second group G. What must thus be satisfied overall is that two successive lines are always affected by a line insertion.

[0060] With reference to FIG. 5 wherein lines 1, 2, 5, and 6, 9 and 10 are affected by a line insertion, for example, the lines 3 and 4, 5 and 6 and 7 and 8 could also be affected by a line insertion without infringing the required criteria.

[0061] It is advantageous, however, to distribute lines to be inserted within the second groups G such that an optimally uniform division of inserted lines derives overall. The analogous case applies to the admission of lines. FIG. 3 indicates an example wherein the conversion is composed of an omission of lines.

[0062] A conversion from an HDTV image having 1250 lines to a PAL image having 625 lines is implemented in FIG. 3. According to the above-described demands, first groups g having two lines drive here and two lines must be skipped per second group G. Since it also must be taken into consideration that two successive lines always must be affected by a line insertion or, respectively, a line skipping, the diagram of FIG. 3 can be ultimately utilized to implement the conversion from the one system into the other system. To that end, the last two lines of the second group G have been selected in FIG. 3. However, the middle two lines to the first lines also could also have been selected. A limitation to the respectively first, middle or last two lines per second group G is not compulsory, but is advantageous due to the uniform distribution and the better image that is thus acquired.

[0063] FIG. 6 shows an example of a conversion from a three-dimensional image into a two-dimensional image. Since the plurality of lines remains constant here, it is sufficient when, for example, every odd-numbered or every even-numbered line is copied. The line polarization thereby plays no part.

[0064] FIG. 7 shows how the three-dimensional viewing effect can be influenced given a three-dimensional image [sic] generated with the line polarization method. By shifting the lines for the field of the one eye relative to the lines for the field of the other eye, the depth effect given three-dimensional viewing is enhanced to a certain extent and vice versa.

[0065] FIGS. 8 and 9 show schematic circuit diagrams of circuit arrangements with which the conversion of three-dimensional images from one line resolution to another line resolution can be implemented according to the above-disclosed method. FIG. 8 thereby shows an exemplary embodiment for an analog circuit arrangement, whereas FIG. 9 shows an exemplary embodiment for a digital circuit arrangement.

[0066] In FIG. 8, a conversion of the line plurality is implemented in a frequency converter 1 by a frequency switching from, for example, the frequency f1 to the frequency f2. Electronic switches 3 that switch signals having a predetermined time delay onto the output 4, 5 with at least one delay line 2 are actuated with the control electronics 6. Respectively one signal is thereby switched at the same time. It is thereby possible to double (1*▾T) lines or to transpose (2*▾T) lines.

[0067] In FIG. 9, the input signal VS is digitalized and at least one image is deposited in the RAM memory 2 at the same time. With the controller 3, the stored images are fetched at a rate independent of the storing and are forwarded to the digital-to-analog converter 4 that generates a video signal with a new resolution therefrom and forwards it to the picture screen 5. For the 3D conversion in conjunction with the line polarization, the stored lines are also fetched from the memory in a different sequence by the controller 3. As a result, the line doubling and transposition is realized.

[0068] Given a purely digital system wherein the video signal VS is already present in digitalized form and wherein the picture screen 5 can also process digital signals, the components 1 and 4 can be eliminated.

[0069] Although the present invention has been described with reference to specific embodiments, those of skill in the art will recognize that changes may be made thereto without departing from the spirit and scope of the invention as set forth in the hereafter appended claims.