US 6,885,408 B2Grant
Image processing method and image processing apparatus
Issue Date:2005-04-26
•23 Claims
•5 Drawing Sheets
Abstract
Disclosed is an image processing method and an image processing apparatus that improve quality of display images in different formats of a multi-format data broadcast image. The image processing method according to the present invention comprises the steps of: separating menu data, character data, still image data, and moving image data in a plurality of formats from a broadcast video signal; generating a layer image signal such that the image signal of data in each of the formats is superimposable on the data in the plurality of formats; and subjecting the superimposed layer image signal to adaptive image processing according to a preset parameter by means of an adaptive image processing unit. Therefore, by subjecting each layer to different image processing irrespective of the type and the format of the signal, it is possible to perform image processing adapted to each format.
Metadata
Assignee
- Sony Corporation
Inventor
- Tsuyoshi Hirano
Application Information
Application Number:US 09/919,264
Filing Date:2001-07-30
Priority Date:2000-07-31
Art Unit:2614
Patent Drawings (5 sheets)
Description
Background of the Invention
[0001] The present invention relates to an image processing method and an image processing apparatus suitable for a multi-format data broadcast image such as a digital broadcast image, for example.
[0002] A conventional television receiver has dealt with only single-format image signals, and thus has not processed image signals in different formats. However, BS digital broadcast requires processing of data broadcast data and still image broadcast data that are in a broadcast format different from that of a conventional image signal.
[0003] FIG. 1 shows a conventional multi-format data broadcast image. When a still image 44 and characters 45 are displayed together with a moving image 43 in the data broadcast image 42 on a single screen, an HD (High Definition) image 41 can be displayed with high quality, while edges of the still image 44 and the characters 45 shine, thus making the still image 44 and the characters 45 less easy to see.
[0004] However, when the still image 44 and the characters 45 are displayed together with the moving image 43 in the above-mentioned conventional multi-format data broadcast image 42 on a single screen, areas of the still image 44, the characters 45, and the moving image 43 cannot be distinguished from each other because the still image 44, the characters 45, and the moving image 43 are mixed with each other to form a single image. Therefore, the still image 44, the characters 45, and the moving image 43 cannot be processed independently of each other for higher image quality. This results in a disadvantage in that although the HD image 41 can be displayed with high quality, the still image 44 and the characters 45 are lowered in image quality.
Summary of the Invention
[0005] It is accordingly an object of the present invention to provide an image processing method and an image processing apparatus that improve quality of display images in different formats of a multi-format data broadcast image.
[0006] The image processing method according to the present invention comprises the steps of: separating data in a plurality of formats from a broadcast video signal; generating a layer image signal such that the image signal of data in each of the formats is superimposable on the data in the plurality of formats; and subjecting the superimposed layer image signal to adaptive image processing according to a preset parameter.
[0007] Therefore, by subjecting each layer to different image processing irrespective of the type and the format of the signal, it is possible to perform image processing adapted to each format.
[0008] Also, the image processing method according to the present invention generates a display section signal for each layer image signal. Therefore, by determining a display area for each layer, it is possible to readily perform different image processing for each layer.
[0009] In addition, the image processing method according to the present invention generates the layer image signal and the display section signal on the basis of an arbitrarily changeable form. Therefore, it is possible to readily generate the signals on the basis of the changeable form.
[0010] Moreover, the image processing apparatus according to the present invention comprises: separating means for separating data in a plurality of formats from a broadcast video signal; layer image signal generating means for generating a layer image signal such that the image signal of data in each of the formats is superimposable on the data in the plurality of formats; and adaptive image processing means for subjecting the superimposed layer image signal to adaptive image processing according to a preset parameter.
[0011] Therefore, by subjecting each layer to different image processing irrespective of the type and the format of the signal, it is possible to perform image processing adapted to each format.
[0012] The image processing apparatus according to the present invention further includes storage means for storing a parameter in a table. Therefore, it is possible to make automatic setting for adaptive image processing.
[0013] In addition, the image processing apparatus according to the present invention sets a parameter according to the status of a layer image signal. Therefore, it is possible to adjust image quality by performing adaptive image processing according to the status of a layer image signal while viewing a data broadcast image on a television receiver.
[0014] Thus, according to the present invention, the following actions are performed.
[0015] The separating means subjects a video signal inputted thereto to digital processing to thereby separate menu data, character data, still image data, and moving image data. The separating means supplies the menu data, the character data, the still image data, and the moving image data to the layer image signal generating means.
[0016] The layer image signal generating means generates an OSD layer from the menu data, a character layer from the character data, a still image layer from the still image data, and a moving image layer from the moving image data. The layer image signal generating means generates an image signal for each of the OSD layer, the character layer, the still image layer, and the moving image layer.
[0017] The layer image signal generating means also generates a display section signal for each of the OSD layer, the character layer, and the still image layer, as well as layer image signals on which the OSD layer, the character layer, and the still image layer are superimposed. The layer image signal generating means supplies the display section signal for each of the layers and the superimposed layer image signals to the adaptive image processing means.
[0018] The adaptive image processing means reads preset image processing parameters stored in a parameter table in a table form. An image processing unit subjects each of the layer image signals to adaptive image processing for an area of its display section signal according to the parameters stored in the parameter table.
[0019] The above and other objects, features and advantages of the present invention will become apparent from the following description and the appended claims, taken in conjunction with the accompanying drawings in which like parts or elements denoted by like reference symbols.
Brief Description of the Drawings
[0020] FIG. 1 shows a conventional multi-format data broadcast image;
[0021] FIG. 2 is a configuration block diagram showing a multi-format adaptive image processing system to be applied to an embodiment of the present invention;
[0022] FIGS. 3A , 3B, and 3C illustrate layer pasting of multi-format data and parameter setting for each layer, FIG. 3A showing a moving image, FIG. 3B showing a still image, and FIG. 3C showing characters; and
[0023] FIG. 4 shows an adaptive processed multi-format data broadcast image.
Detailed Description of the Preferred Embodiments
[0024] An image processing method according to an embodiment of the present invention generates a layer image signal and a display section signal for each layer when displaying signals in different formats simultaneously on a single screen. The image processing method can thereby perform image processing with optimum image quality parameters for each display area to display the signals.
[0025] FIG. 2 shows configuration of a multi-format adaptive image processing system to be applied to the present embodiment. In this case, data in each format is sent by BS digital broadcast, for example.
[0026] A digital processing unit 1 in FIG. 2 subjects a BS digital broadcast signal S1 inputted thereto to digital processing to thereby separate menu data D1, character data D2, still image data D3, and moving image data D4.
[0027] A multi-screen processing unit 2 generates a multi-screen video signal S5 for multi-screen display and a display section signal S7 for the moving image data D4 from HD video S2 inputted to the multi-screen processing unit 2 and the moving image data D4 supplied from the digital processing unit 1.
[0028] A layer generating and media superimposing unit 3 generates an OSD (On Screen Display) layer 4 from the menu data D1 supplied from the digital processing unit 1, a character layer 5 from the character data D2, a still image layer 6 from the still image data D3, and a moving image layer 7 from the moving image data supplied from the multi-screen processing unit 2.
[0029] The layer generating and media superimposing unit 3 also generates a display section signal S4 for each of the OSD layer 4, the character layer 5, and the still image layer 6 as well as layer image signals S3 on which the OSD layer 4, the character layer 5, and the still image layer 6 are superimposed.
[0030] A CRT driver 8 reads preset image processing parameters stored in a parameter table 9 in a table form. An image processing unit 10 subjects each of the layer image signals S3 to optimum image processing for an area of its display section signal S4 according to the parameters stored in the parameter table 9. Also in the case of the multi-screen video signal S5, the CRT driver 8 performs optimum image processing using S5 and S7.
[0031] The thus formed multi-format adaptive image processing system applied to the present embodiment operates as follows. The multi-format adaptive image processing will be described in the following with reference to FIGS. 3A , 3B, and 3C.
[0032] FIGS. 3A , 3B, and 3C illustrate layer pasting of multi-format data and parameter setting for each layer. FIG. 3A shows a moving image; FIG. 3B shows a still image; and FIG. 3C shows characters.
[0033] The digital processing unit 1 in FIG. 2 subjects the BS digital broadcast signal S1 inputted thereto to digital processing to thereby separate the menu data D1, the character data D2, and the still image data D3. The digital processing unit 1 supplies the menu data D1, the character data D2, and the still image data D3 to the layer generating and media superimposing unit 3.
[0034] In this case, the still image data D3 corresponds to the still image 22 shown in FIG. 3B , and the character data D2 corresponds to the characters 23 shown in FIG. 3C.
[0035] The multi-screen processing unit 2 generates the multi-screen video signal S5 and the display section signal S7 from the HD video S2 inputted to the multi-screen processing unit 2 and the moving image data D4 supplied from the digital processing unit 1. The multi-screen processing unit 2 supplies the moving image data D4 to the layer generating and media superimposing unit 3, and supplies the multi-screen video signal S5 and the display section signal S7 to the CRT driver 8.
[0036] For simplicity, FIG. 3A shows a single frame of moving image.
[0037] In this case, the moving image data corresponds to the high-quality moving image 21 shown in FIG. 3A.
[0038] The layer generating and media superimposing unit 3 generates the OSD layer 4 from the menu data D1 supplied from the digital processing unit 1, the character layer 5 from the character data D2, the still image layer 6 from the still image data D3, and the moving image layer 7 from the moving image data D4 supplied from the multi-screen processing unit 2. The layer generating and media superimposing unit 3 then supplies the OSD layer 4, the character layer 5, the still image layer 6, and the moving image layer 7 to the CRT driver 8.
[0039] In FIGS. 3A , 3B, and 3C, the OSD layer does not have data, and therefore the OSD layer is not shown in the figures.
[0040] In this case, the character layer 5 corresponds to a character layer 26 shown in FIG. 3C ; the still image layer 6 corresponds to a still image layer 25 shown in FIG. 3B ; and the moving image layer 7 corresponds to a moving image layer 24 shown in FIG. 3A. Images of the layers are thus pasted to the display area.
[0041] Incidentally, each of the layer image signals may be set into a preset, arbitrarily changeable form.
[0042] The layer generating and media superimposing unit 3 also generates a display section signal S4 for each of the OSD layer 4, the character layer 5, and the still image layer 6 as well as the layer image signals S3 on which the OSD layer 4, the character layer 5, and the still image layer 6 are superimposed. The layer generating and media superimposing unit 3 supplies the display section signal S4 for each of the layers and the superimposed layer image signals S3 to the CRT driver 8.
[0043] In this case, the display section signal S4 for the character layer 5 corresponds to a display section signal C of horizontal HC×vertical VC shown in FIG. 3C ; the display section signal S4 for the still image layer 6 corresponds to a display section signal B of horizontal HB×vertical VB shown in FIG. 3B ; and the display section signal S4 for the moving image layer 7 corresponds to a display section signal A of horizontal HA×vertical VA shown in FIG. 3A.
[0044] Incidentally, each of the display section signals may be outputted so as to correspond to a preset, arbitrarily changeable form.
[0045] The CRT driver 8 reads preset image processing parameters stored in the parameter table 9 in a table form. The image processing unit 10 subjects each of the layer image signals S3 to optimum image processing for an area of its display section signal S4 according to the parameters stored in the parameter table 9.
[0046] In this case, parameter settings stored in the parameter table 9 are: parameter settings C (29) for the character layer 26 shown in FIG. 3C ; parameter settings B (28) for the still image layer 25 shown in FIG. 3B ; and parameter settings A (27) for the moving image layer 24 shown in FIG. 3A.
[0047] In this case, in the parameter settings C (29) for the character layer 26, image processing for sharpness, VM, dynamic picture, and hyper-white is off and therefore is not performed, while color temperature is set relatively high.
[0048] In the parameter settings B (28) for the still image layer 25, image processing for sharpness, dynamic picture, and hyper-white is off and therefore is not performed, VM image processing is performed relatively weakly, and color temperature is set relatively low.
[0049] In the parameter settings A (27) for the moving image layer 24, sharpness image processing is performed moderately, VM image processing is performed relatively strongly, image processing for dynamic picture and hyper-white is on and therefore is performed, and color temperature is set relatively high.
[0050] It is to be noted that the sharpness processing enhances image sharpness. The VM processing provides a three-dimensional appearance to the image by slowing a sweep rate when luminance difference is large and normalizing the sweep rate when luminance difference is small. The dynamic picture processing makes details clear by setting a portion of the lowest (black) level in a signal as black. The hyper-white processing enhances white level. The color temperature processing renders white in a movie and other images sepia.
[0051] FIG. 4 shows an adaptive processed multi-format data broadcast image after being subjected to the above image processing.
[0052] A data broadcast image 31 in FIG. 4 displays a moving image 32 subjected to the adaptive image processing with parameters A (35), a still image 33 subjected to the adaptive image processing with parameters B (36), and characters 34 subjected to the adaptive image processing with parameters C (37).
[0053] In this case, since according to the set parameters A (35), the sharpness processing is performed moderately, the sharpness of the moving image 32 is set to a moderate level. Since the VM processing is performed relatively strongly, the sweep rate is slowed relatively strongly when luminance difference is large and is normalized relatively strongly when luminance difference is small. Since the dynamic picture processing is performed, the lowest black level is raised to make details clear. Since the hyper-white processing is performed, white level is enhanced. Since the color temperature is set relatively high, white in a movie and other images is rendered sepia.
[0054] Since according to the set parameters B (36), the sharpness processing is not performed, the sharpness of the still image 33 is set to a low level. Since the VM processing is performed relatively weakly, the sweep rate is slowed relatively weakly when luminance difference is large and is normalized relatively weakly when luminance difference is small. Since the dynamic picture processing is not performed, black level is not changed. Since the hyper-white processing is not performed, white level is not enhanced. Since the color temperature is set relatively low, white remains as it is.
[0055] Since according to the set parameters C (37), the sharpness processing is not performed, the sharpness of the characters 34 is set to a low level. Since the VM processing is not performed, the sweep rate is not slowed even when luminance difference is large and is not normalized even when luminance difference is small. Since the dynamic picture processing is not performed, black level is not changed. Since the hyper-white processing is not performed, white level is not enhanced. Since the color temperature is set relatively high, white is rendered sepia.
[0056] Thus, since the layer image signal and the display section signal are generated for each of the layers, the image processing unit in the succeeding stage can determine an image processing area by means of the display section signal. This allows the above-described adaptive image processing for sharpness, VM, dynamic picture, hyper-white, and color temperature to be performed for each of the layers according to the set parameters A (35), B (36), or C (37).
[0057] It is to be noted that the parameter settings are not limited to those described above; the parameter settings may be changed for each layer and according to the status of a layer image signal. This makes it possible to adjust image quality by performing adaptive image processing according to the status of a layer image signal while viewing a data broadcast image on a television receiver.
[0058] Also, the kinds and descriptions of parameters are not limited to those described above; other image processing for enhancing or blurring an edge of an image and image processing in a Y system, a color difference system, and an R, G, and B system may be used.
[0059] In addition, the image quality of a still image may be improved so as to match the high quality of a moving image by performing interpolation processing and the like.
[0060] Moreover, another image may be used as a background in the display section area for characters.
[0061] Furthermore, a moving image, a still image, and character data may be inputted from a recording apparatus such as a digital camera or a personal computer.
[0062] It is also to be noted that the present embodiment has been described by taking only BS digital broadcast as an example; however, the present invention is of course applied to terrestrial digital broadcasts and cable digital broadcasts.
[0063] In addition, optimum image processing between moving images can be performed by using a multi-screen function. Even when an NTSC (narrow video band) image is displayed on a left screen and an HD (wide video band) image is displayed on a right screen, a video parameter for the left screen and a video parameter for the right screen can be set independently of each other.
[0064] While a preferred embodiment of the present invention has been described using specific terms, such description is for illustrative purposes only, and it is to be understood that changes and variations may be made without departing from the spirit or scope of the following claims.
Claims
1. An image processing method comprising the steps of:
separating data in a plurality of formats from a broadcast video signal;
generating a plurality of layer image signals for data in said plurality of formats such that each of the plurality of image signals of data in each of the formats is superimposable on said data in the plurality of formats; and
adaptively processing said each layer image signal according to preset parameters to enable parameters of said each layer image signal to be individually optimally adjusted for viewing, said preset parameters including a sweep rate of said each layer image signal,
wherein the sweep rate is adjusted in accordance with a luminance difference.
2. An image processing method as claimed in claim 1, further comprising:
generating a display section signal for said each layer image signal.
3. An image processing method as claimed in claim 1, wherein said each layer image signal is generated on the basis of an arbitrarily changeable form.
4. An image processing method as claimed in claim 2, wherein said display section signal is generated on the basis of an arbitrarily changeable form.
5. An image processing method as claimed in claim 1, wherein said preset parameters are stored in a table.
6. An image processing method as claimed in claim 1, wherein said preset parameters are set according to status of said each layer image signal.
7. An image processing method as claimed in claim 1, wherein said data in the plurality of formats is inputted from a recording apparatus.
8. An image processing method as claimed in claim 1, further comprising:
superimposing said plurality of layer image signals to output a processed multi-format data broadcast signal.
9. An image processing method as claimed in claim 1, wherein said preset parameters include sharpness of said each layer image signal.
10. An image processing method as claimed in claim 9, wherein said sharpness of a still image is set to a low level.
11. An image processing method as claimed in claim 9, wherein said sharpness of a text image is set to a low level.
12. An image processing method as claimed in claim 9, wherein said sharpness of a moving image is set to a moderate level.
13. An image processing method as claimed in claim 1, wherein said sweep rate of said each layer image signal is slowed relatively strongly when a luminance difference is large.
14. An image processing method as claimed in claim 1, wherein said sweep rate of said each layer image signal is normalized relatively weakly when a luminance difference is small.
15. An image processing method as claimed in claim 1, wherein said preset parameters include color temperature of said each layer image signal.
16. An image processing apparatus comprising:
separating means for separating data in a plurality of formats from a broadcast video signal;
layer image signal generating means for generating a plurality of layer image signals for data in said plurality of formats such that each of the plurality of image signals of data in each of the formats is superimposable on said data in the plurality of formats; and
adaptive image processing means for adaptively image processing said each layer image signal according to preset parameters to enable parameters of said each layer image signal to be individually optimally adjusted for viewing, said preset parameters including a sweep rate of said each layer image signal,
wherein the sweep rate is adjusted in accordance with a luminance difference.
17. An image processing apparatus as claimed in claim 16, further including display section signal generating means for generating a display section signal for said each layer image signal.
18. An image processing apparatus as claimed in claim 16, wherein said each layer image signal is generated on the basis of an arbitrarily changeable form.
19. An image processing apparatus as claimed in claim 17, wherein said display section signal is generated on the basis of an arbitrarily changeable form.
20. An image processing apparatus as claimed in claim 16, further including storage means for storing said preset parameters in a table.
21. An image processing apparatus as claimed in claim 16, wherein said preset parameters are set according to status of said each layer image signal.
22. An image processing apparatus as claimed in claim 16, wherein said data in the plurality of formats is inputted from a recording apparatus.
23. An image processing apparatus as claimed in claim 16, further comprising:
superimposing means for superimposing said plurality of layer image signals to output a processed multi-format data broadcast signal.
Patent Citations (18)
| Patent | Date | Inventor | Cited By |
|---|---|---|---|
| US5109279(A) | 1992-04-01 | Ando | Examiner |
| US5327156(A) | 1994-07-01 | Masukane et al. | Applicant |
| US5579057(A) | 1996-11-01 | Banker et al. | Applicant |
| US5608864(A) | 1997-03-01 | Bindlish et al. | Applicant |
| US5751371(A) | 1998-05-01 | Shintani | Examiner |
| US5781247(A) | 1998-07-01 | Wehmeyer et al. | Examiner |
| US5909212(A) | 1999-06-01 | Nishina et al. | Examiner |
| US5969769(A) | 1999-10-01 | Hamadate | Examiner |
| US5990860(A) | 1999-11-01 | Takeuchi | Examiner |
| US6057888(A) | 2000-05-01 | Bril | Applicant |
| US6211922(B1) | 2001-04-01 | Jun | Examiner |
| US6330036(B1) | 2001-12-01 | Murakami et al. | Examiner |
| US6348951(B1) | 2002-02-01 | Kim | Examiner |
| US6373526(B1) | 2002-04-01 | Kessler et al. | Examiner |
| US6477705(B1) | 2002-11-01 | Yuen et al. | Examiner |
| US6577350(B1) | 2003-06-01 | Proehl et al. | Examiner |
| US6590618(B1) | 2003-07-01 | Park et al. | Examiner |
| US6732371(B1) | 2004-05-01 | Lee et al. | Examiner |