Image processing apparatus and method for accepting image signals from a medium or source of a plurality of types to display images of a plurality of frames simultaneously on a screen

[0002] 1. Field of the Invention

[0003] This invention relates to an image processing apparatus and method.

[0004] 2. Description of the Related Art

[0005] In an image processing apparatus having a function for recording/reproducing image data representing the image of a subject photographed using a solid-state image sensing device such as a CCD, the image data representing the image of the photographed subject can be recorded on storage media of a plurality of types (e.g., a memory card, the memory of a personal computer, etc.). However, a plurality of frames of image data that have been read out of storage media of a plurality of different types cannot be reproduced simultaneously on the same monitor screen. Consequently, a plurality of frames of images represented by image data stored in storage media of a plurality of types cannot be compared directly on a monitor screen. In order to compare these images, it is required that they be printed out.

[0006] An object of the present invention is to provide an image processing apparatus and method in which image data stored in storage media of or outputted by image signal generating sources of a plurality of different types can be reproduced simultaneously on the same monitor screen.

[0007] According to the present invention, the foregoing object is achieved by providing an image processing apparatus comprising an image signal processor for converting image signals, provided by storage media or image signal generating sources of a plurality of types, to respective items of image data in a prescribed format, and an image reducer converting image data, which is output by the image signal processor, to reduced image data, which represents a reduced image, in accordance with a given reduction ratio. An image memory capable of storing at least one screen of image data, multiple-screen construction for storing image data, which has been provided by a designated storage medium or image signal generating source and converted by the image signal processor, or reduced image data reduced by the image reduction means, in the image memory in an arrangement capable of constructing multiple screens. An image signal output converting the image data, which has been stored in the image memory, to an image signal suitable for being displayed, and outputting this image signal. The image signal referred to here covers the concept of a video signal and image data.

[0008] According to the present invention, the foregoing object is achieved by providing an image processing method comprising the steps of converting image signals, provided by storage media or image signal generating sources of a plurality of types, to respective items of image data in a prescribed format, converting the converted image data to reduced image data, which represents a reduced image, in accordance with a given reduction ratio if the given reduction ratio represents image reduction, storing the image data provided by a designated storage medium or image signal generating source and converted to the prescribed format, or the reduced image data obtained by image reduction, in an image memory in an arrangement capable of constructing multiple screens, converting the image data, which has been stored in the image memory, to an image signal suitable for being displayed, and outputting this image signal.

[0009] In accordance with the present invention, original image data provided by a plurality of storage media or image signal generating sources is converted to reduced image data representing a reduced image, and the original image data or the reduced image data is stored in an image memory that is capable of storing one screen of image data in an arrangement in which multiple split screens can be constructed. A plurality of frames of the (reduced) image data read out of different storage media or the like are stored in the image memory. These items of image data in the image memory are converted to image signals, which are suitable for being displayed, and the image signals are output. Accordingly, if the output image signals are applied to a monitor display unit, a plurality of frames of image data represented by the image data read out of storage media or image signal generating sources of a plurality of different types are displayed simultaneously on a single monitor screen. Thus, images of a plurality of frames represented by image data provided by storage media or image signal generating sources of a plurality of types can be compared directly on a monitor screen without being printed out. If a high-definition display unit is used as the monitor display unit, even reduced images can be displayed clearly. Alternatively, images can be displayed without always being reduced in size. As a result, a comparison can be made in appropriate fashion.

[0010] Other features and advantages of the present invention will be apparent from the following description taken in conjunction with the accompanying drawings, in which like reference characters designate the same or similar parts throughout the figures thereof.

[0011] FIG. 1 is a block diagram illustrating the electrical configuration of a digital image processing apparatus;

[0012] FIGS. 2aand 2bare diagrams illustrating processing through which image data read out of different media are reproduced in a multiple split-screen arrangement, in which FIG. 2ashows a monitor display screen split into a plurality of zones in accordance with a set screen arrangement, and FIG. 2bshows the images, which have been read out of the different media, displayed on the same display screen;

[0013] FIG. 3 is a diagram showing processing for reducing (thinning out) image data; and

[0014] FIGS. 4aand 4bare flowcharts showing the flow of one cycle of image processing.

[0015] An embodiment of the present invention will now be described in detail with reference to the accompanying drawings.

[0016] FIG. 1 is a block diagram showing the electrical configuration of a digital image processing system which includes an image processing apparatus 5 according to the present invention.

[0017] A digital electronic still-video camera 1 is exemplified as an image signal generating source, and a memory card 2 and an optical disk 3 are exemplified as storage media. These are capable of being connected to the image processing apparatus 5. A magnetic disk and an internal or external memory of a personal computer can also be mentioned as storage media.

[0018] The image processing apparatus 5 is provided with a connector 8 for connecting the digital electronic still-video camera 1, a connector 9 for loading and connecting the memory card 2, and an optical disk drive 14 for reading data recorded on the optical disk 3.

[0019] The image processing apparatus 5 is further provided with a Y/C-RGB converting circuit 12 for converting Y/C data (luminance data Y and color data C representing an image, wherein the color data C generally is dot-sequential data of color-difference data R-Y and B-Y), which is provided by the digital electronic still-video camera 1, to data R, G, B representing the three primary colors, and a compression/expansion circuit 13 for decompressing (expanding) compressed image data read out of the memory card 2 and compressing image data to be written to the memory card 2. The Y/C-RGB converting circuit 12, compression/expansion circuit 13 and optical disk drive 14 are connected to an internal common bus.

[0020] The image processing apparatus 5 further includes a CPU 16, a buffer memory 19 and a display memory (VRAM) 20, which are connected to the internal common bus. The CPU 16 is equipped with a RAM 17 for storing data and the like and a ROM 18 for storing programs. The buffer memory 19 has a capacity capable of storing one frame of the image data R, G, B. In this embodiment, the buffer memory 19 is capable of storing 640×512 pixels of R, G, B data.

[0021] A high-definition monitor display unit 4 is used to display images and therefore the display memory 20 has a capacity capable of storing 1280×1024 pixels of R, G, B data (which is one screen of image data as presented on the monitor display unit 4). The image data R, G, B (image data which constructs a multiple split-screen display, as will be described later) stored in the display memory 20 is read out by a VRAM controller 21, converted to analog signals for each of the colors by a D/A converting circuit 22 and applied to the display unit 4 via an output terminal 23.

[0022] An operation (control) panel 6 includes keys for selecting the digital electronic still-video camera 1, the memory card 2 or the optical disk 3, a key for designating a desired frame of a plurality of frames of image data stored in these storage media, a key for selecting the multiple split-screen arrangement, and a command key for causing the image processing apparatus 5 to perform other desired operations. The operation panel 6 is connected to the CPU 16 via an operation-panel control circuit 15. The CPU 16 responds to commands from the operation panel 6 by communicating with the camera 1, accessing the memory card 2, controlling the optical disk drive 4, etc. As will be described later, the CPU 16 further forms multiple screens, controls the display, etc.

[0023] The digital electronic still-video camera 1 is capable of photographing a subject, executing recording processing by recording the image data, which represents the image of the subject obtained by photography, on the memory card 2 upon compressing (or not compressing) the image data, and communication processing for transmitting the image data obtained by photography to the image processing apparatus 5 via a cable. In a case where “camera (on-line)” has been set in the operation panel 16 as the input medium, the image data (Y/C data) obtained by photography is output by the digital electronic still-video camera 1 and applied to the image processing apparatus 5 via the connector 8. The image data is converted to R, G, B data by the Y/C-RGB converting circuit 12, and the R, G, B data is stored in the buffer memory 19.

[0024] The memory card 2 can be freely loaded into and unloaded from the digital electronic still-video camera 1 and image processing apparatus 5. The memory card 2 has an internal semiconductor memory that is capable of storing a plurality of frames of compressed image data or uncompressed image data. If “memory card” is set in the operation panel 6 as the input medium, compressed Y/C data representing a designated frame is read out of the memory card 2 under the control of the CPU 16. The expanded Y/C image data read out is compressed by the compression/expansion circuit 13. The expanded Y/C image data is converted to R, G, B image data by the Y/C-RGB converting circuit 12, and the R, G, B image data is stored in the buffer memory 19. It goes without saying that when uncompressed image data has been read out of the memory card 2, decompression processing is not executed.

[0025] R, G, B image data that has not been compressed is stored on the optical disk 3. The latter is located in the optical disk drive 14 of the image processing apparatus 5. If “optical disk” is set as the input medium, the drive 14 is started up by the CPU 16 and R, G, B image data representing a designated frame is read out of the optical disk 3. The read R, G, B image data is stored in the buffer memory 19.

[0026] Multiple screens are constructed in order that a plurality of frames of image data thus read out of image data generating sources or storage media of a plurality of types may be displayed simultaneously on the display screen of the display unit 4. An example of the multiple-screen arrangement is illustrated in FIG. 2a. The screen is split into a 2×2, 3×3, 4×4 arrangement or the like. The numbers 1˜4 illustrated are numbers representing the zones in which the screen has been split. The reduction ratio qf the image data is decided in conformity with the screen arrangement. The image data for constructing the multiple screens is created in the display memory 20.

[0027] In case of the 2×2 split-screen arrangement, for example, processing for reducing the image data is not necessary. The reason for this is that the image data of one from that has been stored in the buffer memory 19 is composed of 640×512 pixels and the display memory 20 is capable of storing 1280×1024 pixels of image data. The image data is read out of the buffer memory 19 and stored in the display memory 20 in dependence upon the positions of zones constituting the multiple split-screen display. For example, when an image of one frame is displayed in zone 2 shown in FIG. 2a, the image data representing this image is stored in the display memory 20 at an address corresponding to the display on the zone 2 when this data is read out of the memory 19.

[0028] In case of the 4×4 split-screen arrangement, an image represented by data stored in the buffer memory 19 requires reduction. In this case, the image data is reduced by one-half in the both the horizontal and vertical directions. Image reduction processing is performed by thinning-out processing. As shown in FIG. 3, reduced image data, the reduction ratio of which is 1/2, is obtained by thinning out image data one item at a time in the horizontal and vertical directions. Averaging processing is another example of reduction processing. This method involves calculating the average value of four mutually adjacent pixels of image data in the original image and adopting this average value as one pixel of image data in the reduced image (in a case where the reduction ratio is 1/2).

[0029] In either case, transfer of image data from the buffer memory 19 to the display memory 20 (which includes determining addresses so as to construct multiple screens) and image reduction processing are executed by the CPU 16.

[0030] FIGS. 4aand 4bare flowcharts illustrating the flow of one cycle of image processing.

[0031] The contents of the memories 19, 20 in the image processing apparatus 5 are cleared (step 101). As a result, the screen on the monitor display unit 4 is cleared. Using the operation panel 6, the operator selects a screen arrangement (step 102). The screen arrangement is selected from among a plurality of types, prepared in advance. Examples of the split-screen arrangements are the aforementioned 2×2, 3×3, 4×4 split-screen arrangements, etc.

[0032] The CPU 16 partitions the display memory (VRAM) 20 into a plurality of storage areas in conformity with the screen arrangement designated by the operator (step 103). A frame representing the split zones appears on the screen of the monitor display unit 4 (see FIG. 2a) (step 104). At this time the numbers representing the respective zones also are displayed on the screen.

[0033] Using the operation panel 6, the operator enters a number to select the zone in which an image is desired to be displayed (step 105). Next, the operator enters the input medium from which is to be read the image data representing the image whose screen is desired to be displayed, as well as a frame number (ID number) (step 106). The image data having the designated frame number is read out of the designated input medium (the camera 1, memory card 2 or optical disk 3) under the control of the CPU 16.

[0034] If the designated input medium is “camera (on-line)”, the Y/C image data is read out of the digital electronic still-video camera 1 (step 107), this image data is converted to R, G, B image data by the Y/C-RGB converting circuit 12 (step 111) and the R, G, B image data is stored in the buffer memory 19 (step 112).

[0035] If the designated input medium is “memory card”, the compressed Y/C image data representing the image of the designated frame is read out of the memory card 2 (step 108), decompressed by the compression/expansion circuit 13 (step 110) and converted to R, G, B image data by the Y/C-RGB converting circuit 12 (step 111), with the R, G, B image data being stored in the buffer memory 19 (step 112).

[0036] If the designated input medium is “optical disk”, then the R, G, B data representing the image of the designated frame is read out of the optical disk 3 by the optical disk drive 14 (step 109) and stored in the buffer memory 19 (step 112).

[0037] In accordance with the designated split-screen arrangement, the CPU 16 calculates a reduction ratio (inclusive of a reduction ratio=1, namely no reduction) for when image data is written in the display memory (VRAM) 20. The CPU 16 reduces (as by thinning-out processing), at the calculated reduction ratio, the R, G, B digital image data stored in the buffer memory 19, and writes the reduced image data in the storage area of the display memory (VRAM) 20 corresponding to the designated zone (step 113).

[0038] The R, G, B image data stored in the display memory (VRAM) 20 is converted to analog signals, which are then applied to the monitor display unit 4. As a result, the reduced image is displayed on the screen in the zone designated (step 114).

[0039] In a case where there is another image desired to be displayed (YES at step 115), the processing from step 105 to step 115 is repeated. In this way images read out of each input medium and reduced may be displayed in each of the zones on the display screen, as depicted in FIG. 2b.

[0040] In a case where it is desired to change the screen arrangement (YES at step 116), the processing from step 101 to step 116 is repeated.

[0041] The embodiment described above is premised on the fact that one frame of image data read out of the digital electronic still-video camera 1, memory card 2 and optical disk 3 is composed of 640×512 pixels. In a case where the image data provided by these input media has a higher definition (1280×1024 pixels, for example), the buffer memory 19 would have a capacity capable of storing this high-definition image data. Further, reduction processing would be absolutely necessary in this case in order to construct the multiple screen.

[0042] As many apparently widely different embodiments of the present invention can be made without departing from the spirit and scope thereof, it is to be understood that the invention is not limited to the specific embodiments thereof except as defined in the appended