Digital camera, memory control device usable for it, image processing device and image processing method

[0001] The present invention relates to a digital camera such as a memory control device and an electronic still camera. The present invention also relates to an image processing method and an image processing apparatus which can be used therefor. The present invention relates to technology in which to code or decode according to the MPEG (Moving Picture Expert Group) and JPEG (Joint Photographic Coding Expert Group) standards, and relates to apparatuses which utilize the technology.

[0002] In recent years, the demand for electronic still cameras is expanding in the place of cameras using the silver-salt photographing technology developed since 19th century. In the electronic still camera, JPEG is used as a data compression and expansion technique in order to efficiently process image data on the occasions of transmitting and storing the image data. A technical core of the JPEG method lies in the discrete cosine transform (DCT).

[0003] Since the compression and expansion of moving image data are also possible according to the JPEG method, there is an electronic still camera using this method, which is equipped with a shooting function of the moving image. The technology in which the moving image data are compressed and expanded in units of frame by the JPEG method is called M-JPEG (Motion-JPEG).

[0004] On the other hand, MPEG is one of techniques in which to compress and expand multimedia data including moving images. In the MPEG method, the technical core used in the video part lies in motion compensated prediction (MC) and DCT. The coding technique combining MC and DCT is called the hybrid coding technique. It can be said that the MPEG method is the technique in which the MC is combined into the JPEG method.

[0005] In the electronic still camera utilizing the MPEG method, it is desired that a snapshot which corresponds to one frame of the moving image can be recorded during the shooting of the moving image; for example, such a technique is disclosed in Japanese Patent Application Laid-Open No. Hei11-75148. It is known that in this type of electronic still camera there is provided an exclusive-use memory area for use in pushing aside and storing snapshot data. However, in this type of camera, this exclusive-use memory area is not utilized until the snapshot shooting is instructed, so that the effective usage rate of the memory during the shooting of moving image is not enhanced. Making it compact-size and low-cost plays a crucial role in evaluation of merchandise values, and it is admitted that there is a room for improvement in terms of implementing area and cost performance. This is the first problem which the inventor of the present invention recognized.

[0006] The second problem which the inventor recognized relates also to the similar room for improvement. Since the photographed snapshot is oftentimes printed on paper medium by using a video printer or the like, high image quality is required. However, when the moving image is recorded with the same high image quality as the snapshot, the memory capacity runs out quickly. Thus, a technique is known in which the still image is recorded at the same pixel density level as that in the shooting of the still image, and the moving image whose pixel density is reduced after performing a filtering processing thereon is recorded. In this conventional technique, however, the edge smoothing of the still image or emphasis processing thereof, for example, and so forth can not be performed, thus a filter circuit needs to be newly provided in order to realize these functions.

[0007] The third problem that the inventor recognized relates to the usability of a user at the time of shooting a snapshot. Conventionally, the outcome of the photographed snapshot is confirmed only after the shooting of the moving image is completed, so that there are many occasions where the proper photographing of the snapshot is missed out when the shooting of the snapshot is mistaken. Moreover, provision of two shooting modes for the moving image and snapshot is not likely to become a use-friendly design.

[0008] Therefore, an objective of the present invention is to provide a technique in which to give merits in terms of implementing area or cost performance thereof in the digital cameras and related technical field thereof. Another objective of the present invention is to provide a technique in which to realize further user-friendly merchandise in the digital cameras and the related technical field. These objectives and those related thereto become gradually clearer hereinafter.

[0009] A certain mode of the present invention relates to an image processing apparatus. This apparatus comprises: a still image encoder which codes image data as a still image; a moving image encoder which codes the image data as a series of motion images; an image correcting unit, provided in an input route of the image data leading to the still image encoder and the moving image encoder, which performs a filtering processing on the image data; and a control unit which controls a series of these processings.

[0010] By implementing this structure, both the still image and the motion image can be filtering-processed by the same image correcting unit. Those filtering processings may be set in a manner such that contents thereof are made different. For example, the filtering processing performed on the image data for the still image encoder (hereinafter referred to as a first filtering processing also) may include a pixel value transform processing, and the filtering processing performed on the image data for the moving image encoder (hereinafter referred to as a second filtering processing also) may include a pixel density transform processing. A plurality of types of the first filtering processings may be prepared and there may be provided a selector which selects a desirable filtering function from these processings. The filtering processing may be able to be set to an identity transform processing in which an input coincides with an output.

[0011] This apparatus may further comprise a storage unit which temporarily stores image data for one frame, in response to a still image record instructing signal during a coding processing by the moving image encoder. This image data may be image data prior to or after correction by the image correcting unit.

[0012] Another mode of the present invention relates to an image processing method. In this method, a filtering processing is performed on both image data to be coded as a still image (hereinafter possibly abbreviated simply as still image data) and image data to be coded as a moving image (hereinafter possibly abbreviated simply as moving image data), by a common image correcting unit. According to this method, an edge emphasis processing, for example, can be performed on the still image data, and a pixel number reduction processing can be performed on the motion image data.

[0013] Still another mode of the present invention relates an image processing method. In this method, a processing route of the still image data and that of the moving image data are unified, so that they are inputted to a common image correcting unit; and a predetermined processing is performed in a time sharing manner. Namely, at the timing of performing respective processings on the still image data and the moving image data, the image correcting unit operates as the same or different processor. When the image correcting unit performs the filtering processings and the still image data and moving image data are processed, a filter coefficient may be dynamically changed.

[0014] Still another mode of the present invention relates to a digital camera. This camera includes: a signal processing circuit which performs a processing, including an A-D conversion, on a shot image signal; a still image encoder which codes image data outputted from the signal processing circuit, as a still image; a moving image encoder which codes the image data as a series of moving images; and an image correcting unit, provided in an input route of the image data leading to the still image encoder and the moving image encoder, which performs a filtering processing on the image data.

[0015] Still another mode of the present invention relates to a digital camera. This camera is capable of recording a still image during shooting of a moving image, and it comprises: a display control unit which generates an image signal by which shot image data are displayed on a display; and a control unit which, while the shot image data are being displayed on the display as a moving image, instructs the display control unit to display on the display a still image corresponding to part of the moving image, for example the still image corresponding to one frame. By this structure, when a snapshot is photographed during the recording of the moving image, the contents thereof can be confirmed, so that if the outcome thereof is not satisfactory one can shoot again another snapshot.

[0016] Still another mode of the present invention relates to a digital camera. This camera comprises: a still image encoder which codes shot image data as a still image; a moving image encoder which codes the shot image data as a series of moving images; a recording unit which records image data coded by the still image encoder and the moving image encoder; a display control unit which generates an image signal by which the shot image data are displayed on a display; and a control unit which controls a series of processings, wherein the control unit is structured such that, while the shot image data are being displayed on the display as a moving image, image data shot at a timing responsive to a still image shooting instruction signal is displayed on the display. This camera may further comprise a unit, such as an operational button and a switch or the like, which inputs a shooting instruction of the still image.

[0017] The control unit may control the display control unit in a manner such that the motion image and the still image are displayed in parallel. By operations of the control unit, either one of the still image or the motion image displayed in parallel may be set to a main picture of the display so as to be displayed thereon, and these may be switchable, and, for example, permission or denial of the display of the still image may be able to be set. The still image may be displayed for a predetermined period of time, and the displayed period of time may be determined according to a user's instruction. When the still image is displayed, the user may be able to erase it, for example, by pressing a predetermined button.

[0018] Still another mode of the present invention relates to a digital camera. This camera is capable of recording a snapshot during shooting of the moving image, and it comprises: a display control unit which generates an image signal by which shot image data are displayed on a display; and a control unit which, while the shot image data are being displayed on the display as a moving image, instructs the display control unit to display the snapshot on the display.

[0019] Still another mode of the present invention relates to an image processing method in the digital camera. This method includes: a processing of shooting a moving image; a processing of shooting a snapshot during shooting of the moving image; a processing of displaying the shot moving image; and a processing of displaying the shot snapshot, wherein the moving image and the snapshot are displayed in the digital camera in a simultaneously visible manner. In addition to a case in which the motion image and the snapshot are displayed in parallel on a single display, they may be displayed on different displays and it suffices as long as they are simultaneously visible. Moreover, this simultaneous visible state may be generated for a predetermined limited duration of time.

[0020] Still another mode of the present invention relates to a memory control device. This device comprises: a storage unit which includes a plurality of memory areas which sequentially stores inputted data; and a control unit which controls input-output of the storage unit in a manner that the memory areas are used cyclically, wherein input-output of the storage unit is controlled by the control unit in a manner that, when the control unit stores data in arbitrary memory area within a plurality of the memory areas, the remaining memory areas are used cyclically. In each memory area, the data may be stored in predetermined units of block, for example in units of image frame or in units of data's coded group.

[0021] Still another mode of the present invention relates to a digital camera. This digital camera is equipped with the above-described memory control device and is capable of recording a still image corresponding to part of a moving image during shooting of the moving image. The storage unit sequentially stores inputted moving image data in a plurality of the memory areas. The control unit controls input-output of the storage unit in a manner that when the data are taken in at a store-the-still-image instructing timing, in a plurality of the memory areas the moving image data are taken into the remaining memory areas excluding the memory area which stored said data.

[0022] The control unit may control in a manner that when data are again taken in at the store-the-still-image instructing timing, previously stored data are cancelled, namely, overwrite by other data is permitted, and the moving image data are taken into the rest of the memory areas excluding the memory area which stores newly taken-in data. Alternatively, it may control in a manner that the moving image data are taken into the remaining memory areas excluding the memory areas that store the previously stored data and the memory areas that store newly taken-in data.

[0023] Still another mode of the present invention relates to an image processing apparatus equipped with a memory control device which performs a control by which image data are stored in a memory. This memory includes a put-to-common-use area which temporary stores moving image data and still image data so as to be respectively given to predetermined image processings. When storing the still image data, the memory control device utilizes an area, in the put-to-common-use area, having moving image data whose processing has been completed, and when storing the moving image data the memory control device sequentially utilizes areas other than those which store unprocessed still image data in the put-to-common-use area.

[0024] A digital camera equipped with this image processing apparatus may be provided. In that case, when shooting of a still image is instructed for the second time during shooting of a moving image, the memory control device, on the occasion of storing still image data for the second time, may utilize an area other than that which stores the still image data shot for the first time. This digital camera may further comprise a control unit which, according to a user's instruction, selects either one of the still image data shot for the first time or the still image data shot for the second time, so as to be finally stored. Moreover, on the occasion of storing still image data for the second time, the area which stores the still image data shot for the first time, may be utilized by overwriting contents thereof.

[0025] Moreover, arbitrary combinations of the above-described elements and so forth, as well as expressions thereof changed between a method, an apparatus, a recording medium, a computer program, etc. are encompassed by the scope of the present invention.

[0026] The above described objectives, other objectives, features and advantages are further made clear by the following preferred embodiments and drawings accompanied thereby.

[0027] FIG. 1 is a block circuit diagram showing an electronic still camera according to an embodiment in which the present invention is embodied.

[0028] FIG. 2 is a schematic block diagram showing a JPEG core circuit and an MPEG core circuit according to the present embodiment.

[0029] FIG. 3 is a schematic block diagram showing an image data correcting circuit according to the present embodiment.

[0030] FIG. 4 is a circuit diagram showing a filter unit of the image data correcting circuit according to the present embodiment.

[0031] FIG. 5 is a flowchart showing operations of the electronic still camera according to the present embodiment.

[0032] FIG. 6 is a flowchart showing operations of the electronic still camera according to the present embodiment.

[0033] FIG. 7 is a flowchart showing operations of the electronic still camera according to the present embodiment.

[0034] FIG. 8 is a flowchart showing operations of the electronic still camera according to the present embodiment.

[0035] FIG. 9 shows a display screen obtained at the time of recording a snapshot by the electronic still camera, according to the present embodiment.

[0036] FIG. 10 is provided for describing a usage mode of a frame buffer, according to the present embodiment.

[0037] FIG. 11 is provided for describing another example of the usage mode of the frame buffer, according to the present embodiment.

[0038] FIG. 1 is a block circuit diagram showing an electronic still camera 1 utilizing JPEG and MPEG method according to an embodiment.

[0039] The electronic still camera 1 comprises an image pickup device 2, a signal processing circuit 3, an image data correcting circuit 4, a JPEG core circuit 5, an MPEG core circuit 6, a frame buffer 7, a display circuit 8, a display 9, a memory card 10, input-output circuit 11, data buses 12 and 13, a control core circuit 14 and a group of operational buttons 15.

[0040] The control core circuit 14 controls each component 2-13 of the electronic still camera 1 in response to an ON-OFF signal of the group of operational buttons 15. The group of buttons 15 includes a still picture recording button 15a, a moving picture recording button 15b and other selection buttons 15c.

[0041] The image pickup device 2 comprises a CCD (Charge Coupled Device) and so forth, and shoots a subject image so as to generate an output signal. The signal processing circuit 3, which includes an A-D converting circuit, generates original image data, for example, whose pixel number is vertical 1200horizontal 1600, in units of picture, by performing white balance adjustment and gamma correction and so forth after the output signal of the image pickup device 2 is A-D converted. The original image data generated by the signal processing circuit 3 is transferred to either of the frame buffer 7 or the display circuit 8, or both thereof via the data bus. The display circuit 8 generates an image signal from image data, in a single picture unit, transferred via the data bus 12. The display 9 displays the image signal generated by the display circuit 8, as a subject image.

[0042] The frame buffer 7 comprises a rewritable semiconductor memory such as SDRAM (Synchronous Dynamic RAM), DRAM, Rambus DRAM and the like, stores pictures transferred via the data bus 12, namely, stores the image data in units of frame, and reads out the stored image data picture by picture. In this frame buffer 7, there is provided a memory area 7a (hereinafter referred to also as a memory area for use in pushing aside 7a) which temporarily pushes aside applicable still image data for one frame and stores it in response to an ON signal of the still picture recording button 15a during recording of moving images.

[0043] The picture-by-picture image data read out from the frame buffer 7 are transferred to the image data correction unit 4 via the data bus 12. The image data correction circuit 4 performs a correction processing, which will be described later, on image data inputted from the signal processing circuit 3. The picture-by-picture image data, generated from the image data correcting circuit 4, on which the correction processing has been performed, are transferred to the JPEG core circuit 5 or the MPEG core circuit 6 via the data bus 12.

[0044] The memory card 10 is mounted on the electronic still camera 1 in a detachable manner and includes a flash memory 10a therein. The flash memory 10a stores picture-by-picture compressed image data transferred via the data bus 13, and reads out the stored compressed image data picture by picture so as to be outputted to the data bus 13.

[0045] The input-output circuit 11 outputs picture-by-picture image data transferred via the data bus 13 to external apparatuses connected to the electronic still camera 1, for example, an external display, a personal computer, a printer or the like, and outputs image data inputted from these external apparatuses, to the data bus 13. The image data read out from the memory card 10 or the image data inputted via the input-output circuit 11 are transferred to the JPEG core circuit 5 or the MPEG core circuit 6 via the data bus 13.

[0046] As shown in FIG. 2, the JPEG core circuit 5 comprises a DCT circuit 16, a quantization circuit 17, a Huffman coding circuit 18, a Huffman decoding circuit 19, an inverse quantization circuit 20, and an inverse DCT (IDCT; Inverse DCT) circuit 21. In the JPEG core circuit 5, image data of one picture are divided into a plurality of macroblocks set by standards of the JPEG method, and then a compression-expansion processing is performed thereon for each block. The DCT circuit 16, the quantization circuit 17 and the Huffman coding circuit 18 constitute a JPEG encoder so as to perform the compression-coding processing on still image data, and the Huffman decoding circuit 19, the inverse quantization circuit 20 and the inverse DCT circuit 21 constitute a JPEG decoder. The JPEG core circuit 5 or the JPEG encoder serves as an example of a still image encoder in the present invention.

[0047] The DCT circuit 16 takes in image data of one picture in one block unit, against picture-by-picture image data read out from the frame buffer 7, and a two-dimensional discrete cosine transform (DCT: Discrete Cosine Transform) is performed on the image data so as to generate DCT coefficients. The quantization circuit 17 quantizes the DCT coefficient supplied from the DCT circuit 16, by referring to a quantization threshold value stored in a quantization table stored in a RAM (not shown).

[0048] The Huffman coding circuit 18 performs variable-length coding on the DCT coefficients quantized by the quantization circuit 17, by referring to Huffman codes stored in a Huffman table stored in a RAM (not shown), so that compressed image data are generated picture by picture. The compressed image data generated by the Huffman coding circuit 18 are transferred to at least one of the memory card 10 or the input-output circuit 11 via the data bus 13.

[0049] The MPEG core circuit 6 is constituted by adding first and second MC (motion compensated prediction) circuits 22a and 22b to the Huffman coding circuit 18. Thus, the DCT circuit 16, quantization circuit 17, Huffman coding circuit 18, Huffman decoding circuit 19, inverse quantization circuit 20, and inverse DCT circuit 21 are shared by the JPEG core circuit 5 and the MPEG core circuit 6, and whether to use the JPEG core circuit 5 or the MPEG core circuit 6 in which the first and second MC circuits 22a and 22b are added to this circuit 5 is selected by a switch signal from the control core circuit 14. It is presupposed that the JPEG and the MPEG are provided with the above-described quantization table and Huffman table, separately.

[0050] In the MPEG core circuit 6, image data of one picture are divided into a plurality of macroblocks set by standards of the MPEG method, and then a compression-expansion processing is performed thereon for each block. The DCT circuit 16, the quantization circuit 17, the Huffman coding circuit 18 and the first MC circuit 22a constitute an MPEG encoder so as to perform the compression-coding processing on moving image data, and the Huffman decoding circuit 19, the inverse quantization circuit 20 and the inverse DCT circuit 21 and the second MC circuit 22b constitute an MPEG decoder. The MPEG core circuit 6 or the MPEG encoder serves as an example of a moving image encoder in the present invention. The compressed image data generated by the MPEG encoder, too, are transferred to at least one of the memory card 10 or the input-output circuit 11 via the data bus 13.

[0051] In the JPEG core circuit 5 or the MPEG core circuit 6, the Huffman decoding circuit 19 performs the variable-length decoding on the picture-by-picture compressed image data transferred via the data bus 13 by referring to Huffman codes, so that expanded image data are generated picture by picture. The inverse quantization circuit 20 inverse-quantizes the picture-by-picture expanded image data generated by the Huffman decoding circuit 19, by referring to the quantization threshold value, so as to generate DCT coefficients.

[0052] The inverse DCT circuit 21 performs the two-dimensional inverse discrete cosine transform (IDCT: Inverse DCT) on the DCT coefficients generated by the inverse quantization circuit 20. In the MPEG core circuit 6, the second MC circuit 22b performs an MC processing on the picture-by-picture expanded image data on which the inverse discrete cosine transform has been performed by the inverse DCT circuit 21.

[0053] The expanded image data from the JPEG core circuit 5 or the MPEG core circuit 6 are transferred to the frame buffer 7 via the data bus 12. The frame buffer 7 stores the transferred picture-by-picture image data. The display circuit 8 generates an image signal, from the picture-by-picture image data transferred from the frame buffer 7 via the data bus 12, so that the signal is displayed on the display 9 as a subject image.

[0054] As shown in FIG. 3, the image data correcting unit 4 comprises a digital filter unit 23, a ROM 24 and a timing control unit 25. The digital filter unit 23 includes a spatial filter which is a non-cyclic type digital filter, for example, an FIR (Finite Impulse Response) filter. The digital filter unit 23 comprises, as shown in FIG. 4, n units of delay elements 26 . . . , which delay n bits of input signal inputted from the signal processing circuit 3 for every sampling cycle, n1 units of multipliers 27 . . . , and an adder 28 which convolutes signals from the multipliers 27 . . . . The respective coefficients an, a_n, a_n1 . . . . . . a₂, a₁ of the multipliers 27 . . . are coefficients that determine the characteristics of the filter, and coefficients for use with a filtering processing of the moving image data and those for use with a filtering processing of the still image data are written in advance in the ROM 24. These coefficients are in advance set to proper values through simulation at a manufacturing stage.

[0055] For example, when the moving image data are filtering-processed, satisfactory low-pixel-density images are achieved by changing the value of each coefficient for every sampling cycle by the use of the concepts of linear interpolation and others. As an example, let us consider the case of reducing the horizontal number of pixels to {fraction (2/3)}. Suppose that there are three pixels p₁ to p₃ placed side by side horizontally in an original image. Now these pixels are converted into two pixels q₁ and q₂ by the filtering processing for the moving image data. To accomplish this, q₁ and q₂ are each expressed as primary linear sum of p₁, p₂ and p₃. Namely, a filtering processing for reducing a data amount is realized by determining each coefficient of the linear sums by experiment or like means upon deciding on the ratio by which to express a degree of reduction in the number of pixels. As an example, the number of pixels may be reduced to 480 (vertical)720 (horizontal).

[0056] On the other hand, when the filtering processing is performed on the still image data, a high-pass filter may be formed by setting each coefficient so that a high-frequency region is emphasized. Thereby, a sharp image having less deterioration at edge portions can be obtained while the number of pixels is kept at a constant rate. Though n8 is set in the present embodiment, this of course may vary according to the freedom of designing.

[0057] The timing control unit 25 controls the timing at which the coefficient is read out from the ROM 24, the timing of the latch of input-output data, the timing of filter operation and so forth, according to the control of the control core circuit 14.

[0058] Based on the above-described structure, operations for recording the image data will be described with reference to flowcharts shown in FIG. 5 to FIG. 8. In FIG. 5, the still image processing shown in FIG. 6 is performed when the still picture recording button 15a is switched ON while the moving image processing shown in FIG. 7 is performed when the moving picture recording button 15b is switched ON.

[0059] (Still Image Recording)

[0060] Referring to FIG. 6, an original image signal taken in from the image pickup device 2 is inputted to the signal processing circuit 3 at a timing corresponding to the ON signal of the still picture recording button 15a and is then converted to digital original image data of one picture, so as to be taken into the frame buffer 7 (S1). The original image data of one picture are sent out from the frame buffer 7 to the image data correcting circuit 4 and are also sent out to the display circuit 8, so that the still image is displayed on the display 9 (S2).

[0061] The above-described correction processing designed for handling the still image is performed on the data taken in the image data correcting circuit 4 (S3), and the corrected data are inputted to the JPEG core circuit 5. Then, after a predetermined compression-coding processing is performed thereon (S4), they will be recorded in the flash memory 10a (S5).

[0062] (Moving Image Recording)

[0063] Referring to FIG. 7, the original image signal taken in from the image pickup device 2 is inputted to the signal processing circuit 3 at a timing corresponding to the ON signal of the moving picture recording button 15b and is then converted to picture-by-picture digital original image data, so as to be successively taken into the frame buffer 7 (S11). The picture-by-picture original image data are sent out from the frame buffer 7 to the image data correcting circuit 4 and are also sent out to the display circuit 8, so that the moving image is displayed on the display 9 (S12).

[0064] The above-described correction processing designed for handling the moving image is performed on the data successively taken in the image data correcting circuit 4 (S13), and the corrected data are inputted to the MPEG core circuit 6. Then, after a predetermined compression-coding processing is performed thereon (S14), they will be recorded in the flash memory 10a (S15). This operation continues until the ON signal is again sent out from the moving picture recording button 15b (S16).

[0065] (Snapshot Recording)

[0066] Referring to FIG. 7, when the ON signal is sent out from the still picture recording button 15a during the recording of the moving image, the control core circuit 14 judges that snapshot shooting is instructed from an external source and then executes a snapshot processing shown in FIG. 8 (S17). Then, image data for one frame are temporarily pushed aside and stored in the memory area 7a for use in pushing aside in the frame buffer 7 (S21). During this pushing-aside operation, the recording of the moving image continues. In other words, the original image signal taken in from the image pickup device 2 is inputted to the signal processing circuit 3 and is then converted to picture-by-picture digital original image data, so as to be successively taken into the frame buffer 7 (S22). The picture-by-picture original image data are sent out from the frame buffer 7 to the image data correcting circuit 4 and are also sent out to the display circuit 8. The above-described correction processing designed for handling the moving image is performed on the data successively taken in the image data correcting circuit 4 (S23), and the corrected data are inputted to the MPEG core circuit 6. Then, after a predetermined compression-coding processing is performed thereon (S24), they will be recorded in the flash memory 10a (S25).

[0067] In the present embodiment, the picture-by-picture original image data are sent out from the frame buffer 7 to the display circuit and, together with this, the image data for one frame pushed aside in the memory area for use in pushing aside 7a are sent out. The moving image of being presently shot and the still image to be recorded as a snapshot are displayed in parallel (S26) on the display 9. FIG. 9 shows an example of the moving image and the still image being displayed on the display 9 in parallel, where a moving image 200 whose size is {fraction (1/16)} of the picture is displayed in the upper right position of a screen while a still image 100 is displayed as a main picture.

[0068] The still image is displayed for predetermined time duration, for example, for five seconds and, thereafter, the display is switched to display of the moving image alone (S27) and the operation is returned to the normal display image processing shown in FIG. 7 (S28). During the parallel display of the still image the user can confirm on the display 9 whether or not a desired snapshot was shot. When the ON signal is again sent out from the still picture recording button 15a during the display of the still image, the processings of S21 to S27 are performed based on the data taken in at a timing corresponding to the ON signal (S29). In this case, the contents of the memory area for use in pushing aside 7a are replaced by new data.

[0069] FIG. 10 is provided for explaining a usage state of the frame buffer 7 in the moving image processing and snapshot processing. The frame buffer 7 is provided with four normal memory areas A to D, and one picture, that is data for one frame, is stored for each memory area A-D. Of course, the number of the memory areas is changed as appropriate according to specifications of the camera 1.

[0070] In the normal moving image processing shown in FIG. 7, as shown in FIG. 10(a), the picture-by-picture digital original data from the signal processing circuit 3 are stored in the order of ABCD and are outputted to the data bus 12 in the order starting from the one inputted first (First-In First-Out). When the data are stored in the last memory area D, the memory area A is again used. Namely, the memory areas A to D are used cyclically. For the cyclic use of the frame buffer 7, an LRU (Least Recently Used) algorithm and others such as a page memory control method may be adopted.

[0071] When the ON signal for a snapshot is sent out from the still picture recording button 15a during the processing of the moving images, the data taken in at a timing corresponding to the ON signal is stored in a certain memory area and said area is used, as it is, as the memory area 7a for use in pushing aside the still image data. For example, when data taken in at a timing of recording a snapshot are stored in the third memory area C, the memory area C is used as the memory area 7a for use in pushing aside, as shown in FIG. 10(b), and in the moving image processing thereafter the remaining memory areas A, B and D are used cyclically. Thereafter, when another data taken in again at a timing of recording a snapshot are stored in the second memory area B this time, the data at the third memory area C are cancelled, that is, the data are removed from a protected subject and the second memory area B is used as the memory area for use in pushing aside 7a, as shown in FIG. 10(c), and in the moving image processing thereafter the memory areas A, C and D other than the second memory area B are used cyclically.

[0072] As described above, the order in which the four memory areas A to D are used depends on the algorithm to be implemented; the memory areas may be used in the order, for example, ACDBAC . . . or ACDABC . . . or the like. In short, when there exist a plurality of memory areas which have stored processing-completed moving image data, that are, the moving image data in which overwriting thereof is allowed, any memory area may be utilized for use in pushing aside the data. In these cases too, such usage is called cyclically used. When only two of the memory areas are prepared at first, the recording data of a snapshot are stored, so that the moving image data thereafter are successively outputted after the moving image data are taken in to a single memory area. In this case too, it is called cyclically used.

[0073] When the moving image recording is completed, the control core circuit 14 judges whether or not the pushing-aside operation of the still image is performed during the recording of the moving image (S18) as shown in FIG. 7; if performed, the data, for one frame, which are being stored in the memory area for use in pushing aside 7a are transferred to the image data correcting circuit 4 via the data bus 12 and the similar processing to the still image recording is performed (S19).

[0074] The electronic still camera 1 according to the present embodiment provides the following operation and effects.

[0075] (1) Since the still image can be extracted as a snapshot during shooting of the moving image, the function as an electronic still camera improves.

[0076] (2) Since the still image is displayed as a snapshot on the display 9, the user can easily confirm a shooting state of the snapshot and he/she can take another snapshot in no time if he/she doesn't like the snapshot. Thereby, frequency of mis-shooting snapshots can be reduced. Thus, the value of merchandise as an electronic still camera can be raised.

[0077] (3) In addition to the above (2), the moving image which is presently being shot is displayed in parallel, so that a shooting state of the moving image can also be confirmed in real time.

[0078] (4) In addition to above (2) and (3), a shooting state of the snapshot can be easily confirmed by displaying the still image to be recorded as a main picture on the display 9 while the moving image is displayed in a small size.

[0079] (5) In addition to the above (2), since the still image to be recorded as a snapshot is displayed temporarily on the display 9, the operation necessary for confirming the recording of the moving images on the display 9 will not be interfered for long period of time.

[0080] (6) As shown in FIG. 10, the memory area for use in pushing aside 7a will not be provided until a still shooting for a snapshot is instructed and all are utilized as normal memory areas, so that use efficiency of the frame buffer 7 is enhanced.

[0081] (7) The still image data can be corrected to a further optimal image by using the data correcting circuit 4.

[0082] (8) Since it is so structured that not only the moving image data but also the still image data passes through the data correcting circuit 4, the still image can also be correction-processed by merely storing coefficients in the ROM 24, thus realizing low cost and function improvement. Since no correcting circuiting for exclusive use with the still image needs to be provided, the tendency of the apparatus to become large-sized as well as the increase in power consumed can be prevented.

[0083] (9) The DCT circuit 16, the quantization circuit 17, the Huffman coding circuit 18, the Huffman decoding circuit 19, the inverse quantization circuit 20 and the inverse DCT (IDCT; Inverse DCT) circuit 21 are shared in the JPEG core circuit 5 and the MPEG core circuit 6, so that the structure of the electronic still camera 1, an arithmetic processing algorithm and so forth can be simplified.

[0084] (10) Provision of the memory area 7a for use in pushing aside for the snapshot facilitates the sorting and search of the still image and the moving image, and makes possible a faster reproduction.

[0085] (11) When the snapshot shooting is instructed, image data prior to being inputted to the image data correcting circuit 4 are pushed aside; as a result, filtering processing and zooming processing in the vertical direction will be facilitated when thereafter processing the data at the image data correcting circuit 4, and the moving images can be recorded without being interrupted.

[0086] The present embodiments include the following modified examples.

[0087] (i) At S26 in FIG. 8, the still image alone is displayed on the display 9.

[0088] (ii) At S26 in FIG. 8, the size of the still image and that of the moving image displayed on the display 9 in parallel are reversed, so that the moving image becomes the main picture. Moreover, a structure is provided such that permission and denial of the display of the still image can be instructed by the user using a button or the like.

[0089] (iii) At S29 in FIG. 8, image data for a newly taken snapshot is stored in parallel with old data which is not replaced thereby. Namely, as shown in FIG. 11, in the normal moving image processing the memory areas A-D of the frame buffer 7 are used cyclically (FIG. 11(a)). Next, when data taken in at a timing the first snapshot is recorded is stored in the third memory area C, the memory area C is used as the memory area for use in pushing aside 7a (FIG. 11(b)), and in the moving image processing thereafter, the remaining three memory areas A, B and D are used cyclically. When data taken in at a timing the second snapshot is recorded is stored in the second memory area B, the second and third memory areas B and C are used as the memory area for use with pushing aside 7a (FIG. 11(c)), and in the moving image processing thereafter, two memory areas A and D are used cyclically, that is, alternately. In this manner, a plurality of snapshots can be recorded. Increasing the number of snapshots, which can be taken, will reduce the area in which the frame buffer 7 can be used in the moving image processing. Thus, the number of snapshots which can be taken needs to be set to the degree that overflow of the frame buffer 7 does not occur at the time of processing the moving images.

[0090] (iv) A magneto-optical disk, optical disk, magnetic disk or the like is used in place of the memory card 10.

[0091] (v) When the shooting for taking a snapshot is instructed, the image data in which a processing has been completed at the image data correcting circuit 4 are temporarily pushed aside to the memory area for use in pushing aside 7a. By so doing, the data can be easily taken out when a predetermined compression processing is performed in the JPEG core circuit 5 thereafter.

[0092] (vi) The still image data do not go through the image data correcting circuit 4.

[0093] (vii) The M-JPEG techniques are used in compression and expansion of the moving image data.

[0094] (viii) In addition to JPEG used for the compression and expansion of the still image data, compression technology using the difference-processing-based difference YUV, the block-based Hadamard transform, the Slant transform or Haar transform method is used for the compression of the still image data.

[0095] (ix) When the filtering processing is performed on the still image data, a low-pass filter, a band-pass filter or the like may be formed by setting each coefficient value so that a high frequency range is not emphasized. Thereby, the aliasing or jaggy may be suppressed.

[0096] (x) When the filtering processing is performed on the still image data, a dynamic range of a color signal is extended and each coefficient value is set so as to obtain a vivid image. Besides, arbitrary linear or nonlinear filter can be used in accordance with use or user's taste.

[0097] (xi) As shown in FIG. 1, the selection button 15c is provided which selects the correcting functions of the above embodiments and the above (ix) and (x). Thereby, the still image in accordance with the user's taste can be formed, and the function as the electronic still camera 1 is further enhanced. The selection button 15c is an example of a selector in the present invention.

[0098] (xii) The filtering processing in the image data correcting circuit 4 may be such that the filtering processing can be set to the identity transform processing. In that case, the still image data inputted are outputted as kept intact. In this structure, the filter function can be easily put to effective use when necessary. In order to realize the identity transform, for example, in FIG. 4, coefficient ₁ only is set to 1 and the remaining coefficients ₁ . . . ₂, ₁ are all set to 0. The present invention is characterized in the feature that the still image data and the moving image data are made to pass through the image data correcting circuit 4, and the identity transform processing, of course, belongs to the concept of the filtering processing.

[0099] (xiii) Though described is that either the snapshot or the moving image is displayed in the main picture, which one is to be set to the main picture may be user-selectable. The control core circuit 14 may switch which one is set to the main picture, by the operation of the selection button 15c or the like by the user. Moreover, the control core circuit 14 may include a mode by which the display of the snapshot is prohibited according to the user's instruction, or the snapshot may be displayed for the time duration specified by the user.

[0100] Industrial Usability

[0101] As have been described, the present invention can be used for the digital camera or the image processing method, image processing apparatus and the memory control circuit which can be used therefor.