Reproduction apparatus, imaging apparatus, screen display method, and user interface

[0001] This application is a national phase application of International Application No. PCT/JP2005/018986, filed Oct. 11, 2005, and claims the priority of Japanese Application No. 2004-298392, filed Oct. 13, 2004, the content of all of which is incorporated herein by reference.

[0002] The present invention relates to a reproduction apparatus, an imaging apparatus, a screen display method, and a user interface that are applicable to for example an electronic camera and that allow a photographed image to be easily retrieved.

[0003] Electronic cameras of recent years can record many images to a record medium. Thus, it is becoming bothersome to retrieve a desired image from many images that have been photographed and recorded. In related art, an index display function, a calendar display function, a folder display function, and so forth that allow many images to be efficiently checked on a screen are known.

[0004] The index display function is a function of successively displaying many images recorded on a record medium on an index screen that is a multiply segmented screen. The calendar display function is a function of reducing images every photographed year, month, or day and displaying the reduced images on one screen. The folder display function is a function of reducing images contained in a folder and displaying the reduced images.

[0005] However, the index display function simply displays a plurality of images of many images on one screen. In the calendar display function, if there are many images photographed on the same date, retrieval efficiency deteriorates. The folder display function necessitates photographed images to be separately recorded in folders in advance. A method of categorizing image data of moving image data as groups is described in Japanese Patent Application Laid-Open No. HEI 10-254746. In this related art, as a method of categorizing image data as groups, image data are categorized as groups on the basis of photographed locations and photographed times.

[0006] Japanese Patent Application Laid-Open No. HEI 10-254746 describes that top images of individual groups are multi-segment displayed. By designating a desired image from those, a group is selected and image data registered to the group are successively reproduced.

[0007] In the display method described in Japanese Patent Application Laid-Open No. HEI 10-254746, photographed images are hierarchically categorized as groups. The user browses representative images of individual groups, designates his or her desired group from the representative images, and then selects his or her desired image in the designated group. However, with representative images, the user is not able to easily know other images in the groups. Thus, it is thought that the related art is not user-friendly to retrieve a desired image from many images.

[0008] Thus, an object of the present invention is to provide a reproduction apparatus, an imaging apparatus, a screen display method, and a user interface that allow a desired image to be easily retrieved from many photographed images.

[0009] To solve the foregoing problem, the present invention is a reproduction apparatus which reproduces a plurality of images from a record medium. The reproduction apparatus includes a process means, a display means, and an input means. The process means divides a plurality of images recorded in the record medium into image groups based on photographed conditions. The display means displays a plurality of reproduced images. The input means accepts an operation input from a user. The display means successively displays a representative image which belongs to each of the plurality of image groups and images chronologically adjacent to the representative image or images which belong to image groups which are adjacent to the image group to which the representative image belongs. The input means is capable of performing a first feed operation of successively selecting representative images which belong to the plurality of image groups and a second feed operation of successively selecting a plurality of images which belong to each of the plurality of image groups.

[0010] The present invention is an imaging apparatus. The imaging apparatus includes an image capturing means, a record means, and a reproduction means. The image capturing means captures an image of a subject. The record means records an image captured by the image capturing means. The reproduction means reproduces a plurality of images from the record means. The imaging apparatus also includes a process means, a display means, and an input means. The process means divides a plurality of images recorded in the record medium into image groups based on photographed conditions. The display means displays a plurality of reproduced images. The input means accepts an operation input from a user. The display means successively displays a representative image which belongs to each of the plurality of image groups and images chronologically adjacent to the representative image or images which belong to image groups which are adjacent to the image group to which the representative image belongs. The input means is capable of performing a first feed operation of successively selecting representative images which belong to the plurality of image groups and a second feed operation of successively selecting a plurality of images which belong to each of the plurality of image groups.

[0011] The present invention is a screen display method of a reproduction apparatus which displays a plurality of images recorded in a record medium. The plurality of images recorded in the record medium are divided into image groups based on photographed conditions. A representative image which belongs to each of the plurality of image groups and images chronologically adjacent to the representative image or images which belong to image groups which are adjacent to the image group to which the representative image belongs are successively displayed. The representative image and the plurality of images are changed depending on whether a first feed operation of successively selecting representative images which belong to the plurality of image groups or a second feed operation of successively selecting a plurality of images which belong to each of the plurality of image groups is performed.

[0012] The present invention is a user interface for a reproduction apparatus which reproduces a plurality of images recorded in a record medium. The plurality of images recorded in the record medium are divided into image groups based on photographed conditions. A representative image which belongs to each of the plurality of image groups and images chronologically adjacent to the representative image or images which belong to image groups which are adjacent to the image group to which the representative image belongs are successively displayed. A first feed operation of successively selecting representative images which belong to the plurality of image groups and a second feed operation of successively selecting a plurality of images which belong to each of the plurality of image groups are performed.

[0019] Next, with reference to the accompanying drawings, an embodiment of the present invention will be described. FIG. 1 shows an example of a structure of a digital camera according to an embodiment of the present invention. This embodiment is based on a standard for current regular digital cameras defined by JEITA (Japan Electronics and Information Technology industries Association).

[0020] In other words, this embodiment is based on standards for DCF (Design rule for Camera File System) and Exif (Exchangeable image file format for digital still camera). The JPEG file format defines an area for an application marker segment, in which intrinsic information of an application is stored. In the Exif file format, unique information of Exif is stored in this area.

[0021] In FIG. 1, a section 1 surrounded by dotted lines represents a process section controlled by a CPU (Central processing Unit) 2. The process section 1 is composed of an internal record medium 3, such as a RAM, an image process section 4, an external interface 5, an RGB process section 6, a signal process section 7, and a video output process section 8. Connected to the CPU 2 is an operation section 9. A signal corresponding to an operation of for example a shutter disposed in the operation section 9 is supplied to the CPU 2.

[0022] A captured image signal is compressed according to JPEG (Joint Photographic Exports Group) system or the like. The compressed data are recorded to an external record medium 11 through a media process section 10. The external record medium 11 is a writable optical disc, a memory card, or the like.

[0023] Supplied to the signal process section 7 is a captured image signal from a CCD (Charge Coupled Device) 12 as an image sensor. The signal process section 7 processes the captured image signal. In addition, regardless of whether or not an input has been made from the operation section 9, an image signal captured by the CCD 12 is output from the signal process section 7 and stored in the internal record medium 3. While a subject is being photographed, an image stored in the internal record medium 3 is continuously updated. Data that are written to and read from the internal record medium 3 are controlled by the CPU 2.

[0024] A captured image signal is supplied from the internal record medium 3 to the RGB process section 6 through the signal process section 7. A display signal generated by the RGB process section 6 is supplied to an LCD (Liquid Crystal Display) 13 as a display device. The LCD 13 is disposed for example on the rear of the camera body. The LCD 13 displays not only a captured image signal and an image signal supplied from the external record medium 11 through the media process section 10.

[0025] When the shutter of the operation section 9 is pressed, the image process section 4 converts the captured image signal stored in the internal record medium 3 into an image file according to for example the JPEG system. The image file is stored as data different from the captured image signal in the internal record medium 3. An image file read from the internal record medium 3 is stored in the external record medium 11 through the media process section 10 under the control of the CPU 2. Instead, the image file temporarily stored in the internal record medium 3 may be kept stored therein.

[0026] An image file is continuously updated and a reproduced image is displayed on the LCD 13. OSD data such as reduced images of recorded image data, icons, and so forth are superimposed with the reproduced image by the signal process section 7 and the superimposed image is displayed on the LCD 13. The OSD (On Screen Display) is a general term that represents a memory area and a mechanism that prepare data of icons or the like superimposed with a real time image captured from a camera.

[0027] When OSD data are created, latest image data are obtained from the external record medium 11. The obtained image data are converted into data having a size suitable for OSD by the image process section 4. Thereafter, the converted image data are stored in an OSD display area of the internal record medium 3. However, if there is an image having the OSD display size corresponding to the just photographed image in the internal record medium 3, it is not necessary to obtain data from the external record medium 11. The image process section 4 is controlled by the CPU 2 such that an image to be displayed is enlarged or reduced for example according to a key operation of the user for the operation section 9.

[0028] An analog color video signal outputted from the video output process section 8 is obtained from a video output terminal (not shown). When an external monitor 14 is connected to the video output terminal, images stored in the internal record medium 3 or the external record medium 11 can be displayed on the external monitor 14. In addition, for example a printer 15 is connected to the external interface 5. With the printer 15, images can be printed.

[0029] The operation section 9 includes a cross key. When tip portions of a cross-shaped operation portion of the cross key (referred to as left button, right button, up button, and down button) are pressed, the moving directions of the cursor is designated as upper, low, left, and right directions, respectively. The directional key may be an input device such as a dial, a roller, a track ball, or a touch panel other than the cross key. Instead of such mechanical structures, a GUI (Graphical User Interface) of which buttons or the like are operated on the display screen may be used.

[0030] In the Exif file format, additional information of Exif IFD shown in FIG. 2A and FIG. 2B is defined. FIG. 2A and FIG. 2B list an excerpt of the additional information as tags with respect to photographed conditions and tags with respect to the structure of image data. In FIG. 2A and FIG. 2B, only meanings, tag names, and tags (2 bytes) of Exif IFD are listed; however, for simplicity, their types and counts are omitted.

[0031] Photographing setting information of an image stored in the internal record medium 3 or the external record medium 11 is contained in an image file in the Exif file format. This photographing setting information is read to a nonvolatile memory (RAM) portion of the internal record medium 3. When the photographing setting information relates to setting for a lens, a camera lens control section of the signal process section 7 controls the lens corresponding to the setting such that an image is displayed on the LCD 13 corresponding to the setting of the lens.

[0032] According to the present invention, many images are delimited in the unit of a so-called event based on photographed conditions for example photographed locations such that desired images can be efficiently retrieved from or checked in many images stored in a photographed order in the internal record medium 3 or the external record medium 11. In each event, a plurality of images are arranged based on photographed dates and times. Events may be set based on time information for example in the unit of one day or one week.

[0033] FIG. 3 shows a concept of events. In FIG. 3, a total of nine images are arranged on time axis. In FIG. 3, images photographed at three different locations are illustrated. A process of categorizing photographed images as events based on different photographed locations is automatically performed by the image process section 4 (refer to FIG. 1) when their subjects are photographed. As an example of categorizing an image as an event, a state of which no subject is photographed for a preset time or longer is detected as an event delimitation. Photographed date and time, namely date and time on and at which an original image was created, are described with tags of Exif IFD. Thus, when an interval of photographed images is longer than the preset time, it can be determined that the photographed locations have changed. As a result, this state can be detected as an event delimitation.

[0034] Next, the process of categorizing an image as an event based on the length of the interval of photographed images will be more specifically described. Detected events are categorized based on event identification information. Information with which continuities of events are managed is stored in the RAM of the internal record medium 3 instead of an image file. The CPU 2 reads time information of photographed dates and times of image files of many images stored in the internal record medium 3 or the external record medium 11 to the RAM portion of the internal record medium 3.

[0035] The CPU 2 compares time information that has been previously read and later time information that has been just read and detects the time difference therebetween. The CPU 2 compares the preset time and the detected time difference. When the time difference is larger than the preset time, the CPU 2 detects the time difference as an event delimitation. In FIG. 3, T1 and T2 represent event delimitations detected in such a manner. When the time difference is smaller than the preset time, two image files are kept together as one event. Event identification information of each image file is stored in the RAM of the internal record medium 3. For example, a table that correlates file names, which identify images, and event numbers is created as event identification information. Instead, event identification information may be stored in the RAM of the CPU 2.

[0036] As another method of categorizing images as events, location information as GPS (Global Positioning System) information is used. When a digital camera has a GPS function, the GPS information can be obtained. The obtained GPS information is described with a tag of Exif IFD.

[0037] Instead, photographed images may be categorized as events based on color hues of the images. Since the color hues of images tend to be identical depending on photographed locations, the images can be categorized as events based on their color hues. Instead, images may be categorized as events based on at least two factors of length of the interval of photographed images (namely, the duration of non-photographed state), GPS information, and color hues of images.

[0038] FIG. 4 describes images displayed on the LCD 13 according to an embodiment of the present invention. The LCD 13 can be a regular LCD having an aspect ratio of 4:3 or a wide LCD having an aspect ratio of 16:9 or 8:3. However, it is preferred that the LCD 13 be capable of displaying two or more reproduced images. FIG. 4 shows the case of which a wide LCD is used as the LCD 13. When necessary, images are read from the external record medium 11 and stored in the internal record medium 3. Image data are read from the external record medium 11, decoded and size-reduced by the image process section 4, and then stored in the internal record medium 3.

[0039] Reproduced images P11, P12, P21, P22, and P3n are arranged horizontally on time axis. Arrows in FIG. 4 represent the direction on time axis on which time passes from past to present. The direction on time axis on which reproduced images are successively displayed may be reversed. A plurality of images arranged on one axis in the order of photographed dates and times are arranged in the horizontal direction, vertical direction, or diagonal direction on the display screen of the LCD 13. In this embodiment, a plurality of images are arranged in the horizontal direction.

[0040] Reference numeral 24 represents a shutter button. Reference numeral 25 represents a menu button. Reference numeral 26 represents a delete button. Reference numeral 27 represents a cross key. Reference numeral 28 represents a dial key.

[0041] Displayed above the plurality of images arranged in the horizontal direction are horizontal lines L1, L2, and L3 delimited every event. Horizontal lines L1, L2, and L3 visualize images that belong to the same events. Images P11 and P12 belong to the same event. Images P21 and P22 belong to the same event. Image P3n is an n-th image that belongs to another event. The display method is not limited to such an example as long as images that belong to the same events are visualized. For example, horizontal lines may be displayed below a plurality of images. Instead, images that belong to the same event may be surrounded by windows having the same color. Instead, the same icon may be superimposed with images that belong to the same event. For example, the latest image (hereinafter referred to as a top image) that belong to each event is designated as a representative image. Dots are displayed on horizontal lines corresponding to representative images P11 and P21. In addition, photographed dates and times are displayed only on representative images P11 and P21. In such a manner, a plurality of reproduced images are simultaneously displayed on the LCD 13. Among these reproduced images, representative images that belong to individual events are identifiably displayed. Representative images are not limited to top images that belong to individual events. Instead, representative images can be suitably designated based on additional information of Exif IFD. Instead, the user may select desired images as representative images.

[0042] When representative images are designated, the user can have a cue to retrieve his or her desired image based on his or her memory of each event. In addition, it is preferred that a representative image and other images be arranged on time axis such that the user can simultaneously see representative image and reproduced images that are adjacent thereto and that belong to the same event or reproduced images that belong to another event.

[0043] In this embodiment of the present invention, the user is provided with intuitional and clear operability unlike with a hierarchical structure in which only representative images are displayed, a group is selected with a representative image, and images of the selected group are displayed. In addition, images photographed on the same date are categorized as a plurality of events depending on the photographed locations such as airport, staying place in trip, restaurant, and so forth, the user can more easily estimate the position of his or her desired image based on his or her memory with representative images than the method of which images are categorized as groups simply based on photographed dates.

[0044] Left and right feed buttons of the cross key 27 (or a left or right feed button) are used to feed events. The event feed is an operation of which a reproduced image is jumped from one representative image to another representative image. For example, in the case that a representative image is a top image, when the right feed button is pressed, a reproduced image is jumped to a top image that belongs to the just older event is reproduced. When the left feed button is pressed, a reproduced image is jumped to a top image of the just newer event is reproduced.

[0045] When the dial key 28 is rotated, an image that belongs to each event is fed (hereinafter, sometimes referred to as the frame feed). When the dial key 28 is rotated clockwise, a row of reproduced images is fed leftward. When the dial key 28 is rotated counterclockwise, a row of reproduced images is fed rightward. The relationship of the rotation directions of the dial key 28 and the frame feed directions may be reversed from the foregoing example. Instead, the event feed may be preformed by the dial key 28, whereas the frame feed may be performed by the cross key 27.

[0046] The event feed and the frame feed may be performed by the same key rather than independent keys. For example, the dial key 28 may be able to be pressed. In this case, when the dial key 28 is pressed, the event feed is performed. When the dial key 28 is rotated, the frame feed is performed. Instead, while the center portion of the cross key 27 is being pressed, the event feed is performed at a predetermined interval. The frame feed for each event may be performed by the left and right feed buttons.

[0047] In the case that these operations are accomplished by a GUI, when the cursor is placed at a date and an event feed key, for example, the left or right feed button of the cross key 27 is operated, the event feed of which a reproduced image is jumped to a top image that belongs to the newer or older event can be performed leftward or rightward. Specifically, in the reproduction mode for which images are reproduced, a plurality of images including an image that has been just photographed are displayed on the LCD 13. The cursor is placed on the just photographed image. In this state, when the left or right reproduction button is operated, a reproduced image is jumped to a top image that belongs to an adjacent event. When the left or right feed button is pressed several times, a reproduced image is jumped to a top image that belongs to an event corresponding to the number of times the left or right feed button was pressed. When the frame feed key, which causes images to be fed one by one, is operated, the cursor can be moved to an image adjacent to the top image. The GUI may be combined with the touch panel.

[0048] FIG. 5 is a flow chart showing an operation accomplished by a GUI. FIG. 6 is a schematic diagram showing a transition of images. Arrows at ST1 to ST4 shown in FIG. 6 represent the direction on time axis on which time passes from past to present. When the reproduction operation is started, an image that has been just photographed and adjacent images are displayed on the LCD 13. The cursor is placed on the image that has been just photographed (at step S1).

[0049] At step S1, the display screen of the LCD 13 is represented as ST1 in FIG. 6. The cursor represented as Cs is placed at image P41 that has been just photographed. Image P41 is a top image that belongs to one event represented by line L11. Black dot D11 is displayed on line L11. In addition, photographed date and time are displayed above image P41.

[0050] At step S2, when the event feed key (for example, the right feed button of the cross key 27) is operated one time, the cursor Cs is placed at a top image that belongs to the just older event on the screen.

[0051] As shown in FIG. 6, when the cursor Cs is placed at image P41, the right feed button of the cross key 27 is pressed. Display screen ST3 on which the cursor Cs is placed at top image P31 that belongs to the just older event is displayed through transition display screen ST2. Transition display screen ST2 is an animation transition screen on which a row of images horizontally arranged on time axis slides leftward to display screen ST3. Transition display screen ST2 is momentarily displayed. With such an animation transition, the user can easily recognize that the event feed is being performed. On display screen ST3, line L12 represents a row of images that compose (belong to) the just older event. Image P31 represents a top image that belongs to the event.

[0052] In FIG. 6, on display screen ST3, the dial key 28 is rotated for example clockwise. Display screen ST4 displays the state of which a row of a plurality of images slides leftward. In this case, an animation transition of which the cursor Cs is fixedly placed nearly at a center position of display screen ST4 and the row of the plurality of images slides leftward is performed.

[0053] In the flow chart shown in FIG. 5, at step S3 (on display screen ST3), the cursor Cs is placed at a top image that belongs to the just older event. Thereafter, the event feed key is operated several times (at step S4). The cursor is placed at a top image that belongs to an event older than the current event by events corresponding to the number of times the event feed key was pressed. At step S6, the frame feed is performed frame by frame on display screen ST4. The cursor is placed at the adjacent image (at step S7).

[0054] At step S8, when an OK button, for example the center position of the cross key 27, is pressed, an image to be selected is decided. When an image to be selected has been decided, various types of image processes can be performed on the menu for the selected image. For example, the selected image is enlarged or reduced. Instead, the selected image can be deleted by the delete button 26.

[0055] The present invention is not limited to the foregoing embodiment. Instead, various modifications and changes may be made without departing from the spirit of the present invention. For example, the present invention is not limited to a digital camera that records still images. Instead, the present invention can be applied to a photographing apparatus that records moving images and a photographing apparatus that records both still images and moving images. When a moving image is recorded, for example one photographing operation is delimited as one event.

[0056] As described above, according to this embodiment, a representative image that belongs to an image group and images chronologically adjacent thereto are successively displayed on time axis on a display means. A first feed operation of successively selecting reproduced images that belong to image groups and a second feed operation of successively selecting images that belong to the selected image group can be performed. Thus, according to the present invention, a desired image can be easily retrieved from many images in comparison with a hierarchical operation of which image groups are selected based on only representative images and images that belong to the selected image group are selected.

• [0057] 1 PROCESS SECTION
• [0058] 2 CPU
• [0059] 3 INTERNAL RECORD MEDIUM
• [0060] 9 OPERATION SECTION
• [0061] 11 EXTERNAL RECORD MEDIUM
• [0062] 12 CCD
• [0063] 13 LCD
• [0064] 24 SHUTTER BUTTON
• [0065] 27 CROSS KEY
• [0066] 28 DIAL KEY
• [0067] S1 DISPLAY CURSOR AT JUST PHOTOGRAPHED IMAGE.
• [0068] S2 OPERATE EVENT FEED KEY.
• [0069] S3 DISPLAY CURSOR AT TOP IMAGE THAT BELONGS TO JUST OLDER EVENT
• [0070] S4 OPERATE EVENT FEED KEY SEVERAL TIMES.
• [0071] S5 DISPLAY CURSOR AT TOP IMAGE THAT BELONGS TO OLDER EVENT THAN CURRENT EVENT BY SEVERAL EVENTS.
• [0072] S6 OPERATE FRAME FEED KEY.
• [0073] S7 DISPLAY CURSOR AT ADJACENT IMAGE.
• [0074] S8 PRESS OK BUTTON.
• [0075] S9 FRAME DISPLAY SCREEN