Digital image-sensing apparatus and control method therefor

[0002] This invention relates to a digital image-sensing apparatus which converts an optical image, obtained by sensing an object, into an electric video signal, then converts the electric video signal into a digital video signal so that an external printer can print the sensed image based on the digital video signal.

[0003] In conventional digital image-sensing devices such as a digital camera, to print a sensed image, it is necessary to once download image data into a computer machine such as a personal computer (PC), then output the data to a printer connected to the computer machine by using an application program for performing printing based on the data.

[0004] In this technique, a user searches a table of image information and file names displayed on a display device by using the application on the computer machine, and selects output data for printing.

[0005] However, this technique must use a computer machine to print a digital image sensed by an image-sensing device such as a digital camera. For this reason, the user who desires to see a printed sensed image must activate an application program to download the digital image data stored in the image-sensing device, and an application program to perform printing based on the data, then operate the programs. In addition, only the printer connected to the computer machine can perform printing.

[0006] The present invention has been made to solve the above problems, and has its object to provide a digital image-sensing apparatus which enables image sensing utilizing portability and enables an external printer to easily print a sensed image.

[0007] Another object of the present invention is to provide an image-sensing apparatus which automatically recognizes an external device upon transferring sensed video image data to the external device, and generate and output data in format interpretable by the external device, and the external device.

[0008] Further object of the present invention is to provide an image sensing apparatus which add decorative information to the sensed video image data, and causes an external device, especially a printer, to print a sensed image not only simply based on sensed video image data, but also based on the video image data with the decorative information.

[0009] Other features and advantages of the present invention will be apparent from the following description taken in conjunction with the accompanying drawings, in which like reference characters designate the same name or similar parts throughout the figures thereof.

[0010] The accompanying drawings, which are incorporated in and constitute a part of the specification, illustrate embodiments of the invention and, together with the description, serve to explain the principles of the invention.

[0011] FIG. 1 is a block diagram showing the construction of an image-sensing and printing system according to a first embodiment of the present invention;

[0012] FIG. 2 shows a printer-type management table managed by an image-sensing apparatus of the first embodiment;

[0013] FIG. 3 is a flowchart showing a communication protocol between the image-sensing apparatus and a printer of the first embodiment and process procedures on both sides;

[0014] FIG. 4 shows the structure of sample table data in a memory of the image-sensing apparatus of the first embodiment;

[0015] FIG. 5 shows a sample image table printed in the first embodiment;

[0016] FIG. 6 is a flowchart showing a process procedure of generating sample-table print data according to the first embodiment;

[0017] FIG. 7 is a flowchart showing a process procedure of generating print data of a sensed video image according to the first embodiment;

[0018] FIG. 8 is a block diagram showing the construction of a camera according to a fourth embodiment;

[0019] FIG. 9 is a block diagram showing the construction of the external device of the fourth embodiment;

[0020] FIG. 10 is a flowchart showing a process procedure according to the fourth embodiment;

[0021] FIG. 11 is an example of device information transferred between the camera and the external device of the fourth embodiment;

[0022] FIG. 12 is an another example of the apparatus information transferred between the camera and the external device of the fourth embodiment;

[0023] FIG. 13 is a block diagram showing the construction of the image-sensing and printing system according to a fifth embodiment;

[0024] FIG. 14 is a flowchart showing process procedure of recording a form data number according to the fifth embodiment;

[0025] FIG. 15 is a flowchart showing process procedure of recording a video image data number according to the fifth embodiment;

[0026] FIG. 16 is a flowchart showing a process procedure of printing according to the fifth embodiment;

[0027] FIG. 17 is a display example of the form data of the fifth embodiment;

[0028] FIG. 18 shows the format of the form data of the fifth embodiment; and

[0029] FIG. 19 is a flowchart showing a process procedure of downloading the form data.

[0030] Preferred embodiments of the present invention will now be described in detail in accordance with the accompanying drawings.

[0031] Note that the present invention is implemented by a system having a digital image-sensing apparatus which comprises a CPU, a memory, a storage device, and an interface unit for communication with a printer, and a communication-protocol management module which discriminates a printer connected to the system and manages the communication protocol, a sample-table generating module which generates a table of stored image data, and a printer-control code generating module which generates printer-control codes.

[0032] The above system enables searching and selection of information on paper by using a printer, instead of conventional search and selection made on a display device of a computer machine.

[0033] In the above system, a user selects an image to be printed from a printed sample image table, and instructs the printer directly from the digital image-sensing apparatus to perform printing.

[0034] Next, the embodiments of the present invention will be described in detail.

[0035] [First Embodiment]

[0036] FIG. 1 shows the construction of the image-sensing and printing system according to a first embodiment of the present invention. In this construction, an image-sensing apparatus main body 10 comprises an image sensing unit 10a, a CPU 10d, a memory 10e, a user interface (I/F) parts group 10i, a user interface (I/F) unit 10h, an internal-device interface (I/F) unit 10j, an external-device interface (I/F) unit 10k, an external storage device 10l, and a system bus 10band a local bus 10cconnecting the-respective elements.

[0037] Note that the user I/F parts group 10iincludes a display (liquid crystal display) device for displaying a sensed video image and simple messages, and various buttons such as a shutter button used for image-sensing, a print button used for printing, and a selection button for selecting items displayed on the display device.

[0038] The image-sensing apparatus main body 10 is communicable with a printer 11 via the external-device I/F unit 10k. In the memory 10e, storage areas are allocated to a communication-protocol management module 10ffor managing communication protocol with the printer 11, a sample-table generating module 10mfor generating a sample image table of a plurality of image data stored in the external storage device 10l, a print-control code generating module 10gfor generating printer-control codes, a system management module 10nfor managing the overall image sensing apparatus 10, and a sample table buffer 10ofor storing the sample image table.

[0039] The printer-control code generating module 10ghas a printer-type management table 20 as shown in FIG. 2. The printer-type management table 20 contains a printer-type logical name 20a, a printer horizontal resolution 20b, a printer vertical resolution 20c, and a printer driver program 20d.

[0040] In the image-sensing and printing system, when the shutter button in the user I/F parts group 10iis pressed, video image data obtained by sensing by the image sensing unit 10ais stored, as digital image data, into the external storage device 10lin the form of image file. In the present embodiment, upon storing data into the external storage device 10l, image data obtained from image sensing is compressed by a method in accordance with the JPEG (Joint Photographic Coding Experts Group) standards.

[0041] On the other hand, the printer 11 comprises a CPU 11a, a memory 11d, a printer-control system 11i, a printer controller 11h, an external-device interface (I/F) unit 11e, and a system bus 11band a local bus 11cconnecting the respective elements.

[0042] In the memory 11d, storage areas are allocated to a communication-protocol management module 11ffor managing a communication protocol with the image-sensing apparatus 10, a print buffer 11jfor storing the printer-control codes transferred from the image-sensing apparatus 10, and a printer-control code interpretation module 11gfor interpreting the printer-control codes.

[0043] In the present embodiment, the system management module 10nin the memory 10ealways manages messages from the image sensing unit 10a, the internal-device I/F unit 10j, the external-device I/F unit 10k, and the user I/F unit 10h.

[0044] The communication-protocol management module 10fmanages signals inputted/outputted to/from the external-device I/F unit 10k, i.e., communication with the printer 11.

[0045] In the present embodiment, the communication system between the image-sensing apparatus main body 10 and the printer 11 can be constructed either a wired-communication system or a wireless-communication system.

[0046] To perform communication between the image-sensing apparatus main body 10 and the printer 11, it is necessary to first establish a communication link. The communication at this stage is performed by the communication-protocol management module 10fin the memory 10eof the image sensing apparatus 10 and the communication-protocol interpretation module 11fin the memory 11dof the printer 11. The operation and processing to generate a sample image table by using the protocol during this communication will be described with reference to FIGS. 2 to 4.

[0047] FIG. 2 shows the printer-type management table 20. FIG. 3 shows the communication protocol between the image sensing apparatus 10 and the printer 11 and process procedures on both sides. FIG. 4 shows the structure of sample table data in the memory 10eof the image-sensing apparatus 10.

[0048] In FIG. 3, the process starts when the print button in the user I/F parts group 10iis pressed.

[0049] First, the image sensing apparatus 10 and the printer 11 both start negotiation (P32) as shown in FIG. 3 to establish a communication link between them by using the communication-protocol management modules 10fand 11f, and the image sensing apparatus 10 becomes print-communication start status (step S30a), at which the printer-control code generating module 10gis started. Similarly, the printer 11 becomes print-communication start status (step S31a), at which the printer-control code interpretation module 11gis started.

[0050] At step S31a, the printer 11 sends printer-type information to the image sensing apparatus 10 by using the communication-protocol management module 11f(P33).

[0051] At step S30b, the image sensing apparatus 10 receives the printer-type information by the communication-protocol management module 10f, and determines a program to generate printer-control codes by using the printer-type management table 20. In the present embodiment, in the printer-type management table 20 in FIG. 2, as three printer types a101, a202 and a b 101 are registered, the printer type is discriminated (steps S30cto S30e) based on the printer-type information from the printer 11, and processing (any of steps S30fto S30h) corresponding to the printer type is performed. If the printer type informed from the printer 11 is not registered in the printer-type management table 20, the printer-control code generating module 10gon the image sensing apparatus 10 side is terminated (S30k), and the communication with the printer 11 is terminated (S30l) by the communication-protocol management module 10f. At this time, the display device in the user I/F parts group 10idisplays an error message.

[0052] On the image sensing apparatus 10 side, image data obtained from image sensing is stored into the external storage device 10lsequentially. The printer-control code generating module 10g, that has executed a print-code generating program corresponding to the printer type, displays a menu message requesting a print mode on the display device in the user I/F parts group 10i, then waits for data-input for data transfer to the printer 11. If the user of the image sensing apparatus 10 selects to print a sample image table by using the use I/F parts group 10i, the system management module 10nreceives a sample-table generation message (step S30m). The process proceeds to step S30nat which the sample-table generating module 10min the memory 10eis started.

[0053] The sample-table generating module 10mgenerates sample table data having a size corresponding to the resolution (20band 20cin FIG. 2) obtained from the printer-type management table 20 in the initial communication with the printer 11. More specifically, the sample-table generating module 10mloads the respective image data stored in the external storage device 10l, and performs interpolation or thinning on the loaded data in accordance with the determined image size. As shown in FIG. 4, a data structure 40, comprising a file name 41, a width 42 and a height 43 with respect to each image, is sequentially stored into the sample table buffer 10oin the memory 10l, for forming the sample image table.

[0054] Next, the process procedure of the sample-table generating module 10m(step S30n) will be described in detail with reference to the flowchart of FIG. 6.

[0055] The printing of sample image table is to print a plurality of images, based on the plurality of image data stored in the external storage device 10l, on one print sheet. For this purpose, the determination of the size of each image (frame), i.e., the number of dots in a horizontal direction and that in a vertical directions, determined based on each corresponding video image data, is important. To obtain a constant image size regardless of the printer connected to the image sensing apparatus, the number of dots in the horizontal direction and the vertical direction of each image to be generated must be determined in accordance with the resolution of the printer.

[0056] At step S41, since the printer type is known by the communication-protocol management module 10f, the number of dots in the horizontal direction and that in the vertical direction of one image is determined based on the resolution of the printer. If the resolution of the connected printer is high, the number of the dots in the horizontal and vertical directions increases; contrary, if the resolution is lower, the number of dots decreases.

[0057] At step S42, one video image data (data for one image) is read from the external storage device 10l, and the data is decoded. At step S43, the read video image data is interpolated or thinned to have the above-determined number of dots.

[0058] Generally, a CCD used in digital image-sensing devices and the like has at most 300,000 to 400,000 pixels, and image data obtained from image sensing has about 640×480 dots. However, recent printers have a higher resolution (e.g., 720 dpi). Printing a sample image table using such printers, without any processing, results in a very small table. For this reason, interpolation rather than thinning is actually performed. As interpolation is well-known technique, the explanation of this processing will be omitted.

[0059] Thus, when image data for one frame of the sample image table has been generated, the data having the format as shown in FIG. 4 is stored in the sample table buffer 10o.

[0060] The processing at step S42 and the subsequent steps is repeated until it is determined at step S45 that generation of sample-table print data for all the stored image data has been completed.

[0061] Returning to FIG. 3, the printer-control code generating module 10g, that has received image data 44 and the file name 41 from the sample table data generated by the sample-table generating module 10m, converts the image data 44 and the file name 41 into print codes that the printer can interpret by using the selected program (S30o).

[0062] At step S30j, the image sensing apparatus 10 sends the generated print codes to the printer 11 (P34), and as the transfer has been completed, the printer-control code generating module 10gis terminated (S30k). Then, the communication-protocol management module 10fterminates the communication with the printer 11 (S30l).

[0063] On the printer 11 side, the printer codes are received from the image sensing apparatus 10 by the communication-protocol management module 11f(step S31c). The received codes are temporarily stored via the external-device I/F unit 11einto the print buffer 11jin the memory 11d. The stored codes are loaded into the CPU 11aand interpreted (step s31d). Printing is performed by the printer controller 11hand the printer control system 11i(step S31e). As the printing has been completed, the printer-control code interpretation module 11gis terminated (step S31f). The communication-protocol management module 11fdetects by time out that data transfer from the image sensing apparatus 10 has not been made (step S31g), and terminates the communication (S31h).

[0064] Note that if the sample table data has not been received (NO at step S30m), and an image file has been directly selected (S30i), the image sensing apparatus 10 generates print codes by using the selected program and sends the print codes to the printer 11 (P34).

[0065] Next, the processing by step S30iwill be described in detail with reference to the flowchart of FIG. 7.

[0066] First, a variable i is initialized to “1” at step S51. Next, the i-th sensed video image data from the external storage device 10l, and appropriate thinning is performed on the read data. A sensed video image is displayed on the display device in the user I/F parts group 10i, based on the data.

[0067] The user looks at the displayed video image, and by manipulating the various buttons in the user I/F parts group 10i, instructs to or not to print, or performs frame feed operation or frame feed-back operation.

[0068] Upon frame feed instruction, the process proceeds from step S53 to S54, at which the variable i is incremented by “1”, then returns to step S52. As a result, the display device displays the next frame (sensed video image).

[0069] On the other hand, upon frame feed-back instruction, the process proceeds from step S55 to S56, at which the variable i is decremented by “1”, then the returns to step S52.

[0070] In this manner, when the user finds a video image to be printed, the user instructs printing. In this case, the process proceeds from step S57 to S58, at which the number of dots in the horizontal direction and that in the vertical direction is determined in accordance with the resolution of the currently connected printer, so that image printing is performed based on the currently selected i-th video image data in an appropriate image size (larger than the size of frames in the printed sample image table). The process proceeds to step S59, at which interpolation is performed on the data to have the determined number of dots in the horizontal direction and that in the vertical direction. At step S60, the processed image data is stored into the sample table buffer 10o, and the process ends.

[0071] In the above-described sample table printing, the plurality of video image data are stored into the sample table buffer 10o, however, in case of printing only one frame, only one print data is stored into the sample table buffer 10o.

[0072] Further, in FIG. 7, the video image to be printed is displayed one after another. In a case where a sample image table has been previously printed, each frame has its file name. Therefore it may be arranged such that a list of file names is displayed. In this case, in the flowchart of FIG. 7, instead of displaying one frame video image at a time at step S52, the file name of the i-th file stored in the external storage device 10lcan be displayed. As a result, the display device merely displays numerals and characters, which reducing costs.

[0073] FIG. 5 shows an example of printed sample image table.

[0074] [Second Embodiment]

[0075] In the system of the first embodiment, after a message instructing to generate a sample image table has been received from the user, the sample image table is generated based on image data. However, it may be arranged such that, upon image sensing, data for the sample image table is generated besides the sensed image data. In this system, after reception of the message instructing to generate a sample image table, search is performed on the data for a sample image table, and print data of the sample image table is generated from the image data obtained from the search.

[0076] [Third Embodiment]

[0077] In the above systems, after reception of a message instructing to generate a sample image table, the sample image table is generated based on image data, however, it may be arranged such that once-generated sample-table data is saved as a sample-table file. In this case, the sample image table can be printed by directly designating the sample-table file by name or ID and the like.

[0078] As described above, according to the first to third embodiments, a digital image sensing apparatus can prints a sensed image by directly controlling a printer connected to the image sensing apparatus. Further, it is possible to provide search means which functions similar to a printing environment using a computer machine. This realizes image sensing, searching and print environment utilizing portability as the feature of the image sensing apparatus.

[0079] [Fourth Embodiment]

[0080] In the first to third embodiments, video image data obtained by sensing by the image sensing apparatus is outputted to a printer connected to the image sensing apparatus as an external device, however, the external device is not limited to the printer.

[0081] In the following embodiment, video image data can be outputted to either a printer or a facsimile apparatus. That is, if the image sensing apparatus is connected to a printer, printing is performed similarly to the first embodiment, while if the image sensing apparatus is connected to a facsimile apparatus, video image data is sent to the facsimile apparatus via facsimile transmission.

[0082] FIG. 8 shows the construction of a camera according to a fourth embodiment of the present invention.

[0083] In FIG. 8, an image sensing unit 111, a data holding unit 112, a communication unit 113, and a CPU 116 are connected to each other via a bus 114. The CPU 116 includes a format converter 115 and a format selector 117, for converting the format of image data. The CPU 116 is connected to a command-input unit 118 for inputting various commands from a user of the camera and forwards the commands to the CPU 116.

[0084] FIG. 9 shows the construction of an external device (printer or facsimile apparatus) 121 as an image processing apparatus which receives image data from the camera. In FIG. 9, in addition to an original function 122 of the external device, a device information holder 123 holding device information, (including format information) to be described later, of the external device 121 is provided. A communication unit 124 is an original constituent of the external device 121, but the communication unit 124 is also used for transfer of device information. Also, a CPU 125 is an original constituent of the external device 121.

[0085] FIG. 10 shows a process procedure in the camera. In FIG. 10, description is made on the assumption that image data obtained by sensing by the image sensing unit 111 is stored in the data holding unit 112 (e.g., a memory card and a hard disk).

[0086] At step S1, it is determined whether or not a data-transfer request command has been received from the user of the camera via the command-input unit 118. A data-transfer request command from the user is inputted from the command-input unit 118 and forwarded to the CPU 116. As the data-transfer request command form the user has been inputted, the process proceeds to step S2.

[0087] At step S2, communication is performed with the external device 121 connected to the camera, and device information is obtained from the external device 121. More specifically, the CPU 116 sends a device-information request command via the communication unit 113 and the bus 114 to the external device 121. On the external device 121 side, the CPU 125 receives the device-information request command from the camera via the communication unit 124, and reads device information of the external device 121 and format information on image data format from the device-information holder 123. The CPU 125 transfers the read device information and format information via the communication unit 124 to the camera. FIG. 11 shows an example of device information. In FIG. 11, the device information includes device type data 141, which indicates the type of the external device, e.g., whether it is a printer or a facsimile, model data 142 indicating the model of the external device, format data 143 indicating the format of page description language or image data format, and format data 144 indicating the format of facsimile communication.

[0088] Note that FIG. 11 shows the device information when the external device is a printer. In case of a facsimile apparatus, the device information as shown in FIG. 12 is used.

[0089] That is, the device information in FIG. 12 includes device type data indicating the type of the device, e.g., whether it is a facsimile or a printer, model data indicating the model of the external device, and data format data indicating data format in communication.

[0090] In FIG. 11, it is indicated by the format data 143 and 144 that data to be transferred must be described in page description language LIPS III or LIPS IV. In FIG. 12, it is indicated that data transfer must be performed by using the MH or MR coding.

[0091] At step S3, the device information obtained at step S2 is read into the format selector 117 via the bus 114, and the format of the image data to be transferred is determined. In a case where the external device can process a plurality of formats, the device information obtained at step S2 includes a plurality of format data. Accordingly, an appropriate format is selected from the plurality of format data. The basic format is selected from “image quality” and “transfer speed” by the user in advance. If the device information includes only one format data, that format is employed. In the processing at step S3, if the external device is a printer, it is determined that the image data must be converted to data in printer-processible description language, while if the external device is a facsimile apparatus, it is determined that the image data must be converted to facsimile-processible data.

[0092] At step S4, the image data is converted to the format determined at step S3. More specifically, the image data held in the data holding unit 112 is read via the bus 114 into the format converter 115, and converted into the desired format data. Note that the present embodiment performs the format conversion by software under the control of the CPU 116, however, it may arranged such that the format converter 115 is realized by a hardware, and the format conversion is performed by the hardware.

[0093] At step S5, the image data format-converted at step S4 is outputted to the communication unit 113 via the bus 114, and transferred to the external device via the communication unit 113. When the data transfer has been completed, the completion of data transfer is notified from the communication unit 113 to the CPU 116. Then the CPU 116 displays a message indicating the completion of the data transfer on a display panel (not shown).

[0094] Note that in the present embodiment, a passive device such as a printer or a facsimile apparatus is used as the external device which is an image-data transfer destination, however, by utilizing the fact that the determination of image format is made based on the device information from the external device, an active device such as a PC can be used to designate the desired format, of the device information to be sent to the camera, and the image data in the designated format can be transferred from the camera to the external device. This enables the user to obtain image data obtained by sensing by the camera in the image format designated by the user without considering of the data format of the camera.

[0095] Note that if the external device 121 is a facsimile apparatus, it is required to call a destination apparatus. In the present embodiment, it is assumed that the external device 121 which is a facsimile apparatus makes a call to the destination apparatus first, then after the communication link has been established between the external device 121 and the destination apparatus, data is transmitted to the external device so that the external device can transmit the received and coded data to the destination apparatus. In a case where the facsimile apparatus has an external storage device such as a hard disk, the data can be transferred to the external storage device in advance, and the facsimile apparatus can call the destination apparatus.

[0096] As described above, according to the fourth embodiment, the data format of image data obtained by sensing by the camera can be automatically converted in accordance with the format of the external device. This omits format conversion by using a computer machine such as a PC. Further, as image format that the external device can process can be automatically selected, the user of the camera can perform image sensing without considering the image format of the camera.

[0097] Further, the image processing apparatus (121) of the present invention can request the camera to send image data in the format that the image processing apparatus can process.

[0098] [Fifth Embodiment]

[0099] Next, a fifth embodiment of the present invention will be described.

[0100] FIG. 13 shows the construction of the image-sensing and printing system according to the fifth embodiment. In FIG. 13, numeral 210 denotes an image sensing apparatus; 220, a printer which prints an image based on image data obtained by sensing and processed by the image sensing apparatus 210 on a print sheet; 230, a transmission path connecting the image sensing apparatus 210 with the printer 220.

[0101] In the image sensing apparatus 210, numeral 211 denotes an image sensing unit which image-senses an object; 212, a camera-signal processor which processes a video image signal obtained by sensing by the image sensing unit 211 and outputs video image data; 213, a memory for storing the video image data and storing form data to be described later; and 214, an image processor which converts the video image data in the memory 213 into data in the format indicated by the form data, and generates and outputs print data in format printable by the printer 220. The image processor 214 includes a CPU for controlling the overall image sensing apparatus 210. Numeral 215 denotes an input unit for selecting form data for the image processor 214; 216, a display unit which displays necessary data; and 217, an I/F unit which outputs the print data onto the transmission path 230.

[0102] In the printer 220, numeral 221 denotes an I/F unit which receives the print data via the transmission path 230; and 222, a printing unit which prints an image based on the print data on a print sheet.

[0103] The form data is format data indicating the format for printing a sensed video image based on video image data. The form data includes data on the output position of the sensed video image and data on other decorative information.

[0104] FIG. 17 shows a display example of the form data. In FIG. 17, numerals 300 and 301 respectively denote the decorative information. The data 300 is character-string data; the data 301, line-figure data; and 302, area data indicating an area where the video image is to be inserted. In image printing, the broken line represented by the area data 302 in FIG. 17 is not actually printed.

[0105] In the memory 213, the data indicating the format as described above is stored in a form-data storage area. The form-data storage area has a structure as shown in FIG. 18.

[0106] In the present embodiment, as a plurality of form data are stored, the respective data must be uniquely specified. As shown in FIG. 18, each form data has its form data number (“1”, “2” . . . In FIG. 18) and its format data.

[0107] In FIG. 18, the format data has delimiters 310 to 312 for different formats. The format following one delimiter can be discriminated by examining the delimiter. For example, after the delimiter 310 indicating the format of character-string data, a character-string output position, a font name, and a character-string (one or more character codes) are stored. After the delimiter 311 indicating the format of line-figure data, a line-figure output position and line data are stored.

[0108] Note that besides the form data registered in advance in the memory 213, form data may be generated by a PC, for example, and downloaded via the I/F unit 217 into the memory 213 so as to be registered there.

[0109] In this case, an application program for generating form data is started on the PC. Then, the image sensing apparatus 210 is connected to the PC via the I/F unit 217. The form data received from the PC via the I/F unit 217 is registered into the memory 213.

[0110] The application program which runs on the PC has a function to determine an input character-string, a line figure to be drawn, and an area where a sensed video image is inserted, and generates data in the format as shown in FIG. 18, and has a function to transfer the data to the image sensing apparatus 210. The downloading in this case will be described with reference to FIG. 19.

[0111] Note that the process starts by operating a download switch provided in the input unit 215.

[0112] First, at step S61, a form data number transferred from the PC is received. At step S62, it is determined whether or not form data corresponding to the form data number has been already registered in the memory 213. If YES, i.e., it is determined that the form data is registered, the process proceeds to step S63 at which the data is deleted. Then at step S64, form data is received. At step S65, the received new form data is registered in the form-data storage area in the memory 213.

[0113] Next, print processing utilizing the form data will be described.

[0114] As described above, the form data stored in the memory 213 comprises data indicating the coordinates of area of print data in which video image data is inserted, character and line data other than sensed image data and the like. The video image data inserted into the print data is equal or similar to the original video image data. The memory 213 holds various types of such form data.

[0115] Next, the actual processing will be described with reference to the flowcharts of FIGS. 14 to 16.

[0116] The video image data and form data stored in the memory 213 respectively have a video data identifier and a form data identifier, as identification information, each of which is stored into a storage area of the memory 213 when the data is selected by the user, so that the CPU of the image processor 214 is informed of the data designated by the user when a printing instruction is inputted. Hereinafter, these identifiers will be referred to as “form data number” and “video-image data number”.

[0117] Upon printing, the user first selects form data by using the input unit 215. At this time, the CPU stores a form data number corresponding to the form data into a predetermined storage area of the memory 213 at step S21 in FIG. 14. Similarly, when the user designates video image data by using the input unit 215, the CPU stores a video-image data number corresponding to the video image data into a predetermined storage area of the memory 213 at step S22 in FIG. 15. These operations may be made any number of times, and in any order, before printing. Note that the content of data to be selected can be verified by using the display unit 216 by instructing to display the content from the input unit 215.

[0118] As printing has been instructed from the input unit 215, the CPU reads the form data number and video-image data number designated by the user, currently stored in the storage area. Next, the image processor 214 reads the form data and video data corresponding to the read form data number and video-image data number from the memory 213. Then print data in printer-interpretable form is generated by using the form data and video image data. In this print-data generating processing, image data is generated for a line, from the top to the bottom, temporarily in a print-output buffer area (not shown) of the memory 213. Accordingly it is necessary to determine whether or not an image developed at one-line position is a character (array), a line or a sensed video image. At step S23 in FIG. 16, video-image insertion area data, indicated by the designated form data, is compared with the position at which the print data is currently generated, and it is determined whether or not the current position corresponds with a video-image insertion area. If it is determined that the position is in the video-image insertion area, the process proceeds to step S24, at which the video image data is converted into the printer-interpretable form data, and mapped as print data. At this time, if the size of the video-image insertion area data included by the form data is different from the size of the video image data, the video image data is reduced or enlarged.

[0119] On the other hand, if it is determined at step S23 that the position is not in the video-image insertion area, the process proceeds to step S25, at which the data on character(s) and line(s) included in the form data is mapped as print data. The processing at steps S24 or S25 is repeated until it is determined at step S26 that all the data has been mapped. As the mapping has been completed, the process proceeds to step S27, at which the print data is transferred to the printer 220 via the I/F unit 217, the transmission path 230 and the I/F unit 221. In the printer 220, the printing unit 220 performs printing based on the print data.

[0120] Note that a communication protocol used for transferring the print data to the printer 220 is selected in accordance with the function of the printer 220 connected at that time. This is similar to the first embodiment therefore the explanation of the selection of protocol will be omitted.

[0121] In the above embodiment, it is assumed that the shape of the video image data to be inserted into the print data is equal or similar to the original video image data, however, the shape and the size of the video image data used for printing can be arbitrarily changed.

[0122] In such case, when printing is instructed, the shape of a video image area is calculated based on the video-image insertion area data of the form data. Then a frame having the shape of video image is displayed over the video image data for printing displayed on the display unit 216. The user changes the size and/or position of the frame by using the input unit 215, and instructs execution of printing. Thus, the shape of video image can be arbitrarily changed by mapping the video image data in the area selected at that time similarly to the above embodiment.

[0123] Further, in the above embodiment, the predetermined types of form data are provided on the image sensing apparatus, however, it may be arranged such that the image sensing apparatus has an I/F unit connecting the image sensing apparatus to a computer, and form data are generated on the computer. The generated form data are transferred to the image sensing apparatus via the I/F unit. This avoids limiting types of form data.

[0124] Further, in the above embodiment, after the all the print data has been mapped, the print data is transferred to the printer 220, however, in a case where all the data cannot be processed at once due to limitation on the image sensing apparatus 210 or the printer 220, mapping may be performed by a predetermined amount of data that can be transferred to the printer 220, and the mapping and data transfer may be repeated a plural number of times.

[0125] As described above, according to the present embodiment, the image sensing apparatus contains form data indicating printing format for the printer, so that video image data can be directly transferred to the printer, further, printing can be performed not only using the video image data but also using character data, line data and the like, included in the form data.

[0126] Further, by arranging such that form data, generated by an external device such as a computer, is transferred to the image sensing apparatus, printing in more various formats can be performed.

[0127] The present invention is not limited to the above embodiments and various changes and modifications can be made within the spirit and scope of the present invention. Therefore, to appraise the public of the scope of the present invention, the following claims are made.