Camera system including digital audio message recording on photographs

[0002] The following Australian provisional patent applications are hereby incorporated by cross-reference. For the purposes of location and identification, US patent applications identified by their US patent application serial numbers (USSN) are listed alongside the Australian applications from which the US patent applications claim the right of priority.

[0003] Not applicable.

[0004] The present invention relates to a camera system having an integral sound recording means for recording and outputting a permanent record of sound associated with a photograph. Hence the present invention relates to a Camera System Including Audio Message Recordal Means.

[0005] The present invention also relates to a means for reproducing the recorded sound and discloses a camera system including audio message recordal means.

[0006] The production of images by means of photographic techniques have been well known for a substantial period of time. Further, recently, digital cameras have becoming increasingly popular where an image is captured by the digital camera device and stored for later printing.

[0007] Recently, in Australian provisional patent application PO7991 entitled “Image Processing Method and Apparatus (Art 01)” filed Jul. 15th 1997 with a large number of associated applications, in addition to Australian provisional patent application PO8505 entitled “Image Processing Method and Apparatus (Art 01a)” filed Aug. 11th 1997, again with a number of associated applications, a camera system has been proposed that includes an integral printer device for the printing out of sensed images.

[0008] When using such devices and other image capture devices it will be desirable to be able to suitably deal with audio and other environmental information when taking a picture.

[0009] The present invention relates to a camera system able to record audio when acquiring a sensed image in addition to being able to playback the audio information when viewing a “photograph”.

[0010] In accordance with a first aspect of the present invention, there is provided a camera system comprising a sensor means for sensing an image; a processing means for processing the sensed image in accordance with a predetermined processing requirement, if any; audio recording means for according an audio signal to be associated with the sensed image; printer means for printing the processed sensed image on a first area of a print media supplied with the camera system, in addition to printing an encoded version of the audio signal on a second area of the print media. Preferably the sensed image is printed on a first surface of the print media and the encoded version of the audio signal is printed on a second surface of the print media.

[0011] In accordance with a second aspect of the present invention there is provided a camera system comprising: sensor means for sensing an image; processing means for processing said sensed image in accordance with a predetermined processing requirement, if any; audio recording means for recording an audio signal associated with said sensed image; means for processing said audio signal into a fault tolerant encoded digital version; printer means including at least one page width print head for printing said processed sensed image using an inkjet printing process on a first area of a print media and for printing said fault tolerant encoded digital version of said audio signal on a second area of said print media, as an array of ink dots, said camera system comprising a portable hand held unit for the imaging of scenes by said image sensor means and printing said scenes directly out of said camera system via said printer means.

[0012] According to a third aspect of the invention there is provided a method of recording an audio system associated with a photograph, the method comprising: sensing an input image; printing using an inkjet printing process said input image using a page width print head on a first surface of a print media; recording an associated audio signal, processing said associated audio signal into a fault tolerant encoded digital version and printing said encoded version of said audio signal on a second surface of said print media as an array of ink dots.

[0013] The print media can be supplied in the camera system on a detachable print roll and the printer means includes at least one ink jet printhead for printing the processed sensed image and a second printing head for the encoded version of the audio signal. The encoding can include Reed-Solomon encoding of the audio-signal. The encoded version can be further modulated with a high frequency component such as a checkerboard pattern to assist in sensing of the encoded version.

[0014] Notwithstanding any other forms which may fall within the scope of the present invention, preferred forms of the invention will now be described, by way of example only, with reference to the accompanying drawings in which:

[0015] FIG. 1 illustrates schematically the camera system constructed in accordance to the preferred embodiment;

[0016] FIG. 2 illustrates schematically a printer mechanism for printing on the front and back of output media;

[0017] FIG. 3 illustrates a format of the output data on the back of the photo;

[0018] FIG. 4 illustrates an enlarged portion of the output media;

[0019] FIG. 5 illustrates a reader device utilized to read data from the back of a photograph; and

[0020] FIG. 6 illustrates the utilization of an apparatus of the preferred embodiment.

[0021] The preferred embodiment is preferable implemented through suitable programming of a hand held camera device such as that described in Australian Provisional Patent Application No. PO7991 entitled “Image Processing Method and Apparatus (Art 01)” filed Jul. 15th 1997 with a large number of associated applications in addition to Australian Provisional patent Application No. PO 8505 entitled “Image Processing Method and Apparatus (Art 01a)” filed Aug. 11th 1997, again with a number of associated applications.

[0022] The aforementioned patent specification discloses a camera system, hereinafter known as an “Artcam” type camera, wherein sensed images can be directly printed out by an Artcam portable camera unit. Further, the aforementioned specification discloses means and methods for performing various manipulations on images captured by the camera sensing device leading to the production of various effects in any output image. The manipulations are disclosed to be highly flexible in nature and can be implemented through the insertion into the Artcam of cards having encoded thereon various instructions for the manipulation of images, the cards hereinafter being known as Artcards. The Artcam further has significant onboard processing power by an Artcam Central Processor unit (ACP) which is interconnected to a memory device for the storage of important data and images.

[0023] In the preferred embodiment, the Artcam device is suitably modified so as to equip it with a microphone device and associated recording technologies. When a picture is taken, the opportunity is provided to record either the surrounding sound environment or a message associated with the image. The recorded audio is then printed on the back of the output photograph in an encoded format, the encoding preferably being of a highly resilient form. The recorded audio provides a permanent audio record associated with the corresponding photograph. Subsequently, a playback apparatus is provided for scanning the encoded audio and decoding this information.

[0024] Turning now to FIG. 1, there is illustrated, in schematic form the preferred embodiment 1 which includes the arrangement as described in the aforementioned patent specification wherein an image 2 is sensed via a CCD sensor 3 and forwarded to an Artcam central processor 4 which includes significant computational resources as described in the aforementioned patent specification. The Artcam central processor 4 can store the image in memory 5 which preferably comprises a high speed RAMBUS (Trade Mark) interfaced memory. The Artcam central processor 4 is also responsible for controlling the operation of a printhead 6 for the printing out of full colour photographs, eg. 7, so as to provide for instant images on demand.

[0025] In the preferred embodiment, the camera arrangement 1 is also supplied with a sound chip 10 which interfaces via RAMBUS 11 to memory 5 under the control of the ACP processor 4. The sound chip 10 can be of a standard or specialised form and can, for example, comprise a DSP processor that takes an analogue input 12 from a sound microphone 13. Alternatively, with increasing chip complexities (Moore's Law), the functionality of sound chip 10 can be incorporated onto the ACP chip 4 which preferably comprises a leading edge CMOS type integrated circuit chip. It will be readily evident that many other types of arrangements can be provided which fall within the scope of the present invention.

[0026] The sound chip 10 converts the analogue input 12 to a corresponding digital form and forwards it for storage in memory 5. The recording process can be activated by means of the depressing of a button (not shown) on the camera device, the button being under the control of the ACP processor 4 otherwise it can be substantially automatic when taking a photo. The recorded data is stored in the memory 5.

[0027] Turning now to FIG. 2, the camera arrangement preferably includes a printer device 6 which includes two printheads 15, 16 with the first printhead 15 being utilized to print an image on print media 17 and a second printhead 16 being utilized to print information on the back of print output media 17. Similar arrangements for printing information on the back of an output photo image are described in Australian Provisional Patent Specification PO8031 filed Jul. 15th 1997, entitled “Image Processing Method and Apparatus (Art 12)” the contents of which are hereby incorporated by cross reference.

[0028] Turning now to FIG. 3, there is illustrated an example output on the back of photo media 17, the output being printed by printhead 16 of FIG. 2. The information 20 can include location, date and time data with the location data being provided by means of keyboard input or, alternatively, through the utilization of attached positioning systems such as GPS or the like. The information 20 is presented in a viewable form for a user to maintain a record of the printed image. Importantly, on the back of the image 17 is also printed an encoded form 22 of the audio information. The format of the encoding can be many and various, however, preferably the encoding is provided in a highly fault tolerant manner so as to tolerate scratches, grime, writing, wear, rotation, fading etc. One form of suitable technology is the printing technology utilized in the construction of “Artcards” as described in the aforementioned patent specifications PO7991 and PO8505. The portion of the data 25 is shown in schematic form in FIG. 4 and the data comprises a array of dots as printed by the printhead 16 of FIG. 2. The disclosed methodologies provide for the storage of about 2.5 Megabyte of arbitrary data on the back of a photo which, in this particular instance, can comprise sound data. The encoding format relates heavily upon utilisation of Reed-Solomon encoding of the data to provide for a high degree of fault tolerance. Further, as indicated in FIG. 4, a high frequency “checkerboard” pattern is described as being added to the data so as to assist in sensing of an image. The portion of the data 25 is shown in schematic form in FIG. 4 as the data will comprise a array of dots as printed by the printhead 16 of FIG. 2.

[0029] When it is desired to “play back” the recorded audio, the photo 17 is passed through a reader device 26 which includes pinch rollers for pinch rolling the photo 17 passing a linear CCD sensor device 27. The sensor device 27 can be a suitably adapted sensor device as described in the aforementioned patent specification.

[0030] Referring now to FIG. 6, there is illustrated a schematic form illustrating the operation of the audio reader device 26 of FIG. 5. The linear CCD sensor 27 is interconnected to a second Artcam central processor 28 which is suitably adapted to read and decode the data stored on the back of the photograph. The decoded audio information is stored in memory 32 for playback via a sound processing chip 35 on speaker 29. The sound processing chip 35 can operate under the control of the ACP decoder 28 which in turn operates under the control of various user input controls 33 which can include volume controls, rewind, play and fast forward controls etc. Importantly, the CCD linear sensor 27 and the ACP decoder 28 can implement the reading process as if the information were printed on the back of an Artcard as described in the aforementioned patent specifications.

[0031] It can be seen from the foregoing description of the preferred embodiment that there is provided a system for the automatic recording of audio associated with an output image so as to provide an audio record associated with a photograph. There is also disclosed a audio reader system for reading an image output on the back of a photograph.

[0032] It would be appreciated by a person skilled in the art that numerous variations and/or modifications any be made to the present invention as shown in the specific embodiment without departing from the spirit or scope of the invention as broadly described. For example, the utilisation of more complex audio recording and playback techniques such as stereo and B-format techniques. The present embodiment is, therefore, to be considered in all respects to be illustrative and not restrictive.

[0033] Ink Jet Technologies

[0034] The embodiments of the invention use an ink jet printer type device. Of course many different devices could be used. However presently popular ink jet printing technologies are unlikely to be suitable.

[0035] The most significant problem with thermal ink jet is power consumption. This is approximately 100 times that required for high speed, and stems from the energy-inefficient means of drop ejection. This involves the rapid boiling of water to produce a vapor bubble which expels the ink. Water has a very high heat capacity, and must be superheated in thermal ink jet applications. This leads to an efficiency of around 0.02%, from electricity input to drop momentum (and increased surface area) out.

[0036] The most significant problem with piezoelectric ink jet is size and cost. Piezoelectric crystals have a very small deflection at reasonable drive voltages, and therefore require a large area for each nozzle. Also, each piezoelectric actuator must be connected to its drive circuit on a separate substrate. This is not a significant problem at the current limit of around 300 nozzles per printhead, but is a major impediment to the fabrication of pagewidth printheads with 19,200 nozzles.

[0037] Ideally, the ink jet technologies used meet the stringent requirements of in-camera digital color printing and other high quality, high speed, low cost printing applications. To meet the requirements of digital photography, new ink jet technologies have been created. The target features include:

[0038] low power (less than 10 Watts)

[0039] high resolution capability (1,600 dpi or more)

[0040] photographic quality output

[0041] low manufacturing cost

[0042] small size (pagewidth times minimum cross section)

[0043] high speed (<2 seconds per page).

[0044] All of these features can be met or exceeded by the ink jet systems described below with differing levels of difficulty. Forty-five different ink jet technologies have been developed by the Assignee to give a wide range of choices for high volume manufacture. These technologies form part of separate applications assigned to the present Assignee as set out in the list under the heading Cross References to Related Applications.

[0045] The ink jet designs shown here are suitable for a wide range of digital printing systems, from battery powered one-time use digital cameras, through to desktop and network printers, and through to commercial printing systems

[0046] For ease of manufacture using standard process equipment, the printhead is designed to be a monolithic 0.5 micron CMOS chip with MEMS post processing. For color photographic applications, the printhead is 100 mm long, with a width which depends upon the ink jet type. The smallest printhead designed is covered in U.S. patent application Ser. No. 09/112,764, which is 0.35 mm wide, giving a chip area of 35 square mm. The printheads each contain 19,200 nozzles plus data and control circuitry.

[0047] Ink is supplied to the back of the printhead by injection molded plastic ink channels. The molding requires 50 micron features, which can be created using a lithographically micromachined insert in a standard injection molding tool. Ink flows through holes etched through the wafer to the nozzle chambers fabricated on the front surface of the wafer. The printhead is connected to the camera circuitry by tape automated bonding.

[0048] Tables of Drop-on-Demand Ink Jets

[0049] The present invention is useful in the field of digital printing, in particular, ink jet printing. A number of patent applications in this field were filed simultaneously and incorporated by cross reference.

[0050] Eleven important characteristics of the fundamental operation of individual ink jet nozzles have been identified. These characteristics are largely orthogonal, and so can be elucidated as an eleven dimensional matrix. Most of the eleven axes of this matrix include entries developed by the present assignee.

[0051] The following tables form the axes of an eleven dimensional table of ink jet types.

[0052] Actuator mechanism (18 types)

[0053] Basic operation mode (7 types)

[0054] Auxiliary mechanism (8 types)

[0055] Actuator amplification or modification method (17 types)

[0056] Actuator motion (19 types)

[0057] Nozzle refill method (4 types)

[0058] Method of restricting back-flow through inlet (10 types)

[0059] Nozzle clearing method (9 types)

[0060] Nozzle plate construction (9 types)

[0061] Drop ejection direction (5 types)

[0062] Ink type (7 types)

[0063] The complete eleven dimensional table represented by these axes contains 36.9 billion possible configurations of ink jet nozzle. While not all of the possible combinations result in a viable ink jet technology, many million configurations are viable. It is clearly impractical to elucidate all of the possible configurations. Instead, certain ink jet types have been investigated in detail. Forty-five such inkjet types were filed simultaneously to the present application.

[0064] Other ink jet configurations can readily be derived from these forty-five examples by substituting alternative configurations along one or more of the 11 axes. Most of the forty-five examples can be made into ink jet printheads with characteristics superior to any currently available ink jet technology.

[0065] Where there are prior art examples known to the inventor, one or more of these examples are listed in the examples column of the tables below. The simultaneously filed patent applications by the present applicant are listed by USSN numbers. In some cases, a print technology may be listed more than once in a table, where it shares characteristics with more than one entry.

[0066] Suitable applications for the ink jet technologies include: Home printers, Office network printers, Short run digital printers, Commercial print systems, Fabric printers, Pocket printers, Internet WWW printers, Video printers, Medical imaging, Wide format printers, Notebook PC printers, Fax machines, Industrial printing systems, Photocopiers, Photographic minilabs etc.

[0067] The information associated with the aforementioned 11 dimensional matrix are set out in the following tables.