Integrated camera circuit including image sensor, image processing, and printer drive circuits

[0002] The present relates substantially to the concept of a disposable camera having instant printing capabilities and in particular, discloses An Integrated Camera Circuit including Sensor and Drive Transistors.

[0003] The following Australian provisional patent applications are hereby incorporated by cross-reference. For the purposes of location and identification, US patent applications, identified by their US patent application serial numbers (USSN) are listed alongside the Australian applications from which the US patent applications claim the right of priority.

[0004] Recently, the concept of a “single use” disposable camera has become an increasingly popular consumer item. Disposable camera systems presently on the market normally include an internal film roll and a simplified gearing mechanism for traversing the film roll across an imaging system including a shutter and lensing system. The user, after utilising a single film roll returns the camera system to a film development centre for processing. The film roll is taken out of the camera system and processed and the prints returned to the user. The camera system is then able to be re-manufactured through the insertion of a new film roll into the camera system, the replacement of any worn or wearable parts and the re-packaging of the camera system in accordance with requirements. In this way, the concept of a single use “disposable” camera is provided to the consumer.

[0005] Recently, a camera system has been proposed by the present applicant which provides for a handheld camera device having an internal print head, image sensor and processing means such that images sense by the image sensing means, are processed by the processing means and adapted to be instantly printed out by the printing means on demand. The proposed camera system further discloses a system of internal “print rolls” carrying print media such as film on to which images are to be printed in addition to ink to supplying the printing means for the printing process. The print roll is further disclosed to be detachable and replaceable within the camera system.

[0006] Unfortunately, such a system is likely to only be constructed at a substantial cost and it would be desirable to provide for a more inexpensive form of instant camera system which maintains a substantial number of the quality aspects of the aformentioned arrangement.

[0007] In particular, in any “disposable camera” it would be desirable to provide for a simple and rapid form of replenishment of the consumable portions in any disposable camera so that the disposable camera can be readily and rapidly serviced by replenishment and return to the market place.

[0008] It would be desirable to provide for an extremely low cost camera system having as great quality as possible. In this respect, the camera system, as previously proposed should include mechanisms for sensing and processing sensed images in addition to mechanisms for printing out the images on print media via a printhead system. It would be further desirable to provide for a system having a convenient and compact arrangement of components such that they can be inexpensively manufactured in an inexpensive manner so as to allow for the readily disposable form of printing.

[0009] It is an object of the present invention to provide for the efficient and effective operation of a print on demand camera system.

[0010] In accordance with a first aspect of the present invention, there is provided a camera system comprising an image sensor and processing device for sensing and processing an image; a print media supply means provided for the storage of print media; a print head for printing the sensed image on print media stored internally to the camera system; the image sensor and processing device comprising a single integrated circuit chip including the following interconnected components: a processing unit for controlling the operation of the camera system; a program ROM utilized by the processing unit; a CMOS active pixel image sensor for sensing the image; a memory store for storing images and associated program data; a series of motor drive units each including motor drive transistors for the driving of external mechanical system of the camera system; and print head interface unit for driving the print head for printing of the sensed image.

[0011] Preferably, the motor drive transistors are located along one peripheral edge of the integrated circuit and the CMOS pixel image sensor is located along an opposite edge of the integrated circuit.

[0012] Preferably, the image sensor and processing device further include a halftoning unit for halftoning the sensed image into corresponding bi-level pixel elements for printing out by the print head. The halftoning unit can implement a dither operation and includes a halftone matrix ROM utilized by the halftoning unit in performing the halftoning operation.

[0013] Notwithstanding any other forms which may fall within the scope of the present invention, preferred forms of the invention will now be described, by way of example only, with reference to the accompanying drawings in which:

[0014] FIG. 1 illustrated a side front perspective view of the assembled camera of the preferred embodiment;

[0015] FIG. 2 illustrates a back side perspective view, partly exploded, of the preferred embodiment;

[0016] FIG. 3 is a side perspective view of the chassis of the preferred embodiment;

[0017] FIG. 4 is a side perspective view of the chassis illustrating the insertion of the electric motors;

[0018] FIG. 5 is an exploded perspective of the ink supply mechanism of the preferred embodiment;

[0019] FIG. 6 is a side perspective of the assembled form of the ink supply mechanism of the preferred embodiment;

[0020] FIG. 7 is a front perspective view of the assembled form of the ink supply mechanism of the preferred embodiment;

[0021] FIG. 8 is an exploded perspective of the platten unit of the preferred embodiment;

[0022] FIG. 9 is a side perspective view of the assembled form of the platten unit;

[0023] FIG. 10 is also a perspective view of the assembled form of the platten unit;

[0024] FIG. 11 is an exploded perspective unit of the printhead recapping mechanism of the preferred embodiment;

[0025] FIG. 12 is a close up exploded perspective of the recapping mechanism of the preferred embodiment;

[0026] FIG. 13 is an exploded perspective of the ink supply cartridge of the preferred embodiment;

[0027] FIG. 14 is a close up perspective, partly in section of the internal portions of the ink supply cartridge in an assembled form;

[0028] FIG. 15 is a schematic block diagram of one form of chip layer of the image capture and processing chip of the preferred embodiment;

[0029] FIG. 16 is an exploded perspective illustrating the assembly process of the preferred embodiment;

[0030] FIG. 17 illustrates a front exploded perspective view of the assembly process of the preferred embodiment;

[0031] FIG. 18 illustrates a side perspective view of the assembly process of the preferred embodiment;

[0032] FIG. 19 illustrates a side perspective view of the assembly process of the preferred embodiment;

[0033] FIG. 20 is a perspective view illustrating the insertion of the platten unit in the preferred embodiment;

[0034] FIG. 21 illustrates the interconnection of the electrical components of the preferred embodiment;

[0035] FIG. 22 illustrates the process of assembling the preferred embodiment; and

[0036] FIG. 23 is a perspective view further illustrating the assembly process of the preferred embodiment.

[0037] Turning initially simultaneously to FIG. 1, and FIG. 2 there is illustrated perspective views of an assembled camera constructed in accordance with the preferred embodiment with FIG. 1 showing a front side perspective view and FIG. 2 showing a back side perspective view. The camera 1 includes a paper or plastic film jacket 2 which can include simplified instructions 3 for the operation of the camera system 1. The camera system 1 includes a first “take” button 4 which is depressed to capture an image. The captured image is output via output slot 6. A further copy of the image can be obtained through depressing a second “printer copy” button 7 whilst an LED light 5 is illuminated. The camera system also provides the usual view finder 8 in addition to a CCD image capture/lensing system 9.

[0038] The camera system 1 provides for a standard number of output prints after which the camera system 1 ceases to function. A prints left indicator slot 10 is provided to indicate the number of remaining prints. A refund scheme at the point of purchase is assumed to be operational for the return of used camera systems for recycling.

[0039] Turning now to FIG. 3, the assembly of the camera system is based around an internal chassis 12 which can be a plastic injection molded part. A pair of paper pinch rollers 28, 29 utilized for decurling are snap fitted into corresponding frame holes eg. 26, 27.

[0040] As shown in FIG. 4, the chassis 12 includes a series of mutually opposed prongs eg. 13, 14 into which is snapped fitted a series of electric motors 16, 17. The electric motors 16, 17 can be entirely standard with the motor 16 being of a stepper motor type and include a cogged end portion 19, 20 for driving a series of gear wells. A first set of gear wells is provided for controlling a paper cutter mechanism and a second set is provided for controlling print roll movement.

[0041] Turning next to FIGS. 5 to 7, there is illustrated an ink supply mechanism 40 utilized in the camera system. FIG. 5 illustrates a back exploded perspective view, FIG. 6 illustrates a back assembled view and FIG. 7 illustrates a front assembled view. The ink supply mechanism 40 is based around an ink supply cartridge 42 which contains printer ink and a print head mechanism for printing out pictures on demand. The ink supply cartridge 42 includes a side aluminium strip 43 which is provided as a shear strip to assist in cutting images from a paper roll.

[0042] A dial mechanism 44 is provided for indicating the number of “prints left”. The dial mechanism 44 is snap fitted through a corresponding mating portion 46 so as to be freely rotatable.

[0043] As shown in FIG. 6, the print head includes a flexible PCB strip 47 which interconnects with the print head and provides for control of the print head. The interconnection between the Flex PCB strip and an image sensor and print head chip can be via Tape Automated Bonding (TAB) Strips 51, 58. A moulded aspherical lens and aperture shim 50 (FIG. 5) is also provided for imaging an image onto the surface of the image sensor chip normally located within cavity 53 and a light box module or hood 52 is provided for snap fitting over the cavity 53 so as to provide for proper light control. A series of decoupling capacitors eg. 34 can also be provided. Further a plug 45 (FIG. 7) is provided for re-plugging ink holes after refilling. A series of guide prongs eg. 55-57 are further provided for guiding the flexible PCB strip 47.

[0044] The ink supply mechanism 40 interacts with a platten unit which guides print media under a printhead located in the ink supply mechanism. FIG. 8 shows an exploded view of the platten unit 60, while FIGS. 9 and 10 show assembled views of the platten unit. The platten unit 60 includes a first pinch roller 61 which is snap fitted to one side of a platten base 62. Attached to a second side of the platten base 62 is a cutting mechanism 63 which traverses the platten by means of a rod 64 having a screwed thread which is rotated by means of cogged wheel 65 which is also fitted to the platten 62. The screwed thread engages a block 67 which includes a cutting wheel 68 fastened via a fastener 69. Also mounted to the block 67 is a counter actuator which includes a prong 71. The prong 71 acts to rotate the dial mechanism 44 of FIG. 6 upon the return traversal of the cutting wheel. As shown previously in FIG. 6, the dial mechanism 44 includes a cogged surface which interacts with pawl lever 73, thereby maintaining a count of the number of photographs taken on the surface of dial mechanism 44. The cutting mechanism 63 is inserted into the platten base 62 by means of a snap fit via receptacle eg. 74.

[0045] The platten 62 includes an internal recapping mechanism 80 for recapping the print head when not in use. The recapping mechanism 80 includes a sponge portion 81 and is operated via a solenoid coil so as to provide for recapping of the print head. In the preferred embodiment, there is provided an inexpensive form of printhead re-capping mechanism provided for incorporation into a handheld camera system so as to provide for printhead re-capping of an inkjet printhead.

[0046] FIG. 11 illustrates an exploded view of the recapping mechanism whilst FIG. 12 illustrates a close up of the end portion thereof. The re-capping mechanism 90 is structured around a solenoid including a 16 turn coil 75 which can comprise insulated wire. The coil 75 is turned around a first stationery solenoid arm 76 which is mounted on a bottom surface of the pattern 62(FIG. 8) and includes a post portion 77 to magnify effectiveness of operation. The arm 76 can comprise a ferrous material.

[0047] A second moveable arm of the solenoid actuator is also provided 78. The arm 78 being moveable and also made of ferrous material. Mounted on the arm is a sponge portion surrounded by an elastomer strip 79. The elastomer strip 79 is of a generally arcuate cross-section and act as a leaf springs against the surface of the printhead ink supply cartridge 42 (FIG. 5) so as to provide for a seal against the surface of the printhead ink supply cartridge 42. In the quiescent position a elastomer spring units 87, 88 act to resiliently deform the elastomer seal 79 against the surface of the ink supply unit 42.

[0048] When it is desired to operate the printhead unit, upon the insertion of paper, the solenoid coil 75 is activated so as to cause the arm 78 to move down to be adjacent to the end plate 76. The arm 78 is held against end plate 76 while the printhead is printing by means of a small “keeper current” in coil 77. Simulation results indicate that the keeper current can be significantly less than the actuation current. Subsequently, after photo printing, the paper is guillotined by the cutting mechanism 63 of FIG. 8 acting against Aluminium Strip 43 of FIG. 5, and rewound so as to clear the area of the re-capping mechanism 88. Subsequently, the current is turned off and springs 87, 88 return the arm 78 so that the elastomer seal is again resting against the printhead ink supply cartridge.

[0049] It can be seen that the preferred embodiment provides for a simple and inexpensive means of re-capping a printhead through the utilisation of a solenoid type device having a long rectangular form. Further, the preferred embodiment utilises minimal power in that currents are only required whilst the device is operational and additionally, only a low keeper current is required whilst the printhead is printing.

[0050] Turning next to FIGS. 13 and 14, FIG. 13 illustrates an exploded perspective of the ink supply cartridge 42 whilst FIG. 14 illustrates a close up sectional view of a bottom of the ink supply cartridge with the printhead unit in place. The ink supply cartridge 42 is based around a page width printhead 102 which comprises a long slither of silicon having a series of holes etched on the back surface for the supply of ink to a front surface of the silicon wafer for subsequent ejection via a micro electro mechanical system. The form of ejection can be many different forms such as those set out in the tables below.

[0051] Of course, many other inkjet technologies, as referred to the attached tables below, can also be utilised when constructing a printhead unit 102. The fundamental requirement of the ink supply cartridge 42 being the supply of ink to a series of colour channels etched through the back surface of the printhead 102. In the description of the preferred embodiment, it is assumed that a three colour printing process is to be utilised so as to provide full colour picture output. Hence, the print supply unit 42 includes three ink supply reservoirs being a cyan reservoir 104, a magenta reservoir 105 and a yellow reservoir 106. Each of these reservoirs is required to store ink and includes a corresponding sponge type material 107-109 which assists in stabilising ink within the corresponding ink channel and therefore preventing the ink from sloshing back and forth when the printhead is utilised in a handheld camera system. The reservoirs 104, 105, 106 are formed through the mating of first exterior plastic piece 110 mating with a second base piece) 111.

[0052] At a first end of the base piece 11 includes a series of air inlet 113-115. The air inlet leads to a corresponding winding channel which is hydrophobically treated so as to act as an ink repellent and therefore repel any ink that may flow along the air inlet channel. The air inlet channel further takes a convoluted path further assisting in resisting any ink flow out of the chambers 104-106. An adhesive tape portion 117 is provided for sealing the channels within end portion 118.

[0053] At the top end, there is included a series of refill holes for refilling corresponding ink supply chambers 104, 105, 106. A plug 121 is provided for sealing the refill holes.

[0054] Turning now to FIG. 14, there is illustrated a close up perspective view, partly in section through the ink supply cartridge 42 of FIG. 13 when formed as a unit. The ink supply cartridge includes the three colour ink reservoirs 104, 105, 106 which supply ink to different portions of the back surface of printhead 102 which includes a series of apertures 128 defined therein for carriage of the ink to the front surface.

[0055] The ink supply unit includes two guide walls 124, 125 which separate the various ink chambers and are tapered into an end portion abutting the surface of the printhead 102. The guide walls are further mechanically supported and regular spaces by a block portions eg. 126 which are placed at regular intervals along the length of the printhead supply unit. The block portions 126 leaving space at portions close to the back of printhead 102 for the flow of ink around the back surface thereof.

[0056] The printhead supply unit is preferably formed from a multi-part plastic injection mould and the mould pieces eg. 10, 11 (FIG. 1) snap together around the sponge pieces 107, 109. Subsequently, a syringe type device can be inserted in the ink refill holes and the ink reservoirs filled with ink with the air flowing out of the air outlets 113-115. Subsequently, the adhesive tape portion 117 and plug 121 are attached and the printhead tested for operation capabilities. Subsequently, the ink supply cartridge 42 can be readily removed for refilling by means of removing the ink supply cartridge, performing a washing cycle, and then utilising the holes for the insertion of a refill syringe filled with ink for refilling the ink chamber before returning the ink supply cartridge 42 to a camera.

[0057] Turning now to FIG. 15, there is shown an example layout of the Image Capture and Processing Chip (ICP) 48. The Image Capture and Processing Chip 48 provides most of the electronic functionality of the camera with the exception of the print head chip. The chip 48 is a highly integrated system. It combines CMOS image sensing, analog to digital conversion, digital image processing, DRAM storage, ROM, and miscellaneous control functions in a single chip.

[0058] The chip is estimated to be around 32 mm²using a leading edge 0.18 micron CMOS/DRAM/APS process. The chip size and cost can scale somewhat with Moore's law, but is dominated by a CMOS active pixel sensor array 201, so scaling is limited as the sensor pixels approach the diffraction limit.

[0059] The ICP 48 includes CMOS logic, a CMOS image sensor, DRAM, and analog circuitry. A very small amount of flash memory or other non-volatile memory is also preferably included for protection against reverse engineering.

[0060] Alternatively, the ICP can readily be divided into two chips: one for the CMOS imaging array, and the other for the remaining circuitry. The cost of this two chip solution should not be significantly different than the single chip ICP, as the extra cost of packaging and bond-pad area is somewhat cancelled by the reduced total wafer area requiring the color filter fabrication steps.

[0061] The ICP preferably contains the following functions:

[0062] The CPU, DRAM, Image sensor, ROM, Flash memory, Parallel interface, JTAG interface and ADC can be vendor supplied cores. The ICP is intended to run on 1.5V to minimize power consumption and allow convenient operation from two AA type battery cells.

[0063] FIG. 15 illustrates a layout of the ICP 48. The ICP 48 is dominated by the imaging array 201, which consumes around 80% of the chip area. The imaging array is a CMOS 4 transistor active pixel design with a resolution of 1,500×1,000. The array can be divided into the conventional configuration, with two green pixels, one red pixel, and one blue pixel in each pixel group. There are 750×500 pixel groups in the imaging array.

[0064] The latest advances in the field of image sensing and CMOS image sensing in particular can be found in the October, 1997 issue of IEEE Transactions on Electron Devices and, in particular, pages 1689 to 1968. Further, a specific implementation similar to that disclosed in the present application is disclosed in Wong et. al, “CMOS Active Pixel Image Sensors Fabricated Using a 1.8V, 0.25 μm CMOS Technology”, IEDM 1996, page 915.

[0065] The imaging array uses a 4 transistor active pixel design of a standard configuration. To minimize chip area and therefore cost, the image sensor pixels should be as small as feasible with the technology available. With a four transistor cell, the typical pixel size scales as 20 times the lithographic feature size. This allows a minimum pixel area of around 3.6 μm×3.6 μm. However, the photosite must be substantially above the diffraction limit of the lens. It is also advantageous to have a square photosite, to maximize the margin over the diffraction limit in both horizontal and vertical directions. In this case, the photosite can be specified as 2.5 μm×2.5 μm. The photosite can be a photogate, pinned photodiode, charge modulation device, or other sensor.

[0066] The four transistors are packed as an ‘L’ shape, rather than a rectangular region, to allow both the pixel and the photosite to be square. This reduces the transistor packing density slightly, increasing pixel size. However, the advantage in avoiding the diffraction limit is greater than the small decrease in packing density.

[0067] The transistors also have a gate length which is longer than the minimum for the process technology. These have been increased from a drawn length of 0.18 micron to a drawn length of 0.36 micron. This is to improve the transistor matching by making the variations in gate length represent a smaller proportion of the total gate length.

[0068] The extra gate length, and the ‘L’ shaped packing, mean that the transistors use more area than the minimum for the technology. Normally, around 8 μm²would be required for rectangular packing. Preferably, 9.75 μm²has been allowed for the transistors.

[0069] The total area for each pixel is 16 μm², resulting from a pixel size of 4 μm×4 μm. With a resolution of 1,500×1,000, the area of the imaging array 101 is 6,000 μm×4,000 μm, or 24 μmm².

[0070] The presence of a color image sensor on the chip affects the process required in two major ways:

[0071] The CMOS fabrication process should be optimized to minimize dark current

[0072] Color filters are required. These can be fabricated using dyed photosensitive polyimides, resulting in an added process complexity of three spin coatings, three photolithographic steps, three development steps, and three hardbakes.

[0073] There are 15,000 analog signal processors (ASPs) 205, one for each of the columns of the sensor. The ASPs amplify the signal, provide a dark current reference, sample and hold the signal, and suppress the fixed pattern noise (FPN).

[0074] There are 375 analog to digital converters 206, one for each four columns of the sensor array. These may be delta-sigma or successive approximation type ADC's. A row of low column ADC's are used to reduce the conversion speed required, and the amount of analog signal degradation incurred before the signal is converted to digital. This also eliminates the hot spot (affecting local dark current) and the substrate coupled noise that would occur if a single high speed ADC was used. Each ADC also has two four bit DAC's which trim the offset and scale of the ADC to further reduce FPN variations between columns. These DAC's are controlled by data stored in flash memory during chip testing.

[0075] The column select logic 204 is a 1:1500 decoder which enables the appropriate digital output of the ADCs onto the output bus. As each ADC is shared by four columns, the least significant two bits of the row select control 4 input analog multiplexors.

[0076] A row decoder 207 is a 1:1000 decoder which enables the appropriate row of the active pixel sensor array. This selects which of the 1000 rows of the imaging array is connected to analog signal processors. As the rows are always accessed in sequence, the row select logic can be implemented as a shift register.

[0077] An auto exposure system 208 adjusts the reference voltage of the ADC 205 in response to the maximum intensity sensed during the previous frame period. Data from the green pixels is passed through a digital peak detector. The peak value of the image frame period before capture (the reference frame) is provided to a digital to analogue converter(DAC), which generates the global reference voltage for the column ADCs. The peak detector is reset at the beginning of the reference frame. The minimum and maximum values of the three RGB color components are also collected for color correction.

[0078] The second largest section of the chip is consumed by a DRAM 210 used to hold the image. To store the 1,500×1,000 image from the sensor without compression, 1.5 Mbytes of DRAM 210 are required. This equals 12 Mbits, or slightly less than 5% of a 256 Mbit DRAM. The DRAM technology assumed is of the 256 Mbit generation implemented using 0.18 μm CMOS.

[0079] Using a standard 8F cell, the area taken by the memory array is 3.11 mm². When row decoders, column sensors, redundancy, and other factors are taken into account, the DRAM requires around 4 μm².

[0080] This DRAM 210 can be mostly eliminated if analog storage of the image signal can be accurately maintained in the CMOS imaging array for the two seconds required to print the photo. However, digital storage of the image is preferable as it is maintained without degradation, is insensitive to noise, and allows copies of the photo to be printed considerably later.

[0081] A DRAM address generator 211 provides the write and read addresses to the DRAM 210. Under normal operation, the write address is determined by the order of the data read from the CMOS image sensor 201. This will typically be a simple raster format. However, the data can be read from the sensor 201 in any order, if matching write addresses to the DRAM are generated. The read order from the DRAM 210 will normally simply match the requirements of a color interpolator and the print head. As the cyan, magenta, and yellow rows of the print head are necessarily offset by a few pixels to allow space for nozzle actuators, the colors are not read from the DRAM simultaneously. However, there is plenty of time to read all of the data from the DRAM many times during the printing process. This capability is used to eliminate the need for FIFOs in the print head interface, thereby saving chip area. All three RGB image components can be read from the DRAM each time color data is required. This allows a color space converter to provide a more sophisticated conversion than a simple linear RGB to CMY conversion.

[0082] Also, to allow two dimensional filtering of the image data without requiring line buffers, data is retread from the DRAM array.

[0083] The address generator may also implement image effects in certain models of camera. For example, passport photos are generated by a manipulation of the read addresses to the DRAM. Also, image framing effects (where the central image is reduced), image warps, and kaleidoscopic effects can all be generated by manipulating the read addresses of the DRAM.

[0084] While the address generator 211 may be implemented with substantial complexity if effects are built into the standard chip, the chip area required for the address generator is small, as it consists only of address counters and a moderate amount of random logic.

[0085] A color interpolator 214 converts the interleaved pattern of red, 2×green, and blue pixels into RGB pixels. It consists of three 8 bit adders and associated registers. The divisions are by either 2 (for green) or 4 (for red and blue) so they can be implemented as fixed shifts in the output connections of the adders.

[0086] A convolver 215 is provided as a sharpening filter which applies a small convolution kernel (5×5) to the red, green, and blue planes of the image. The convolution kernel for the green plane is different from that of the red and blue planes, as green has twice as many samples. The sharpening filter has five functions:

[0087] To improve the color interpolation from the linear interpolation provided by the color interpolator, to a close approximation of a sinc interpolation.

[0088] To compensate for the image ‘softening’ which occurs during digitization.

[0089] To adjust the image sharpness to match average consumer preferences, which are typically for the image to be slightly sharper than reality. As the single use camera is intended as a consumer product, and not a professional photographic products, the processing can match the most popular settings, rather than the most accurate.

[0090] To suppress the sharpening of high frequency (individual pixel) noise. The function is similar to the ‘unsharp mask’ process.

[0091] To antialias Image Warping.

[0092] These functions are all combined into a single convolution matrix. As the pixel rate is low (less than 1 Mpixel per second) the total number of multiplies required for the three color channels is 56 million multiplies per second. This can be provided by a single multiplier. Fifty bytes of coefficient ROM are also required.

[0093] A color ALU 113 combines the functions of color compensation and color space conversion into the one matrix multiplication, which is applied to every pixel of the frame. As with sharpening, the color correction should match the most popular settings, rather than the most accurate.

[0094] A color compensation circuit of the color ALU provides compensation for the lighting of the photo. The vast majority of photographs are substantially improved by a simple color compensation, which independently normalizes the contrast and brightness of the three color components.

[0095] A color look-up table (CLUT) 212 is provided for each color component. These are three separate 256×8 SRAMs, requiring a total of 6,144 bits. The CLUTs are used as part of the color correction process. They are also used for color special effects, such as stochastically selected “wild color” effects.

[0096] A color space conversion system of the color ALU converts from the RGB color space of the image sensor to the CMY color space of the printer. The simplest conversion is a 1's complement of the RGB data. However, this simple conversion assumes perfect linearity of both color spaces, and perfect dye spectra for both the color filters of the image sensor, and the ink dyes. At the other extreme is a tri-linear interpolation of a sampled three dimensional arbitrary transform table. This can effectively match any non-linearity or differences in either color space. Such a system is usually necessary to obtain good color space conversion when the print engine is a color electrophotographic.

[0097] However, since the non-linearity of a halftoned ink jet output is very small, a simpler system can be used. A simple matrix multiply can provide excellent results. This requires nine multiplies and six additions per contone pixel. However, since the contone pixel rate is low (less than 1 Mpixel/sec) these operations can share a single multiplier and adder. The multiplier and adder are used in a color ALU which is shared with the color compensation function.

[0098] Digital halftoning can performed as a dispersed dot ordered dither using a stochastic optimized dither cell. A halftone matrix ROM 116 is provided for storing dither cell coefficients. A dither cell size of 32×32 is adequate to ensure that the cell repeat cycle is not visible. The three colors—cyan, magenta, and yellow—are all dithered using the same cell, to ensure maximum co-positioning of the ink dots. This minimizes ‘muddying’ of the mid-tones which results from bleed of dyes from one dot to adjacent dots while still wet. The total ROM size required is 1 KByte, as the one ROM is shared by the halftoning units for each of the three colors.

[0099] The digital halftoning used is dispersed dot ordered dither with stochastic optimized dither matrix. While dithering does not produce an image quite as ‘sharp’ as error diffusion, it does produce a more accurate image with fewer artifacts. The image sharpening produced by error diffusion is artificial, and less controllable and accurate than ‘unsharp mask’ filtering performed in the contone domain. The high print resolution (1,600 dpi×1,600 dpi) results in excellent quality when using a well formed stochastic dither matrix.

[0100] Digital halftoning is performed by a digital halftoning unit 217 using a simple comparison between the contone information from the DRAM 210 and the contents of the dither matrix 216. During the halftone process, the resolution of the image is changed from the 250 dpi of the captured contone image to the 1,600 dpi of the printed image. Each contone pixel is converted to an average of 40.96 halftone dots.

[0101] The ICP incorporates an 16 bit microcontroller CPU core 219 to run the miscellaneous camera functions, such as reading the buttons, controlling the motor and solenoids, setting up the hardware, and authenticating the refill station. The processing power required by the CPU is very modest, and a wide variety of processor cores can be used. As the entire CPU program is run from a small ROM 220. Program compatibility between camera versions is not important, as no external programs are run. A 2 Mbit (256 Kbyte) program and data ROM 220 is included on chip. Most of this ROM space is allocated to data for outline graphics and fonts for specialty cameras. The program requirements are minor. The single most complex task is the encrypted authentication of the refill station. The ROM requires a single transistor per bit.

[0102] A Flash memory 221 may be used to store a 128 bit authentication code. This provides higher security than storage of the authentication code in ROM, as reverse engineering can be made essentially impossible. The Flash memory is completely covered by third level metal, making the data impossible to extract using scanning probe microscopes or electron beams. The authentication code is stored in the chip when manufactured. At least two other Flash bits are required for the authentication process: a bit which locks out reprogramming of the authentication code, and a bit which indicates that the camera has been refilled by an authenticated refill station. The flash memory can also be used to store FPN correction data for the imaging array. Additionally, a phase locked loop resealing parameter is stored is provided for scaling the clocking cycle to an appropriate correct time. The clock frequency does not require crystal accuracy since no date functions are provided. To eliminate the cost of a crystal, an on chip oscillator with a phase locked loop 124 is used. As the frequency of an on-chip oscillator is highly variable from chip to chip, the frequency ratio of the oscillator to the PLL is digitally trimmed during initial testing. The value is stored in Flash memory 121. This allows the clock PLL to control the ink-jet heater pulse width with sufficient accuracy.

[0103] A scratchpad SRAM is a small static RAM 222 with a 6T cell. The scratchpad provided temporary memory for the 16 bit CPU. 1024 bytes is adequate.

[0104] A print head interface 223 formats the data correctly for the print head. The print head interface also provides all of the timing signals required by the print head. These timing signals may vary depending upon temperature, the number of dots printed simultaneously, the print medium in the print roll, and the dye density of the ink in the print roll.

[0105] The following is a table of external connections to the print head interface:

[0106] The print head utilized is composed of eight identical segments, each 1.25 cm long. There is no connection between the segments on the print head chip. Any connections required are made in the external TAB bonding film, which is double sided. The division into eight identical segments is to simplify lithography using wafer steppers. The segment width of 1.25 cm fits easily into a stepper field. As the print head chip is long and narrow (10 cm×0.3 mm), the stepper field contains a single segment of 32 print head chips. The stepper field is therefore 1.25 cm×1.6 cm. An average of four complete print heads are patterned in each wafer step.

[0107] A single BitClock output line connects to all 8 segments on the print head. The 8 DataBits lines lead one to each segment, and are clocked in to the 8 segments on the print head simultaneously (on a BitClock pulse). For example, dot 0 is transferred to segments₀, dot 750 is transferred to segment₁, dot 1500 to segment₂etc simultaneously.

[0108] The ParallelXferClock is connected to each of the 8 segments on the print head, so that on a single pulse, all segments transfer their bits at the same time.

[0109] The NozzleSelect, BankEnable and ColorEnable lines are connected to each of the 8 segments, allowing the print head interface to independently control the duration of the cyan, magenta, and yellow nozzle energizing pulses. Registers in the Print Head Interface allow the accurate specification of the pulse duration between 0 and 6 ms, with a typical duration of 2 ms to 3 ms.

[0110] A parallel interface 125 connects the ICP to individual static electrical signals. The CPU is able to control each of these connections as memory mapped I/O via a low speed bus.

[0111] The following is a table of connections to the parallel interface:

[0112] A serial interface is also included to allow authentication of the refill station. This is included to ensure that the cameras are only refilled with paper and ink at authorized refill stations, thus preventing inferior quality refill industry from occurring. The camera must authenticate the refill station, rather than the other way around. The secure protocol is communicated to the refill station via a serial data connection. Contact can be made to four gold plated spots on the ICP/print head TAB by the refill station as the new ink is injected into the print head.

[0113] Seven high current drive transistors eg. 227 are required. Four are for the four phases of the main stepper motor two are for the guillotine motor, and the remaining transistor is to drive the capping solenoid. These transistors are allocated 20,000 square microns (600,000 F) each. As the transistors are driving highly inductive loads, they must either be turned off slowly, or be provided with a high level of back EMF protection. If adequate back EMF protection cannot be provided using the chip process chosen, then external discrete transistors should be used. The transistors are never driven at the same time as the image sensor is used. This is to avoid voltage fluctuations and hot spots affecting the image quality. Further, the transistors are located as far away from the sensor as possible.

[0114] A standard JTAG (Joint Test Action Group) interface 228 is included in the ICP for testing purposes and for interrogation by the refill station. Due to the complexity of the chip, a variety of testing techniques are required, including BIST (Built In Self Test) and functional block isolation. An overhead of 10% in chip area is assumed for chip testing circuitry for the random logic portions. The overhead for the large arrays the image sensor and the DRAM) is smaller.

[0115] The JTAG interface is also used for authentication of the refill station. This is included to ensure that the cameras are only refilled with quality paper and ink at a properly constructed refill station, thus preventing inferior quality refills from occurring. The camera must authenticate the refill station, rather than vice versa. The secure protocol is communicated to the refill station during the automated test procedure. Contact is made to four gold plated spots on the ICP/print head TAB by the refill station as the new ink is injected into the print head.

[0116] FIG. 16 illustrates rear view of the next step in the construction process whilst FIG. 17 illustrates a front camera view.

[0117] Turning now to FIG. 16, the assembly of the camera system proceeds via first assembling the ink supply mechanism 40. The flex PCB is interconnected with batteries only one 84 of which is shown, which are inserted in the middle portion of a print roll 85 which is wrapped around a plastic former 86. An end cap 89 is provided at the other end of the print roll 85 so as to fasten the print roll and batteries firmly to the ink supply mechanism.

[0118] The solenoid coil is interconnected (not shown) to interconnects 97, 98 (FIG. 8) which include leaf spring ends for interconnection with electrical contacts on the Flex PCB so as to provide for electrical control of the solenoid.

[0119] Turning now to FIGS. 17-19 the next step in the construction process is the insertion of the relevant gear chains into the side of the camera chassis. FIG. 17 illustrates a front camera view, FIG. 18 illustrates a back side view and FIG. 19 also illustrates a back side view. The first gear chain comprising gear wheels 22, 23 are utilised for driving the guillotine blade with the gear wheel 23 engaging the gear wheel 65 of FIG. 8. The second gear chain comprising gear wheels 24, 25 and 26 engage one end of the print roller 61 of FIG. 8. As best indicated in FIG. 18, the gear wheels mate with corresponding buttons on the surface of the chassis with the gear wheel 26 being snap fitted into corresponding mating hole 27.

[0120] Next, as illustrated in FIG. 20, the assembled platten unit is then inserted between the print roll 85 and aluminium cutting blade 43.

[0121] Turning now to FIG. 21, by way of illumination, there is illustrated the electrically interactive components of the camera system. As noted previously, the components are based around a Flex PCB board and include a TAB film 58 which interconnects the printhead 102 with the image sensor and processing chip 51. Power is supplied by two AA type batteries 83, 84 and a paper drive stepper motor 16 is provided in addition to a rotary guillotine motor 20.

[0122] An optical element 31 is provided for snapping into a top portion of the chassis 12. The optical element 31 includes portions defining an optical view finder 32, 33 which are slotted into mating portions 35, 36 in view finder channel 37. Also provided in the optical element 31 is a lensing system 38 for magnification of the prints left number in addition to an optical pipe element 39 for piping light from the LED 5 for external display.

[0123] Turning next to FIG. 22, the assembled unit 90 is then inserted into a front outer case 91 which includes button 4 for activation of printouts.

[0124] Turning now to FIG. 23, next, the unit 92 is provided with a snap-on back cover 93 which includes a slot 6 and copy print button 7. A wrapper label containing instructions and advertising (not shown) is then wrapped around the outer surface of the camera system and pinch clamped to the cover by means of clamp strip 96 which can comprise a flexible plastic or rubber strip.

[0125] Subsequently, the preferred embodiment is ready for use as a one time use camera system that provides for instant output images on demand. It will be evident that the preferred embodiment further provides for a refillable camera system. A used camera can be collected and its outer plastic cases removed and recycled. A new paper roll and batteries can be added and the ink cartridge refilled. A series of automatic test routines can then be carried out to ensure that the printer is properly operational. Further, in order to ensure only authorised refills are conducted so as to enhance quality, routines in the on-chip program ROM can be executed such that the camera authenticates the refilling station using a secure protocol. Upon authentication, the camera can reset an internal paper count and an external case can be fitted on the camera system with a new outer label. Subsequent packing and shipping can then take place.

[0126] It will be further readily evident to those skilled in the art that the program ROM can be modified so as to allow for a variety of digital processing routines. In addition to the digitally enhanced photographs optimised for mainstream consumer preferences, various other models can readily be provided through mere re-programming of the program ROM. For example, a sepia classic old fashion style output can be provided through a remapping of the colour mapping function. A further alternative is to provide for black and white outputs again through a suitable colour remapping algorithm. Minimumless colour can also be provided to add a touch of colour to black and white prints to produce the effect that was traditionally used to colourize black and white photos. Further, passport photo output can be provided through suitable address remappings within the address generators. Further, edge filters can be utilised as is known in the field of image processing to produce sketched art styles. Further, classic wedding borders and designs can be placed around an output image in addition to the provision of relevant clip arts. For example, a wedding style camera might be provided. Further, a panoramic mode can be provided so as to output the well known panoramic format of images. Further, a postcard style output can be provided through the printing of postcards including postage on the back of a print roll surface. Further, cliparts can be provided for special events such as Halloween, Christmas etc. Further, kleidoscopic effects can be provided through address remappings and wild colour effects can be provided through remapping of the colour lookup table. Many other forms of special event cameras can be provided for example, cameras dedicated to the Olympics, movie tie-ins, advertising and other special events.

[0127] The operational mode of the camera can be programmed so that upon the depressing of the take photo a first image is sampled by the sensor array to determine irrelevant parameters. Next a second image is again captured which is utilised for the output. The captured image is then manipulated in accordance with any special requirements before being initially output on the paper roll. The LED light is then activated for a predetermined time during which the DRAM is refreshed so as to retain the image. If the print copy button is depressed during this predetermined time interval, a further copy of the photo is output. After the predetermined time interval where no use of the camera has occurred, the onboard CPU shuts down all power to the camera system until such time as the take button is again activated. In this way, substantial power savings can be realized.

[0128] The embodiments of the invention use an ink jet printer type device. Of course many different devices could be used. However presently popular ink jet printing technologies are unlikely to be suitable.

[0129] The most significant problem with thermal inkjet is power consumption. This is approximately 100 times that required for high speed, and stems from the energy-inefficient means of drop ejection. This involves the rapid boiling of water to produce a vapor bubble which expels the ink. Water has a very high heat capacity, and must be superheated in thermal inkjet applications. This leads to an efficiency of around 0.02%, from electricity input to drop momentum (and increased surface area) out.

[0130] The most significant problem with piezoelectric inkjet is size and cost. Piezoelectric crystals have a very small deflection at reasonable drive voltages, and therefore require a large area for each nozzle. Also, each piezoelectric actuator must be connected to its drive circuit on a separate substrate. This is not a significant problem at the current limit of around 300 nozzles per print head, but is a major impediment to the fabrication of pagewide print heads with 19,200 nozzles.

[0131] Ideally, the inkjet technologies used meet the stringent requirements of in-camera digital color printing and other high quality, high speed, low cost printing applications. To meet the requirements of digital photography, new inkjet technologies have been created. The target features include:

[0132] low power (less than 10 Watts)

[0133] high resolution capability (1,600 dpi or more)

[0134] photographic quality output

[0135] low manufacturing cost

[0136] small size (page width times minimum cross section)

[0137] high speed (<2 seconds per page).

[0138] All of these features can be met or exceeded by the inkjet systems described below with differing levels of difficulty. 45 different inkjet technologies have been developed by the Assignee to give a wide range of choices for high volume manufacture. These technologies form part of separate applications assigned to the present Assignee as set out in the table below.

[0139] The inkjet designs shown here are suitable for a wide range of digital printing systems, from battery powered one-time use digital cameras, through to desktop and network printers, and through to commercial printing systems.

[0140] For ease of manufacture using standard process equipment, the print head is designed to be a monolithic 0.5 micron CMOS chip with MEMS post processing. For color photographic applications, the print head is 100 mm long, with a width which depends upon the inkjet type. The smallest print head designed is IJ38, which is 0.35 mm wide, giving a chip area of 35 square mm. The print heads each contain 19,200 nozzles plus data and control circuitry.

[0141] Ink is supplied to the back of the print head by injection molded plastic ink channels. The molding requires 50 micron features, which can be created using a lithographically micromachined insert in a standard injection molding tool. Ink flows through holes etched through the wafer to the nozzle chambers fabricated on the front surface of the wafer. The print head is connected to the camera circuitry by tape automated bonding.

[0142] The following table is a guide to cross-referenced patent applications filed concurrently herewith and discussed hereinafter with the reference being utilized in subsequent tables when referring to a particular case:

[0143] Eleven important characteristics of the fundamental operation of individual inkjet nozzles have been identified. These characteristics are largely orthogonal, and so can be elucidated as an eleven dimensional matrix. Most of the eleven axes of this matrix include entries developed by the present assignee.

[0144] The following tables form the axes of an eleven dimensional table of inkjet types.

[0145] Actuator mechanism (18 types)

[0146] Basic operation mode (7 types)

[0147] Auxiliary mechanism (8 types)

[0148] Actuator amplification or modification method (17 types)

[0149] Actuator motion (19 types)

[0150] Nozzle refill method (4 types)

[0151] Method of restricting back-flow through inlet (10 types)

[0152] Nozzle clearing method (9 types)

[0153] Nozzle plate construction (9 types)

[0154] Drop ejection direction (5 types)

[0155] Ink type (7 types)

[0156] The complete eleven dimensional table represented by these axes contains 36.9 billion possible configurations of inkjet nozzle. While not all of the possible combinations result in a viable inkjet technology, many million configurations are viable. It is clearly impractical to elucidate all of the possible configurations. Instead, certain inkjet types have been investigated in detail. These are designated IJ01 to IJ45 above.

[0157] Other inkjet configurations can readily be derived from these 45 examples by substituting alternative configurations along one or more of the 11 axes. Most of the IJ01 to IJ45 examples can be made into inkjet print heads with characteristics superior to any currently available inkjet technology.

[0158] Where there are prior art examples known to the inventor, one or more of these examples are listed in the examples column of the tables below. The IJ01 to IJ45 series are also listed in the examples column. In some cases, a printer may be listed more than once in a table, where it shares characteristics with more than one entry.

[0159] Suitable applications include: Home printers, Office network printers, Short run digital printers, Commercial print systems, Fabric printers, Pocket printers, Internet WWW printers, Video printers, Medical imaging, Wide format printers, Notebook PC printers, Fax machines, Industrial printing systems, Photocopiers, Photographic minilabs etc.

[0160] The information associated with the aforementioned 11 dimensional matrix are set out in the following tables.

[0161] A large number of new forms of ink jet printers have been developed to facilitate alternative ink jet technologies for the image processing and data distribution system. Various combinations of ink jet devices can be included in printer devices incorporated as part of the present invention. Australian Provisional Patent Applications relating to these ink jets which are specifically incorporated by cross reference include:

[0162] Further, the present application may utilize advanced semiconductor fabrication techniques in the construction of large arrays of ink jet printers. Suitable manufacturing techniques are described in the following Australian provisional patent specifications incorporated here by cross-reference:

[0163] Further, the present application may utilize an ink delivery system to the ink jet head. Delivery systems relating to the supply of ink to a series of ink jet nozzles are described in the following Australian provisional patent specifications, the disclosure of which are hereby incorporated by cross-reference:

[0164] Further, the present application may utilize advanced semiconductor microelectromechanical techniques in the construction of large arrays of ink jet printers. Suitable microelectromechanical techniques are described in the following Australian provisional patent specifications incorporated here by cross-reference:

[0165] Further, the present application may include the utilization of a disposable camera system such as those described in the following Australian provisional patent specifications incorporated here by cross-reference:

[0166] Further, the present application may include the utilization of a data distribution system such as that described in the following Australian provisional patent specifications incorporated here by cross-reference:

[0167] Further, the present application may include the utilization of camera and data processing techniques such as an Artcam type device as described in the following Australian provisional patent specifications incorporated here by cross-reference: