Image Forming Apparatus

This invention relates to an image forming apparatus which has a character recognition function.

When a user would like to copy a document so that a page with a caption is front side, in double-sided copying from the document having a plurality of single-sided/double-sided pages, the user has to manually divide the pages into several sets of pages each having a page with a caption on top, and performs a plurality of jobs using a copying machine. Thus, copying operation in this case has been troublesome.

Further, an operator conventionally looks through the content of the document, and forms a table of contents using a word processor and the like, then prints out the table of contents. In this manner, this operation is also tiresome.

Accordingly, the present invention has been made to solve the above situation and has its object to provide an image forming apparatus which attains improved utility by controlling output such that a page of document including specific character(s) is copied on the front side of a recording sheet.

According to the present invention, the foregoing object is attained by providing an image forming apparatus, comprising: original reading means for reading an original; character recognition means for performing character recognition on the original read from the original, by the original reading means; extraction means for extracting a specific character array included in the original, based on the results of recognition by the character recognition means; memory means for storing page information of the original including the specific character array; and control means for controlling output based on the page information stored in the memory means.

In accordance with the present invention as described above, the apparatus reads an original document page, performs character recognition, and extracts a specific character array, included in the document, based on the recognition results. Then, the apparatus stores the page number of the document page including the extracted specific character array, and controls outputting based on the stored page number.

Another object of the present invention is to provide an image forming apparatus which automatically edits a table of contents of document, thus attains improved utility.

According to the present invention, the foregoing object is attained by providing an image forming apparatus which automatically edits a table of contents by using a character recognition function, comprising: extraction means for extracting contents information indicative of a caption of an original and a page number of the original, by using the character recognition function; storage means for storing the contents information extracted by the extraction means; and output means for editing a table of contents, based on the-contents information stored in the storage means and outputting the table of contents.

In accordance with the present invention as described above, the apparatus extracts a caption of document part and content information including the page number of the page including the caption, using a character recognition function, stores the extracted content information, edits a table of contents based on the stored content information, and outputs the edited table of contents.

Further, the present invention provides an image forming apparatus which automatically edits a table of contents by using a character recognition function, comprising: extraction means for extracting contents information indicative of a caption of an original and a page number of the original, by using the character recognition function; counter means for counting the number of pages of the original; storage means for storing the caption extracted by the extraction means and a count value indicative of the number of pages counted by the counter means, as contents information; and output means for editing a table of contents, based on the contents information stored in the storage means and outputting the table of contents.

In accordance with the present invention as described above, the apparatus extracts a caption of document part using a character recognition function, counts the number of pages of the document, stores the extracted caption and the count value as content information, edits a table of contents based on the stored content information, and outputs the edited table of contents.

Other objects and advantages besides those discussed above shall be apparent to those skilled in the art from the description of a preferred embodiment of the invention which follows. In the description, reference is made to accompanying drawings, which form a part thereof, and which illustrate an example of the invention. Such example, however, is not exhaustive of the various embodiments of the invention, and therefore reference is made to the claims which follow the description for determining the scope of the invention.

The accompanying drawings, which are incorporated in and constitute a part of the specification, illustrate embodiments of the invention and, together with the description, serve to explain the principles of the invention.

FIG. 1 is a block diagram showing the construction of an image copying apparatus according to a first embodiment of the present invention;

FIG. 2 is a cross-sectional view of the entire structure of the image copying apparatus according to the first embodiment;

FIG. 3 is a top plan view of an operation panel of the copying apparatus according to the first embodiment;

FIG. 4 is a flowchart showing copying operation according to the first embodiment;

FIG. 5 is an explanatory view showing the relation between original document and output recording sheet;

FIG. 6 is a flowchart showing caption-extraction processing according to the first embodiment;

FIG. 7 is an example of an original document page;

FIG. 8 is a block diagram for explaining the principle of OCR operation;

FIG. 9 is a block diagram showing the construction of a second embodiment comprising an OCR and an image copying apparatus;

FIG. 10 is a flowchart showing processing by an image processor according to the second embodiment;

FIG. 11 is a flowchart showing correction processing according to the second embodiment;

FIG. 12 is a flowchart showing page-number extraction processing according to the second embodiment;

FIG. 13 is an example of a table of contents; and

FIG. 14 is a flowchart showing processing by an image processor according to a third embodiment.

Preferred embodiments of the present invention will now be described in detail in accordance with the accompanying drawings.

›First Embodiment!

FIG. 1 is a block diagram showing the construction of an image copying apparatus according to a first embodiment of the present invention. As shown in FIG. 1, an original 100 is optically read by an image reader 200, and reflected light from the original is inputted into an A/D converter 203, via a CCD line sensor 202, then an A/D-converted signal is inputted into an image processor 300. At the image processor 300, first shading correction is performed by a shading corrector 301 on the input image signal, and switching of signal-output destination is made by mode switching circuit 302, based on set current mode, i.e., image processing setting mode or copying mode. If the mode is copying mode, the image signal is density-converted by a color-density converter 303, and outputted to an image editor 304. Prior to processing at the image editor 304, data-setting processing is performed by a data processing circuit 700 on the image signal, in accordance with data as settings such as image processing setting, stored in an RAM 403 of a controller 400. The set data processing is transferred to the image editor 304, and processing is performed on the image signal. When the processing at the image processor is completed, the processed image signal is outputted to an image recording unit 801 which comprises a control circuit for a motor for conveying recording sheets, a laser-recording circuit for writing the image signal inputted from the image processor 300 into an electrostatic drum, and a development control circuit for performing development. Note that an image recorder 800 will be described in detail later.

If the current mode is image processing setting mode, the mode switching circuit 302 switches the output of image signal to a recognition unit 600. At the recognition unit 600, first, a character recognition circuit 601 separates an image by one character (character pattern) from the input image and performs character recognition. The character recognition circuit 601 has a dictionary for character recognition. As the character recognition is completed, a natural-language analysis circuit 602 analyzes each character code and forms a word, further analyzes the meaning of the word, and converts the word into a knowledge code. As the natural-language analysis is completed, the knowledge code is outputted into a mode conversion circuit 603. The mode conversion circuit 603 has an inference circuit which infers the correspondence between the knowledge code generated by the natural-language analysis circuit 602 and content of knowledge base. Note that the ROM 402 and RAM 403 of the controller 400 respectively hold general knowledge base and knowledge base unique to the apparatus. The unique knowledge base is updated each time the image processing mode is activated, through the apparatus' own learning function.

At the inference circuit (603), if the knowledge code corresponds with the content of the image processing setting, the current mode is converted to image processing mode. If the knowledge code does not correspond with the content of the image processing setting, a CPU 401 of the controller 400 displays a mode setting image for setting the appropriate mode on an operation panel 500, based on the knowledge code, thus advising a user to input a setting. As the setting is made on the operation panel 500, the image processing mode is stored into the RAM 403 of the controller 400. Then, the processing at the mode conversion circuit 603 is over.

The operation panel 500 has a group of various keys for designating image editing contents to the image processor, and image copying operation such as the number of copies, a zoom ratio and the like, a group of various LED's and a display panel for displaying the content of operation and the like. Note that the operation panel 500 will be described in detail with reference to FIG. 3. later.

FIG. 2 is a cross-sectional view of the structure of the image copying apparatus of the present embodiment. In FIG. 2, reference numeral 1 denotes a document feeder (DF) as document feeding means, for feeding document set therein to a predetermined position on a glass platen 2, by one or serially two sheets. Numeral 4 denotes a scanner comprising a lamp 3 and scanning mirrors 5 to 7. When the original fed by the original feeder 1 is placed on the glass platen 2, the scanner 4 reciprocates in a predetermined direction. Light reflected from the original is passed through a lens 8 via the scanning mirrors 5 to 7, and focused on an image sensor 9 into an image. Numeral 10 denotes an exposure controller, comprising a laser scanner, for emitting a light beam modulated based on the image data outputted from the image processor onto an electrostatic drum 11; 12 and 13, developers for visualizing the electrostatic image formed on the electrostatic drum 11 with developing material (toner) in a predetermined color; and 14 and 15, paper trays on which a predetermined-sized recording sheets accumulated, then conveyed to a resist roller by drive of a convey roller. The recording sheets are re-fed at timing where the top end of the sheet meets with the end of the image formed on the electrostatic drum 11.

Numeral 16 denotes a separating discharger for separating a recording sheet from the electrostatic drum 11 after the toner image developed on the electrostatic drum 11 has been transferred onto the recording sheet; 17, a fixing unit for fixing the toner image onto the recording sheet; 18, a discharge roller for discharging the recording sheet on which the image formation has been completed onto a tray 20; and 19, a direction flapper for switching a direction for conveying the recording sheet after the image formation to discharge orifice or internal conveyance direction for overlaying/double-sided image formation process.

<Operation Panel>

FIG. 3 is a top plan view of the construction of the operation panel 500 of the present embodiment.

In FIG. 3, numeral 501 denotes a power switch for controlling the turning on/off of the apparatus; 502, a reset key for setting a current mode to a standard mode in a stand-by status; 503, a copy start key; 504, a clear key for clearing numerical values; 505, an ID key for enabling copying operation with respect to a specific user, but prohibiting copying with respect to the others; 506, a stop key for halting or canceling copying operation; 507, a guide key for guidance of various functions; 508, an upper cursor key for moving a cursor in various setting images upward; 509, a lower cursor key for moving the cursor in the various setting images downward; 510, a right cursor key for moving the cursor in the various setting images rightward; 511, a left cursor key for moving the cursor in the various setting images leftward; 512, an OK key for confirming set contents in the various setting images; and 513, an execute key for executing content outputted at a lower right portion of a display screen to be described later in the various setting images.

Numeral 514 denotes a standard-size reduction key for reducing standard copying size to another; 515, a same-size copying key for selecting same-size copying; 516, a standard-size magnification key for magnifying a standard copying size; 517, a cassette selection key for selecting the paper cassette to be used in copying; 518, a copying density adjustment key for lowering the copying density; 519, an AE key for automatically adjusting the copying density with respect to the density of original; 520, a copying density adjustment key for increasing the copying density; 521, a sorter operation designation key; 522, a preparatory heating key for ON/OFF of a preparatory heating mode; and 524, ten keys for inputting numerical values.

Numeral 525 denotes a marker processing key for setting trimming, masking, partial processing (outline processing, hatching, shadow-adding, negative/positive processing (reversing the gradations)) etc.; 526, a pattern processing key for representing colors by patterns or difference of densities; 527, a color deletion key for deleting a specific color; 528, an image quality key for setting an image quality; 529, a negative/positive key for negative/positive processing; 530, a image create key for outline processing, hatching, shadow-adding, italic processing, mirror processing and repeat processing; 531, a trimming key for designating an image area and performing trimming on the area; 532, a masking key for designating an image area and masking the area; 533, a partial processing key for designating an image area and designating a partial processing (outline processing, hatching, shadow-adding, negative/positive processing); and 534, a frame deletion key for deleting a frame of an original image in accordance with a set mode. Note that frame-deletion modes include a sheet-frame deletion mode (for forming a frame in accordance with a several sheet size), an original-frame deletion mode for forming a frame in accordance with an original size designated), a book-frame deletion mode (for forming blank spaces at the central portion and the peripheral portions of an original in accordance with a spread book size designated).

Numeral 535 denotes a binding-margin key for forming a binding margin at one end of a recording sheet; and 536, a movement key for movement. Note that the movement includes parallel movement (upward/downward/rightward/leftward), centering, movement to a corner and a designated movement (point designation. Numeral 537 denotes a zoom key for 1%-base setting of zooming ratio from 25% to 400%. Note that zooming ratio can be separately set for main-scanning and subscanning. Numeral 538 denotes an auto-zoom key for automatically changing a zooming ratio in accordance with a recording sheet size. Note that the auto-zooming ratio can be separately set for main-scanning and subscanning. Numeral 539 denotes a magnification & successive copy key for copying where an original image is magnified into a plurality of copies. Numeral 540 denotes a reduction layout key for copying where a plurality of original images are reduced into one page.

Numeral 543 denotes a successive copy key for dividing a copying range of the glass platen into right and left portions and automatically performing copying by two pages (successive page copying, double-sided copying); 544, a double-sided copy key for double-sided copying (one-sided original to double-sided copy, successive pages to double-sided copy, double-sided original to double-sided copy); 545, an overlaying key for overlaying (overlaying, overlaying of successive pages); 546, a memory key for a mode using a memory (memory synthesizing, area synthesizing, openwork synthesizing); 547, a projector key used when a projector is used; 548, a printer key for making settings of a printer; 550, a different-size key used when the sizes of pages of an original are different upon copying the original; 551, a mode memory key for reading a registered copying mode to register a set copying mode; 552, a mode switching key for switching of the copying mode and image processing setting mode; and 555, a display image for displaying apparatus status, the number of copies, a copying ratio and a size of recording sheet, and in setting of a copying mode, displaying setting contents.

<Copying Operation>

Next, copying operation according to the present embodiment, to output an image of a page including a caption on the front side of a recording sheet, will be described with reference to the flowchart of FIG. 4.

It should be noted that the description will be made on the assumption that a count value i indicative of a page number of a page including a caption is "1", and an initial count value k of the number of pages of original is "1".

First, at the operation panel, as the copying mode is set to "single-sided.fwdarw.double-sided: caption mode" or "double-sided.fwdarw.double-sided: caption mode" and the start key is pressed, the document feeder 1 feeds an original (total number of pages: n), from the last page (n-th page), to the glass platen 2. The image reader 200 reads information of the original, then outputs the information to the recognition unit 600, and character recognition is performed on the input information (S101). As the recognized results are outputted to the CPU 401, the CPU 401 examines character sizes of the input recognized results (S102), and if it finds a large-sized character, it regards the character as a caption letter, and stores the page including the character (m(i)=k) into the RAM 403 (S103).

Then, the page number of the captioned page (a page including caption(s)) is counted (i=i+1 (S104)) and the number of pages of original is counted (k=k+1 (S105)). If the character sizes are equal to each other, only the number of pages of original is counted. In this manner, character recognition with respect to all the document pages has been completed (S106), copying operation is performed.

Assuming the total number of original pages is n (n=k), the total number of captioned pages is i, the current count value of the number of original pages is p (initial value p=n), the count value of the captioned pages is j (initial value j=1), and the captioned page is m(j) (S107), when j=1 holds, if the number of pages (n+1-m(1) from the last page (n) to the first captioned page (m(1)) is an even number (S108), copying is controlled such that the last page image is outputted onto the back side of a recording sheet (S109), on the other hand, if an odd number, copying is controlled such that the last page image is outputted onto the front side of the recording sheet (S110).

When copying has been completed to the first captioned page (S113), the number of captioned page is counted (j=j+1 (S114)), and the number of original pages is counted (p=p+1 (S112). Thereafter, if the number of pages (m(j-1)-m(j)) from the (j-1)th captioned page (p=m(j)-1) to the next page of j-th captioned page (p=m(j)-1) is an even number (S108), the (m(j)-1)th page image is transferred onto the back side of a recording sheet and the (m(j)-2)th page image is transferred onto the front side of the recording sheet (S109), while if an odd number, the (m(j)-1)th page image is transferred onto the front side of a recording sheet, then the recording sheet is discharged with it back side blank, and the (m(j)-2)th page image is transferred onto the back side of another recording sheet (S110).

The above operation is repeated until all the original pages have been copied (S111), when the CPU 401 ends the copying operation.

FIG. 5 is an explanatory view showing recording sheets outputted by the above copying operation. As shown in FIG. 5, captioned pages (1, 3, p, n-1) are transferred onto the front side of recording sheets.

Next, the above caption extraction method will be described in detail with reference to the flowchart of FIG. 6 and the sample original 100 shown in FIG. 7.

Upon caption extraction at the recognition unit 600, first, character recognition is performed on the whole original page, and a histogram of character data is generated (S201). Then, character arrays having a size larger than an average character size are cut out (S202). Next, the extracted character arrays are checked (S203) to determine whether or not right and left spaces to the character arrays are larger than a predetermined standard value as space between character arrays from the histogram. If the right and left spaces to the character arrays are larger than the predetermined standard value, the line spaces of the extracted character arrays are checked (S204). Otherwise, if the right and left spaces to the character arrays are less than the predetermined standard value, it is determined that there is no caption in the page, and the process ends.

Next, in the line space check (S204), if the upper and lower line spaces are larger than a predetermined standard value as line space between character arrays from the histogram, it is determined that the extracted character arrays are independent character arrays, and the character arrays are separately recognized (S205). In FIG. 7, numeral 102 and 103 denote character arrays having line spaces larger than the predetermined standard value, and 104, a character array having line spaces less than the predetermined standard value. If the line spaces of the extracted character arrays are less than the predetermined standard value, the character arrays are recognized as one character array (S206). Next, the recognition results are stored into the RAM 403 (S207), and registered character arrays are checked (S208) to determine whether there is difference(s)in the histogram (size difference(s) among the registered character arrays). If there is difference(s) in the histogram, the character arrays are labeled from an array having the most characters (S209), while if there is no difference in the histogram, the process ends.

As described above, according to the present embodiment, it is possible to automatically form a double-sided copy where a page including caption(s) is outputted on the front side of a recording sheet, without user's manual operation.

According to the embodiment, utility can be improved by controlling image output regarding an original page including specific character array(s).

›Second Embodiment!

Next, a second embodiment of the present invention will be described below ›with reference to the drawings!. The second embodiment is a construction for extracting caption(s) and a page number of the captioned page, and automatically editing a table of contents.

First, an OCR principle of the present embodiment will be described with reference to FIG. 8.

In FIG. 8, an original 1101 is scanned by an exposure system 1102 of an image reader 1104. The reflection light from the original is focused on a CCD 1106 via a mirror 1103 and a lens 1105, binarized by an A/D converter 1107, and inputted into an image processor 1108. Next, at the image processor 1108, the binary data is stored into an image memory 1110, then images, one character at a time (character patterns), are separated by a one-character cutout unit 1111, from the binary data in the image memory 1110, and character-recognized by a character recognition unit 1112. Note that the image processor 1108 has a dictionary for character recognition. The one-by-one converted characters are edited by an editing unit 1113.

FIG. 9 is a block diagram showing the construction of the second embodiment comprising the OCR and an image copying apparatus. Next, automatic editing of table of contents will be described with reference to FIG. 9.

First, a DF 1401 feeds a page-numbered original document, of which a user wants to form a table of contents, to a DF 1401, and the scanner 1402 reads the original. Then, an OCR 1403 performs character recognition on image data read by the scanner 1402 from the original, and extracts caption(s) and a page number from the recognized characters. If caption(s) is found in the image, the caption and the page number are stored, as a pair, into a memory 1405. Next, an image processor 1404 arranges the captions stored in the memory 1405 in numerical order based on the page numbers, and a printer 1406 outputs the arranged captions as a table of contents. Note that upon arranging the captions, if correction on the table of contents to be outputted is required, the table of contents is corrected by input from an attached operation panel 407.

Next, processing by the above-mentioned image processor 1404 will be described with reference to the flowchart of FIG. 10.

First, at step S301, whether or not an original is set is checked. If YES, the process proceeds to step S302, at which the scanner 1402 reads the original, and at step S303, the OCR 1403 performs character recognition on the read image data. Next, at step S304, whether or not there is a caption among the character data is checked. If a caption is found, it is extracted. At the following step S305, whether or not there is a page number is checked. If a page number is found, the process proceeds to step S308, at which the extracted caption and the page number are stored, as a pair, into the memory 1405 (registration processing). Note that the above caption extraction is similar to that of the first embodiment, therefore the explanation of the caption extraction will be omitted. However, extraction of page number will be described in detail later with reference to FIG. 12.

At step S305, if there is no page number, the process proceeds to step S306, at which an error message is displayed on a display portion of the operation panel 1407. Next, at step S307, a proper page number is inputted from the operation panel 1407. As the correction (input) has been completed, the process proceeds to step S308 to perform the above registration processing.

On the other hand, at step S304, if there is no caption among the character data, when the registration processing at step S308 has been completed, the process proceeds to step S309 at which the next page is read with another page. The exchange is made using the DF 1401 ›in FIG. 8! or the like. Then, returning to step S301 at which existence/absence of original is determined, the next image data is inputted.

In the above processing, when reading of all the original pages has been completed, the process proceeds to step S310, at which whether or not data on captions and page numbers are stored in the memory 1405 is checked. If data on captions and page numbers are found, the process proceeds to step S311, at which a table of contents is formed by sorting the page numbers registered in the memory 1405 in ascending order. Next, at step S312, the data on the formed table of contents is transferred to the printer 1406, thus output of the table of contents is started, and then the process ends. At step S310, if there is no data on captions and page numbers in the memory 1405, the process proceeds to step S313, at which a message indicative of status where a table of contents cannot be formed is displayed at the display portion of the operation panel 1407, and then the process ends.

Next, the above-mentioned page-number correction (input) processing will be described with reference to the flowchart of FIG. 11.

First, at step S401, data to be corrected is read out of the memory 1405, and at step S402, correction on caption(s) or page number(s) is made by input from the operation panel 1407. Thereafter, as correction on a table of contents has been completed, the corrected data is re-registered into the memory 1405 at step S403, and then the process ends.

Next, the above-mentioned page number extraction processing will be described with reference to the flowchart of FIG. 12.

First, similar to the caption extraction processing, a histogram of character data character-recognized by the OCR 1403 is generated at step S501. At step S502, a page number less than an average character size in the histogram (101 in FIG. 7) is picked up. Next, at step S503, upper and lower line spaces and right and left spaces to the number are checked. If the spaces surrounding the picked up number, i.e., space between characters in the histogram is equal to or larger than a predetermined standard value, the process proceeds to step S504, at which the data is registered as a page number. If the spaces surrounding the number are less than the predetermined standard value, the process proceeds to step S505, at which an error message is displayed at the display portion on the operation panel 1407.

Further, as shown in FIG. 13, if there are two or more captions (captions 1601 and 1602 in FIG. 13) in the same page, the page number (1603 in FIG. 13) extracted by the page number extraction is outputted to the associated caption (1602 in FIG. 13).

In this manner, according to the second embodiment, it is possible to extract captions and page numbers and automatically generate a table of contents.

›Third Embodiment!

Next, a third embodiment of the present invention will be described below with reference to the drawings.

The third embodiment will be described as a case where a table of contents is generated with respect to an original having unnumbered pages. In this case, first, copying of the original is made, and page numbers are recorded at a predetermined position of image data by add-on (overlaying copying) which is one of functions of copying machines. If the copying apparatus has a page memory, image data both sides page-number data are synthesized on the memory, at one scanning, and a copy page is outputted in accordance with the synthesized image data. Note that the construction of the copying apparatus is similar to that of the second embodiment, therefore the explanation of the construction will be omitted.

FIG. 14 is a flowchart showing processing by the image processor 1404 according to the third embodiment.

At step S601, whether or not an original is set is checked. If YES, the process proceeds to step S602, at which a value of a page counter is incremented by one (+1), so as to maintain the correspondence between page numbers and actual pages. Next, at step S603, the scanner 1402 inputs image data from the original, and at step S604, the OCR 1403 performs character recognition. At step S605, whether or not there is a caption among character data is checked. If a caption is found, the caption and a page number based on the page counter value are registered, as a pair, into the memory 1405 at step S606. At step S605, if there is no caption among the character data, after the page number is registered at step S606, the process proceeds to step S607 at which the original page is exchanged for another original page. The process returns to step S601 to check existence/absence of original and input the next original.

By the above processing, as reading of all the original pages has been completed, the process proceeds to step S608 to check whether or not data on captions and page numbers are stored in the memory 1405. If YES, the process proceeds to step S609, at which the data on the captions and page numbers are transferred to the printer 1406, to start output of a table of contents. At step S608, if there is no data on the captions and page numbers, the process proceeds to step S610, at which a message indicating that a table of contents cannot be generated at the display portion of the operation panel 1407, and the process ends.

According to the second and third embodiments, even if an original has pages with disordered page numbers or unnumbered pages, a table of contents can be easily generated by merely inputting an original.

The present invention can be applied to a system constituted by a plurality of devices or to an apparatus comprising a single device.

Furthermore, the invention is also applicable to a case where the invention is embodied by supplying a program to a system or apparatus. In this case, a storage medium, storing a program according to the invention, constitutes the invention. The system or apparatus installed with the program read from the medium realizes the functions according to the invention.

As described above, according to the second and third embodiments, an image forming apparatus that automatically edits a table of contents of input original, thus improving utility for users, and an editing method for the apparatus can be provided.

The present invention is not limited to the above embodiments and various changes and modifications can be made within the spirit and scope of the present invention. Therefore, to apprise the public of the scope of the present invention, the following claims are made.