US 8,553,284 B2Grant
Information input/output method using dot pattern
Issue Date:2013-10-08
•24 Claims
•14 Drawing Sheets
Abstract
A dot pattern including a block defined as a rectangular area of a square or a rectangle of a medium face, such as printed matter. A straight line in a vertical direction and a horizontal direction configuring a frame of the block each are defined as a standard grid line. Virtual reference grid points are provided at predetermined intervals on the reference grid line. Reference grid point dots are placed on respective virtual reference grid points. Straight lines that connect the virtual reference grid points to each other and are parallel to the reference grid lines are defined as grid lines. A point of intersection of grid lines is defined as a virtual grid point. A dot pattern is generated by arranging one or a plurality of information dots, each of which has a distance and a direction around the virtual grid point.
Metadata
Inventor
- Kenji Yoshida
Application Information
Application Number:US 13/589,767
Filing Date:2012-08-20
Priority Date:2011-10-03
Art Unit:2673
Classifications
IPC:
G06K15/00
Patent Drawings (14 sheets)
Description
Cross-Reference to Related Applications
[0001] This application is a divisional application claiming the benefit under 35 U.S.C. §120 of U.S. application Ser. No. 13/251,903, filed on Oct. 3, 2011, which is a divisional application claiming benefit under 35 U.S.C. §120 of U.S. application Ser. No. 11/912,597, filed on Oct. 25, 2007, which is a §371 of PCT/JP2005/008210, the entire contents of which are incorporated herein by reference.
Technical Field
[0002] The present invention relates to an information input/output method using dot patterns for inputting/outputting a variety of information or programs by optically reading dot pattern information that is formed on a printed matter or the like.
Background Art
[0003] Conventionally, there has been an information output method for reading a barcode printed on a printed matter or the like, and then, outputting information such as a voice. For example, there has been a method for storing in advance information that is coincident with key information imparted to storage means, retrieving the information from a key read by means of a barcode reader, and then, outputting information or the like. In addition, there has also been proposed a technique of generating a dot pattern obtained by arranging fine dots under a predetermined rule so as to output a plenty of information or programs, picking up and digitizing the dot pattern printed on picking up the dot pattern printed onto a printed matter or the like as image data by means of a camera, digitizing, and then, outputting voice information.
[0004] However, the conventional method for outputting a voice or the like by mean of a barcode has entailed a problem that the barcode printed on a printed matter or the like is an eyesore. In addition, the above conventional method has entailed a problem that a barcode is large in size and occupies part of paper, and thus, if the barcode is thus large in size, it is impossible, on the aspect of layout, to clearly lay out a number of barcodes by partial paragraph or sentence or by character or object which has the significance appearing in images of photographs, pictures or graphics.
[0005] A dot pattern is picked up as image data by means of a camera, and then, the image data is digitized in no-color 256 gradations. In order to easily recognize dots, the variation of the gradation is differentiated, and then, a dot edge is sharpened. Next, the data on the 256 gradations is binarized to white or black. By means of this binarization, when a dot is printed on paper, a dot print error occurs, the error being caused by a print shift or blurring and a shift when a pixel has been provided. Conventionally, such a print error has been error-checked by means of a parity check. However, these error checks have had: a problem that an error check is made relative to a block of data obtained from a plurality of dots instead of a print error check by dot, making it impossible to determined with which of the dot such a print error has occurred; and a problem that a camera image picking up range must be widely determined.
[0006] Further, the above error checks have entailed a problem that a distortion occurs with the dot pattern picked up as an image exerted by a lens distortion or a distortion exerted at the time of oblique image pickup, paper expansion or contraction, medium surface curling, or printing, and then, sophisticated technique is required to correct this distortion.
[0007] The present invention has been achieved in order to solve such problems. In other words, it is an object of the present invention to provide an information input/output method using dot patterns, which is capable of imparting information or functions different depending on dots of a dot pattern displayed on a printed matter or the like, thereby defining a large amount of data by means of a dot pattern and, at the time of defining information from that dot pattern, recognizing directivity and speedily defining information; which is capable of checking an error on dot layout state; and further, which is capable of enhancing security.
Disclosure of the Invention
[0008] Claim 1 of the present invention is directed to an information input/output method using dot patterns, the method comprising: defining as a block a rectangular area of a square or a rectangle, of a medium face such as a printed matter; while a straight line in a vertical direction and a horizontal direction configuring a frame of the block is defined as a standard grid line, providing a virtual reference grid point by predetermined interval on the reference grid line; laying out a reference grid point dot on a virtual reference grid point; connecting the virtual reference grid points to each other and defining a straight line parallel to the reference grid line as a grid line; defining a cross point between the grid lines as a virtual grid point; generating a dot pattern obtained by laying out one or a plurality of information dots, respectively, having a distance and a direction around the virtual grid point; reading such dot pattern as image information by optical reader means; numerically valuing the dot pattern; and reading and outputting information that corresponds to the numerically defined information from storage means.
[0009] According to claim 1, information dots can be laid out by grid (first virtual grid point) formed in large amount in blocks, so that more information can be stored in blocks.
[0010] In addition, the virtual reference grid point by predetermined direction used herein denotes a predetermined interval in a vertical or horizontal direction; however, this interval may be made different depending on the vertical direction and the horizontal direction.
[0011] Claim 2 of the present invention is directed to the information input/output method using dot patterns, as set forth in claim 1, wherein, in the block, assuming an oblique grid line connecting virtual reference grid points in a further oblique direction, a cross point between the oblique grid lines is also defined as a virtual grid point (second virtual grid point); and one or a plurality of dots, each of which has a distance and a direction, are laid out around this virtual grid point.
[0012] According to claim 2, information dots can be laid out by virtual grid point that is a cross point between the grid lines in an oblique direction, so that further more information can be stored in blocks.
[0013] Claim 3 of the present invention is directed to the information input/output method using dot patterns, as set forth in claim 1 or 2, wherein the dot pattern provides significance of information in accordance with whether or not dots are laid out around the virtual grid point.
[0014] According to claim 3, by intentionally generating and laying out a dot-free area, the outer frame of a mask defining an area on a printing face can be expressed. In addition, by laying out dots on all the virtual grid points in a predetermined area, the laid out dots can also be recognized as ordinary background information.
[0015] A first algorithm for defining information in accordance with whether or not a dot exists on a virtual grid point and a second algorithm associated with an information dot that exists at a position shifted from a virtual grid point can be mixed with each other, and more information can be laid out.
[0016] Claim 4 of the present invention is directed to the information input/output method using dot patterns, as set forth in any one of claims 1 to 3, wherein a key dot defining orientation of the block is laid out at a position shifted from at least one virtual reference grid point on the reference grid line configuring the block.
[0017] In this way, the orientation of the block can be defined by laying out the key dot. Utilizing the key dot, the tilting in a predetermined direction can be detected relative to a read axis of optical reader means, so that the read dot pattern can be corrected or the significance different depending on a tilt angle can be provided.
[0018] In addition, in the case where such a key dot has been laid out, that portion (reference grid point dot on virtual reference grid line) does not exist because it is substituted for a key dot.
[0019] Claim 5 of the present invention is directed to the information input/output method using dot patterns, as set forth in any one of claims 1 to 3, wherein, with respect to an information dot of a predetermined position that is defined as a key dot in the block, the information dot being laid out in a respective one of rectangular areas that exists at a position at which the rectangular area to which the key dot belongs is turned by 90 degrees around the block center, information is defined by a direction or a distance that excludes a direction required to define the key dot.
[0020] In the case where an information dot other than a block center is defined as a key dot, there is a possibility that an information dot that exists at a corresponding position when the block center is turned as a rotational axis by 90 degrees cannot be discriminated from a key dot if the information dot is read by optical reader means. According to claim 5, however, in the corresponding rectangular area other than the key dot, the manner of imparting an information dot is made different from usual, thereby making it possible to discriminate the key dot and the information dot from each other.
[0021] For example, it is sufficient if a key dot is laid out as a vector in only the vertical and horizontal directions from a virtual grid point and if information is defined in an oblique direction in another rectangular area that exists at a position turned by 90 degrees.
[0022] In addition, with respect to a key dot, while a length of a vector is defined as a predetermined length, information may be defined by means of a vector of a different length in another rectangular area that is exists at a position turned by 90 degrees.
[0023] In this way, the manner of defining an information dot is determined in advance so to be different from the manner of defining a key dot with respect to an area in which the key dot can be laid out, whereby an information dot can be laid out with respect to the corresponding area other than the key dot and a dot pattern without wastefulness can be achieved.
[0024] In the case where a key dot has been laid out at a block center, with respect to another information dot in a block may, of course, information may be defined depending on which of the vertical, horizontal, and oblique directions is to be determined.
[0025] Claim 6 of the present invention is directed to the information input/output method using dot patterns, as set forth in any one of claims 1 to 5, wherein, in an information dot of the block, depending on a position in a block of the information dot, a distance and a direction from the virtual grid point are arbitrarily limited by information dot, and information is defined.
[0026] According to claim 6, information can be defined while the distance and direction from the virtual grid point are arbitrarily limited. Therefore, for example, the manner of defining information, by information dot, can be varied by type of industrial field using the dot pattern (by manufacture, by service industrial field or by company using this dot pattern).
[0027] In this way, the dot patterns of the present can be utilized discriminatively by limited usage, so that mutual securities can be laid out. In other words, the limited defined information can be provided so as to be readable by optical reader means corresponding thereto.
Brief Description of the Drawings
[0028] FIG. 1 is an illustrative view depicting one example of a dot pattern.
[0029] FIG. 2 is an enlarged view showing an example of information dots in a dot pattern.
[0030] FIG. 3 (a), FIG. 3 (b), and FIG. 3 (c) are illustrative views depicting how key dots and information dots are laid out.
[0031] FIG. 4 shows an example of information dots and bit representation of data defined therein.
[0032] FIGS. 5 (a) to (f) each show an example of information dots and bit representations defined therein, wherein FIG. 5 (a) shows a case in which two dots are laid out; FIG. 5 (b) shows a case in which four dots are laid out; FIG. 5 (c) to (e) each show an case in which five dots are laid out; and FIG. 5 (f) shows a case in which seven information dots are laid out.
[0033] FIGS. 6 (a) to (d) are views each showing an exemplary configuration of a block, wherein FIG. 6 (a) shows an exemplary configuration of 2×3=6 rectangular areas; FIG. 6 (b) shows an exemplary configuration of 3×3=9 rectangular areas; FIG. 6 (c) shows an exemplary configuration of 4×3=12 rectangular areas; and FIG. 6 (d) shows an exemplary configuration of 5×5=25 rectangular areas, respectively.
[0034] FIG. 7 is an illustrative view of a method for assigning “0” and “1” to least significant bits and checking an error of an information dot.
[0035] FIG. 8 is an illustrative view depicting a relationship among a true value K, a security table R, and an information dot 1 for the purpose of illustration of the security of the information dot.
[0036] FIGS. 9 (a) to (d) shows dummy dots and null dots, wherein FIG. FIG. 9 (a)-1 is an illustrative view of dummy dots; FIG. 9 (a)-2 is an illustrative view of null dots; FIG. 9 (b) and FIG. 9 (c) each are one example of a printed matter; FIG. 9 (d)-1 is an exemplary layout of dot patterns restricting the boundary between two masks by means of null dots; and FIG. 9 (d)-2 is an illustrative view depicting an exemplary layout of dot patterns restricting the boundary between a null dot and a background by means of null dots.
[0037] FIG. 10 (a) is an illustrative view depicting a sequential order of inputting information dots and FIG. 10 (b) is an illustrative view depicting a method for reading dot patterns and calculating X and Y coordinate values.
[0038] FIG. 11 is a view showing a relationship in layout between a reference grid line configuring an outer frame of a block and a reference grid point dot.
[0039] FIG. 12 is a view showing a relationship in layout between a grid line, an oblique grid line, and a virtual grid point and an information dot.
[0040] FIG. 13 is a view for explaining a method for retrieving an information dot 3 around a virtual grid point.
[0041] FIG. 14 is a view for explaining a relationship in layout between a block orientation and a key dot.
Best Mode for Carrying Out the Invention
[0042] Hereinafter, preferred embodiments of the present invention will be described with reference to the accompanying drawings.
[0043] FIG. 1 is an illustrative view depicting one example of a dot pattern of the present invention; FIG. 2 is an enlarged view showing one example of information dots of a dot pattern and bit representation of data defined therein; and FIG. 3 (a), FIG. 3 (b), and FIG. 3 (c) are illustrative views each depicting how key dots and information dots are laid out.
[0044] The information input/output method using dot patterns, according to the present invention, is comprised of: recognition of a dot pattern 1; and means for outputting information and programs from this dot pattern 1.
[0045] In other words, the dot pattern 1 is picked up as image data by means of a camera; a reference grid point dot 4 is first extracted, and then, the thus extracted dot is determined to be at a position of a virtual reference grid point 6; and a straight line connecting these virtual reference grid points 6 is defined as a reference grid line 7. In the case where the reference grid point dots 4 are not laid out at position of the virtual grid points 6 at which the dots should be, dots at the periphery of this virtual reference grid points 6 are extracted, and the extracted dots each are defined as a key dot 2 (rectangular parts at four corners of a block). Next, vertical and horizontal grid lines 8a, 8b connecting the virtual reference grid points 6 are set, and then, a cross points between the grid lines 8a and 8b is defined as a virtual grid point 11 (first virtual grid point). Then, the dots at the periphery of this virtual grid point 11 are retrieved, and then, an information dot 3 defined depending on the distance and direction from the virtual grid point is extracted.
[0046] In addition, assuming an oblique grid line 8c connecting the virtual reference grid points 6 to each other in an oblique direction, a cross point of these oblique grid lines 8c is also defined as a virtual grid point 12 (second virtual grid point). Then, the dots at the periphery of this virtual grid point 12 are also retrieved, and then, the information dot 3 defined depending on the distance and direction from the virtual grid point 12 is extracted.
[0047] Next, the orientation of the block is determined depending on the direction from the virtual reference grid point 6 or virtual grid point 11 of a key dot 2. For example, in the case where the key dot 2 has been shifted in the +y direction from a virtual grid point, the information dot 3 in a block may be recognized while a vertical direction is defined as a forward direction.
[0048] Further, if the key dot 2 is shifted in the −y direction from the virtual reference grid point 6 or virtual grid point 11, the information dot 3 in a block may be recognized while the direction in which the block has been rotated at 180 degrees around a block center is defined as a forward direction.
[0049] Furthermore, if the key dot 2 is shifted in the −x direction front the virtual reference grid point 6 or virtual grid point 11, the information dot in a block may be recognized while the direction in which the block has been rotated clockwise at an angle of 90 degrees around a block center is defined as a forward direction.
[0050] Moreover, if the key dot 2 is shifted in the +x direction from the virtual reference grid point 6 or virtual grid point 11, the information dot 3 in a block may be recognized while the direction in which the block has been rotated counterclockwise at an angle of 90 degrees around a block center is defined as a forward direction.
[0051] If images of dot patterns read by optical reader means are accumulated in a frame buffer, a central processing unit (CPU) of the optical reader means analyzes dots in the frame buffer, and then, decodes the numeric values defined by information dot 3 depending on the distance and direction from virtual grid points 11, 12 of information dots 3. As the xy coordinate or codes, these numeric values are crosschecked with information stored in the optical reader means or memory of a personal computer; and the voice, images, mobile images, and programs or the like corresponding to the xy coordinate or codes are read out, and then, are outputted from a voice/image output means or the like.
[0052] In generation of the dot pattern 1 of the present invention, in accordance with an algorithm for generating a dot code, in order to recognize information such as a voice, fine dots, i.e., the key dot 2, the information dot 3, and reference grid point dot 4 are arranged under a predetermined rule.
[0053] As shown in FIG. 1 , a rectangular area such as a square or a rectangle, of a medium face such as a printer matter, is defined as a block 1. In addition, while straight lines in the vertical and horizontal directions configuring a frame of the block 1 each are defined as a reference grid line 7 (lines indicated by thick lines in FIG. 1 ), virtual reference grid points 6 are provided at predetermined intervals on the reference grid line 7, and then, reference grid point dots 4 are laid out on the virtual reference grid points 6. Next, straight lines connecting the virtual reference grid points 6 to each other and parallel to the reference grid line 7 are defined as grid lines 8a, 8b and a cross point between the grid lines 8a and 8b is defined as a virtual grid point 11 (first virtual grid point).
[0054] Still furthermore, an oblique grid line 8c connecting the virtual reference grid points 6 to each other in an oblique direction is set and a cross point between these oblique grid lines 8c is defined as a virtual grid point 12 (second virtual grid point).
[0055] One or plurality of information dots 3 having a distance and a direction around the thus set grid point are laid out, respectively, to generate a dot pattern.
[0056] When this dot pattern 1 is picked up as image data by means of a camera, lens distortion of the camera or a distortion exerted at the time of oblique image pickup, paper expansion and contraction, medium surface curling, or printing can be corrected by means of the reference grid point dots 4. Specifically, a correction function (Xb Ya)=f (X′a Y′a) is obtained for converting distorted four virtual grid points into an original square, information dots are corrected by the same function, and the vector of correct information dot 3 is obtained.
[0057] If the reference grid point dots are laid out in the dot pattern 1, the image data obtained by picking up this dot pattern 1 by means of a camera corrects the distortion caused by the camera, so that, when the image data on the dot pattern 1 is picked up by means of a general type camera having a lens with a high distortion rate mounted thereon as well, the image data can be precisely recognized. In addition, even if the camera is tilted relative to a face of the dot pattern 1, the dot pattern 1 can be precisely recognized.
[0058] The key dot 2, as shown in FIG. 1 , serves as a dot laid out depending on a distance and a direction around one virtual grid point 11 that exists at a substantially central position of virtual grid points laid out in a rectangular shape. This key dot 2 serves as a representative point of the dot pattern 1 for one block representative of a group of information dots. For example, these dots are laid out at the positions shifted by 0.2 mm upwardly of a virtual grid point at the block center of the dot pattern 1. Therefore, in the case where the information dot 3 is defined by X, Y coordinate values from a virtual grid point, the position distant at a distance of 0.2 mm downwardly of the key dot 2 is defined as a virtual grid point (coordinate point). However, this numeric value 80.2 mm) can vary according to whether the block of the dot patterns 1 is large or small in size without being limitative thereto.
[0059] The information dot 3 serves as a dot for recognizing a variety of information. In the case of FIG. 1 , the information dots 3 are laid out at the periphery thereof while the key dot is defined as a representative point and are laid out at end points expressed by means of a vector while the center surrounded by four virtual grid points 11 (first virtual grid points) is defined as a virtual grid point (second virtual grid point), and then, the defined grid point is defined as a start point. For example, this information dot 3 is surrounded by means of virtual grid points 11, 12. As shown in FIG. 2 , the dots that are distant by 0.2 mm from the virtual point are laid out in eight directions while they are rotated clockwise by 45 degrees in order to provide the direction and length that are expressed by the vector, and then, three bits are expressed.
[0060] With reference to the figure, 3 bits×16=48 bits can be expressed in a dot pattern 1 of one block.
[0061] While, in the illustrative embodiment, the dots layout is provided in the eight directions to express three bits, the dot layout can be provided in 16 directions to express four bits and, of course, the dot layout can be variously changed.
[0062] It is desirable that the diameter of the key dot 2, information dot, or reference grid point dot 4 be on the order of 0.1 mm in consideration of appearance, precision of printing relative to paper, camera resolution and optimal digitization.
[0063] In addition, it is desirable that intervals of reference grid point dots 4 be on the order of 1 mm vertically and horizontally in consideration of incorrect recognition of a variety of dots 2, 3, 4. It is desirable that the distortion of the key dot 2 be on the order of 20% of the grid intervals.
[0064] It is desirable that a gap between this information dot 3 and a virtual grid point 11, 12 be on the order of 15% to 30% of a distance between the virtual grid points 11 and 12 adjacent thereto. The reason therefor is set forth as follows. If the distance between the information dot and the virtual grid point 11, 12 is longer than this interval, dots are easily visually recognized as a large block, and the dot pattern 1 is eyesore. On the other hand, if the distance between the information dot 2 and the virtual grid point 11, 12 is shorter than the above interval, it becomes difficult to determine that the target dot is an information dot 3 having vector directivity around either of the virtual grid points 11, 12 adjacent thereto.
[0065] FIG. 3 shows a sequential order of reading information dots 3 in a block, wherein the numbers circled in the figure denotes a layout area of the information dots laid out by virtual grid points 11, 12, respectively.
[0066] For example, in the case of FIG. 3 (a), (1) to (25) are laid out clockwise therefrom around (1) of as block center (this denotes number “1” circled in the figure). At this time, the grid interval is 1 mm, for example, and 3 bits×16=48 bits is expressed by 4 mm×4 mm.
[0067] In FIG. 3 (b), after from an information dot (1) in the rectangular area at the left top of a block to an information dot (4) have been laid out sequentially in a vertical direction, information dots (5) to (7) are laid out at cross points between the grid lines in the vertical and horizontal direction.
[0068] In FIG. 3 (c), after an information dot (1) in the rectangular area at the left top of a block to an information dot (16) have been laid out sequentially in a vertical direction, information dots (17) to (25) are laid out alternately at a cross point between the vertical and horizontal grid lines.
[0069] FIG. 4 shows an example of an information dot 3 and bit representation of data defined therein and shows another aspect of the invention.
[0070] In addition, if eight vector directions are defined with the use of two types of dot i.e., a long dot (upper stage of FIG. 4 ) and a short dot (lower stage of FIG. 4 ) from the virtual grid points 11, 12 surrounded by the reference grip point dot 4 relative to the information dot 3, four bits can be expressed. At this time, it is desirable that the long dot be on the order of 25% to 30% of a distance between the virtual grid points 11 and 12 adjacent thereto and that the short dot be on the order of 15% to 20% thereof. However, it is desirable that a central interval of the long and short be longer than the diameter of each of these dots.
[0071] It is desirable that the information dot 3 surrounded by four virtual grid points 11, 12 be one dot in consideration of appearance. However, in the case where an attempt is made to increase the amount of information while ignoring the appearance, a large amount of information can be provided by assigning one bit, and then, expressing information dots 3 in plurality. For example, in concentric eight-directional vectors, information for 2 can be expressed by means of a information dot 3 and 2128 is obtained by 16 information dots in one block.
[0072] FIGS. 5 (a) to (f) each show an example of an information dot 3 and bit representation of data defined therein, wherein FIG. 5 (a) shows a case in which two dots are laid out; FIG. 5 (b) shows a case in which four dots are laid out; and FIG. 5 (c) to FIG. 5 (e) each show a case in which five dots are laid out; and FIG. 5 (f) shows a case in which seven dots are laid out.
[0073] FIGS. 6 (a) to (d) each show modification of a dot pattern, wherein FIG. 6 (a) shows a case in which eight information dots 3 are laid out in a block; FIG. 6 (b) shows a case in which 18 information dots are laid out therein; FIG. 6 (c) shows a case in which 13 information dots are laid out; and FIG. 6 (d) shows a case in which 41 information dots 3 are laid out.
[0074] Each of the dot patterns 1 shown in FIGS. 1 and 3 described previously also shows an example in which 25 information dots 3 are laid out in one block. However, these information dots 3 can be variously changed without being limitative thereto. For example, according to a large or small amount of information required or camera resolution, eight information dots 3 may be laid out in one block (FIG. 6 8a); 13 information dots may be laid out in one block (FIG. 6 (b); 18 information dots 3 are laid out in one block (FIG. 6 (c)); or 41 information dots 3 are laid out in one block (FIG. 6 (d)).
[0075] FIG. 7 is an illustrative view of a method for assigning “0” and “1” to the least significant bits and checking an information dot error.
[0076] Further, one information dot 3 is uniformly laid out and “0” and “1” are alternately assigned to the least significant bits so that they are used for checking an error, thereby making it possible to check an error of this information dot 3. In this error check system, information dots are generated alternately in the vertical, horizontal, and 45-degree tilt directions, making it possible to eliminate the regularity of a dot pattern. In other words, the information dots obtained by alternately assigning “0” and “1” to the least significant bits are always positioned in the vertical, horizontal, or 45-degree tilt direction around the virtual grid points 11, 12. Therefore, when the information dots 3 are positioned in a direction other than the horizontal or 45-degree tilt direction, these dots are determined as those displayed at their appropriate positions. In this way, an error inputted when the information dots 3 are shifted in a rotational direction around the virtual grid points 11, 12 can be reliably checked.
[0077] When the information dots 3 are determined as eight directions (45-degree intervals) and as long/short dots (refer to FIG. 4 ), if the least significant one bit is “0” or “1”, among four bits, in the case where the above one bit is shifted to one of the positions of the adjacent three dots (concentric circle±two points at 45-degree rotation position+either one of long and short dots), it can be handled as an error and 100% error check can be made.
[0078] FIG. 8 is an illustrative view depicting how information dots I1 to I16 are arranged in order to explain the security of information dots.
[0079] For example, in order to disable visually reading data on a dot pattern 1, the computation expressed by a function f (Ka) is carried out with respect to Is of an information dot 3; Ia=Ka+Rn is expressed by means of the dot pattern 1; a dot pattern In is inputted; and thereafter, Ka=In−Rn is obtained.
[0080] Alternatively, in order to disable visually reading data on the dot patter 1, a plurality of information dots are laid out in one column with a key dot 2 being a representative point and such one train is laid out in plurality of trains, and then, a difference in date between two trains adjacent to each other is handled as data on the information dot 3, whereby the information dots 3 each can be laid out so that regularity of the information dots 3 is eliminated.
[0081] In this manner, the security can be enhanced in order to disable visually reading the dot pattern 1 printed on a medium face. In addition, when the dot pattern 1 has been printed on the medium face, the information dots 3 are laid out in random, a pattern is eliminated, and the dot pattern can be made moderate.
[0082] FIGS. 9 (a) to (d) show dummy dots, wherein FIG. 9 (a) is an illustrative view of dummy dots; FIG. 9 (b) shows an example of a printed matter; FIG. 9 (c) shows an area in a printed matter; and FIG. 9 (d) is an illustrative view depicting an example of laying out dot patterns that restrict the boundary of a mask by means of dummy dots.
[0083] A dot is laid out at a central position (second virtual grid point) of four virtual grid points 11 (first virtual lattice points), and this dot is defined as a dummy dot 5 to which no information is imparted (FIG. 9 (a). This dummy dot 5 can be used for numeric data or areas in which X, Y coordinate values have been defined and the boundary between the areas, numeric data or an area in which the X, Y coordinate values are not defined.
[0084] For example, as shown in FIG. 9 (a), three types of patterns such as lesser bear, hippopotamus, or sum are printed on a printed matter, and then the areas corresponding to these three patterns are laid out as mask 1, mask 2, and mask 3, as shown in FIG. 9 (c). As shown in FIG. 9 (d), the dummy dot 5 is laid out at the boundary of mask 1 and mask 2.
[0085] In the case where the dummy dot 5 is used for the boundary, there is no need for defining all of the blocks of the corresponding positions as dummy dots 5, and it is sufficient if a minimum dot is defined as a dummy dot in order to indicate the boundary.
[0086] In addition, a dummy dot is laid out in an area other than the masks, and an area in which no information is defined can be provided.
[0087] When the dot pattern 1 is picked up as image data by means of a camera, the X, Y coordinate values are calculated at the positions of the key dot 2 that is a representative point of information, and thereafter, the coordinate values are compensated for by means of the increments of the X, Y coordinate values at the representative points adjacent to each other and a distance from an image pickup center to the key dot 2 on which the X, Y coordinate values have been calculated.
[0088] Alternatively, when the block of dot patterns 1 is picked up as image data by means of a camera, information dots are sequentially read from the information dots that exist at the periphery of the image pickup center of the camera in an area in which identical data is defined in blocks or an area in which the X, Y coordinate values are defined, and then, information dots 3 equivalent to one block are read, whereby the dot pattern 1 is read in a minimum area from the image pickup center of the camera, and then, data at the image pickup central position is calculated.
[0089] FIG. 10 (a) shows sequential order of information dots equivalent to one block in a minimum area from the image pickup center of the camera. 4×4 columns=16 information dots are inputted clockwise.
[0090] FIG. 10 (b) is an illustrative view depicting a method for reading a dot pattern and calculating X, Y coordinate values.
[0091] As illustrated, the X, Y coordinate values to be obtained are defined as X, Y coordinate values of a block having the camera image pickup center. With respect to the X, Y coordinate values, if the increment is defined as +1 in the X direction (right direction) and in the Y direction (upper direction) by block, there is a need for compensating for the information dots inputted from another block. K8 K7 K6 K5 (i16 i15 i14 i13 i12 i11 i10 i9) indicating the X-coordinate value and K4 K3 K2 K1 (i8 i7 i6 i5 i4 i3 i2 i1) indicating the Y-coordinate value are targeted for compensation. Other coordinate values K16 to K9 (i32 to i17) become identical in any block, and there is no need for compensation.
[0092] These calculations are obtained by formula 1 below. Even if a digit is risen by means of calculation in [ ], it is assumed that the columns of bits preceding [ ] are not adversely affected. If an error check bit is excluded from among an information dot I, the bit is defined as K.
<Formula 1>
{circle around (1)} In the case where 11I11 is a start point (camera image pickup center)
X coordinate=11K8·11K7·11K6·21K5
Y coordinate=12K4·12K3·12K2·[22K1+1]
{circumflex over (2)} In the case where 11I15 is a start point (camera image pickup center)
X coordinate=12K8·12K7·12K6·22K5−1
Y coordinate=12K4·12K3·12K2·[22K1+1]
{circle around (3)} In the case where 12I3 is a start point (camera image pickup center)
X coordinate=12K8·12K7·12K6·22K5
Y coordinate=12K4·12K3·12K2·[22K1+1]
{circle around (4)} In the case where 11I7 is a start point (camera image pickup center)
X coordinate=12K8·12K7·12K6·22K5
Y coordinate=12K4·12K3·12K2·[22K1+1]
{circle around (5)} In the case where 11I12 is a start point (camera image pickup center)
X coordinate=11K8·11K7·21K6·21K5
Y coordinate=12K4·12K3·[22K2·22K1+1]
{circle around (6)} In the case where 11I16 is a start point (camera image pickup center)
X coordinate=12K8·12K7·22K6·22K5−1
Y coordinate=12K4·12K3·[22K2·22K1+1]
{circle around (7)} In the case where 12I4 is a start point (camera image pickup center)
X coordinate=12K8·12K7·22K6·22K5
Y coordinate=12K4·12K3·[22K2·22K1+1]
{circle around (8)} In the case where 12I8 is a start point (camera image pickup center)
X coordinate=12K8·12K7·22K6·22K5
Y coordinate=12K4·12K3·[22K2·22K22K1+1]
{circle around (9)} In the case where 21I9 is a start point (camera image pickup center)
X coordinate=11K8·21K7·21K6·21K5
Y coordinate=12K4·12K3·[22K2·22K1+1]−1
{circle around (10)} In the case where 21I13 is a start point (camera image pickup center)
X coordinate=12K8·22K7·22K6·21K5−1
Y coordinate=12K4·12K3·[22K2·22K1+1]−1
{circle around (11)} In the case where 22I1 is a start point (camera image pickup center)
X coordinate=12K8·22K7·22K6·22K5
Y coordinate=12K4·12K3·[22K2·22K1+1]−1
{circle around (12)} In the case where 22I5 is a start point (camera image pickup center)
X coordinate=12K8·22K7·22K6·22K5
Y coordinate=12K4·12K3·[22K2·22K1+1]−1
{circle around (13)} In the case where 21I16 is a start point (camera image pickup center)
X coordinate=21K8·21K7·21K6·21K5
Y coordinate=22K4·22K3·22K2·22K1
{circle around (14)} In the case where 21I14 is a start point (camera image pickup center)
X coordinate=22K8·22K7·22K6·22K5
Y coordinate=22K4·22K3·22K2·22K1
{circle around (15)} In the case where 22I2 is a start point (camera image pickup center)
X coordinate=22K8·22K7·22K6·22K5
Y coordinate=22K4·22K3·22K2·22K1
{circle around (16)} In the case where 22I6 is a start point (camera image pickup center)
X coordinate=22K8·22K7·22K6·22K5
Y coordinate=22K4·22K3·22K2·22K1
X coordinate=11K8·11K7·11K6·21K5
Y coordinate=12K4·12K3·12K2·[22K1+1]
{circumflex over (2)} In the case where 11I15 is a start point (camera image pickup center)
X coordinate=12K8·12K7·12K6·22K5−1
Y coordinate=12K4·12K3·12K2·[22K1+1]
{circle around (3)} In the case where 12I3 is a start point (camera image pickup center)
X coordinate=12K8·12K7·12K6·22K5
Y coordinate=12K4·12K3·12K2·[22K1+1]
{circle around (4)} In the case where 11I7 is a start point (camera image pickup center)
X coordinate=12K8·12K7·12K6·22K5
Y coordinate=12K4·12K3·12K2·[22K1+1]
{circle around (5)} In the case where 11I12 is a start point (camera image pickup center)
X coordinate=11K8·11K7·21K6·21K5
Y coordinate=12K4·12K3·[22K2·22K1+1]
{circle around (6)} In the case where 11I16 is a start point (camera image pickup center)
X coordinate=12K8·12K7·22K6·22K5−1
Y coordinate=12K4·12K3·[22K2·22K1+1]
{circle around (7)} In the case where 12I4 is a start point (camera image pickup center)
X coordinate=12K8·12K7·22K6·22K5
Y coordinate=12K4·12K3·[22K2·22K1+1]
{circle around (8)} In the case where 12I8 is a start point (camera image pickup center)
X coordinate=12K8·12K7·22K6·22K5
Y coordinate=12K4·12K3·[22K2·22K22K1+1]
{circle around (9)} In the case where 21I9 is a start point (camera image pickup center)
X coordinate=11K8·21K7·21K6·21K5
Y coordinate=12K4·12K3·[22K2·22K1+1]−1
{circle around (10)} In the case where 21I13 is a start point (camera image pickup center)
X coordinate=12K8·22K7·22K6·21K5−1
Y coordinate=12K4·12K3·[22K2·22K1+1]−1
{circle around (11)} In the case where 22I1 is a start point (camera image pickup center)
X coordinate=12K8·22K7·22K6·22K5
Y coordinate=12K4·12K3·[22K2·22K1+1]−1
{circle around (12)} In the case where 22I5 is a start point (camera image pickup center)
X coordinate=12K8·22K7·22K6·22K5
Y coordinate=12K4·12K3·[22K2·22K1+1]−1
{circle around (13)} In the case where 21I16 is a start point (camera image pickup center)
X coordinate=21K8·21K7·21K6·21K5
Y coordinate=22K4·22K3·22K2·22K1
{circle around (14)} In the case where 21I14 is a start point (camera image pickup center)
X coordinate=22K8·22K7·22K6·22K5
Y coordinate=22K4·22K3·22K2·22K1
{circle around (15)} In the case where 22I2 is a start point (camera image pickup center)
X coordinate=22K8·22K7·22K6·22K5
Y coordinate=22K4·22K3·22K2·22K1
{circle around (16)} In the case where 22I6 is a start point (camera image pickup center)
X coordinate=22K8·22K7·22K6·22K5
Y coordinate=22K4·22K3·22K2·22K1
[0093] When the dot pattern 1 is picked up as image data by means of the camera, if an error has occurred with the information dot 3, the closest information dot 3 equivalent to the information dot 3 is read, and then, the error is corrected, whereby the dot pattern 1 can be read in the minimum area from the image pickup center of the camera.
[0094] Utilizing the method for picking up information described above, a tablet or a digitizer that uses the XY coordinate and an input interface can be practiced. For example, with respect to the tablet or the digitizer, a transparent sheet on which the dot pattern 1 has been printed is superimposed on a target; an image is picked up by means of the camera; and then, the XY coordinate values of the dot pattern 1 are inputted.
[0095] Next, with reference to FIGS. 11 to 14 , a description will be given in further detail with respect to a case in which key dots 2 have been laid out at the positions different from those shown in FIG. 1 and a method of making searches for information dots 3 and key dots 2 in that case.
[0096] When an image pickup element such as a CCD or a CMOS serving as optical image pickup means first picks up reflection light of irradiation light irradiated on a medium face, the image pickup data (image data) is expanded on a memory frame buffer. Next, a central processing unit (CPU) of the optical image pickup means starts a search for the image data expanded on the frame buffer by means of a search program read out from the memory.
[0097] At this time, reference grid point dots 4 configuring an outer frame of a block are linearly laid out at predetermined intervals, so that the central processing unit (CPU) determines whether or not a straight line is substantially obtained by connecting these linearly laid out dots to each other (refer to FIG. 11 ).
[0098] Then, it is determined whether or not the dots existing on the reference grid line 78 are laid out by predetermined length. At this time, if a distance between dots is equal to another distance, such dots are determined to be reference grid point dots 4. In the case where dots are laid out differently, these dots are determined to be key dots 2 (FIG. 14 ).
[0099] Next, reference grid point dots 4 in the vertical arid horizontal directions (virtual reference grids 6) are connected to each other by means of straight lines (grid lines 8a, 8b), a cross point therebetween is defined as a virtual grid point 11 (first virtual grid point). Next, virtual reference grid points 6 in the oblique direction are connected to each other, an oblique grid line 8c is defined, and a cross point between these oblique grid lines 8c is further defined as a virtual grid point 12 (second virtual grid point).
[0100] Next, while either of the above two types of virtual grid points 11, 12 is defined as a start point, a search is made for information dots in a spiral manner (refer to FIG. 13 ).
[0101] Then, with respect to four portions (four virtual grid points existing at positions at which intervals are equal to each other in the vertical and horizontal directions from a block center in FIG. 14 ) at which key dots 2 can be laid out in a block, it is determined which of the dots is a key dot 2, with reference to the orientation and length of a respective one of the information dots 3 from the virtual grid points. In this manner, the information possessed by information dots 3 is determined by identifying the orientation.
[0102] As shown in FIG. 14 , in the case where an information dot 3 other than a block center is defined as a key dot 2 (in the case of FIG. 14 , where the position shifted in the upward direction by one virtual grid point from a block center is defined as the layout position of the key dot 2), there is a possibility that an information dot 3 that exists at a corresponding position when the block center is turned as a rotational axis by 90 degrees cannot be discriminated from a key dot 2 if the information dot is read by optical reader means. However, the manner of imparting the information dot 3 in the corresponding rectangular area other than the key dot 2 is made different, whereby the key dot 2 and the information dot 3 can be discriminated from each other.
[0103] For example, as shown in FIG. 14 , it is sufficient if the key dot 2 is laid out as a vector in only the vertical and horizontal directions from a virtual reference grid point 6 and if information is defined in an oblique direction in another rectangular area existing at a position turned by 90 degrees.
[0104] In addition, with respect to the key dot 2, while length of a vector is defined as a predetermined length, information may be defined by means of a vector different from another one in another rectangular area existing at a position turned by 90 degrees.
[0105] In the case where the key dot 2 has been laid out at the block center, with respect to another information dot 3, information may be defined in any of the vertical, horizontal, and oblique directions.
[0106] The dot pattern 1 of the present invention, as described above, is printed on a printed matter such as a picture book or a text, and then, image data is picked by means of the camera. From the image data, a search is made for positions of information dots. From information on the positions, codes or XY coordinates are decoded. The voices, still pictures, motion pictures, characters, programs or the like corresponding to the codes or XY coordinates, are outputted from constituent elements such as a liquid crystal display device, s speaker, and a voice/image output terminal of equipment such as a personal computer, an information output device, a PDA (Personal Data Assistant), or a portable cellular phone.
[0107] With respect to an information dot 3 of the block, information may be defined depending on a position that exists in the block of the information dot 3 while the distance and direction from the virtual grid points 11, 12 are arbitrarily limited by information dot 3.
[0108] More specifically, specification may be defined such that the distance and direction from the virtual grid points 11, 12 has been changed by type of industry using the dot pattern (by manufacturer, by service industrial field or by company using this dot pattern).
[0109] In this way, the dot pattern of the present invention can be utilized discriminately by limited usage, making it possible to ensure the security against leakage such as information leakage or code system leakage between types of industries or between companies. In other words, the limited defined information can be provided so as to readable only by the optical reader means corresponding thereto.
[0110] The present invention is not limitative to the embodiments of the invention described above. As long as a large amount of data is defined in a dot pattern by imparting different functions to dots 2, 3, 4 of a dot pattern 1, predetermined information or programs are outputted, and then, a variety of uses are enabled by recognizing directivity and speedily providing information, the present invention is not limitative to the embodiments described above. Of course, various modifications can occur without departing from the spirit of the present invention.
[0111] For example, the dots (information dots 3 or key dots 2), which are laid out around a cross point (virtual grid point 11) of grid lines 8a, 8b in the vertical and horizontal directions, may be shifted from the virtual grid point 11 onto the cross point. In addition, the dots at the cross point on an oblique grid line 8c may be laid out on the oblique grad line 8c similarly. In this way, dots are always laid out on the grid lines 8a, 8b, 8c, whereby an algorithm of a reading program for making a search for the grid lines 8a, 8b, 8c can be simplified and reading efficiency can be remarkably improved.
[Industrial Applicability]
[0112] As has been described above, according to the information input/output method using dot patterns, of the present invention, a dot pattern is picked up as image data by means of a camera, a reference grid point is first recognized and a key dot is extracted, directivity is recognized by means of the key dot, so that the direction can be used as a parameter. Next, by extracting the information dot laid out at the periphery of this key dot, information and programs can be outputted speedily.
[0113] In addition, a reference grid point dot is laid out in a dot pattern, so that, when this dot pattern is picked up as image data by means of the camera, a distortion can be corrected to a dot pattern picked up as an image due to a lens distortion of the camera or a distortion exerted at the time of oblique image pick, paper face expansion or contraction, medium surface curling, or printing.
[0114] Further, an error relative to a dot layout state can be checked, and security can be further enhanced.
Claims
The invention claimed is:
1. A printed material printed with a dot pattern adapted for information input/output in which a plurality of fine dots are arranged in a rectangular area of a square or rectangular block on a medium surface on the basis of a dot code generating algorithm in accordance with a predetermined rule, the fine dots being used for recognition of a variety of information, the dot pattern comprising:
reference grid point dots arranged on virtual reference grid points virtually provided at predetermined intervals on virtual straight lines in a vertical direction and a horizontal direction configuring a frame of the block; and
one or a plurality of information dots, each of which is arranged with a distance and a direction with reference to each of a virtual grid point at a point of intersection of grid lines provided by virtually connecting the virtual reference grid points to each other, the grid lines being straight lines parallel to the reference grid lines.
2. The printed material printed with the dot pattern, according to claim 1, wherein, the reference grid point dots are arranged only on the virtual reference grid points.
3. The printed material printed with the dot pattern, according to claim 1, wherein, the reference grid point dots are arranged on each of the virtual reference grid points.
4. The printed material printed with the dot pattern, according to claim 1, wherein, in the block, one or a plurality of information dots are further placed, each of which has a distance and a direction with reference to each of a virtual grid point at a point of intersection of oblique grid lines connecting the virtual reference grid points in an oblique direction.
5. The printed material printed with the dot pattern, according to claim 1, wherein, at a boundary between areas that define different information on a medium surface, the dot pattern causes recognition of the boundary of the areas by whether or not a dot is arranged on the virtual grid point, instead of arranging the information dot.
6. The printed material printed with the dot pattern, according to claim 1, wherein the dot pattern has an area that defines no information on a medium surface, and causes recognition of the area that defines no information by whether or not a dot is arranged on the virtual grid point, instead, of arranging the information dot.
7. The printed material printed with the dot pattern, according to claim 1, wherein the dot pattern defines information by whether a dot is arranged on the virtual grid point as the information dot or not, in addition to arranging the information dot.
8. The printed material printed with the dot pattern according to claim 1, further comprising a key dot that defines the orientation of the block and is placed at a position that is shifted from at least one virtual reference grid point on the reference grid line configuring the block.
9. The printed material printed with the dot pattern, according to claim 1, wherein an information dot at a predetermined position among the information dots is defined as a key dot in the block, and information of the information dot placed in a respective rectangular area by rotating the rectangular area by 90 degrees around the block center is defined by a direction or a distance that excludes a direction required to define the key dot.
10. The printed material printed with the dot pattern, according to claim 1, wherein information of the information dot in the block is defined by arbitrarily limiting the position of the information dot in the block by a distance and a direction thereof from the virtual grid point for each information dot.
11. A dot pattern adapted for information input/output, in which a plurality of fine dots are arranged in a rectangular area of a square or rectangular block on a medium surface on the basis of a dot code generating algorithm in accordance with a predetermined rule, the fine dots being used for recognition of a variety of information, the dot pattern comprising:
reference grid point dots arranged on virtual reference grid points virtually provided at predetermined intervals on virtual straight lines in a vertical direction and a horizontal direction configuring a frame of the block; and
one or a plurality of information dots, each of which is arranged with a distance and a direction with reference to each of a virtual grid point at a point of intersection of grid lines provided by virtually connecting the virtual reference grid points to each other, the grid lines being straight lines parallel to the reference grid lines.
12. An optical reading device comprising:
a reading unit that obtains the dot pattern according to claim 1, as image data; and
a processor that analyzes the image data and decodes a numeric value defined by the dot pattern.
13. A reading method comprising:
obtaining the dot pattern according to claim 1, as image data; and
by a processor, analyzing the image data and decoding a numeric value defined by the dot pattern.
14. An electronic device storing a sequence of instructions for causing a processor to execute:
from a reading unit, obtaining the dot pattern according to claim 1, onto the processor as image data; and
analyzing the image data and decoding a numeric value defined by the dot pattern.
15. A dot pattern reading device comprising:
a reading unit that obtains the dot pattern according to claim 1, as image data; and
a processor that analyzes the image data, decodes a numeric value defined by the dot pattern, and controls an information output device based on the decoded numeric value.
16. A reading method comprising:
obtaining the dot pattern according to claim 1, as image data;
by a processor, analyzing the image data and decoding a numeric value defined by the dot pattern; and
controlling an information output device based on the decoded numeric value.
17. An information processing device for using a dot pattern reading method, the information processing device comprising:
a reading unit that obtains the dot pattern according to claim 1, as image data; and
a processor that analyzes the image data, decodes a numeric value defined by the dot pattern, and executes a processing corresponding to the decoded numeric value.
18. A non-transitory computer-readable medium storing a dot pattern generation program for generating the dot pattern according to claim 1.
19. A dot pattern generation device comprising:
a processor programmed in accordance with a dot pattern generation algorithm for generating the dot pattern according to claim 1; and
a transmission unit that transmits the dot pattern, to a dot pattern output unit.
20. A dot pattern generation method of a dot pattern comprising:
generating the dot pattern according to claim 1 in accordance with a dot pattern generation algorithm for generating the dot pattern; and
transmitting the dot pattern to a dot pattern output unit.
21. An information input and output device comprising:
a reading unit that obtains the dot pattern according to claim 1, as image data;
a processor that analyzes the image data and decodes a numeric value defined by the dot pattern; and
an output unit that outputs at least one of a voice, an image, a moving image, a character, and an executed result of a program that are related with the numeric value decoded by the processor.
22. An information input and output method using a dot pattern comprising:
from a reading unit, obtaining the dot pattern according to claim 1, as image data;
by a processor, decoding the dot pattern; and
outputting at least one of a voice, an image, a moving image, a character, and an executed result of a program that are related with a numeric value decoded by the processor.
23. An electronic device, storing a sequence of instructions for causing a processor to execute a method comprising:
from a reading unit, obtaining the dot pattern according to claim 1, onto the processor as image data;
by a processor, decoding the dot pattern; and
outputting at least one of a voice, an image, a moving image, a character, and an executed result of a program that are related with a numeric value decoded by the processor.
24. The information processing device for reading the dot pattern according to claim 17, wherein the processing corresponding to the decoded numeric value is outputting of at least one of a voice, an image, a moving image, a character, and an executed result of a program.
Patent Citations (32)
| Patent | Date | Inventor | Cited By |
|---|---|---|---|
| US6133927(A) | 2000-10-01 | Arai et al. | Applicant |
| US6186405(B1) | 2001-02-01 | Yoshioka | Applicant |
| US6460155(B1) | 2002-10-01 | Nagasaki et al. | Applicant |
| US6548768(B1) | 2003-04-01 | Pettersson et al. | Applicant |
| US6633008(B2) | 2003-10-01 | Johnson | Applicant |
| US6633526(B1) | 2003-10-01 | Imade et al. | Applicant |
| US6674427(B1) | 2004-01-01 | Pettersson et al. | Applicant |
| US7475824(B2) | 2009-01-01 | Yoshida | Applicant |
| US8031375(B2) | 2011-10-01 | Yoshida | Applicant |
| US2005/0173544(A1) | 2005-08-01 | Yoshida | Applicant |
| US2006/0154559(A1) | 2006-07-01 | Yoshida | Applicant |
| US2007/0164110(A1) | 2007-07-01 | Yoshida | Examiner |
| CA2519271(A1) | 2004-09-01 | Applicant | |
| EP407734(A1) | 1991-01-01 | Applicant | |
| EP1548635(A1) | 2005-06-01 | Applicant | |
| EP1703434(A1) | 2006-09-01 | Applicant | |
| EP1833001(A1) | 2007-09-01 | Applicant | |
| EP1876555(A1) | 2008-01-01 | Applicant | |
| JP10-187907(A) | 1998-07-01 | Applicant | |
| JP10-257309(A) | 1998-09-01 | Applicant | |
| JP2003-511761(A) | 2003-03-01 | Applicant | |
| JP2002-380503 | 2004-04-01 | Applicant | |
| JP2002-380932 | 2004-04-01 | Applicant | |
| JP2002-381743 | 2004-04-01 | Applicant | |
| RU2126598(C1) | 1999-02-01 | Applicant | |
| WO95/14346(A1) | 1995-05-01 | Applicant | |
| WO/73981(A1) | 2000-12-01 | Applicant | |
| WO1/26032(A1) | 2001-04-01 | Applicant | |
| WO2/23464(A1) | 2002-03-01 | Applicant | |
| WO3/049023(A1) | 2003-06-01 | Applicant | |
| WO2004/029871(A1) | 2004-04-01 | Applicant | |
| WO2004/084125(A1) | 2004-09-01 | Applicant |
Non-Patent Literature (16)
- Russian Office Action dated Apr. 28, 2005, issued in corresponding Russian Patent Application No. 2007-144103.Applicant
- European Search Report dated Jun. 18, 2010, issued in corresponding European Peant Application No. 05737287.2.Applicant
- International Search Report of PCT/JP2005/008210, date of mailing Aug. 16, 2005.Applicant
- Translation of the International Preliminary Report on Patentability of International Application No. PCT/JP2005/008210 mailed Oct. 30, 2007 ( Forms PCT/IB/373 and PCT/ISA/237).Applicant
- Notice of Allowance dated Apr. 4, 2012, issued in related U.S. Appl. No. 11/794,174 (now U.S. patent No. 8,237,983).Applicant
- Russian Office Action dated Jan. 19, 2009, issued in corresponding Russian Patent Application No. 2007128915/09(031489). Cited in related U.S. Appl. No. 11/794,174 (now U.S. patent No. 8,237,983). with English Translation.Applicant
- Russian Office Action dated Nov. 17, 2008 (mailing date), issued in corresponding Russian Patent Application No. 2007128915/09(031489). Cited in related U.S. Appl. No. 11/794,174 (now U.S. patent No. 8,237,983), with English Translation.Applicant
- International Preliminary Report on Patentability dated Oct. 30, 2007, issued in corresponding PCT Application No. PCT/JP2005/008210 (Form PCT/IB/373 and Form PCT/ISA/237). Cited in related U.S. Appl. No. 11/794,174 (now U.S. patent No. 8,237,983).Applicant
- International Search Report of PCT/JP2004/019613, date of mailing Apr. 12, 2005.Applicant
- International Preliminary Report dated Jul. 3, 2007, issued in corresponding PCT Application No. PCT/JP2004/019613 (Form PCT/IB/373 and Form PCT/ISA/237).Applicant
- U.S. Office Action (Notice of Allowance) dated Apr. 4, 2012, issued in related U.S. Appl. No. 11/794,174 (now U.S. patent No. 8,237,983).Applicant
- U.S. Office Action dated Jul. 12, 2011, issued in related application No. 11/794,174 (now U.S. patent No. 8,237,983).Applicant
- U.S. Office Action (Notice of Allowance) dated Feb. 28, 2012, issued in related U.S. Appl. No. 11/794,174 (now U.S. patent No. 8,237,983).Applicant
- Extended European Search Report dated Aug. 14, 2013, issued in corresponding European Patent Application No. 12173995.7.Applicant
- European Notice of Opposition to a European Patent dated Aug. 13, 2013, issued in corresponding European Patent Application No. 05737287.2.Applicant
- German Cancellation Action dated Apr. 30, 2012, issued in German Patent Application DE 202005022002.7, w/ English-language explanation of relevance.Applicant