US 12,700,264 B2Grant

Method for recognizing a fake eyeball using lights at two wavelengths

Issue Date:2026-08-04

•5 Claims

•4 Drawing Sheets

Abstract

A method for recognizing a fake eyeball using lights at two wavelengths comprises the steps of: illuminating simultaneously an eye region with lights at a first and a second wavelength; acquiring a single image of said eye region of said user, by using an imaging device in which R-color sensing elements, G-color sensing elements and B-color sensing elements are arranged; setting an inspection area by specifying a scleral portion, in said single image; calculating a first color average detection amount by averaging the detection amounts of the first color sensing elements at a location corresponding to said inspection area and a second color average detection amount by averaging the detection amounts of the second color sensing elements at the location corresponding to said inspection area; and calculating a ratio between said first and said second color average detection amounts, and comparing said ratio with a predetermined reference ratio.

Metadata

Assignee

CMITECH CO., LTD.

Inventors

Jang-Jin Chae
Woong Park

Application Information

Application Number:US 18/716,803

Filing Date:2023-08-11

Priority Date:2022-08-12

Art Unit:2665

Classifications

IPC:

G06V40/40G06V10/143G06V10/56G06V40/19

Field of Search:

G06V 40/40G06V 10/143G06V 10/56

Patent Drawings (4 sheets)

Description

Cross-Reference to Related Applications

[0001] This application is the U.S. national phase of International Application No. PCT/KR2023/011949 filed Aug. 11, 2023 which designated the U.S. and claims priority to KR Patent Application No. 10-2022-0101144 filed Aug. 12, 2022, the entire contents of each of which are hereby incorporated by reference.

Field of the Invention

[0002] The present invention relates to a method for recognizing a fake eyeball. More specifically, the present invention relates to a method for recognizing a fake eyeball using lights at two wavelengths.

Background

[0003] Recently, as iris-based security systems have become widely used, fraudulent authentication attempts using fake eyeballs, contact lenses, or prints on which pre-enrolled users' iris is printed have become an issue.

[0004] As a prior art for detecting fraudulent authentication attempts using a fake eyeball there is a Korean Patent No. 10-0691772 (hereinafter referred to as “Prior Art 1”). Said Prior Art 1 discloses that the user's eye is illuminated with a short-wavelength infrared light at a wavelength of 750 nm to obtain a short-wavelength eye image, the ratio of the brightness of the iris region to that of the sclera region (short-wavelength reflectance ratio) is calculated, and then, the user's eye is illuminated with long-wavelength infrared light at a wavelength of 850 nm to obtain a long-wavelength eye image, the ratio of the brightness of the iris region to that of the sclera region (long-wavelength reflectance ratio) is calculated, a fake eyeball is recognized using short-wavelength reflectance ratio and the long-wavelength reflectance ratio.

[0005] However, the Prior Art 1 discloses the method of photographing twice by performing separately the illumination at the different wavelengths. Therefore, while photographing by performing separately illumination twice, the reflection condition of the eyeball may change depending on the illumination state of the illuminating devices and the posture or gaze of the user, and thus the accuracy of recognizing a fake eyeball may vary.

[0006] As another prior art for recognizing a fake eyeball, there is a Korean Patent No. 10-1032499 (hereinafter referred to as “Prior Art 2”). Said Prior Art 2 discloses that an iris image is acquired by illuminating simultaneously lights at different wavelengths, the acquired iris image is separated per wavelength band using a CCD filter, the response degrees from the iris images separated per wavelength band is obtained, and the fake eyeball is recognized using the response degrees of the iris images separated per wavelength band.

[0007] In the Prior Art 2, lights with two wavelengths are simultaneously illuminated and iris images per wavelength are acquired using a dedicated CCD in which cells with L wavelength characteristics and cells with S wavelength characteristics are alternately formed.

[0008] In other words, the Prior Art 2 has the problem that it requires the dedicated CCD configured to detect only the L and S wavelengths.

[0009] In addition, the Prior Art 2 describes using a subtraction image of images at different wavelengths or an iris image to recognize a fake eyeball, but does not describe specific ways for doing so.

Summary

[0010] It is an object of the present invention to solve the problems described above, and to provide a method for recognizing whether an eye is fake and/or whether an iris is fake using a single image taken by only one illumination.

[0011] It is another object of the present invention to provide a method for obtaining images at different wavelengths, using commonly available color imaging components.

[0012] It is a further object of the present invention to provide specific ways for recognizing a fake eyeball using images at different wavelengths.

[0013] A method for recognizing a fake eyeball using lights at two wavelengths, which is for resolving the object of the present invention, comprises the steps of: illuminating simultaneously an eye region including the iris and sclera of a user with a light at a first wavelength and a light at a second wavelength;

- [0014] acquiring, synchronously with said illuminating, a single image of said eye region of said user, by using an imaging device in which R-color sensing elements, G-color sensing elements and B-color sensing elements are arranged in a Bayer pattern; setting an inspection area by specifying a scleral portion (E_S), in said single image; calculating a first color average detection amount by averaging the detection amounts of the first color sensing elements at a location corresponding to said inspection area in said single image and a second color average detection amount by averaging the detection amounts of the second color sensing elements at the location corresponding to said inspection area in said single image; and calculating a ratio (A_average) between said first color average detection amount and said second color average detection amount, and comparing said ratio (A_average) with a predetermined reference ratio (A_Ref) to determine whether said user's eye is a fake eyeball.

[0015] The first wavelength may be selected in the range of 750±50 nm and said second wavelength may be selected in the range of 850±50 nm.

[0016] The first color sensing elements may be R-color sensing elements, and the second color sensing elements may be B-color sensing elements.

[0017] The reference ratio (A_Ref) may be a ratio (A_{average_living}) between a first color average detection amount and a second color average detection amount each measured at a sclera portion (E_S) of the user's eye, and wherein the ratio (A_{average_living}) have been initially registered by the user to perform the method for recognizing a fake eyeball.

[0018] The reference ratio (A_Ref) may be a ratio (A_{average_artificial}) between a first color average detection amount and a second color average detection amount experimentally measured using an arbitrary fake eyeball in the sclera portion of an arbitrary fake eyeball.

[0019] According to the present invention which includes the configuration as described above, it is possible to take a single image by only one illumination and to recognize whether an eye is fake by the single image taken.

[0020] Furthermore, the present invention is capable of obtaining images of different wavelengths, even if a conventional color imaging component is used. Therefore, it is not necessary to prepare a dedicated imaging component for acquiring images at different wavelengths.

[0021] Furthermore, the present invention provides specific ways for recognizing a fake eyeball using images at different wavelengths.

Brief Description of the Drawings

[0022] FIG. 1 illustrates a schematic configuration of a fake eyeball recognition device using lights at two different wavelengths, according to one embodiment of the present invention.

[0023] FIG. 2 illustrates an example of setting an inspection region in an acquired eye image.

[0024] FIGS. 3a and 3b respectively illustrate the Bayer pattern of a color imaging component and a graph of quantum efficiency per wavelength of each color sensing element in a color imaging component.

[0025] FIG. 4 is a flow chart illustrating a method for recognizing a fake eyeball using lights at two different wavelengths, according to another embodiment of the present invention.

Detailed Description

[0026] Hereinafter, with reference to the accompanying drawings, a preferred embodiment of a method for recognizing a fake eye using two wavelengths at light according to the present invention will be described. Furthermore, the terms referring to each component of the present invention are named exemplarily in view of its function and should not be understood as predicting and limiting the technical ideas of the present invention by the terms themselves.

[0027] Furthermore, the various embodiments of the invention that will be described hereinafter are intended only to illustrate the technical ideas of the invention by way of example. Accordingly, the scope of protection of the present invention should be interpreted in accordance with the appended claims. Furthermore, one having ordinary skilled in the art to which the invention pertains will be able to design various modifications and variations without departing from the essential features of the invention. Therefore, the scope of the invention should be interpreted as encompassing all technical ideas within the scope equivalent to the present invention.

[0028] First, with reference to FIGS. 1 to 3b, the configuration and operation of a fake eyeball recognition device 100 using lights at two different wavelengths presented in the present invention will be described. FIG. 1 illustrates a schematic configuration of a fake eyeball recognition device 100 for performing the method of recognizing a fake eyeball using lights at two different wavelengths, according to one embodiment of the present invention. FIG. 2 illustrates an example of setting an inspection region in an acquired eye image, wherein an example of an iris region and a sclera region are shown. FIG. 3a illustrates the Bayer pattern of a color imaging component and FIG. 3b is a graph which illustrates a quantum efficiency per wavelength of each color sensing element.

[0029] Referring to FIG. 1, a fake eyeball recognition device 100 according to one embodiment of the present invention may include an illuminating part 110, an imaging part 120, and a determining part 130.

[0030] The illuminating part 110 is configured to simultaneously irradiate light at the first wavelength and light at the second wavelength to the eye region including the iris and sclera of the user. The illuminating part 110 may comprise a single light source capable of emitting both the light at the first wavelength and the light at the second wavelength together. Alternatively, the illuminating part 110 may comprise a first light source emitting the light at the first wavelength and a second light source emitting the light at the second wavelength, and operate them simultaneously.

[0031] The imaging part 120 may be a camera with a color imaging component. The color imaging component may include a CCD in which an R-color sensing element for detecting the red color, a B-color sensing element for detecting the blue color, and a G-color sensing element for detecting the green color are arranged, for example, in a Bayer pattern (see FIG. 3a).

[0032] In other words, the imaging part 120 of the present invention is characterized in that it uses an imaging component which can be mounted on a commercially available camera and which has elements for detecting R, G, and B colors in the visible light region. (This means, for example, that the imaging part of the present invention does not utilize a specially designed imaging component which has arranged alternately only elements for detecting light at a wavelength of 750 nm and elements for detecting light at a wavelength of 850 nm.) On the other hand, this commonly commercialized imaging element is capable of detecting light in the infrared wavelength range due to the basic nature of the sensing elements of each color (see FIG. 3b). The present invention takes advantage of the fact that this commonly commercialized imaging element is capable of detecting light in the infrared wavelength range.

[0033] Meanwhile, the imaging part 120 receives lights reflected from the pupil of the user's eye (including the iris and sclera) and the area around the eye in synchronization with the time when the illuminating part 110 irradiates light toward the user's eye, and acquires (or photographs) a single image of the eye.

[0034] In the present invention, the light at the first wavelength may be infrared light at a wavelength of 750±50 nm. Further, the light at the second wavelength may be infrared light at a wavelength of 850±50 nm.

[0035] Alternatively, referring to the quantum efficiency of respective color sensing elements in the color imaging element, the light having a high detection amount in one color sensing element can be selected as the light at the first wavelength and the light having a high detection amount in the other color sensing element can be selected as the light at the second wavelength.

[0036] The determining part 130 may be configured to analyze one image acquired by the imaging part 120, determine whether the currently imaged eye is a fake eyeball, and transmit the determined result to outside.

[0037] Specifically, the determining part 130 determines whether the currently photographed eye is a fake eyeball, by setting an inspection area in the single acquired image, obtaining respective average values of detection amounts (or light intensities) of the same color sensing elements at the location corresponding to the inspection area, calculating a ratio (A_average) between the obtained average values for two different colors, and comparing the calculated ratio to a predetermined reference ratio (A_Ref).

[0038] For example, it is possible to recognize a fake eyeball, by obtaining a ratio between the average value of the detected amounts for the inspection area by the R-color sensing elements and the average value of the detected amounts for the inspection area by the B-color sensing elements, and comparing the obtained ratio with a reference ratio (A_{Ref_artificial}) pre-calculated using the fake eyeball.

[0039] By another method, it is possible to determine whether the currently photographed eye is a fake eyeball, by obtaining a ratio between the average value of the detection amounts by the R-color sensing elements and the average value of the detection amounts by the B-color sensing elements from the eye image of the user taken when the user first attempts to register his or her eye with the fake eyeball recognition device or when the user attempts to input the reference ratio using his or her eye, defining the value of the obtained ratio as a reference ratio (A_{Ref_living}), and then comparing the ratio (A_average) calculated from the currently photographed eye image with the reference ratio (A_{Ref_living}).

[0040] Referring to FIG. 2, a way of setting an inspection area in the present invention will be described. The fake eyeball recognition device 100 according to the present invention, when acquiring an eye image of a user, can identify eyebrows, eyelids, pupils, irises, sclera, etc. from the eye image using a contrast/color/chroma distribution of the eye image.

[0041] In the present invention, the sclera portion (E_S) of the user's eye image is set as an inspection area to determine whether the currently photographed eye is a fake eyeball.

[0042] The sclera is typically white in color (regardless of the color of the iris) and has little individual variation. Therefore, it is possible to recognize a fake eyeball, by comparing the ratio (A_{average_sclera}) calculated from the sclera portion (E_S) of the user's currently photographed eye image to a pre-calculated reference ratio (A_{Ref_artificial sclera}) using the sclera of a fake eyeball or eye printout or a white sheet of paper.

[0043] In this case, if the ratio (A_{average_sclera}) calculated from the current user is similar to the reference ratio (A_{Ref_artificial sclera}), the photographed eye may be determined to be a fake eyeball.

[0044] In the meantime, the reference ratio may be a previously obtained and calculated ratio (A_{Ref_living sclera}) from the said user. In this case, if the currently obtained and calculated ratio (A_{average_sclera}) from the user is similar to the reference ratio (A_{Ref_living sclera}) previously obtained from the user, the photographed eye will be determined to be a real eyeball.

[0045] In the present invention, the infrared lights used for recognizing a fake eyeball in the present invention may be infrared lights in the wavelength range of 750±50 nm and infrared light in the wavelength range of 850±50 nm. These wavelengths are chosen because short wavelength infrared light penetrates the human skin (pupil) shallowly and is reflected instantly from the surface of the pupil or from shallow skin, and long wavelength infrared light penetrates the human skin deeply and is reflected weakly, and these different reflective properties can be utilized. On the other hand, infrared light cannot penetrate the fake eyeball, so infrared light will be reflected with high reflectance from the surface of the fake eyeball.

[0046] In the present invention, an R-color sensing element is used to measure the reflected light at short-wavelength infrared light, and a B-color sensing element is used to measure the reflected light at long-wavelength infrared light.

[0047] Referring to FIG. 3b, the B-color sensing element has a low quantum efficiency for the short wavelength infrared light at 750 nm and a high quantum efficiency for the long wavelength infrared light at 850 nm. Therefore, using the B-color sensing element, it is possible to detect and measure the reflected light at the long wavelength infrared light at 850 nm even if the light at 750 nm and the light at 850 nm are irradiated together.

[0048] Meanwhile, the R-color sensing element has approximately similar quantum efficiency for the short wavelength of 750 nm and the long wavelength of 850 nm. Therefore, for example, the detection amount of reflected light of the B-color sensing element can be subtracted from the detection amount of reflected light of the R-color sensing element to obtain the detection amount of infrared light at a short wavelength of 750 nm.

[0049] In this case, the G-color sensing element is not used in the present invention because the difference between the quantum efficiencies of the 750 nm and the quantum efficiencies of the 850 nm of the G-color sensing element is not very large compared to other sensing elements and the quantum efficiencies of the 750 nm and the quantum efficiencies of 850 nm are not similar to each other.

[0050] However, which wavelength of light to select and which color sensing element to utilize can be determined based on the characteristics of the imaging device, because the quantum efficiency per wavelength of each of these color sensing elements can vary depending on the design and materials of each color sensing element.

[0051] In particular, the present invention recognizes a fake eyeball, by obtaining average reflectance values of each of infrared lights of two different wavelengths (i.e., average values of the detection amount of color sensing elements for each color), and comparing the ratio (A_average) of the average values to a reference ratio (A_Ref). This results in a higher recognition accuracy compared to detecting fake eyeballs using an infrared light at single wavelength. In addition, since a single value is calculated (i.e., a ratio of the average values of the detection amount of color sensing elements for each color) and the fake eyeball is recognized using the calculated single value, the processing result is clear and the processing speed is fast.

[0052] Next, referring to the flowchart shown in FIG. 4, a method for recognizing a fake eyeball using lights at two wavelengths will be described, by using the fake eyeball recognition device 100 as described above.

[0053] First, by using the illuminating part 110, a light at the first wavelength and a light at the second wavelength are simultaneously irradiated to the eye area of the user including the iris portion and the sclera portion (S10).

[0054] Then, by using an imaging element in which R-color sensing elements, G-color sensing elements and B-color sensing elements are arranged in a Bayer pattern, the eye area of the user is photographed once in synchronization with the time of irradiation of the lights, and thus a single eye image is obtained (S20).

[0055] An inspection area is set on the photographed single eye image (S30). The inspection area may be set in the scleral region (E_S).

[0056] Then, a first color average detection amount is calculated by averaging the light detection amounts of the first color sensing elements, such as the R-color sensing elements, at the location corresponding to the sclera portion E_S. Further, the second color average detection amount is calculated by averaging the light detection amounts of the second color sensing elements, such as the B-color sensing elements, at the location corresponding to the sclera portion E_S (S40).

[0057] Then, it may be determined whether said user's eye is a fake eyeball, by calculating a ratio (A_average) between the first color average detection amount and the second color average detection amount, and comparing the calculated ratio (A_average) with a predetermined reference ratio (A_Ref) (S50).

Claims

What is claimed is:

1. A method for recognizing a fake eyeball using lights at two wavelengths, wherein the method is performed by an apparatus for recognizing whether an eye of a user is a fake eyeball by analyzing an eye image of the user, said method comprising:

illuminating simultaneously an eye region including the iris and sclera of a user with a light at a first wavelength and a light at a second wavelength;

acquiring, synchronously with said illuminating, a single image of said eye region of said user, by using an imaging device in which R-color sensing elements, G-color sensing elements and B-color sensing elements are arranged in a Bayer pattern;

setting an inspection area by specifying a scleral portion (E_S), in said single image;

calculating a first color average detection amount by averaging the detection amounts of the first color sensing elements at a location corresponding to said inspection area in said single image and a second color average detection amount by averaging the detection amounts of the second color sensing elements at the location corresponding to said inspection area in said single image; and

calculating a ratio (A_average) between said first color average detection amount and said second color average detection amount, and comparing said ratio (A_average) with a predetermined reference ratio (A_Ref) to determine whether said user's eye is a fake eyeball.

2. The method according to claim 1, wherein said first wavelength is selected in the range of 750±50 nm and said second wavelength is selected in the range of 850±50 nm.

3. The method according to claim 1, wherein the first color sensing elements are R-color sensing elements, and the second color sensing elements are B-color sensing elements.

4. The method according to claim 1, wherein the reference ratio (A_Ref) is a ratio (A_{average_living}) between a first color average detection amount and a second color average detection amount each measured at a sclera portion (E_S) of the user's eye, and wherein the ratio (A_{average_living}) have been initially registered by the user to perform the method for recognizing a fake eyeball.

5. The method according to claim 1, wherein the reference ratio (A_Ref) is a ratio (A_{average_artificial}) between a first color average detection amount and a second color average detection amount experimentally measured using an arbitrary fake eyeball in the sclera portion of an arbitrary fake eyeball.

Patent Citations (10)

Patent	Date	Inventor	Cited By
US2016/0019420(A1)	2016-01-01	Feng	Examiner
US2016/0019421(A1)	2016-01-01	Feng	Examiner
US2018/0096119(A1)	2018-04-01	Yun	Examiner
CN114582008(A)	2022-06-01		Examiner
KR100691772(B1)	2007-03-01		Applicant
KR100711110(B1)	2007-04-01		Applicant
KR101032499(B1)	2011-05-01		Applicant
KR20110121874(A)	2011-11-01		Applicant
KR101286454(B1)	2013-07-01		Applicant
KR20240012724(A)	2024-01-01		Examiner

Non-Patent Literature (2)

International Search Report for PCT/KR2023/011949 dated Nov. 15, 2023, 7 pages.Applicant
Written Opinion of the ISA for PCT/KR2023/011949 dated Nov. 15, 2023, 3 pages.Applicant