METHOD AND SYSTEM FOR PERFORMING USER AUTHENTICATION

[0001] This application claims priority to U.S. Provisional Application Ser. No. 63/223,703, filed Jul. 20, 2021, U.S. Provisional Application Serial No. 63/149,592, filed Feb. 15, 2021, and U.S. Provisional Application Ser. No. 63/091,260, filed October 13, 2020, the entire contents of each of which are incorporated herein by reference.

[0002] The present invention generally relates to the field of security authentication. For example, the present invention relates to a system and method for performing user authentication for access to digital systems and content, computing systems and devices, and physical locations.

[0003] While advanced computing systems and the Internet have made it easier to access digital information and computer devices, it has also made it increasingly difficult to restrict access to digital information, computing devices and even physical locations as modern technology has introduced several vulnerabilities that may easily be exploited. Though user verification systems are often employed to restrict access to certain information, devices, computer systems or physical locations, these systems may be inappropriately accessed through deception and/or hacking or by otherwise bypassing verification systems. Further, users may permit unauthorized access to the foregoing by sharing user name and/or password information.

[0004] With respect to access to digital content and computer devices and systems, unique usernames and password combinations may help protect against unauthorized access. However, users often forget usernames and passwords as users typically have multiple online accounts, each with a different username and password. Also, the users may leave their usernames and passwords in plain view or may use generic passwords that may be easily determined. While solutions such as token generators and one-time passwords (OTP) have been developed, these solutions are prone to being tampered with and/or hacked. Also, these solutions are often overly complex and costly and may even require users to carry separate devices that generate tokens or passwords, which may be easily misplaced.

[0005] Regarding access to physical locations, several well-known approaches exist. For example, physical key cards that have unique digital identifiers may be used in combination with proximity readers to grant users access through doors or gates. However, these systems may be expensive and require users to keep key cards on their person. Further, if the key card may be used by unauthorized individuals to gain access to the restricted area. Access to physical locations may also be granted by entering in a unique passcode. However, these systems require a computing device that is prone to the same vulnerabilities described above with respect to digital authentication.

[0006] Also, while it is now easy to digitally review documents and apply a digital signature using well-known document execution applications (e.g., DocuSign by DocuSign, Inc. and Adobe Sign by Adobe Inc.), validating the identity of the user applying the digital signature is extremely difficult. While current systems may involve conventional passwords, including a one-time password (OTP), tokens or SMS text (e.g., numbers/code), and may even involve unique security questions, this information can be hacked and easily misappropriated or guessed. While a link to open a document may be sent to an email of an individual, the email may be hacked or accessible on computer that has been left unattended.

[0007] Previous systems have been described such as U.S. Pat. No. 7,894,634 to Chung, U.S. Pat. No. 7,941,664 to Wheeler, U.S. Pat. No. 10,491,588 to Krishan, U.S. Patent App. Pub. No. 2018/0183779 to Krishan, U.S. Patent App. Pub. No. 2019/0213430 to Schwartz, and U.S. Patent App. Pub. No. 2019/0222570 to Krishan, the entire contents of each of which are incorporated herein by reference. Accordingly, there is a need for improved methods and systems for performing user authentication involving a simple authentication process that is cost efficient, less susceptible to hacking and unauthorized password sharing, and otherwise overcomes one or more of the above-mentioned problems and/or limitations.

[0008] Provided herein are systems and methods for authenticating a user via an authentication system to provide access to digital systems and content, computing systems and devices, and physical locations. The authentication system preferably involves software that runs on at least one mobile device having at least one biometric sensor and at least one computing device that may be an interface device. The mobile device runs a mobile application and includes a display having a user interface. The authentication system may further include software that runs on at least one server that communicates with the mobile device. The mobile device is in communication with the computing device or interface device. The server is in communication with the computing device or interface device and may be in communication with the mobile device.

[0009] The authentication system may provide access to a website or a web portal. To access the website or web portal, a user may download the mobile application to the mobile device. An application may also be downloaded to the computing device upon which the website or web portal is accessed. Alternatively, the application may be downloaded on the backend of the website or web portal on a server. Using the mobile application, the user may set up a user profile and provide user identification information, authentication data include biometric data, and credential information (e.g., website usernames and passwords) to access certain websites or web portals. The user identification information (e.g., phone number and/or any other unique mobile device identifier) and the credential information may be shared with the server. The authentication data may be saved on the mobile device.

[0010] A user may initiate communication between the devices and provide the application on the computing device user identification information that may be validated by the server. A request for authentication data may be sent to the mobile device and the mobile application may prompt the user to generate authentication data including biometric information using the biometric sensor. The mobile application may compare the authentication data generated to the authentication data in the user's profile to validate the authentication data. The mobile application may inform the server that the user has been validated and the credential information may be sent to the website or web portal for access to the website or web portal.

[0011] The authentication system for access to a computing device, digital information or functionality, physical location or object involves a computing device in the form of an interface device that may or may not involve a display and that interfaces with the mobile device as well as a secure system having an open and closed position. A similar approach may be employed to gain access to the secure system involving the user using the mobile application to create a user profile and validating the user on the mobile device using authentication data generated by the mobile application.

[0012] An authentication method provided herein includes receiving a request for access from a first device, sending, after receiving the request for access, a first request for authentication to a second device associated with the first device, determining that the second device has not responded to the first request for authentication, sending, after determining that the second device has not responded, a second request for authentication to a third device associated with the first device, receiving biometric data from the third device, comparing the biometric data received from the third device to saved biometric data, and determining that the biometric data received from the third device matches the saved authentication data. The method may further include, granting access to digital content. The method may further include granting access to a physical location. A predetermined period of time may elapse between sending the request for first authentication and determining that the second device has not responded. The first, second device and third device may be associated in a user profile.

[0013] Another authentication method provided herein includes receiving a request for access from a first device, sending, after receiving the request for access, a first request for authentication to a second device associated with the first device, determining that the second device has not responded to the first request for authentication, sending, after determining that the second device has not responded, a second request for authentication to a third device associated with the first device, the second request for authentication instructing the third device to obtain biometric data and compare the biometric data to saved biometric data on the third device, and receiving confirmation that authentication on the third device was successful, the confirmation indicating that the biometric data obtained on the third device matched the saved biometric data on the third device. A predetermined period of time may have elapsed between sending the first request for authentication and determining that the second device has not responded. The method may further include granting access to digital content. The method may further include, granting access to a physical location. The first, second device and third device may be associated in a user profile.

[0014] A method for establishing symmetric encryption provided herein may include, determining a user profile, receiving a public key from a first device, sending a request for authentication using biometric information to a second device, the second device associated with the user profile, receiving confirmation that authentication was successful from the second device; generating a session private key based on successful authentication, encrypting the session private key using the public key to create an encrypted session private key, sending the encrypted session private key to the first device, and receiving an encrypted message that has been encrypted using the session private key from the first device. The method may further include decrypting the encrypted message using the session private key. The first device may be associated with the user profile. The biometric information may include one or more of retina scan information, iris pattern information, finger print scan information, finger vein scan information, face scan information, and voice pattern information. The public key may be associated with a private key on the first device.

[0015] The confirmation that authentication was successful may be indicative of confirmation of successful authentication on a third device in communication with the second device based on the biometric information. The method may further include determining a user identification value, wherein the user profile is determined based on the user identification value. The method may further include establishing a connection with the first device and requesting the public key from the first device. The method may further include sending a second request for authentication using a passphrase to the second device. Receiving confirmation that authentication was successful from the second device may be based on successful authentication using the biometric information and successful authentication using the passphrase.

[0016] A method for identifying and authenticating a user located in an area may include determining visual data indicative of the user in the area, determining a biometric property based on the visual data and corresponding to the user, identifying the user based on the biometric property, determining a device associated with the user, sending a request for authentication to the device, determining that the user is authenticated, sending a request for consent to send commercial messages to the device, and receiving consent to send commercial messages. The commercial messages may include at least one of a promotion, a coupon, and product data. The method may further include sending a request for consent to use visual data to the device, receiving consent to use visual data from the device, and determining user data corresponding at least one user action in the area. The user data may correspond to one or more of the location of the area, purchases made by the user, time spent in the area, and time of day.

[0017] The foregoing summary is illustrative only and is not intended to be in any way limiting. In addition to the illustrative aspects, embodiments, and features described above, further aspects, embodiments, and features will become apparent by reference to the following drawings and the detailed description.

[0036] The foregoing and other features of the present invention will become apparent from the following description and appended claims, taken in conjunction with the accompanying drawings. Understanding that these drawings depict only several embodiments in accordance with the disclosure and are, therefore, not to be considered limiting of its scope, the disclosure will be described with additional specificity and detail through use of the accompanying drawings.

[0037] The present invention is directed to a user authentication system that performs authentication tasks to grant a user access to a digital content, computing systems and devices, applications including document execution applications, and/or physical locations or objects. The user authentication system involves a mobile device that runs a user authentication application that performs authentication tasks. The mobile device may communicate with at least one other computing device (e.g., a server) to access to digital content, computing systems, applications, and devices and/or physical locations or objects upon successful authentication.

[0038] Referring now to FIG. 1, exemplary user authentication system 100 is illustrated. User authentication system 100 is designed to perform user authentication on mobile device 106 and grant access to digital content and systems. For example, user authentication system 100 may grant a user using mobile device 106 access to a web browser, a web portal or other software systems.

[0039] User authentication system 100 involves mobile device 106, computing device 110, server 102 and database 114. Mobile device 106 may be any device having processing power, storage, network connectivity, an input device, a display and preferably at least one biometric sensor. For example, mobile device 106 may be a mobile phone, personal computer, laptop, tablet or any other computing device having the foregoing features. Computing device 110 may be any device having processing power, storage, network connectivity, an input device and/or a display. For example, computing device 110 may be a laptop, personal computer, mobile phone, tablet or any other computing device having the foregoing features. Server 102 is one or more servers that is hosted and delivered through a cloud computing platform over the Internet, such as, for example, a cloud computing service. Server 102 may have the same components as computing device 110 but includes at least processor and network connectivity. Database 114 is a database that may include information such as the user profile, user identification information, authorization information, registration information, and/or credential information, as defined below, as well other information relevant to the authentication system. Database 114 may be stored on or otherwise incorporated into or part of server 102 or may be stored elsewhere and accessed by server 102.

[0040] Mobile device 106 is configured to run mobile application 318. Mobile application 318 may be any mobile software application configured to run on mobile device 106 and generate a user interface on mobile device 106, and programmed to perform the tasks executed on mobile device 106 described herein. Computing device 110 is configured to run application 220. Application 220 is a software application that may be web-based and that is configured to be executed on computing device 110 and/or hosted on server 102 and accessed via computing device 110.

[0041] Mobile device 106 running mobile application 318 may communicate with computing device 110 running application 220 to perform the operations herein described with respect to authentication system 100. Application 220 may be installed by the user on computing device 110 or installed on the backend of a website or web-based application. Mobile device 106 may communicate with computing device 110 via any well-known wired or wireless connection, described in further detail below. Mobile device 106, running mobile application 318, may connect to the Internet using any well-known methods and may communicate with computing device 110 and/or server 102 over the Internet. It is understood that mobile device 106 may communicate with computing device 110 and server 102 using different communication technologies or the same communication technologies. It is further understood that in some cases mobile device 106 may communicate directly with server 102 (e.g., over the Internet). Where database 114 is not stored on server 102, server 102 may access database 114 over the Internet or over any well-known wired or wireless connection.

[0042] Referring now to FIGS. 2A and 2B, exemplary functional blocks representing the software and hardware components of computing device 110 and mobile device 106 are illustrated. As is shown in FIG. 2A, computing device 110 may include processing unit 202 and system memory 204. Processing unit 202 may be any processor configured to run application 220 and perform the tasks and operations of computing device 110 set forth herein. System memory 204 may include, but is not limited to, volatile (e.g. random-access memory (RAM)), non-volatile (e.g. read-only memory (ROM)), flash memory, or any combination thereof. Operating system 205 and one or more programming modules 206 as well program data 207 may be run on computing device 110. Operating system 205 may be suitable for controlling computing device 110's operation. Programming modules 206 may optionally include image processing module, machine learning module and/or image classifying module. It is understood that computing device 110 may be practiced in conjunction with a graphics library, other operating systems, or any other application program.

[0043] Computing device 110 may have additional features and functionality. For example, computing device 110 may also include additional data storage devices (removable and/or non-removable) such as, for example, magnetic disks, optical disks, or tape. Such additional storage is illustrated in FIG. 2A by a removable storage 209 and a non-removable storage 210. Computer storage media may include volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information, such as computer-readable instructions, data structures, program modules, or other data. System memory 204, removable storage 209, and non-removable storage 210 are all computer storage media examples (i.e., memory storage.) Computer storage media may include, but is not limited to, RAM, ROM, electrically erasable read-only memory (EEPROM), flash memory or other memory technology, CD-ROM, digital versatile disks (DVD) or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium which may be used to store information and which may be accessed by computing device 110. Any such computer storage media may be part of computing device 110. Computing device 110 may also have input device(s) 212 such as a keyboard, a mouse, a pen, a sound input device, a touch input device (e.g., touch pad or touch screen), a location sensor, a camera, etc. Output device(s) 214 such as a display, speakers, a printer, etc. may also be included. Output device 214 may display a user interface.

[0044] Computing device 110 may also contain communication connection 216 that may allow computing device 110 to communicate with mobile device 106, server 102 and any other computing devices 217 within or in communication with authentication system 100 over any well-known wired or wireless connection, and (e.g., cellular, Near Field Communication (NFC), Wi-Fi Direct (P2P), Bluetooth, USB, radio frequency (RF and RFID), infrared, etc.) including over any well-known standard such as any IEEE 802 standard. Communication connection 216 may be embodied or otherwise facilitated by computer readable instructions, data structures, program modules, or other data in a modulated data signal. The term “modulated data signal” may describe a signal that has one or more characteristics set or changed in such a manner as to encode information in the signal.

[0045] As stated above, a number of program modules and data files may be stored in system memory 204, including operating system 205. While executing on processing unit 202, application 220 and/or programming modules 206 may perform processes including, for example, one or more stages of methods, algorithms, systems, applications, servers, databases as described herein. For example, programming modules 206 and/or application 220 permits computing device 110 to interface with mobile device 106 running mobile application 318 and server 102, as described in more detail below with respect to FIG. 3. Application 220 may be a browser extension (i.e., web browser plug-in) that extends the functionality of a web browser to include the authentication functionality described in more detail below. Alternatively, application 220 may be an extension on the backend of a website (e.g., website generated by www.wordpress.com) and hosted on server 102 or a different server. In other configurations, application 220 may be embodied as, for example, but not be limited to, a website, a web application, a desktop application, and/or a mobile application compatible.

[0046] Other programming modules that may be used in accordance with embodiments of the present disclosure may include sound encoding/decoding applications, machine learning application, encryption/decryption applications, acoustic classifiers etc. Generally, program modules may include routines, programs, components, data structures, and other types of structures that may perform particular tasks or that may implement particular abstract data types. It of course is understood that computing device 110 may include additional or fewer components than those illustrated in FIG. 2A and may include more than one of each type of component.

[0047] Referring now to FIG. 2B, exemplary functional blocks of mobile device 106 are shown. As is shown in FIG. 2B, mobile device 106 may include processing unit 302 and system memory 304. Processing unit 302 may be any processor configured to run mobile application 318 and perform the tasks and operations set forth herein with respect to mobile device 106. System memory 304 may include, but is not limited to, volatile (e.g. random-access memory (RAM)), non-volatile (e.g. read-only memory (ROM)), flash memory, or any combination.

[0048] Operating system 305 and one or more programming modules 306 as well as program data 307 may be run on computing device 110. Operating system 305 may be suitable for controlling the operation of mobile device 106. Programming modules 306 may optionally include image processing module, machine learning module and/or image classifying module. It is understood that mobile device 106 may be practiced in conjunction with a graphics library, other operating systems, or any other application program.

[0049] Mobile device 106 may have additional features and functionality. For example, mobile device 106 may also include additional data storage devices (removable and/or non-removable). Such additional storage is illustrated in FIG. 2B by a removable storage 309 and a non-removable storage 310. Mobile device 106 may include volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information, such as computer-readable instructions, data structures, program modules, or other data. System memory 304, removable storage 309, and non-removable storage 310 are all computer storage media examples (i.e., memory storage.)

[0050] Mobile device 106 may also have input device(s) 312 such as a keyboard, a mouse, a pen, a sound input device, a touch input device, a location sensor, a camera, etc., as well as output device(s) 314 such as a display, speakers, etc., for example. Mobile device 106 further includes biometric sensor 320 which may be one or more biometric sensors each configured to obtain biometric data of the user. Biometric sensor may be, for example, a camera, a finger print scanner, a retina scanner, a microphone, an infrared camera, thermal imaging camera, or any other sensor or input device suitable for biometric measurements. Biometric sensor(s) 320 may be a combination of hardware and software built into mobile device 106 and executed on processing unit 302. Biometric sensor 320 may employ, for example, one more of the following: well-known retina scan functionality that may involve analyzing an image of the blood vessel pattern in the light-sensitive surface lining the individual's inner eye; well-known iris pattern identification functionality that may involve analyzing a unique pattern within the ring-shaped region surrounding the pupil of the eye; well-known finger print identification functionality that may involve identifying a pattern of raised areas and branches in an image of a human finger; well-known finger vein identification functionality that may involve identifying a unique vascular pattern in an individual's finger; well-known face scan technology that may involve analyzing multiple nodal points on a human face and; well-known voice recognition functionality that may involve the identification of one or more of voice pitch, tone, inflection and/or speaking style and may rely on characteristics created by the shape of the speaker's mouth and throat.

[0051] Mobile device 106 may also contain communication connection 316 that may allow mobile device 106 to communicate with computing device 110, server 102 and any other computing devices 217 over any well-known wired or wireless connections. Communication connection 316 may be embodied or otherwise facilitated by computer readable instructions, data structures, program modules, or other data in a modulated data signal.

[0052] As stated above, a number of program modules and data files may be stored in system memory 304, including operating system 305. While executing on processing unit 302, programming modules 306 may perform processes including, for example, one or more stages of methods, algorithms, systems, applications, servers, databases as described herein. For example, programming modules 306 includes mobile application 318 that performs authentication functionality executed on mobile device 106 and described herein. Other programming modules that may be used in accordance with embodiments of the present disclosure may include encoding/decoding applications, for example. It, of course, is understood that mobile device 106 may include additional or fewer components than those illustrated in FIG. 2B and may include more than one of each type of component.

[0053] Referring now to FIG. 3A, a flowchart is illustrated detailing the data flow and decisions made in implementing authentication system 100. As mentioned above, authentication system 100 may be used to authenticate a user using mobile device 106. Upon authenticating a user on mobile device 106 using biometric data, mobile device 106 will provide certain credentials to application 220 to grant the user access to a web browser, a web portal or other software systems. It is understood that the process set forth in FIG. 3 applies whether application 220 is installed on the computing device, a browser extension, and/or incorporated into the backend of a website.

[0054] To initiate the process set forth in FIG. 3A, at step 351 the user downloads mobile application 318 on mobile device 106. The user may download mobile application 318 from the Internet. For example, the user using mobile device 106 may access the Apple or Google application store over the Internet, or any other website or application that provides access to downloadable applications. Mobile application 318 may then be installed on mobile device 106.

[0055] Upon downloading mobile application 318 on mobile device 106, at step 352 the user may register and generate a user profile using mobile application 318. The registration process may require the user to provide user identification information. Alternatively, the mobile application 318 may automatically retrieve user identification information from mobile device 106. The user identification information may be the phone number associated with mobile device 106 of the user or a different alphanumeric identifier of the user and unique to the user. Yet further, the user identification information may be any other unique identifier which may be linked to the phone number associated with the mobile device 106 of the user or other unique identifier (such as Media Access Control (MAC) address) associated with mobile device 106 of the user. For example, the User ID may be a mobile identification number (MIN), mobile subscription identification number (MSIN), Electronic Serial Number (ESN), Mobile Equipment Identifier (MEID), International Mobile Equipment Identity (IMEI), and/or international mobile subscriber identity (IMSI), or any other identifier unique to mobile device 106. The user profile may include at least the user identification information and may additionally include information about the user and/or the mobile device and/or any other user information. The user profile may be saved on server 102 as well as computing device 110, mobile device 106 and/or database(s) 114.

[0056] Authentication system 100 may optionally require the user to confirm that the user is in possession of the mobile device corresponding to the user identification information. For example, upon receiving the user identification information, the server may send a verification message having a verification code, such as a SMS verification message, to the mobile device corresponding to the user identification information. Upon receiving the verification message, the user using the mobile application may transmit the verification code to the server and the server may confirm that the code is correct. It is understood that the verification message may include a link that the user may click to automatically send the verification code to the server. It is understood that the server may coordinate with a third party verification service to verify that the user in the possession of the mobile device corresponding to the user identification information. For example, the server may instruct a third party server to send the SMS verification message to the mobile device and confirm that the code received from the mobile device is correct. Upon performing this verification procedure, the third party server may inform the server that the mobile device has been verified. Authentication system 100 may only require a user to verify a mobile device once during registration or, alternatively, may require verification each time the user identification information is provided to the server.

[0057] Further, the registration process may require the user to generate authentication data unique to the user. Authentication data may include conventional passwords, including a one-time password (OTP), tokens or SMS text (e.g., numbers/code), and/or biometric data such as retina scan information, iris pattern information, finger print scan information, finger vein scan information, face scan information, voice pattern information.

[0058] For example, upon downloading mobile application 318 to mobile device 106, mobile application 318 may instruct the user to select one or more authentication methods and/or may prompt the user to generate authentication data using one or more biometric sensors 320 according to preprogrammed and preselected authentication methods. In this example, mobile application 318 may prompt the user to place their thumb on a first biosensor which may be a thumbprint scanner. Next, mobile application 318 may prompt the user to take a picture of their eye using a second biosensor that is a camera.

[0059] The authentication data will be saved locally by mobile device 106. The authentication data may be stored in an encrypted format on mobile device 106 to protect the user's privacy. As user authentication is performed by mobile device 106, the authentication data need not be communicated to any other device. However, in some configurations, the authentication data may be shared with and saved on the remote server.

[0060] Further, the user profile may further include an identifier for computing device 110 and/or a default location for computing device 110 (i.e., computing device identifier). Examples of identifiers of computing device 110 include, but are not limited to, a MAC address, MIN, MSIN, ESN, MEID, IMEI, and/or IMSI, or any other identifier unique to computing device 110. The user may manually input the identifier and/or default location for computing device 110 or, alternatively, application 220 may automatically retrieve and populate user profile with identification information and/or default location. The default location may be an address, GPS coordinates, or any other location identifier. The designated location may be the location that a user typically uses computing device 110. The user may select the designated location to be a location that computing device 110 is currently in when the user is registering mobile device 106.

[0061] The registration process may include collecting user credentials for each website or application that the user intends to access using authentication system 100. For example, mobile application 318 may prompt the user to provide user credentials (e.g., user name or information, password information, and any other information required for access to that website) for websites and/or applications, referred to as credential data. Credential data may be stored in an encrypted format on computing device 110. Alternatively, or in addition to, the credential data may be shared with and stored in an encrypted format on server 102, database 114 and/or mobile device 106. Application 220 may retrieve and copy credential data that has been saved locally on computing device 110.

[0062] Mobile device 106 may copy credential data for one or more websites or applications saved on computing device 110. Mobile device 106 may copy the credentials upon receiving an instruction from the user using application 318 or application 220 to copy the credentials from computing device 110. Mobile device 106 may store credential data for any number of websites and/or applications.

[0063] In some instances, authentication data and/or user profile data may already be present on mobile device 106 and/or computing device 110. The authentication data may be stored in locally on these devices and may be associated with another application (e.g., a third party application). For example, biometric data (e.g., thumbprint scan) may be saved on mobile device 106 and associated with a third party application. Mobile application 318 may scan mobile device 106 for this data and may copy or extract the relevant data. Mobile application 318 may copy or extract the relevant data to the user profile. Application 220, may present the user with an option to extract or copy the authentication data and/or user profile data from computing device 110 and/or mobile device 106.

[0064] Mobile device 106 and/or computing device 110 may transmit the authentication data and/or user profile data to server 102 to be stored and may also transmit such data between one another to be stored on the receiving device. Server 102 may receive and store the authentication data and/or user profile data and any other data relating to the user.

[0065] To permit mobile device 106 to communicate with computing device 110, at step 353 the user must also download application 220 to computing device 110. The user may access the application 220 via a website or application store (e.g., Apple or Google app store) as discussed above. In some cases, application 220 automatically downloads (i.e., without user intervention) to computing device 110 when computing device 110 accesses a website. Alternatively, in some cases, application 220 may be an extension on the backend of a website (e.g., website generated by www.wordpress.com) and may be hosted on server 102 or a different server. Where application 220 is an extension on the backend of a website, the user need not download application 220 to computing device 110 and step 353 may be skipped. In another example, application 220 may be pre-installed on computing device 110. Also, step 353 may occur before, after, or simultaneously with step 351 and/or 352.

[0066] To employ authentication system 100, at step 354, communication between mobile application 318 and application 220 may be initiated. As explained above, mobile device 106 and computing device 110 may communicate with one another via well-known short range communication methods such as Near Field Communication (NFC), Bluetooth, and Wi-Fi Direct (P2P) for example. Alternatively, mobile device 106 and computing device 110 and/or server 102 may communicate using other well-known communication methods. For example, mobile device 106 and computing device 110 may each be Wi-Fi compatible and may communicate with one another over the Internet.

[0067] Communication between mobile application 318 and application 220 may be initiated, for example, by clicking on an initiation icon on an altered browser generated by application 220. Upon clicking on the initiation icon, the browser may prompt the user to enter user identification information into computing device 110 such as the phone number corresponding to mobile device 106. Alternatively, the user may use the mobile application 318 to send user identification information from mobile device 106 to computing device 110. Computing device 110, running application 220, may share the user identification information with server 102. In some cases, initiation may automatically occur with a default or preselected mobile device upon the user opening or accessing a website or application.

[0068] At step 355, application 220 via computing device 110 may send a command to initiate communication with mobile device 106 to server 102. Where computing device 110 stores user profiles or at least user identification information, application 220 may confirm that the mobile number or other user identification information provided by the user corresponds to user identification information for a registered user prior to sending request. In response to the command, at step 360 the server may relay the request for authentication to mobile device 106. In another example, computing device may send the request for authentication to mobile device 106 immediately in response to communication being initiated.

[0069] Alternatively, prior to sending the authentication request to mobile device 106, at step 356, server 102 may request identification data and/or location data from computing device 110. As described above, the identification data may be data unique to computing device 110. Computing device 110 may receive the request and transmit an identifier (e.g., a MAC address, MIN, MSIN, ESN, MEID, IMEI, and/or IMSI, or any other identifier unique to mobile device 106) identifying computing device 110. Server 102 may also, or alternatively, request and computing device 110 may provide in response location data indicating where computing device 110 currently is located (e.g., GPS data). At step 357, server 102 may receive the identifier and location data and compare the identifier and location data to the identifier and location data the user provided during the registration process.

[0070] At decision 358, server 102 may confirm that the identification data and/or location data provided from computing device 110 matches identification data and/or location data provided by the user during registration. Server 102 may communicate with database 114 and/or mobile device 106 to make this confirmation. If server 102 determines that the identification data and/or location data received from computing device 110 is the same as the identification data and/or location data the user provided during the registration process, server 102 may send the request for authentication to mobile device 106 at step 360. Mobile device 106 may be the device corresponding to the phone number or other identifier entered at step 354 or may be the primary mobile device registered by the user during registration. If server 102 determines at decision 358 that the location data and/or the identification information does not match the data obtained during registration, server 102 may reject the command to initiate a communication between mobile device 106 and computing device 110.

[0071] Where application 220 is an extension on the back end of the website, at step 354 the user may initiate communication between mobile device 106 and computing device 110 by accessing the website via computing device 110. For example, upon opening the website, the website will prompt the user to enter a user name and password. Upon verifying that the user name and password are correct (e.g., by comparing the user name and password to a database on a remote server), the website will prompt the user to enter a phone number or other user identification information. Alternatively, upon visiting the website on computing device 110, the website may prompt the user to enter the user identification information. As is the case with the system involving the browser extension, the user identification information provided to the website may be shared with server 102. Server 102 and/or database(s) 114 may confirm that the mobile number or other user identification information provided corresponds to user identification information of a registered user.

[0072] Referring now to FIG. 3B, a flowchart is illustrated detailing the data flow and decisions made in implementing authentication system 100 to authenticate a user via mobile device 106. At step 361, mobile device 106 may receive the request for authentication from server 102 or computing device 110. At step 362 mobile device 106 running mobile application 318 will obtain authentication data. Mobile application 318 may be programmed to require a certain authentication data (e.g., password, fingerprint data, retina data, iris data, face data, voice data) to authenticate the user. Mobile application 318 may be programmed to have a bias for certain authentication methods according to a programmed hierarchy and may further be programmed to require a certain number of authentication methods. For example, mobile application 318 may be programmed to have a two-step authentication process involving authentication via thumb print and face recognition. In this example, mobile application 318 may first prompt the user to place his or her thumb on biometric sensor 320, which in this example is a fingerprint scanner, to obtain fingerprint data. Next, mobile application 318 will prompt the user to obtain an image of his or her face using a second biosensor, which in this example is a camera, to obtain face data.

[0073] At step 363, mobile device 106 running mobile application 318 may analyze authentication data using for example, well known fingerprint analysis, retina analysis, iris analysis, face analysis and voice analysis techniques. The data collected and/or the analyzed data will be compared to the authentication data corresponding to a user's profile and stored locally on mobile device 106. At decision 364, after comparing the data obtained at step 362 to the authentication data corresponding to the user's profile, mobile device 106 running mobile application 318 will determine whether the obtained data is the same or substantially similar to the authentication obtained during the registration process, and thus if the user has been authenticated. The degree to which the data must be similar may be set and altered by an administrator.

[0074] If mobile device 106 running mobile application 318 determines at decision 364 that the user is not authenticated (i.e., authentication data obtained at step 362 is not the same or substantially similar to authentication data obtained during registration), at step 365 mobile device 106 may optionally generate a message on the display of mobile device 106 that the authentication failed. Mobile device may repeat steps 361-363 a preset number of times or may even prompt the user to generate different biometric data (e.g., iris pattern scan) if the first attempt to authenticate failed. Further, at step 366 mobile device 106 running mobile application 318 may inform computing device 110 running application 220 and/or server 102 that authentication failed. Application 220 may also generate a message on the display of the computing device informing the user that authentication failed.

[0075] Conversely, if mobile device 106 running mobile application 318 determines at decision 364 that the user is authenticated, at step 367, mobile device 106 may optionally generate a message on the display of mobile device 106 that the authentication was successful. Further, at step 368, mobile device 106 will inform application 220 and/or server 102 that the authentication was successful.

[0076] At step 369, in response to a successful authentication, mobile device 106 and/or server 102 may communicate credentials to computing device 110 running application 220. The credentials may be communicated to application 220 via any of the well-known communication methods set forth above and may be transmitted in an encrypted format. The credentials will be specific to the website for which communication was initiated in step 364. Alternatively, where computing device 110 has been provided and stores the credential information, computing device 110 may provide the credential information.

[0077] In one example, computing device 110 may include a password manager module which may be a part of application 220 or may be a standalone software application run on computing device 110. A user may save passwords and various information, such as user names, using password manager module. This information may be saved locally on application 220 or may be saved on a remote server (e.g., server 102) and retrieved by application 220. Upon being informed that authentication was successful, application 220 may communicate with the password manager module to obtain certain credentials. Specifically, application 220 may generate a request for credential information from password manager module and/or transmit the request to password manager module. Upon receiving the request, password manager module may retrieve the requested credential information, either locally or from the remote server, and generate and/or transmit the requested credential information.

[0078] Application 220, upon receiving the credentials, may auto-populate the credentials into the corresponding fields and may automatically submit the credentials. Alternatively, application 220 may display the credentials on computing device 110 and the user may cut and paste or otherwise place the credentials into the appropriate location on the graphic user interface and manually submit the credentials. In this manner, the user using mobile device 106 may perform authentication on mobile device 106 to access the website on computing device 110.

[0079] In one example, server 102 may be a manager server managed by a company administrator using an administrator device. The manager server may be employed where a company seeks to limit and control access (e.g., employee access) to a company website or web portal. The manager server may run inside the enterprise network, on the cloud and/or a Blockchain based platform. It is understood that the manager server may also be used to control access to and otherwise manage authentication system 400, described below.

[0080] The manager server may maintain and manage user profile information including user identification information and even credential information relevant to that website or web portal. Administrators with access to manager server may oversee the manager server and set and alter user profile information, user identification, authorization information, registration information, and/or credential information. For example, the administrator may add or delete user profiles, limiting access to the website or web portal, and may determine how often the credentials for the website or web portal must be changed. The administrator may set the credential information for each user and the individual users (such as employees) may not be allowed to view the credentials information (passwords) though they may be only allowed to use (copy and paste) the passwords and/or auto-fill the passwords. Manager server may be controlled by a software installed on the manager server that interfaces with software on an administrator device. In one example, the manager server may include or may interface with a policy server programmed to dynamically change the credential information. The manager server and/or policy server may change the credential information necessary for access to the company system after a set period of time (e.g., every five minutes). The manager server and/or policy server may also change company policies related to the credential information (e.g., may modify the set period of time for changing passwords).

[0081] As explained above, communication between the mobile device and the computing device may be initiated and the user identification information may be requested. The user identification information will be communicated to the manager server to confirm that the user has been registered. Alternatively, if the user's computing device is within the corporate network (e.g., not accessing the website or web portal remotely) the user's computing device and manager server may interact directly via local network (such as Ethernet or Wi-Fi) and automatically confirm identification.

[0082] After confirming that the user has been registered, the manager server may send a request to the mobile device to authenticate the user. As explained above, the user may provide the required authentication data (such as face print, finger print, iris pattern, voice pattern) on the user's computing device (i.e., mobile device 106). Thereafter, the user's computing device may inform the manager server of whether the authentication was successful. If authentication was successful, then the password manager server sends the corresponding credentials (e.g., to the browser running the website or web portal to provide access to the corresponding website or web portal).

[0083] Further, a company (or employer) may also set access privileges. For example, if an employee leaves the company, the administrators may revoke access of the employee by deleting the user profile corresponding to that employee or otherwise altering the user profile to prevent access. Further, the manager server may track access by employees or other users. Also, manager server may limit access to certain information within website or web portal. For example, for more sensitive data, the company may allow access only to employees that have a certain security clearance. The manager server may also track the user devices that have installed the mobile application. The company may restrict access to the mobile application to only work phones and work computers. Using the administrator device, the administrators may also detect any suspicious devices accessing the manager server.

[0084] Referring now to FIG. 3C, a flowchart is illustrated detailing the data flow and decisions made in implementing authentication system 100 to authenticate a user via server 102. FIG. 3C starts after application 220 has been downloaded to computing device 110 and mobile application 318 has been downloaded to mobile device 106, as described in steps 351-352 of FIG. 3A. At step 370, a user may initiate authentication. For example, a user may initiate the authentication via a user interface on mobile device 106 or computing device 110.

[0085] At step 371, mobile device 106 or computing device 110 may obtain authentication data. Computing device 110 may include components to collect authentication data similar to the components of mobile device 106 (e.g., a retina scanner, a thumbprint scanner, a camera, etc.). Mobile device 106 or computing device 110 may obtain the authentication data in a process similar to the process mobile device 106 uses to obtain authentication data in step 362. At step 372, computing device 110 or mobile device 106 may transmit the obtained authentication data to server 102. Where both computing device 110 and mobile device 106 are capable of generating authentication data, computing device 110 may operate as a back-up system to mobile device 106.

[0086] At step 373, server 102 may compare the obtained authentication data to registered authentication data. The user profile and data generated during registration may be saved on server 102 or database 114. At decision 374, server may determine if the user is authenticated. This procedure may be the same as the approach described at decision 364 in FIG. 3B described above. If server 102 determines at decision 374 that the authentication failed (i.e., the generated authentication data does not match or substantially match the registered authentication data), at step 375, server 102 may inform application 220 and/or mobile application 318 that authentication failed. Conversely, if server 102 determines that authentication was successful (i.e., the generated authentication data matches or substantially matches the registered authentication data), at step 376, server 102 may inform application 220 or 318 that authentication was successful.

[0087] At step 377, after the user has been authenticated, server 102 or mobile device 106 may provide credentials (e.g., user name and password information) to computing device 110 or, alternatively, computing device 110 may retrieve the credentials locally. Advantageously, a user may only need to generate authentication data to successfully access a website or application that requires a user name and password as the credentials may be auto-populated upon successful authentication.

[0088] Referring now to FIG. 3D, a flowchart is illustrated detailing the data flow and decisions made in implementing a backup authentication system in authentication system 100. The data flow and decisions shown in FIG. 3D represent an optional process for performing authentication where communication is initiated and a request for authentication is communicated to mobile device 106 but, at step 378, a response has not been received by mobile server 102 and/or computing device 110 after a predetermined period of time. The predetermined period of time may begin when computing device 110 or server 102 transmits a request for authentication data to mobile device 106. An administrator may determine the predetermined period of time to be any length. The expected response is a message from mobile device 106 that authentication succeeded for failed.

[0089] At decision 379, server 102 and/or computing device 110 may determine whether a secondary mobile device (not shown) is associated with an account of the user based on the user profile or registration data. If server 102 determines that there is not a registered secondary device, at step 380, server 102 may send a one-time password (OTP) code to the registered email of the user for email authentication. At step 381, the user may receive and submit the OTP code via email using mobile device 106 or computing device 110 to complete authentication. Advantageously, by using an OTP code for authentication, the user may be authenticated even if the request for authentication sent to application 318 running mobile device 106 fails.

[0090] If server 102 determines that there is a registered secondary mobile device, at step 382, either computing device 110 or server 102 communicates a new request for authentication to secondary mobile device. At step 383, the secondary mobile device obtains authentication data in the same manner described in step 362. At step 384, the secondary mobile device compares obtained authentication data to registered authentication data in the same manner described in step 363. The secondary mobile device may have access to registered authentication data from computing device 110, server 102, and/or mobile device 106 and may save this data locally. At decision 385, the secondary mobile device may determine whether the authentication data is authenticated in the same manner described with respect to decision 364. At step 386, if the user is not authenticated, the secondary mobile device may optionally generate a failure display in the same manner described with respect to step 365. At step 387, the secondary device may inform an application or server that authentication failed in the same manner described with respect to step 366. At step 388, if the user is authenticated, the secondary mobile device may optionally generate a success display in the same manner described with respect to step 367. At step 389, the secondary mobile device may optionally inform application 220 or server 102 that authentication was successful in the same manner described with respect to step 368. At step 390, credentials are provided to the application from the server or secondary mobile device or retrieved locally from the computing device in the same manner described with respect to step 369. It is understood that the same approach described above may be used with a secondary device that is not a mobile device, such as personal computer, laptop, tablet or any other computing device with features enabling receipt and transmission of authentication data and/or email.

[0091] FIGS. 3E-3H illustrate an exemplary process for authenticating a user via a server. For example, a user may register a secondary device, in addition to the mobile device, on the server and may use the secondary device to generate authentication data which may be sent to the server for authentication. The secondary device may serve as an alternative to the mobile device for authentication. It is understood that the secondary device may be the same as the device illustrated in FIG. 2B and that mobile application 318 may perform the tasks and/or operations of the secondary device set forth in FIGS. 3E-L.

[0092] Referring now to FIG. 3E, an exemplary data flow and decisions executed by a secondary device to register the secondary device is illustrated. To initiate the process set forth in FIG. 3E, at step 431 the secondary device downloads a secondary device application (e.g., mobile application 318) . For example, the secondary device may download the secondary device application from an application store via the Internet. The user using the secondary device may access the Apple or Google application store over the Internet, or any other website or application that provides access to downloadable applications. The secondary device application may then be installed on the secondary device.

[0093] Upon downloading the secondary device application on the secondary device, at step 432, the secondary device application may determine user identification information. For example, the secondary device application may retrieve this information from the secondary device or cause the user to generate this information. The user identification information may be a user identifier such as the phone number associated with a registered device of the user or a different alphanumeric identifier of the user and unique to the user. Yet further, the user identification information may be any other unique identifier which may be linked to the phone number associated with a registered device of the user or other unique identifier (such as Media Access Control (MAC) address) associated with the registered device of the user. For example, the User ID may be a mobile identification number (MIN), mobile subscription identification number (MSIN), Electronic Serial Number (ESN), Mobile Equipment Identifier (MEID), International Mobile Equipment Identity (IMEI), and/or international mobile subscriber identity (IMSI), or any other identifier unique to the registered device. The user profile may include at least the user identification information and may additionally include information about the user and/or the registered device and/or any other user information. The user profile may be saved on server 102 as well as a registered device and/or database(s) 114.

[0094] At step 433, the secondary device running the secondary device application may send the user identification information and a request to register the secondary device to server 102. At step 434, the secondary device application running on the secondary device may receive a request for authentication data from the server. Authentication data may include conventional passwords, including a one-time password (OTP), tokens or SMS text (e.g., numbers/code), and/or biometric data such as retina scan information, iris pattern information, finger print scan information, finger vein scan information, face scan information, voice pattern information.

[0095] At step 435, the secondary device application running on the secondary device may instruct the user to generate authentication data via one or more authentication methods using one or more biometric sensors 320 according to preprogrammed and preselected authentication methods. For example, the secondary device application may prompt the user to place their thumb on a first biosensor which may be a thumbprint scanner.

[0096] Alternatively, authentication data and/or user profile data may already be present on the secondary device. The authentication data may be stored locally on the secondary device and/or may be associated with another application (e.g., a third party application). For example, biometric data (e.g., thumbprint scan) may be saved on the secondary device and associated with a third party application. In one example, the secondary device application may scan the secondary device for this data and may copy or extract the relevant data. The secondary device application may copy or extract the relevant data to the user profile.

[0097] Following generation of the authentication data, at step 436, the secondary device may send the authentication data to server 102 to be stored on the server. It is understood that the authentication data may be encrypted before being sent to the server. Optionally, at step 437, the secondary device may receive confirmation from the server that registration of the secondary device was successful.

[0098] Referring now to FIG. 3F, exemplary data flow and decisions executed by a secondary device to authenticate a user via the secondary device is illustrated. After the secondary device is registered (e.g., using the steps set forth above with respect to FIG. 3E), the secondary device may be used for authentication. At step 438, the secondary device may receive a request for authentication, including a request for authentication data, from server 102 or the computing device. For example, an attempt to connect with the mobile device may fail and thus the server may attempt to authenticate via the secondary device.

[0099] At step 439, the secondary device running the secondary device application (e.g., mobile application 318) may determine authentication data from the user as described above. For example, the secondary device application may first prompt the user to place his or her thumb on biometric sensor 320, which in this example is a fingerprint scanner, to obtain fingerprint data.

[0100] At step 441, the secondary device may send the authentication data to server 102. Server 102 may then compare the newly determined authentication data to saved authentication data. If server 102 determines the newly determined authentication data is the same and/or substantially similar to saved authentication data (e.g., during the process set forth above with respect to FIG. 3E), at optional step 442, the secondary device may receive confirmation from server 102 that authentication was successful.

[0101] Referring now to FIG. 3G, an exemplary data flow and decisions executed by a server to register a secondary device on the server is illustrated. At step 443, server 102 may receive a request to register a secondary device and may receive user identification information (e.g., a user identifier) that corresponds to the secondary device. The server may determine that a user identifier corresponds to a user profile at step 444. For example, user profiles and associated user identification information may be saved to the server. A user profile may include user identifiers for each device associated with the user profile (e.g., mobile device and secondary device).

[0102] At step 445, server 102 may send a request for permission to register the secondary device to the server and/or associate the secondary device with the user profile to the mobile device and/or another device already associated with the user profile. For example, the request to authorize may be sent to another registered device, such as the computing device. The request may prompt the user to generate authentication data to approve the request or alternatively deny the request to authorize via the mobile device and/or other device associated with the user profile. At step 446, server 102 may receive authorization from the mobile device and/or other registered device to register the secondary device on the server 102 and/or associate the secondary device to the user profile.

[0103] After authorization is granted, at step 447, server 102 may request authentication data (e.g., biometric information) from the secondary device. For example, the secondary device running the secondary device application may generate and/or determine authentication data in a process similar to the process the secondary device uses to determine authentication data in steps 435 and 439. At step 448, server 102 may receive the authentication data from the secondary device and may save the authentication data to server 102. This authentication data may be used in the future for comparison to newly determined authentication data to authenticate the newly determined authentication data. Optionally, at step 449, server 102 may inform the secondary device that registration was successful.

[0104] Referring now to FIG. 3H, a flowchart is illustrated detailing an exemplary data flow and decisions executed by a server to authenticate a user on a secondary device via the server when authentication on another registered device has failed. At step 450, server 102 receives a request to access digital content from a computing device. At step 451, server 102 may determine a mobile device associated with the computing device. For example, the mobile device may be associated with the computing device on the user profile. The mobile device may be designed to determine authentication data such as biometric information.

[0105] At step 452, server 102 may send a request for authentication to the mobile device. At step 453, the server may determine that the mobile device has failed to response to the request. For example, the server may determine that a predetermined period of time has elapsed without a response since the request for authentication was sent at step 452. At decision 454, the server may determine whether a secondary device is registered and associated with the computing device. For example, the server may determine if another device is associated with the user profile.

[0106] If server 102 determines that a secondary device is not registered, at step 455, server 102 may send a one-time password (OTP) code to a registered email of the user (e.g., associated with the user profile) for email authentication. Alternatively, the OTP code may be sent to another registered device for authentication. Optionally, at step 456, server 102 may receive the OTP code and, at step 457, the server may send credentials to the computing device and/or permit digital access on the computing device.

[0107] If server 102 determines that a secondary device is registered, at step 458, server 102 may request authentication data from the secondary device. The secondary device may generate authentication data in a process similar to the process the secondary device uses to obtain authentication data in steps 435 and 439. At step 459, server 102 may receive the authentication data from the secondary device. At step 460, server 102 may determine whether the authentication data received at step 459 is the same and/or substantially similar to saved authentication data determined during registration of the secondary device, and thus if the user has been authenticated. Optionally, at step 461, if the authentication data received at step 459 is the same and/or substantially similar to the authentication data saved during registration, server 102 may inform the secondary device that registration was successful. At step 462, server 102 may send credentials associated with the request for digital access at step 450 to the computing device. Alternatively, this process may be used to grant access to a physical location, as described in the system in FIG. 4. For example, at step 462, rather than sending credentials to the computing device, server 102 may communicate with user interface 405 to unlock secure system 410.

[0108] FIGS. 3I-3L illustrate an exemplary process for authenticating a user via a secondary device. For example, a user may register a secondary device, in addition to the mobile device, on the server and may use the secondary device to generate authentication data which may be used to authenticate the user by comparing the newly determined authentication data to previously determined authentication data. The secondary device may serve as an alternative to the mobile device for authentication. It is understood that the secondary device may be the same as the device illustrated in FIG. 2B and that mobile application 318 may perform the tasks and/or operations of the secondary device set forth in FIGS. 3E-L.

[0109] Referring now to FIG. 3I, an exemplary data flow and decisions executed by a secondary device is illustrated detailing the process to register the secondary device to use the secondary device to authenticate.

[0110] At steps 463-465, the process closely follows steps 431-433 in FIG. 3E in which the secondary device downloads the secondary device application (e.g., mobile application 318), the secondary device determines user identification information from the user or secondary device, and the secondary device sends the user identification information and a request to register the secondary device to the server (e.g., server 102).

[0111] At step 466, server 102 may send a command to determine authentication data to the secondary device along with a command to save the newly determined authentication data to the secondary device. At step 467, the secondary device running the secondary device application may determine authentication data on the secondary device and save the authentication data to the secondary device. For example, the secondary device running the secondary device application may instruct the user to select one or more authentication methods and/or may prompt the user to generate authentication data using one or more biometric sensors 320 according to preprogrammed and preselected authentication methods. The newly determined authentication data may be saved locally by the secondary device. The authentication data may be stored in an encrypted format on secondary device to protect the user's privacy. After saving the authentication data to the secondary device, at step 468, the secondary device may send confirmation to the server that the authentication data has been saved to the secondary device.

[0112] Referring now to FIG. 3J, an exemplary data flow and decisions executed by a secondary device is illustrated detailing the process to authenticate a user on the secondary device via the secondary device. At step 469, the secondary device receives a request for authentication, including a request for authentication data, from server 102 or the computing device. At step 471, the secondary device may obtain the authentication data in a process similar to the process the secondary device uses to obtain authentication data in steps 435 and 439. Steps 469 and 471 may be the same as steps 438 and 439.

[0113] At step 472, the secondary device running mobile application 318 may compare the newly determined authentication data to authentication data saved to the secondary device during registration. For example, the secondary device running the secondary device application may analyze the authentication data determined during registration and the newly determined authentication data using for example, well-known fingerprint analysis, retina analysis, iris analysis, face analysis and voice analysis techniques. The authentication data collected and/or the analyzed data may be compared to the authentication data corresponding to a user's profile and stored locally on the secondary device. At step 473, the secondary device running secondary device application may determine whether the newly determined authentication data is the same and/or substantially similar to the saved authentication data, and thus if the user has been authenticated. The degree to which the data must be similar may be set and altered by an administrator.

[0114] If the secondary device running the secondary device application determines that the user is authenticated, the secondary device may optionally generate a message on the display of the secondary device that the authentication was successful. Further, at step 474, the secondary device may inform server 102 that the authentication was successful.

[0115] Referring now to FIG. 3K, an exemplary data flow and decisions executed by a server is illustrated detailing the process to register a secondary device to use the secondary device to authenticate. At steps 475-478, the process closely follows steps 443-446 in FIG. 3G in which server 102 receives a request to register the secondary device and determine the user identification information that corresponds to the secondary device, determines which user profile the user identification information corresponds to, sends a request to authorize the secondary device to a registered device associated with the user profile, and receives authorization from the registered device.

[0116] At step 479, server 102 may instruct the secondary device to determine authentication data. This may involve generating authentication data and saving the newly determined authentication data to the secondary device. The secondary device may generate authentication data in a process similar to the process the secondary device uses to obtain authentication data in steps 435 and 439. The newly determined authentication data may be saved locally by the secondary device and may be stored in an encrypted format on the secondary device to protect the user's privacy. Alternatively, the authentication data may be retrieved by the secondary device (e.g., from memory on the secondary device, from another device, from a server, etc.). Optionally, at step 480, server 102 may receive confirmation from the secondary device that the authentication data has been saved to the secondary device. Additionally, at step 481, server 102 may optionally inform the secondary device that registration was successful.

[0117] Referring now to FIG. 3L, an exemplary data flow and decisions executed by a server is illustrated detailing the data flow and decisions to authenticate a user on a secondary device when authentication on another registered device has failed. At steps 482-485 the process closely follows steps 450-453 in FIG. 3G in which server 102 receives a request to access digital content from a computing device, determines whether a mobile device is registered and associated with the computing device, sends a request for authentication to the mobile device, and determines that the mobile device has failed to respond (e.g., after a predetermined period of time has elapsed). At decision 486, server 102 may determine whether a secondary device is registered and associated with the computing device (e.g., in a user profile). If server 102 determines that a secondary device is not registered, at steps 487-489 server 102 may optionally send a one-time password (OTP) code to a registered email of the user and/or registered device for authentication, may receive the OTP code, and may send credentials to the computing device and/or permit digital access on the computing device.

[0118] If server 102 determines that a secondary device is registered, at step 490 server 102 may send a request for authentication to the secondary device to cause the secondary device to determine authentication information and compare the determined authentication information to the authentication information determined during registration. The secondary device may then generate authentication data in a process similar to the process the secondary device uses to obtain authentication data in steps 435 and 439. Next, the secondary device may determine whether the newly determined authentication data is the same and/or substantially similar to saved authentication data determined at registration, and thus if the user has been authenticated. At step 491, server 102 may receive confirmation that authentication was successful from the secondary device. Optionally, at step 492, server 102 may send the credentials to the computing device upon determining that the secondary device authenticated the user. Alternatively, this process may be used to grant access to a physical location, as described in the system in FIG. 4. For example, at step 492, rather than sending credentials to the computing device, server 102 may communicate with user interface 405 to unlock secure system 410.

[0119] The steps and decisions set forth above with respect to FIGS. 3A-L are applicable to web-based subscription streaming services that play media content (e.g., Netflix, Hulu, HBO Go, etc.). In one example, computing device 110 may be a television that connects to the Internet and permits the user to access the streaming services via a website or web-based application. The user may download a television application to the television and also download a mobile application to the user's mobile device (i.e., mobile device 106), consistent with steps 351 and 353. The television application may interface with the website or web-based application and facilitate access to the subscription services. Using the application downloaded to the mobile device, the user may generate a user profile and register the mobile device, as described above with respect to step 352. The user profile will include user identification information (e.g., phone number). The mobile device will share the user identification information with the television which will send the user identification information to the remote server. Alternatively, the mobile device will send the user identification information directly to the remote server. The user profile will also include a username and password (i.e., credential information) for the streaming services. The mobile device will send that credential information to the television, which will save the user name and password on the television.

[0120] To access and otherwise use the streaming services, the user using the mobile device may initiate communication with the television at step 354 by sending user identification information (e.g., phone number) to the television application unprompted. As explained above, the mobile device and the television may connect via well-known short range communication methods such as Bluetooth or Wi-Fi Direct (P2P). Alternatively, the user may prompt the television application (e.g., using a remote control) to send nearby computing devices, or computing devices that the television is in short range communication with, a request for user identification information. Upon receiving the request for user identification information, the mobile application may automatically send user identification information to the television application or may send this information directly to the remote server. In both examples, where the television application receives user identification information, the television application will send this user identification information to the remote server over the internet.

[0121] As explained above with respect to steps 354 and 355, the remote server will confirm that the user identification information matches the user identification information saved on the server (i.e., confirm that the mobile device is registered) and will send a request for authentication to the mobile device. Alternatively, the server may send the request for authentication to the television and the television may send the request for authentication to the mobile device. The mobile device will then authenticate the user as described above with respect to decision 356. In this example, the mobile application may authenticate the user by scanning the user's thumbprint using a thumbprint scanner on the mobile device and comparing the thumbprint to the thumbprint generated during registration.

[0122] If the mobile application determines that the user is authenticated (e.g., the obtained fingerprint matches the fingerprint in the user's profile), the mobile device will send a message to the television instructing the television that the user has been authenticated. Upon being instructed that the user has been authenticated, the television will retrieve credential information stored on the television to gain access to the streaming services.

[0123] It is understood that the mobile device used to communicate with computing device 110 in FIGS. 3A-3D, may be a different mobile device than the mobile device used during the registration process in step 352 described above. It is further understood that a user may select one or more mobile numbers to affiliate a user profile with the mobile devices corresponding to one or more mobile numbers. If a different mobile device is used to communicate with computing device 110, user identification information may optionally involve information not specific to the mobile device used during registration. For example, user identification information may be alphanumeric information unique to the user. Further, where a different mobile device is used to communicate with computing device 110, the user profile information saved on server 102 will include authentication data saved in an encrypted format. In this configuration, upon receiving a request for authentication and obtaining authentication data at step 362, the mobile device will obtain authentication data and send the obtained authentication data to server 102. As the mobile device used to obtain authentication data does not have the authentication data generated during registration saved locally, server 102 will compare the obtained authentication data to the authentication data obtained during registration to authenticate the user. Server 102 will inform application 220 whether the user has been authenticated. Alternatively, server 102 will send the authentication data generated during registration to the mobile device and the mobile device will authenticate the user and inform application 220 whether the user has been authenticated.

[0124] It is further understood that the mobile device that initiates communication at step 354 may be a different mobile device than the mobile device that receives the request for authentication at step 361, obtains authentication data at step 362, compares the obtained authentication data to registered authentication data at step 363, and authenticates the authentication data at decision 364. Specifically, a first mobile device used by a first user may initiate communication and cause authentication system 100 to generate a request for authentication data from a second mobile device used by a second user. Where two mobile devices implement authorization system 100, the second mobile device may directly inform the first mobile device whether the authentication was successful at decision 364 and/or may communicate with the second mobile device via the server. This approach may be useful where the user of the first mobile device does not have authority to access certain information or data and needs authorization from a second user to access the information or data. It is understood that both the first and second mobile device may be required to register as set forth above, or, alternatively, only the second mobile device may be required to register.

[0125] The steps and decisions set forth above with respect to FIGS. 3A-3L are applicable to mobile-based ride-share applications (e.g., Uber, LYFT, etc.). In one example, the ride-share applications allow for a passenger to request a ride from a driver via one of the ride-share applications. The passenger may submit, via a mobile device, a request to receive a ride from a first location to a second location and the driver may accept the request, via the driver's mobile device. The ride-share application may inform the potential passenger of the identity of the potential driver through the application on the mobile device of the passenger. In some cases, a driver may loan their mobile device to an unauthorized friend of the driver so the friend may drive the passenger and earn money. To avoid this situation mobile application 318 may be employed alongside the ride-share application. Application 318 may interface with the ride-share application to facilitate access to the ride-share application and authenticate the driver using biometric information to confirm the registered driver is using the application. Using the application downloaded to the mobile device, the driver may generate a user profile and register the mobile device, as described above with respect to step 352. The driver may receive a notification on the mobile device indicating a request from a passenger for the driver to give the passenger a ride. Before the driver accepts the ride, application 318 may interface with the with the ride-share app to verify the identity of the driver. In some cases, the request for a ride from a passenger may take the form of a request for authentication. The driver may provide authentication data (e.g., a face scan or a thumbprint scan) to the mobile device and the mobile device may authenticate the driver in the manner described above with reference to steps 362-369. Alternatively, the mobile device may transmit the authentication data to a server to authenticate the driver in the manner described above with reference to steps 371-377. Once the driver is authenticated, application 318 may permit the driver to accept the ride. If the driver is not authenticated, application 318 will not allow the driver to accept the ride.

[0126] Referring now to FIG. 4, authentication system 400 is illustrated. User authentication system 400 is designed to perform user authentication and grant a user access to a digital system or application or a physical location. For example, user authentication system 400 may grant a user using mobile device 107 access to a computer device such as a desktop computer or to a physical location such as a building, room, restricted area or object (e.g., building, room, garage, parking lot or even a vehicle or locker).

[0127] User authentication system 400 involves mobile device 107, interface device 405, secure system 410 server 102 and database 114. Sever(s) 102 and database(s) 114 may be the same mobile device, servers and databases described above with respect to authentication system 100 and/or may be a manager server. Mobile device 107 is the same as mobile device 106 but instead of running mobile application 318, mobile device 107 runs mobile application 50 (not shown).

[0128] Interface device 405 may be any computing device having processing power, storage, and network connectivity and may optionally include an input device and a display. It is understood that interface device 405 may be a standalone computing device having standalone hardware and software modules or may be incorporated into secure system 410. In one example, interface device 405 may be a computing device having a mechanical button affixed to a portion of secure system 410.

[0129] Secure system 410 may be a physical barrier to a physical location such as a door, gate, arm, fence, or any other physical barrier. Secure system 410 may involve electronics and mechanical structure to permit the physical barrier to be locked and unlocked, or opened and/or closed. Alternatively, secure system 410 may be a computing device or even a software system or software application that has a locked configuration and an unlocked configuration. In the locked configuration, information and functionality may not be accessed by the user. Interface device 405 may optionally be incorporated into secure system 410 such that secure system 410 and interface device 405 share at least some hardware and/or software.

[0130] Mobile application 50 may be any mobile software application configured to run on mobile device 107 and generate a user interface on mobile device 107 and programmed to perform the tasks and operations executed on mobile device 107 described herein. Interface device 405 is configured to run software application 420. Mobile device 107 running mobile application 50 may communicate with software application 420 running on interface device 405 to perform the operations herein and otherwise facilitate user authentication.

[0131] Using mobile device 107 running mobile application 50, a user may communicate with interface device 405 running software application 420 via any well-known wired or wireless connection. Mobile device 107, running mobile application 50, may connect to the Internet using any well-known methods and may communicate with interface device 405 and/or server 102 over the Internet. It is understood that mobile device 107 may communicate with computing device 110 and server 102 using different communication technologies or the same communication technologies. It is further understood that, in some cases, mobile device 107 may communicate directly with server 102 (e.g., over the Internet).

[0132] Referring now to FIG. 5, exemplary functional blocks representing the software and hardware components of interface device 405 are illustrated. As is shown in FIG. 5, interface device 405 may include processing unit 402 and system memory 404. Processing unit 402 may be any processor configured to run software application 420 and perform the tasks and operations set forth herein. System memory 404 may include, but is not limited to, volatile (e.g. random-access memory (RAM)), non-volatile (e.g. read-only memory (ROM)), flash memory, or any combination. Operating system 418 and one or more programming modules 406 as well program data 407 may be run on computing device 110. Operating system 418 may be suitable for controlling the operation of interface device 405. Programming modules 406 may optionally include image processing module, machine learning module and/or image classifying module. It is understood that interface device 405 may be practiced in conjunction with a graphics library, other operating systems, or any other application program.

[0133] Interface device 405 may have additional features and functionality. For example, interface device 405 may also include additional data storage devices (removable and/or non-removable) such as, for example, magnetic disks, optical disks, or tape. Such additional storage is illustrated in FIG. 5 by a removable storage 409 and a non-removable storage 421. Computer storage media may include volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information, such as computer-readable instructions, data structures, program modules, or other data. System memory 404, removable storage 409, and non-removable storage 421 are all computer storage media examples (i.e., memory storage.) Computer storage media may include, but is not limited to, RAM, ROM, electrically erasable read-only memory (EEPROM), flash memory or other memory technology, CD-ROM, digital versatile disks (DVD) or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium which may be used to store information and which may be accessed by interface device 405. Any such computer storage media may be part of interface device 405. Interface device 405 may also have input device(s) 412 such as a keyboard, a mouse, a pen, a sound input device, a touch input device, a location sensor, a camera, etc. Input device 412 may also be a mechanical button or touch screen button. Output device(s) 414 such as a display, speakers, a printer, etc. may also be included. Output device 414 may display a user interface.

[0134] Interface device 405 may also contain communication connection 416 that may allow interface device 405 to communicate with mobile device 107, server 102 and any other computing devices 217 over any well-known wired or wireless connection. Communication connection 416 may be embodied or otherwise facilitated by computer readable instructions, data structures, program modules, or other data in a modulated data signal.

[0135] As stated above, a number of program modules and data files may be stored in system memory 404, including operating system 418. While executing on processing unit 402, programming modules 406 may perform processes including, for example, one or more stages of methods, algorithms, systems, applications, servers, databases as described herein. For example, programming modules 406 includes software application 420 that permits interface device 405 to interface with mobile device 107 running mobile application 50, server 102 and secure system 410, as described in more detail below. Software application 420 may be a stand-alone software application downloaded to and executed on interface device 405 or, alternatively may be hosted on server 102 and accessed via interface device 405. Other programming modules that may be used in accordance with embodiments of the present disclosure may include encoding/decoding applications, machine learning application, acoustic classifiers etc. Generally, program modules may include routines, programs, components, data structures, and other types of structures that may perform particular tasks or that may implement particular abstract data types. It of course is understood that interface device 405 may include additional or fewer components than those illustrated in FIG. 4 and may include more than one of each type of component.

[0136] Referring now to FIG. 6A, a flowchart is illustrated detailing the data flow and decisions made in implementing authentication system 400. As mentioned above, authentication system 400 may be used to authenticate a user using mobile device 107. If the user is authenticated on mobile device 107 using biometric data, mobile device 107 will inform software application 420 that the user has been authenticated and software application 420 will communicate and cooperate with secure system 410 to grant the user access to digital content. In some configurations, mobile device 107 or server 102 may provide credentials to interface device 405 if necessary for access to secure system 410.

[0137] To initiate the process set forth in FIG. 6A, at step 501 the user downloads mobile application 50 on mobile device 107. Similar to the process explained above with respect to mobile application 318 the user may download mobile application 50 from the Internet. For example, the user using mobile device 107 may access the Apple or Google application store over the Internet, or any other website or application that provides access to downloadable applications. Mobile application 50 may then be installed on mobile device 107.

[0138] Upon downloading mobile application 50 on mobile device 107, at step 502 the user may register using mobile application 50 similar to the registration process described above with respect to mobile application 318. For example, the user may provide user identification information such as a phone number associated with mobile device 107 of the user. The user identification information may be any other unique identifier which may be linked to the phone number associated with the mobile device 107 of the user (e.g., MAC address, MIN, MSIN, ESN, MEID, IMEI, and/or IMSI, or any other identifier unique to mobile device 107). The user identification information and any other the user registration information, referred to as registration data, may be saved on server 102 and/or databases 114.

[0139] Authentication system 400, like authentication system 100, may optionally require the user to confirm that the user is in possession of the mobile device corresponding to the user identification information and may employ the same procedures for verification as set forth above. For example, upon receiving the user identification information, the server may send a verification message having a verification code, such as a SMS verification message, to the mobile device corresponding to the user identification information and upon receiving the verification message, the user using the mobile application may transmit the verification code to the server and the server may confirm that the code is correct. As explained above with respect to authentication system 100, authentication system 400 may only require a user to verify a mobile device once during registration or, alternatively, may require verification each time the user identification information is provided to the server.

[0140] Further, the registration process may require the user to set up a user profile that includes one or more authentication methods. For example, authentication methods may include conventional passwords, including a one-time password (OTP), tokens or SMS text (e.g., numbers/code), as well as biometric authentication methods already discussed above such as, for example, retina scan, iris pattern identification, finger print identification, finger vein identification, face recognition, voice pattern recognition. Upon downloading mobile application 50 to mobile device 107, mobile application 50 will instruct the user to select one or more authentication methods and/or will prompt the user to generate authentication data using one or more biometric sensors 320.

[0141] The biometric data and password data (if applicable) collected by mobile device 107, referred to as authentication data, will be saved locally mobile device 107. The method for collecting and obtaining authentication data is the same as described above with respect to authentication system 100. The authentication data may be stored in an encrypted format on mobile device 107 to protect the user's privacy. As user authentication is performed by mobile device 107, the authentication data need not be communicated to any other device.

[0142] For applications where secure system 410 requires user credentials (e.g., user name and password/pin) for access to secure system 410 the registration process may optionally include collecting user credentials for each secure system 410 that requires credentials for access, referred to as secure system credential data. For example, where secure device is a computing device such as a desktop computer or an Automated Teller Machine (ATM), the user name and password for these systems may be obtained from the user using mobile device 107 running mobile application 50. The secure system credential data may be stored in an encrypted format on mobile device 107 and/or shared with server 102 and/or databases 114 and stored in an encrypted format on server 102 and/or databases 114.

[0143] Some or all authentication data and/or user profile data (e.g., user credentials and other information about the user) of a user may already be present on mobile device 107. The authentication data may be stored in memory of mobile device 107 and may be associated with another application (e.g., a third party application). Mobile application 318 may scan mobile device 107 for this data and may copy or extract the relevant data. Mobile device 107 may present the user with an option to extract or copy the authentication data and/or user profile data for registration instead of or in addition to obtaining new authentication data and/or user profile data.

[0144] Mobile device 107 and/or interface device 405 may transmit the authentication data and/or user profile data to server 102 to be stored. Advantageously, by storing the data on server 102, server 102 may authenticate the data without retrieving the data from other components in authentication system 400 (e.g., mobile device 107 or interface device 405.

[0145] As mentioned above, mobile device 107 running mobile application 50 may communicate with interface device 405 running software application 420. Interface device 405 may be initially designed and programmed with software application 420. Alternatively, at step 503, the user or an administrator with access to interface device 405 may download software application 420 to interface device 405. Where interface device 405 is initially designed and programmed with software application 420, step 503 may be skipped.

[0146] To employ authentication system 400, at step 504, communication between mobile device 107 running mobile application 50 and interface device 405 running software application 420 may be initiated. Communication may be initiated by, for example, the user pressing or otherwise engage input device 412 which may be a physical button or a button or a screen of interface device 405 that initiates communication. Upon clicking on input device 412, interface device 405 running software application 420 will send mobile device 107 running mobile application 50 a message requesting the user to provide user identification information such as the phone number corresponding to mobile device 106.

[0147] Alternatively, interface device 405 may have a proximity sensor or other sensor for sensing nearby computing devices such as mobile device 107. Interface device 405 may be programmed to automatically generate a request for user identification information upon detecting a nearby device. In yet another example, to initiate communication, the user may instruct mobile application 318 to send a user identification information from mobile device 107 to interface device 405 unprompted by interface device 405.

[0148] The user, using mobile device 107, will enter the requested user identification information into mobile device 107 which will transmit that information to interface device 405. Alternatively, mobile device 107 may be programmed to automatically respond to interface device 405 and provide user identification information stored on mobile device 107 or otherwise known to mobile device 107. Interface device 405 running software application 420 may share the user identification information with server 102. Server 102 and/or interface device 405 running software application 420 may confirm that the mobile number or other user identification information provided by mobile device 107 corresponds to a valid registered user. Server 102 may optionally communicate with database 114 to confirm that the user identification information corresponds to a valid registered user.

[0149] Upon initiating communication at step 504, at step 505 software application 420 via interface device 405 or server 102 will send a request for authentication to mobile device 107. At step 506, mobile device 107 running mobile application 50 will obtain authentication data. Like mobile application 318, mobile application 50 may be programmed to require one or more types of authentication data (e.g., password, fingerprint data, retina data, iris data, face data, voice data) to authenticate the user. Mobile application 50 may be programmed to have a bias for certain authentication methods according to a hierarchy and/or may require a certain number of authentication methods.

[0150] In some instances, the initiation of communication between mobile device 107 and interface device 405 may fail. The initiation may fail because mobile device 107 is not connected to a network to receive a request for authentication data or because mobile device 107 may not be working properly, for example. In such instances, interface device 405 may perform steps similar to steps 378-390 to authenticate a user via a secondary device. For example, if interface device 405 fails to receive an authentication response from mobile device 107, interface device may determine whether a secondary device is associated with the same user profile as mobile device 107 and may use the secondary device to perform authentication, as described in step 378-384. Specifically, if interface device 405 determines there is not a secondary device, interface device 405 may signal for server 102 to send an OTP code to an email of the user for authentication. If there is a secondary device registered, a request for authentication may be sent to the secondary device on which authentication data may be obtained. The secondary device may then determine if the user is authenticated as described in steps 385-390.

[0151] The secondary device may be a mobile phone, personal computer, laptop, tablet or any other computing device with features enabling receipt and transmission of authentication data and/or email. The user may download mobile application 318 to the secondary device and register the secondary device. In one example, the user may register the phone number of the secondary device. A user may enter the URL into interface device 405 and enter the secondary device phone number. Upon entering the URL and phone number, application 420 may transmit a request to server 102. Server 102 may compare the phone number received against registered phone numbers. If the received number matches the stored number, server 102 may send a message to the secondary device asking for authentication data (e.g., a face scan or a thumbprint scan).

[0152] A user using secondary device may generate authentication data and send the authentication data to server 102. Server 102 may compare the authentication data with data stored in server 102. If the received authentication data matches the authentication data stored within server 102, server 102 may send a message to interface device 405 indicating the user is authenticated.

[0153] At step 507, mobile device 107 running mobile application 50 may analyze authentication data using, for example, well known fingerprint analysis, retina analysis, iris analysis, face analysis and voice analysis techniques. The data collected and/or the analyzed data will be compared to the authentication data corresponding to the user's profile and stored locally on mobile device 107. At decision 508, after comparing the data obtained at step 506 to the authentication data corresponding to the user's profile, mobile device 107 running mobile application 50 will determine whether the obtained data is the same or substantially similar to the data corresponding to the user's profile, and thus if the user has been authenticated.

[0154] If mobile device 107 running mobile application 318 determines at decision 508 that the user is not authenticated, at step 509 mobile device 107 may optionally generate a message on the display of mobile device 107 that the authentication failed. Mobile device may repeat step 506 and step 507 a preset number of times or may even prompt the user to generate different biometric data if the first attempt to authenticate failed. Further, at step 510 mobile device 107 running mobile application 50 may inform software application 420 and/or server 102 that authentication failed. Software application 420 may also generate a message on the display of the interface device 405, if interface device 405 includes a display, informing the user that authentication failed.

[0155] Conversely, if mobile device 107 running mobile application 50 determines at decision 508 that the user is authenticated (i.e., authentication was successful), at step 511 mobile device 106 may optionally generate a message on the display of mobile device 107 that the authentication was successful. Further, at step 512, mobile device 107 will inform software application 420 and/or server 102 that the authentication was successful.

[0156] At step 513, in response to a successful authentication, mobile device 106 and/or server 102 optionally may communicate credentials to interface device 405. The credentials may be communicated to software application 420 via any of the well-known communication methods set forth above and may be transmitted in an encrypted format. the credential information may be provided from and saved locally on interface device 405

[0157] In one example, interface device 405 may include a password manager module which may be a part of software application 420 or may be a standalone software application run on interface device 405. A user may save passwords and various information, such as user names, using password manager module. This information may be saved locally on software application 420 or may be saved on a remote server (e.g., server 102) and retrieved by software application 420. Upon being informed that authentication was successful, software application 420 may communicate with the password manager module to obtain certain credentials. Specifically, software application 420 may generate a request for credential information from password manager module and/or transmit the request to password manager module. Upon receiving the request, password manager module may retrieve the requested credential information, either locally or from the remote server, and generate and/or transmit the requested credential information.

[0158] Software application 420, upon receiving the credentials, will submit or otherwise transmit the credentials to secure system 410 which will grant access to the user upon validating the credentials. Alternatively, in some circumstances, upon receiving notification that authentication was successful at step 512, interface device 405 may instruct secure system 410 to grant access to the user without the need for credentials. In this manner, the user using mobile device 107 may perform authentication on mobile device 107 to access secure system 410.

[0159] As explained above, authentication system 400 may be employed to grant a user access to a physical location. For example, secure system 410 may be a door that grants access to a secure employment facility. The door may remain locked but may be unlocked using authentication system 400.

[0160] In this example, an employee may approach the door of the facility and press a physical button located on interface device 405 located on or near the door. Interface device 405 may initiate communication with the employee's mobile device as set forth above. The employee, having registered his or her mobile device, may use the mobile device to gain access to the facility.

[0161] As described above with respect to steps 505-507, after pressing the button to initiate communication, the employee will receive a message on the mobile device requesting the user to enter biometric information for authentication. In this example, mobile device 107 is programmed to automatically send interface device 405 user identification information in the form of the phone number corresponding to the mobile device which is validated by an offsite server.

[0162] The employee will next follow prompts on the display of his or her mobile device. In this example, the company has programmed application 50 to request a thumbprint first and then perform a face scan, resulting in a two-step authentication approach. Following the prompts on his or her phone, the employee will generate authentication data in the form of a thumb print and a face scan and authenticate the data on the employee's mobile device.

[0163] The employee's phone will compare the authentication data to authentication data stored locally on the phone. If it is determined that the authentication is successful, the mobile device will send a message to interface device 405 informing the interface device that authentication was successful. The interface device may share this message with the offsite server. Interface device will then, via a wired or wireless connection, instruct the door (i.e., secure system 410) to open.

[0164] Referring now to FIG. 6B, a flowchart is illustrated detailing the data flow and decisions made in implementing authentication system 400 to authenticate a user via server 102. FIG. 6B starts after software application 420 has been downloaded to interface device 405 and mobile application 318 has been downloaded to mobile device 107, as described with respect to steps 501-503 of FIG. 6A. At step 514, a user using mobile application 318 running on mobile device 107 may initiate communication between software application 420 running on interface device in the same manner as described with respect to step 504. At step 515, interface device 405 may send and mobile device 107 may receive a request for authentication in the same manner described with respect to step 505. At step 516, a user using mobile application 318 running on mobile device 107 may obtain authentication data in the same manner described with respect to step 506. At step 517, mobile device may send the obtained authentication data directly to server 102 or may send the data to interface device 405 which may relay the data to server 102.

[0165] At step 518, server 102 receives the authentication data and determines at decision 519 whether the user is authenticated. This determination will be made in the same manner as described above with respect to step 507 and decision 508, except that server 102 and not mobile device 107 will determine whether the user is authenticated. If it is determined at decision 520 that the user is not authenticated, at step 520, the server may inform software application 420 and/or mobile application 318 that authentication failed. Conversely, if server 102 determines at decision 508 that the user is authenticated (i.e., authentication was successful), at step 521 server 102 may inform software application 420 and/or mobile application 318 that the authentication was successful. At step 522, in response to a successful authentication, mobile device 106 and/or server 102 optionally may communicate credentials to software application 520. The credentials may be communicated to software application 420 via any of the well-known communication methods set forth above and may be transmitted in an encrypted format. Alternatively, the credential information may be provided from and saved locally on interface device 405.

[0166] In this manner the employee may gain access to the employment facility using the employee's mobile device. The offsite server may be informed every time the interface device instructs the secure system to open the door. In this way, the offsite server may keep a log of each user that enters the employment facility and at what time. A similar authentication system may be used to exit the facility (of course allowing for emergency exiting). The system that permits exiting the facility may also be in communication with the same offsite server which may generate a log of each user that exits the employment facility and at what time. Accordingly, a log may be generated for the users that enter and exit the facility. The log could be used to automatically track the time worked for hourly employees.

[0167] The steps and decisions set forth above with respect to FIGS. 6A and 6B are applicable to lock boxes (e.g., lockers and safety deposit boxes) that may be stored or located in buildings or facilities such as, but not limited to, schools, fitness centers, retail stores, hotels, and banks. The lock boxes may be used to store belongings of a user. The lock boxes may be connected to the Internet via WiFi, Ethernet, or cellular data, or any other well-known communication network. The lock boxes may include or be in communication with interface device 405. On a mobile device (e.g., mobile device 107), a user may download an application (e.g., application 50) that interfaces with software application 420 of the lock boxes. The user may generate an account linked to the phone number of the mobile device associated with the account. An administrator also may manage the lock boxes by communicating with interface device 405. Each lock box may be assigned a unique identifier. To lock or unlock a lock box, a user may initiate communication between interface device 405 and mobile application 107 and provide the unique identifier of the lock box to interface device 405. Interface device 405 may then request authentication data (e.g., a face scan or a thumbprint scan) from mobile device 107. Mobile device 107 may authenticate the user in the manner described above with reference to steps 505-513. Alternatively, the mobile device may transmit the authentication data to a server to authenticate the user in the manner described above with reference to steps 515-522. Once the user is authenticated, software application 420 may lock or unlock the lockbox.

[0168] The steps and decisions set forth above with respect to FIGS. 6A and 6B are also applicable to Wi-Fi networks. Specifically, software application 420 may be run on an access point which serves as interface device 405 and may connect one or more devices (computing devices, mobile devices, etc.) to a network (e.g., the Internet) via a router. Interface device 405, serving as an access point, may thus generate a wireless connection with other devices. For example, a user may request to access the wireless network via a message sent from the mobile device to the access point. When a request is received by the access point, software application 420 running on the access point may send a request to mobile application 318 running on the mobile device for an identification number (e.g., phone number). The mobile device may receive the request and provide the access point the identification number. Alternatively, the request to join the network may automatically include the identification number. The access point may compare the transmitted identification number to a list of stored numbers within the access point. If the entered identification number matches a registered identification number that is permitted access, the access point may send a request to the mobile device for authentication. Alternatively, the mobile device or access point may send the identification number directly to server 102 and server 102 may compare the identification number to registered numbers and inform the access point if the number matches a registered identification number. Once the identification number is confirmed, the mobile device may perform the processes described above (e.g., steps 505-508) to authenticate the user of the mobile device. Alternatively, the mobile device may transmit the authentication data to a server to authenticate the user in the manner described above with reference to steps 515-522. Once the mobile device is authenticated, the mobile device, or server, will inform the access point running software application 420 that the user has been authenticated. Once the user is authenticated, the access point may grant the mobile device access to the wireless network.

[0169] As also explained above, authentication system 400 may be employed to grant a user access to a computing device such as an ATM and/or to restricted information and/or functionality on a computing device. In this example, secure system 410 and interface device 405 is the same device and/or interface device 405 is incorporated into and otherwise part of the desktop computer and ATM.

[0170] At set forth above with respect to FIGS. 6A-B, the user may download the mobile application to the user's mobile device. The user may register and populate a user profile running the mobile application on the mobile device. Accordingly, using the mobile device, the user may generate biometric authentication data that is stored on the user's mobile device. The mobile application will be programmed to store the user identification information, in this case, the user's phone number, name, and bank identification number, on a bank server. To complete registration, the user also inputs ATM login-in credentials to the mobile application which will be saved locally on the mobile device in an encrypted format. It is assumed that, for the purposes of this example, software application 420 was loaded on to the ATM by the bank administrators.

[0171] To access the ATM, the user will approach the ATM with the mobile device. The user will either press a mechanical button on the ATM or a touch screen button on the ATM to initiate communication with the ATM. Alternatively, the ATM may include a proximity sensor and determine that the user's mobile device is nearby. The ATM will send a message to the mobile device requesting user identification information. Alternatively, the ATM may communicate with the mobile device through the bank server.

[0172] The user will enter the requested user identification information into the mobile device. The ATM will communicate the user identification information to the bank server for validation. Upon confirming that the user is registered with the bank's authentication system, the ATM and/or bank server will request authentication data from the mobile device. In this case the requested authentication data involves a thumbprint scan. The user will generate the requested authentication data using the mobile device and the authentication data will be compared to authentication data in the user's profile.

[0173] If the authentication is successful (i.e., the obtained authentication data is the same or substantially similar to the authentication data in the user's profile), the mobile device will inform the ATM and/or bank server that the authentication was successful. The ATM and/or bank server will then request that that the mobile device provide ATM credentials which includes the user's ATM pin. The user credentials are stored on the mobile device as part of the user's profile. The mobile device will automatically generate an encrypted response with the user's ATM credentials.

[0174] The bank server will compare the received ATM credentials to those in the bank's database. If the credentials provided match those saved on the bank's server, the server will send a message to the ATM granting the user access to the user's bank account on the ATM. In this manner the bank customer may gain access to ATM using only the user's mobile device. This approach reduces the risk of fraudulent access to the user's account.

[0175] A user may employ a similar approach to access a computing device such as a work desktop computer. Like in the ATM example, the user may download the mobile application to the user's mobile device and register the user profile. However, in this example the credentials will be sign-in credentials for the computing device. The user's profile will be shared with a company server. It is assumed that, for the purposes of this example, software application 420 was loaded on to the work desktop computer by the company administrators.

[0176] To access the work computer the user will either press an initiation button on the work computer touch screen or use an input device (keyboard or mouse) to select an initiation button on the display of the work computer. The work computer will proceed to send a request to the mobile device for user identification information. In this case the mobile device running mobile application 50 will be programmed to automatically respond to the request with the employee's user identification information. The work computer will communicate the user identification information to the company server for validation. Upon confirming that the user is registered with the company's authentication system, the work computer or company server will request authentication data from the mobile device. In this case the requested authentication data involves a face scan. The user will generate the requested authentication data using the mobile device and the authentication data will be compared to authentication data in the user's profile.

[0177] If the authentication is successful (i.e., the obtained authentication data is the same or substantially similar to the authentication data in the user's profile), the mobile device will inform the work computer and/or company server that the authentication was successful. In response, the work computer will grant the user access to the work computer. In this manner the bank customer may gain access to the work computer using only the user's mobile device.

[0178] It is further understood that the mobile device that initiates communication at step 504 may be a different mobile device than the mobile device that receives the request for authentication at step 505, obtains authentication data at step 506, compares the obtained authentication data to registered authentication data at step 507, and authenticates the authentication data at decision 508. Specifically, a first mobile device used by a first user may initiate communication and cause authentication system 400 to generate a request for authentication data from a second mobile device used by a second user. Where two mobile devices implement authorization system 400, the second mobile device may directly inform the first mobile device whether the authentication was successful at decision 508 and/or may communicate with the second mobile device via the server. This approach may be useful where the user of the first mobile device does not have authority to access certain locations and needs authorization from a second user to access the location. It is understood that both the first and second mobile device may be required to register as set forth above, or, alternatively, only the second mobile device may be required to register.

[0179] Mobile application 318 and/or mobile application 50 may also include a panic button. If the user presses the panic button for a predetermined time (e.g., 30 seconds), then the mobile application may raise an alarm and/or alert the law enforcement agencies. The panic button may be hidden in a particular area of the user interface. For example, the user may be forced by a thief to authenticate on an online bank account using her mobile device. In such a situation, the user may press the panic button for the predetermined time to raise alarm and alert the law enforcement agencies.

[0180] Authentication system 100 and/or authentication system 400 may be used by users (i.e., authorizers) to authorize other individual's access to a location or to information. For example, an individual in one location may attempt to gain access to digital information or a location while an authorizer is in different location. A request for authentication data may be generated and sent to the authorizer's mobile device. Upon receiving the request, the authorizer may grant the individual access to the digital information or location by generating authentication data, such as biometric data, using the mobile device and authenticating the data as set forth above. Upon authenticating the authentication data, the mobile device may inform the server that the remote individual is granted permission to access the location or digital information and the server may then grant the individual access to the location or digital information. The server may keep a log of the permissions granted by the authorizer.

[0181] Authentication system 100 and/or authentication system 400 may be used to access a forgotten password or reset a password. Often times an administrator may be tasked with retrieving the employee's forgotten password from a password database. Also, company protocol may require the user to change the employee's password to a new password. However, authentication system 100 and/or authentication system 400 may allow the employee that forgot their password to access their password or reset their password using authentication data. For example, upon failing to login, mobile application 50 or mobile application 318 may prompt the employee to input authentication data, such as biometric data, on a mobile device, such as a mobile device. The user may then generate the authentication data and the authentication may be authenticated as explained above. Upon authenticating the data, mobile application 50 or mobile application 318 may instruct the server to provide the forgotten password, provide a new password, or permit the user to generate a new password.

[0182] Authentication system 100 and/or authentication system 400 may be used to provide a user access to websites without user credentials (e.g., username and password). Upon accessing a website corresponding to application 220, application 220 may immediately request user authorization to access the website. For example, application 220 may prompt the user to enter a mobile phone number and may send a request for authentication to that mobile phone number. The user may then obtain authentication data and mobile application 318 may perform authentication to grant the user access to the website. Alternatively, authentication may be performed on computing device 110.

[0183] Authentication system 100 and/or authentication system 400 may be used as a person locator. For example, a user's mobile device may receive a request from another device to input biometric data to provide assurances that the person is using and physically with the mobile device. The user receiving the request may generate authentication data which may be authenticated as described above. A message will then be generated and sent to the requesting device indicating whether or not the authentication data was authenticated. The message may also include the location of the mobile device.

[0184] Authentication system 100 and/or authentication system 400 may be used to permit access key box having a physical key inside for access to a residence or building or may permit access to a residence or building. For example, a real estate professional may gain access to a key box having a key inside by accessing authentication system 100 or authentication system 400 from a mobile device. The real estate professional may generate a request for authentication data by actuating an authentication button on the key box. Alternatively, the real estate professional may generate the request by accessing mobile application 318. The request for authentication data may be sent to the mobile device of the real estate professional. Upon receiving the request, the real estate agent may generate the requested authentication data using the mobile device. The authentication data may then be authenticated as described above. Upon authenticating the authentication data, the code needed to open the key box may be sent to the real estate agent's mobile device from the server or the server may send a message directly to the key box instructing the key box to open. Additionally, a similar process as described below may be used to prove the real estate agent is who they claim to be to obtain approval from a homeowner for a visit.

[0185] Authentication system 100 and/or authentication system 400 may be used to permit a homeowner to modify a home security system, including system settings and/or password information. For example, the home owner may actuate a button on a security system keypad or may access a security system website or application to generate a request for authenticate data to be sent to the mobile device. The user may generate the authentication data on the mobile device and the data may be authenticated as explained above. Once authenticated, the security system may permit the user to change the security system settings.

[0186] Authentication system 400 may be used to verify the identity of a voter at a voting booth to ensure that the voter is present in the voting booth. Once entering the voting booth, the person may actuate a button that sends a request to the mobile device to generate authentication data. The voting booth system may additionally require the user to enter their mobile device number. Upon receiving the request for authentication data, the voter may generate the requested authentication data and the data may be authenticated as described above. If the authentication data is authenticated, a ballot may be submitted. A similar system may also be employed for voting using a mobile device. For example, a website or application for submitting a vote using a mobile device may require the user to generate authentication data and upon generating authentication data, the authentication may be authenticated as described above. If the authentication data is authenticated, the ballot may be submitted.

[0187] Authentication system 100 may be used to authenticate owners of social media accounts and/or change the settings of a social media account. For example, when generating a social media account, the social media service may send a request for authentication to the mobile device corresponding to that account. The user of the mobile device may generate authentication data and the data may be authenticated as explained above. Authentication system 100 may also implement the procedure when a user tries to reactivate an account after it was deactivated. A similar approach may be used more generally in the creation and maintenance of any digital account. It is understood that this approach may reduce the risk of fake accounts.

[0188] Authentication system 100 may be used to verify that a delivery has been completed. Once the delivery is made, the delivery person using a mobile device may generate and send a message to the server confirming that the delivery is complete. Alternatively, an automated message may be generated based on the location of the mobile device of the delivery person. In response to receiving the message that the delivery is complete, a request may be generated by the server and sent to a mobile device of either the intended recipient or the delivery person requesting authentication data to confirm that the delivery is complete. The recipient of the request may then generate authentication data and authenticate the data using the respective mobile device, as explained above. Upon authenticating the data, the mobile device that received the request will send a message to the server confirming that the delivery is complete. In one example, if the intended recipient of the package is not present at the time of delivery, the delivery person, using the mobile device of the delivery person, may send a request for authorization to leave the package at the delivery location corresponding the intended recipient or at certain location. The intended recipient of the package may generate authentication data in response to the request and the authentication data may be authenticated as described above. Upon authenticating the authentication data, the mobile device of the intended recipient may generate a message to the server and/or mobile device of the delivery person, indicating that the delivery person is authorized to leave the package at the delivery location corresponding the intended recipient or at certain location.

[0189] Authentication system 100 may be used to restrict access to digital files and/or content to only those users that have been authorized to access the files and/or content. For example, a document may require a user to enter authentication data by generating a phone number upon opening the document. The user may enter the phone number associated with his or her mobile device and the mobile number may be communicated to the server. The server may then send the mobile device associated with the phone number a request for authentication data. The individual attempting to open the document will then generate the authentication information and authenticate the authentication information using the mobile device, as explained above. Upon authenticating the authentication data, the user will be permitted access to the document.

[0190] Authentication system 100 may be used to certify a file or document or attach a certified electronic signature to a file or document. For example, an agreement may need to be signed by an individual. Upon opening the digital file on a computing device, a the individual may either be prompted to provide certification or may request to do so. In response, a request for authentication data will be generated and sent to the mobile device of the user. The system may request the individuals mobile number, if this information is not already known. Using the mobile device, the individual will then generate authentication data and the authentication data will be authenticated, as described above. Upon authenticating the authentication data, the document will be certified by the individual. This may involve attaching a certified electronic signature.

[0191] Authentication system 100 may be used for on-demand approval of certain actions. For example, an employee may need approval for a work expenditure such as office supplies. An employee may use mobile application 318 or may access a URL such as a company website to submit a request for authorization to purchase the work expenditure. The request may be automatically routed to a known authorizer or the employee may direct the request to a particular individual for authorization. The request may include an amount and/or information about the proposed purchase. The authorizer may receive the request on the mobile device of the authorizer. The request may prompt the authorizer to generate authentication data to approve the request or alternatively deny the request. The authorizer may generate authentication data and the mobile application may authenticate authentication data information using the mobile device, as explained above. Upon authenticating the authentication data, the mobile device of the authorizer may inform the requestor that expenditure has been approved. For example, the message may be sent to the URL and/or requestor's mobile device. If authentication fails or if the authorizer denies the request, the mobile device of the authorizer may inform the mobile device of the requestor that request has not been approved. A log of the requests, approvals, and denials may be generated.

[0192] Authentication system 100 may be used to access an online account (e.g. online bank account). For example, a user may visit a website to access the online account. The website may prompt the user to enter their mobile device number or other user identification information. The user may then enter their mobile device number which may be sent to the server which transmits a request for authentication to the mobile device corresponding to the mobile device number. The user may generate authentication data and the mobile device may authenticate the authentication data, as described above. Upon, authenticating the authentication data, the mobile device may inform the server that the user has been authenticated and the user may be granted access to the online account.

[0193] It is understood that managed service providers (MSPs) may implement and manage authentication system 100 and/or authentication system 400 and consequently have the ability to manage password servers and dynamic passwords and/or otherwise implement the procedures and systems described herein. MSPs may manage authentication data provided by users and request additional authentication data. For example, MSPs may ensure biometric data is up-to-date.

[0194] Referring now to FIG. 7, exemplary user authentication system 600 is illustrated. Authentication system 600 may be used to authenticate a user and facilitate digital review and execution of a document that may be a digital file with text, one or more images or videos, and/or other digital content. Authentication system 600 may be substantially similar to authentication 100 and may involve mobile device 540, computer device 530, server 550, and database 555. Mobile device 540 may communicate with computing device 530 and server 550. Computing device 530 may communicate with mobile device 540 and server 550. Server 550 may communicate with computing device 530, mobile device 540, and database 555, which may be one or more databases. Communication may be via the internet, and/or or any other well-known wired or wireless connection described above with respect to FIG. 1. It is understood that authentication system 600 may include more than one mobile device, computing device, server and/or database. For example, where multiple users are involved, a second mobile device and/or second computing device used by the second user may be included in authentication system 600.

[0195] Referring now to FIGS. 8A-8C, exemplary functional blocks representing the software and hardware components of computing device 530, mobile device 540, and server 550 are illustrated. As shown in FIG. 8A, computing device 530 may be substantially the same as computing device 110 except that programming modules 206 may include computer application 531 and document execution application 532. Computer application 531 may be substantially similar to mobile application 541 and may be used to authenticate a user as set forth in FIG. 3B, except that computing device 530 may perform the authentication rather than the mobile device. Input device 212 may be or include a biosensor such as biosensor 320. Accordingly, computing device 530 may be used to authenticate a user.

[0196] Document execution application 532 may be a software application dedicated to document review and execution using a digital signature. For example, document execution application 532 may be used to view a digital document on computing device 530 and to affix one or more digital signatures to the digital document using computing device 530. The digital signature may be an image of the user's signature, text of the user's initials or name, and/or any other identifier of the user. Document execution application 532 may be similar to DocuSign by DocuSign, Inc. or Adobe Sign by Adobe Inc. Document execution application 532 may be web-based and may be downloaded to the computing device when a website or web portal is accessed and/or may be downloaded on the backend of the website or web portal on a server. Where document execution application 532 is web-based, document execution application 532 and document execution application 556 may be the same application. Accordingly, document execution application 532 may permit users to review a document and attach a digital signature to the document that is legally binding. Processing unit 308 may be configured to run computer application 531 and document execution application 532. It of course is understood that computing device 530 may include additional or fewer components than those illustrated in FIG. 8A and may include more than one of each type of component.

[0197] Referring now to FIG. 8B, mobile device 540 may be substantially the same as mobile device 106 except that programming modules 306 may further include document execution application 542. Mobile application 541 may be used to authenticate the user. Mobile application 541 may be the same or substantially similar to mobile application 318 and may perform the functions attributed to it herein. Document execution application 542 may be similar to document execution application 532 but may be run on mobile device 540. Specifically, document execution application 542 may be used to view a digital document on mobile device 540 and to affix one or more digital signatures to the digital document using mobile device 540. Document execution application 542 may be web-based and may be downloaded to the mobile device when a website or web portal is accessed and/or may be downloaded on the backend of the website or web portal on a server. Where document execution application 542 is web-based, document execution application 542 and document execution application 556 may be the same. Processing unit 308 may be configured to document execution application 542. It of course is understood that mobile device 540 may include additional or fewer components than those illustrated in FIG. 8B and may include more than one of each type of component.

[0198] Referring now to FIG. 8C, exemplary functional blocks of server 550 are shown. Server 550 may be substantially the same as server 102. Server 550 may be one or more servers. As is shown in FIG. 8C, server 550 may include processing unit 558 and system memory 552. Processing unit 558 may be one or more processors configured to run server application 554 and document execution application 556 and perform the tasks and operations of server 550 set forth herein. Alternatively, server application 554 and document execution application 556 may be executed on separate servers. It is further understood that document execution application 556 and/or server application 554 may be executed on one or more servers.

[0199] System memory 552 may include, but is not limited to, volatile (e.g. random-access memory (RAM)), non-volatile (e.g. read-only memory (ROM)), flash memory, or any combination thereof. Operating system 553 and one or more programming modules 566 as well program data 557 may be run on server 550. Operating system 553 may be suitable for controlling server 550′s operation. Programming modules 566 may optionally include image processing module, machine learning module and/or image classifying module. It is understood that server 550 may be practiced in conjunction with a graphics library, other operating systems, or any other application program.

[0200] Server 550 may have additional features and functionality. For example, server 550 may also include additional data storage devices (removable and/or non-removable) such as, for example, magnetic disks, optical disks, or tape. Such additional storage is illustrated in FIG. 8C by removable storage 559 and non-removable storage 561. Computer storage media may include volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information, such as computer-readable instructions, data structures, program modules, or other data. System memory 552, removable storage 559, and non-removable storage 561 are all computer storage media examples (i.e., memory storage.) Computer storage media may include, but is not limited to, RAM, ROM, electrically erasable read-only memory (EEPROM), flash memory or other memory technology, CD-ROM, digital versatile disks (DVD) or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium which may be used to store information and which may be accessed by server 550. Any such computer storage media may be part of server 550.

[0201] Server 550 may also contain communication connection 565 that may allow server 550 to communicate with computing device 530, mobile device 540 and/or any other computing devices described herein over any well-known wired or wireless connection, and (e.g., cellular, Near Field Communication (NFC), Wi-Fi Direct (P2P), Bluetooth, USB, radio frequency (RF and RFID), infrared, etc.) including over any well-known standard such as any IEEE 802 standard. Communication connection 565 may be embodied or otherwise facilitated by computer readable instructions, data structures, program modules, or other data in a modulated data signal.

[0202] As stated above, a number of program modules and data files may be stored in system memory 552, including operating system 553. While executing on processing unit 558, programming modules 566 (server application 554 and document execution application 556) may perform processes including, for example, one or more stages of methods, algorithms, systems, applications, servers, databases as described herein.

[0203] Document execution application 556 may be a software application dedicated to document review and execution using a digital signature. Document execution application 556 may be similar to DocuSign by DocuSign, Inc. or Adobe Sign by Adobe Inc. For example, document execution application 556 may work together with document execution application 532 and/or document execution application 542 to affix one or more digital signatures to a digital document. Accordingly, document execution application 532 may permit users to review a document and attach a digital signature to the document using computer device 530 and/or mobile device 540. Document execution application 556 and document execution application 532 and/or document execution application 432 collectively form a document execution platform, which may be referred to herein as the document execution application.

[0204] Server application 554 may be a software application and/or platform that works together with computer application 531 and/or mobile application 541 such that computer application 531 and/or mobile application 541 may be hosted on server 102 and accessed via computing device 530 and mobile device 540. Server application 554 may be used together with computer application 531 and/or mobile application 541 to authenticate a user as set forth in FIG. 3C and described above.

[0205] It is understood that server application 554 and document execution application 556 may be separate and distinct software applications and may be run on the same or different severs. In one example, server application 554 may include an application programming interface (API) for facilitating communication and data exchange between server application 554 and document execution application 556. Alternatively, the API may be part of document execution application 556 or even may be a standalone application further included in programming modules 566. In this manner, authentication data and other information corresponding to authentication data may be shared between server application 554 and document execution application 556. Additionally, information and instructions may be communicated.

[0206] Other programming modules that may be used in accordance with embodiments of the present disclosure may include sound encoding/decoding applications, machine learning application, encryption/decryption applications, acoustic classifiers etc. Generally, program modules may include routines, programs, components, data structures, and other types of structures that may perform particular tasks or that may implement particular abstract data types. It of course is understood that server 550 may include additional or fewer components than those illustrated in FIG. 8C and may include more than one of each type of component.

[0207] Referring now to FIG. 9, a process for authenticating a user and digital execution of a document is illustrated. As explained above, server application 554 may work together with document execution application 556 and may cooperate and exchange data via an API that is part of server application 554. In another embodiment, the API may be standalone or part of document execution application 556.

[0208] Prior to permitting a user to view and/or execute the document according to the process set forth in FIG. 9, an account and a user profile may be established on document execution application 556 by an uploader and a document may be uploaded to document execution application 556. At step 571, a user may use computing device 530 running document execution application 531 and/or mobile device 540 running document execution application 542 to communicate with document execution application 556 and create an account. In this manner a user profile may be generated on document execution application 556. The user profile may include a user identification, a user password, personal information about the user, and/or other user information and may require the user to verify certain devices such as computing device 530 and mobile device 540.

[0209] At step 572, upon creating a user profile with document execution application 556, document execution application 556 may prompt and/or require the user to create a profile on server application 554, which may cause server application 554 to generate a user profile. Computing device 530 running computer application 531 and/or a mobile device 540 running mobile application 541 may be used to create a user profile.

[0210] As explained above, the registration process may require the user to provide user identification information. The user identification information may be the phone number associated with mobile device 540 of the user or a different alphanumeric identifier of the user. The user profile may include at least the user identification information and may additionally include information about the user and/or the mobile device and/or any other user information. The user profile may be saved on server 550 as well as computing device 530, mobile device 540 and/or database(s) 555.

[0211] Further, the registration process may require the user to generate authentication data unique to the user. Authentication data may include conventional passwords, including a one-time password (OTP), tokens or SMS text (e.g., numbers/code), and/or biometric data such as retina scan information, iris pattern information, finger print scan information, finger vein scan information, face scan information, voice pattern information, as also explained above. The authentication data may be saved locally by mobile device 540 and may be shared with computing device 530 and/or server 550. The authentication data may be stored in an encrypted format to protect the user's privacy.

[0212] At step 573, document execution application 556 may prompt and/or instruct a user to access a document. This may occur after an uploader has uploaded a document for review and execution. For example, document execution application 556 may send an email to the user instructing the user to open the document and execute the document. The email may include a link that may cause the document to open on computing device 530 and/or mobile device 540. Alternatively, at step 573, document execution application 556 may send a notification to mobile device 530 and/or computing device 540 (e.g., a push notification) informing a user that a document is available for review and execution. In yet another example, document execution application 556 may cause computer application 531 or mobile application 541 to instruct the user that a document is available for review and execution.

[0213] A user may either click on a link or otherwise may request access to the document on computing device 530 and/or mobile device 540 (e.g., by opening document execution application 532 and/or document execution application 542). Upon clicking on the link or otherwise requesting access to the document, a request to access the document may be sent to and received by document execution application 556 at step 574.

[0214] The request at step 574 may cause document execution application 556, document execution application 532, or document execution application 542 to request authentication of the user that is requesting to access the document. Preferably, a push notification or similar message may be sent to mobile device 540 for authentication using mobile application 541. Alternatively, a request for authentication may be sent to computer application 531 on computing device 530. For example, if no response is received from mobile device 540, a request for authentication may then be sent to computing device 530, similar to the process described above with respect to FIG. 3D. At step 575, mobile device 540 running mobile application 541 and/or computing device 530 running computer application 531 may receive the request for authentication.

[0215] At step, 576 mobile device 540 running mobile application 541 and/or computing device 530 running computer application 531 may prompt the user for authentication. For example, mobile device 540 running mobile application 541 and/or computing device 530 running computer application 531 may generate a display on mobile device 540 or computing device 530, respectively, which may accompanied by an alert.

[0216] At step 577, the user may be authenticated. Preferably, mobile application 541 may be used to authenticate the user. For example, a user using mobile device 540 may authenticate a user using mobile application 541 using the process set forth in steps 361 to 368 of FIG. 3B and described above. Alternatively, computer application 531 may be used to authenticate the user using computer application 531 as described above. Server 550 may also be used to authenticate the user using the process described above with respect to FIG. 3C in steps 371-376.

[0217] At decision 579, mobile application 541 may determine whether the authentication was successful. Mobile application 541 may make this decision by determining whether the obtained data is the same or substantially similar to the authentication data obtained during the registration process, and thus if the user has been authenticated, as explained above with respect to FIG. 3B. Alternatively, where computing device 530 performs authentication, computer application 541 may instead determine if authentication was successful at decision 579.

[0218] At step 581, if it is determined at step 579 that authentication was not successful, the device performing the authentication, either mobile device 540 running mobile application 541 or computing device 530 running computer application 531, may inform document execution application 556 that authentication was not successful. In response, document execution application 556 may refuse the user access to the document. Instead, if at decision 579 it is determined that authentication was successful, at step 582 the device performing the authentication (e.g., mobile device 540 running mobile application 541 or computing device 530 running computer application 531) may inform document execution application 556 that authentication was successful.

[0219] In addition to informing document execution application 556 that authentication was successful, at step 583 mobile application 541 or computer application 531 may transmit authentication data (e.g., biometric data) or information corresponding thereto to document execution application 556. Mobile application 541 and/or computer application 531 may encrypt this information before sending it. At step 584, document execution application 556 may save the authentication data at server 550 and/or database 555. Mobile application 541 and/or computer application 531 may also save this information on mobile device 540 and computing device 530, respectively. Document execution application 556 may associate the document with the saved authentication data (e.g., for auditing purposes). Alternatively, or in addition to, mobile application 541 and/or computer application 531 may associate this information with the document.

[0220] Upon being informed that authentication was successful at step 582, document execution application 556 may permit the user access to the document at step 585. This may involve informing document execution application 532 and/or document execution application 542 that the user may access the document. Using mobile device 540 and/or computing device 530, a user may access and review the document. A user may also execute the document by causing document execution application 556 to generate one or more digital signatures at step 586. For example, a user using mobile device 540 running document execution application 542 or a user using computing device 530 running document execution application 532 may cause document execution application 556 to generate one or more digital signatures. Document execution application 556 may save the executed document and/or digital signature(s) to database 555.

[0221] Referring now to FIG. 10, a flowchart is illustrated detailing the data flow and decisions made in implementing authentication system 100 to set and/or change a default authentication device. While the process set forth in FIG. 10 describes a process for switching the default authentication device from mobile device 106 to computing device 110, it is understood that these same steps may be used by any type of electronic device (e.g., laptop, personal computer, mobile phone, tablet or the like) to designate another device (e.g., laptop, personal computer, mobile phone, tablet or the like) as the default authentication device. Additionally, these same steps may be used to once again designate mobile device 106 as the default authentication device.

[0222] To initiate the process set forth in FIG. 10, mobile application 318 may be installed on mobile device 106 and, at step 600, registration information may be sent from mobile device 106 to server 114. Registration information may include data and other information generated on mobile device 106 and/or sent from mobile device 106 to server 102 to create a user profile as described above. For example, registration information may include user identification data and/or user authentication data (e.g., biometric data).

[0223] At step 601, server 102 may receive the registration information, set up a user profile using the registration information, and/or may register the mobile device. Registering the mobile device may involve associating the mobile device to the user profile and/or to a user account. At optional step 602, upon registering mobile device 106, server 102 may set mobile device 106 as the default authentication device. Authentication system 100 may be designed such that only the default authentication device may be used to authenticate a user. For example, only the default authentication device may be used to send authentication data to server 102 for authentication. Accordingly, the device previously designated as the default authentication device (e.g., mobile device 106) may no longer be used to send authentication data to server 102 for authentication.

[0224] At step 603, computer application 220 may be installed on computing device 110. At step 604, a request may be sent to server 102 to change the default authentication device to computing device 110. This request may be sent from computing device 110 running computer application 220. At step 605, the server may receive the request to change the default authentication device to computing device 110.

[0225] At step 606, computing device 110 running computer application 220 may receive a mobile device identifier. For example, a user may input the mobile device identifier into computing device 110. A mobile device identifier may be a mobile phone number associated with mobile device 106 and/or any other identifier of mobile device 106. For example, a mobile device identifier may be a number, letter or alphanumeric identifier. Alternatively, the mobile device identifier may be a MAC address, MIN, MSIN, ESN, MEID, IMEI, and/or IMSI, or any other identifier unique to mobile device 106. At step 607, computing device 110 running computer application 220 may send the mobile device identifier to server 102.

[0226] At step 608, server 102 may receive the mobile device identifier. Upon receiving the mobile device identifier, at step 609, server 102 may send a passcode message to a mobile device associated with the mobile device identifier. The passcode message may be a Short Message Service (SMS) text message or any other message sent to mobile device 106, such as an email. The passcode message may include passcode data which may include a passcode or unique value. For example, the passcode data may include a one-time passcode (OTP). At step 610, the passcode message may be received on mobile device 106.

[0227] At step 611, the passcode data may be received on computing device 110. For example, a user may receive the passcode message on mobile device 106, view the passcode data on mobile device 106, and manually enter the passcode data onto computing device 110. Alternatively, mobile device 106 may send the passcode data to mobile device 106 (e.g., via email or push notification) and the computer application 220 may be designed to automatically enter the passcode data and/or a user may then input the passcode data on computing device 110. At step 612, computing device 110 may send the passcode data to server 102. At step 613, the server 102 may receive the passcode data from computing device 110.

[0228] At step 614, upon receiving the passcode data from computing device 110, server 102 may request authentication data from computing device 110. At step 615, computing device 110 running mobile application 220 may send authentication data to server 102. As explained above, authentication data may include biometric data. At step 616, server 102 may receive authentication data from computing device 110. At step 617, server 102 may compare the authentication data received from computing device 110 to authentication data associated with the user profile and/or included in registration information. At step 618, server 102 may determine that the authentication data received from computing device 110 is the same as the authentication data associated with the user profile and/or included in registration information.

[0229] At step 619, upon determining that the authentication data received from computing device 110 corresponds to (e.g., matches) authentication data associated with the user profile and/or included in registration information, server 102 may set computing device 110 as the default authentication device. In this manner, computing device 110 may be the sole device associated with the user profile for authenticating a user. As explained above computing device 110 may be a laptop, personal computer, mobile phone, tablet or the like. As also explained above, computing device 110 may include a camera and/or bio-sensors for generating authentication data.

[0230] Referring now to FIG. 11, a flowchart is illustrated detailing the data flow and decisions executed by a registered device to authenticate a user on the registered device when the user's face is obstructed. For example, the user's face may be obstructed by a mask covering the user's nose and mouth. At step 621, the registered device will determine authentication data corresponding to the user's face. Authentication data may include face scan information.

[0231] At decision 622, the registered device may determine whether the user's face is partially obstructed (e.g., by a medical mask). For example, a portion of a user's face may be obstructed by a medical mask but other features including the eyes, nose bridge, ears, forehead, and hairline may be exposed. The application on the registered device may employ algorithms to determine whether or not the face is obstructed. For example, algorithms may be trained using machine learning. If the user's face is not obstructed, at step 623, the registered device may determine saved authentication data corresponding to the user's non-obstructed face. At step 624, the saved authentication data may be sent to the server for comparison. Alternatively, at step 625, the registered device may compare the newly determined authentication data to the saved authentication data corresponding to the user's non-obstructed face. Alternatively, if the user's face is obstructed, at step 626, the registered device will determine saved authentication data corresponding to the user's obstructed face. For example, during registration, the application may have determined authentication information corresponding to a facial scan of the user wearing a mask. At step 627, the saved authentication data may be sent to the server for comparison. Alternatively, at step 628, the registered device may compare the newly determined authentication data to the saved authentication data corresponding to the user's obstructed face. For example, after the registered device determines the saved authentication data either corresponds to the user's non-obstructed face or the user's obstructed face, registered device may send the newly determined authentication data and the saved authentication data to the server for comparison.

[0232] After the registered device determines which saved authentication data to utilize for authentication and compares the newly determined authentication data, at decision 629, the registered device may determine whether the newly determined authentication data is the same or substantially similar to the saved authentication data.

[0233] If the registered device or server determines that the newly determined authentication data does not match the authentication data determined at registration, at step 630, the registered device may optionally generate a message on the display of the registered device that the authentication failed. The registered device and/or server may repeat steps 621-629 a preset number of times or may even prompt the user to generate different biometric data (e.g., iris pattern scan) if the first attempt to authenticate failed. Further, at step 631, the registered device will inform the application and/or server 102 that authentication failed.

[0234] If the registered device determines that the newly determined authentication data does match the saved authentication data, at step 632, the registered device may optionally generate a message on the display of the registered device that the authentication was successful. Further, at step 633, the registered device may inform the application and/or server 102 that authentication was successful. Optionally, at step 634, the registered device or server 102 may send credentials to the application. Alternatively, the application may retrieve the credentials locally from the computing device.

[0235] Referring now to FIGS. 12A-12B, a flowchart is illustrated detailing the data flow and decisions made in implementing an authentication system to authenticate a user via server in communication with a computing device. The server may be any server described herein (e.g., server 102). The computing device may be any computing device, mobile device, interface device, secondary device, or any other electronic device described herein (e.g., computing device 110, mobile device 106, interface device 405, etc.). It is understood that the computing device and server may communicate directly or indirectly (e.g., via another device).

[0236] Referring now to FIG. 12A, the process for server authentication may be initiated at step 700 at which a server running a server application may connect, directly or indirectly (e.g., via another device), with a computing device (e.g., via a well-known wireless connection). The server running a server application may initiate the connection or the computing device or another device may initiate the connection. At optional block 702, a request for authentication may be received. For example the a user may attempt to gain digital (e.g., data, files, information) or physical access (e.g., locker, gate, door) and the computing device or another device in communication with the computing device may send the server the request for authentication. It is understood that the request for authentication may come from the computing device or another device.

[0237] At block 704, in response a request for authentication, a request for first authentication may be sent to the computing device. At block 706, first authentication data may be determined (e.g., received) from the computing device in response to the request for first authentication. It is understood that the request for authentication (e.g., the first, second, third, or fourth request for authentication) and/or for authentication data (e.g., the first, second, third, or fourth authentication data) may correspond to one of identification data (password, username, email, etc.), device information (e.g., unique device identifier), location or time data (e.g., coordinates corresponding to the user's location, information about the time of day), biometric data, user authentication data, and or any other data associated with or corresponding to a user or the user's device. In one example, an individual may only gain access to digital data or a physical location at a certain time of day, and the authentication data may indicate the current time of day and may be authenticated if that time of day matches an acceptable range (e.g., between 9:00 am and 5:00 pm).

[0238] At decision 708 the system (e.g., server application) may determine whether the first authentication data is authenticated by comparing it against saved authentication data on the server. At block 710, if the first authentication data is not authenticated, the server may inform the computing device that authentication failed. Alternatively, if the first authentication data is authenticated, at block 712, the server may send a request for second authentication to the computing device. At block 714, the server may determine (e.g., receive) second authentication data from the computing device.

[0239] At decision 716 the system (e.g., server application) may determine whether the second authentication data is authenticated by comparing it against saved authentication data on the server. At block 718, if the second authentication data is not authenticated, the server may inform the computing device that authentication failed. Alternatively, if the second authentication data is authenticated, at optional block 720, the server may send a request for third authentication to the computing device. At optional block 722, the server may determine (e.g., receive) third authentication data from the computing device.

[0240] At optional decision 724 the system (e.g., server application) may determine whether the third authentication data is authenticated by comparing it against saved authentication data on the server. At optional block 726, if the second authentication data is not authenticated, the server may inform the computing device that authentication failed. Alternatively, if the third authentication data is authenticated, at optional block 728, the server may send a request for fourth authentication to the computing device. At optional block 730, the server may determine (e.g., receive) fourth authentication data from the computing device.

[0241] At optional decision 732 the system (e.g., server application) may determine whether the fourth authentication data is authenticated by comparing it against saved authentication data on the server. At optional block 734, if the fourth authentication data is not authenticated, the server may inform the computing device that authentication failed. Alternatively, if the authentication data received from the computing device is authenticated, at block 736, the server may grant the computing device digital and/or physical access to the computing device. For example, the server may send the computing device an authorization message.

[0242] Referring now to FIG. 12B, the process for server authentication using the computing device may be initiated at step 740 at which a computing device running an application may connect with a server (e.g., via a well-known wireless connection). The server (e.g., running the server application) may initiate the connection or the computing device may initiate the connection. It is understood that the computing device and server may communicate directly or indirectly (e.g., via another device). At block 742, a computing device may determine a request for first authentication data for a server. For example, the computing device may attempt to gain digital (e.g., data, files, information) or physical access (e.g., locker, gate, door) and the computing device may send the server the request for authentication to prompt the server to request first authentication data.

[0243] At block 744, the computing device may determine (e.g., obtain, generate, receive, etc.) first authentication data. At block 746 the computing device may send the first authentication data to the server. It is understood that the request for authentication data (e.g., the first, second, third, or fourth request for authentication) and/or the authentication data (e.g., the first, second, third, or fourth authentication data) may correspond to one of identification data, device information, location or time data, biometric data, user authentication data, and or any other data associated with or corresponding to a user or the user's device.

[0244] At block 748, the computing device may determine a request for second authentication from the server. Based on this request, at block 750, the computing device may determine second authentication data. At block 752, the computing device may send the second authentication data to the server for authentication. At optional block 754, the computing device may determine a request for third authentication from the server. Based on this request, at optional block 756, the computing device may determine third authentication data. At optional block 758, the computing device may send the third authentication data to the server for authentication. At optional block 760, the computing device may determine a request for fourth authentication from the server. Based on this request, at optional block 762, the computing device may determine fourth authentication data. At optional block 764, the computing device may send the fourth authentication data to the server for authentication. At block 766, the computing device may receive authorization to access digital information and/or data or to access a physical location or item. It is understood that the first, second, third, and/or fourth authentication data may be the same or different. If it is further understood that server may not request third authentication and/or fourth authentication data. Alternatively, the authentication system may involve more than four steps in the authentication approach (e.g., five-step authentication, seven-step authentication, etc.).

[0245] Referring now to FIGS. 13A-13B, a flowchart is illustrated detailing the data flow and decisions made in implementing an authentication system to authenticate a user via computing device in communication with a server. The server may be any server described herein (e.g., server 102). The computing device may be any computing device, mobile device, interface device, secondary device, or any other electronic device described herein (e.g., computing device 110, mobile device 106, interface device 405, etc.). It is understood that the computing device and server may communicate directly or indirectly (e.g., via another device).

[0246] Referring now to FIG. 13A, the process for computing device authentication may be initiated at step 802 at which a server running a server application may connect with a computing device (e.g., via a well-known wireless connection). The server running a server application may initiate the connection or the computing device may initiate the connection. At optional block 804, a request for authentication may be received. For example the a user may attempt to gain digital (e.g., data, files, information) or physical access (e.g., locker, gate, door) and the computing device or another device in communication with the computing device may send the server the request for authentication. It is understood that the request for authentication may come from the computing device or another device.

[0247] At block 806, in response a request for first authentication, a request for first authentication may be sent to the computing device. At block 807, an authentication result corresponding to first authentication data may be determined (e.g., received) from the computing device in response to the request for first authentication. In response to the request for first authentication, the computing device may determine authentication data and may compare to authentication data stored on the computing device to determine if the first authentication is authenticated.

[0248] It is understood that the request for authentication (e.g., the first, second, third, or fourth request for authentication) and/or the authentication data corresponding to the authentication (e.g., the first, second, third, or fourth authentication data) may correspond to one of identification data (password, username, email, etc.), device information (e.g., unique device identifier), location or time data (e.g., coordinates corresponding to the user's location, information about the time of day), biometric data, user authentication data, and or any other data associated with or corresponding to a user or the user's device.

[0249] At decision 808, the server may determine if the user has been authenticated based on the first authentication result. The first authentication result may indicate whether the first authentication data determined on the computing device was successfully authenticated. If the first authentication was not successfully authenticated (e.g., the user was not authenticated) then at block 810, the server may inform the computing device that authentication failed. Alternatively, at block 812, if the first authentication was successful, then at block 812, a request for second authentication may be sent to the computing device. At block 813, an authentication result corresponding to second authentication data may be determined (e.g., received) from the computing device in response to the request for second authentication.

[0250] At decision 814, the server may determine if the user has been authenticated based on the second authentication result. The second authentication result may indicate whether the second authentication data determined on the computing device was successfully authenticated. If the second authentication was not successfully authenticated (e.g., the user was not authenticated) then at block 816, the server may inform the computing device that authentication failed. Alternatively, at block 818, if the second authentication was successful, then at optional block 818, a request for third authentication may be sent to the computing device. At optional block 819, an authentication result corresponding to third authentication data may be determined (e.g., received) from the computing device in response to the request for third authentication.

[0251] At optional decision 820, the server may determine if the user has been authenticated based on the third authentication result. The third authentication result may indicate whether third authentication data determined on the computing device was successfully authenticated. If the third authentication was not successfully authenticated (e.g., the user was not authenticated) then at optional block 822, the server may inform the computing device that authentication failed. Alternatively, at optional block 824, if the third authentication was successful, then at optional block 825, a request for fourth authentication may be sent to the computing device. At block 825, an authentication result corresponding to fourth authentication data may be determined (e.g., received) from the computing device in response to the request for fourth authentication.

[0252] At optional decision 826, the server may determine if the user has been authenticated based on the fourth authentication result. The fourth authentication result may indicate whether fourth authentication data determined on the computing device was successfully authenticated. If the fourth authentication was not successfully authenticated (e.g., the user was not authenticated) then at optional block 828, the server may inform the computing device that authentication failed. Alternatively, at block 830, if the authentication was successful, then the computing device may grant digital and/or physical access to the computing device. For example, the server may send the computing device an authorization message.

[0253] Referring now to FIG. 13B, the process for computing device authentication using the computing device may be initiated at step 840 at which a computing device running an application may connect with a server (e.g., via a well-known wireless connection). The server (e.g., running the server application) may initiate the connection or the computing device may initiate the connection. At optional block 842, a computing device may send an authentication request to the server. Alternatively, the request for authentication may come from another device. At block 844, the computing device may determine (e.g., obtain, generate, receive, etc.) a request for first authentication. At block 846, the computing device may determine first authentication data.

[0254] It is understood that the request for authentication (e.g., the first, second, third, or fourth request for authentication) and/or the authentication data corresponding to the authentication (e.g., the first, second, third, or fourth authentication data) may correspond to one of identification data (password, username, email, etc.), device information (e.g., unique device identifier), location or time data (e.g., coordinates corresponding to the user's location, information about the time of day), biometric data, user authentication data, and or any other data associated with or corresponding to a user or the user's device.

[0255] At decision 848, the computing device may determine if the user has been authenticated by comparing the first authentication data to authentication data saved on the computing device. If the first authentication was not successfully authenticated (e.g., the user was not authenticated) then at block 850, the computing device may inform the server that authentication failed. Alternatively, at optional block 852, if the first authentication was successful, then the computing device may inform the server that the first authentication was successful. At block 854, the computing device may determine a request for second authentication. At block 856, the computing device may determine second authentication data based on the request for second authentication.

[0256] At decision 858, the computing device may determine if the user has been authenticated by comparing the second authentication data to authentication data saved on the computing device. If the second authentication was not successfully authenticated (e.g., the user was not authenticated) then at block 860, the computing device may inform the server that authentication failed. Alternatively, at optional block 862, if the second authentication was successful, then the computing device may inform the server that the second authentication was successful. At optional block 864, the computing device may determine a request for third authentication. At optional block 866, the computing device may determine third authentication data based on the request for third authentication.

[0257] At optional decision 868, the computing device may determine if the user has been authenticated by comparing the third authentication data to authentication data saved on the computing device. If the third authentication was not successfully authenticated (e.g., the user was not authenticated) then at optional block 870, the computing device may inform the server that authentication failed. Alternatively, at optional block 872, if the third authentication was successful, then the computing device may inform the server that the third authentication was successful. At optional block 874, the computing device may determine a request for fourth authentication. At optional block 876, the computing device may determine fourth authentication data based on the request for fourth authentication.

[0258] At optional decision 878, the computing device may determine if the user has been authenticated by comparing the fourth authentication data to authentication data saved on the computing device. If the fourth authentication was not successfully authenticated (e.g., the user was not authenticated) then at optional block 880, the computing device may inform the server that authentication failed. Alternatively, at optional block 882, if the fourth authentication was successful, then the computing device may inform the server that the fourth authentication was successful. At block 884, the computing device may determine authorization for physical and/or digital access from the server (e.g., an authorization message). It is understood that the first, second, third, and/or fourth authentication data may be the same or different. If it is further understood that server may not request third authentication and/or fourth authentication data. Alternatively, the authentication system may involve more than four steps in the authentication approach (e.g., five-step authentication, seven-step authentication, etc.).

[0259] Referring now to FIGS. 14A-14B, exemplary encryption system 900 and alternative encryption system 920 are illustrated. Encryption system 900 is designed to establish symmetric encryption between remote device 902 and computing device 906 using session private key 908. Preferably, symmetric encryption is established by first using asymmetric encryption. Asymmetric encryption uses both a public key, which may be known to others, and a corresponding to private key, which should be known only to the owner. Messages are encrypted using the public key and then decrypted only using a private key which corresponds to the public key. Symmetric encryption uses only one key to both encrypt and decrypt a message. Generally, asymmetric encryption provides increased security, but can result in slower communication. Encryption system 900 may be used to establish symmetric encryption between two devices by authenticating a user using biometric authentication and then generating a session private key which may be used to both encrypt and decrypt messages between the two devices, thereby enabling faster communication while also increasing security.

[0260] Referring now to FIG. 14A, encryption system 900 involves remote device 902, encrypted messages 904, computing device 906, session private key 908, and mobile device 910. Remote device 902, computing device 906, and mobile device 910 may be substantially the same as computing device 110 described above and may be any device having processing power, storage, network connectivity, an input device, a display. For example, the computing devices may be a mobile phone, personal computer, laptop, tablet or any other computing device having the foregoing features. Mobile device 910 also has at least one biometric sensor, such as a camera, a finger print scanner, a retina scanner, a microphone, an infrared camera, thermal imaging camera, or any other sensor or input device suitable for biometric measurements or otherwise determining biometric data.

[0261] Mobile device 910 is configured to run a mobile application, which may substantially the same as mobile application 318 described above. Preferably, the mobile application may be used to generate a user interface on mobile device 910 and may be programmed to perform tasks executed on mobile device 910. Computing device 906 may be configured to run a software application that may be web-based (e.g., hosted on a server) or alternatively locally run. Mobile device 910 running the mobile application may communicate via any well-known wired or wireless connection with computing device 906 running the software application to perform the operations described herein with respect to FIGS. 14A-C. Mobile device 910 running the mobile application may connect to the Internet using any well-known methods and may communicate with computing device 906 over the Internet. Similarly, computing device 906 may communicate with remote device 902 over the Internet or via any well-known wired or wireless connection.

[0262] Referring now to FIG. 14B, encryption system 920 may be used to establish symmetric encryption between a remote device and a computing device using a session private key. Encryption system 920 includes remote device 922, encrypted messages 924, computing device 926, session private key 928, mobile device 930, and server 932. Remote device 922, computing device 926, and mobile device 930 may be the same as or similar to remote device 902, computing device 906, and mobile device 910 described above. Server 932 may be any type of computing device as described above but preferably is one or more servers. Server 932 includes at least a processor and network connectivity and may additionally have the same components as the computing devices.

[0263] Mobile device 930 may perform biometric authentication similar to the process described above with respect to mobile device 910, but may communicate with computing device 926 and/or server 932 over the Internet. It is understood that mobile device 930 may communicate with server 932 using different communication technologies or the same communication technologies. For example, mobile device 930 may communicate with server 932 via a wired connection while mobile device 930 may communicate with mobile device 926 via a wireless connection. It is further understood that in some cases computing device 930 may communicate directly with server 932 (e.g., over the Internet or cellular connection).

[0264] Referring now to FIG. 14C, a flow chart is illustrated detailing a process for establishing symmetric encryption between a computing device and a remote device.

[0265] Some or all of the steps in the flowchart may be optional and may be performed in a different order. To initiate the process, at step 940, the computing device determines a user profile associated with a user, computing device and/or remote device. At step 941, a connection with a mobile device may be established. At step 942, the computing device may receive a public key from the remote device. As described above, a public key may be used to encrypt messages and may be known by others while a private key may be used to decrypt messages and should be known only to one user. The public key may correspond to a private key known to the remote device.

[0266] At step 944, the computing device may send a request for authentication to a mobile device corresponding to the user profile. The request for authentication may request biometric information, which may include retina scan information, iris pattern information, finger print scan information, finger vein scan information, face scan information, voice pattern information and/or any other biometric information. Optionally, the computing device may send a request for comparison on a server to the mobile device. The request for comparison may include a request to compare, on the server, the biometric information obtained by the mobile device to second biometric information that corresponds to the user profile and is saved to the server. The server may send the computing device confirmation that authentication was successful, or alternatively a message that confirmation was not successful.

[0267] If the biometric information matches the second biometric information, at step 946, the computing device may receive confirmation that authentication using biometric information was successful from the mobile device. Optionally, in addition to authenticating via biometric information, at step 948, the computing device further may send a second request for authentication via a passphrase to the mobile device. For example, the passphrase may be a sequence of words, texts, numbers and/or an alphanumeric value. The passphrase could then be entered into the mobile device and the computing device may confirm that authentication using the passphrase was successful. At step 949, the computing device may receive confirmation that authentication using passphrase was successful from the mobile device.

[0268] At step 950, the computing device may generate a session private key based on successful authentication of the user. Alternatively, the computing device may not generate a session private key until the computing device receives both confirmation that authentication using biometric information was successful and confirmation that authentication using the passphrase was successful.

[0269] At step 952, the computing device may encrypt the session private key so that it may securely be sent to the remote device. The session private key is encrypted using the public key that was previously sent from the remote device to the computing device. At step 954, the computing device may send the encrypted session private key to the remote device. The remote device may then able to decrypt the session private key using the private key that corresponds to the public key that was used to encrypt the session private key. At this point, both the computing device and the remote device may encrypt messages to one another using the session private key.

[0270] At step 956, the computing device may receive, from the remote device, a message encrypted using the session private key. At step 958, the computing device may decrypt the message using the session private key. As discussed above, using symmetric encryption may enable faster communication between two devices than using only asymmetric encryption.

[0271] Referring now to FIG. 15A, an exemplary system is illustrated. Authentication system 1000 may be used to identify and authenticate a customer within an area, such as a store, restaurant or similar facility. Identification and authentication of a customer within an area may provide several benefits to the business. For example, once authentication of an individual such as a customer determined, the business may request consent from the individual to use the visual data for identification purposes or to send the individual commercial messages. In addition, consent may be provided such that the business may obtain customer data such as the purchases made by the customer or the time the customer spent at the business. Access to customer data in addition to consent from the customer may allow the business to personalize the commercial messages that are sent to the customer, thereby resulting in messages that are more likely to result in customer action. In addition, the customer data may be aggregated such that the business can determine buying trends and other similar information.

[0272] Authentication system 1000 may involve camera 1002, customer device 1004, and computing device 1006. Camera 1002 may be any type of well-known camera and may be configured to capture visual data. Camera 1002 is positioned within the area such that camera 1002 may capture the visual data of persons located within the area. Customer device 1004 may belong to the customer and may be the same as or similar to computing device 910 described above, which preferably has at least one biometric sensor. Computing device 1006 may be similar to computing device 932 described above.

[0273] Camera 1002 may communicate with computing device 1006 via the internet, and/or any other well-known wired or wireless connection described above with respect to FIG. 1. For example, camera 1002 may obtain visual data and send the visual data to computing device 1006. Customer device 1004 may also communicate with computing device 1006 via any well-known wired or wireless connection. For example, computing device 1006 may send customer device 1004 a request for authentication or a request for consent.

[0274] Referring now to FIG. 15B, a flow chart is illustrated detailing a process for identifying and authenticating a customer in an area such as a store, restaurant or similar facility. Some or all of the steps in the flowchart may be optional and may be performed in a different order. To initiate the process, at step 1010, a computing device may determine visual data indicative of a customer in an area. This visual data may be received from a camera located in the area, which may be configured to capture visual data (e.g., visual images and/or video) of customers within the area and to send the visual data to the computing device. Additionally, or alternatively, audio data may be captured and analyzed.

[0275] At step 1012, the computing device may determine biometric property based on the visual data and corresponding to the customer. The biometric property may include retina scan information, iris pattern information, face scan information, and voice pattern information, or any other biometric information. At step 1014, the computing device may identify the customer based on the biometric property and, at step 1016, the computing device determines a device associated with the customer. The computing device may identify the customer based on a customer identification algorithm which is trained to match the obtained biometric properties to saved biometric properties corresponding to multiple customers on a database. The database may be stored on or otherwise incorporated into or part of the computing device or may be stored elsewhere and accessed by the computing device. The database may associate customer profiles with each customer biometric data. The customer profile may include one or more devices and/or contact information corresponding to each customer.

[0276] At step 1018, the computing device may send a message requesting biometric authentication to the device associated with the identified customer. The customer may then respond to the request by generating biometric information using the customer's device and performing authentication on the customer's device. The authentication may take place on the customer's device as described above with respect to FIG. 3B, or may involve sending the obtained biometric data to a remote device to perform authentication. At step 1019, the computing device may receive a message from the customer's device regarding the status of the requested authentication (e.g., whether the authentication was successful or not).

[0277] At decision 1020, the computing device may determine whether the customer has been authenticated. Optionally, if authentication was not successful, at step 1022, the computing device may train the customer identification algorithm such that the algorithm can better identify customers. If authentication was successful, at step 1024, the computing device may optionally send a request for consent to use the visual and/or audio data (e.g., for identification purposes) to the device. At step 1025, the computing device may receive a message from the customer device regarding consent.

[0278] At optional decision 1026, the computing device may determine whether the customer gave consent. If the customer did not give consent (e.g., to use the visual data for identification purposes), at optional step 1028, the computing device may take no further action and may even delete the visual data. If the customer gave consent, at optional step 1030, the computing device may confirm that the customer was accurately identified and may even determine customer data corresponding to a customer action in the area, depending on the type and/or scope of the consent. The customer action may include a location of the area, a purchase made by the customer, the time the customer spent in the area, the time of the day that the customer was in the area, and/or any other customer related information. Alternatively, consent to use visual data may be obtained when the customer creates a user profile or at some other time (e.g., when the consumer enters the area).

[0279] At step 1032, the computing device may send to the device a request for consent to send the customer commercial messages. The commercial messages may include a promotion, a coupon, or product information. At step 1033, the computing device may receive a message from the customer device regarding consent requested at step 1032. At decision 1034, the computing device may determine if the customer gave consent. If the customer did not give consent, at step 1036, the computing device may not send the customer commercial messages. If the customer gave consent, at step 1038, the computing device may send the customer commercial message.

[0280] Referring now to FIGS. 16A-16B, flowcharts are illustrated detailing the data flow and decisions made in implementing an authentication system to authenticate a user via computing device in communication with a server. The server may be any server described herein (e.g., server 102). The computing device may be any computing device, mobile device, interface device, secondary device, or any other electronic device described herein (e.g., computing device 110, mobile device 106, interface device 405, etc.). It is understood that the computing device and server may communicate directly or indirectly (e.g., via another device).

[0281] Referring now to FIG. 16A, a process for computing device authentication may be initiated at step 1050 at which a computing device running a mobile application may connect with a server (e.g., via a well-known wireless connection). The server running a server application may initiate the connection or the computing device may initiate the connection. At block 1052, a request for authentication may be received. For example a user may attempt to gain digital (e.g., data, files, information) or physical access (e.g., locker, gate, door) and the server may send the computing device a request for authentication corresponding to the request or attempt to gain digital or physical access. It is understood that the request for authentication may come from the computing device or another device.

[0282] At optional block 1054, the computing device running the mobile application may determine an authentication type associated with the request for authentication. For example, the authentication type may be FIDO2 (Fast Identity Online) authentication, non-FIDO2 authentication, and/or any other well-known authentication types or standards. Alternatively, the server may determine the authentication type and/or may inform the computing device running the mobile application of the authentication type (e.g., based on an exchanged token). For example, the exchanged tokens and/or parameters embedded therein may inform the computing device of the authentication type. It is understood that where the authentication type requires multi-factor authentication, steps 1056-1070 may be repeated for different authentication types and/or different authentication data.

[0283] At block 1056, the computing device running the mobile application may determine first authentication data (e.g., based on the authentication type and/or request for authentication). For example, the computing device running the mobile application may determine any type of authentication data described herein. At decision 1058, the computing device running the mobile application may determine if the authentication data is sufficient. For example, the computing device running the mobile application may determine of the authentication data is of sufficient quality to authenticate. In one example, the computing device running the mobile application may analyze the authentication data and assign a quality value to the authentication data (e.g., a quality value for an image and/or scan), which may be compared against a threshold value to determine if the authentication data is sufficient. It is understood that a separate application and/or module running on the computing device may analyze the authentication data to make this determination.

[0284] At block 1060, if it is determined by the computing device that the authentication data is not sufficient (e.g., is assigned a quality value that does not satisfy a given threshold value), then the computing device running the mobile application may inform the server that authentication has failed. At block 1062, the computing device may receive a request for new authentication data from the server. The new authentication data may be a different type of authentication data. For example, if the authentication data at block 1056 was a face scan and/or image, the new authentication data may be a fingerprint scan. At block 1064, the computing device running the mobile application may determine the new authentication data (e.g., may generate the new authentication data). After block 1064, decision 1058 may be reinitiated.

[0285] If the authentication data determined at block 1056 is alternatively determined to be sufficient at decision 1058, then at decision 1066 the computing device will determine if the user is authenticated based on the authentication data and/or new authentication data. If the user is not authenticated, then at block 1068 the computing device may inform the server that authentication failed. Alternatively, if at decision 1066 the computing device running the mobile application determines that the authentication data and/or new authentication data is authenticated, then at block 1070 the computing device may inform the server that authentication was successful.

[0286] Referring now to FIG. 16B, the process for authentication on a server may be initiated at step 1071 at which a server running a server application may connect with a computing device (e.g., via a well-known wireless connection). The server running a server application may initiate the connection or the computing device may initiate the connection. At optional block 1072, a request for access may be received. For example the server may receive a request for digital (e.g., data, files, information) or physical access (e.g., locker, gate, door). It is understood that the request for access may come from the computing device or another device.

[0287] At optional block 1074, the server running the server application may determine authentication is required for access and may determine an authentication type associated with the request for acess. For example, the authentication type may be FIDO2 (Fast Identity Online) authentication, non-FIDO2 authentication, and/or any other well-known authentication types or standards for authentication. In one example, exchanged tokens and/or parameters embedded therein may inform the server of the authentication type. It is understood that where the authentication type requires multi-factor authentication, steps 1078-1090 may be repeated for different authentication forms and/or different authentication data.

[0288] At block 1076, in response to a request for access, a request for authentication data may be sent to the computing device. Information about the type of authentication may optionally be sent to the computing device. At block 1078, the server running the server application may receive authentication data from the computing device. At decision 1080, the server running the server application may determine if the authentication data is sufficient. For example, the computing device running the mobile application may determine if the authentication data is of sufficient quality to authenticate. In one example, the server running the server application may analyze the authentication data and assign a quality value to the authentication data (e.g., a quality value for an image and/or scan), which may be compared against a threshold value to determine if the authentication data is sufficient. It is understood that a separate application and/or module running on the server may analyze the authentication data to make this determination.

[0289] If at decision 1080 the server determines that the authentication is not sufficient (e.g., the quality value does not satisfy the threshold value), then at block 1082 the server may request new authentication data from the computing device. It is understood that the new authentication data may be the different than the authentication data requested at block 1076. At block 1084, the server may receive the new authentication data. After block 1084, decision 1080 may be reinitiated.

[0290] If the authentication data received at block 1078 is alternatively determined to be sufficient at decision 1080, then at decision 1086 the server running the server application will determine if the user is authenticated based on the authentication data and/or new authentication data. If the user is not authenticated, then at block 1088 the computing device may inform the computing that authentication failed. Alternatively, if at decision 1086 the server running the server application determines that the authentication data and/or new authentication data is authenticated, then at block 1090 the computing device may inform the server that authentication was successful.

[0291] It should be understood that any of the computer operations described herein above may be implemented at least in part as computer-readable instructions stored on a computer-readable memory. It will of course be understood that the embodiments described herein are illustrative, and components may be arranged, substituted, combined, and designed in a wide variety of different configurations, all of which are contemplated and fall within the scope of this disclosure.

[0292] The foregoing description of illustrative embodiments has been presented for purposes of illustration and of description. It is not intended to be exhaustive or limiting with respect to the precise form disclosed, and modifications and variations are possible in light of the above teachings or may be acquired from practice of the disclosed embodiments. It is intended that the scope of the invention be defined by the claims appended hereto and their equivalents.