Secure and custom configurable key, pen or voice based input/output scheme for mobile devices using a local or central server

[0001] The present application is a continuation-in-part of application entitled INTELLIGENT KEYBOARD SYSTEM, Ser. No. 09/281,739, filed Jun. 4, 1999 now U.S. Pat. No. 6,169,789, which is a continuation-in-part application of now abandoned application entitled A SYSTEM LEVEL SCHEME TO CONTROL INTELLIGENT APPLIANCES, Ser. No. 08/764,903 filed Dec. 16, 1996 now abandoned.

[0002] Currently the key pad buttons on a cellular telephone/mobile device (CT/MD) pose a limitation in inputting broad based queries. There are only 12 non-control buttons on many CT/MDs. Even where there are more, there are so few that inputting even as little as the letter-number ASCII set is not really practical. For example, in the present art there have been attempts to expand the number of keys, such as treating the numeric keys as numbers unless a code is entered, such as “*#” or the like, then treating a “2” as an “a”, “2—2” as a “b”, and “2—2—2” as a “c”. Entering “2” three times to form a “c” is both confusing and slow, and such approaches have not been popular. If a mixed string of letters and numbers are desired, there three “2”s may have to be delimited with, for example, “*#”, and the process becomes increasingly more unwieldy. There has been some success in using a computer, especially a computer operating with “fuzzy” logic, to extract the probable combination of letters in a numeric string, exemplified by an interactive directory for finding the telephone extension number of an employee by “spelling” the employee's name on a numeric key pad. This is a satisfactory solution only in limited cases. Numeric reduction of this type has not been generally used except for telephone directories and similar purposes.

[0003] It is an object of the present invention to provide a scheme by which the limitations of a key pad are overcome and the key pad is enhanced. The scheme uses a local or network server.

[0004] The protocols for configuring each key to a specific function or variable set of functions are stored in a Server C. The protocols for all keys may be stored on Server C similarly. The menu for any macro function can be stored on this Server C. Server C may be part of a local loop or located on the internet.

[0005] In an embodiment of the present invention, displays, such as small LCD displays, are mounted on the top of the keys and connected to a matrix addressing system. When a key is reconfigured, such as from an English language “A” to some Japanese character, the legend displayed on the key with the small display is changed accordingly.

[0006] In another embodiment of the present invention, the keyboard is displayed in the display window of a computing device, such as a hand held wireless device. The term wireless device includes entertainment/game machines. The screen of the wireless device is touch sensitive, so the user can type on the screen as if it were a standard keyboard.

[0007] In another embodiment of the present invention, the keyboard is displayed on a separate screen in the position of and replacing the keyboard on a device, such as a hand held wireless device. This screen is touch sensitive, so the user may type on it as if it were a keyboard.

[0008] In another embodiment of the present invention, the keys on any of the above keyboards, as well as on keyboards of the present invention generally, have a sound output, such as a voice output. In this way visually impaired or persons with similar concerns can listen to what keys are being depressed.

[0009] Other objects, features and advantages of the present invention will become apparent from the following detailed description when taken in conjunction with the accompanying drawings.

[0017] The present invention provides means for more easily and intuitively assigning, for example, key values to a wireless device such as to a key associated with the wireless device. The present invention also provides means for compressing or expanding the keys on an entry system such as a wireless device or wireless computing device to more efficiently provide keys needed for entry or other reasons, such as sound, in a desired space.

[0018] The present invention uses a Central Server C providing the software routines and other support for realizing the improved input key means for a wireless device or for a wireless computing device.

[0019] Thus the Server C contains a number of menus for different applications comprising of assigned values for each key function.

[0020] 1. Individual Key−>may take one or more values that are programmable.

[0021] 2. Full set or subset of keys−>may take one or more values that are programmable.

[0022] 3. The individual or subsets or full set of keys −>is programmable to perform assigned functions.

[0023] 4. The above individual or subset or full set of keys in combination may comprise a menu to perform various customizable functions.

[0024] 5. The identity of each programmed value for a key, set of keys or full set of keys is stored in the Server C.

[0025] 6. The menus, sub menus and individual key functions are stored in Server C and may be accessed for use by wired or wireless means. They can be dynamically changed as defined by the user's needs.

[0026] 7. The user may easily go from one set of functions or menus to another set of functions or menus by selecting an option from the CT/MD.

[0027] 8. The menus or functions may coexist on the CT/MD. One function or menu may go to the background and one may be in the foreground. One set may be primary and the others secondary or a hierarchy of functions/menus may be maintained, such as with a windowing of templates, where the user may change templates in the same manner as changing windows on a personal computer (PC).

[0028] 9. Server C manages the delivery of these functions to the CT/MD and also maintains a history.

[0029] 10. This same process is extendible to pen based inputs where certain figures or icons or strokes may be designated to indicate certain functions or menus that we stored on the Server C and delivered as needed by a command from the CT/MD.

[0030] 11. This same process is extendible to voice based input commands and output where each voice command or output means a certain function or a menu that is stored in Server C. The voice recognition function in addition may add more functionality to respond to a given voice. The voices may be in different languages.

[0031] 12. The same process may be extendible to sounds rather than voice; for example, the sound of a bell.

[0032] In addition the CT/MD may contain electronics and process capability to internally store the various programmable key functions or menus such that different functions and menus may be chosen as the need arises.

[0033] In addition, the web server may be shrunk into a microchip that can be part of the internal electronics of the CM/MD, in which case a local or network server may or may not be needed. In this event the features described above for programming and describing each key or input/output could be handled by the internal web server independently or in conjunction with a local or network Server C.

[0034] If a user initiates communication with a particular device, i.e., if a user selects a particular device, the system may understand the context and may change the keypad automatically. Thus the system may perform context-aware keypad changes. This context may be based upon location, the device communicated with, devices present in its local environment, or other factors

[0035] FIG. 1 illustrates a wireless system 100 with a CT/MD 102 having a dynamically reconfigurable keypad 104. Such a keypad 104 provides the ability to define macro keys not included with the standard alphanumeric keypad. In FIG. 1, a CT/MD 102 which seems standard has display devices mounted on each key 106, so that the legend appearing on the key 106 is configurable in software such as from Central Server C 108 without requiring external physical changes.

[0036] FIG. 2 illustrates a wireless device 200 such as a CT/MD having a display 202 and a key pad 204. The key pad 204 has keys such as key 206 which are assignable as desired in software.

[0037] The user may choose to reassign a key on the wireless device to represent a particular function. For example, the user could assign a key to server as a garage door opener. The user may also use this functionality for universal language capability, such as to change an English keypad to serve as a Japanese keypad. The display mounted on the key may be used to change the keypad template, such as by introducing a Japanese character on the key replacing the English letter “A” or a macro such as “open garage door”.

[0038] FIG. 3 shows an embodiment of the present invention in the form of a key 300 such as a key that might be found on a multifunction keyboard. In FIG. 3, the key 300, such as a key from a multi-function keypad, is composed of a liquid crystal display (LCD) which can be modified with electrical inputs only. In this manner, as new templates are used, the key 300 will immediately reflect these changes. Thus, when a key 300 is reassigned a new name and function, the key's new name can become apparent to the user as a legend 302 on the key 300 itself.

[0039] The LCD or similar display need not form a part of the key. A clear button made of, for example, plastic may encase a LCD type display which may or may not be touch sensitive; that is, a touch sensitive LCD. As new templates are loaded, the LCD display is modified to reflect these changes.

[0040] FIG. 4 shows an embodiment of the present invention with a CT/MD 400. FIG. 4 shows the CT/MD 400 having a dynamic key pad 402 such as a touch sensitive LCD panel. The CT/MD 400 optionally includes a liquid crystal display (LCD) 404. If a writing area is present then new templates can be loaded with, for example, selectable icons, and a stylus 406 can be used to choose the various keys.

Server Bases, Remote Handwriting Recognition.

[0041] Handwriting recognition may be processing intensive. Wireless devices may not have the processing capability to perform advanced handwriting recognition techniques within a reasonable time. The wireless devices can offload handwriting recognition functions to a central server. The server may then transmit the recognized characters back to the wireless device, such as a screen 402.

[0042] This could serve also as a signature authentication or finger print authentication mechanism. A scanner could be used to perform finger print authentication. Such authentication could take place remotely on a Central Server C 108.

[0043] FIG. 5 illustrates a wireless system 500 which is an embodiment of the present invention. In FIG. 5, a wireless device 502 transmits an image of the text that has been captured from the writing area 504. This may be a bit map image or it could be in a standard format that both the wireless device 502 and Central Server C 508 understand.

[0044] The wireless device 502 establishes a wireless connection with the Central Server C 508 and transmits the image in a standard format. The Server C 508 then performs the processing on the image and converts it into a format of standard recognized characters which the wireless device 502 understands. The server 508 thus takes an image format of the inputted information and converts it into another format of known characters. After this processing is complete the server C 508 can then transmit the converted format back to the wireless device 502. The server C 508 could also perform language translation on the inputted information. A microphone 506 at the wireless device 502 accepts voice. Voice clips may be transferred to the server 508 and converted to text using voice recognition software at the server 508. Alternatively, language translation may be performed on the voice file for voice based language translation. After the server 508 has performed these processing steps, voice files or text may be sent back to the wireless device 502.

[0045] The system 500 can also be used for user authentication such as with finger print, eye print, or password authentication.

Authentication:

[0046] Additionally, the key pad 400/stylus 406 interface could be redefined so that a finger print could be taken for image authentication. This image would be used, for example, for user authentication. The software for recognizing a finger print could reside on a network server 508 or on the hand held device 502.

[0047] The present invention allows for handwriting recognition and can be used for authentication. The recognition software can be on the network server or on the hand held device. The present invention also allows for the person to speak to a cell phone/hand held device and access remote macros. For example, by stating “open garage”. This command could connect to a network server 508 which would then authenticate the voice. Since voice recognition could be burdensome, this operation could be performed on a networked server 508 or on the hand held device 502. Once the voice has been recognized through voice recognition software, the command will be performed.

[0048] In FIG. 6, an embodiment of an input pad such as a touch sensitive screen 600 of another part of the invention allows for collaborating. The present invention allows screens such as screen 600 to be viewed interactively for interacting from separate devices. For example, if three screens such as screens 602-1, 602-2, 602-3 are used to sign a document from different places, signatures 602 can be on separate screens 600 and optionally displayed on other screens as well. Each screen can be watched separately, with signing being done in parallel or sequentially on the separate screens. This allows the signatures displayed on screens 602 to be placed on a virtual document 604 for interactive verification. Each signature displayed on screens 602 can have a different trust level. The escrow agent is Server C 508.

[0049] The present invention has been described with a number of features and advantages. For example, one embodiment of the present invention provides a keyboard device including a a plurality of configurable keys and a central server where the central server includes means for dynamically configuring a legend on a selected key from the configurable keys, means for detecting an actuation (selection) of the selected key with the legend, and means for associating the actuation of the selected key with the legend on the selected key. The central server could be remote or local to the keyboard device.

[0050] The keys in the keyboard typically could be LCDs for displaying the respective legends, and desirably are touch sensitive.

[0051] The keyboard device could be voice based, sound based or macro based, including key, sound or voice. The keyboard device could be wireless, such as a cellular telephone or mobile device. The keyboard device could be non-wireless.

[0052] The foregoing descriptions of specific embodiments of the present invention have been presented for purposes of illustration and description. They are not intended to be exhaustive or to limit the invention to the precise forms disclosed, and it should be understood that many modifications and variations are possible in light of the above teaching. The embodiments were chosen and described in order to best explain the principles of the present invention and its practical application, to thereby enable others skilled in the art to best utilize the present invention and various embodiments, with various modifications, as are suited to the particular use contemplated. It is intended that the scope of the invention be defined by the Claims appended hereto and their equivalents.