US 7,403,191 B2Grant
Tactile overlay for an imaging display
Issue Date:2008-07-22
•17 Claims
•4 Drawing Sheets
Abstract
A tactile overlay for a touchscreen includes one or more button structures, a flexible resilient membrane, and one or more nibs corresponding to the one or more button structures. The overlay is disposed over and in propinquity with the touchscreen display, with button and corresponding nib structure(s) of the overlay corresponding to virtual buttons that are displayed by the touchscreen display. The button structure(s) and corresponding nibs are positioned on the overlay so that a user can press a button structure, which causes the corresponding nib to touch a desired virtual button being displayed by the touchscreen display. The flexible resilient layer causes the nib to return to original position, breaking contact with the touchscreen display.
Metadata
Assignee
- Microsoft Corporation
Inventor
- Michael J. Sinclair
Application Information
Application Number:US 10/767,291
Filing Date:2004-01-28
Priority Date:2004-01-28
Art Unit:2629
Classifications
IPC:
G06F3/041G06F3/02G09G5/00
Patent Drawings (4 sheets)
Description
Field
[0001] Various embodiments described below relate generally to displays for mobile electronic devices, more particularly but not exclusively to, overlays for touchscreen displays for mobile electronic devices.
Background
[0002] Some mobile or handheld electronic devices (e.g., personal digital assistants or PDAs, tablet personal computer or tablet PC, etc.) typically include hardware buttons and a touchscreen. The touchscreen can be used to display a “virtual” keypad, keyboard or other input mechanism graphics (also referred to herein as “virtual buttons”) that can be activated by the user (e.g., by using a finger to press a button) to perform input functions.
[0003] Due to the small size and power saving designs of typical mobile electronic devices, such devices generally have some undesirable limitations. For example, a typical mobile electronic device's display is relatively small, forcing the displayed virtual buttons to be relatively small, which tends to increase a user's difficulty in using a finger to pressing a virtual button. Thus, many such mobile electronic devices suggest the use of (and may even provide) a stylus so that the user can accurately activate the desired virtual button. Also, the user generally has to look at the display in order to activate the desired virtual button (as opposed to hardware buttons that may be identified tactilely in some applications) because there are no tactile indications of the boundaries between the virtual buttons. In addition, to save power, the display's backlight may be turned off for significant periods of time (e.g., when the mobile electronic device has not been used for a selected time period). When the backlight is turned off, a user may have difficulty seeing the virtual buttons.
Summary
[0004] In accordance with aspects of the various described embodiments, a tactile overlay for a touchscreen display is provided. For example, in one application the touchscreen display is part of a mobile electronic device such as a PDA. In one aspect, the overlay includes one or more button structures, a flexible resilient layer (also referred to herein as a membrane), and one or more nibs corresponding to the one or more button structures. The overlay is disposed over and in propinquity with the touchscreen display, with button and corresponding nib structure(s) of the overlay corresponding to virtual buttons that are displayed by the touchscreen display. The button structure(s) and corresponding nibs are positioned on the overlay so that a user can press a button structure, which causes the corresponding nib to touch a desired virtual button being displayed by the touchscreen display, as if being touched by a stylus. The flexible resilient layer causes the nib to return to original position, breaking contact with the touchscreen display. This aspect can advantageously allow a user to accurately operate the virtual buttons without having to look at the touchscreen display.
[0005] In some embodiments, the button structure(s), membrane and nib(s) of the overlay are made of a translucent material so that a user may see virtual buttons displayed by the underlying touchscreen display initially, and then rely on the sense of touch to operate the virtual buttons afterwards.
[0006] In another aspect, the button structure(s) of the overlay include haptic structures that provide tactile feedback and/or sounds (e.g., a “click” sound) that allow a user to know that the button structure was pressed.
[0007] In another aspect, the overlay includes button structures in the form of a QWERTY keyboard. This overlay can be advantageously used with mobile electronic devices that are configured with a virtual QWERTY keyboard.
[0008] In yet another embodiment, the overlay includes a lighting device that can be used to illuminate the button structures so that a user can see the button structures under low-light conditions.
[0009] In still another embodiment, the overlay includes a redirector that can be positioned over the infrared port of some mobile electronic devices. The redirector is used to change the direction of the infrared beam so that a user can simultaneously view the button structure(s) of the overlay while directing an infrared beam toward a desired target (e.g., an appliance that can be remotely controlled by the mobile electronic device via an infrared beam).
[0010] In another embodiment, the overlay includes a captive slider button with a respective nib such that when the user actuates the slider button by pressing and sliding it, the nib in turn actuates a virtual slider on the touch screen display.
Brief Description of the Drawings
[0011] Non-limiting and non-exhaustive embodiments are described with reference to the following figures, wherein like reference numerals refer to like parts throughout the various views unless otherwise specified.
[0012] FIG. 1 is a perspective diagram illustrating a mobile electronic device and an overlay according to one embodiment.
[0013] FIG. 2 is a side elevation illustrating a portion of the mobile electronic device and the overlay operationally coupled to the mobile electronic device.
[0014] FIG. 3 is a diagram illustrating a button structure layout of an overlay, according to one embodiment.
Detailed Description
[0015] FIG. 1 illustrates an embodiment of an overlay 101, which has button structures 103 extending from one of its surfaces. In the illustrated example, overlay 101 is to be used as an accessory to a mobile or handheld electronic device 105 having a touchscreen display 107. Button structures 103 have corresponding nibs (see FIG. 2 ) on the surface of overlay 101 that faces electronic device 105.
[0016] The portion of overlay 101 illustrated in FIG. 2 shows a button structure 103 with a nib 201, both formed on a flexible and resilient layer or membrane 203. Button structures 103 can be sized so that a finger can easily press a button structure without inadvertently pressing a neighboring button structure. The nibs 201 can be relatively smaller (e.g., having a contact point on touchscreen display 107 similar in size to that of a stylus).
[0017] In one embodiment, membrane 203 is made from a clear polycarbonate material that provides adequate flexibility and resiliency, and the button structures 103 and nibs 201 are made from a clear acrylic material. In this embodiment, button structures 103 and nibs 201 are attached to membrane 203 using a suitable adhesive (e.g., acrylic cement solvent). This embodiment allows a user to view the underlying virtual buttons through these translucent materials. In other embodiments, the same material can be used to implement the membrane, button structures and nibs. In still other embodiments, different materials can be used to implement the membrane, button structures and nibs of overlay 101.
[0018] In still other embodiments, membrane 203 may be implemented using a fiber optic plate; e.g., a plate that resembles a slice taken from a bundle of a large number of parallel touching optical fibers, the slice being taken perpendicularly from the longitudinal axis of the bundle. The fiber optic plate in effect implements a large number of parallel waveguides that direct light from one side of the plate to the other.
[0019] Referring again to FIG. 1 , the example electronic device 105 is a so-called personal digital assistant or PDA. In other applications, electronic device 105 can be a cellular telephone with touchscreen display, a tablet personal computer (PC), a remote control for an appliance, and the like. Touchscreen display 107 is typically used to display virtual buttons that allow a user to perform input functions on electronic device 105.
[0020] Overlay 101 is attached to electronic device 105 in any suitable manner. For example, many mobile electronic devices have its touchscreen display recessed so that overlay 101 may be press fitted into the recess. In other embodiments, overlay 101 may be part of or inserted into a sleeve into which electronic device 105 may be inserted. Similarly, overlay 101 may be part of or inserted into a cover that is attached to the body of electronic device 105. In a similar manner, overlay 101 may be formed as part of a replacement faceplate designed for electronic device 105. Similar sleeves, covers and faceplates are commercially available for some electronic devices and can be modified to accept or incorporate an overlay. In other embodiments, adhesive and/or mechanical fasteners (e.g., screws) may be used to attach overlay 101 to electronic device 105. In still other embodiments, a mechanical attachment means (e.g., clips, Velcro® or Gecko Tape™, etc.) can be used to removably attach overlay 101 to electronic device 105. In this embodiment, overlay 101 is attached to electronic device 105 so that none of the nibs 201 (FIG. 2 ) contact touchscreen display 107 unless a button structure is pressed. In this embodiment, the nibs 201 are located on overlay 101 so that they are substantially centered on a corresponding virtual button to be displayed by touchscreen display 107 (e.g., see FIG. 3 ).
[0021] A user can use overlay 101 to accurately operate virtual button displayed by touchscreen display 107 under limiting circumstances (e.g., large fingers, low-light conditions, etc. as described above). For example, in one application, overlay 101 is operationally coupled to mobile electronic device 105 so that a user can press the button structures 103 to operate virtual buttons displayed by touchscreen display 107. The overlay is formed so that when a user presses a button structure 103, the corresponding nib 201 (FIG. 2 ) moves or extends from the surrounding portion of the overlay to contact the desired virtual button. In one embodiment, each nib moves or extends away from the surrounding portion of the overlay substantially independently of other nibs so that only the desired virtual button is pressed. When the user stops pressing the button structure, the resiliency of membrane 203 causes the nib to move away from (thereby breaking contact with) the surface of touchscreen display 107. The button structures 103 provide a means that advantageously allows a user to accurately operate the virtual buttons by touch, reducing the need to look at the virtual buttons being displayed by the touchscreen display 107.
[0022] In an alternative embodiment, button structures 103 are made using haptic technology to provide a further indication (e.g., a “click” or other sound and/or feel) that a button was pressed. Suitable haptic devices are commercially available (e.g., those used in some keypads). The audio/mechanical feedback provided by haptic devices provides confirmation that the button structure was correctly pressed, which is desirable to many users.
[0023] In another embodiment, overlay 101 is configured so that button structures 103 are in the form of a QWERTY keyboard. This overlay can be advantageously used with electronic devices that do not have enough space for a hardware QWERTY keyboard. A user that wishes to use a QWERTY keyboard to input data into such an electronic device can obtain software that implements a virtual QWERTY keyboard along with a “QWERTY” overlay 101.
[0024] In yet another embodiment, overlay 101 includes a lighting device 109 that can be used to illuminate the button structures so that a user can see the button structures under low-light conditions. For example, overlay 101 can include a light emitting diode (LED) 111 and a power source 113 (e.g., a battery) that is configured to provide edge lighting of the overlay. In one embodiment, the power source 113 can be turned on and off using one of the button structures of the overlay.
[0025] In another embodiment, overlay 101 includes a cutout slot 301 as illustrated in FIG. 3 that houses a slider button 303 on the top side and a respective nib on the other side such that the slider button is captive and is forced to move only along the slot 301 and up and down similar to the other buttons. When the user actuates the slider button 303 by pressing and sliding it, the nib in turn actuates a virtual slider on the touch screen display.
Example Application of Tactile Overlay
[0026] In one application, overlay 101 is used as an accessory to improve the performance of a PDA device (with infrared port) that is configured to operate as a remote control for one or more appliances (e.g., a television, video cassette recorder, a stereo, etc.). In one embodiment, the PDA device is configured with universal remote controller software package such as, for example, “TV Remote Controller 5.5”, which is available from PDAwin.com. In this embodiment, a user can program a desired virtual button arrangement using this software. For example, in one embodiment, a user can arrange the virtual buttons to correspond to the button structures of the overlay illustrated in FIG. 3 (described further below). The software enables the PDA device to operate as a universal remote control for various household appliances.
[0027] FIG. 3 illustrates a button structure layout of overlay 101, according to one embodiment. In this embodiment, button structures 103 include button structures that have a raised portion 103A that a user can discern by sense of touch. The raised portion of the button structure can be used to differentiate one set of similar button structures from another set. For example, in the layout of FIG. 3 , the top pair of triangular button structures on the right side of overlay 101 have raised portions 103A to indicate that the top set is used for a preselected function (e.g., to change channels). On the other hand, the lower pair of triangular button structures 103 on the right side of overlay 101 do not have raised portions to indicate that the bottom set is used for a different preselected function (e.g., to change volume). In addition, in this embodiment, button structures 103 include a button structure that has a circular ridge 103B that can be used to indicate the position of that button structure relative to other associated button structures (e.g., the middle numeric “key” of a numeric keypad). In other embodiments, different topographic features can be formed in selected button structures to provide indications for particular functions, locations or other selected parameter. These topographic features can advantageously help a user to press desired button structures without having to look at the overlay. This feature can be advantageous for users that like to point the IR port of the PDA device at the desired appliance when changing a channel, volume, etc.
[0028] In an alternative embodiment, overlay 101 includes a redirector 115 that is positioned over the infrared port 117 of the PDA device. The redirector is used to change the direction of the infrared beam 117 so that a user can simultaneously view the button structure(s) of the overlay while directing an infrared beam toward a desired appliance. For example, in one embodiment the redirector 115 could be implemented using a fiber optic plate (similar to that described above) with a bend in the optical fiber segments that form the plate. In such an embodiment, the overlay can be formed so that the redirector 115 resembles a flange-like structure at the top side of the overlay, whereby the redirector covers the IR port of the PDA device. Other optical structures (e.g., a mirror, prism, etc.) can be used to implement the redirector 115 in other embodiments.
[0029] Reference has been made throughout this specification to “one embodiment,” “an embodiment,” or “an example embodiment” meaning that a particular described feature, structure, or characteristic is included in at least one embodiment of the present invention. Thus, usage of such phrases may refer to more than just one embodiment. Furthermore, the described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments.
[0030] One skilled in the relevant art may recognize, however, that the invention may be practiced without one or more of the specific details, or with other methods, resources, materials, etc. In other instances, well known structures, resources, or operations have not been shown or described in detail merely to avoid obscuring aspects of the embodiments being described.
[0031] While example embodiments and applications have been illustrated and described, it is to be understood that the invention is not limited to the precise configuration and resources described above. Various modifications, changes, and variations apparent to those skilled in the art may be made in the arrangement, operation, and details of the methods and systems of the present invention disclosed herein without departing from the scope of the claimed invention.
Claims
What is claimed is:
1. An apparatus, comprising:
a membrane including a fiber optic plate configured to direct light from a first side of the membrane to a second side opposite the first side, the first side positioned adjacent to a touchscreen display;
a button structure disposed on the second side of the membrane; and
a nib corresponding to the button structure and disposed on the first side of the membrane, wherein the apparatus is configured to be operatively coupled to the touchscreen display so that when a user applies a force to the button structure the nib contacts the touchscreen display so as to activate a virtual button being displayed by the touchscreen display.
2. The apparatus of claim 1, wherein the membrane comprises a flexible and resilient material.
3. The apparatus of claim 1, wherein the button structure comprises a translucent portion.
4. The apparatus of claim 1, wherein the button structure is configured as a remote control.
5. The apparatus of claim 1, wherein the button structure comprises a haptic structure configured to emit an audible sound.
6. The apparatus of claim 1, wherein the button structure is one of a plurality of button structures disposed on the membrane, wherein the plurality of button structures implement a QWERTY keyboard.
7. The apparatus of claim 1, further comprising a lighting device to selectively illuminate the button structure, the lighting device including at least one light emitting diode (LED) and a power source.
8. The apparatus of claim 1, further comprising a redirector to change a direction of an infrared beam directed onto the redirector.
9. The apparatus of claim 1, wherein the membrane is sized to be press fitted into a recessed portion of a mobile electronic device, wherein the membrane is disposed within the recess to position the nib in propinquity with the touchscreen display.
10. The apparatus of claim 1, further comprising a sleeve to contain a mobile electronic device that includes the touchscreen display, wherein the sleeve is to position the nib in propinquity with the touchscreen display.
11. The apparatus of claim 1, wherein the button structure and nib are slidably fitted to a guide slot in the membrane, the guide slot constraining the button structure and nib along a guide slot path.
12. An apparatus to be operatively coupled to a touchscreen display for operating a virtual button displayed by the touchscreen display, the apparatus comprising:
a membrane, wherein the membrane comprises a fiber optic plate; and
tactile means, coupled to the membrane, for selectively contacting a touchscreen display at a desired location in response to a force exerted on the tactile means by a user, wherein the tactile means further includes a means for slidably contacting the touchscreen display along a pre-determined linear slot.
13. The apparatus of claim 12 wherein the membrane comprises a flexible and resilient material.
14. The apparatus of claim 12 wherein the tactile means comprises a translucent portion.
15. The apparatus of claim 12 wherein the tactile means comprises a haptic structure configured to emit an audible sound.
16. The apparatus of claim 12 wherein the tactile means comprises a plurality of button structures disposed on the membrane, wherein the plurality of button structures implement a QWERTY keyboard.
17. The apparatus of claim 12 further comprising a lighting device to selectively illuminate a portion of the apparatus.
Patent Citations (58)
| Patent | Date | Inventor | Cited By |
|---|---|---|---|
| US4333092(A) | 1982-06-01 | Field | Applicant |
| US4406998(A) | 1983-09-01 | Willough | Applicant |
| US5086287(A) | 1992-02-01 | Nutzel | Applicant |
| US5154614(A) | 1992-10-01 | Matsuoka et al. | Applicant |
| US5165897(A) | 1992-11-01 | Johnson | Applicant |
| US5186629(A) | 1993-02-01 | Rohen | Applicant |
| US5233333(A) | 1993-08-01 | Borsuk | Applicant |
| US5272470(A) | 1993-12-01 | Zetts | Applicant |
| US5412189(A) | 1995-05-01 | Cragun | Applicant |
| US5568536(A) | 1996-10-01 | Tiller et al. | Applicant |
| US5580254(A) | 1996-12-01 | Ramsey | Applicant |
| US5588839(A) | 1996-12-01 | Shimoda | Applicant |
| US5590373(A) | 1996-12-01 | Whitley et al. | Applicant |
| US5619684(A) | 1997-04-01 | Goodwin et al. | Applicant |
| US5729394(A) | 1998-03-01 | Sevier et al. | Examiner |
| US5748177(A) | 1998-05-01 | Baker et al. | Applicant |
| US5757361(A) | 1998-05-01 | Hirshik | Applicant |
| US5805138(A) | 1998-09-01 | Brawne et al. | Applicant |
| US5810597(A) | 1998-09-01 | Allen, Jr. et al. | Applicant |
| US5821881(A) | 1998-10-01 | Fischer et al. | Examiner |
| US5835080(A) | 1998-11-01 | Beeteson et al. | Applicant |
| US5874955(A) | 1999-02-01 | Rogowitz et al. | Applicant |
| US5909211(A) | 1999-06-01 | Combs et al. | Applicant |
| US5920303(A) | 1999-07-01 | Baker et al. | Applicant |
| US5936614(A) | 1999-08-01 | An et al. | Applicant |
| US5989099(A) | 1999-11-01 | Arnold, III et al. | Applicant |
| US6042383(A) | 2000-03-01 | Herron | Applicant |
| US6059575(A) | 2000-05-01 | Murphy | Applicant |
| US6088805(A) | 2000-07-01 | Davis et al. | Applicant |
| US6141754(A) | 2000-10-01 | Choy | Applicant |
| US6162059(A) | 2000-12-01 | Murphy et al. | Applicant |
| US6217338(B1) | 2001-04-01 | Tieman | Applicant |
| US6233576(B1) | 2001-05-01 | Lewis | Applicant |
| US6259043(B1) | 2001-07-01 | Clary et al. | Applicant |
| US6262718(B1) | 2001-07-01 | Findlay et al. | Applicant |
| US6267598(B1) | 2001-07-01 | Allen, Jr. et al. | Applicant |
| US6278944(B1) | 2001-08-01 | Lui et al. | Applicant |
| US6292713(B1) | 2001-09-01 | Jouppi et al. | Applicant |
| US6292904(B1) | 2001-09-01 | Broomhall et al. | Applicant |
| US6308173(B1) | 2001-10-01 | Glasser et al. | Applicant |
| US6320496(B1) | 2001-11-01 | Sokoler et al. | Applicant |
| US6351748(B1) | 2002-02-01 | Deen et al. | Applicant |
| US6357940(B1) | 2002-03-01 | Murphy | Applicant |
| US6381602(B1) | 2002-04-01 | Shoroff et al. | Applicant |
| US6384743(B1) | 2002-05-01 | Vanderheiden | Applicant |
| US6412070(B1) | 2002-06-01 | Van Dyke et al. | Applicant |
| US6446206(B1) | 2002-09-01 | Feldbaum | Applicant |
| US6449633(B1) | 2002-09-01 | Van et al. | Applicant |
| US6473103(B1) | 2002-10-01 | Bailey et al. | Applicant |
| US6492978(B1) | 2002-12-01 | Selig et al. | Examiner |
| US6513721(B1) | 2003-02-01 | Salmre et al. | Applicant |
| US6581099(B1) | 2003-06-01 | Deen et al. | Applicant |
| US6609199(B1) | 2003-08-01 | DeTreville | Applicant |
| US6776546(B2) | 2004-08-01 | Kraus et al. | Examiner |
| US7079119(B2) | 2006-07-01 | Hanson et al. | Examiner |
| US7116313(B2) | 2006-10-01 | Nasu | Examiner |
| US2003/0095110(A1) | 2003-05-01 | Ukita et al. | Examiner |
| US2003/0134256(A1) | 2003-07-01 | Tretlakoff et al. | Applicant |
Non-Patent Literature (9)
- “Touch -Sensitive Overlay with Tactile Feedback”, IBM Disclosure Bulletin, pp. 761-763, vol. 29, No. 2, Jul. 1986.Applicant
- McMath, et al., “High Sampling Resolution Tactile Sensor for Object Recognition”, IEEE Instrumentation and Measurement Technology Conference, pp. 579-583, vol. 29, No. 2, May 18-20, 1993.Applicant
- Yeung et al., “High Sampling Resolution Tactile Sensor for Object Recognition”, IEEE Transactions on Instrumentation and Measurement Conference, pp. 277-282, vol. 43, No. 2, Apr. 1994.Applicant
- Timothy Griffin, “Haptic Feedback in Button Technologies: A Guide for Industrial Designers”, http://tim.griffins.ca/writings/haptic—tech—body.html; pp. 1-47, Apr. 14, 1999.Applicant
- “Automated Home . . . The Hows, Wheres and Whys of HA in the UK (Est. 1996)”, www.automatedhome.co.uk, PDA-ir Review, pp. 1-8, May 24, 2002.Applicant
- Gerovichev et al., “The Effect of Visual and Haptic Feedback on Manual and teleoperated Needle Insertion”, Lecture Notes in Computer Science, Proceedings Part 1, pp. 147-154, vol. 2488, Sep. 25-28, 2002.Applicant
- “TV Remote Controller 5.5 (voice operated)—reduced price!”, www.pdawin.com/tvremote.html, pp. 1-4 Aug. 2003.Applicant
- “SoftFlow Version 3.0-Appliation Programming Manual”, Delta Systems, Inc., www.delta-systems-inc.com, Stone Ridge Publishing, Inc., pp. 1-8, Aug. 2003.Applicant
- S.D. Laycock and A.M. Day, “Recent Developments and Applications of Haptic Devices”, Computer Graphics Forum, EG Eurographics Digital Library, pp. 117-132, vol. 22, No. 2, 2003.Applicant