Optical keyboard

[0003] The present invention relates generally to fiber optics, and, more specifically, to optical panels.

[0004] U.S. Pat. No. 5,381,502 discloses a polyplanar optical display (POD) including ribbon optical waveguides laminated together, and having an inlet face at one end for receiving light, and a screen defined at an opposite end for displaying the light channeled through the individual waveguides with total internal reflection.

[0005] U.S. Pat. No. 5,455,882 discloses an interactive optical panel in which outbound light is channeled through the stacked waveguides for projecting an image on the screen, and inbound light may be channeled through the same waveguides and detected for providing interactive capability.

[0006] In both patents, the similarly configured optical panels permit light transmission in either direction from the inlet face to the opposite screen, or from the screen to the opposite inlet face. This capability permits the use of the optical panels in various applications for providing high definition viewing screens for televisions, computer monitors, and various other types of viewing screens as desired.

[0007] In a typical computer application, the viewing monitor is controlled by a digital computer for projecting thereon various information as required for corresponding computer programs or software. Software is typically interactive and requires input from a user which is typically provided by using a conventional keyboard having multiple keys thereon for the various letters of the alphabet and numbers, as well as specialized keys.

[0008] A keyboard may be mechanical with individually articulated keys. Another type of keyboard is known as a touch screen which overlays a viewing screen for detecting engagement of virtual keys displayed on the screen. Touch screens use optical beams or capacitance for detecting the two-dimensional (2-D) position on the screen being touched by a user for coordinating that position with virtual keys or options displayed on the screen.

[0009] A typical computer console includes discrete components such as the screen, keyboard, and internal electronics including the central processing unit (CPU), which must be suitably manufactured and integrated together with an associated cost therefor.

[0010] Accordingly, it is desired to provide an improved keyboard for various applications including use in a computer console.

[0011] An optical keyboard includes an optical panel having optical waveguides stacked together. First ends of the waveguides define an inlet face, and opposite ends thereof define a screen. A projector transmits a light beam outbound through the waveguides for display on the screen as a keyboard image. A light sensor is optically aligned with the inlet face for sensing an inbound light beam channeled through the waveguides from the screen upon covering one key of the keyboard image.

[0012] The invention, in accordance with preferred and exemplary embodiments, together with further objects and advantages thereof, is more particularly described in the following detailed description taken in conjunction with the accompanying drawings in which:

[0013] FIG. 1 is a partly sectional, isometric view of an optical computer console in accordance with an exemplary embodiment of the present invention.

[0014] FIG. 2 is an enlarged, partly sectional view of a portion of the optical keyboard panel illustrated in FIG. 1 in accordance with exemplary embodiments.

[0015] FIG. 3 is an enlarged, partly sectional view of an exemplary one of the ribbon waveguides used in the keyboard panel illustrated in FIGS. 1 and 2, as well as in the optical screen pane illustrated in FIG. 1.

[0016] FIG. 4 is an enlarged, partly sectional view of a portion of the keyboard panel illustrated in FIG. 2 activated by touch in accordance with an exemplary embodiment of the present invention.

[0017] FIG. 5 is a flowchart representation of various embodiments of the keyboard and screen display panels illustrated in FIG. 1 in combination with projectors and sensors associated therewith.

[0018] Illustrated in FIG. 1 is a computer console 10 including an optical keyboard 12 in accordance with an exemplary embodiment of the present invention. The keyboard 12 is an assembly of components including a first optical panel 14 preferably positioned horizontally. A second optical panel 16 is preferably disposed vertically adjacent the horizontal panel 14, and both are suitably mounted in a housing 18 configured in an exemplary self-standing console unit.

[0019] The two optical panels 14,16 are of the conventional type known as polyplanar optical displays (PODs) disclosed in substantial detail in the above identified patents. Each optical panel includes a plurality of sheet or ribbon optical waveguides 20 which are stacked or laminated together in a relatively thin laminate of a substantial number of the waveguides as desired. First or inboard ends of the waveguides collectively define corresponding inlet faces 22a,bfor the two panels, and opposite or outboard ends thereof collectively define corresponding screens 24a,b.

[0020] The first and second screens 24a,bare beveled at relatively small acute face angles of about a few degrees, for example, to position the corresponding screens almost perpendicular to the corresponding first and second inlet faces 22a,bto provide substantially thin optical panels. In a typical configuration, hundreds of the waveguides 20 may be laminated in each optical panel with a combined thickness of a few centimeters, for example. The ribbon waveguides 20 extend the full width of the panels and the degree of acute bevel of the screens controls the desired length or height of the screens.

[0021] A portion of the keyboard panel 14 is illustrated enlarged in more detail in FIG. 2, with a portion of an individual waveguide 20 being further enlarged in FIG. 3.

[0022] As shown in FIG. 3, each waveguide 20 includes an optically transparent core 20a, having a suitable index of refraction or refractive index, sandwiched between a pair of cladding sheets 20bhaving a lower refractive index. Adjacent cores in the panel laminate may be separated by common cladding sheets extending the full width and length of the individual laminates. The core and cladding may be different plastics joined together by heat or other means. Or, the cores may be glass or plastic adhesively bonded together to form cladding layers therebetween.

[0023] Both optical panels 14,16 illustrated in FIG. 1 may therefore be constructed in identical fashion with the waveguides being configured for total internal reflection of light therein for use in the exemplary computer console. Means including a first or keyboard projector 26aare suitably disposed inside the housing 18 for projecting a light beam 28 outbound through the waveguides 20 for display on the keyboard screen 24aas a keyboard image 30 which is a virtual representation of any desired keyboard. The keyboard image 30 is illustrated in more detail in FIG. 2 and includes a plurality of individual image keys 30aprojected on the keyboard screen 24a.

[0024] As shown schematically in FIG. 1, the keyboard projector 26amay have any conventional configuration including a suitable light source, such as a laser or incandescent bulb, light modulator for defining the form of the keyboard image, and suitable optics for expanding the outbound beam 28 over the first inlet face 22ato project the desired keyboard image on the screen. The beveled ends of the individual waveguides may be frosted to diffuse the outbound beam thereat for improving the angle of viewing of the virtual keys formed thereby.

[0025] In FIG. 1, the keyboard projector 26ais mounted near the bottom of the housing 18 to direct the outbound beam 28 vertically upwardly toward a folding mirror 32 which reflects the beam laterally across the first inlet face 22aalong the width of the panel in the X axis or direction, and transversely over the height of the stacked waveguides for display along the length of the panel in the Y axis or direction. The keyboard projector 26amay be otherwise optically aligned with the first inlet face 22ain any suitable manner subject to available space in the particular form of housing.

[0026] Similarly, a second or screen projector 26bis optically aligned with the second inlet face 22bof the second screen 24bfor projecting a corresponding outbound light beam 28bthrough the waveguides thereof to form a suitable screen or output image 34 on the second screen.

[0027] In the exemplary embodiment illustrated in FIG. 1, the keyboard projector 26aand the screen projector 26bare separate and distinct, although they may be identically configured with a light source, light modulator, and suitable optics for forming the desired images on the two panels 14,16.

[0028] The console illustrated in FIG. 1 also includes suitable electronics including a digitally programmable computer 36 operatively joined to both projectors 26a,bfor controlling images on the corresponding screens 24a,b.

[0029] As initially shown in FIG. 1, the optical keyboard 12 further includes means including at least one light sensor 38afor detecting or sensing an inbound light beam 40 channeled back through the waveguides from the keyboard screen 24aupon covering one of the keys. As shown in more particularity in FIG. 2, the light sensor 38ais optically aligned with a plurality of the waveguides 20 at least corresponding with all the keys 30aof the keyboard for discriminating individual keys upon detecting the inbound beam corresponding therewith. The light sensor 38aextends transversely across the stack of waveguides 20, over the full number thereof if desired, along the keyboard inlet face 22afor discriminating position or location of the inbound beam at the keyboard screen 24a, such as its Y coordinate position.

[0030] The light sensor 38ais operatively joined to the computer 36 and may be operated in various manners for sensing the inbound light beam 40 to determine two-dimensional (2D) position of the inbound beam at the keyboard screen 24aalong both the X and Y axes.

[0031] For example, the light sensor 38ais illustrated in an exemplary embodiment in FIG. 2 in the form of a conventional linear diode array with individual photodiodes corresponding with the many waveguides 20 for individually detecting in which waveguide the inbound beam is transmitted. The light sensor may include diodes in a 1:1 correspondence with the individual waveguides for detecting light independently therein. A suitable light sensor is a linear image sensor which is a monolithic, self-scanning, photodiode array having 1,024 diodes therein as available from Hamamatsu Corporation of Japan. This exemplary sensor is effective for detecting visible through infrared (IR) light as described in more detail hereinbelow.

[0032] An enlarged section of the keyboard 24ais illustrated in FIG. 4 cooperating with the linear diode array light sensor 38a, shown in part. In typical operation, the outbound beam 28 is channeled through the waveguides for display on the screen 24a. An operator or user of the console may then press a finger 42 atop one of the virtual keys displayed on the screen for inputting into the computer the corresponding data identified by the specific key being covered by the finger. For example, the virtual keys may be the various letters of the alphabet or various numerals from zero through nine, or may be specialized keys as desired.

[0033] Since the finger is warm, it generates its own IR energy which may be channeled back through the waveguides for detection by the light sensor. However, this may provide a weak signal, or no signal at all if the finger itself is cold or covered.

[0034] In a preferred embodiment, the outbound beam 28 encounters the finger covering several of the waveguides and is reflected thereby back into the waveguides to define the inbound light beam 40 as the local reflection of the outbound beam. Human skin is not only partly reflective, but is translucent for reflecting back the outbound beam over several adjoining waveguides.

[0035] If desired, the keyboard panel may also include a transparent plastic cover 44 as shown in FIG. 4 laminated atop the screen 24afor transmitting the reflected inbound beam into the waveguides as a key is covered. In this way, the outbound beam first passes through the cover 44 prior to engaging the finger, and is then reflected off the finger and back through the cover into several of the waveguides for transmission back to the light sensor 38a.

[0036] The light sensor 38amay be located at any convenient position along the width of the first panel 14 since the inbound beam may be detected across the full width of the waveguide sheets thereof. In this way, the light sensor does not interfere with the outbound beam being transmitted through the remainder of the first inlet face.

[0037] The keyboard panel 14 illustrated in FIG. 2 is thusly capable of both displaying the desired keyboard image 30 using the outbound beam 28 while also providing a return path for the inbound beam 40 created when one or more of the waveguides is covered at the screen. Since the keyboard screen 24ais an optical device it is subject to ambient or background light which must be distinguished from the reflected inbound beam corresponding with covering of individual keys. This may be effected in various manners.

[0038] For example, the sensing means including the light sensor 38aand computer 36 joined thereto may be configured for detecting the inbound beam simultaneously as the outbound beam is projected by the keyboard projector 26ausing visible light, IR light, or both. In one configuration, the keyboard projector 26ais configured for projecting the outbound beam 28 at a wavelength substantially equal to the wavelength of the inbound beam 40.

[0039] In an alternate embodiment, the projector 26amay be configured for projecting the outbound beam at a wavelength which is different than the wavelength of the inbound beam. In this example, the outbound beam may be visible light, whereas the inbound beam may be IR light for providing enhanced contrast therebetween and a large signal to noise ratio.

[0040] Since the light sensor 38ais capable of detecting light in the wavelengths corresponding with visible and infrared, it may be optionally covered with a IR pass band filter for transmitting thereto solely IR light corresponding with the IR inbound beam to distinguish or discriminate over the outbound beam and any other visible light which may be carried through the waveguides.

[0041] As shown schematically in FIG. 1 and in flowchart form in FIG. 5, the keyboard projector 26amay be configured for projecting both visible and IR light from a common light source for simultaneous transmission through the waveguides as the outbound beam defining the keyboard image. Upon covering an individual key as illustrated in FIG. 4, both the visible and IR light are reflected back into the screen as the inbound beam 40. The light sensor 38amay therefore include the IR pass band filter across its diodes for detecting only the IR light. In this way, the light sensor may be tuned for detecting only IR light for increasing contrast and detection sensitivity over the visible light also being transmitted through the common waveguides in opposite directions.

[0042] In another configuration illustrated schematically in FIG. 2, the keyboard projector 26aas driven by the computer is effective for projecting the outbound beam in the keyboard image 30 intermittently with the projection of the outbound beam in a position grid 46, which is another image corresponding with the keyboard image. In this way, the keyboard image may be displayed in a relatively fast cycle of repeating image frames, alternating as desired with image frames for the position grid 46 for decoupling projection of the keyboard image from detection of covered keys thereof.

[0043] A particular advantage of this decoupling is that the position grid 46 may be tailored independently of the keyboard image 30 for increasing discrimination or contrast between the outbound and inbound beams for improving detection capability. For example, the projecting means may be configured for projecting the outbound beam in fewer waveguides 20 for the position grid 46 than for the keyboard image 30.

[0044] As shown in FIG. 2, each virtual key 30amay have a rectangular configuration of finite area each covering several waveguides 20 at their screen ends illustrated in more detail in FIG. 4. The position grid 46, in contrast, may be narrow bands of light in a few adjoining waveguides centered transversely along the Y axis in corresponding ones of the keys. One key may cover tens of the beveled ends of the waveguides whereas the position grid may cover only a few thereof.

[0045] Accordingly, many of the waveguides remain blank of outbound light between the corresponding elements of the position grid, and become available for transmitting the inbound beam 40 therethrough.

[0046] Correspondingly, the computer cooperating with the linear array light sensor 38amay be configured so that the sensing means detect the inbound beam only in the blank waveguides and not in those waveguides through which the position grid is transmitted. In this way, only those individual diodes corresponding with the blank waveguides are used in detecting the inbound beam reflected therethrough simultaneously with the outbound beam being transmitted through the remaining waveguides. The inbound beam is thusly decoupled from the outbound beam for providing enhanced contrast and detection sensitivity.

[0047] In this way, the same keyboard projector 26amay be configured for projecting visible light to form both the keyboard image 30 and the position grid 46. The light sensor 38awill thusly detect visible light which may be contrasted with background or ambient light in the waveguides by preferentially monitoring the blank waveguides for reflected inbound light as a key is covered.

[0048] Since the linear diode array illustrated in FIGS. 1 and 2 extend across the several waveguides at their inlet face and may include a photodiode optically aligned with a respective waveguide, the transverse location along the Y axis of the inbound beam from the keyboard screen is readily determined by which photodiode is light activated. In order to additionally determine the lateral location along the X axis of the source of the inbound beam atop the keyboard screen, the sensing means preferably include a pair of substantially identical linear diode array light sensors 38a,b. The two light sensors extend transversely across the waveguides at their inlet face, and are spaced laterally apart from each other preferably at opposite ends of the inlet face to avoid interference with the outbound beam directed thereat.

[0049] The two light sensors 38a,bare operatively joined to a conventional electronic comparator 48 cooperating with the computer which determines the relative intensity of the inbound beam detected thereby from which the lateral X position of the covered key may be accurately determined. The Y position of the covered key is determined by identifying which of the waveguides carries the inbound beam. In this way, the accurate 2D position of any one of the covered keys of the keyboard screen may be determined from the location of the inbound beam emanating therefrom.

[0050] Since the keyboard image 30 and the position grid 46 illustrated in FIG. 2 are created by projected light, they may have any desired configuration, including the same or different configurations. They, therefore may be displayed either simultaneously or intermittently as desired depending upon the contrast requirements for detecting covered keys over background noise in the form of incident ambient light.

[0051] In one embodiment, the projecting means including the keyboard projector 26aand the driving computer 36 are effective for projecting the outbound beam in the position grid 46 corresponding simultaneously with the keyboard image 30. Both images may be visible light, or the former may be visible and the latter IR light, for example.

[0052] The sensing means including the light sensors are correspondingly configured for determining lateral, X position and transverse, Y position of any one of the covered keys upon detection of the inbound beam from the position grid.

[0053] The optical keyboard may be substantially simplified by configuring the projecting means for rastering the outbound beam in a position grid at the keyboard screen corresponding with the keyboard image. As shown in FIG. 2, the individual elements of the position grid may be defined as a travelling or a raster element 46ahaving any suitable form such as a local spot or the narrow strips formed by illuminating only some of the several waveguides under each of the virtual keys.

[0054] Accordingly, instead of having a complete position grid displayed substantially simultaneously for all the virtual keys, the grid may be formed sequentially by temporarily positioning the raster element 46aat each virtual key position in a sequential cycle. This may be effected in a fraction of a second and is imperceptible to a user.

[0055] The sensing means may then be substantially simplified to use a single light sensor in the form of the linear diode array 38aor 38b, for example, or may be a single-element photodiode 38cas shown in FIG. 4. The single light sensor extends transversely across the several waveguides at the inlet face 22aillustrated in FIG. 2. In this configuration the actual 2D location of the raster element is predetermined and controlled by the electronics creating the position grid. Since the raster element 46ais repositioned in turn from key to key on the keyboard screen, its X,Y position is known for each of the virtual keys.

[0056] The function of the single light sensor is therefore limited to detecting the presence of the inbound beam when any one of the virtual keys is covered. When the inbound beam is detected, the computer instantaneously determines the position of the raster element corresponding thereto from which is determined the identity of the corresponding virtual key being covered.

[0057] A single light sensor is sufficient for this rastering embodiment and requires only a single photodiode traversing the inlet face. A second light sensor and the comparator are not required in this embodiment. Contrast over background noise is enhanced, and the rastering and key detection may be effected in a digital circuit specifically configured therefor at relatively low cost.

[0058] As indicated above, a single keyboard projector 26amay be configured to emit a visible outbound beam both for displaying the virtual keys on the keyboard screen as well as for rastering the raster element 46aof the corresponding position grid. In this configuration, the projecting means are effective for projecting the visible outbound beam in the keyboard image 30 intermittently with rastering the outbound beam in the position grid corresponding thereto. The keyboard image may thusly be projected in alternating frames which is a substantially continuous image to a user. The position grid is intermittently projected between keyboard frames and is effectively invisible to the user. For example, individual projection frames may be formed and displayed in a small fraction of a second for up to about a hundred frames per second.

[0059] In an alternate embodiment illustrated in FIG. 5, the projecting means may include the first keyboard projector 26aspecifically configured for displaying only the keyboard image including its keys on the keyboard screen. And, a second keyboard projector 26cmay be provided and dedicated for rastering its outbound beam in the position grid 46 including the raster element 46aatop the keyboard screen.

[0060] In this configuration the keyboard projector 26amay be configured to emit a visible beam, whereas the grid projector 26cis configured to emit an infrared outbound beam. The two projectors and their driving electronics may therefore be tailored to their different requirements for reducing complexity of the configurations thereof while maximizing performance.

[0061] In yet another configuration illustrated in FIG. 5, a common, single projector 26dmay be used to combine the separate functions of the output screen projector 26b, the keyboard projector 26aand the grid projector 26c, or various combinations thereof. In this configuration, the common projector 26dmust be configured to separately drive both optical panels 14,16 for their required functions. The common outbound beam from the common projector 26dmay be suitably split in a conventional splitter 50 for diverting a portion of the outbound beam to the keyboard panel 14 for its various functions, and a portion of the outbound beam to the screen panel for its output display function.

[0062] In one embodiment, the splitter 50 may include a mirror which is reflective or transmissive depending upon the polarization of the incident light beam. This mirror cooperates with a conventional polarizer optically aligned with the common projector 26dso that the outbound beam therefrom may be differently polarized for the requirements of the two optical panels 14,16. The outbound beam polarized in one state will be transmitted to the mirror through one of the panels, and when polarized in an opposite state will reflect off the mirror to the other panel.

[0063] The various embodiments disclosed above may be used individually or in any suitable combination thereof for tailoring performance of the system. Common or multiple light projectors may be used for displaying the virtual keyboard and position grid on the first panel 14 and the desired output images on the second panel 16. Inbound light detection for the keyboard panel 14 may be effected using a single photodiode light sensor or one or more linear array light sensors as disclosed above.

[0064] Since the two optical panels 14,16 illustrated in FIG. 1 may be structurally identical, the keyboard function may be incorporated in either panel, or a single panel may be used for both input and output functions. For example, instead of using a conventional touch screen monitor, similar functions may be obtained by using the keyboard panel 14 in which a portion of the screen 24ais dedicated to input keys, with the remainder of the screen being used to display any desired output information as typically provided in touch screen monitors.

[0065] Furthermore, in the two panel 14,16 configuration illustrated in FIG. 1, the first screen 24amay be substantially larger than the requirements for a typical keyboard configuration, with the surrounding border being used to display any desired information including specialized control keys as desired. Since the keyboard panel 14 is an optical device through which light is transmitted either outbound or inbound, the outbound light may be used for displaying any desired information, while also being reflected by covering any portion of the screen for providing inbound light which is detectable. The keyboard panel 14 therefore provides a unique interactive device which may be used for various applications requiring interactive performance.

[0066] While there have been described herein what are considered to be preferred and exemplary embodiments of the present invention, other modifications of the invention shall be apparent to those skilled in the art from the teachings herein, and it is, therefore, desired to be secured in the appended claims all such modifications as fall within the true spirit and scope of the invention.