Control unit with variable visual indicator

[0002] The present invention is related to control units arranged with data input means, which control units are devised to transmit control signals dependent on the activation of said data input means. More precisely the invention is related to control units wherein said data input means are devised with variable visual indicators.

[0003] Each day a great number of electronic equipment are used, for which equipment control signals often are needed or wanted. For this purpose specially adapted control units are often used. Examples of such control units are keyboards for computers, remote controls for TV-sets, stereo recorders or other electronic apparatus, key pads on mobile phones and calculators, etc. Consequently, the term control unit refers both to such that are integrated with the apparatus they are adapted to transmit control signals to, and such control units that can be communicatively connected to different apparatuses for transfer of control signals.

[0004] The type of control units referred to is more precisely such that include some form of data input means, e.g. press-down keys, rotary controls, switches, etc. In most cases these data input means are equipped with visual indicators devised to present an indication of the control signal the control unit is devised to emit at the activation of the data input means. In general, the visual indicators consist of preprinted or raised markings. On a keyboard, symbols are used that directly indicate which character the control signal will be interpreted as by the existing computer program in the computer the keyboard is adapted to control. For example, if the “A” button is activated in a text editing program, the character a or A will be shown on the computer screen. Furthermore, certain buttons of the keyboard are devised with indicators that refer to a function or action that is commanded by the control unit at the activation of said button. This concerns the function keys, but also, for example, the return key and the arrow keys. Further, there are on a keyboard a number of keys that will activate alternative actions or characters when pushed simultaneously, in combination with one another, or with other keys. These keys include Shift, Alt, Ctrl and Alt Gr. In some cases these alternative characters are shown with separate indicators on the keys, e.g. all the characters that are activated through a simultaneous holding-down of the upper numeric row and Alt-Gr on a regular PC-keyboard.

[0005] Already with two characters indicated on one key, it may be difficult to find the characters one is seeking, even though it is shown on the key. If three or more characters are indicated on the keys, the general appearance of the keyboard will fail to be lucid. A key with several characters implicate, apart from having additional characters on the keyboard, that the characters must be smaller to fit on the key. Alternative characters and functions that are not expected to be used in a greater extent are therefor often not indicated.

[0006] On mobile phones, e.g., which have a tendency to become smaller and smaller, there is often both a number and between three and four letters indicated on each key, which key is often very small, around half a centimetre. As a result thereof, the characters indicated on the key become very small, and it is both difficult and time-consuming to write messages with the key pad of the mobile phone. Similar problems exist for most non-stationary control units. One problem is that the aim of making the control units small and flexible to use, in some cases becomes the clean contrary to the aim of designing a control unit which is able to emit a large number of different control signals, whereby the manufacturers often have to compromise.

[0007] A solution to this problem that is often used is the use of a menu system on the display of the apparatus the control unit is devised to control. This concerns for instance both computers and mobile phones, but also TV-sets. This basically enables an unlimited range of functions or characters per key, but a consequence thereof is that the indication of which control signals will be activated is shown on another place than on the key.

[0008] Another problem related to data input means having visual indicators is that it is predefined during manufacturing which indicators are devised on each key, rotary control, etc. If one only uses some of the existing keys, e.g. on a keyboard, the user has to accept the fact that they may be scattered all over the keyboard. It would of course be desirable if these keys could be arranged on suitable places, for example gathered together in a group or as an optional fingering. If one uses a computer program devised to interpret some keys as special commands, it would also be desirable if it were possible to indicate this as accurately and clearly as possible. This concerns e.g. computer-games or TV-games. Further, it would be desirable to be able to rearrange these special commands to optional keys. The problems with work-related injuries which are more and more apparent and related to working with a mouse pointer, make it desirable to transfer more and more functions and characters to the keys.

[0009] In computer software, often in the operative system, there are decoding systems that are devised to decide how the pressed buttons on the keyboard should be interpreted. These decoding systems are often adjustable so that different keyboard configurations can be enabled. Thus, it is possible, for instance, to change the alphabet from Roman to Cyrillic, or to Japanese characters. However, a reconfigured keyboard becomes difficult to master since the indications on the keys remain unchanged.

[0010] In WO97/45794, a computer without a traditional keyboard is shown, and the computer is instead devised with two screens. One screen is used for data input, for example by direct writing on the screen through the use of a suitable pen unit. The screen can also be devised to show pictures and functions of a keyboard where even different alphabets can be used. One inconvenience with the presented solution is however that the feeling of working with separates keys is lost, at which one must be very accurate to guarantee that the fingers do not glide out of the desired finguring. Another inconvenience is that the input screen must be of a touch-screen type, which is considerably less robust than traditional keys.

[0011] The object of the present invention is, thus, to supply control units with data input means that overcome the problems with the prior art as mentioned above.

[0012] One aspect of the object is to supply a control unit which in a simple way can be configured to be adapted to different users or purposes.

[0013] An additional aspect of this object is to supply a control unit having a limited number of data input means and being arranged to emit a large number of different control signals without limiting the accessibility to the corresponding characters and functions.

[0014] With the object to solve the above-mentioned problems, the present invention refers to a system for controlling an apparatus, which system comprises a control unit adapted for transmission of control signals to the apparatus, dependent on control data. Said control unit comprises data input means for input of said control data, and said apparatus comprises interpreting means adapted to translate said control signals to an action. For the purpose of indicating to a user of a control unit which action the apparatus is set to take at the activation of the data input means, a visual indicator is provided on said data input means. The invention is characterized in that said data input means comprises a variable presentation means, devised to realise said indicator, whereby said control unit comprises a first storage means adapted to store appearance data which is presentable by means of said presentation means. Preferably said control unit comprises a plurality of separate data input means, each equipped with a presentation means, where each presentation means comprises between themselves separate displays devised to present an image dependent on said appearance data.

[0015] In a preferred embodiment, said displays are LCD's with a plurality of pixels, whereby said appearance data includes pixel data. Said control unit can be a remote control to said apparatus, wireless or connectable through a cable. Examples of such embodiments are remote controls for TV-sets and video recorders, or other electronic apparatus. Another example is the keyboard for a computer. The control unit can also be integrated with said apparatus, for example the key pad on a mobile phone.

[0016] Preferred embodiments of the invention are described in detail below with references to the accompanying drawings, on which:

[0017] FIG. 1 illustrates schematically a computer with a keyboard, realised according to the present invention;

[0018] FIG. 2 illustrates schematically a TV-set and a remote control, realised according to the present invention;

[0019] FIG. 3 illustrates schematically a mobile phone with an integrated key pad, realised according to the present invention;

[0020] FIG. 4 illustrates schematically a number of keys with variable presentation means, according to the present invention:

[0021] FIG. 5 illustrates schematically a preferred circuit solution for a control unit, according to the present invention.

[0022] In the FIGS. 1 through 3, examples of devices are outlined for which the present invention is of use and advantageous. In FIG. 1, a computer 11 is schematically illustrated, which is equipped with a presentation unit 12 in the shape of a screen. Keyboard 13 is arranged as a user interface, which keyboard serves as a control unit for the computer. Further, the keyboard is arranged in a known manner with a plurality of data input means in the shape of keys 14. The user gives control data to the keyboard by means of the keys and control signals are thereby transmitted from the keyboard in the figure, to the computer. Said communication connection could be wire dependent or wireless. In the computer there is an interpreting means comprising a computer program devised to decode the control signals, so as to interpret which action or measures the user has ordered.

[0023] FIG. 2 schematically illustrates a TV-set 21 that is equipped with a presentation unit 22 in the shape of a picture tube, plasma screen or similar. The control unit 23 is a remote control, on which buttons or keys 24 are arranged for the input of control data. Control signals are thereby transmitted from the remote control, by means of IR, bluetooth or cable, to the TV-set. In the TV-set, there is a receiver mounted, devised to act as an interpreting unit, for the purpose of interpreting which measures the user wants the TV-set to execute.

[0024] FIG. 3 schematically illustrates a mobile phone 31, equipped with a display 32. The control unit of the mobile phone is its key pad 33, which is integrated with the apparatus 31. The key pad is provided with buttons/keys 34, and in some cases rotary controls or similar. When the control unit and the apparatus are integrated, the transmission of control signal is provided by means of physical connections, for example through cables or wires formed on a printed circuit board.

[0025] Common for all embodiments of the present invention is that the data input means of the control units are equipped with a presentation means 45 enabling immediate reconfiguration of the data input means. In a preferred embodiment of the invention, outlined in FIG. 4, each data input means include a LCD (Liquid Crystal Display). In FIG. 4 , the invention is illustrated for seven keys 44 of a computer keyboard, and it is understood that the arrangement with a display 45 on the key is valid for one or more of the control units' keys 44, rotary controls etc.

[0026] Equally, it is understood that the control unit can have an arbitrary number of keys. Consequently, the embodiment illustrated in FIG. 4 should merely be considered as an example aiming to clearly illustrate the invention.

[0027] In the preferred embodiment according to FIG. 4, each key comprises a 16×16 pixel LCD. Each display 45 is encapsulated, meaning that the display 45 is not compressed when the key is pushed down. The arrangement with these variable presentation means 45 on the keys 44 has consequently no mechanical importance for the function of the keys, which keys can be arranged in a known manner with a matrix decoder or as totally separated contactors.

[0028] Referring to FIG. 5, a preferred embodiment of the invention is described below, wherein said control unit is a computer keyboard. FIG. 5 shows schematically a preferred embodiment of a circuit solution for the control unit, i.e. the keyboard, according to the present invention. The control unit comprises a processor 51, arranged to handle the presentation means of the data input units, i.e. the displays on the keys. Through a PLD (Programmable Logic Unit) 52, the processor 51 is connected to a memory means in the form of a Flash ROM 53. Data representing the different visual indicators the displays are set to show are stored in this memory 53. Consequently, pixel data for a number of different characters is stored therein. To the PLD 52 and the memory 53 is also a second memory 54 connected, preferably a SRAM. In this second memory the configuration of the characters for the different keys of the keyboard is stored. In this second memory 54, information is consequently stored indicating that key i,j shall show the character R, key i,j+1 shall show the character T, etc. In this second memory 54 there are pointers, which point towards data stored in the first memory 53, for the characters included in the configuration defined in the second memory 54.

[0029] The keyboard is operated in two modes: Download and Operation. In the Download mode, the processor, which comprises an internal program and its own data memory, receives data from a computer. The received data comprises either appearance data for one or several keys, or configuration data with information on mapping of different characters on different keys. The appearance data thus describes the appearance for one or several separate keys, and therefor includes pixel data for a character or symbol. The configuration data describes the allocation of each character or symbol to different keys on the keyboard. When the Download mode is initiated, the PLD takes control of the data and addresses buses to memory banks. Received configuration data is stored in the memory 54, which enables rapid reconfiguration of the characters, while the appearance data for the characters is stored in the memory 53 for non-volatile storage when the current supply is turned off. When the Download mode is completed, the PLD's exits are set to high impedance mode, and will thereby not interfere with the bus during the Operation mode.

[0030] During the Operation mode, a binary counter 55 controls the address-lines to the configuration memory 54 by means of a clock pulse generator. The output data from the configuration memory 54, which goes through the characters for the current configuration in a cyclic manner, is used to address the high eight bits in the character memory 53. Simultaneously the counter 55 addresses the display matrix 56. In order to ease understanding, FIG. 5 shows only nine displays 57 in the matrix 56, but it is obvious to a person skilled in the art that an arbitrary number of displays can be included in the display matrix 56. The displays 57 correspond to the displays 45 in FIG. 4. Each display 57 corresponds to one key. The displays 57 of the matrix are addressed by the counter in a multiplexed manner, where rows and columns are addressed each in turn through a set of decoders and buffers. The decoder 58 circulates over the display rows, and the rows are addressed by means of a three-state buffer 59. Further, the decoder 60 is arranged to circulate through the display columns, and a decoder 61 is arranged to address pixel columns for each display column.

[0031] Preferably, the pixel columns of one display row are addressed at a time, in order to prevent the displays to flash at low frequencies. This is a solution comparable to the one used in TV interlacing, where odd and even rows are shown alternately. In a preferred embodiment of the invention, the decoder 60 first addresses the first display column. The decoder 58 circulates thereafter through the three-state buffers 59 from the first to the last row of the display, at which the pixel data for each pixel column is addressed by means of the first of the decoders 61. Thereafter, the decoder 60 addresses the second display column, and the output of pixel data to the respective display proceeds in a corresponding manner by cycling through the display rows.

[0032] Owing to the distinction between the data banks for the character configuration in memory 54 and the appearance of the characters in memory 53, the characters can quickly be rearranged into a new configuration without needing to download new characters to the keyboard. Thanks to the non-volatile nature of the Flash-ROM's memory 53, the characters do not have to be downloaded before each use of the keyboard. When downloading is needed, this is arranged through a suitable link 62 to a computer.

[0033] It should be noted that during the Operation mode the keyboard does not need to have access to a computer, which enables remote control of apparatuses. The keyboard must, however, have access to some sort of a power supply, preferably a battery. In a preferred embodiment said second memory 54 comprises configuration data for a number of pre-defined configurations of which only one can be active at a time. That enables a quick and easy rearrangement of the configuration of the keyboard for different purposes or users.

[0034] In the preferred embodiment of the present invention described above, nothing concerning the function of the keys has been mentioned. Irrespective of which character or symbol that is visually indicated on the keys, the same control signal is transferred from the keyboard to the computer at the activation of the keys. In an ordinary state of the art keyboard, which includes a matrix decoder, a scan code is transferred at the activation of a key, from the keyboard to the computer. In the keyboard according to the present invention, the transmission of the control signal, e.g. scan codes, can be transferred over the same communication link 62, used for downloading data to the keyboard, or through some other communication link. In the computer, there is a scan code interpreting means or a decoder in the form of a computer program, arranged to interpret, based upon said control signal, which action the user wants to perform. In the present invention, said code decoder is intimately associated with the character configuration for the keyboard arranged to control the computer.

[0035] For browsing and for selection of the configurations and the specific keys, the present invention includes a computer program product, which is preferably executable on the apparatus the control unit is adapted to control, i.e. the computer in what is now described. According to a first aspect, the computer program for selection is arranged to show a plurality of different character configurations to choose among. This is preferably done by visualizing the keyboards' 13 keys 14 on the computer's 11 screen 12, where each key is shown with the appearance and the location defined by the configuration in question. The computer program can be arranged to show one character configuration at a time, with the possibility to browse, or to show several different configurations simultaneously. According to this first aspect the computer program also includes means for selecting a specific character configuration, and means for transferring a quantity of data representing the selected character configuration to the control unit. In case the selected character configuration solely includes characters that are already stored in the memory 53 of the keyboard, the transmission of the new character configuration to the keyboard only brings about a change in the configuration memory 54. If new characters are also included, then also memory 53 is updated. According to a second aspect, the computer program is arranged to show a visualization of the keys of the keyboard, and a set of characters to choose among on the computer's screen. The characters to choose among can be shown on the screen in a matrix or a table and sorted in a alphabetic order, numeric order or by character type. With character type is meant for example letters, numbers, arrows etc. With the help of the mouse pointer, the appearance of the key can be selected by click-and-drag from the table to the key on the visualized keyboard to which one wishes to give the appearance in question.

[0036] Preferably one can also choose the action that is to be taken for each key. Preferably there are a number of standard keys where the action is predefined, for example the letters and the numbers. In a preferred embodiment, the action related to the selected character is the printout of the actual character at activation of the selected key. By choosing amongst different actions from a list, for example by using the mouse and different menus, the software will however allow a change of action.

[0037] During restructuring of the character configuration according to the second aspect, where in a very simple example, the A- and B-keys can be arranged to shift location, naturally, the control unit, i.e. the keyboard is also affected concerning the characters to be presented. In this example, the data is changed in memory 54, so that the present configuration points onto the correct character in memory 53 with regards to the characters A and B. The possible change of action that is selected, which action is to be taken at activation of the A- and B-key, respectively, is registered in the scan code decoder of the computer but does not affect the keyboard. In a preferred embodiment of the computer program according to said second aspect, visualizing means are also included, for visualizing, on a computer screen, a return location for characters whereby characters can be pulled from keys on the visualized keyboard by means of the mouse pointer and be placed in the return location. The computer program is thereby arranged to automatically, and preferably visually, put back the returned character to its location in the character table.

[0038] According to a third aspect, said computer program includes means for visualizing a character, wherein the possibility to edit the character is given. For the illustrated example in FIG. 4, where each character is represented by 16×16 pixels, such a pixel map is preferably visualized on the computer's 11 screen 12. The software subsequently enables marking of the pixels one wishes to activate, e.g. by means of the mouse pointer. When one has finished the editing, one clicks a OK-button presented by the computer program, at which the appearance for a new character is created. This character is then placed into the previously mentioned character table, in a location chosen by either the user or automatically by the computer program. In one embodiment the appearance data is also automatically downloaded to the keyboard for storage in memory 53. During construction or editing of a character, the possibility of selecting action is also given, according to what has been said above.

[0039] According to a fourth aspect, said computer program includes means for transfering picture data for an arbitrary picture to a file format that is adapted for presentation on the keys. Therefor, the computer program is arranged to split the information of a given picture into 16×16 pixels, and to visually present the transformed picture for the user on the computer screen. The transformed picture can then be edited according to the above-mentioned third aspect.

[0040] According to a preferred embodiment of the invention, the computer is communicatively connectable to a database in a communication network, e.g. the Internet. Further, the computer includes means for receiving and transmitting data from and to the above-mentioned database. By data is here meant both the separate appearance data for keys and the configuration data for the whole keyboard. The apparatus further comprises means for downloading configuration data and appearance data from said database, for the purpose of transmitting the downloaded data to the keyboard, where the data is stored in memories 53 and 54, respectively.

[0041] According to the invention, not only characters like letters and numbers can be selected, referring to the appearance and location. This could also be valid for keys that have other functions, like Shift, Alt and Return. Further, standard functions or actions, which on a keyboard are accessible only by means of combined key commands, can be configured on a specific key, at which only one keystroke is needed for the activation of the actual function or action. For example, a save button can be arranged and supplied with a suitable symbol.

[0042] According to a preferred embodiment of the invention, a key on a keyboard is arranged for browsing between the character configurations. The activation of this browse key firstly renders browsing of the visual indicators between different configurations, i.e. a change in the appearance of the keys on the keyboard, and secondly to a change in the computer's decoder, dependent on the changed appearance data, so that the scan codes are interpreted as the correct actions. The activation of this browse key consequently includes communication 62 between the keyboard and the computer. The functionality of the browse key makes it especially easy to reconfigure the key settings for the keyboard. This is especially advantageous when there is a limited number of keys, or at least fewer keys than the desired number of key functions. Consequently, the browse key can be arranged to be used as the Shift- or the Alt Gr-key. For example, in one embodiment, a keyboard could be arranged with a row of numeric keys at the top of the keyboard, as is normally the case, but where only the numbers are indicated on the keys' display in one mode. A single keystroke of the browse key will thereby replace the numbers with the alternative characters, corresponding to the combined activation of Shift and the respective key, i.e. the characters !, “, #. Additional activation of the browse key may render these alternative characters to be replaced with the next setting of alternative keys, which correspond to the combined activation of the Alt Gr key and the respective number key, i.e. @, £, etc. The result thereof is both that the keyboard can be made easier to interpret, since fewer characters are shown simultaneously on each keys, and also that all the keys on the keyboard can be arranged with one or more alternative keys that are clearly shown by browsing with the browse key. A particularly advantageous embodiment of the invention, arranged with the browse key, is where the apparatus is realized as a mobile phone 31. An ordinary mobile phone has a range of 12-15 keys 34, of which the number keys 0-9 are dominating. Text input, for example for an SMS message, can become both difficult and time consuming since the input of each character may demand up to four keystrokes. In a mobile phone according to the present invention, a plurality or all of the keys or buttons of the mobile phone are arranged with displays. During normal operation, when the number keys are mostly used, these keys are arranged to show the numbers only. During input of text, the browse key of the mobile phone is activated, rendering the displays on the number keys to show letters in stead. In one embodiment each key can assume the appearance of several different letters, whereby the text input progresses as normal. In another, and preferred, embodiment the number keys are reconfigured from showing 0-9 to show A-J at a first activation of the browse key. Additional activation of the browse key renders the keys to show the letters K-T, and so on. In accordance with what has been described for the embodiment wherein the apparatus is a computer, activation of the browse key naturally also renders the action taken upon the activation of corresponding key to changes when its appearance changes. In one embodiment the browse key is realized as two keys arranged to browse upwards and downwards, respectively, similar to what already is common for mobile phones for browsing in the menu system.

[0043] In another embodiment of the present invention, said control unit is arranged for controlling a number of different apparatuses. The control unit can e.g. be a central and portable control unit for controlling devices in so called intelligent homes. Thus, the control unit can be devised to be able to communicate with, e.g. the TV, the video recorder, the refrigerator, the answering machine etc. In a preferred embodiment the browse button is then used for quick and easy reconfiguration of the control unit to a key set that is adapted for an apparatus one wishes to control. Preferably, the control unit of this embodiment includes parts of what was included in the apparatus in the previously mentioned description of the embodiment with the computer and the keyboard, i.e. the computer itself. Thus, the embodiment with one control unit devised to control several different apparatuses is equipped with an interpreting unit, a decoder for scan codes or similar that are emitted upon a keystroke. The control unit is thereby devised to adapt outgoing control signals dependent on the character configuration, whereby browsing with the browse button between the different character configurations enables the communication with different apparatuses. With this arrangement, one push on the browse button can enable the control unit to show keys that are adapted for communication with the TV-set. Further browsing with the browse button causes, e.g. the character configuration on the control unit to assume the appearance of the suited symbols for communicating with a refrigerator in an intelligent home, for example the customer cart and different basic consumer goods.

[0044] Other advantages with the browsing functionality, when using a computer, is e.g. the capability to brows between mathematical or physical symbols, special writing or drawing characters, or to bring up a character configuration where different keys could show in a distinct visual manner a symbol for a computer program, at which the computer program could be activated by the activation of the respective keys. The functionality consequently enables a very simple execution of functions, which before demanded many keystrokes, alternatively combinations of several keys, or the use of a mouse. The invention is also usable to adapt control units in form of game consoles to game appliances like computer games or TV games. At that, different keys can be given different appearances reflecting different events, accessories etc. The invention also enables easy reconfiguration of the game consoles for different games or players.

[0045] Many examples of embodiments of the present invention have been described above, but many more imaginable applications and embodiments of the present invention are possible. The scope of the invention is only limited by the accompanying claims.