Electronic device, and methods of the electronic device for generating feedback related to an interaction with a touch input arrangement

[0001] The embodiments herein relate to an electronic device and methods for generating feedback related to an interaction with a touch input arrangement. A corresponding computer program and a computer program carrier are also disclosed.

[0002] Electronic devices tend to have buttons on the side or backside as the manufacturers want to maximize the display vs physical device area. When the buttons are on the side or at the back it is hard to know which button is which and it is also difficult to read a text next to the button if that would exist. The user may need to learn the position of the buttons.

[0003] If a physical button of the electronic device is not in direct line of sight, e.g., by being located on a headset being worn by the user, and if there are more than one button closely located on said headset, said user may need to use his or hers fingers to sense an area around the buttons to make sure the right button is being used. This may be cumbersome to the user and may result in the user interacting with a button which the user didn't intend to interact with. In the end the power consumption of the electronic device may be increased.

[0004] Furthermore, if a device is not used that often the user might forget about the functionality and placement of the physical buttons and need to relearn.

[0005] A solution may be to present buttons as an overlay on the display once one of the buttons has been pressed to guide and help the user to find the right button to press. However, this solution increases the power-consumption of the electronic device since the display needs to be turned on to be able to display the buttons. Further, the buttons need to be pressed for something to happen. Thus, interaction with the wrong button is likely to happen.

[0006] An object of embodiments herein may be to obviate some of the problems described above and related to handling of physical buttons on electronic devices, or at least reduce the impact of them.

[0007] According to an aspect, the object is achieved by a method, performed by an electronic device for generating feedback related to an interaction with a touch input arrangement. The electronic device comprises a display and the touch input arrangement is arranged outside a display area of the display. In response to a sensed proximity of an object relative to the touch input arrangement, the electronic device displays on the display, a graphical representation of the touch input arrangement and a position of the object relative to the touch input arrangement.

[0008] According to a further aspect, the object is achieved by an electronic device for generating feedback related to an interaction with a touch input arrangement. The electronic device comprises a display and the touch input arrangement is arranged outside a display area of the display. The electronic device is configured to display on the display, a graphical representation of the touch input arrangement and a position of the object relative to the touch input arrangement in response to a sensed proximity of an object relative to the touch input arrangement.

[0009] According to a further aspect, the object is achieved by a further method, performed by the electronic device, for generating feedback related to an interaction with a touch input arrangement. The electronic device comprises a display, a display driver, and a sub-display driver. The display comprises a display area, wherein the display area comprises a sub-display area which is smaller than the display area. The display driver is configured to control a respective one of one or more pixels of the display area including one or more pixels of the sub-display area. The sub-display driver is configured to control the respective one of the one or more pixels of the sub-display area. The touch input arrangement is arranged outside the display area of the display.

[0010] The display driver is configured to control the one or more pixels of the sub-display area to display information related to the touch input arrangement in response to a sensed proximity of an object relative to the touch input arrangement.

[0011] According to a further aspect, the object is achieved by an electronic device for generating feedback related to an interaction with a touch input arrangement. The electronic device comprises a display, a display driver, and a sub-display driver.

[0012] The display comprises a display area, wherein the display area comprises a sub-display area which is smaller than the display area.

[0013] The display driver is configured to control a respective one of one or more pixels of the display area including one or more pixels of the sub-display area. The sub-display driver is configured to control the respective one of the one or more pixels of the sub-display area. The touch input arrangement is arranged outside the display area of the display.

[0014] The electronic device is configured to, by means of the sub-display driver: control the one or more pixels of the sub-display area to display information related to the touch input arrangement in response to a sensed proximity of an object relative to the touch input arrangement.

[0015] According to a further aspect, the object is achieved by a computer program comprising instructions, which when executed by a processor, causes the processor to perform actions according to any of the aspects above.

[0016] According to a further aspect, the object is achieved by a carrier comprising the computer program of the aspect above, wherein the carrier is one of an electronic signal, an optical signal, an electromagnetic signal, a magnetic signal, an electric signal, a radio signal, a microwave signal, or a computer-readable storage medium.

[0017] Since the electronic device displays the graphical representation of the touch input arrangement and the position of the object relative to the touch input arrangement in response to the sensed proximity of the object an improved feedback from the user interface is achieved which improves the user interface guidance and prevents unnecessary user interface usage.

[0018] Since the sub-display driver of the electronic device controls the one or more pixels of the sub-display area to display information related to the touch input arrangement an improved feedback from the user interface is achieved which improves the user interface guidance and prevents unnecessary user interface usage while power consumption is reduced.

[0019] Further embodiments herein may reduce the power consumption even further.

[0031] Embodiments herein relate to electronic devices and their buttons in general. FIG. 1a depicts an electronic device 100 wherein embodiments herein may be implemented. The electronic device 100 may be or comprise any of a mobile phone, a tablet, a TV, a monitor, a headset, electronic eyewear, such as smart glasses, an alarm clock, a car, or a music player. Other examples of implementations of the electronic device 100 are a watch, such as a smart watch, and an augmented or virtual reality headset.

[0032] In FIG. 1a the electronic device 100 is illustrated with a mobile phone.

[0033] In some embodiments herein the electronic device 100 comprises a touch input arrangement 102a-d, such as one or more physical buttons and/or a touch panel.

[0034] The electronic device 100 comprises a display 104, e.g., arranged on a first surface 106a of the electronic device 100, such as a front side of the electronic device 100 in FIG. 1. The display 104 may comprise a touch panel not shown in FIG. 1a. The display may also be referred to as the screen.

[0035] In FIG. 1a a display area 104a of the display 104 is illustrated. The display area 104a may take up a large part, or even all, of the first surface 106a and therefore it may be disadvantageous to arrange buttons on the first surface 106a. In embodiments herein the touch input arrangement 102a-d is arranged outside the display area 104a of the display 104.

[0036] In some embodiments herein the touch input arrangement 102a-d may be more or less visually obstructed, e.g., arranged on a surface of the electronic device 100 which usually is not visible when operating the electronic device 100. Thus, the touch input arrangement 102a-d may be arranged on the electronic device 100 such that it is not visible when the display 104 is viewed. As an example, in FIG. 1a a first touch input arrangement 102a, a second touch input arrangement 102b and a third touch input arrangement 102c are arranged on a second surface 106b, such as on a backside, of the electronic device 100. The second surface 106b differs from the first surface 106a. The second surface 106b may face away from the first surface 106a. The second surface 106b may face an opposite direction compared to the first surface 106a.

[0037] In other embodiments a fourth touch input arrangement 102d is arranged on the electronic device 100 such that not the entire fourth touch input arrangement 102d is visible, e.g, when viewing the front side. The fourth touch input arrangement 102d may, e.g., be arranged on a side surface of the electronic device 100.

[0038] In some embodiments herein the touch input arrangements 102a-d are arranged on a same surface as the display but outside the display area 104a of the display 104. For example, the touch input arrangements 102a-d and the display 104 may form a smooth surface and the touch input arrangements 102a-d may not be visible. Thus, the second surface 106b may be a surface next to the display surface.

[0039] FIG. 1a further illustrates an object 107 interacting with the electronic device 100, more specifically with the first touch input arrangement 102a. The object 107 may be a part of a user, such as a finger, or part of a finger.

[0040] As mentioned above, if a touch input arrangement 102a-d of the electronic device 100 is not in direct line of sight, e.g., by being located on a headset being worn by a user, and if there are more than one button closely located, said user may need to use his or hers fingers to sense an area around the buttons to make sure the right button is being used. This may be cumbersome to the user and may result in the user interacting with a button which the user didn't intend to interact with. In the end the power consumption of the electronic device may be increased.

[0041] Embodiments herein seek to reduce at least some of the problems described above and are directed to a low-power user interface.

[0042] Some embodiments herein solve the above-described problems by displaying a graphical representation 108a-b of the touch input arrangement 102a-d and a position of the object 107 relative to the touch input arrangement 102a-d in response to a sensed proximity of the object 107 relative to the touch input arrangement 102a-d.

[0043] The above embodiments increase the chances of finding a specific touch input arrangement 102a-d, such as a specific button.

[0044] Furthermore, the above embodiments may also remove a need to press a button in order to activate the button and get an indication of what the button is used for since an indication of what the button is used for may be displayed when the object 107, such as the finger of the user, touches or is in proximity of the button.

[0045] Further, the electronic device 100 may activate the touch input arrangement 102a-d in response to sensing proximity of the object 107. Activating the touch input arrangement 102a-d may comprise initiating an operation or a function associated with the touch input arrangement 102a-d.

[0046] In some further embodiments the display area 104a comprises a sub-display area 104b which is smaller than the display area 104a. Then the electronic device 100 may solve some of the above problems by separately controlling the sub-display area 104b to display information related to the touch input arrangement 102a-d. This may be implemented by including two display drivers in the electronic device 100. A hardware display driver may control incoming data from a host device, such as the electronic device 100, and may keep control of what pre-processing of data that is going to be done and it may also set a drive voltage or drive current for each pixel at each frame.

[0047] FIG. 1b illustrates a system block diagram of the electronic device 100 comprising two display drivers. Thus, in these embodiments the electronic device 100 comprises a display driver 112 configured to control a respective one of one or more pixels of the display area 104a including one or more pixels of the sub-display area 104b. In these embodiments the electronic device 100 further comprises a sub-display driver 114 configured to control a respective one of the one or more pixels of the sub-display area 104b.

[0048] The display driver 112 may control what value is going to be put on each pixel or even on each subpixel on the display 104. For an OLED there is an offset power consumption depending on the size of the display 104 and a linear part depending on how many pixels that are turned on and at what light level.

[0049] The sub-display driver 114 controls only a part of the full display 104, such as the sub-display area 104b which may be activated in a low power state, to be able to reduce the power consumption of the electronic device 100 e.g., when the electronic device 100 is in standby.

[0050] The sub-display driver 114 may be integrated with the display driver 112 or a separate integrated circuit. The pixels of the sub-display area 104b that are controlled by both the display driver 112 and the sub-display driver 114 may need to be connected to each display driver.

[0051] The sub-display part may have its own memory, such as a read only memory (ROM). In this sub-display memory graphics and information related to the touch input arrangement 102a-d, such as text and a menu tree may be stored. Thus, the electronic device 100 may comprise a memory 116 comprising the information related to the touch input arrangement 102a-d and configured for use only for the sub-display area 104b. The memory 116 may also be part of a bigger memory. Then before the display 104 is shut down the sub-display memory parts may be added. If a host display device is operable with different button devices, then different menus that may be activated for the different button devices may need to be stored.

[0052] The detection of touch or proximity may be implemented, at least partly, with a touch integrated circuit (IC) 118 which may be a low power solution. For example, a proximity detection algorithm running in the touch IC 118 may go down to tens of micro watts in power consumption. Therefore, the touch IC 118 may be running continuously. Thus, in some embodiments herein the touch IC 118 may be always on. The touch IC 118 may also be referred to as a touch panel IC. The electronic device 100 may comprise the touch IC 118.

[0053] In some embodiments the memory 116 is integrated in the touch IC 118 or in close proximity to the touch IC 118, e.g., for low power usage. By having a separate sub-display memory no other part of the display system needs to be turned on when the sub-display part is active. Depending on the content, the memory 116 may need to have different size.

[0054] These embodiments enable visibility of the touch input arrangements 102a-d, such as buttons, even when the display 104 is in standby mode. Some embodiments include a zero-force activation feature make it easier for the user. For example, the same button may have multiple functions: zero-force activation may change position in a menu and pressing a mechanical switch may activate a function in the menu.

[0055] An advantage of the sub-display driver 114 and the memory 116 is that other parts of the electronic device 100 do need to be turned on.

[0056] These embodiments also provide a hardware solution where the display 104 may be partially turned on, and be ready to provide information about different buttons.

[0057] An advantage is that the electronic device 100 enables a user to find the touch input arrangements 102a-d even though the display 104 is in standby. This is also a good way of changing settings without having to turn on the entire display 104 or the host device or host system, such as the electronic device 100.

[0058] The display 104 may be of different technologies such as Organic LED (OLED), LCD, MicroLED or other display technologies. It can be noted that OLED, MicroLED and other emissive display technologies may have an advantage as they only need to activate a small part 104b of the display 104 that is going to be active. Transflective and reflective type of displays also provide this advantage but they are not commonly used today.

[0059] Transmissive displays, such as Liquid Crystal Displays (LCD), are displays that need a separate backlight unit to be able to show any information. For transmissive displays the backlight commonly needs to be turned on even when a small part 104b of the display 104 is activated. Transmissive displays are the main technology used today in TVs, monitors, smartphones etc. The trend is pointing towards that transmissive displays will be replaced by OLED displays in the future.

[0060] For the ease of explanation, embodiments herein may be exemplified with an OLED display.

[0061] In some embodiments herein the display 104 is arranged on a separate display device such as a smartphone, tablet, or smart watch. An advantage of this is that the device comprising the input arrangement 102a-d does not need to have a display or does not need to turn on its display.

[0062] FIG. 2 depicts a first electronic device 200a, such as a display device and a second electronic device 200b, such as a button device, wherein embodiments herein may be implemented. The first electronic device 200a may be a mobile phone and the second electronic device 200b may be an associated headset.

[0063] In some embodiments herein the second electronic device 200b comprises one or more touch input arrangements 202a-c, such as one or more physical buttons and/or a touch panel.

[0064] The first electronic device 200a comprises the display 104 comprising the display area 104a which in turn may comprise the sub-display area 104b which is smaller than the display area 104a.

[0065] FIG. 2 further illustrates a system block diagram of the first electronic device 200a and the second electronic device 200b.

[0066] The second electronic device 200b may comprise a touch IC 218 which may, by some second communications means 220b in the second electronic device 200b and some first communications means 220a in the first electronic device 200a, trigger the display driver 112 or the sub-display driver 114 of the first electronic device 200a to display information related to the touch input arrangements 202a-c. The first electronic device 200a may further comprise the memory 116.

[0067] The memory 116 may be writeable for the display driver 112 and/or the sub-display driver 114 so that an application in the display device 200a may write appropriate data in the memory 116 as this will vary depending on what button device 200b that is connected to the display device 200a.

[0068] The communication between the button device 200b and the display device 200a may be radio based and could use various different interface protocols such as Bluetooth, Zigbee, Z-wave, Wi-Fi, and cellular to mention a few. The devices may be paired, and the button device may have privileges to wake up the display device.

[0069] FIG. 3 depicts details of the touch input arrangement 102a-d of the electronic device 100, 200 according to some embodiments herein.

[0070] In FIG. 3 the touch input arrangement comprises a button 300. The button 300 may comprise a mechanical switch actuator 301. The mechanical switch actuator 301 may be used for triggering a function related to the button 300.

[0071] The mechanical switch actuator 301 may comprise a collapsible mechanical structure. For example, the mechanical switch actuator 301 may comprise a dome switch actuator. Such mechanical switches provides both tactile feedback and function activation/triggering in a single button. For example, the mechanical switch actuator 301 may provide push haptic sensation and function activation. The activation of the function is triggered by a collapse of the mechanical switch actuator 301 due to a physical press, e.g., by the user.

[0072] The touch input arrangement 102a-d may further comprise a proximity sensor 302 for sensing proximity of the object 107, 307 interacting with the touch input arrangement 102a-d, 202a-c. The proximity sensor 302 may be configured to sense proximity of the object 107, 307 relative to the touch input arrangement 102a-d, 202a-c. The proximity sensor 302 may be connected to the touch IC 118. The touch IC 118 may control the proximity sensor 302. The touch IC 118 may further convert output from the proximity sensor 302 into signals that can be used by other parts of the electronic device 100, such as the sub-display driver 114.

[0073] In some embodiments herein the touch input arrangement 102a-c, 202a-c and the proximity sensor 302 configured to sense proximity of the object 107, 307 relative to the touch input arrangement 102a-c are comprised in the second electronic device 200b.

[0074] The proximity sensor 302 may be an electromagnetic sensor such as a capacitive sensor. For example, the button 300 may comprise the proximity sensor 302.

[0075] In some embodiments, the mechanical switch actuator 301 may be integrated with a capacitive switch overlay. The button 300 may alternatively be a capacitive button with no physical feedback. Thus, the touch input arrangement 102a-d, 202a-c may comprise a capacitive sensor 302 configured to sense proximity of the object 303 relative to the touch input arrangement 102a-d, 202a-c.

[0076] The proximity sensor 302 allows to sense when the object 303 is touching or nearby the button 300. The proximity sensor 302 may be activated with zero-force touch. A zero-force touch sensor is able to register a touch without pressure and convert that touch into an electrical output that initiates an operation or a function. Thus, activating the proximity sensor 302 may comprise initiating the operation or the function.

[0077] In some further embodiments herein the button 300 comprises a layered structure and the proximity sensor 302 is comprised in a second layer while a first layer comprises the mechanical switch actuator 301. The second layer may be arranged on top of the first layer with respect to a surface 310 of the electronic device 100.

[0078] In some further embodiments herein the proximity sensor 302 is at least partly not covered by a conductive material. For example, a capacitive sensing region of the capacitive sensor may not be covered fully by a conductive material. Thus, in some embodiments herein the proximity sensor 302 is at least partly not covered by a conductive material on a sensing side of the proximity sensor 302.

[0079] Exemplifying embodiments herein will now be described with reference to FIG. 4a and with further reference to FIGS. 1, 2 and 3. In these embodiments the display area 104a does not necessarily comprise the sub-display area 104b and the electronic device 100 does not necessarily comprise the sub-display driver 114.

[0080] FIG. 4a illustrates a flowchart describing a method, performed by the electronic device 100, for generating feedback related to the interaction with the touch input arrangement 102a-d.

[0081] One or more of the following actions presented in FIG. 4a may be performed in the following exemplifying order. In other examples, the order may differ from what is described below.

Action 400

[0082] In some embodiments, wherein the electronic device 100 comprises the proximity sensor 302, the electronic device 100 senses proximity of the object 107, 307 relative to the touch input arrangement 102a-d with the proximity sensor 302. The electronic device 100 may sense proximity of the object 107, 307 in order to display information related to the touch input arrangement 102a-d before the touch input arrangement 102a-d is interacted with, or at least before the touch input arrangement 102a-d activates a function of the electronic device 100.

[0083] For example, when the object 107, 307, such as a finger, is approaching the proximity of the touch input arrangement 102a-d, such as buttons on the backside of the electronic device 100, the touch IC 118 may notice the conductive material and trigger the display 104 to display the information. Triggering the display 104 may comprise triggering the sub-display driver 114 of the electronic device 100.

Action 401

[0084] In response to a sensed proximity of the object 107 relative to the touch input arrangement 102a-d, the electronic device 100 displays on the display 104 a graphical representation 108a-b of the touch input arrangement 102a-d and a position of the object 107 relative to the touch input arrangement 102a-d.

[0085] In some embodiments herein the touch input arrangement 102a-d comprises multiple touch input arrangements 102a-d. If proximity is sensed for the first touch input arrangement 102a then the electronic device 100 may display a graphical representation 108a-b of a first touch input arrangement 102a out of the multiple touch input arrangements 102a-d and the position of the object 107 relative to the first touch input arrangement 102a.

[0086] In other words, displaying the graphical representation 108a-b of the touch input arrangement 102a-d and the position of the object 103 relative to the touch input arrangement 102a-d may comprise displaying the graphical representation 108a-b of the first touch input arrangement 102a out of the multiple touch input arrangements 102a-d and the position of the object 107 relative to the first touch input arrangement 102a, for which first touch input arrangement 102a proximity is sensed.

[0087] Exemplifying embodiments herein will now be described with reference to FIG. 4b and with further reference to FIGS. 1, 2 and 3. FIG. 4b illustrates a further flowchart describing a further method, performed by the electronic device 100, for generating feedback related to the interaction with the touch input arrangement 102a-d.

[0088] In these embodiments the display area 104a comprises the sub-display area 104b and the electronic device 100 comprises both the display driver 112 and the sub-display driver 114. As mentioned above, the touch input arrangement 102a-d is arranged outside the display area 104a of the display 104.

[0089] One or more of the following actions presented in FIG. 4b may be performed in the following exemplifying order. In other examples, the order may differ from what is described below. The actions of FIG. 4b may also be combined with the actions of FIG. 4a.

Action 409

[0090] When the electronic device 100 comprises the touch input arrangement 102a-d and the proximity sensor 302, the electronic device 100 may further sense proximity of the object 107, 307 relative to the touch input arrangement 102a-d with the proximity sensor 302. As mentioned above, the proximity sensor 302 may be comprised in the touch input arrangement 102a-d, 303.

Action 410a

[0091] In some embodiments herein the electronic device 100 activates the sub-display area 104b in response to the sensed proximity of the object 107 relative to the touch input arrangement 102a-d.

Action 410b

[0092] The electronic device 100 may also activate the touch input arrangement 102a-d in response to the sensed proximity of the object 107 relative to the touch input arrangement 102a-d.

Action 411

[0093] The sub-display driver 114 controls the one or more pixels of the sub-display area 104b to display information related to the touch input arrangement 102a-d in response to a sensed proximity of the object 107 relative to the touch input arrangement 102a-d.

[0094] In some embodiments herein the sub-display driver 114 controls the one or more pixels of the sub-display area 104b to display information related to the touch input arrangement 102a-d while the display driver 112 is off.

[0095] In other words, the sub-display driver 114 controls the one or more pixels of the sub-display area 104b to display information related to the touch input arrangement 102a-d while the display driver 112 controls pixels in parts of the display 104 outside the sub-display area 104b to be off. That is, the sub-display driver 114 may be active while the display driver 112 is inactive. Since the display driver 112 is off the rest of the display 104 outside the sub-display area 104b will also be off.

[0096] As mentioned above when describing the method of FIG. 4a, the information related to the touch input arrangement 102a-d may comprises the graphical representation 108a-b of the touch input arrangement 102a-d and the position of the object 107 relative to the touch input arrangement 102a-d.

[0097] When the touch input arrangement 102a-d comprises multiple touch input arrangements 102a-d, then the information related to the touch input arrangement 102a-d may comprise information related to a first touch input arrangement 102a out of the multiple touch input arrangements 102a-d for which first touch input arrangement 102a proximity is sensed.

Action 415

[0098] In some embodiments herein the electronic device 100 de-activates the sub-display and/or the touch input arrangement 102a-d in response to a sensed removal of the object 107 from the proximity of the touch input arrangement 102a-d.

[0099] Exemplifying embodiments herein will now be described with reference to FIG. 5a and with further reference to FIGS. 1, 2 and 3. FIG. 5a illustrates a further flowchart describing a further method, performed by the electronic device 100, for generating feedback related to the interaction with the touch input arrangement 102a-d.

[0100] One or more of the following actions presented in FIG. 5a may be performed in the following exemplifying order. In other examples, the order may differ from what is described below.

Action 501

[0101] In some embodiments herein, when the object 107, 307, such as a finger, is approaching the proximity of the touch input arrangement 102a-d, such as buttons on the backside of the electronic device 100, the touch IC 118 may notice the conductive material and trigger the display to display the information. Triggering the display 104 may comprise triggering the sub-display driver 114 of the electronic device 100.

[0102] The four touch input arrangements 102a-d of FIG. 1a may be displayed with different text or graphics.

[0103] If the displayed picture is just in front of the touch input arrangements 102a-d, then it is easy to understand where the touch input arrangement 102a-d are located and which touch input arrangement 102a-d is which. If not, a position of the finger may be shown in relation to the layout of the touch input arrangements 102a-d shown. In an alternative embodiment, only the touch input arrangement 102a-d being touched or close to the finger is shown on the display with its name or an explanation of which function it is associated with, in case it is not obvious from the name.

[0104] In some other embodiments herein the proximity sensing can be done by radar technology.

[0105] In yet another embodiment, the radar technology is also available in the electronic device 100 for gesture recognition. Then proximity detection or touch may activate the sub-display driver 114 to display in a very energy-efficient way input gestures that are available or enabled, and as the user makes the gestures the electronic device 100 may provide feedback on whether those are recognized or not. This may be relevant also when the first electronic device 100a comprising the display 104 is paired and with the second electronic device 200b comprising the touch input arrangement 102a-d, such as the headset comprising buttons for volume control.

Action 502

[0106] The electronic device 100 checks whether or not the display 104 is on.

Action 503a

[0107] If the display 104 is turned off the sub-display driver 114 may light only a small part of the display 104 which may show the touch input arrangement 102a-d for which proximity of the object 107, 307 is sensed, e.g., that the user would like to use. The small part of the display 104, such as the sub-display area 104b, may be connected to the touch input arrangement 102a-d.

Action 503b

[0108] If the display 104 is turned on when the object 107, 307 is in proximity of the touch input arrangement 102a-d then the touch input arrangement 102a-d may be displayed on a sub-display, e.g., corresponding to the sub-display area 104b, as an overlay on the existing content on the display 104.

Action 504

[0109] Once the sub-display part of the display 104 is active the touch input arrangement 102a-d may be pressed or tapped depending what solution that has been selected, e.g., a pure capacitive touch solution or a dome switch solution.

Action 505

[0110] Once the touch input arrangement 102a-d is pressed and/or tapped a command may be executed and the electronic device 100 will behave accordingly. If necessary, a menu may be updated with text and graphics from the memory 116. The electronic device 100 may go back to a mode in which it senses whether or not the touch input arrangement 102a-d has been touched and/or pressed (e.g. a button listening mode), and wait for a next command.

Action 506

[0111] The electronic device 100 may then check whether or not the object 107, 307 is removed from the proximity of the touch input arrangement 102a-d.

Action 507

[0112] Once the object 107, 307 is removed from the proximity of the touch input arrangement 102a-d the sub-display driver 114 may turn off the sub-display part 104b and put the touch IC 118 back in a low power mode. In the low power mode the touch IC 118 may have different sensor settings than in an activated mode, such as after the touch IC has been activated by the sensed proximity. Such sensor settings may comprise frequency of scans, signal strength and signal threshold.

[0113] Exemplifying embodiments herein will now be described with reference to FIG. 5b and with further reference to FIGS. 1a, 1b, 2 and 3. FIG. 5b illustrates a further flowchart describing a method, performed by the first electronic device 200a and the second electronic device 200b, for generating feedback related to the interaction with the touch input arrangement 102a-d comprised in the second electronic device 200b. The second electronic device 202b has been described above in relation to FIG. 2. As mentioned above, the first electronic device 202a comprises the display 104 and may also be referred to as the display device, while the second electronic device 200b may be referred to as the button device.

[0114] One or more of the following actions presented in FIG. 5b may be performed in the following exemplifying order. In other examples, the order may differ from what is described below.

Action 511

[0115] In some embodiments herein, the touch object 107, 307 is within distance of a touch input arrangement 202a-c of the second electronic device 200b, e.g., within a distance of a button on the button device.

Action 512

[0116] The touch IC 218 of the second electronic device 200b may notice the touch object 307, such as a finger, e.g., by sensing a conductive material of the touch object 307, and trigger the display 104 of the first electronic device 200a to display information related to the touch input arrangement 202a-c of the second electronic device 200b. Triggering the display 104 may comprise triggering a signal from the button device 200b to the display device 200a to start the display 104 of the display device 200a.

Action 513

[0117] The first electronic device 200a checks whether or not the display 104 is on.

Action 514a

[0118] Either the first electronic device 200a has the feature with a subpart of the display 104 being activated or all of the display 104 may be turned on.

[0119] If the display 104 is turned off the sub-display driver 114 may light only a small part of the display 104 that is connected to the touch input arrangement 102a-d for which proximity of the object 107, 307 is sensed, e.g., that the user would like to use.

Action 514b

[0120] If the display 104 is turned on when the object 107, 307 is in proximity of the touch input arrangement 102a-d then the touch input arrangement 102a-d may be displayed on a sub-display, e.g., corresponding to the sub-display area 104b, as an overlay on the existing content on the display 104. The first electronic device 200a may also show a position of the object 107, 307 in relation to the position of the touch input arrangement 102a-d. The position of the object 107, 307 may continuously be transferred from the button device 200b to the first electronic device 200a. If the display 104 only displays information related to the touch input arrangement 102a-d being close to the object 107, 307 or being touched by the object 107, 307, then it is not needed to show the position of the object 107, 307 specifically.

Action 515

[0121] Once the sub-display part of the display 104 is active the touch input arrangement 102a-d may be pressed or tapped depending what solution that has been selected, e.g., a pure capacitive touch solution or a dome switch solution.

Action 516

[0122] Once the touch input arrangement 102a-d is pressed and/or tapped a command may be executed and the electronic device 100 will behave accordingly. If necessary, a menu may be updated with text and graphics from the memory 116. The electronic device 100 may go back to a mode in which it senses whether or not the touch input arrangement 102a-d has been touched and/or pressed (e.g. a button listening mode), and wait for a next command.

Action 517

[0123] The second electronic device 200b may then check whether or not the object 107, 307 is removed from the proximity of the touch input arrangement 102a-d.

Action 518

[0124] Once the interaction with the touch input arrangement 102a-d is done a communication channel may be shut down between the button device 200b and the display device 200a and then the display device 200a may go into sleep mode. Thus, once the object 107, 307 is removed from the proximity of the touch input arrangement 102a-d the sub-display driver 114 may turn off the sub-display part 104b and put the touch IC 118, 218 back in a low power mode.

[0125] In another embodiment the display device may also receive the touch input. For example, the object 107, 307 activates the buttons on the button device which triggers an establishment of a connection with the display device. Then the button device menu may be shown on the display device. As long as the display device displays the buttons of the button device all further interactions with the display device and/or the button device are done through the display device, e.g. by interacting with a touch panel integrated with the display.

[0126] FIG. 6 illustrates a schematic block diagram of embodiments of the electronic device 100.

[0127] The electronic device 100 may comprise a processing module 601 for performing the above method actions. The processing module 601 may comprise a display driver module 610 to, e.g., display content on the display 104 and/or control pixels of the display area 104a. The processing module 601 may comprise a sub-display driver module 620 to, e.g., display on the sub-display area 104b and/or control pixels of the sub-display area 104b. The processing module 601 may further comprise a controlling module 630 to, e.g. control pixels of the sub-display area 104b. The processing module 601 may comprise a sensing module 640 to, e.g. sense proximity of the object 107. The processing module 601 may comprise an activating module 650 to e.g. activate the sub-display area 104b, or to activate the touch-input arrangement 102a-d. The processing module 601 may comprise a de-activating module 660 to, e.g. de-activate the sub-display area 104b.

[0128] In some embodiments, e.g., to perform the actions 400-401 above, the electronic device 100 is configured to, e.g. by means of the display driver module 610, in response to a sensed proximity of an object 107 relative to the touch input arrangement 102a-d, display on the display 104 a graphical representation 108a-b of the touch input arrangement 102a-d and a position of the object 107 relative to the touch input arrangement 102a-d.

[0129] The electronic device 100 may further be configured to, e.g., by means of the sensing module 640, sense proximity of the object 107, 307 relative to the touch input arrangement 102a-d, 300 with a proximity sensor 302.

[0130] In some of these embodiments, the display 104 is arranged on a first surface 106a of the electronic device 100 and the touch input arrangement 102a-d is arranged on a second surface 106b of the electronic device 100 which second surface 100 differs from the first surface 106a.

[0131] In some of these embodiments, wherein the touch input arrangement 102a-d is arranged on the electronic device 100 such that it is not visible when the display 104 is viewed.

[0132] In some of these embodiments, the touch input arrangement 102a-d, and a proximity sensor 302 configured to sense proximity of the object 303 relative to the touch input arrangement 102a-d are arranged to be comprised in a second electronic device 200.

[0133] In some of these embodiments, the touch input arrangement 102a-d is adapted to comprise a capacitive sensor 302 configured to, e.g. by means of the sensing module 640, sense proximity of the object 303 relative to the touch input arrangement 102a-d.

[0134] In some of these embodiments, the touch input arrangement 102a-d is adapted to comprise a button 300.

[0135] In some of these embodiments, the touch input arrangement 102a-d is adapted to comprise multiple touch input arrangements 102a-d, and wherein the electronic device 100 is configured to, e.g. by means of the display driver module 610, display the graphical representation 108a-b of the touch input arrangement 102a-d and the position of the object 103 relative to the touch input arrangement 102a-d by displaying a graphical representation 108a-b of a first touch input arrangement 102a out of the multiple touch input arrangements 102a-d and the position of the object 107 relative to the first touch input arrangement 102a, for which first touch input arrangement 102a proximity is to be sensed.

[0136] In some other embodiments, e.g., to perform the method Actions 409-415 above, the electronic device 100 may be configured to generate feedback related to an interaction with a touch input arrangement 102a-d. The electronic device 100 comprises:

• • [0137] The display 104 comprising a display area 104a, wherein the display area 104a comprises a sub-display area 104b which is smaller than the display area 104a;
  • [0138] the display driver 112 configured to, e.g. by means of the controlling module 630, control a respective one of one or more pixels of the display area 104a including one or more pixels of the sub-display area 104b; and
  • [0139] the sub-display driver 114 configured to, e.g. by means of the controlling module 630, control the respective one of the one or more pixels of the sub-display area 104b. The touch input arrangement 102a-d is arranged outside the display area 104a of the display 104.

[0140] The electronic device 100 may further be configured to, e.g., by means of the sub-display driver 114 and/or the controlling module 630, control the one or more pixels of the sub-display area 104b to display information related to the touch input arrangement 102a-d in response to the sensed proximity of the object 107 relative to the touch input arrangement 102a-d.

[0141] The electronic device 100 may further be configured to, e.g., by means of the activating module 650 and/or the sub-display driver 114, activate the sub-display area 104b in response to the sensed proximity of the object 107 relative to the touch input arrangement 102a-d.

[0142] The electronic device 100 may further be configured to, e.g., by means of the activating module 650, activate the touch input arrangement 102a-d in response to the sensed proximity of the object 107 relative to the touch input arrangement 102a-d.

[0143] The electronic device 100 may further be configured to, e.g., by means of the de-activating module 660, de-activate the sub-display and/or the touch input arrangement 102a-d in response to a sensed removal of the object 107 from the proximity of the touch input arrangement 102a-d.

[0144] In some of these embodiments the electronic device 100 is adapted to comprise a memory 116, integrated or in close proximity of the touch input arrangement 102a-d, wherein the memory 116 is adapted to comprise the information related to the touch input arrangement 102a-d and configured for use only for the sub-display area 104b.

[0145] In some of these embodiments the touch input arrangement 102a-d is adapted to comprise a proximity sensor 302 configured to sense proximity of the object relative to the touch input arrangement 102a-d.

[0146] In some of these embodiments the electronic device 100 is adapted to comprise the touch input arrangement 102a-d and the proximity sensor 302, the electronic device 100 further being configured to, e.g., by means of the sensing module 640, sense proximity of the object relative to the touch input arrangement 102a-d with the proximity sensor 302.

[0147] In some of these embodiments the information related to the touch input arrangement 102a-d is adapted to comprise a graphical representation 108a-b of the touch input arrangement 102a-d and a position of the object 107 relative to the touch input arrangement 102a-d.

[0148] In some of these embodiments the display 104 is arranged on a first surface 106a of the electronic device 100 and the touch input arrangement 102a-d is arranged on a second surface 106b which differs from the first surface 106b.

[0149] In some of these embodiments the touch input arrangement 102a-d is arranged on the electronic device 100 such that it is not visible when the display 104 is viewed.

[0150] In some of these embodiments the touch input arrangement 102a-d is adapted to comprise a capacitive sensor 302.

[0151] In some of these embodiments the touch input arrangement 102a-d is adapted to comprise multiple touch input arrangements 102a-d, and wherein the information related to the touch input arrangement 102a-d comprises information related to a first touch input arrangement 102a out of the multiple touch input arrangements 102a-d for which first touch input arrangement 102a proximity is to be sensed.

[0152] In some of these embodiments the touch input arrangement 102a-d and a proximity sensor 302 configured to sense proximity of the object 107 relative to the touch input arrangement 102a-d are arranged to be comprised in a second electronic device 200b.

[0153] In some of these embodiments the touch input arrangement 102a-d is adapted to comprise a button 300.

[0154] In some of these embodiments the sub-display driver 114 is adapted to e.g., by means of the controlling module 630, control the one or more pixels of the sub-display area 104b to display information related to the touch input arrangement 102a-d while the display driver 112 is off.

[0155] In some of these embodiments the electronic device 100 is adapted to be any of a mobile phone, a tablet, a TV, a monitor, electronic eyewear, a headset, an alarm clock, a car, and a music player.

[0156] The embodiments herein may be implemented through a processing circuit 604, e.g. comprising one or more processors, in the electronic device 100 depicted in FIG. 6, together with computer program code, e.g. computer program 603, for performing the functions and actions of the embodiments herein. The program code mentioned above may also be provided as a computer program product, for instance in the form of a data carrier carrying computer program code for performing the embodiments herein when being loaded into the electronic device 100. One such carrier may be in the form of a CD ROM disc. It is however feasible with other data carriers such as a memory stick. The computer program code may furthermore be provided as pure program code on a server and downloaded to the electronic device 100.

[0157] The electronic device 100 may further comprise a memory 602 comprising one or more memory units. The memory 602 comprises instructions executable by the processing circuit in the electronic device 100. The memory 602 is arranged to be used to store e.g. information, indications, data, configurations, and applications to perform the methods herein when being executed in the electronic device 100.

[0158] In some embodiments, a computer program 603 comprises instructions, which when executed by the processing circuit 604, cause the processing circuit 604 of the electronic device 100 to perform any of the method actions above.

[0159] In some embodiments, a carrier 604 comprises the respective computer program 603, wherein the carrier 604 is one of an electronic signal, an optical signal, an electromagnetic signal, a magnetic signal, an electric signal, a radio signal, a microwave signal, or a computer-readable storage medium.

[0160] To perform the method actions above, the electronic device 100 may further comprise an Input and Output (I/O) unit 606. The I/O unit 606 may be part of a user interface and may comprise or be configured to communicate with e.g., the display 104, the touch input arrangement 102a-d and the proximity sensor 302.

[0161] Those skilled in the art will appreciate that the modules and/or units in the electronic device 100 described above may refer to a combination of analog and digital circuits, and/or one or more processors configured with software and/or firmware, e.g. stored in the electronic device 100, that when executed by, e.g., the processing circuit 601, above causes the electronic device to perform the method actions above. The processing circuit 601, as well as the other digital hardware, may be included in a single Application-Specific Integrated Circuitry (ASIC), or several processors and various digital hardware may be distributed among several separate components, whether individually packaged or assembled into a system-on-a-chip (SoC).

[0162] As used herein, the term “module” may refer to one or more functional modules, each of which may be implemented as one or more hardware modules and/or one or more software modules and/or a combined software/hardware module. In some examples, the module may represent a functional unit realized as software and/or hardware.

[0163] As used herein, the term “computer program carrier”, “program carrier”, or “carrier”, may refer to one of an electronic signal, an optical signal, a radio signal, and a computer readable medium. In some examples, the computer program carrier may exclude transitory, propagating signals, such as the electronic, optical and/or radio signal. Thus, in these examples, the computer program carrier may be a non-transitory carrier, such as a non-transitory computer readable medium.

[0164] As used herein, the term “processing module” may include one or more hardware modules, one or more software modules or a combination thereof. Any such module, be it a hardware, software or a combined hardware-software module, may be a connecting means, providing means, configuring means, responding means, disabling means or the like as disclosed herein. As an example, the expression “means” may be a module corresponding to the modules listed above in conjunction with the figures.

[0165] As used herein, the term “software module” may refer to a software application, a Dynamic Link Library (DLL), a software component, a software object, an object according to Component Object Model (COM), a software component, a software function, a software engine, an executable binary software file or the like.

[0166] The terms “processing module” or “processing circuit” may herein encompass a processing unit, comprising e.g. one or more processors, an Application Specific integrated Circuit (ASIC), a Field-Programmable Gate Array (FPGA) or the like. The processing circuit or the like may comprise one or more processor kernels.

[0167] As used herein, the expression “configured to/for” may mean that a processing circuit is configured to, such as adapted to or operative to, by means of software configuration and/or hardware configuration, perform one or more of the actions described herein.

[0168] As used herein, the term “action” may refer to an action, a step, an operation, a response, a reaction, an activity or the like. It shall be noted that an action herein may be split into two or more sub-actions as applicable. Moreover, also as applicable, it shall be noted that two or more of the actions described herein may be merged into a single action.

[0169] As used herein, the term “memory” may refer to a hard disk, a magnetic storage medium, a portable computer diskette or disc, flash memory, Random Access Memory (RAM) or the like. Furthermore, the term “memory” may refer to an internal register memory of a processor or the like.

[0170] As used herein, the term “computer readable medium” may be a Universal Serial Bus (USB) memory, a DVD-disc, a Blu-ray disc, a software module that is received as a stream of data, a Flash memory, a hard drive, a memory card, such as a MemoryStick, a Multimedia Card (MMC), Secure Digital (SD) card, etc. One or more of the aforementioned examples of computer readable medium may be provided as one or more computer program products.

[0171] As used herein, the term “computer readable code units” may be text of a computer program, parts of or an entire binary file representing a computer program in a compiled format or anything there between.

[0172] As used herein, the terms “number” and/or “value” may be any kind of number, such as binary, real, imaginary or rational number or the like. Moreover, “number” and/or “value” may be one or more characters, such as a letter or a string of letters. “Number” and/or “value” may also be represented by a string of bits, i.e. zeros and/or ones.

[0173] As used herein, the expression “in some embodiments” has been used to indicate that the features of the embodiment described may be combined with any other embodiment disclosed herein.

[0174] Even though embodiments of the various aspects have been described, many different alterations, modifications and the like thereof will become apparent for those skilled in the art. The described embodiments are therefore not intended to limit the scope of the present disclosure.