US 8,941,683 B2Grant
Transparent display interaction
Issue Date:2015-01-27
•19 Claims
•9 Drawing Sheets
Abstract
In embodiments of transparent display interaction, a portable device includes a handheld base movably coupled to a display device. The display device includes a display panel system that displays an image, and includes display surfaces through which the image is viewable. The image may appear as being projected into an environment behind the display device and viewable through the display surfaces of the display device. The display device is also configurable to open relative the handheld base to a position that the environment is viewable through the display device.
Metadata
Assignee
- Microsoft Corporation
Inventors
- Sung Ho Son
- Rod G. Fleck
- Jordan P. Evans
Application Information
Application Number:US 12/917,265
Filing Date:2010-11-01
Priority Date:2010-11-01
Art Unit:2613
Classifications
IPC:
G09G5/00G06F3/0487G06T19/00G06F1/16G06F3/01
Field of Search:
G06T 19/006
Patent Drawings (9 sheets)
Description
Background
[0001] Mobile phones and portable devices that display information when open or closed are typically implemented with two displays. For example, a mobile phone may have a larger, primary display for use when the device is open, and a smaller, secondary display on the back of the device to display the current time or a notification of an incoming call. The current flip, slide, or swivel type of phone devices allow a user to interact with all of the device functions when the primary display is open. However, many of the device functions may be limited or disabled when the primary display is closed over the device and/or when a smaller, secondary display is in use. Additionally, users typically want the smallest possible device to conveniently carry in a pocket or purse, but also want larger user interface surfaces for a primary display, keypad, and potentially a secondary display. Some tablet notebook computers and/or phones that have a single display may be used when in an open or closed position, but need relatively complex rotating hinges and hardware components to position the display screen for use while open or closed.
Summary
[0002] This summary is provided to introduce simplified concepts of transparent display interaction that are further described below in the Detailed Description. This summary is not intended to identify essential features of the claimed subject matter, nor is it intended for use in determining the scope of the claimed subject matter.
[0003] Transparent display interaction is described. In embodiments, a portable device includes a handheld base movably coupled to a display device. The display device includes a display panel system that displays an image, and further includes display surfaces through which the image is viewable. The image may appear as part of an environment that is viewable through the display device, or appear as being projected into the environment behind the display device and viewable through the display surfaces of the display device. The display device is also configurable to open relative the handheld base to a position that the environment is viewable through the display device.
[0004] In other embodiments, the environment that is viewable through the display device may include an object, and the displayed image appears as part of the object in the environment. The displayed image may be displayed as a wearable item that appears to be worn by a user who is viewable, at least in part, in the environment that is viewable through the display device. The environment that is viewable through the display device may include text, such as on a sign, a marquee, and/or a building, and a text image of the environment text is displayed magnified. Alternatively, the environment that is viewable through the display device may be a page of content when the display device is positioned over the page, and the displayed image includes text associated with the content on the page.
[0005] In other embodiments, the portable device can receive item information, location information, and/or navigation information from a data source. The environment that is viewable through the display device may include an item, and the displayed image includes the information that pertains to the item. Alternatively or in addition, the displayed image may include the location information that corresponds to a location in the environment, which is viewable through the display device. Alternatively or in addition, the displayed image may include the navigation information that appears to display as part of the environment, which is viewable through the display device.
Brief Description of the Drawings
[0006] Embodiments of transparent display interaction are described with reference to the following drawings. The same numbers are used throughout the drawings to reference like features and components:
[0007] FIG. 1 illustrates examples of a portable device and various embodiments of transparent display interaction.
[0008] FIG. 2 illustrates examples of a portable device and various embodiments of transparent display interaction.
[0009] FIG. 3 illustrates examples of a portable device and various embodiments of transparent display interaction.
[0010] FIG. 4 illustrates examples of a portable device and various embodiments of transparent display interaction.
[0011] FIG. 5 illustrates examples of a portable device and various embodiments of transparent display interaction.
[0012] FIG. 6 illustrates an example of a portable device and an embodiment of transparent display interaction.
[0013] FIG. 7 illustrates example method(s) of transparent display interaction in accordance with one or more embodiments.
[0014] FIG. 8 illustrates various components of an example device that can implement embodiments of transparent display interaction.
Detailed Description
[0015] Embodiments of transparent display interaction are described. A portable device, such as a mobile phone or computer device, includes a display device that can be controlled for transparent and non-transparent display. Optionally, the portable device can also include an additional display device integrated into a handheld base of the portable device. The display device can be movably coupled to the handheld base so that the display device can be positioned to open and close over the handheld base. For example, the display device may open like the display of a notebook computer, slide up like on a slider phone, or flip up like on a flip phone. The display device includes a front display surface and a back display surface, and the front and back display surfaces are viewable from opposite sides of the display device. The display device also includes various display panels and surfaces that are assembled between the front and back display surfaces, and different combinations of the display panels and surfaces may be utilized to implement a transparent display. As described herein, the transparency of a display device may be a percentage of transparency as measured with light detection equipment and/or as visually determined or perceived by a user when viewing through the display device.
[0016] Interactions with the portable device having the transparent display device may include displaying an image that appears as part of an environment, which is viewable through the display device. The displayed image can appear as being projected into the environment behind the display device. The environment that is viewable through the display device may also include an object, and the displayed image can appear as part of the object in the environment. The displayed image may be displayed as a wearable item that appears to be worn by a user who is viewable, at least in part, in the environment that is viewable through the display device. The environment that is viewable through the display device may include text, such as on a sign, marquee, and/or a building, and a text image of the environment text can be displayed magnified for easier reading.
[0017] In other interactions, the portable device can receive item information, location information, and/or navigation information from a data source. Alternatively or in addition, the portable device may include components that can be utilized for location and navigation determinations, such as a gyro, an accelerometer, and/or a rear-facing camera that can be used to adjust an overlay image onto the environment behind the display device. The environment that is viewable through the display device may include an item, such as a consumer product, and the information that pertains to the item can be displayed. The display device can also display the location information that corresponds to a location in the environment, which is viewable through the display device. Alternatively or in addition, the navigation information can appear to display as part of the environment that is viewable through the display device.
[0018] While features and concepts of the described systems and methods for transparent display interaction can be implemented in any number of different environments, systems, devices, and/or various configurations, embodiments of transparent display interaction are described in the context of the following example devices, systems, and configurations.
[0019] FIG. 1 illustrates examples 100 of a portable device 102 and various embodiments of transparent display assembly. The portable device includes a display device 104 and a handheld base 106 that may include a physical keyboard (shown at 108) or an additional display device 110 as an integrated component of the portable device. The additional display device may be utilized to display text, graphics, images, user interfaces, and/or a virtual keyboard, such as when an implementation of a portable device does not include a physical keyboard. In the examples, the display device 104 is movably coupled at 112 to the handheld base of the portable device, such as with a rotating hinge, slide track, flip mechanism, or other coupling device. The display device can open and close over the handheld base, such as when folded, slid, or flipped closed over the additional display device, folded around to the back of the handheld base, or any position in-between approximately zero degrees (0°) and three-hundred sixty degrees (360°) relative to the handheld base.
[0020] The display device 104 includes a display housing 114 that supports various display panels and surfaces that may be utilized to assemble the display device. In this example, the display device includes a front display surface 116 (also referred to as a first display surface), and includes a back display surface 118 (also referred to as a second display surface). The front display surface and the back display surface are viewable from opposite sides of the display device.
[0021] A displayed image 120 may be viewable through the front and back display surfaces, and as illustrated, the display device 104 is transparent. As described herein, the transparency of a display device may be a percentage of transparency as measured with light detection equipment and/or as visually determined or perceived by a user when viewing an environment as seen through the various display panels and surfaces of the display device.
[0022] In the illustrated examples, a hand may be viewable through the front and back display surfaces of the display device, such as when viewed through the front of the display device. An environment 122 behind the display device can also be viewable through the front and back display surfaces of the display device, and a displayed image may appear projected into the environment for an augmented view of reality. For example, a displayed image 124 of the dog may appear projected into the environment 122 that includes trees and a building behind the display device and viewable through the front and back display surfaces of the display device.
[0023] In addition to the front display surface 116 and the back display surface 118, the display device 104 includes a display panel system 126 that is located between the front and back display surfaces. The display panel system is implemented to display images that are then viewable through the front and/or back display surfaces of the display device. The display device may include a light source 128 that illuminates the display panel system for image display. The display device may also include a touch screen 130 that is located between the front and back display surfaces to sense a touch input to either of the front display surface or the back display surface. Alternatively, the display device may include a first touch screen located proximate the front display surface and a second touch screen located proximate the back display surface, and the touch screens sense touch inputs to the respective front and back display surfaces.
[0024] The display device 104 also includes a multi-mode panel 132 located between the front display surface 116 and the back display surface 118. In embodiments, the multi-mode panel is operable to switch on and off, such as to prevent an image from being viewable through the front display surface or the back display surface, or for transparency to permit the image being viewable through the front and back display surfaces. The multi-mode panel may be implemented to switch on and/or off the entire panel, sections of the panel, and/or individual pixels of the panel.
[0025] In these examples, the display device 104 includes a display panel controller 134 that is implemented to control display modes of the display device for transparent and non-transparent display. The display panel controller can be implemented as computer-executable instructions, such as a software component, and executed by one or more processors to implement various embodiments for a transparent display. In practice, the portable device 102 is implemented with a processor (e.g., a CPU), a graphics processor (e.g., a GPU), and an internal display controller to drive display content to the display device. In the display device 104, the display panel system 126 may include the display panel controller 134 that drives each pixel according to the type of display at various voltages.
[0026] In an embodiment, the display panel controller 134 is implemented to invert a viewable perspective of a displayed image when the image is viewable through the back display surface 118. For example, the displayed image 120 that is viewable through the front display surface 116 would appear as a mirror image when viewed through the back display surface if not inverted, or flipped, by the display panel controller so that the displayed image appears in the same perspective when viewed through either of the front or back display surfaces. The display panel controller can be implemented to invert the pixels in each row of a display to reverse an image.
[0027] In various configurations, such as when the display device 104 is positioned open relative to the handheld base 106 of the portable device (e.g., as illustrated in the examples), the display panel controller 134 can activate the display device to prevent a displayed image from being viewable through the front display surface 116 or the back display surface 118. Alternatively, the display panel controller can activate the display device for transparency to permit the displayed image being viewable through the front and back display surfaces. Similarly, the display panel controller can activate the display device for a transparent view of the environment 122, which is viewable through the display device. For example, the display panel controller can control and switch on the multi-mode panel 132 of the display device to prevent a displayed image from being viewable through the back display surface, or switch off the multi-mode panel for transparency to permit the displayed image being viewable through the back display surface.
[0028] The portable device 102 may be configured as any type of client or user device that includes wired and/or wireless devices, and may be implemented as a consumer, computer (e.g., a laptop or tablet device), portable, communication, phone (e.g., a dual-display phone), appliance, gaming, media playback, and/or electronic device. The portable device can be implemented with one or more processors, data communication components, memory components, navigation components, data processing and control circuits, and a display system. Further, any of the portable devices described herein can be implemented with any number and combination of differing components as further described with reference to the example device shown in FIG. 8 .
[0029] FIG. 2 illustrates examples 200 of the portable device 102 described above with reference to FIG. 1 , and various embodiments of transparent display configuration modes. In the examples 200, an image 202 of a wine bottle and glass are displayed on the display device 104, and an image 204 of wine barrels are displayed on the additional display device 110 that is integrated into the handheld base 106 of the portable device 102. The display device 104 may then be positioned closed over the handheld base 106 and both the image of the wine bottle and glass, and the image of the wine barrels, are viewable through the back display surface 118 of the display device. In the illustrated example at 206, the wine bottle and glass appear to be located on one of the wine barrels when viewed through the display surfaces of the display device.
[0030] The display panel controller 134, as described with reference to FIG. 1 , can be implemented to activate the display device 104 for transparency when the display device is positioned closed over the handheld base 106 to permit the images being viewable through the display device. The display panel controller may also be implemented to invert and/or rotate the displayed images as the orientation and/or configuration of the portable device changes, such as from portrait to landscape mode and vice-versa. The display panel controller can invert and/or rotate a displayed image before, during, and/or after the display device is positioned closed over the handheld base. For example, when the display device is positioned closed over the handheld base at 208, and before the image 202 of the wine bottle and glass is inverted, the reverse of the image is viewable through the back display surface 118 (note that the image 204 of the wine barrels would also be viewable at 208, but are omitted simply for discussion of the inverted image 202). When the image of the wine bottle and glass is then inverted at 206, the image is viewable in the same perspective (e.g., the wine glass is to the left of the wine bottle) as when viewed through the front display surface 116 when the display device is positioned open relative to the handheld base of the portable device.
[0031] In embodiments, a depth-of-field indicated at 210 between the image 202 that is viewable through the back display surface 118 over the additional image 204 displayed on the additional display device 110 appears as a pseudo 3-D display. The depth-of-field creates a visual 3-D effect that can be utilized to enhance a user experience for photos, images, graphics, motion video, and/or user interfaces, such as for multi-tasking and application management. This display configuration provides a wide viewing angle and, as an added benefit, a pseudo 3-D display of images does not involve special 3-D glasses for viewing, which limits viewer eyestrain because a viewer is looking at two separate displays, rather than one display with two separate images displayed on the one display.
[0032] FIG. 3 illustrates examples of the portable device 102 described above with reference to FIG. 1 , and various embodiments of transparent display interaction. In a first example 300, an image 302 of a watch is displayed on the display device 104, and a user of the portable device can move a hand and wrist at 304 to a position behind the display device to virtually try-on the watch. The displayed image of the watch is a wearable item that appears to be worn by a user who is viewable, at least in part, in an environment 306 that is viewable through the display device.
[0033] In another example 308, the display panel controller 134 (as described with reference to FIG. 1 ) is implemented to move an image 310 that is displayed on the additional display device 110 for display on the display device 104 responsive to a user input 312, and the displayed image appears as part of an environment 314 that is viewable through the display device. The display panel controller is also implemented to control the display positions of images for display with reference to objects in environments that are viewable through the display device.
[0034] FIG. 4 illustrates examples of the portable device 102 described above with reference to FIG. 1 , and various embodiments of transparent display interaction. In a first example 400, an environment 402 that is viewable through the display device 104 includes text 404, such as text on a sign, marquee, and/or a building. The display panel controller 134 (as described with reference to FIG. 1 ) can be implemented to generate a text image 406 that displays the environment text magnified on the display device for viewing and/or easier reading.
[0035] In other embodiments, the portable device 102 includes a data interface and can receive information about an item from a data source. An environment that is viewable through the display device 104 may include the item, and the information about the item can be displayed for viewing on the display device and/or on the additional display device 110 that is integrated in the handheld base 106 of the portable device. For example, information 408 about the establishment that is viewable through the display device 104 as part of the environment 402 is displayed on the additional display device in the handheld base of the portable device. Other items for which information can be received and displayed may include specifications about a vehicle or consumer information about products when the vehicle and/or the products are viewed in an environment that is viewable through the display device.
[0036] In another example 410, an environment 412 of various buildings and streets is viewable through the display device 104 of portable device 102. In embodiments, the portable device can receive location information that corresponds to a location in the environment that is viewable through the display device, and/or navigation information that appears to display as part of the environment that is viewable through the display device. The location and/or navigation information can include GPS coordinate data and/or wireless communication coordinate data.
[0037] Recognition software may be implemented in the portable device 102 that compares the location and/or navigation information to correlate the reality viewed in an environment with augmented display information. For example, a navigation indicator 414 is displayed on the display device 104 and appears as part of the environment 412 that is viewable through the display device. Additionally, navigation instructions 416 that correspond to the navigation indicator are displayed on the additional display device 110 in the handheld base 106 of the portable device. In embodiments, augmented reality can include geo-information projected into a view of the environment through the display device 104 to augment the environment. For example, the buildings shown in the environment 412 that are viewable through the display device may include displayed information 418 to inform a viewer about the buildings.
[0038] FIG. 5 illustrates examples of the portable device 102 described above with reference to FIG. 1 , and various embodiments of transparent display interaction. In a first example 500, a page of content 502, such as a magazine page or a page of newsprint, is viewable through the display device 104 when the portable device is positioned over the page of content. Images, graphics, and/or text 504 from the page of content 502 can be displayed as an image 506 on the additional display device 110 that is integrated in the handheld base 106 of the portable device. Alternatively or in addition, other images, graphics, and/or text may be displayed on the display device over the page of content that is viewable through the display device. Additional information that is associated with the text 504 and/or the page of content may also be displayed, such as the user selectable control 508 that is selectable to buy movie tickets to the movie that is described in the text on the page of content. Alternatively or in addition, a game or other media content that is associated with the page of content may be displayed for viewer interaction. In another implementation, the image 506 that is displayed on the additional display device 110 may be an answer key to educational questions displayed as text 504 in a text book.
[0039] In another example 510, a video conference with others may be displayed on the display device 104 of the portable device. The transparency of the display device provides that the environment 512 behind the display device is viewable through the display device. This may provide a viewer (i.e., a participant in the video conference) with a greater sense of connection to the other video conference participants who appear to be in the same room as the viewer and within the environment.
[0040] FIG. 6 illustrates an example 600 of the portable device 102 described above with reference to FIG. 1 , and another embodiment of transparent display interaction. In this example, a game board 602 is viewable through the display device 104 when the portable device is positioned over the game board. Images, graphics, and/or text associated with the game can be displayed on the additional display device 110 that is integrated in the handheld base 106 of the portable device. A first game piece 604 is shown on the game board. A second game piece 606 that is also on the game board is viewable through the display device. When the portable device is positioned over the game board, other images, graphics, and/or text associated with the game may be displayed on the display device. For example, possible moves and hints at 608 and 610 for game piece 606 are displayed on the display device, and appear projected onto the game board when viewed through the display device. Other hidden features or clues for the game may also be displayed for viewing on the display device, and a user is provided a new game experience and/or a new level of game interaction.
[0041] Example method 700 is described with reference to FIG. 7 in accordance with one or more embodiments of transparent display interaction. Generally, any of the functions, methods, procedures, components, and modules described herein can be implemented using software, firmware, hardware (e.g., fixed logic circuitry), manual processing, or any combination thereof. A software implementation represents program code that performs specified tasks when executed by a computer processor. The example methods may be described in the general context of computer-executable instructions, which can include software, applications, routines, programs, objects, components, data structures, procedures, modules, functions, and the like. The program code can be stored in one or more computer-readable memory devices, both local and/or remote to a computer processor. The methods may also be practiced in a distributed computing environment by multiple computer devices. Further, the features described herein are platform-independent and can be implemented on a variety of computing platforms having a variety of processors.
[0042] FIG. 7 illustrates example method(s) 700 of transparent display interaction. The order in which the method blocks are described are not intended to be construed as a limitation, and any number of the described method blocks can be combined in any order to implement a method, or an alternate method.
[0043] At block 702, an image is displayed that is viewable through display surfaces of a display device, the image appearing projected as part of an environment that is viewable through the display device. For example, the portable device 102 (FIG. 1 ) includes the display device 104, which has the front display surface 116 and the back display surface 118. The displayed image 124 appears projected as part of the environment 122 that is viewable through the display device when the display device is operably transparent.
[0044] At block 704, a display position of the image on the display device is controlled to display the image with reference to an object in the environment that is viewable through the display device. For example, the display panel controller 134 controls the display positions of the displayed image 310 (FIG. 3 ) for display with reference to objects in the environment 314 that is viewable through the display device.
[0045] At block 706, information associated with the object in the environment is received, and the displayed image includes the information associated with the object. For example, the portable device 102 includes a data interface and receives information about an item from a data source. The environment 402 (FIG. 4 ) that is viewable through the display device 104 includes the item (e.g., the building or establishment), and the information 408 about the item is displayed for viewing, such as on the display device 104 or on the additional display device 110 that is integrated into the handheld base 106 of the portable device.
[0046] At block 708, location information that corresponds to a location of the object in the environment is received, and the displayed image includes the location information associated with the object. At block 710, navigation information is received, and the displayed image includes the navigation information that appears as part of the environment that is viewable through the display device. For example, the portable device 102 receives location information that corresponds to a location in the environment 412 (FIG. 4 ) that is viewable through the display device 104, and/or receives navigation information that appears to display as part of the environment that is viewable through the display device. The location and/or navigation information can include GPS coordinate data and/or wireless communication coordinate data. The navigation indicator 414 that is displayed on the display device appears as part of the environment, which is viewable through the display device. Navigation instructions 416 that correspond to the navigation indicator are displayed on the additional display device 110 in the handheld base 106 of the portable device. Additionally, a building shown in the environment, which is viewable through the display device 104, includes the displayed information 418 to inform a viewer about the building.
[0047] FIG. 8 illustrates various components of an example device 800 that can be implemented as a portable device as described with reference to any of the previous FIGS. 1-7 . In embodiments, the device may be implemented as any one or combination of a fixed or mobile device, in any form of a consumer, computer, portable, user, communication, phone, navigation, television, appliance, gaming, media playback, and/or electronic device. The device may also be associated with a user (i.e., a person) and/or an entity that operates the device such that a device describes logical devices that include users, software, firmware, hardware, and/or a combination of devices.
[0048] The device 800 includes communication devices 802 that enable wired and/or wireless communication of device data 804, such as received data, data that is being received, data scheduled for transmission, data packets of the data, etc. The device data or other device content can include configuration settings of the device, media content stored on the device, and/or information associated with a user of the device. Media content stored on device can include any type of audio, video, and/or image data. The device includes one or more data inputs 806 via which any type of data, media content, and/or inputs can be received, such as user-selectable inputs, messages, communications, music, television content, recorded video content, and any other type of audio, video, and/or image data received from any content and/or data source.
[0049] The device 800 also includes communication interfaces 808, such as any one or more of a serial, parallel, network, or wireless interface. The communication interfaces provide a connection and/or communication links between the device and a communication network by which other electronic, computing, and communication devices communicate data with the device.
[0050] The device 800 includes one or more processors 810 (e.g., any of microprocessors, controllers, and the like) which process various computer-executable instructions to control the operation of the device. Alternatively or in addition, the device can be implemented with any one or combination of software, hardware, firmware, or fixed logic circuitry that is implemented in connection with processing and control circuits which are generally identified at 812. Although not shown, the device can include a system bus or data transfer system that couples the various components within the device. A system bus can include any one or combination of different bus structures, such as a memory bus or memory controller, a peripheral bus, a universal serial bus, and/or a processor or local bus that utilizes any of a variety of bus architectures.
[0051] The device 800 also includes one or more memory devices 814 (e.g., computer-readable storage media) that enable data storage, such as random access memory (RAM), non-volatile memory (e.g., read-only memory (ROM), flash memory, etc.), and a disk storage device. A disk storage device may be implemented as any type of magnetic or optical storage device, such as a hard disk drive, a recordable and/or rewriteable disc, and the like.
[0052] Computer readable media can be any available medium or media that is accessed by a computing device. By way of example, and not limitation, computer readable media may comprise storage media and communications media. Storage media include volatile and non-volatile, removable and non-removable media implemented in any method or technology for storage of information, such as computer-readable instructions, data structures, program modules, or other data. Storage media include, but are not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disks (DVD) or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to store information and which can be accessed by a computer.
[0053] Communication media typically embody computer-readable instructions, data structures, program modules, or other data in a modulated data signal, such as carrier wave or other transport mechanism. Communication media also include any information delivery media. The term modulated data signal means a signal that has one or more of its characteristics set or changed in such a manner as to encode information in the signal. By way of example, and not limitation, communication media include wired media such as a wired network or direct-wired connection, and wireless media such as acoustic, RF, infrared, and other wireless media.
[0054] A memory device 814 provides data storage mechanisms to store the device data 804, other types of information and/or data, and various device applications 816. For example, an operating system 818 and a display controller 820 can be maintained as software applications with a memory device and executed on the processors. The device applications may also include a device manager, such as any form of a control application, software application, signal processing and control module, code that is native to a particular device, a hardware abstraction layer for a particular device, and so on.
[0055] The device 800 may also include a graphics processor 822, and includes an audio and/or video processing system 824 that generates audio data for an audio system 826 and/or generates display data for a display system 828. The audio system and/or the display system may include any devices that process, display, and/or otherwise render audio, video, display, and/or image data. For example, the display system includes a display panel controller 830. Display data and audio signals can be communicated to an audio device and/or to a display device via an RF (radio frequency) link, S-video link, composite video link, component video link, DVI (digital video interface), analog audio connection, or other similar communication link. In implementations, the audio system and/or the display system are external components to the device. Alternatively, the audio system and/or the display system are integrated components of the example device.
[0056] Although embodiments of transparent display interaction have been described in language specific to features and/or methods, the subject of the appended claims is not necessarily limited to the specific features or methods described. Rather, the specific features and methods are disclosed as example implementations of transparent display interaction.
Claims
The invention claimed is:
1. A portable device, comprising:
a display device that includes a display panel system configured to display an image, the image configured to display information about an object in an environment viewable through the display device;
a data interface configured to receive the information about the object based at least in part on geo-location information;
display surfaces of the display device through which the image is viewable, the image appearing projected into the environment behind the display device and viewable through the display surfaces of the display device;
a handheld base of the portable device movably coupled to the display device, the display device configurable to open relative to the handheld base to a position that the environment is viewable through the display device;
an additional display device integrated into the handheld base and configured to display information about the object in the environment, the environment not being viewable through the additional display device; and
a display panel controller configured to correlate a display position of the image for display with reference to the object in the environment based on the geo-location information.
2. A portable device as recited in claim 1, wherein the displayed image appears as part of the object in the environment.
3. A portable device as recited in claim 1, wherein the displayed image is a wearable item that appears to be worn by a user who is viewable, at least in part, in the environment that is viewable through the display device.
4. A portable device as recited in claim 1, wherein the data interface is further configured to receive location information from a data source, and wherein the displayed image includes the location information that corresponds to a location in the environment that is viewable through the display device.
5. A portable device as recited in claim 1, wherein the data interface is further configured to receive navigation information from a data source, and wherein the information displayed on the additional display device includes the navigation information that appears to display as part of the environment that is viewable through the display device.
6. A portable device as recited in claim 1, wherein the environment that is viewable through the display device includes text, and wherein the displayed image includes a text image of the text displayed magnified.
7. A portable device as recited in claim 1, the display panel controller further configured to:
move the item from the additional display device for display on the display device responsive to a user input, the item appearing as part of the object in the environment.
8. A portable device as recited in claim 1, wherein the environment that is viewable through the display device includes a page of content when the display device is positioned over the page, and wherein the information displayed on the additional display device includes text associated with the content on the page that is viewable through the display device.
9. A portable device as recited in claim 1, wherein the item includes a game board; and
wherein the image includes possible moves associated with a game piece on the game board.
10. A display device, comprising:
a transparent display panel system configured to display an image, the image including information about an object in the environment viewable through the transparent display panel system;
a data interface configured to receive the information about the object based at least in part on geo-location information;
a non-transparent display panel system movably coupled to the transparent display and configured to display text and images including the information about the object;
display surfaces of the transparent display panel system that include a front display surface and a back display surface through which the image is viewable, the image appearing projected as part of the environment; and
a display panel controller configured to correlate a display position of the image for display with reference to the object in the environment based on the geo-location information.
11. A display device as recited in claim 10, wherein the displayed image is a wearable item appears to be worn by a user who is viewable, at least in part, in the environment that is viewable through the transparent display panel system.
12. A display device as recited in claim 10, wherein the displayed image appears as part of the object in the environment that is viewable through the transparent display panel system.
13. A display device as recited in claim 10, wherein the displayed image includes location information associated with a location of the object in the environment that is viewable through the transparent display panel system.
14. A display device as recited in claim 10, wherein the information displayed on the non-transparent display panel system includes navigation information that appears to display as part of the environment that is viewable through the transparent display panel system.
15. A display device as recited in claim 10, wherein the environment that is viewable through the transparent display panel system includes a page of content when the transparent display panel system is positioned over the page, and wherein the information displayed on the non-transparent display panel system includes text associated with the content on the page that is viewable through the transparent display panel system.
16. A method, comprising:
displaying an image on a display device, an environment behind the display device not being viewable through the display device;
moving the image from the display device to an additional display device, the additional display device movably coupled to the display device;
displaying the image to be viewable through display surfaces of the additional display device, the image appearing projected as part of an environment that is viewable through the additional display device;
receiving information about an object in the environment viewable through the additional display device based at least in part on geo-location information; and
correlating, based on the geo-location information, a display position of the image on the additional display device to display the image with reference to the object.
17. A method as recited in claim 16, wherein the displayed image includes the information about the object.
18. A method as recited in claim 16, further comprising receiving location information that corresponds to a location of the object in the environment, and wherein the displayed image includes the location information associated with the object.
19. A method as recited in claim 16, further comprising receiving navigation information, and wherein the displayed image includes the navigation information that appears to display as part of the environment that is viewable through the additional display device.
Patent Citations (87)
| Patent | Date | Inventor | Cited By |
|---|---|---|---|
| US5644369(A) | 1997-07-01 | Jachimowicz et al. | Applicant |
| US5745203(A) | 1998-04-01 | Valliath et al. | Applicant |
| US5896575(A) | 1999-04-01 | Higginbotham et al. | Applicant |
| US6215920(B1) | 2001-04-01 | Whitehead et al. | Applicant |
| US6246450(B1) | 2001-06-01 | Inbar | Applicant |
| US6452582(B1) | 2002-09-01 | Rolston | Applicant |
| US6618104(B1) | 2003-09-01 | Date et al. | Applicant |
| US6834974(B2) | 2004-12-01 | Lee et al. | Applicant |
| US6961167(B2) | 2005-11-01 | Prins et al. | Applicant |
| US7128432(B1) | 2006-10-01 | Stern et al. | Applicant |
| US7154469(B2) | 2006-12-01 | Weng | Applicant |
| US7205959(B2) | 2007-04-01 | Henriksson | Applicant |
| US7230764(B2) | 2007-06-01 | Mullen et al. | Applicant |
| US7273291(B2) | 2007-09-01 | Kim et al. | Applicant |
| US7658528(B2) | 2010-02-01 | Hoelen et al. | Applicant |
| US7701517(B1) | 2010-04-01 | Geronimi | Applicant |
| US7804502(B2) | 2010-09-01 | Azuma | Examiner |
| US8362992(B2) | 2013-01-01 | Kuhlman et al. | Applicant |
| US8770813(B2) | 2014-07-01 | Bohn et al. | Applicant |
| US2001/0038425(A1) | 2001-11-01 | Lee | Applicant |
| US2003/0020707(A1) | 2003-01-01 | Kangas et al. | Examiner |
| US2003/0201969(A1) | 2003-10-01 | Hiyama et al. | Applicant |
| US2003/0210222(A1) | 2003-11-01 | Ogiwara et al. | Applicant |
| US2004/0075628(A1) | 2004-04-01 | Chien et al. | Applicant |
| US2004/0150584(A1) | 2004-08-01 | Chuman et al. | Examiner |
| US2004/0150653(A1) | 2004-08-01 | Sakamaki et al. | Examiner |
| US2005/0052342(A1) | 2005-03-01 | Wu et al. | Applicant |
| US2005/0140641(A1) | 2005-06-01 | Kim et al. | Applicant |
| US2005/0215323(A1) | 2005-09-01 | Miyamoto et al. | Examiner |
| US2006/0044286(A1) | 2006-03-01 | Kohlhaas et al. | Applicant |
| US2006/0092355(A1) | 2006-05-01 | Yang et al. | Applicant |
| US2006/0152658(A1) | 2006-07-01 | Ozawa et al. | Applicant |
| US2006/0262976(A1) | 2006-11-01 | Hart et al. | Examiner |
| US2007/0018585(A1) | 2007-01-01 | Ijzerman et al. | Applicant |
| US2007/0078007(A1) | 2007-04-01 | Maekawa et al. | Examiner |
| US2008/0055701(A1) | 2008-03-01 | Liu et al. | Applicant |
| US2008/0063808(A1) | 2008-03-01 | Stumpe et al. | Applicant |
| US2008/0136775(A1) | 2008-06-01 | Conant | Examiner |
| US2008/0186255(A1) | 2008-08-01 | Cohen et al. | Examiner |
| US2008/0198292(A1) | 2008-08-01 | Marra et al. | Applicant |
| US2008/0262910(A1) | 2008-10-01 | Altberg et al. | Applicant |
| US2008/0297880(A1) | 2008-12-01 | Steckl et al. | Applicant |
| US2009/0046220(A1) | 2009-02-01 | Tsuchiya et al. | Applicant |
| US2009/0140950(A1) | 2009-06-01 | Woo et al. | Applicant |
| US2009/0219253(A1) | 2009-09-01 | Izadi et al. | Applicant |
| US2009/0232509(A1) | 2009-09-01 | Heikenfeld et al. | Applicant |
| US2009/0295731(A1) | 2009-12-01 | Kim et al. | Applicant |
| US2010/0045705(A1) | 2010-02-01 | Vertegaal et al. | Examiner |
| US2010/0085510(A1) | 2010-04-01 | Okuyama et al. | Applicant |
| US2010/0100842(A1) | 2010-04-01 | Kim | Applicant |
| US2010/0128015(A1) | 2010-05-01 | Feenstra et al. | Applicant |
| US2010/0144394(A1) | 2010-06-01 | Han et al. | Applicant |
| US2010/0157410(A1) | 2010-06-01 | Kim et al. | Applicant |
| US2010/0165634(A1) | 2010-07-01 | Hong et al. | Applicant |
| US2010/0177025(A1) | 2010-07-01 | Nagata et al. | Applicant |
| US2010/0207964(A1) | 2010-08-01 | Kimmel et al. | Applicant |
| US2010/0277439(A1) | 2010-11-01 | Charlier et al. | Examiner |
| US2011/0040539(A1) | 2011-02-01 | Szymczyk et al. | Examiner |
| US2011/0124376(A1) | 2011-05-01 | Kim et al. | Examiner |
| US2011/0137561(A1) | 2011-06-01 | Kankainen | Examiner |
| US2011/0161875(A1) | 2011-06-01 | Kankainen | Examiner |
| US2011/0164047(A1) | 2011-07-01 | Pance | Examiner |
| US2011/0164163(A1) | 2011-07-01 | Bilbrey et al. | Examiner |
| US2011/0276556(A1) | 2011-11-01 | Meier et al. | Examiner |
| US2011/0285622(A1) | 2011-11-01 | Marti et al. | Examiner |
| US2012/0099250(A1) | 2012-04-01 | Robinson et al. | Examiner |
| US2012/0102438(A1) | 2012-04-01 | Robinson et al. | Examiner |
| US2012/0105306(A1) | 2012-05-01 | Fleck | Applicant |
| US2012/0105428(A1) | 2012-05-01 | Fleck | Applicant |
| US2012/0105474(A1) | 2012-05-01 | Cudalbu et al. | Examiner |
| US2012/0105475(A1) | 2012-05-01 | Tseng | Examiner |
| US2012/0162268(A1) | 2012-06-01 | Fleck | Applicant |
| US2012/0162269(A1) | 2012-06-01 | Bohn | Applicant |
| US2012/0163021(A1) | 2012-06-01 | Bohn | Applicant |
| US2012/0235827(A1) | 2012-09-01 | Chi et al. | Examiner |
| US2013/0207896(A1) | 2013-08-01 | Robinson et al. | Examiner |
| US2014/0286047(A1) | 2014-09-01 | Bohn et al. | Applicant |
| CN1189047 | 2005-02-01 | Applicant | |
| CN1240042 | 2006-02-01 | Applicant | |
| CN1879139 | 2006-12-01 | Applicant | |
| EP2169966 | 2010-03-01 | Applicant | |
| JP2002208307 | 2002-07-01 | Applicant | |
| JP2002320012 | 2002-10-01 | Applicant | |
| JP2010231069 | 2010-10-01 | Applicant | |
| KR20080012005 | 2008-02-01 | Applicant | |
| KR20100038840 | 2010-04-01 | Applicant | |
| WO-2010126756 | 2010-11-01 | Applicant |
Non-Patent Literature (28)
- Patel, Nilay, “Double-Sided Transparent Touch Display would Make Battleship Amazing”, Retrieved at << http://www.engadget.com/2008/08/29/double-sided-transparent-touch-display-would-make-battleship-ama >>, Aug. 29, 2008, pp. 5.Applicant
- Greene, Kate, “Two-Sided Touch Screen”, Retrieved at << http://www.technologyreview.in/computing/19300/ >>, Aug. 24, 2007, pp. 4.Applicant
- Wu, et al., “Advanced Organic Light-Emitting Devices for Enhancing Display Performances”, Retrieved at << http://ntur.lib.ntu.edu.tw/bitstream/246246/148555/1/37.pdf >>, Journal of Display Technology, vol. 01, No. 2, Dec. 2005, pp. 248-266.Applicant
- “Final Office Action”, U.S. Appl. No. 12/977,852, (May 7, 2013), 12 pages.Applicant
- “Non-Final Office Action”, U.S. Appl. No. 12/977,852, (Nov. 15, 2012), 10 pages.Applicant
- “Non-Final Office Action”, U.S. Appl. No. 12/977,943, (Dec. 28, 2012), 14 pages.Applicant
- “Non-Final Office Action”, U.S. Appl. No. 12/977,943, (May 9, 2013), 13 pages.Applicant
- “Non-Final Office Action”, U.S. Appl. No. 12/977,959, (May 9, 2013), 13 pages.Applicant
- “PCT Search Report and Written Opinion”, Application No. PCT/US2011/057479, (Apr. 10, 2012), 9 pages.Applicant
- “PCT Search Report and Written Opinion”, Application No. PCT/US2011/066757, (Sep. 25, 2012), 9 pages.Applicant
- “Restriction Requirement”, U.S. Appl. No. 12/977,852, (Sep. 6, 2012), 5 pages.Applicant
- “Restriction Requirement”, U.S. Appl. No. 12/977,943, (Aug. 20, 2012), 6 pages.Applicant
- Aleksander, Marek et al., “Possibilities of application of polymer-dispersed liquid crystals in information displays”, In Proceedings of SPIE 2004, vol. 5565, Available at <http://lib.semi.ac.cn:8080/tsh/dzzy/wsqk/SPIE/vol5565/5565-304.pdf>,(2004), pp. 304-308.Applicant
- Giraldo, Andrea et al., “Transmissive Electrowetting-Based Displays for Portable Multi-Media Devices”, SID 09 Digest, Available at <http://www.liquavista.com/downloads/getFile.aspx?DocID=112>,(2009), pp. 479-482.Applicant
- Heikenfeld, J. et al., “Electrowetting Light Valves with Greater than 80% Transmission, Unlimited View Angle, and Video Response”, SID 05 Digest, http://www.google.com/url?sa=t&source=web&cd=3&ved=0CBwQFjAC&url=http%3A%2F%2Fwww.ece.us.edu%2Fdevices%2FDownloads%2FDocuments&2FHeikenfeld—TransELV—SID05.pdf&rct=j&q=Electrowetting%20Light%20Valves%20with%20Greater%20than%2080%25%20Transmission%2C%20Unlim,(2005), pp. 1-4.Applicant
- Hu, Heng-Cang et al., “Electrowetting-Based Total Internal Reflection Chip for Optical Switch and Display”, In Proceedings of IEEE/LEOS 2007, Available at <http://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=4373844>,(2007), pp. 69-70.Applicant
- Humphries, Matthew “Clear LCD display in development”, Retrieved from: <http://www.geek/com/articles/consumer/clear-lcd-display-in-development-2007079/>on, (Jul. 9, 2007), 8 pages.Applicant
- Klosowicz, Stanislaw J., “Polymer-dispersed liquid crystals as perspective media for displays and optical elements”, In Proceedings of Symposium on Photonics Technologies for 7th Framework Program, Available at <http://www.opera2015.org/deliverables/D—4—3—CD-ROM—Wroclaw—Nieuw/6—Proceedings/46—Klosowicz.pdf>,(Oct. 2006), pp. 238-241.Applicant
- Kwong, Vincent H., et al., “Control of reflectance of liquid droplets by means of electrowetting”, Applied Optics, vol. 43, No. 4, Available at <http://www.phas.ubc.ca/ssp/papers/Publications/Control%20of%20Reflectance%20of%20Liquid%20Droplets%20by%20Means%20of%20Electrowetting.pdf>,(Feb. 2004), pp. 808-813.Applicant
- “Foreign Office Action”, CN Application No. 201110355941.3, Dec. 23, 2013, 12 Pages.Applicant
- “Foreign Office Action”, CN Application No. 201110436269.0, Nov. 25, 2013, 18 Pages.Applicant
- “Non-Final Office Action”, U.S. Appl. No. 12/914,761, (Aug. 9, 2013),13 pages.Applicant
- “Final Office Action”, U.S. Appl. No. 12/914,761, Mar. 17, 2014, 15 pages.Applicant
- “Notice of Allowance”, U.S. Appl. No. 12/977,852, Feb. 24, 2014, 6 pages.Applicant
- “Foreign Notice of Allowance”, CN Application No. 201110436269.0, Aug. 1, 2014, 6 pages.Applicant
- “Foreign Office Action”, AU Application No. 2011320628, Sep. 10, 2014, 3 pages.Applicant
- “Foreign Office Action”, CN Application No. 201110355941.3, Aug. 13, 2014, 15 Pages.Applicant
- “Foreign Office Action”, CN Application No. 201110358454.2, Sep. 11, 2014, 15 pages.Applicant