Three-dimensional television viewing environment

[0001] This application is related to the following U.S. Patent Application:

[0002] application Ser. No. ______, bearing Attorney Docket No. MS1-1237US, filed ______, entitled Three-Dimensional Program Guide, and naming Peter T. Barrett as inventor.

[0003] This invention relates to television viewing and, in particular, to a three-dimensional television viewing environment.

[0004] With technological advances, television viewing has become more interactive. Many television viewing systems include a client device, such as a set-top box, that provides access to a programming guide through a user interface displayed on the television. Typically, a viewer accesses the programming guide by tuning to a particular channel over which the program guide data is being transmitted. The user can view the program guide, identify a program of interest, and then tune to the channel on which the interesting program is being broadcast. The programming guide user interface may also display advertisements and/or program recommendations in addition to the program guide data.

[0005] Client devices that provide viewer interaction with a television may also include gaming consoles, such as the Microsoft Xbox gaming system. These gaming consoles support interactive three-dimensional video games, and may also include one or more tuners, such that the gaming consoles may replace traditional television set-top boxes. As such, the three-dimensional graphics functionality supported by the gaming console (or any other advanced client device, such as an advanced television set-top box or personal computer) may be utilized to enhance the television viewing experience.

[0006] A three-dimensional television viewing environment is described. Media content such as a broadcast television program is rendered in a two-dimensional area within a three-dimensional environment. An electronic program guide, advertisements, and program recommendations may be rendered in additional two-dimensional areas within the same three-dimensional environment. Viewers can navigate the three-dimensional environment using an input device such as a joystick.

[0007] The same numbers are used throughout the drawings to reference like features and components.

[0008] FIG. 1 illustrates a three-dimensional graphics environment.

[0009] FIG. 2a illustrates a two-dimensional plane within the three-dimensional graphics environment.

[0010] FIG. 2b illustrates a display of the two-dimensional plane within the three-dimensional graphics environment.

[0011] FIG. 2c illustrates a zoomed-in display of the two-dimensional plane within the three-dimensional graphics environment.

[0012] FIG. 3 illustrates an electronic program guide rendered using multiple two-dimensional areas within a three-dimensional environment.

[0013] FIG. 4 illustrates the display of exemplary navigational landmarks.

[0014] FIG. 5 illustrates components of an exemplary television viewing system that supports a three-dimensional television viewing environment.

[0015] FIG. 6 illustrates select components of a client device implemented to support a three-dimensional television viewing environment.

[0016] FIG. 7 illustrates a method for rendering media content and related data in a three-dimensional television viewing environment.

[0017] The following discussion is directed to methods and systems that allow users to view media content and related information in a three-dimensional graphics environment. The three-dimensional television viewing environment described herein may be implemented using a client device with three-dimensional graphics capabilities configured to receive media content, such as broadcast television data or on-demand video. Media content, program guide data, program recommendations, advertisements, and any other related information is presented to a viewer within a three-dimensional viewing environment.

[0018] FIG. 1 illustrates a three-dimensional viewing environment 100 in which media content and related information may be presented to a viewer. Points A, B, C, D, E, F, G, and H define a particular area within three-dimensional viewing environment 100 that extends substantially, if not infinitely, in each direction. An eye 102 represents a virtual location and viewing direction of a viewer within three-dimensional area 100. For example, as illustrated, the viewer is virtually located approximately equidistance from plane ABCD and from plane EFGH, and is looking toward plane EFGH. Two-dimensional area 104 lies within plane EFGH, and represents a two-dimensional area in which data, such as a broadcast television program, a program guide, advertisements, or program recommendations, may be presented. Similarly, two-dimensional area 106 lies within plane ABCD, and represents another two-dimensional area in which data may be presented. It is recognized that any number of data/content areas may be defined within three-dimensional environment 100. Furthermore, although data/content areas 104 and 106 are shown on parallel planes within environment 100, it is recognized that data/content areas may be defined on any plane within environment 100, and that planes containing defined two-dimensional areas may be at any angle to other planes containing defined two-dimensional areas. For example, area 108 is a two-dimensional area defined within a plane containing points A, B, F, and E and area 110 is a two-dimensional area defined within a plane that contains points A, C, and H.

[0019] A viewer interacts with viewing environment 100 using a television remote control, a joystick, game controller, or other input device to move and/or rotate the virtual location of the viewer 102 within the environment 100. For example, if a viewer is viewing a broadcast television program that is being rendered in area 104, the viewer can use a joystick to rotate the virtual location of the viewer 180 degrees to bring into view an electronic program guide being presented in area 106. As another example, if a viewer is viewing data that is being rendered in area 104, the viewer can user the joystick to move the virtual location of the viewer closer to (zoom in on) or back away from (zoom out on) the displayed data. Using an input device, a viewer can move and/or rotate the virtual location of the viewer 102 in any direction within the three-dimensional viewing environment 100.

[0020] FIG. 2a illustrates multiple data/content areas defined on a single plane within three-dimensional environment 100. As in FIG. 1, points A, B, C, and D define a two dimensional plane within three-dimensional environment 100. Furthermore, the rectangular area defined by points A, B, C, and D represents an area that is visible to a user through a display device, such as a television screen.

[0021] FIG. 2b illustrates an example display on display device 206 of the visible area illustrated in FIG. 2a.

[0022] Area 106 is defined as a two dimensional area, in which program listings are presented, such as a typical electronic program guide. Area 202 is defined as a two-dimensional area, in which advertisements are presented. Area 204 is defined as a two-dimensional area in which recommended programs are presented. As described with reference to FIG. 1, three-dimensional viewing environment 100 can include any number of two-dimensional areas for displaying any type of media or media data. Furthermore, although illustrated as being on the same plane, the multiple two-dimensional areas may each exist at any location within the thee-dimensional environment 100.

[0023] Using an input device, a viewer can zoom in or out, scroll in any direction, including up, down, left, and right, and rotate the viewing perspective in any direction. For example, to view only the program listings in area 106, a viewer can interact with the viewing environment 100 using an input device (e.g., a joystick or remote control) to zoom in on area 106 until area 106 fills the entire screen. FIG. 2c illustrates an example display after a viewer zooms in on two-dimensional area 106.

[0024] In one implementation, multiple two-dimensional areas can be used to allow a user to navigate between media content and related data that is made available to the viewer via triggers in the media content itself. For example, while viewing a football game, an icon may be rendered that indicates that commercial products associated with the teams that are playing are available for purchase. Using an input device, the viewer can select the icon, which then causes the viewer perspective within the three-dimensional viewing environment to change, bringing into view a second two-dimensional area. Through the new viewing perspective, the viewer can view a commercial for the available products, or in an alternate implementation, a website through which the viewer can purchase the products.

[0025] In one implementation, while the viewer is navigating through the additional data associated with the selected icon or trigger, the program that was originally being displayed is paused. The viewer can then resume viewing the program after navigating and experiencing the triggered additional content and/or data.

[0026] EPG data can be categorized in many ways, such as according to program type (e.g., television series, movie, pay-per-view, sports program, etc.), according to genre (e.g., drama, romance, mystery, horror, comedy, etc.), according to intended audience (e.g., children, teen, men, women, adults, etc.), according to channel and/or time, and so on. By providing a viewer multiple ways to view EPG data, the viewer is able to quickly identify media content of interest.

[0027] FIG. 3 illustrates an exemplary display of EPG data using multiple two-dimensional areas within a three-dimensional viewing environment. In an exemplary implementation, EPG data is displayed across multiple two-dimensional areas, with each two-dimensional area representing, for example, a different category of data. The categories and layout of two-dimensional areas illustrated in FIG. 3 is only one example, and it is recognized that more and/or different data categorizations may be displayed in any number of configurations.

[0028] Points K, L, M, and N define a plane within a three-dimensional viewing environment 100. Points P, Q, R, and S define another plane within three-dimensional viewing environment 100. As illustrated in FIG. 3, plane PQRS is parallel to and, from the illustrated perspective, behind plane KLMN. Two-dimensional areas 302, 304, 306, and 308 are rendered in plane KLMN and two-dimensional areas 310, 312, and 314 are rendered in plane PQRS. As described above, with reference to FIGS. 1, 2a, 2b, and 2c, a viewer can navigate among the displayed two-dimensional areas using an input device, such as a joystick or game controller. For example, a viewer can zoom in on two-dimensional area 306 to view EPG data that describes programs that are appropriate for children. Similarly, a viewer can zoom past plane KLMN to zoom in on two-dimensional area 310 to view EPG data that describes programs that are categorized as comedies. Additionally, in the described implementation, two-dimensional areas may be arranged to take advantage of peripheral vision such that when a viewer is navigating within the three-dimensional viewing environment, the viewer may catch a glimpse of a portion of another panel near an edge of the screen, which may suggest the depth or variety of information available at other locations within the three-dimensional viewing environment.

[0029] Furthermore, information pertaining to a particular program may be displayed in multiple two-dimensional areas. For example, according to the configuration illustrated in FIG. 3, a movie that is a comedy may be represented in two-dimensional area 304 and also in two-dimensional area 310. In an alternate implementation, two-dimensional areas may also be defined such that each area displays detailed information about a particular program, rather than EPG data describing a category of programs.

[0030] Navigational landmarks may be rendered, along with media content and/or other data, to indicate that additional content and/or data is available to a viewer if the viewer navigates in a particular direction within the three-dimensional viewing area. In one implementation, the navigational landmarks may simply indicate that additional content or data is available by navigating in a particular direction. In an alternate implementation, the navigational landmarks may also indicate descriptive information about the type of data or content that is available.

[0031] FIG. 4 illustrates an example display in which navigational landmarks indicate the presence of additional data and/or content. Box 402 represents the screen area of a display device 206. Media content and/or other data (e.g., EPG data or advertisements) may be rendered within a two-dimensional area 403. Navigational landmarks 404, 406, and 408 are displayed to indicate to a viewer that additional two-dimensional areas for rendering media content or associated data are available if the viewer navigates (e.g., using a game controller, joystick, or other input device) in the direction indicated. For example, as illustrated in FIG. 4, navigational landmark 404 indicates that additional data or content is available to a viewer if the viewer navigates to the right while navigational landmark 406 indicates that additional data or content is available to a viewer if the viewer navigates up. Similarly, navigational landmark 408 indicates that additional data or content is available to a viewer if the viewer navigates down and to the left.

[0032] In one implementation, navigational landmarks are always visible to a viewer, providing a persistent reminder that additional content and/or data is available and an indication of how the viewer can navigate to the available content and/or data. In an alternate implementation, some or all of the navigational landmarks are displayed only when requested by a viewer, for example in response to the press of a button or movement of a joystick or other input device. Alternatively, a navigational landmark may be rendered when available data or content changes. For example, if an adjacent but out of view two-dimensional area is used to render broadcast media content, a navigational landmark may be automatically rendered for a short period of time (e.g., 30 seconds) when a new broadcast program begins in the available two-dimensional area.

[0033] Although illustrated in FIG. 4 as arrows, navigational landmarks may include any type of demarcation, including icons, text, colored indicators, and so on. Furthermore, text or audio may be associated with a navigational landmark to provide further information to the viewer regarding what type of content or data is available. For example, a user may press a remote control button to display navigational landmarks. If the user presses the button a second time, text associated with the navigational landmarks may be displayed as well to indicate, for example, that a listing of upcoming sports programs is available by navigating to the right, and a listing of upcoming movies is available by navigating to the left.

[0034] In one implementation, the viewer can customize the relative placement of two dimensional areas such that frequently accessed content and/or data is always easily available. For example, the viewer can customize a two-dimensional area for rendering program listing data for programs currently being broadcast to always be available when the viewer navigates to the left. Similarly, a default navigational directional can be defined so that regardless of where the viewer is navigating within the three-dimensional viewing environment, navigating in the default direction will always bring into view a two-dimensional area for viewing current broadcast media content. Furthermore, when customizing relative placement of two-dimensional areas, the viewer can choose to inactivate navigational landmarks associated with the customized directions, because the viewer will know, based on the customization, that a particular set of data or content is always available by navigating in a particular direction.

[0035] In addition to customizing the relative placement of particular two-dimensional areas, an input device may be programmed such that a particular input causes a particular two-dimensional area to be moved into the viewing area. For example, pressing a particular button on a remote control or game controller causes the viewer perspective to move within the three-dimensional area to bring the two-dimensional area that renders broadcast media content into view.

[0036] FIG. 5 shows an exemplary television viewing system 500. System 500 includes a client device, such as gaming console 502 and up to four controllers, as represented by controllers 504(1) and 504(2). The game console 502 is equipped with an internal hard disk drive and a portable media drive 506 that supports various forms of portable storage media as represented by optical storage disc 508. Examples of suitable portable storage media include DVD, CD-ROM, game discs, and so forth.

[0037] The game console 502 has four slots 510 on its front face to support up to four controllers, although the number and arrangement of slots may be modified. A power button 512 and an eject button 514 are also positioned on the front face of the game console 502. The power button 512 switches power to the game console and the eject button 514 alternately opens and closes a tray of the portable media drive 506 to allow insertion and extraction of the storage disc 508.

[0038] The game console 502 connects to a television 516 or other display via A/V interfacing cables 518 and 520. A power cable 522 provides power to the game console. Cable or modem connector 524 facilitates access to a network, such as the Internet, a cable broadcast network, or a video-on-demand service.

[0039] Each controller 504 is coupled to the game console 502 via a wire or wireless interface. In the illustrated implementation, the controllers are USB (Universal Serial Bus) compatible and are connected to the console 502 via serial cables 530. Controller 504 may be equipped with any of a wide variety of user interaction mechanisms. As illustrated in FIG. 5, each controller 504 is equipped with two thumbsticks 532(1) and 532(2), a D-pad 534, buttons 536, and two triggers 538. These mechanisms are merely representative, and other known gaming mechanisms may be substituted for or added to those shown in FIG. 5. Each controller 504 provides a viewer with a mechanism for controlling a virtual viewer location 102 within a three-dimensional viewing environment 100.

[0040] A memory unit (MU) 540 may be inserted into the controller 504 to provide additional and portable storage. Portable memory units enable users to store game parameters and port them for play on other consoles. In the described implementation, each controller is configured to accommodate two memory units 540, although more or less than two units may be employed in other implementations.

[0041] Although shown and described as a game console, client device 502 may include any type of client device that includes a three-dimensional graphics processor and is capable of rendering three-dimensional images. For example, a television set-top box may be implemented with a three-dimensional graphics processor such that the set-top box may replace the game console illustrated in FIG. 5.

[0042] FIG. 6 shows functional components of game console 502 in more detail. Game console 502 has a central processing unit (CPU) 600 and a memory controller 602 that facilitates processor access to various types of memory, including a flash ROM (Read Only Memory) 604, a RAM (Random Access Memory) 606, a hard disk drive 608, and the portable media drive 506. The CPU 600 is equipped with a level 1 cache 610 and a level 2 cache 612 to temporarily store data and hence reduce the number of memory access cycles, thereby improving processing speed and throughput.

[0043] The CPU 600, memory controller 602, and various memory devices are interconnected via one or more buses, including serial and parallel buses, a memory bus, a peripheral bus, and a processor or local bus using any of a variety of bus architectures. By way of example, such architectures can include an Industry Standard Architecture (ISA) bus, a Micro Channel Architecture (MCA) bus, an Enhanced ISA (EISA) bus, a Video Electronics Standards Association (VESA) local bus, and a Peripheral Component Interconnects (PCI) bus also known as a Mezzanine bus.

[0044] As one suitable implementation, the CPU 600, memory controller 602, ROM 604, and RAM 606 are integrated onto a common module 614. In this implementation, ROM 604 is configured as a flash ROM that is connected to the memory controller 602 via a PCI (Peripheral Component Interconnect) bus and a ROM bus (neither of which are shown). RAM 606 is configured as multiple DDR SDRAM (Double Data Rate Synchronous Dynamic RAM) that are independently controlled by the memory controller 602 via separate buses (not shown). The hard disk drive 608 and portable media drive 506 are connected to the memory controller via the PCI bus and an ATA (AT Attachment) bus 616.

[0045] One or more tuners 620 allow game console 502 to receive media content, as well as data that describes the media content, such as electronic program guide data. For example, the tuners 620 can be implemented to receive data over a satellite or cable broadcast network. Graphical media content and data that is received is processed using a 3D graphics processing unit 622 and a video encoder 624, which form a video processing pipeline for high speed and high resolution graphics processing. Data is carried from the graphics processing unit 622 to the video encoder 624 via a digital video bus (not shown). Corresponding audio content and data that is received is processed using an audio processing unit 626 and an audio codec (coder/decoder) 628, which form a corresponding audio processing pipeline with high fidelity and stereo processing. Audio data is carried between the audio processing unit 626 and the audio codec 628 via a communication link (not shown). The video and audio processing pipelines output data to an A/V (audio/video) port 630 for transmission to the television 206 or other display. In the illustrated implementation, the video and audio processing components 620-630 are mounted on the module 614.

[0046] Also implemented on the module 614 are a USB host controller 632 and a network interface 634. The USB host controller 632 is coupled to the CPU 600 and the memory controller 602 via a bus (e.g., PCI bus) and serves as host for the peripheral controllers 504(1)-504(4). The network interface 634 provides access to a network (e.g., Internet, home network, cable broadcast network, etc.) and may be any of a wide variety of various wire or wireless interface components including an Ethernet card, a modem, a Bluetooth module, a cable modem, and the like. The network interface 634 may be configured to enable the one or more tuners 620 to receive media content and data.

[0047] The game console 502 has two dual controller support subassemblies 640(1) and 640(2), with each subassembly supporting two game controllers 504(1)-504(4). Input received from a game controller 504 directs the 3D graphics processing unit 622 to perform the indicated visual navigation. A front panel I/O subassembly 642 supports the functionality of the power button 512 and the eject button 514, as well as any LEDs (light emitting diodes) or other indicators exposed on the outer surface of the game console. The subassemblies 640(1), 640(2), and 642 are coupled to the module 614 via one or more cable assemblies 644.

[0048] Eight memory units 540(1)-540(8) are illustrated as being connectable to the four controllers 504(1)-504(4), i.e., two memory units for each controller. Each memory unit 540 offers additional storage on which games, game parameters, and other data may be stored. When inserted into a controller, the memory unit 540 can be accessed by the memory controller 602.

[0049] A system power supply module 650 provides power to the components of the gaming console 502. A fan 652 cools the circuitry within the game console 502.

[0050] FIG. 7 illustrates a method 700 for rendering media content and data within a three-dimensional television viewing environment. Rendering media content and data within a three-dimensional television viewing environment may be described in the general context of computer-executable instructions, such as application modules, being executed by a computer. Generally, application modules include routines, programs, objects, components, data structures, etc. that perform particular tasks or implement particular abstract data types. A three-dimensional television viewing environment may be implemented using any number of programming techniques and may be implemented in local computing systems or in distributed computing systems where tasks are performed by remote processing devices that are linked through various communications networks based on any number of communication protocols. In such a distributed computing system, application modules may be located in both local and remote computer storage media including memory storage devices. The method illustrated in FIG. 7 is described below with reference to components of the example computer system for implementing a three-dimensional television viewing environment that is illustrated in FIG. 5 and more particularly with reference to the exemplary components of client device 502 as illustrated in FIG. 6.

[0051] At block 702, client device 502 receives media content and/or data to be rendered in a three-dimensional viewing environment. For example, tuners 620 receive a broadcast television program and electronic program guide data.

[0052] At block 704, client device 502 defines multiple two-dimensional areas within a rendered three-dimensional environment. As shown in FIG. 1, areas 104, 106, 108, and 110 are multiple two-dimensional areas defined within a three-dimensional environment 100. Furthermore, the multiple two-dimensional areas can be any size and defined on any plane within a three-dimensional area.

[0053] At block 706, client device 502 associates the received media content and/or data with the multiple two-dimensional areas. For example, a received broadcast television program may be associated with a first two-dimensional area while received electronic program guide data may be associated with a second two-dimensional area.

[0054] At block 708, client device 502 presents a portion of the rendered three-dimensional environment for display to a user. Because the three-dimensional television viewing environment is rendered using a display device 206, only a portion of the three-dimensional environment can be displayed at a time. As illustrated and described with reference to FIG. 1, the portion of the three-dimensional environment that is displayed is based on a virtual location and viewing direction 102 of a viewer within the three-dimensional environment. As the virtual location and viewing direction of a viewer moves, the portion of the three-dimensional environment that is displayed also changes.

[0055] At block 710 client device 502 determines whether or not a navigational input is being received. For example, a viewer submits navigational input to client device 502 using controller 504. The navigational input indicates how the viewer wishes to move the virtual location and viewing direction of the viewer within the three-dimensional environment. If the client device receives navigational input (the Yes branch from block 710), then the method continues a block 712. Otherwise (the No branch from block 710), the method continues presenting a portion of the three-dimensional environment as described with reference to block 708.

[0056] At block 712 client device presents a different portion of the three-dimensional environment for display to the user based on the received navigational input. For example, if the received navigational input indicates rotating to the right, then a portion of the three-dimensional environment that is to the right of the currently rendered portion is presented for display to the viewer.

[0057] Although the systems and methods have been described in language specific to structural features and/or methodological steps, it is to be understood that the invention defined in the appended claims is not necessarily limited to the specific features or steps described. Rather, the specific features and steps are disclosed as preferred forms of implementing the claimed invention.