Computer display system using multiple screens

[0001] Typical display screens occupy a relatively small part of a viewer's, or user's, field of view. A standard computer monitor, television screen, liquid crystal, flat panel, thin-film transistor, or other type of display device might measure 14 to 29 inches diagonal. This requires a user to be relatively close to the display in order for the display to fill up a larger portion of the user's field of view.

[0002] Larger displays are possible. For example, a projection display can occupy a much larger area. However, such devices are often expensive and inconvenient. For example, a projector might have to be located at some distance from the screen, or other surface, in order to create a sufficiently large display. Another problem with projection type of displays is that they, in effect, “blow up” a high resolution into a coarser resolution. For example, if a 1024×768 display is projected to create a large image, the image is still at the 1024×768 resolution. The picture elements, or pixels, and spaces between pixels are made larger by projecting. Thus, the pixel density is decreased. This is why projected displays are usually viewed from a larger distance than the display screens mentioned above. A longer viewing distance means that the coarser resolution is not as noticeable.

[0003] Another approach is a so-called “wall of video”. This approach uses multiple display screens usually arranged in a rectangle, or wall. Portions of an image to be displayed are divided among the separate display screens in the wall so that a much larger display can be obtained. Note that this approach maintains the display density since each screen is still displaying at its native density. For example, if three screens are used in a row, and each screen has a 1024×768 density, then although three times as much area is covered by the combination of three display screens, there are also three times as many pixels in the composite display.

[0004] A problem with the wall of video approach is that it is inflexible and expensive. The system must be designed from the outset so that an image source can appropriately generate separate video signals to each of the screens. Typically, a computer is used to divide a single input image into separate images for the sections of the wall of video. For example, if a wall of video uses 9 screens in a 3×3 arrangement, then the computer system is designed to divide an original image into an equal 3×3 grid. Each section of the grid is sent to the associated display screen. The arrangement is hardwired and is typically designed on a customized, per installation, basis. Setting up such a display requires planning of the area to be covered, size and number of screens to use, multiple display output hardware devices, custom software to divide the input images, etc.

[0005] Once a wall of video system is set up it is not easily changed. This makes it difficult to adapt the display to different applications. For example, viewing a movie may require that the screens be arranged in a 4:3 aspect ratio for best viewing. Presenting documents or tables of information might best be achieved if an overall display is taller than it is wide. Playing computer games that simulate immersion into a simulated environment warrant a display area that wraps around a user and that can potentially cover large spherical sections around the user.

[0006] Thus, it is desirable to provide a multi-screen display system that improves upon one or more of the shortcomings of the prior art.

[0007] The present invention allows a user to arbitrarily position display screens so that a larger field of view can be presented by a computer system that senses the screen positions and provides appropriate display information. This is in contrast to the typical use of display screens where a single display screen is used and the position of the display screen is assumed to be directly in front of a user's viewpoint. For example, two screens can be placed side-by-side so that their viewing surfaces together form a rectangular plane. This can be useful for viewing movies or other presentations that benefit from a larger horizontal viewing field. More complex arrangements of multiple screens can be set up for more immersive presentations such as virtual reality, simulations, computer games, etc.

[0008] A mounting bracket for holding screen in a fixed orientation with respect to each other is described. A preferred embodiment of the bracket includes a visual indicator for determining the angle of a screen with respect to another.

[0009] In one embodiment the invention provides a method for generating display information including determining the positions of multiple display screens and generating display information for the display screens by using the determined positions so that different portions of a single scene are displayed upon multiple display screens at the same time to provide a coherent view of the scene from at least one viewpoint.

[0010] In another embodiment the invention provides a method for using multiple display screens in a presentation, comprising first sensing the positions of a plurality of display screens at a first time; providing the first sensed positions to a digital processor for rendering views for the plurality of display screens in accordance with the first sensed positions; sensing the positions of the plurality of display screens at a second time; and providing the second sensed positions to a digital processor for rendering views for the plurality of display screens in accordance with the second sensed positions.

[0011] In another embodiment the invention provides a method for using multiple display screens in a computer-generated presentation, comprising indicating to a human user preferred positions for two or more display screens; and rendering views for the two or more display screens in accordance with the preferred positions.

[0012] In another embodiment the invention provides a bracket for joining two or more display screens, the bracket comprising a first slot for receiving a first display screen; and a second slot coupled to the first slot for receiving a second display screen.

[0023] The present invention allows a user to arbitrarily position display screens so that a larger field of view can be presented by a computer system that senses the screen positions and provides appropriate display information. This is in contrast to the typical use of display screens where a single display screen is used and the position of the display screen is assumed to be directly in front of a user's viewpoint. For example, two screens can be placed side-by-side so that their viewing surfaces together form a rectangular plane. This can be useful for viewing movies or other presentations that benefit from a larger horizontal viewing field. More complex arrangements of multiple screens can be set up for more presentations such as virtual reality simulations, computer games, etc.

[0024] In FIG. 1A, user 102 is in front of main screen 104. Screens 106 and 108 are placed adjacent to main screen 104 to the left and right sides, respectively. Screen 110 is above main screen 104 and is angled towards the user. Augmenting screens 112 and 116 are positioned behind and above the screens already mentioned.

[0025] Screens such as 112 may include obscured screen areas such as at 114 if screens overlap. Obscured areas can be calculated by a program or programs that are used to calculate, render, generate or otherwise present a visual scene, or presentation, on the multiple display screens. In other words, since presentation software is informed of the positions of the display screens, the software can determine that the area at 114 of display screen 112 can not be seen by a user at 102. In this case the software can omit calculation for, and transfer of, viewing information to screen 112.

[0026] In FIG. 1A, screens are shown with borders such as border 120 on screen 108. Borders are portions of a display enclosure that are not used to present information. Borders are not desirable for multiple screen presentation because they detract from an integrated, or coherent, presentation by introducing “blind spots.” When two screens with borders are placed adjacently the border size grows as shown at 122 of FIG. 1A. In a preferred embodiment, the border size, shape and other characteristics (if any) are conveyed to presentation software (i.e., software producing the images to be viewed by a user) so that they can be taken into account in determining the exact size, shape, position and orientation of display screens. Borders can be specified explicitly or implicitly. Explicit specification of borders includes a description of borders such as their size and orientation. Implicit specification of borders assumes that borders exist and are of a known, or assumed, size and orientation with respect to detected or indicated screen positions.

[0027] For example, if a user specifies display positions (not including border positions) then the border positions can be inferred as the spaces between the display screens. In this case no special accommodating of the borders is required. The presentation software merely counts the border areas as “blank space” that does not have screen coverage. If specifications are made for the positions of screens and borders as a unit, as where monitor screens are indicated coarsely by stating adjacencies of units and sizes of screens, then border sizes can be obtained or assumed in varying ways. One way is to have a database of display screen types and provide for detection of display screen types and matching to the database which provides corresponding border sizes. Or a typical border of, e.g., 1.5 inches can be assumed. Or a user can indicate the presence of borders to the presentation software.

[0028] Note that screens can be placed arbitrarily and anywhere. Display screen 116 has been placed somewhat far behind and above the other display screens. In such a case, there may be a large amount of “blank space” or blank area between the screens. In a preferred embodiment, the presentation software (e.g., a graphics program for rendering a scene) only generates the portion of the scene that is appropriate for each display screen area based on the display screen's position and user viewpoint. The number, type, size or other characteristics of the display screens can vary from those discussed herein.

[0029] FIG. 1B illustrates further aspects of display screen positioning.

[0030] In FIG. 1B, display screens are shown as wire frames without borders for simplification and clarity. FIG. 1B is a left-side, perspective view that includes some of the screens shown in FIG. 1A. In FIG. 1B, user 102 faces main screen 104, side screens 106 and 108, and top screen 110, as in FIG. 1A. Displaced screen 116 is also shown. Additional screens show the flexibility of the system by permitting floor screen 130, rear screen 132 and wraparound screen 134. Such a configuration may be useful in immersive environments where the effect of the presentation is enhanced by providing images to a user's peripheral vision, or by allowing a user to look around at the different display screens while still presented with relevant, coherent visual information.

[0031] As used in this application, “coherent” presentation of visual information includes presentation on two or more display devices where there is a perceived aesthetic consistency, or relationship, of the visual information on the different display devices. For example, a single scene that is rendered across the multiple display devices at the same time fits this description. Another example, is movement from one screen to another consistent with a simulation, depiction or portrayal of natural, or physical, movement. An example of natural movement is a person walking, car moving, falling object, exploding object, ballistic path, etc.

[0032] Screen positions can be predetermined, designated, or sensed. Sensing can include using remote sensing devices such as acoustic, radio-frequency, infrared, etc. For example, a user can indicate three points of a screen's perimeter by placing an infrared emitter on each of the points. A computer system is informed of each point by, e.g., a user keypress at or near the time of emitter placing. Once three points, such as three corners of a display screen, are known, the three-dimensional position of the screen, along with the screen dimensions, can be determined.

[0033] Three dimensional sensing can be by any means as is known in the art. For example, laser scanning, coordinate measuring machines, etc. can be used along with triangulation techniques to identify positions. Another approach is to use global positioning system (GPS) sensing. Other alternatives include angulation using phased antenna arrays, imaging using one or multiple cameras and scene analysis, etc.

[0034] Another type of sensing is mechanical sensing. This can use a movable arm located at a known point where the end of the arm is touched (or moved near) to one or more points of a screen. Joints or hinges can be affixed at places where screens are adjacent. Such joints can measure the angles made by the planes of the adjacent screens so that positions of secondary screens relative to a main screen can be determined. This is usually sufficient to determine accurate positions of the secondary screens. Sizes of the screens can be manually input by the user so that presentation software can compute only the views, and viewport sizes, necessary to create information to be displayed on each of the screens. Such sensing joints can be made strong enough to hold and support multiple screens. An example of such a joint is described, below.

[0035] One useful way to determine positions of screens is simply to ask a user to input the positions. This manual position designating includes having a user make measurements of distances and angles which are then entered into a computer system that calculates the screen positions from the measurements. The user measurements can be rough approximations and screen positions can still be determined with enough accuracy to create a coherent multi-screen display.

[0036] Screen positions can be calibrated. One form of calibration allows a user to move models of screens on a computer display. Each screen model corresponds to an actual screen that the user is viewing. The model positions are used to generate views for the screens as the user is moving a model. When the user sees matching views of a scene, test pattern, reference object, etc., among screens that include the model screen being moved, then calibration is achieved. The user indicates to a computer system that the current model position results in a view that is coherent with another screen (e.g., the main screen) and the computer system can then use the information to generate further views for the screen corresponding to the model.

[0037] Screen positions can be predetermined. For example, a presentation program may have default, or optimal, screen placements determined by a program, or presentation, author. In this case, the user is directed to place the screens in a predetermined orientation. It is possible that an automated system can move the screens without user intervention. For example, screens can be on pivoting platforms, moveable robotic arms, etc.

[0038] FIGS. 2A–C illustrate different modes of information transfer to multiple display screens.

[0039] In FIG. 2A, computer system 200 includes 3 outputs 202, 204 and 206, that feed screens 212, 214 and 216, respectively. Thus, the computer generates a separate output for each display screen. The outputs can be digital, composite or component video or any other type of format. Typically, a computer uses a graphics card that provides the image output. The computer can use multiple graphics cards or a single graphics card can provide one or more outputs. Other approaches to generating the output signals are possible.

[0040] FIG. 2B shows computer 200 using single output line 230 to feed information to all three screens 212, 214 and 216. In this case, each screen is “daisy chained” to the next screen. Each screen takes only the information appropriate for the particular screen. Many approaches can be used such as using a digital network (e.g., Universal Synchronous Bus (USB), IEEE 1394, Ethernet, etc.) for the output line. Identifiers can be used to designate packets (or other portions of the signals) for a particular screen. In general, any communications method can be used to transfer information from a computer executing a presentation program to the multiple display screens.

[0041] FIG. 2C illustrates wireless transfer of information from computer 200 to display screens 212, 214 and 216. Transmitter 240 sends signals (e.g., infrared, acoustic, radio frequency or other electromagnetic signals, etc.) to display screens 212, 214 and 216 that are equipped with receivers 232, 234 and 236, respectively.

[0042] FIGS. 3A–B illustrate the use of mounting brackets for positioning a four-screen “hood” display.

[0043] In FIG. 3A, four screens are held in place with two mounting brackets. Left mounting bracket 250 attaches to screens 260, 262 and 268. Right mounting bracket 252 attaches to screens 260, 264 and 268. The user viewpoint is as depicted for a viewer of FIG. 3A.

[0044] Each bracket has three U-shaped slots for holding an edge of a screen. The slots can be tilted, or movably positioned, so that the screens can form different angles in accordance with a user's preference for a specific set of screen orientations. In a preferred embodiment a general configuration is maintained where main screen 260 has left and right screens 262 and 264; along with top screen 268. Details of the brackets are discussed in more detail, below.

[0045] Each screen has a stand. In FIG. 3A, screen 260 is shown with stand 270 while screen 268 is shown with stand 272. Note that screen 268 is upside down so that stand 272 is pointing towards the viewer. In a preferred embodiment, the system can flip a screen's image information so that an upside-down screen still displays a rightside-up image. In general, the system of the present invention can accommodate screens positioned at offset rotational angles such as sideways, or any degree of tilt.

[0046] An alternative arrangement for screens is shown in FIG. 3B. FIG. 3B shows a left-side view of the hood configuration of FIG. 3A. In FIG. 3B, top screen 268 is now rightside-up so that stand 272 is pointed away from a viewer. Some screens in multiple screen arrangements may be more easily positioned if there is not a stand. However, many of today's flat panel displays have stands that are not removable, or positionable, to accommodate desired screen arrangements. Most likely the use of stands for the main, left and right screens is desirable.

[0047] FIGS. 4A–C illustrate details of a mounting bracket for achieving a hood configuration of 4 screens.

[0048] In FIG. 4A, bracket 250 of FIG. 3A is shown shaded so that its geometry can be more easily seen. Other bracket 252 is not shown but, as discussed, operates analogously to bracket 250. The brackets are used to hold four screens together in a movably fixed orientation. The top screen can be tilted up or down. The left and right screens can be angled inward or outward with respect to the main screen. The brackets provide enough stiffness in their joints, or hinges, so that a user can manually move the screens to a position and the position will be thereafter maintained.

[0049] Note that the screens of FIG. 4A include borders. The border area is used as a region for providing width to the slots of the brackets. When screens have borders the material used to make the slots can be opaque since none of the screens' viewing area is obscured. Alternatively, slots can be made transparent where they overlap, or otherwise obscure, screen display areas. For example, where there is no screen border the slots should be transparent.

[0050] FIG. 4B shows a close-up of bracket 250 of FIGS. 2A and 3A.

[0051] In FIG. 4B, three slots 310, 312 and 314 make up the bracket, corresponding to top, main and left slots. Bracket 302 is a mirror image of bracket 300 so that the top, main and right screens are accommodated. Slots 310 and 312 are joined by hinge 320 which is viewed from its end in FIG. 4B. Slots 312 and 314 are joined by hinge 322 which is viewed lengthwise. Each slot is U-shaped for receiving a display screen's edge (as shown in FIG. 4A). Naturally, slots can be made to be different shapes. Any manner of shape is possible and different ways of movably coupling the slots will be apparent, as is known in the art.

[0052] Slots include two sides, or arms, and a bottom. In a preferred embodiment, a slot's arms are not necessarily the same length. For example, slot 310 has a front arm that is longer than the back arm. This is because the top screen that fits into slot 310 will need more support at its front face due to gravity. Other bracket arrangements can have arms of any configuration, length, size, shape, coloration or other attributes or properties.

[0053] FIG. 4C illustrates an enlargement of the circled area, A, of FIG. 4B.

[0054] In FIG. 4C, slots 310, 312 and 314 are joined as discussed, above. Hinge 320 joins slots 310 and 312, while hinge 322 a joins slots 312 and 314. In a preferred embodiment pointers are affixed to the hinges, or other parts of a bracket. The portions of the hinges to which the pointers are affixed are also affixed to slot 312, which is the slot for the main screen. In this manner, the pointers can be used to indicate the angles of the top and side screens with respect to the main screen. Angle markings are printed onto slots 310 and 314 so that a human user can more easily determine the angles to which the screens and slots have been adjusted. The angle is then entered into a computer program for use by a presentation program, or other program, to determine the positions of the screens as discussed, above. Other embodiments can use different methods of indicating angles. For example, sensors such as a potentiometer, switches, etc., can be coupled to an input of a computer system to automatically indicate the angles. Any manner of angle measuring mechanism can be employed.

[0055] Although the invention has been discussed primarily with respect to computer (or digital processor) presentations, aspects of the invention can be applied to other forms of presentation. For example, optical presentations can be coordinated by sensing the positions of screens according to the invention. Slides, film or other media can be projected onto rear-projection display screens according to the detected screen orientations to achieve a desired result, or goal. The images can be designed to portray a scene. A tray of slide photographs can be selected according to whether the display screen is in an overhead, lateral, or ground position. For an overhead position, e.g., a blue sky, clouds, bird, etc. image is selected for display. Similarly, a horizon, person, grass, roadway, etc., image can be displayed according to position.

[0056] Even more basic types of presentations can be employed. For example, where the goal is to illuminate an object with certain colors, intensity, or shading of light, the display screens may be used merely as sources of white or tinted illumination. Thus, the screen positions can be sensed and compared to a desired lighting model that is provided to a computer, or other system. The system can sense the positions and provide each screen with information to create illumination to obtain the desired result. Such an approach is useful, for example, in photography, film or moviemaking where typical lighting sources include key, fill and background lighting. Parameters such as color balance, light temperature, etc. can be used to specify the model for lighting. Sophisticated, controllable, light sources can be substituted for the display screens. Light sources can include incandescent, fluorescent, tungsten, daylight reflectors, plasma screen, electron tubes, LCD, TFT, micromirror or other devices. A “presentation program” can be any type of hardware or software that generates images for viewing on multiple screens.

[0057] Naturally, any combination, position or orientation (e.g., rotated, angled, slanted, etc.) of display screens is possible. Also, any type of display device (or light source) can be used including cathode ray tubes (CRTs), flat-panel displays (e.g., liquid crystal displays (LCDs), thin-film transistors (TFTs), etc.), plasma, electrofluorescent, projection, glass, silvered screens, etc. Any shape and size of display can be used including any size of standard rectangular displays, circular, curved, convex, concave, three dimensional (i.e., non-planar), etc.

[0058] The presentation program need not display the same resolution on all of the screens. In fact, it is more advantageous to detect where a user is viewing so that the focus point can be rendered in higher resolution while screen areas that the user is not looking at directly can be rendered in lower resolution (or not at all). This approach reduces the processing resources needed by the presentation program and reduces bandwidth needed to transfer viewing information to the screens.

[0059] The user's viewing direction or viewpoint can be detected by position sensing, as described above. The user can wear an emitting indicator that assists in automatically detecting the viewing position. For example, the TrackIR™ system from NaturalPoint™ can be used. If it is known, for example, that the user is looking at the main screen then the top and side screens can be rendered in lower resolution. Or regions on the screens, as opposed to the entirety of the screens, can be rendered differently. A rear screen or other screen, or screen portion, not currently visible need not be rendered at all.

[0060] Although a specific type of bracket is described, variations can be obtained that are within the scope of the invention. For example, a bracket might use “V-shaped” rather than U-shaped slots. Clamps can be used instead of the slots. A bracket that does not use the rectangular slots of the preferred embodiment can be employed. Different ways of hinging, or movably connecting the slots together can be employed. Instead of two brackets, a single bracket can be formed by joining the brackets along one or more axes. For example, the brackets can be joined horizontally along the adjacency of the main and top screens. It is possible separate brackets can be used so that, instead of three slots joined together, only two slots are joined. In this case, the bracket may be positioned at different areas of the screens. For example, a bracket can be used at the midpoint of each screen adjacency so that, e.g., the main and top screens are held together, the left and main screens, and the right and main screens are each held by a separate bracket.

[0061] Many variations of brackets are possible. In general, it is not necessary to have the angle measuring indicator of the preferred embodiment. Brackets need not be moveable but can be manufactured with slots in a fixed, unmoveable position. Or a bracket can allow only a few positions, rather than the continuous positioning that is possible with the brackets discussed, herein.

[0062] Thus, the scope of the invention is to be determined solely by the appended claims.