US 8,368,616 B1Grant
Automatic configuration of multiple monitor systems
Issue Date:2013-02-05
•18 Claims
•6 Drawing Sheets
Abstract
Control of multiple display screens associated with a computer, wherein the auxiliary screen display content that depends on conditions of the computer. During some times the auxiliary screen displays content associated with the presently executing program, and during other times the auxiliary screen displays history information. The rules can be automatically changed or manually changed.
Metadata
Inventor
- Scott C. Harris
Application Information
Application Number:US 13/540,798
Filing Date:2012-07-03
Priority Date:2000-05-12
Art Unit:2628
Classifications
IPC:
G09G5/00G06F3/00G06F3/048
Patent Drawings (6 sheets)
Description
Cross Reference to Related Applications
[0001] This application is a continuation of U.S. application Ser. No. 11/775,868 filed Jul. 11, 2007, now U.S. Pat. No. 8,212,740 issued Jul. 3, 2012, which is a continuation of U.S. application Ser. No. 09/569,816, filed May 12, 2000, now U.S. Pat. No. 8,089,423 issued Jan. 3, 2012, the contents of each of which are incorporated by reference herein in their entireties.
Background
[0002] Modern operating systems may allow operation with multiple display screens. Windows 98, for example, allows two different display cards to be used in the system, each display card running an associated display.
Summary
[0003] The present application defines automatic arranging of the content on multiple display screens. The arranging is “intelligent” in the sense that the arrangement on the screens depends on environment and/or history in a way to provide meaningful content to the user. The content is variable depending on conditions. In an embodiment, the system learns preferences from previous operations. For example, rules can be applied based on a user's previous settings for a condition.
[0004] A specified condition can include its own set of rules.
Brief Description of the Drawings
[0005] These and other aspects will now be described in detail with respect to the accompanying drawings, wherein:
[0006] FIG. 1A shows a view of hardware in which a single computer includes two separate display screens;
[0007] FIG. 1B shows hardware with three display screens;
[0008] FIG. 2 shows a configuration in which a remote connection is used to form a multiple screen display system;
[0009] FIG. 3 shows multiple items of screen information;
[0010] FIGS. 4A-4B shows multiple items of screen information;
[0011] FIG. 5 shows a flowchart of preferences;
[0012] FIGS. 6A-6B shows frames displayed in one or multiple screens;
[0013] FIG. 7 shows customization features; and
[0014] FIG. 8 shows the rules; and
[0015] FIG. 9 shows a flowchart of manual operation.
Detailed Description
[0016] FIGS. 1A and 1B show computer systems with multiple display screens. FIG. 1A has two separate computer screens 105, 110. The computer 100 can be a single-processor computer with two different display drivers 102, 104, driving the two different display screens 105, 110. The two display drivers can be part of the computer, or can be separate display cards. Alternately, the two display drivers can be on a single display card. Each display driver drives the separate display screen. The computer can also be a multiple processor computer. The operating system can assign threads to the two processors such that each one processor handles the display for a different one of the screens. This is most advantageously accomplished by including the display drivers on the motherboard itself. However, it can also be accomplished on the PCI bus, e.g. by using PCI bridges in which the PCI bus is periodically controlled by alternate processors. The operating system controls the two display devices according to the description given herein.
[0017] FIG. 1B shows an alternative layout, in which three screens 120, 125, 130 are driven by the computer 100. The screens are arranged with one screen flat in front of the user, and two others at angles to the user.
[0018] An alternative computer system with multiple display screens is shown in FIG. 2 . In this system, the computer 200 with display 205 is connected over remote connection 210 to second computer 220 with its own display screen 225. The remote connection can be for example by Ethernet, by a fast Internet connection, or the like. The remote connection can also be a docking station, e.g. when one of the computers is a laptop and the other is a docking computer. The remote connection can also be by Bluetooth, Firewire USB or any other bi-directional communication system. The information to be displayed on the second computer is sent over the remote connection to the second computer. One additional advantage of this system is that the second computer can also have a sound card and all other peripherals. This enables even more information to be output, e.g. sound from two applications.
[0019] The present application is disclosed in the context of a Windows™ type operating system in which multiple windows of information can be open at once. Other operating systems can alternatively be used. The operating system controls the screens as described herein.
[0020] FIG. 3 shows the screen information to be displayed on the screens. The control of the display is carried out by the operating system. A main screen 300 is shown in the middle with the auxiliary screen 305 shown on the right. A third screen 310 is shown on the left. This would advantageously place the main screen in the middle, with the auxiliary screens surrounding the main screen. A two screen environment, however, is contemplated.
[0021] The contents of the main screen is defined as usual—as the main or focus screen. The alternative screens 305 and 310 change content based on conditions. The conditions can include the software that is running and/or the software that has run in the past.
[0022] Screen 305 shows a content control menu 306. The AUTO setting is the default setting for the screen, but other options can be selected. The content control part can be caused to automatically hide when it is not being used. Placing the cursor over that spot thereafter causes the content control to reappear.
[0023] The “auto” setting operates according to a flowchart of preferences indicating the content that the alternative screens will display based on the computer's condition and a previous operation, the “history”. The user can also select to override the automatic operation as disclosed herein. These preferences effectively form “rules”.
[0024] Manual operations are also available.
[0025] The WINS option causes the auxiliary screen to display reduced versions of all inactive windows as shown in FIG. 4A . FIG. 4A shows all of the currently active windows, including for example Word™ 402 showing a Word document. The most currently-obtained Word document is shown in front, with other Word documents 404 behind it.
[0026] Therefore, the current focus screen is shown in the main screen 300, while the auxiliary screen 305 shows the FIG. 4A view. FIG. 4A also shows the e-mail program 410, a web browser 415 and a hotkey area 420. The hotkey 420 can be a location which enables selection of specified programs which are assigned to the hotkey.
[0027] The HISTORY configuration is shown in FIG. 4B . The HISTORY alternative brings back a historical list of items, e.g. “documents” which were previously opened. While FIG. 4B shows only four such documents, it should be understood that miniaturized versions of many more documents could be provided. FIG. 4B shows the first item 425 being the last document that was opened. Prior to that, the user was editing a second document “doc 2” which is shown as 428. The browser 432 is shown browsing site no. 1, and 434 represents a notepad document for example.
[0028] Another alternative which can be selected is the desktop, in which the user always sees their DESKTOP in auxiliary screen 305. Other alternatives, not specifically disclosed herein, are also possible.
[0029] When the auto selection is selected, the operating system automatically selects which of the multiple modes will appear on the auxiliary screen. This automatic mode configures the auxiliary screen 305 to automatically provide content which is most likely to be the content that is most useful to the user under the conditions. The content can also be based on choices made by the user during a previous operation.
[0030] The operation progresses as shown in FIG. 5 . This occurs according to a flowchart of preferences in which the system first determines various things about the operation and configures the screens accordingly.
[0031] At 500, the system first determines if the application is a type which can be displayed on multiple screens without adaptation, e.g. a multi-screen enabled game or application is displayed on the screens as described herein. If so, the content is displayed on the multiple screens at 502.
[0032] If 500 is negative, the operation moves to 505 which detects a web browser operation. If a browser is active at 505, the system first determines if the browser is reading a page which has multi screen-capable-frames. Multi-screen frames allow display in either one screen or multiple screens. FIG. 6A shows all of the frames are displayed on a single screen. FIG. 6B shows the same content when operating in a multi-screen paradigm at 508. Each frame can be displayed on a separate screen.
[0033] If the web browser detects that the current system is not a special multi-screen enabled frame, then the current page is simply displayed on the main screen 300, and the auxiliary screen 305 is then configured to receive the last web page that was opened at 509. In this way, the system displays the current page, and the last page. When the system is operating in this latter mode, it becomes possible to flip screens. Therefore, a special hotkey 392 is displayed on the main screen in an “always on top” mode. If this portion is actuated by a click, then the main and previous screens are switched. At 515, no browser has been detected, so the system determines if an application is running. Different applications are defined, for example in the windows registry. The present application discusses two such applications, a word processing program such as Microsoft Word, an e-mail program and a web page production program such as “Front Page”. These different options are shown in steps 520, 525 and 530 respectively.
[0034] In the word processing program, the main screen displays the currently active document, while the auxiliary screen display previously opened documents at 522. The previous documents may be displayed in miniature form (like FIGS. 4A-4B ), or may be displayed in full size. If no last document is available, that is if the word processing program is working on only one document, then the screen represents the last window. If no last window is available, then the screen shows the desktop.
[0035] Analogously, in an e-mail program at 525, the main screen showing the list of available e-mail or current open e-mails is first displayed. At this time, the auxiliary screen display, in order of preference, the last e-mail screen worked on, if not, the last window displayed, and if not the desktop at 525.
[0036] The development program, here a web page development program at 530, displays the main control and the main screen on the main screen 300 at 532. The auxiliary screen shows other web pages which are linked to the main web page. If no such pages have yet been formed, the auxiliary screens can show other hidden toolbars and help screens.
[0037] In this way, the user need not configure the multiple screens. Rather they are automatically configured for the user based on data about what the user might want.
[0038] While this system provides preferences, it should be understood that the user may have their own preference that differs from the presets. The system provides a customization feature. However, it is understood that real customization features are usually only fully utilized by so called power users. Therefore this system provides both a direct customization feature, and also a context-imitating customization feature. The real customization feature is shown in FIG. 7 . In this Figure, the user can select and write “rules” for customizing the screen usage. For example, as shown, the “If” content at 700 has a pull down menu at 705 listing the different applications in the registry. The applications may include web browser, e-mail programs, word processing programs, and generic settings. More specific settings for different specific programs can include Word™, Outlook™ and the like. For each of these programs, the user can select various options from the “then” in 710. The current selection (e.g. the usual default) is shown in the pop-up list at 715. The default can be from any of the options discussed above or any other possible option. The “else” options specify what to do if the specified content is not available.
[0039] In addition, the rule-based interface enables different operations at different times. For example, as shown, the user can specify an additional “If” 718. For example, if more than four documents are open, then use the alternative screen in a different way than it would be used if 3 or fewer documents are open. A priority 730 is also set, to determine how to handle multiple rules. The priority sets the order of execution of the rules.
[0040] Each of these preferences is then compiled into a plurality of text-based rules shown in FIG. 8 . The rules are of the general form if X, and Y, or Z (conditions), then alternative screen=option (results). These text based rules may be used directly as the rules for determining what to display on the extra screen, or alternatively they can be compiled into some machine readable form.
[0041] The rules are assembled based on their priority. Each time a rule is completed, the go button 740 is executed. This rule is then added to the end of the list for that priority assigned to that rule. For example, FIG. 8 shows the priority 1 rules 800 including rules 805 and like. If a new priority 1 rule is executed, that priority 1 rule is added to the end of the existing priority 1 rules at the location 810. Similarly, there is a location for priority 2 rules, priority 3 rules and the like. Any of the rules can be selected as shown in FIG. 8 , selecting the rules 815. Once the rule 815 is selected, a menu is displayed including the ability to edit the rule or other operations which can occur on the rule. Editing the rule brings up the screen of FIG. 7 , enabling the rule to be edited to change its priority, its actions, or any other part of the rule. The rule can also be deleted, paused or any other option. Another useful option is DEFAULT which sets this rule as the default rule for the “If” condition associated with that rule, and MAKE UNCHANGEABLE which prevents context automatic formation from changing the rule in the future.
[0042] The rules are shown above as editable using pull down boxes of alternatives. However, the rules can alternatively be plain text type rules, e.g., using Visual Basic or other comparable programming language. The rules can also be written as part of a registry file, e.g., the WINDOWS™ registry. Any form of rule which has conditions and results can be used.
[0043] In addition to the manual editing of the rules, the rules can be automatically formed and/or changed by context type automatic formation. Each time a window is displayed, the user has the capability to override the current contents of that window. This can be done using the menu 306, for example. The flowchart effecting that manual operation is shown in FIG. 9 .
[0044] A change is detected at 900. Once the change is detected, the conditions of the change are detected at 905. That is, a currently running application is detected and all Ifs associated with that currently running application are pulled up. A determination is then made about whether the current condition represents the currently active condition associated with “Then”, or one of auxiliary “Elses”. At step 910, the system executes the new display condition. This is done by accepting the operation executed in the menu. At step 915 the rule is changed to indicate the new preferences. Of course, this possibility can be overridden. If no rule is found at 905, then a new rule of priority 5 is formed at 920.
[0045] Other modifications are contemplated. For example, other forms could be used to express the rules and the preferences. While this system is disclosed for use in editing rules for display, it should be understood that the selectable form of if-then-else that is described for setting preferences could be used for other preference setting operations, such as in the Windows registry or other comparable preference setting parts. All such modifications are intended to be encompassed within the following claims.
Claims
What is claimed is:
1. A method, comprising:
detecting applications which are running on a computer;
using conditions, including both said applications which are running and preset preferences, to automatically control a content which is displayed on both a main screen and at least one auxiliary screen associated with the computer, wherein said using comprises operating in a first mode in which content on the auxiliary screen includes content associated with said main screen and in which said content on said auxiliary screen is different than the content on the main screen, and operating in a second mode in which said auxiliary screen includes content associated with a previous operation of the computer that is not associated with said main screen, said operating in said first or second mode depending on said conditions that includes both said applications which are running and said preset preferences, wherein in said second mode, said auxiliary screen displays miniature versions of multiple different windows which are running on said computer, said multiple different windows that are displayed on said auxiliary screen being windows that represent only inactive windows other than an active window associated with said main screen; and
defining computer-based rules specifying said conditions, which rules define that if a first condition occurs, then a specified content should be displayed on the auxiliary screen, and using a computer to execute said rules to define said content for said auxiliary screen.
2. The method as in claim 1 wherein said defining computer based rules defines a plurality of computer-based rules having conditions and results, which rules define that if a first condition occurs, where said first condition is that a computer is currently executing an application that is multiple screen enabled and can display different information on different screens, then said application is displayed on both the main screen and on the auxiliary screen as first specified content, and that if a second condition occurs, where said second condition indicates that said application is not multiple screen enabled, then a second specified content, different than the first specified content, is displayed on said auxiliary screen, where the second specified content that is displayed when the second condition is present, is not associated with said application.
3. The method as in claim 1 wherein said preferences include a history content, which shows a previously running operation in the auxiliary screen which includes copies of all open but inactive windows other than said active window, said copies being reduced size copies.
4. The method as in claim 1 wherein said using conditions comprises determining a selection and changing said rules based on said selection.
5. The method as in claim 1 further comprising associating both said main screen and said auxiliary screen with a single computer.
6. The method as in claim 1 further comprising associating said main screen and said auxiliary screens with separate computers and connecting said computers by a computer connection protocol.
7. The method as in claim 1, further comprising manually changing said rules.
8. The method as in claim 1, wherein said inactive windows include a history of plural different documents that were previously opened for editing.
9. A method of determining content for multiple associated computer screens, comprising:
operating an operating system on a computer in which multiple windows of information are open at once, said operating system controlling said multiple windows of information, according to a plurality of computer-based rules having conditions and results which rules define that if a first condition occurs, where said first condition is that a computer is currently executing an application that is multiple screen enabled and can display different information on different screens including at least a main screen and an auxiliary screen, then said application is automatically displayed on both the main screen and on the auxiliary screen in a way that allows interacting with parts of said application that are displayed on said main screen, and also interacting with parts of said application that are displayed on said auxiliary screen, and that if a second condition, occurs, where said second condition indicates that said application is not multiple screen enabled, then a second specified content, different than said application is automatically displayed on said auxiliary screen, where the second specified content that is displayed when the second condition is determined, is not associated with said application; and
using the computer to display main content on a main computer screen and to execute said computer-based rules to automatically determine the content of the auxiliary screen automatically changing the rules when a user changes a content of the screens for specified conditions.
10. The method as in claim 9 further comprising manually editing said rules.
11. The method as in claim 9 further comprising operating an operating system on a computer in which multiple windows of information are open at once, said operating system controlling said multiple windows of information, according to said rules.
12. A method comprising:
detecting conditions in a computer system which has a main display screen associated therewith and an auxiliary display screen associated therewith;
displaying a currently running program in the main display screen, and which operates an operating system on the computer system in which multiple windows of information are open at once, said operating system controlling said multiple windows of information, and where different and separately running applications are open in different windows;
detecting whether a preference of said computer has been set to automatic or manual, and setting a content of the auxiliary screen dependent on said conditions if said preference is set to automatic, and
when said preference is set to automatic, using a plurality of computer-based rules to automatically determine the content on said auxiliary screen, said rules having conditions and results which rules define that if a first condition indicating that a computer is currently executing an application that is multiple screen enabled and can display different information on different screens, then said application is displayed on both the main screen and on the auxiliary screen in a way that allows interacting with parts of said application that are displayed on said main screen, and also interacting with first specified content from said application that are displayed on said auxiliary screen, and that if a second condition indicating that said application is not multiple screen enabled occurs, then a second specified content, different than the first specified content, is displayed on said auxiliary screen, where the second specified content that is displayed when the second condition is determined, is not associated with said application; and
using said computer for automatically changing the rules when a user changes a content of the screens for specified conditions.
13. The method as in claim 12 wherein said automatic setting operates according to said conditions of the computer including at least an application which is running and a previous history of applications which are running.
14. The method as in claim 12 wherein said preference is set by a setting on said auxiliary screen.
15. The method as in claim 12 further comprising using a plurality of rules which rules define that if a first condition occurs, then a specified content should be displayed on the auxiliary screen in said automatic setting.
16. An apparatus comprising:
a computer including a processor, a memory, at least one application running on the computer and an operating system running on the computer;
a plurality of display ports, each said display port associatable with a display, each of said display producing outputs that display content associated with said computer;
said operating system operating to automatically display content associated with a currently running program on a main screen associated with said computer, and to display content associated with a current main program on an auxiliary screen of the computer in a first mode of operation, and to automatically display content associated with a previous history of said computer on said auxiliary screen in a second mode of operation, said first mode or said second mode being automatically selected; and
wherein said memory stores computer-based rules which rules define that if a first condition occurs that indicates that the currently running program is capable of being displayed on multiple screens, then said first mode is established and a first specified content is displayed on the auxiliary screen wherein said first specified content on said auxiliary screen is associated with said content on said main screen in a way that allows interacting with parts of said application that are displayed on said main screen, and also interacting with parts of said application that are displayed on said auxiliary screen, and if a second condition occurs that indicates that the currently running program is not capable of being displayed on multiple screens, then said second mode is established and a second specified content is displayed on said auxiliary screen, where said second specified content is not associated with content on the main screen; and
said operating system programmed for and operating for automatically making new rules when a user changes a content of the screens for specified conditions.
17. The apparatus as in claim 16 wherein said second specified content on said auxiliary screen represents miniature versions of multiple different windows which are running on said computer, said multiple different windows that are displayed on said auxiliary screen being windows that represent only inactive windows other than an active window associated with said main screen.
18. The apparatus as in claim 16 further comprising an interface to said memory that allows manually changing said rules.
Patent Citations (50)
| Patent | Date | Inventor | Cited By |
|---|---|---|---|
| US4566004(A) | 1986-01-01 | Emerson | Applicant |
| US4933885(A) | 1990-06-01 | Kato et al. | Applicant |
| US5179648(A) | 1993-01-01 | Hauck | Applicant |
| US5283856(A) | 1994-02-01 | Gross et al. | Applicant |
| US5307055(A) | 1994-04-01 | Baskin et al. | Applicant |
| US5315697(A) | 1994-05-01 | Nagamatsu | Applicant |
| US5481735(A) | 1996-01-01 | Mortensen et al. | Applicant |
| US5530865(A) | 1996-06-01 | Owens et al. | Applicant |
| US5682486(A) | 1997-10-01 | Grossman et al. | Applicant |
| US5682529(A) | 1997-10-01 | Hendry et al. | Applicant |
| US5694141(A) | 1997-12-01 | Chee | Applicant |
| US5694150(A) | 1997-12-01 | Sigona et al. | Applicant |
| US5727155(A) | 1998-03-01 | Dawson | Applicant |
| US5745109(A) | 1998-04-01 | Nakano et al. | Applicant |
| US5757371(A) | 1998-05-01 | Oran et al. | Applicant |
| US5760776(A) | 1998-06-01 | McGurrin et al. | Applicant |
| US5796397(A) | 1998-08-01 | Kusano | Applicant |
| US5835090(A) | 1998-11-01 | Clark et al. | Applicant |
| US5889517(A) | 1999-03-01 | Ueda et al. | Applicant |
| US5923307(A) | 1999-07-01 | Hogle | Applicant |
| US5987345(A) | 1999-11-01 | Engelmann et al. | Applicant |
| US5995085(A) | 1999-11-01 | Bowen | Applicant |
| US5999177(A) | 1999-12-01 | Martinez | Applicant |
| US6002395(A) | 1999-12-01 | Wagner et al. | Applicant |
| US6006225(A) | 1999-12-01 | Bowman et al. | Applicant |
| US6018340(A) | 2000-01-01 | Butler et al. | Applicant |
| US6043817(A) | 2000-03-01 | Bolnick | Applicant |
| US6099317(A) | 2000-08-01 | Bullwinkel et al. | Applicant |
| US6104359(A) | 2000-08-01 | Endres et al. | Applicant |
| US6144358(A) | 2000-11-01 | Narayanaswamy et al. | Applicant |
| US6191758(B1) | 2001-02-01 | Lee | Applicant |
| US6297817(B1) | 2001-10-01 | Larson et al. | Applicant |
| US6310655(B1) | 2001-10-01 | Godwin | Applicant |
| US6327482(B1) | 2001-12-01 | Miyashita | Applicant |
| US6331840(B1) | 2001-12-01 | Nielson et al. | Applicant |
| US6338004(B1) | 2002-01-01 | Usui | Applicant |
| US6456304(B1) | 2002-09-01 | Angiulo et al. | Applicant |
| US6476832(B1) | 2002-11-01 | Park | Applicant |
| US6522309(B1) | 2003-02-01 | Weber | Applicant |
| US6587082(B1) | 2003-07-01 | Moore | Applicant |
| US6728680(B1) | 2004-04-01 | Aaron et al. | Applicant |
| US6859219(B1) | 2005-02-01 | Sall | Applicant |
| US6971109(B1) | 2005-11-01 | Williams et al. | Applicant |
| US6982682(B1) | 2006-01-01 | Kaulgud et al. | Applicant |
| US7007240(B1) | 2006-02-01 | Anderson et al. | Applicant |
| US7030837(B1) | 2006-04-01 | Vong et al. | Applicant |
| US7032172(B1) | 2006-04-01 | Lee et al. | Applicant |
| US7554510(B1) | 2009-06-01 | Grigor et al. | Applicant |
| US2005/0149879(A1) | 2005-07-01 | Jobs et al. | Applicant |
| JP822436(A) | 1996-01-01 | Applicant |
Non-Patent Literature (8)
- Wikipedia.org, “VMU”, Printed 2008.Applicant
- Harris, “Unofficial Dreamcast FAQ” Feb. 2000.Applicant
- Levine et al., “The Complete Reference: Windows 98” McGraw-Hill, 1998.Applicant
- Wikipedia.org, “Resident Evil 2”, Printed 2008.Applicant
- Wikipedia.org, “Taskbar”, Printed 2008.Applicant
- Dreamcast, “Screen Shot of Biohazard 2 Value Plus Game” game, Capcom, 1999.Applicant
- Dreamcast, Resident Evil 2 manual, Capcom 2000.Applicant
- Dreamcast, Visual memory Unit Instruction Manual, Sega 1999.Applicant