US 7,505,049 B2Grant
Instrumentation
Issue Date:2009-03-17
•17 Claims
•4 Drawing Sheets
Abstract
A method of displaying information on an instrument for viewing by a user includes the steps of a) displaying information on a first focal plane, and b) moving the information displayed on the first focal plane to a different focal plane when an alarm or critical situation arises, and c) then moving the information back to the first focal plane, and d) repeating steps b) and c) in order that the viewer of the instrument becomes aware of the displayed information.
Metadata
Assignee
- Deep Video Imaging Limited
Inventor
- Damon Gabriel Engel
Application Information
Application Number:US 10/489,101
Filing Date:2002-09-11
Priority Date:2001-09-11
Art Unit:2628
Classifications
IPC:
G09G5/00
Patent Drawings (4 sheets)
Description
Technical Field
[0001] The present invention relates generally to improvements to instrumentation.
Background Art
[0002] Any potential improvements in the input speed, comprehension and/or retention of information gained from viewing instruments would clearly be beneficial. This is particularly so where the instrument(s) relay critical information such as alarm conditions would be clearly beneficial to a wide spectrum of users, especially in situations where high speed decision making is necessary e.g.: pilots, or other military personnel, drivers, navigators, air traffic control etc.
[0003] This is particularly important in situations such as alarm conditions or when critical parameters are being exceeded as any delay in comprehension of the situation can be catastrophic or even fatal in some circumstances. Currently the most effective way of bringing the viewers attention to these situations is by turning the information off and then on again to make it “flash”. This flashing usually occurs on a visual display with a single focal plane.”
[0004] The time taken for the viewer's brain to assimilate this information can substantially reduce the options available in some time-critical situations and any improvement in the speed of comprehension and hence response time would provide a great advantage in these situations.
[0005] It is believed that use may be made of the viewers subconscious to enhance the recognised conscious reading mechanisms typically employed during the reading of computer screens, visual displays and so forth.
[0006] The manner in which human beings process visual information has been the subject of extensive and prolonged research in an attempt to understand this complex process. The term preattentive processing has been coined to denote the act of the subconscious mind in analysing and processing visual information which has not become the focus of the viewer's conscious awareness.
[0007] When viewing a large number of visual instruments, certain variations or properties in the visual characteristics of the instruments can lead to rapid detection by preattentive processing.
[0008] This is significantly faster than requiring a user to individually scan each instrument, scrutinising for the presence of the said properties.
[0009] Exactly what properties lend themselves to preattentive processing has in itself been the subject of substantial research. Colour, shape, three-dimensional visual clues, orientation, movement and depth have all been investigated to discern the germane visual features that trigger effective preattentive processing.
[0010] Researchers such as Triesman [1985] conducted experiments using target and boundary detection in an attempt to classify preattentive features. Preattentive target detection was tested by determining whether a target element was present or absent within a field of background distractor elements. Boundary detection involves attempting to detect the boundary formed by a group of target elements with a unique visual feature set within distractors.
[0011] It maybe readily visualised for example that a red circle would be immediately discernible set amongst a number of blue circles. Equally, a circle would be readily detectable if set amongst a number of square shaped distractors.
[0012] In order to test for preattentiveness, the number of distractors as seen is varied and if the search time required to identify the targets remains constant, irrespective of the number of distractors, the search is said to be preattentive. Similar search time limitations are used to classify boundary detection searches as preattentive.
[0013] A widespread threshold time used to classify preattentiveness is 200–250 msec as this only allows the user opportunity for a single ‘look’ at a scene. This timeframe is insufficient for a human to consciously decide to look at a different portion of the scene. Search tasks such as those stated above maybe accomplished in less than 200 msec, thus suggesting that the information in the display is being processed in parallel unattendedly or pre-attentively.
[0014] However, if the target is composed of a conjunction of unique features, i.e. a conjoin search, then research shows that these may not be detected preattentively. Using the above examples, if a target is comprised for example, of a red circle set within distractors including blue circles and red squares, it is not possible to detect the red circle preattentively as all the distractors include one of the two unique features of the target.
[0015] Whilst the above example is based on a relatively simple visual scene, Enns and Rensink [1990] identified that targets given the appearance of being three dimensional objects can also be detected preattentively.
[0016] Thus, for example a target represented by a perspective view of a cube shaded to indicate illumination from above would be preattentively detectable amongst a plurality of distractor cubes shaded to imply illumination from a different direction.
[0017] This illustrates an important principle in that the relatively complex, high-level concept of perceived three dimensionality may be processed preattentively by the sub-conscious mind.
[0018] In comparison, if the constituent elements of the above-described cubes are re-orientated to remove the apparent three dimensionality, subjects cannot preattentively detect targets which have been inverted for example. Additional experimentation by Brown et al [1992] confirms that it is the three-dimensional orientation characteristic which is preattentively detected.
[0019] Nakaymyama and Silverman [1986] showed that motion and depth were preattentive characteristics and that furthermore, stereoscopic depth could be used to overcome the effects of conjoin. This reinforced the work done by Enns Rensink in suggesting that high-level information is conceptually being processed by the low-level visual system of the user.
[0020] To test the effects of depth, subjects were tasked with detecting targets of different binocular disparity relative to the distractors. Results showed a constant response time irrespective of the increase in distractor numbers.
[0021] These experiments were followed by conjoin tasks whereby blue distractors were placed on a front plane whilst red distractors were located on a rear plane and the target was either red on the front plane or blue on the rear plane for stereo colour (SC) conjoin tests, whilst stereo and motion (SM) trials utilised distractors on the front plane moving up or on the back plane moving down with a target on either the front plane moving down or on the back plane moving up.
[0022] Results showed the response time for SC and SM trials were constant and below the 250 msec threshold regardless of the number of distractors. The trials involved conjoin as the target did not possess a feature unique to all the distractors. However, it appeared the observers were able to search each plane preattentively in turn without interference from distractors in another plane.
[0023] This research was further reinforced by Melton and Scharff [1998] in a series of experiments in which a search task consisting of locating an intermediate-sized target amongst large and small distractors tested the serial nature of the search whereby the target was embedded in the same plane as the distractors and the preattentive nature of the search whereby the target was placed in a separate depth plane to the distractors.
[0024] The relative influence of the total number of distractors present (regardless of their depth) verses the number of distractors present solely in the depth plane of the target was also investigated. The results showed a number of interesting features including the significant modification of the response time resulting from the target presence or absence.
[0025] In the target absence trials, the reaction times of all the subjects displayed a direct correspondence to the number of distractors whilst the target present trials did not display any such dependency. Furthermore, it was found that the reaction times in instances where distractors were spread across multiple depths were faster than for distractors located in a single depth plane.
[0026] Consequently, the use of a plurality of depth/focal planes as a means of displaying information can enhance preattentive processing with enhanced reaction/assimilation times.
[0027] It is thus believed that a means of overcoming the above described drawbacks is available by harnessing the peripheral vision and subconscious perception of the reader to assimilate additional information sources simultaneously with the process of the conventional reading of the instruments in order to enhance the speed and effectiveness of the whole reading/viewing process.
[0028] This would have particular relevance to the displaying of alarm situations as this is when the time (or lack of it) in which to respond to the information on a display is most critical.
[0029] It is an object of the present invention to address the foregoing problems or at least to provide the public with a useful choice.
[0030] Further aspects and advantages of the present invention will become apparent from the ensuing description which is given by way of example only.
Disclosure of Invention
[0031] According to an aspect of the present invention there is provided a method of displaying information on an instrument for viewing by a user
[0032] characterised by the steps of
-
- [0033] a) displaying information on a first focal plane, and
- [0034] b) moving the information displayed on the first focal plane to a different focal plane when an alarm or critical situation arises, and
- [0035] c) then moving the information back to the first focal plane, and
- [0036] d) repeating steps b) and c) in order that the viewer of the instrument becomes aware of the displayed information.
[0037] According to a further aspect of the present invention there is provided an instrument for displaying information for viewing by a user, including
[0038] a visual display system including at least two single level screens spaced physically apart to form a multi-level screen, and
[0039] information on a first focal plane
[0040] characterised in that
[0041] when an alarm or critical situation arises the information displayed on the first focal plane will move to a different focal plane and then back to the first focal plane in order that the viewer of the instrument become aware of the displayed information.
[0042] It should be understood that within the present specification the term “information” may consist of alpha-numeric characters, symbols, plain text, images, a combination of the same or any other means of visually representing information.
[0043] In preferred embodiments of the present invention the information will be displayed on a multi-level three-dimensional display device such as that disclosed in New Zealand Patent Number 505800.
[0044] However this should not be seen to be a limitation on the present invention in any way as in other embodiments the information may be displayed on any display device that has more than one focal plane.
[0045] It is envisaged that within preferred embodiments of the present specification a control circuit will have access to a number of system parameters in order that when a parameter goes beyond its specified level then the control circuit will signal to the display in order that the appropriate information displayed on the first focal plane will move to another focal plane and then back to the first focal plane so that the viewer will become aware of the displayed information and can therefore can take steps to rectify the situation.
[0046] Preferably the movement of the information between focal planes is done a number of times—sufficient for the viewer to become aware of the displayed information.
[0047] It should be understood that throughout the present specification the term “alarm or critical situation” should be understood to mean when a system parameter is exceeded or an external influence has to be taken account of. For example, in a military situation this could be the proximity of another object such as a plane, missile etc., or it can even be the receiving of a signal such as a radar-lock from a missile.
[0048] The techniques of making a viewer preattentively aware are described in the background art section of this specification and within this explanation it makes it clear that moving information from one focal plane to another is a very fast and effective method for inducing preattentive awareness.
[0049] One of the extreme advantages of this technique is that the viewer need only have the information in their peripheral vision for the technique to be effective. This fact alone will vastly improve the reaction time to an alarm as when preattentive techniques are not used then the viewer generally needs to focus on the alarm information in order to comprehend its relevance or meaning.
[0050] According to another aspect of the present invention there is provided a method of displaying information for viewing by a user, including
[0051] at least two focal planes, and
[0052] a control system
[0053] characterised by the steps of:
-
- [0054] a) displaying primary information in a distinct colour or pattern on a first focal plane, and
- [0055] b) displaying secondary information in a distinct colour or pattern on at least a second focal plane, and
- [0056] c) when the primary and secondary information overlap or come into a proximity that is commensurate with an alarm situation the displayed information will change colour or pattern so that the viewer will become aware of this information.
[0057] According to yet another aspect of the present invention there is provided an instrument for displaying information for viewing by a user, including
[0058] a visual display system including at least two single level screens spaced physically apart to form a multi-level screen, and
[0059] primary information displayed in a distinct colour or pattern on the first focal plane of the instrument, and secondary information displayed in a distinct colour or pattern on at least the second focal plane of the instrument,
[0060] characterised in that
[0061] when the primary and secondary information overlap or come into a proximity that is commensurate with an alarm situation the displayed information will change colour or pattern so that the viewer will become aware of this information.
[0062] It should be further understood that within the present specification the terms “primary information” and “secondary information” are not intended to infer or suggest any hierarchical relationship or degree of relative importance between the primary and secondary information. In general the terms are used to disseminate between information on different focal planes within the display.
[0063] The term pattern is intended to mean a distinct configuration. For example, a first pattern may be a series of horizontal lines within the second pattern vertical lines. The resultant new pattern formed by an overlap may be hatched grid indicating an alarm situation.
[0064] Preferably the information is represented by colour.
[0065] Due to the fact that the primary information and the secondary information are displayed on separate focal planes within the screen the area of overlap will automatically be a combination of the two colours i.e.: the colour of the primary information and the colour of the secondary information.
[0066] This means that no special control or software will be necessary to change the colour of the overlapped area as the image on the second focal plane can clearly be seen through the first focal plane as this is a transparent plane and therefore when the secondary information passes behind part or all of the primary information the colour of the image seen by the viewer will change accordingly.
[0067] It is understood that in preferred embodiments of the present invention the colour of the primary information and the colour of the secondary information will be quite distinct so as to form a new distinct colour when they are combined by an overlap of the information e.g.: if the primary information was yellow and the secondary information was blue then the overlapped area would clearly be green, this is an easily disseminatable colour from either yellow or blue and would therefore be easily and quickly recognised by the viewer.
[0068] In some embodiments of the present specification the instrument will be capable of using both of the described methods for displaying information, however this should not be seen to be a limitation on the present invention in any way as in other preferred embodiments only one of the methods will be able to be displayed on the instrument.
[0069] When an alarm or critical situation is detected by the circuits to which the instrument is connected the circuit will instruct the instrument to display the information as described, in order that the viewer of the instrument will be able to preattentively assimilate that an alarm or critical condition has been detected.
[0070] The most significant advantage of the present invention is that by using the preattentive trigger described within this specification rather than just a flashing of the information (or a separate lamp) the viewer of the information will be able to assimilate the information or the condition more rapidly, which will in turn provide the viewer with a greater time in which to react to the situation.
[0071] It is accepted that with a lot of instruments the time in which the viewer will need to react to the information being displayed will be sufficient for most normal methods of relating the alarm situation to the viewer.
[0072] However, particularly for military and avionic applications the time in which a decision has to be reached, or remedial action needs to be initiated, can be incredibly short and any improvement to the viewer's reaction time or ability to assimilate the information more readily and rapidly will provide a distinct and possibly life-saving advantage.
[0073] The present invention has many distinct and substantial advantages over any method available before, as stated previously the greatest of these is that due to the faster perception time to an alarm situation the remedial action can be initiated more rapidly which in turn will substantially increase the chance of the remedial action being successful.
[0074] Another advantage is that in applications that currently use the separate alarm panel, by using the instruments disclosed within the present specification these panels will become obsolete therefore freeing up space in what is generally a confined environment.
[0075] A further advantage in these applications is that the viewer will have less areas in which to scan for relevant information and will therefore have lower fatigue levels than would presently be encountered.
Brief Description of Drawings
[0076] Further aspects of the present invention will become apparent from the following description which is given by way of example only and with reference to the accompanying drawings in which:
[0077] FIG. 1 is a simplified perspective view of a dual screen display operating in accordance with one preferred embodiment of the present invention.
[0078] FIGS. 2A–2B arc schematic front views of a display in accordance with an embodiment, showing primary and secondary information prior to a “critical situation” and after such a “critical Situation” occurs, respectively.
Best Modes for Carrying Out the Invention
[0079] With reference to FIG. 1 there is shown an instrument containing a multi focal plane display generally indicated by arrow 1.
[0080] The instrument for displaying information or instrument display 1 consists of a background screen (2) in a parallel orientation with, but spaced apart from, a foreground screen (3).
[0081] In FIG. 1 both screens (2, 3) are transparent liquid crystal displays (LCD) panels, although the invention is not necessarily limited to the use of these displays.
[0082] A back light (4) is located behind the background screen (2) to provide illumination for the entire instrument display (1).
[0083] Each of the screens (2, 3) are capable of displaying either primary (5) or secondary (6) information.
[0084] FIG. 1 shows the primary information (5) is displayed on the foreground screen (3) and secondary information (6) is displayed on the background screen (2).
[0085] It should be appreciated however that the reverse situation is equally feasible with the primary information (5) being displayed on the background screen (2) and the secondary information (6) being displayed on the foreground screen (3).
[0086] It should also be appreciated that in a lot of applications only one piece of information (5, 6) will be shown on the instrument display (1). This information (5, 6) can be on either the background screen (2) or the foreground screen (3).
[0087] When the displayed information (5, 6) reaches a critical parameter or “alert level” the information will oscillate between the background screen (2) and the foreground screen (3) in order that the viewer will become preattentively aware that a critical situation is developing or has developed already.
[0088] In applications where both primary information (5) and secondary information (6) are present on the instrument display (1) either of the two methods of preattentiveness may be used.
[0089] For example:
-
- [0090] a) When the primary information (5) and the secondary information (6) overlap or come into a proximity that is commensurate with an alarm situation the displayed information (5, 6) will change colour so that the viewer will be aware of this information.
- [0091] Due to the transparency of the focal planes within the display, when the primary information (5) and the secondary information (6) overlap the combination of their colours will be displayed.
- [0092] As discussed previously if the colours of the primary information (5) and the secondary information (6) are chosen carefully then the colour of the overlapped information (5, 6) would be obviously different to the viewer. The example mentioned earlier was if the primary information (5) was yellow and the secondary information (6) was blue then the colour of the overlap (5, 6) would be green.
FIGS. 2A–2B show an embodiment in which the primary and secondary information (5.6) are displayed in first and second patterns, respectively, and a new pattern (7) is formed when the first and second patterns overlap. - [0093] b) If either the primary (5) or secondary (6) information reaches a critical or alarm level then the appropriate information (5,6) will oscillate between the background screen (2) and the foreground screen (3) thereby making the viewer preattentively aware of the situation.
[0094] Aspects of the present invention have been described by way of example only and it should be appreciated that modifications and additions may be made thereto without departing from the scope of the appended claims.
Claims
I claim:
1. A method of displaying information on an instrument, said method comprising the steps of:
(a) displaying information on a first focal plane;
(b) moving the information displayed on the first focal plane to a different second focal plane when an alarm or critical situation arises;
(c) then moving the information back to the first focal plane; and
(d) repeating steps (b) and (c) in order that a viewer of the instrument becomes preattentively aware of the alarm or critical situation.
2. The method of claim 1, wherein step (d) comprises controllably repeating steps (b) and (c) for alerting the viewer of the instrument of the alarm or critical situation.
3. The method of claim 1, further comprising
arranging first and second LCD (liquid crystal display) panels one in front of another, and a common backlight unit behind said LCD panels, said first and second LCD panels defining said first and second focal planes, respectively; and
powering said common backlight unit during step (d) to use both LCD panels for alerting the viewer of the instrument of the alarm or critical situation.
4. The method of claim 1, further comprising:
connecting a control circuit to a system;
accessing, by said control circuit, to a number of parameters of said system;
when a parameter among said parameters of said system is at, or goes beyond, a specified level, automatically signaling, by the control circuit, the instrument to perform steps (b)–(d) so that the viewer becomes preattentively aware of the alarm or critical situation.
5. A method of displaying information using at least two focal planes, said method comprising the steps of:
(a) displaying primary information in a first distinct color or pattern on a first focal plane;
(b) displaying secondary information in a second distinct color or pattern on at least a second focal plane; and
(c) when the primary and secondary information overlap or come into a proximity that is commensurate with an alarm situation, the displayed information will change color or pattern so that a viewer will become preattentively aware of the alarm or critical situation.
6. The method of claim 5, wherein, in step (c), an overlapping region of said primary and secondary information is displayed in a third distinct color or pattern which is a combination of said first and second colors or patterns.
7. The method of claim 5, further comprising positioning said second focal plane behind said first focal plane which is transparent, and allowing the secondary information to be visible through said transparent first focal plane simultaneously with said primary information being displayed on said first focal plane.
8. The method of claim 5, further comprising positioning said second focal plane behind said first focal plane which is transparent, wherein, in step (c), said secondary information is displayed simultaneously with said primary information and visible through at least a part of said primary information.
9. An instrument for displaying information, comprising:
a visual display system including at least two single level screens spaced physically apart to form a multi-level screen, each of said level screens representing a focal plane; and
information on a first focal plane;
wherein when an alarm or critical situation arises, the information displayed on the first focal plane will move to a different focal plane and then back again so that a viewer becomes preattentively aware of the alarm or critical situation.
10. The instrument as claimed in claim 9, further comprising a control circuit which has access to a number of parameters for a system to which said circuit is connected in order that when a parameter is at, or goes beyond, a specified level, then the control circuit will signal to the visual display system in order that the appropriate information displayed on the first focal plane will move to another focal plane and then back to the first focal plane so that the viewer becomes preattentively aware of the alarm or critical situation.
11. The instrument as claimed in claim 9, wherein the information will be displayed on a visual display system including at least two single level screens spaced physically apart to form a multi-level screen display device.
12. The instrument in claim 11, further comprising a control circuit which has access to a number of parameters for a system to which said circuit is connected in order that when a parameter is at, or goes beyond, a specified level, then the control circuit with automatically signal to the visual display system in order that the appropriate information displayed on the first focal plane will move to another focal plane and then back to the first focal plane so that the viewer becomes preattentively aware of the alarm or critical situation.
13. An instrument for displaying information, comprising:
a visual display system including at least two single level screens spaced physically apart to form a multi-level screen, each of said level screens representing a focal plane and being configured to display a variety of colors and/or patterns; and
primary information displayed in a distinct color or pattern on the first focal plane of the instrument; and
secondary information displayed in a distinct color on at least the second focal plane of the instrument;
wherein when said primary and secondary information overlap, or come into a proximity, the displayed information will change color or pattern so that a viewer of the instrument becomes preattentively aware of the displayed information.
14. The instrument as claimed in claim 13, wherein the color or pattern of the primary information and the color or pattern of the secondary information form a new distinct color or pattern when they are combined by an overlap of the information.
15. The instrument as claimed in claim 13, wherein
said level screens include a background screen and a foreground screen placed in front of said background screen; and
said foreground screen is operable to simultaneously display said primary information and be transparent to allow the secondary information display by the background screen to be visible through said foreground screen.
16. The instrument as claimed in claim 13, further comprising a control circuit for repeatedly moving the primary information back and forth between the first and second focal planes when an alarm or critical situation associated with said primary information arises in order to alert the viewer of the alarm or critical situation.
17. The instrument as claimed in claim 13, wherein said level screens comprise first and second transparent LCD (liquid crystal display) panels defining said first and second focal planes, respectively;
said instrument further comprising a backlight unit common for both said first and second LCD panels, said backlight unit being placed behind said LCD panels.
Patent Citations (243)
| Patent | Date | Inventor | Cited By |
|---|---|---|---|
| US3940788(A) | 1976-02-01 | Abe et al. | Applicant |
| US3967881(A) | 1976-07-01 | Moriyama et al. | Applicant |
| US4153654(A) | 1979-05-01 | Maffitt et al. | Applicant |
| US4239349(A) | 1980-12-01 | Scheffer | Applicant |
| US4333715(A) | 1982-06-01 | Brooks | Applicant |
| US4371870(A) | 1983-02-01 | Biferno | Examiner |
| US4423929(A) | 1984-01-01 | Gomi | Applicant |
| US4443062(A) | 1984-04-01 | Togashi et al. | Applicant |
| US4447141(A) | 1984-05-01 | Eisenkraft | Applicant |
| US4472737(A) | 1984-09-01 | Iwasaki | Applicant |
| US4523848(A) | 1985-06-01 | Gorman et al. | Applicant |
| US4556286(A) | 1985-12-01 | Uchida et al. | Applicant |
| US4568928(A) | 1986-02-01 | Biferno | Examiner |
| US4613896(A) | 1986-09-01 | Takita et al. | Applicant |
| US4648691(A) | 1987-03-01 | Oguchi et al. | Applicant |
| US4649425(A) | 1987-03-01 | Pund | Applicant |
| US4712869(A) | 1987-12-01 | Claxton John C. | Applicant |
| US4757626(A) | 1988-07-01 | Weinreich | Applicant |
| US4927240(A) | 1990-05-01 | Stolov et al. | Applicant |
| US4947257(A) | 1990-08-01 | Fernandez et al. | Applicant |
| US5046826(A) | 1991-09-01 | Iwamoto et al. | Applicant |
| US5046827(A) | 1991-09-01 | Frost et al. | Applicant |
| US5049870(A) | 1991-09-01 | Fitzgerald et al. | Applicant |
| US5075993(A) | 1991-12-01 | Weinreich | Applicant |
| US5091720(A) | 1992-02-01 | Wood | Applicant |
| US5112121(A) | 1992-05-01 | Chang et al. | Applicant |
| US5113272(A) | 1992-05-01 | Reamey | Applicant |
| US5124803(A) | 1992-06-01 | Troxel | Applicant |
| US5198936(A) | 1993-03-01 | Stringfellow | Applicant |
| US5255028(A) | 1993-10-01 | Biles | Applicant |
| US5255356(A) | 1993-10-01 | Michelman et al. | Applicant |
| US5261404(A) | 1993-11-01 | Mick et al. | Applicant |
| US5283560(A) | 1994-02-01 | Bartlett | Applicant |
| US5289297(A) | 1994-02-01 | Bollman et al. | Applicant |
| US5300942(A) | 1994-04-01 | Dolgoff | Applicant |
| US5317686(A) | 1994-05-01 | Salas et al. | Applicant |
| US5333255(A) | 1994-07-01 | Damouth | Applicant |
| US5337181(A) | 1994-08-01 | Kelly | Applicant |
| US5367801(A) | 1994-11-01 | Ahn | Applicant |
| US5416890(A) | 1995-05-01 | Beretta | Applicant |
| US5416895(A) | 1995-05-01 | Anderson et al. | Applicant |
| US5418898(A) | 1995-05-01 | Zand et al. | Applicant |
| US5432626(A) | 1995-07-01 | Sasuga et al. | Applicant |
| US5463724(A) | 1995-10-01 | Anderson et al. | Applicant |
| US5465101(A) | 1995-11-01 | Akiba et al. | Applicant |
| US5473344(A) | 1995-12-01 | Bacon et al. | Applicant |
| US5475812(A) | 1995-12-01 | Corona et al. | Applicant |
| US5502805(A) | 1996-03-01 | Anderson et al. | Applicant |
| US5515484(A) | 1996-05-01 | Sfarti et al. | Applicant |
| US5537233(A) | 1996-07-01 | Miura et al. | Applicant |
| US5585821(A) | 1996-12-01 | Ishikura et al. | Applicant |
| US5590259(A) | 1996-12-01 | Anderson et al. | Applicant |
| US5600462(A) | 1997-02-01 | Suzuki et al. | Applicant |
| US5604854(A) | 1997-02-01 | Glassey | Applicant |
| US5623591(A) | 1997-04-01 | Cseri | Applicant |
| US5638501(A) | 1997-06-01 | Gough et al. | Applicant |
| US5651107(A) | 1997-07-01 | Frank et al. | Applicant |
| US5663746(A) | 1997-09-01 | Pellenberg et al. | Applicant |
| US5664127(A) | 1997-09-01 | Anderson et al. | Applicant |
| US5675755(A) | 1997-10-01 | Trueblood | Applicant |
| US5694532(A) | 1997-12-01 | Carey et al. | Examiner |
| US5706139(A) | 1998-01-01 | Kelly | Applicant |
| US5721847(A) | 1998-02-01 | Johnson | Applicant |
| US5745197(A) | 1998-04-01 | Leung et al. | Applicant |
| US5757522(A) | 1998-05-01 | Kulick et al. | Applicant |
| US5764317(A) | 1998-06-01 | Sadovnik et al. | Applicant |
| US5796455(A) | 1998-08-01 | Mizobata et al. | Applicant |
| US5805163(A) | 1998-09-01 | Bagnas | Applicant |
| US5813742(A) | 1998-09-01 | Gold et al. | Applicant |
| US5825436(A) | 1998-10-01 | Knight | Applicant |
| US5828420(A) | 1998-10-01 | Marshall et al. | Applicant |
| US5831615(A) | 1998-11-01 | Drews et al. | Applicant |
| US5835088(A) | 1998-11-01 | Jaaskelainen, Jr. | Applicant |
| US5880742(A) | 1999-03-01 | Rao et al. | Applicant |
| US5883623(A) | 1999-03-01 | Cseri | Applicant |
| US5883627(A) | 1999-03-01 | Pleyer | Applicant |
| US5883635(A) | 1999-03-01 | Rao et al. | Applicant |
| US5890174(A) | 1999-03-01 | Khanna et al. | Applicant |
| US5923307(A) | 1999-07-01 | Hogle, IV | Applicant |
| US5963197(A) | 1999-10-01 | Bacon et al. | Applicant |
| US5982417(A) | 1999-11-01 | Blonde | Applicant |
| US5990990(A) | 1999-11-01 | Crabtree | Applicant |
| US5999191(A) | 1999-12-01 | Frank et al. | Applicant |
| US6005654(A) | 1999-12-01 | Kipfer et al. | Applicant |
| US6016385(A) | 2000-01-01 | Yee et al. | Applicant |
| US6018379(A) | 2000-01-01 | Mizobata et al. | Applicant |
| US6031530(A) | 2000-02-01 | Trueblood | Applicant |
| US6037937(A) | 2000-03-01 | Beaton et al. | Applicant |
| US6054969(A) | 2000-04-01 | Haisma | Applicant |
| US6057814(A) | 2000-05-01 | Kalt | Applicant |
| US6061110(A) | 2000-05-01 | Hisatake et al. | Applicant |
| US6067137(A) | 2000-05-01 | Ohnishi et al. | Applicant |
| US6072489(A) | 2000-06-01 | Gough et al. | Applicant |
| US6075531(A) | 2000-06-01 | DeStefano | Applicant |
| US6085202(A) | 2000-07-01 | Rao et al. | Applicant |
| US6111614(A) | 2000-08-01 | Mugura et al. | Applicant |
| US6114814(A) | 2000-09-01 | Shannon et al. | Applicant |
| US6118427(A) | 2000-09-01 | Buxton et al. | Applicant |
| US6163318(A) | 2000-12-01 | Fukuda et al. | Applicant |
| US6181349(B1) | 2001-01-01 | Bardon et al. | Applicant |
| US6204902(B1) | 2001-03-01 | Kim et al. | Applicant |
| US6215538(B1) | 2001-04-01 | Narutaki et al. | Applicant |
| US6239852(B1) | 2001-05-01 | Oono et al. | Applicant |
| US6246407(B1) | 2001-06-01 | Wilks et al. | Applicant |
| US6282551(B1) | 2001-08-01 | Anderson et al. | Applicant |
| US6300990(B1) | 2001-10-01 | Yamaguchi et al. | Applicant |
| US6310733(B1) | 2001-10-01 | Dolgoff | Applicant |
| US6317128(B1) | 2001-11-01 | Harrison et al. | Applicant |
| US6326738(B1) | 2001-12-01 | McAndrew | Applicant |
| US6327592(B1) | 2001-12-01 | Yoshikawa | Applicant |
| US6351298(B1) | 2002-02-01 | Mitsui et al. | Applicant |
| US6356281(B1) | 2002-03-01 | Isenman | Applicant |
| US6369830(B1) | 2002-04-01 | Brunner et al. | Applicant |
| US6377229(B1) | 2002-04-01 | Sullivan | Applicant |
| US6377306(B1) | 2002-04-01 | Johnson et al. | Applicant |
| US6384840(B1) | 2002-05-01 | Frank et al. | Applicant |
| US6388648(B1) | 2002-05-01 | Clifton et al. | Applicant |
| US6418426(B1) | 2002-07-01 | Schlesinger | Applicant |
| US6443579(B1) | 2002-09-01 | Myers | Applicant |
| US6466185(B2) | 2002-10-01 | Sullivan et al. | Applicant |
| US6468157(B1) | 2002-10-01 | Hinami et al. | Applicant |
| US6489044(B1) | 2002-12-01 | Chen et al. | Applicant |
| US6496832(B2) | 2002-12-01 | Chi et al. | Applicant |
| US6504587(B1) | 2003-01-01 | Morishita et al. | Applicant |
| US6505209(B1) | 2003-01-01 | Gould et al. | Applicant |
| US6512559(B1) | 2003-01-01 | Hashimoto et al. | Applicant |
| US6515881(B2) | 2003-02-01 | Chou et al. | Applicant |
| US6525699(B1) | 2003-02-01 | Suyama et al. | Applicant |
| US6587118(B1) | 2003-07-01 | Yoneda | Applicant |
| US6609799(B1) | 2003-08-01 | Myers | Applicant |
| US6610102(B1) | 2003-08-01 | Aldred et al. | Applicant |
| US6661425(B1) | 2003-12-01 | Hiroaki | Examiner |
| US6693692(B1) | 2004-02-01 | Kaneko et al. | Applicant |
| US6694486(B2) | 2004-02-01 | Frank et al. | Applicant |
| US6697135(B1) | 2004-02-01 | Baek et al. | Applicant |
| US6720961(B2) | 2004-04-01 | Tracy | Applicant |
| US6721713(B1) | 2004-04-01 | Guheen et al. | Applicant |
| US6725422(B1) | 2004-04-01 | Bauchot et al. | Applicant |
| US6760003(B1) | 2004-07-01 | Sase | Applicant |
| US6771327(B2) | 2004-08-01 | Sekiguchi | Applicant |
| US6812649(B2) | 2004-11-01 | Kim | Applicant |
| US6859907(B1) | 2005-02-01 | McGarry | Applicant |
| US6906762(B1) | 2005-06-01 | Witehira et al. | Applicant |
| US6940507(B2) | 2005-09-01 | Repin et al. | Applicant |
| US6947024(B2) | 2005-09-01 | Lee et al. | Applicant |
| US6958748(B1) | 2005-10-01 | Fukui et al. | Applicant |
| US7016116(B2) | 2006-03-01 | Dolgoff | Applicant |
| US7106275(B2) | 2006-09-01 | Brunner et al. | Applicant |
| US7113188(B2) | 2006-09-01 | Kuroda et al. | Applicant |
| US7262752(B2) | 2007-08-01 | Weindorf | Applicant |
| US2001/0026625(A1) | 2001-10-01 | Azima et al. | Applicant |
| US2002/0001055(A1) | 2002-01-01 | Kimura et al. | Applicant |
| US2002/0012369(A1) | 2002-01-01 | Nasu et al. | Applicant |
| US2002/0047601(A1) | 2002-04-01 | Shannon et al. | Applicant |
| US2002/0064037(A1) | 2002-05-01 | Lee | Applicant |
| US2002/0091728(A1) | 2002-07-01 | Kjaer et al. | Applicant |
| US2002/0093516(A1) | 2002-07-01 | Brunner et al. | Applicant |
| US2002/0105516(A1) | 2002-08-01 | Tracy | Applicant |
| US2002/0109684(A1) | 2002-08-01 | Repin et al. | Applicant |
| US2002/0111195(A1) | 2002-08-01 | Kweon et al. | Applicant |
| US2002/0126396(A1) | 2002-09-01 | Dolgoff | Applicant |
| US2002/0163728(A1) | 2002-11-01 | Myers | Applicant |
| US2002/0163729(A1) | 2002-11-01 | Myers | Applicant |
| US2002/0171682(A1) | 2002-11-01 | Frank et al. | Applicant |
| US2003/0043106(A1) | 2003-03-01 | Woo | Applicant |
| US2003/0132895(A1) | 2003-07-01 | Berstis | Applicant |
| US2003/0184665(A1) | 2003-10-01 | Berstis | Applicant |
| US2004/0012708(A1) | 2004-01-01 | Matherson | Applicant |
| US2004/0239582(A1) | 2004-12-01 | Seymour | Examiner |
| AU82482/98 | 1998-09-01 | Applicant | |
| AU25542/99 | 1999-09-01 | Applicant | |
| AU24806/00 | 2000-07-01 | Applicant | |
| AU24538/00 | 2000-08-01 | Applicant | |
| AU68219/01 | 2001-12-01 | Applicant | |
| BE1011678 | 1999-12-01 | Applicant | |
| CA2009960 | 1990-09-01 | Applicant | |
| CA2139696 | 1995-07-01 | Applicant | |
| CA2320694 | 1999-08-01 | Applicant | |
| CA2329702 | 1999-09-01 | Applicant | |
| CN1201157 | 1998-12-01 | Applicant | |
| EP389123 | 1990-09-01 | Applicant | |
| EP454423(A1) | 1991-10-01 | Examiner | |
| EP460314 | 1991-12-01 | Applicant | |
| EP662669 | 1994-01-01 | Applicant | |
| EP595387 | 1994-05-01 | Applicant | |
| EP605945 | 1994-07-01 | Applicant | |
| EP703563 | 1996-03-01 | Applicant | |
| EP802684 | 1997-10-01 | Applicant | |
| EP935191 | 1999-08-01 | Applicant | |
| EP1057070 | 1999-08-01 | Applicant | |
| EP1058862 | 1999-09-01 | Applicant | |
| EP999088 | 2000-05-01 | Applicant | |
| EP1151430 | 2000-08-01 | Applicant | |
| EP1177527 | 2000-11-01 | Applicant | |
| EP1093008 | 2001-04-01 | Applicant | |
| EP1287401 | 2003-03-01 | Applicant | |
| FR2609941 | 1988-07-01 | Applicant | |
| GB2145897 | 1985-04-01 | Applicant | |
| GB2245092 | 1991-12-01 | Applicant | |
| GB2312584 | 1997-10-01 | Applicant | |
| GB2347003 | 2000-08-01 | Applicant | |
| GB2372618 | 2002-08-01 | Applicant | |
| IL93472 | 1994-11-01 | Applicant | |
| JP3-174580 | 1991-07-01 | Applicant | |
| JP3-226095 | 1991-10-01 | Applicant | |
| JP4-191755 | 1992-07-01 | Applicant | |
| JP5040449 | 1993-02-01 | Applicant | |
| JP6274305 | 1994-09-01 | Applicant | |
| JP8030388 | 1996-02-01 | Applicant | |
| JP8095741 | 1996-04-01 | Applicant | |
| JP9-033858 | 1997-02-01 | Applicant | |
| JP9-308769 | 1997-12-01 | Applicant | |
| JP10-005829 | 1998-01-01 | Applicant | |
| JP10-039782 | 1998-02-01 | Applicant | |
| JP10-039821 | 1998-02-01 | Applicant | |
| JP10-105829 | 1998-04-01 | Applicant | |
| JP10-228347 | 1998-08-01 | Applicant | |
| JP10-301508 | 1998-11-01 | Applicant | |
| JP9308769 | 1999-07-01 | Applicant | |
| JP11205822 | 1999-07-01 | Applicant | |
| JP11272846 | 1999-10-01 | Applicant | |
| JP2000-142173 | 2000-05-01 | Applicant | |
| JP2000347645 | 2000-12-01 | Applicant | |
| JP2001324608 | 2001-11-01 | Applicant | |
| JP2002271819 | 2002-09-01 | Applicant | |
| NL1005868 | 1997-10-01 | Applicant | |
| NZ505801 | 2002-08-01 | Applicant | |
| NZ505800 | 2002-09-01 | Applicant | |
| WO88/05389 | 1988-07-01 | Applicant | |
| WO99/42889 | 1999-08-01 | Applicant | |
| WO99/44095 | 1999-09-01 | Applicant | |
| WO/036578 | 2000-06-01 | Applicant | |
| WO/36578 | 2000-06-01 | Applicant | |
| WO/048167 | 2000-08-01 | Applicant | |
| WO/48167 | 2000-08-01 | Applicant | |
| WO/68887 | 2000-11-01 | Applicant | |
| WO1/01290 | 2001-01-01 | Applicant | |
| WO1/15128 | 2001-03-01 | Applicant | |
| WO1/095019 | 2001-12-01 | Applicant | |
| WO1/95019 | 2001-12-01 | Applicant | |
| WO2/091033 | 2002-11-01 | Applicant | |
| WO3/003109 | 2003-01-01 | Applicant | |
| ZA9703025 | 1997-11-01 | Applicant |
Non-Patent Literature (43)
- Ishii, H., Kobayashi, M., and Arita K., “Interative Design of Seamless Collaboration Media,” Aug. 1994/vol. 37, No. 8 Communications of the ACM.Applicant
- Harrison, B., Ishii, H., Vicente, K., and Buxton, W., “Transparent Layered User Interfaces: An Evaluation of A Display Design to Enhance Focused and Divided Attention,” 1995, CHI Proceedings.Applicant
- Courter, G. and Marquis, A., “Mastering Microsoft Office 2000 Professional Edition,” 1999 Sybex, Inc.Applicant
- “Textarc: An Alternate Way to View A Text,” http://textarc.org.Applicant
- “Textarc: The Print and the Artist,” http://textarc.org.Applicant
- “Textarc: NYSCA Grant and Public Installation,” http://textarc.org.Applicant
- “Teamworkstation 1989-1994,” http://web.media.mit.edu/˜ishii/TWS.html.Applicant
- “Clearboard 1991-1994,” http://web.media.mit.edu/˜ishii/CB.html.Applicant
- Office Action; U.S. Appl. No. 10/048,638; Mail Date Nov. 27, 2007.Applicant
- Office Action; U.S. Appl. No. 10/048,638; Mail Date Jun. 6, 2008.Applicant
- Office Action; U.S. Appl. No. 10/048,638; Mail Date Jun. 26, 2006.Applicant
- Office Action; U.S. Appl. No. 10/048,638; Mail Date Oct. 17, 2005.Applicant
- Office Action; U.S. Appl. No. 10/048,638; Mail Date Jun. 6, 2007.Applicant
- Office Action; U.S. Appl. No. 10/048,966; Mail Date Sep. 18, 2007.Applicant
- Office Action; U.S. Appl. No. 10/048,966; Mail Date May 2, 2007.Applicant
- Office Action; U.S. Appl. No. 10/048,966; Mail Date Aug. 18, 2006.Applicant
- Office Action; U.S. Appl. No. 10/048,966; Mail Date Jul. 14, 2005.Applicant
- Office Action; U.S. Appl. No. 10/048,966; Mail Date Jan. 27, 2005.Applicant
- Office Action; U.S. Appl. No. 10/049,271; Mail Date Aug. 5, 2008.Applicant
- Office Action; U.S. Appl. No. 10/049,271; Mail Date Aug. 23, 2006.Applicant
- Office Action; U.S. Appl. No. 10/049,271; Mail Date Feb. 8, 2006.Applicant
- Office Action; U.S. Appl. No. 10/049,271; Mail Date May 18, 2005.Applicant
- Office Action; U.S. Appl. No. 10/049,271; Mail Date Feb. 5, 2008.Applicant
- Office Action; U.S. Appl. No. 10/049,272; Mail Date Mar. 25, 2008.Applicant
- Office Action; U.S. Appl. No. 10/049,272; Mail Date Oct. 12, 2007.Applicant
- Office Action; U.S. Appl. No. 10/049,272; Mail Date Aug. 28, 2006.Applicant
- Office Action; U.S. Appl. No. 10/049,272; Mail Date Jan. 23, 2006.Applicant
- Office Action; U.S. Appl. No. 10/049,272; Mail Date Jul. 13, 2005.Applicant
- Office Action; U.S. Appl. No. 10/049,272; Mail Date Dec. 31, 2003.Applicant
- Office Action; U.S. Appl. No. 10/476,590; Mail Date Feb. 28, 2008.Applicant
- Office Action; U.S. Appl. No. 10/476,590; Mail Date Oct. 16, 2007.Applicant
- Office Action; U.S. Appl. No. 10/476,590; Mail Date Apr. 19, 2007.Applicant
- Office Action; U.S. Appl. No. 10/476,590; Mail Date Oct. 6, 2006.Applicant
- Office Action; U.S. Appl. No. 10/476,590; Mail Date Mar. 3, 2006.Applicant
- Office Action; U.S. Appl. No. 10/519,285; Mail Date May 28, 2008.Applicant
- Office Action; U.S. Appl. No. 10/519,285; Mail Date Sep. 10, 2007.Applicant
- Office Action; U.S. Appl. No. 10/841,133; Mail Date Aug. 7, 2008.Applicant
- Office Action; U.S. Appl. No. 10/841,133; Mail Date Nov. 28, 2007.Applicant
- Office Action; U.S. Appl. No. 10/841,133; Mail Date Sep. 6, 2007.Applicant
- Office Action; U.S. Appl. No. 10/841,133; Mail Date Jan. 8, 2007.Applicant
- Office Action; U.S. Appl. No. 10/049,272; Mail Date May 21, 2007.Applicant
- Office Action; U.S. Appl. No. 10/049,271; Mail Date Nov. 17, 2004.Applicant
- Office Action; U.S. Appl. No. 10/049,272; Mail Date Jul. 26, 2004.Applicant