Symbol position monitoring for pixelated heads-up display method and apparatus

[0001] The invention relates generally to control systems, and more particularly to a digital control data processing and display method and apparatus which verifies symbol positioning accuracy by receiving the positioning of a blue pixel on an LCD or other pixelated display, computing derived input information based on detected symbol position and symbol type and comprising the desired input information to the actual input information.

[0002] Conventionally, methods and apparatus for verifying the operational status of digital control systems, specifically for flight guidance applications, have been used. For example, there have been known control system apparatuses which project a display symbol in the form of a light image that conveys information concerning the status of an operational state of the system. Such display symbols include pointers and other characters whose position on or direction of movement across the display screen conveys to the observer information about a particular operational state.

[0003] Further, a conventional apparatus for determining whether a display symbol conveys the correct information includes the use of a test program which is executed while the control system is off-line. The test program applies known input information to the data processing apparatus which produces output command information in accordance with a known operational control function. A display symbol generator responds to the output command information by projecting a preassigned pointer symbol at a known location on the display screen. A photo detector positioned at the known location receives the light emitted from the pointer symbol and thereby acknowledges the nominal performance of the control system after a successful execution of the test program.

[0004] These methods of verifying the operational status of the control data processing and display system are capable of neither verifying the status of the system in real time operation nor providing an adequate test for detecting latent software design defects which arise during the execution of a particular control operational function.

[0005] Thus, there is a need for a symbol position and location monitoring system which may be used during flight operations.

[0006] It would be desirable to provide a system and/or method that provides one or more of these or other advantageous features. Other features and advantages will be made apparent from the present specification. The teachings disclosed extend to those embodiments which fall within the scope of the appended claims, regardless of whether they accomplish one or more of the aforementioned needs.

[0007] An example of the invention relates to an information processing system. The information processing system includes a first processor that receives input data and creates a pixel data stream provided over a first channel and a second channel. The first channel provides a signal to affect the output of a pixelated display. The second channel includes location information and symbol information. The information processing system also includes a second processor coupled to the first processor. The second processor receives the location information and the symbol information from the first processor. The second processor receives the input data. The second processor computes a derived version of the inputs based on their location information and the symbol information.

[0008] Another example of the invention relates to a method of providing integrity checking for a pixelated display device. The method includes receiving input data by a first processor. The method also includes generating drawing instructions for a graphics engine. Further, the method includes outputting pixel data to a detector. Further still, the method includes receiving, by a display, at least some of the pixel data over a first channel. Yet further still, the method includes receiving over a second channel, by a symbol monitor, at least some of the pixel data and receiving the input data by the symbol monitor.

[0009] Yet another example of the invention relates to an information processing system. The information processing system includes a first processing means that receives input data and creates a pixel data stream provided over a first channel and a second channel. The first channel provides a signal to affect the output of a pixelated display and the second channel includes location information and symbol information. The information processing system also includes a second processing means coupled to the first processing means. The second processing means receives the location information and the symbol information from the first processing means and the second processing means receives the input data. The second processing means computes a derived version of the inputs based on the location information and the symbol information.

[0010] Alternative examples and other exemplary embodiments relate to other features and combinations of features as may be generally recited in the claims.

[0014] Before describing in detail the particular improved system and method, it should be observed that the invention includes, but is not limited to a novel structural combination of conventional data/signal processing components and communications circuits, and not in particular detailed configurations thereof. Accordingly, the structure, methods, functions, control, and arrangement of conventional components and circuits have, for the most part, been illustrated in the drawings by readily understandable block representations and schematic diagrams, in order not to obscure the disclosure with structural details which will be readily apparent to those skilled in the art, having the benefit of the description herein. Further, the invention is not limited to the particular embodiments depicted in the exemplary diagrams, but should be construed in accordance with the language in the claims.

[0015] Referring now to FIG. 1, an exemplary control data processing system 100 is depicted. A symbol generator 110 receives aircraft data 115 from a plurality of sensor inputs and other system input data which may be delivered in either analog or digital form to both symbol generator 110 and to symbol monitor 120. According to an exemplary embodiment, aircraft data 115 may comprise aircraft sensor data. In accordance with alternative embodiments, aircraft data 115 may include but is not limited to any variety of sensor signals including the position of aerodynamic control surfaces, environmental variables affecting the flight of the aircraft, and/or the operating conditions and status of the pilot's controls. Analog data are converted into digital word format by analog-to-digital converters either included in or outside of symbol generators 110 and symbol monitor 120.

[0016] When receiving aircraft data 115, symbol generator 110 creates a display list containing drawing instructions for the graphics engine 130. A conventional graphics engine 130 is capable of displaying the three primary colors (red, green, and blue) with multiple, independent intensities. In a conventional HUD, only the colors red and green are used. Accordingly, the blue color may be used to carry additional information. Graphics engine 130 processes the display list that is received from symbol generator 110 and produces, as output, a stream of pixel data to a color detector 140. Color detector 140 passes the red data over path 142 and the green data over path 144 to a display 150 and blue data over path 146 to symbol monitor 120. Display 150 may be any variety of pixilated displays, including, but not limited to a liquid crystal display (LCD). Further, display 150 may be a heads-up or a heads-down display although the disclosure describes primarily the use of display 150 in a heads-up display configuration. Certain symbols passed to display 150 may be characterized as “critical symbols” that are critical to the operation of the aircraft, are necessary for critical operations of the aircraft, and/or are identified as such through certification standards. Each critical symbol has associated with it, and X, Y display position, as well as a unique identifier or tag that identifies the type of symbol being displayed. The symbol generator 110 places instructions in a display list to locate the symbol in the correct X and Y position in the blue pixel buffer of graphics engine 130. The intensity level associated with the symbol is the symbol's identifier or tag. Accordingly, the number of identifiers is limited only by the number of blue pixel intensity values and/or by the number of states of intensity that color detector 140 can detect.

[0017] Color detector 140 processes the stream of pixel data from graphics engine 130 and sends red and green pixel data to display 150 over paths 142 and 144. Blue pixel X and Y positions are detected by the color detector 140 and stored for access by symbol monitor 120 over path 146. Symbol monitor 120 provides verification that the symbols displayed are placed in the proper location and/or are the correct symbol. Each blue pixel intensity is used to uniquely identify the symbol being used. Symbol monitor 120 may also determine which symbol is being drawn and where it is being drawn from the information received from color detector 140. Symbol monitor 120 reads the detector symbol position data from color detector 140 and uses the data to determine what sensor input value is required to position the symbol in that unique position. The sensor input values are produced through an inverse processing process. The inverse processing may be a matrix inversion for linear processes or an inverse function for linear or nonlinear relationships. Symbol monitor 120 compares the computed value with the actual input sensor data 115. If a miscompare is computed between display data from graphics engine 130 and the actual aircraft data 115, then a display path error exists, and the display is blanked of the symbol. Further, in an exemplary embodiment, symbol monitor 120 also transmits the symbol position data to test equipment external to the heads up guidance system (HGS).

[0018] In an alternative embodiment, the display using three colored graphics, such as a heads down display, may utilize a fourth monitoring channel to a normal three-color graphics engine which would be similar to the blue channel used in the two-color graphics system described. Further, according to alternative embodiments, the invention which may be used in HGS for aircraft may also be employed in other environments such as, but not limited to automobiles or other vehicle systems. Such a system may be beneficial in autonomous vehicle control systems. Further, the invention may be employed in other environments in which symbol display errors cannot be tolerated, such as but not limited to a surgical application in which a display is being used for the guidance of a surgical device, such as, but not limited to a guided probe. Also, in accordance with an alternative embodiment, a non-pixelated display may be used as pixel data may be converted to whatever format is used by the particular display type.

[0019] Symbol monitor 120 may be an independent symbol monitor processor, that runs a dissimilar algorithm, and computes the state of the aircraft based on the position of the critical symbols. The independent symbol monitor processor 120 also compares the computed aircraft state with the measured aircraft data 115 to determine if a display path fault has occurred. If no miscompare exists, the display path is determined to be good, and the high integrity information is displayed to the pilot.

[0020] In critical applications it is desirable for the display of information, such as attitude, on a HUD to meet a 10⁻⁷ integrity requirement. Further, it may be desirable for the display of misleading guidance on a single HUD must be less than 10⁻⁹. Further, in certain applications, the HUD display path must be monitored in order to meet these integrity requirements. Accordingly, the invention disclosed may be applied to achieve such goals. Further, the HUD symbol position monitoring system as described, may be used in conjunction with other monitoring schemes to verify that displayed symbology is not misleading and thus meets the certification integrity requirements. These requirements may be applicable for landing, take off, and other flight regimes.

[0021] Referring now to FIG. 2, a process 200 is depicted for providing integrity checking for a pixelated display device. Process 200 begins by receiving input data from a plurality of aircraft sensors and/or systems (step 210). Drawing instructions are then generated based on the input data (step 220). Such instructions provide both the location and type of symbol to be drawn on the pixelated display. The pixel data is then output to a detector (step 230). The detector passes through a subset of the data to the display for drawing thereon (step 240). The detector then determines the symbol and its location (step 250). From the symbol and location detected, derived input information is generated by a second processing device. The derived input information is then compared with actual input information to determined whether it is within a tolerable threshold (step 280). If the derived and actual input information are not within a specified threshold, the symbol is then determined to be in error and certain actions can be taken such as blanking the symbol from the display (step 290), blanking the entire display, and/or sending a warning signal of any type such as an aural, and/or visual warning, or the like, to the pilot. This process is carried out continuously during the flight of the aircraft or it may be implemented during certain critical flight segments such as, but not limited to take off and landing.

[0022] While the detailed drawings, specific examples and particular formulations given described preferred and exemplary embodiments, they serve the purpose of illustration only. The inventions disclosed are not limited to the specific forms shown. For example, the methods may be performed in any of a variety of sequence of steps. The hardware and software configurations shown and described may differ depending on the chosen performance characteristics and physical characteristics of the computing devices. For example, the type of computing device, communications bus, or processor used may differ. The systems and methods depicted and described are not limited to the precise details and conditions disclosed. Furthermore, other substitutions, modifications, changes, and omissions may be made in the design, operating conditions, and arrangement of the exemplary embodiments without departing from the scope of the invention as expressed in the appended claims.