Driver assistance system for vehicle

[0001] This application is a continuation of U.S. patent application Ser. No. 11/965,072, filed Dec. 27, 2007, now U.S. Pat. No. 7,580,795, which is a continuation of U.S. patent application Ser. No. 11/644,036, filed Dec. 22, 2006, now U.S. Pat. No. 7,328,103, which is a continuation of U.S. patent application Ser. No. 10/755,627, filed Jan. 12, 2004, now U.S. Pat. No. 7,158,881, which is a continuation of U.S. patent application Ser. No. 10/287,178, filed on Nov. 4, 2002, now U.S. Pat. No. 6,678,614, which is a continuation of patent application Ser. No. 09/799,414, filed on Mar. 5, 2001, now U.S. Pat. No. 6,477,464, which claims priority from U.S. provisional application Ser. No. 60/187,960, filed on Mar. 9, 2000, the disclosures of which are hereby incorporated herein by reference in their entireties, and application Ser. No. 10/755,627 is a continuation-in-part of U.S. patent application Ser. No. 09/449,121, filed on Nov. 24, 1999, now U.S. Pat. No. 6,428,172.

[0002] Vehicle-based global-positioning systems (GPS) are capable of providing complete mapping information, including street layout, street names, directions, landmarks, addresses, and the like. However, consumers often have difficulty reading maps, especially when presented on a video screen, and the study of complex information, such as a map while driving, may dangerously distract from the driving task. Vehicle mirror assemblies are desirable locations for an GPS antenna, such as disclosed in commonly assigned U.S. Pat. No. 5,971,552, the entire disclosure of which is hereby incorporated by reference.

[0003] The present invention fulfills a need to intelligently filter mapping information in a manner that provides useful and usable data to the driver. The present invention also provides an economical driver-usable global-positioning system (GPS) display. A vehicular rearview mirror-based navigation system, according to an aspect of the invention, includes a rearview mirror system, including an interior rearview mirror assembly. The interior rearview mirror assembly includes an interior reflective element and an interior mirror housing for the interior reflective element. The interior rearview mirror assembly further includes a scrolling display. The scrolling display displays scrolling driver informational messages on the scrolling display.

[0004] A vehicular review mirror-based navigation system, according to another aspect of the invention, includes a rearview mirror system having an interior rearview mirror assembly. The interior rearview mirror assembly includes an interior reflective element and an interior mirror housing for the interior reflective element. The interior rearview mirror assembly further includes a GPS display. The GPS display receives an output from a GPS receiving system and displays turn-by-turn information to a vehicle driver.

[0005] One aspect of the present invention offers a complete GPS system, including antenna, receiver and a GPS information display into a vehicular mirror assembly, and particularly an interior rearview mirror assembly. Provision of such a mirror-mounted GPS system as a unitary, complete assembly has several advantages, including obviating an automaker from having to specifically design a dashboard or other interior cabin spaces and would decrease the time to market associated with such level of feature integration. Also, provision of a mirror-mounted GPS system as a unitary, complete assembly facilitates supply of such assemblies as retrofits and as aftermarket installations, and generally increases an automaker's ability to offer a GPS feature as an option on selected vehicles.

[0006] A particular advantage from locating the information display of a GPS system at the interior rearview mirror assembly in the interior vehicular cabin is that such a mirror-mounted GPS display can facilitate multi-tasking by the driver. Thus, there is a need to intelligently filter mapping information to provide useful, but usable, data to the driver. A further object of this present invention is to economically provide a driver-usable GPS display. Map displays are currently one of the largest cost factors in vehicle navigational systems. Thus, it would be desirable to avoid or reduce this cost by providing a simpler means of display to the driver.

[0007] Another aspect of this invention is the location of the GPS antenna and the receiver in the exterior side view assembly. A further aspect is the processing by that exterior side view mirror receiver of GPS location data received by the antenna and fed from there to the receiver, providing an output from that location, that is external to the vehicle cabin, into the vehicle cabin. This has the advantage of the optimal field of view for the antenna for communication to GPS satellites. The placement of the receiver in an exterior side view mirror assembly in close proximity to the antenna also is preferred to avoid RFI and EMC issues associated with low level RF signals. Locating the GPS antenna at a distance from the GPS receiver may render the GPS system subject to stray RF noise from cellular phones and high power portable transmitters, such as CB's and handheld radios.

[0010] Referring now to the drawings and the illustrated embodiments depicted therein, a vehicular rearview mirror-based navigation system 10, in a preferred embodiment of the present invention, includes one or more GPS receiving systems 11 exterior mirror-mounted antennas 12 that receive location information form GPS satellites. A GPS receiver 14, to which is connected the GPS antenna 12, may also be mounted within an exterior side view mirror assembly 15. The geographic data output from the GPS receiver 14 is then transferred to an interior rearview mirror assembly 17 for display with the driver via a communication channel 16 such as by a wire connection, a vehicle data bus connection such as a LIN (Local Interconnet Network) or a CAN bus, as known in the art, or wirelessly such as via short-range RF data transmission using a protocol such as the BLUETOOTH protocol such as is available from Motorola of Schaumberg, Ill. Alternatively, a GPS receiving system 11 including an interior-mounted GPS antenna 12′ and GPS receiver 14′ may be mounted at interior rearview mirror assembly 17. More particularly, the interior-mounted GPS antenna 12′ and/or the GPS receiver 14′ may be positioned at either the movable portion of the interior rearview mirror assembly or the fixed portion of the interior rearview mirror assembly. Preferably, the display of the GPS information at interior rearview mirror assembly 17 provides driver informational messages such as turn-by-turn instructions, such as shown in FIG. 1. This can be displayed using a dot-matrix, pixelated display 18 such as vacuum fluorescent display or an organic electro-luminescent display or a field-emission display or a plasma display or a similar light-emitting display, or by a non-emitting display such as a liquid crystal display in the chin of the interior mirror assembly mirror, in an eyebrow over the mirror and/or in a display visible within the mirror reflector 19 which would update the driver by line-by-line or by scrolling messages which keep the driver updated using GPS positioning techniques such as differential location discrimination which has preferred accuracy of less than 5 m.

[0011] Another aspect of the present invention to the simplification of driver instructions is the use of a simple compass/directional heading display 20 at the interior mirror assembly. For example, if the system needed to communicate that the driver needed to turn right when heading north, heading display 18 may flash the “East” compass heading. Audible alerts or other noises could alert the driver that a directional change was needed. Another means of display could be arrows and the like.

[0012] A further aspect of the present invention is the data input generally shown at 22. The driver will typically desire to input the destination to the GPS system. This can be done several ways. A preferred method would be to take advantage of an existing vehicular wireless telecommunication system 24. Many existing mirror products are already the location for these systems. For example, the driver would activate a vehicular wireless communication system such as the ONSTAR™ system at General Motors which would contact a remote operator or remote voice input system. This may be accomplished utilizing principles disclosed in commonly assigned U.S. patent application Ser. No. 09/466,010 filed Dec. 17, 1999, now U.S. Pat. No. 6,420,975; 09/396,179 filed Sep. 14, 1999, now U.S. Pat. No. 6,278,377; 09/382,720 filed Aug. 25, 1999, how U.S. Pat. No. 6,243,003; 09/449,121 filed Nov. 24, 1999, now U.S. Pat. No. 6,428,172; 09/433,467 filed Nov. 4, 1999, now U.S. Pat. No. 6,326,613; and 09/448,700 filed Nov. 24, 1999, now U.S. Pat. No. 6,329,925, the disclosures of which are hereby incorporated herein by reference. The driver would then tell the operator, such as via a voice input 26, the desired final destination; this takes advantage of the operators' vast data banks for locations and human interaction to help find the destination of choice if you do not know the exact address. The operator would then download the turn-by-turn directions to your mirror. The driver will then be notified by the scrolling messages on the display in the mirror when to turn, how far until the turn, and the direction. The GPS system could update the display in real time as you travel. Audible chirps delivered by a speaker 28 could alert the driver when approaching a turn or if the driver has missed a turn. Thus, the remote ONSTAR™ or equivalent system maintains the detailed maps and directories, and this is fed back wirelessly to the vehicle for display at the interior rearview mirror of directional guidance information.

[0013] In addition to this, the driver may simply have a keypad 30 to enter the destination by spelling the address. Keypad 30 could be hardwire-connected to internal rearview mirror 17 or be connected via a wireless link.

[0014] BLUETOOTH technology from Motorola, or a similar short-range RF transmission system, could be incorporated for wireless interface with the GPS receiver. This allows for better performance in urban canyons and locations with extreme foliage. The exterior mirror-mounted GPS system 11 could improve handheld GPS devices due to a more powerful antenna 12, which does not operate from a small handheld battery or suffer from the limited size and weight constraints. In addition, the vehicular GPS system could have more data storage, faster processing speeds, increased bandwidth for full internet access, increased software and potential to transfer data via 2-way paging such Creatalink 2 by Motorola thereby lowering operating costs to the user. The data could then be transferred back to the mobile unit for display or storage or the handheld features could then be transferred to the vehicle for hands free operation through voice recognition. This could also include smart phones with an IP address and personal digital assistants (PDA). In addition, smart cards might be inserted into the mirror and information exchanged in this manner.

[0015] The driver could also simply have the instructions downloaded to mirror 17 without GPS system 11. This would involve the operator using their cellular service to triangulate your position then download the turn-by-turn directions to your mirror based on your current position and your destination. Then, as you complete each step of the direction, you can scroll to the next direction. This eliminates the cost of the GPS solution, but may not allow for real time positioning. It does offer a simple and effective way to display the information to the driver in a location where the driver is not forced to take their eyes off the road.

[0016] It is preferred that the display of GPS-derived driving directional instructions and allied information be displayed at interior mirror assembly 17 as a reconfigurable display such as a multi-pixel display with individually addressable display pixel elements, such as is known in the display arts. Also, it is preferable that the display have an aspect ratio (defined as ratio of the

[0017] width dimension of the display to its height dimension) of at least about 3, more preferably at least about 5, and most preferably at least about 10 in order to present driving instructions to the driver in a readily readable form. For example, the “Turn right on Swan, etc.” driver instruction shown at the interior mirror assembly in FIG. 1 has a desirably large aspect ratio. Also, preferably, the width dimension W of the display is at least about 4 cm, more preferably at least about 6 cm and most preferably at least about 10 cm in width dimension. Also, preferably, the height dimension H is at least about 0.5 cm, more preferably at least about 0.6 cm and most preferably at least about 1 cm in height dimension. Use of the preferred aspect ratios and dimensions ensures that the driver can readily read and interpret the mirror-displayed driving instructions.

[0018] Also, where display 18 is disposed behind reflective element 19 of interior mirror assembly 17, and when the reflective element is an electrically variable reflectance element such as an electro-optic mirror such as an electrochromic mirror, it is preferred that the intensity of the scrolling GPS-derived directional information display be increased whenever any overlaying variable opacity element, such as an electrochromic medium, decreases in transmission. Thus, when an electrochromic mirror element that the display is viewed through dims, the intensity of the display increases to compensate for the mirror dimming, such as is disclosed in U.S. Pat. Nos. 5,285,060 and 5,416,313, the entire disclosures of which are hereby incorporated herein.

[0019] Further, scrolling GPS-derived driving instruction information can be displayed at an interior mirror-mounted video screen, such as is disclosed in provisional pat. application Ser. No. 60/186,520 filed Mar. 2, 2000, entitled INTERIOR REARVIEW MIRROR ASSEMBLY INCORPORATING A VIDEO SCREEN and in commonly assigned U.S. patent application Ser. No. 09/449,121 filed Nov. 24, 1999, by Hutzel et al., now U.S. Pat. No. 6,428,172, the entire disclosures of which are hereby incorporated herein.

[0020] Also, optionally, a forward-facing video camera, such as a CMOS or CCD camera, can be mounted to the vehicle, such as disclosed in commonly assigned U.S. Pat. No. 5,796,094 and published International Application No. WO 99/23828, the disclosures of which are hereby incorporated herein by reference, that views the forward scene ahead of the vehicle as it travels on a road. Optionally, the video image of the forward scene can be displayed at a mirror-mounted video screen, or at a video screen mounted elsewhere in the vehicle cabin such as in or at the dashboard. Preferably, a computer-produced graphic overlayer/image highlight/picture-in-a-picture for this forward-viewing video image is generated that is derived from geographic information received from the in-vehicle GPS system. Thus, the driver can view a video screen, which preferably is located at the interior rearview mirror assembly, and can see a graphic overlay on the captured forward video image that guides the driver to turn left or right at an upcoming intersection whose image is displayed on the video screen, a highway on/off ramp the driver is to take can be highlighted on the video screen, a destination building can be highlighted (such as by flashing the part of the video screen where the building is being displayed), etc.

[0021] Also, where a video-based rear vision display is included in the vehicle, such as disclosed in commonly assigned U.S. Pat. No. 5,670,935 and published International Application No. WO 96/38319, the disclosures of which are hereby incorporated herein by reference, driver instructional data, maps, and the like, can, optionally, be co-displayed with the video image of the rearward scene. The driver instructional data, maps, and the like, can be derived from the GPS data received by the in-vehicle GPS system, and may be co-displayed via a graphic overlayer or a picture-in-a-picture, or the like.

[0022] The global-positioning system display of the present invention may be incorporated into video screens or video display assemblies, which may be displayed at or adjacent to the interior rearview mirror assembly, such as in a module or a pod or the like, such as described in U.S. utility application entitled VIDEO MIRROR SYSTEMS INCORPORATING AN ACCESSORY MODULE, filed by Kenneth Schofield, Frank O'Brien, Robert L. Bingle, and Niall R. Lynam on Feb. 26, 2001, now U.S. Pat. No. 6,690,268 and U.S. provisional applications entitled VIDEO MIRROR SYSTEMS INCORPORATING AN ACCESSORY MODULE, Ser. No. 60/263,680, filed Jan. 23, 2001; VIDEO MIRROR SYSTEMS INCORPORATING AN ACCESSORY MODULE, Ser. No. 60/243,986, filed Oct. 27, 2000; VIDEO MIRROR SYSTEMS, Ser. No. 60/238,483, filed Oct. 6, 2000; VIDEO MIRROR SYSTEMS, Ser. No. 60/237,077, filed Sep. 30, 2000; VIDEO MIRROR SYSTEMS, Ser. No. 60/234,412, filed Jul. 21, 2000; INTERIOR REARVIEW MIRROR ASSEMBLY INCORPORATING A VIDEO SCREEN, Ser. No. 60/218,336, filed Jul. 14, 2000; and INTERIOR REARVIEW MIRROR ASSEMBLY INCORPORATING A VIDEO SCREEN, Ser. No. 60/186,520, filed Mar. 2, 2000, the entire disclosures of which are herein incorporated by reference. As described in the above-referenced applications, such video screens may be incorporated into the interior rearview mirror assembly or provided at locations within the vehicle separate from the interior rearview mirror assembly. The video display assemblies similarly may be incorporated into the interior rearview mirror assembly, such as by mounting the video display assembly to the interior mirror support or mirror mount or to a pod, or may be separately mounted, such as either above the interior rearview mirror assembly or below the interior rearview mirror assembly. For further variations and details of the mounting of the video screen(s) or the video display assembly, reference is made to the above-referenced applications.

[0023] Such video screens or video display assemblies may be used to display the output from a rear vision back-up camera, such as disclosed in co-pending application Ser. No. 09/199,907, filed Nov. 25, 1998, now U.S. Pat. No. 6,717,610, and Ser. No. 09/361,814, filed Jul. 27, 1999, now U.S. Pat. No. 6,201,642, commonly assigned to Donnelly Corporation, the disclosures of which are herein incorporated by reference in their entireties, along with vehicle instrument status, such as a vehicle information display, such as information relating to fuel gauge levels, speed, climate control setting, GPS directional instructions, tire pressure status, instrument and vehicle function status, and the like. In addition, such video screens may display a panoramic image, such as described in U.S. Pat. Nos. 5,670,935 and 5,550,677 and U.S. patent applications entitled WIDE ANGLE IMAGE CAPTURE SYSTEM FOR VEHICLES, Ser. No. 09/199,907, filed Nov. 25, 1998, now U.S. Pat. No. 6,717,610, and WIDE ANGLE IMAGING SYSTEM, Ser. No. 09/361,814, filed Jul. 27, 1999, now U.S. Pat. No. 6,201,642, the disclosures of which are herein incorporated by reference in their entireties, and can be used instead of a conventional mirror reflector. Other displays or images that may be displayed on the video screen include: a rain sensor operation display, a telephone information display, a highway status information display, a blind spot indicator display, a hazard warning display, a vehicle status display, a page message display, a speedometer display, a tachometer display, an audio system display, a fuel gage display, a heater control display, an air-conditioning system display, a status of inflation of tires display, an E-mail message display, a compass display, an engine coolant temperature display, an oil pressure display, a cellular phone operation display, a global-positioning display, a weather information display, a temperature display, a traffic information display, a telephone number display, a fuel status display, a battery condition display, a time display, a train approach warning display, and a tollbooth transaction display. Furthermore, information displays may be incorporated which provide information to the driver or occupants of the vehicle, such as warnings relating to the status of the passenger airbag. In commonly assigned co-pending application Ser. No. 09/244,726, filed by Jonathan E. DeLine and Niall R. Lynam, on Feb. 5, 1999, now U.S. Pat. No. 6,172,613, information displays are provided which include information relating to vehicle or engine status, warning information, and the like, such as information relating to oil pressure, fuel remaining, time, temperature, compass headings for vehicle direction, and the like, the disclosure of which is incorporated herein by reference in its entirety. The passenger side air bag on/off signal may be derived from various types of seat occupancy detectors such as by video surveillance of the passenger seat as disclosed in co-pending, commonly assigned international application Ser. No. PCT/US94/01954, filed Feb. 25, 1994, the disclosure of which is hereby incorporated by reference, or by ultrasonic or sonar detection, infrared sensing, pyrodetection, weight detection, or the like. Alternately, enablement/displayment of the passenger side air bag operation can be controlled manually such as through a user-operated switch operated with the ignition key of the vehicle in which the mirror assembly is mounted as described in co-pending, commonly assigned U.S. patent application Ser. No. 08/799,734, filed Feb. 12, 1997, now U.S. Pat. No. 5,786,772, the disclosure of which is incorporated by reference herein in its entirety.

[0024] Changes and modifications in the specifically described embodiments can be carried out without departing from the principles of the invention which is intended to be limited only by the scope of the appended claims, as interpreted according to the principles of patent law including the doctrine of equivalents.