Method and device for traffic sign recognition and navigation

[0002] The invention is based on a road sign recognition device and a method for recognizing road signs. From German Patent DE 40 23 952 C2 a road sign recognition device is already known in which an image processing method is employed for the road sign recognition.

[0003] The method of the invention and the apparatus of the invention have the advantage over the prior art that by coupling a road sign recognition device with a navigation device, information can be exchanged between the two systems, and as a result the data ascertained by the two systems can supplement one another, which in turn contributes to enhancing the safety and reliability of each of the systems coupled to one another. This is especially important for instance if interventions are to be made into the speed controller of the vehicle or the like by way of the coupled system; failure to recognize road signs, or recognizing them incorrectly, would mean significant danger to the vehicle driver and to the vehicle itself.

[0004] FIG. 1 is a view schematically showing an apparatus for road sign recognition and for navigation in accordance with the present invention; and

[0005] FIG. 2 is a view showing a process flow diagram illustrating various steps of the inventive method for road sign recognition and for navigation.

[0006] FIG. 1 shows a coupled system 20 for road sign recognition and navigation, which can for instance be built into a motor vehicle 11. The coupled system 20 includes a device 2 for road sign recognition, which is coupled via data exchange lines 1 to a device 3 for navigation. The device 2 for road sign recognition is connected via sensor lines 10 to vehicle area sensors 4

[0007] The vehicle area sensors, such as cameras, are installed for instance in the region of the windshield 5 or in the front region 6 near the front headlights or the bumper. The devices 2 and 3 communicate with an evaluation unit 7 via further data lines 14 and 15.

[0008] The device 2 is used for road sign recognition, and in particular for furnishing road sign recognition data. The device 3 for navigation serves to furnish navigation data, for instance by way of digital road maps stored in a memory; these navigation data include for instance the position and current road type. Via the data exchange lines 1, the device for navigation can communicate data to the road sign recognition device 2, in order to supplement the road sign recognition data. Examples of data communicated by the navigation device are:

[0009] 1. Reporting the current road type, such as city street, country road, Autobahn, country lane, and so forth; this can contain context information that for instance indicates the maximum allowed vehicle speed for a type of road.

[0010] 2. Reporting the change of the vehicle to a new road type or its turning onto a new road, such as a change from a country road to a federal road or the like; as a result of this change, the validity of certain road signs, such as speed limits, is thus cancelled.

[0011] 3. Reporting when entering and leaving a town. The speed limits are as a rule enforced more strongly inside a town than outside city limits. This can be taken into account in reports made by the road sign recognition system to the driver.

[0012] 4. Communicating streets running parallel to the current street or road. As a result, the validity of the road signs set up beside a street extending parallel can be blanked out from the current street by the device for road sign recognition. Because of the coupling between road sign recognition and the navigation system, the relevance of the road signs recognized by the device for road sign recognition can be assessed. This enhances the quality of road sign recognition. A reverse order of information flow is also provided, in which the device for road sign recognition communicates information to the device 3 for navigation, via the data exchange lines 1. For example, the recognition of the danger sign “construction site” can be named, in which the course of the road may have changed because of the construction site and no longer matches the data of the digital map in the navigation system. In particular, the navigation device 3 contains a map memory for storing digital map data in particular, as well as comparison means for comparing the road sign recognition data, which are transmitted from the device for road sign recognition, with the map data. As a result, if there are deviations, a warning can be made to the vehicle driver. In each case, the knowledge of the construction site can be taken into account in reports made by the navigation system to the driver. Conversely, the device for road sign recognition can have a data buffer for temporary storage of data communicated by the navigation device. These data include for instance the current road type, the number of lanes in the road, the width of the roadway, leaving or entering a town, dangers such as a sharp curve at a great distance, implicit cancellation of the validity of road signs because of a change of road, the existence of streets adjacent the current street, entrance and exit lanes, merging lanes, crossings of roadways, intersections, bridges, and footpaths and bicycle paths. If deviations are detected via the comparison means, which for instance is disposed in the device for navigation 3, then errors detected in the digital road map can also be stored in a suitable data medium, so that the next time the vehicle travels through the defective place, the new course of the road will be available. The new course of the road includes for instance the presence of a new construction site or the presence of an altered road sign. The evaluation unit 7 is used to furnish driver information from the navigation data and the road sign recognition data. Upon reports of information by the navigation system to the driver, information from the road sign recognition device is also taken into account, and/or the database of the navigation system is corrected and/or supplemented, as already noted above. The evaluation unit 7 can selectively generate control signals for intervention into a vehicle controller from the coupled system of a road sign recognition system and a navigation system as well. Control signals here include for instance signals for an electronic vehicle brake, an electronic gas pedal and/or for a steering angle controller and/or for triggering a cruise control. The evaluation unit can furthermore ascertain a currently valid speed limit from the road sign recognition data and the navigation data. The evaluation unit is either a separate component of the coupled system 20, or a constituent part of the devices 2 and/or 3. The device 2, the device 3, and the device 7 can also be totally integrated into a single unit.

[0013] The device for road sign recognition can, for Instance, be a video system. A device 2 using a radio system or a laser scanning system can also be employed. A prerequisite of radio methods is that road signs have a built-in, road-sign-specific transmitter, which transmits signals that the road sign recognition device of the vehicle is capable of receiving. In all cases, the information about road signs recognized can be imparted to the driver in a suitable way, for instance acoustically or also optically through warning signals The device 3 for navigation for the driver or vehicle guidance, for instance, includes a memory, in which the location of streets and roads and other information are stored in digital maps. Finding the position of the vehicle within this digital map is typically achieved by a satellite-base positioning method (GPS, for global positioning system), and a GPS module that employs this method is integrated with the navigation device 3.

[0014] FIG. 2 shows a process flow diagram which illustrates various steps of the method for road sign recognition and for navigation, described herein above.