Surveillance system

[0001] Beginning with the terrorist attacks of Sep. 11, 2001, providing cost effective security measures at various high-profile installations increased in importance. Installations such as seaports, airports, chemical plants, nuclear reactors, military and other sensitive installations are vulnerable to terrorist attacks. Unfortunately, the state of the art systems for securing such installations can be very costly to install both in terms of money and in terms of time.

[0002] Some existing systems that can be used to secure such installations include the use of radar to detect intruders. Unfortunately, technicians require extensive training to be able to effectively use radar systems. Further, such systems are prone to false alarms that trigger personnel to investigate a potential incident. This reduces the effectiveness of a conventional radar-based surveillance system.

[0003] Commonly, other surveillance systems use video cameras to secure an area. These systems rely heavily on operators to view data presented on monitors. The larger the installation under surveillance, the more cameras and the more hence personnel are needed to operate the system effectively. A given operator can only be effective in viewing video feeds from a small number of video cameras. Further, the video cameras provide a large volume of data and thus this type of system requires an infrastructure with a large bandwidth to allow the operators to view the available data.

[0004] Therefore, a surveillance system is needed that enables securing an installation with reduced installation, maintenance and operational costs.

[0005] Embodiments of the present invention overcome problems with existing surveillance systems. In one embodiment, a surveillance system is provided. The system includes at least one target detection sensor, a plurality of adjustable identification sensors and a system controller. The syste controller is coupled to the at least one target detection sensor and the plurality of adjustable identification sensors. The system controller processes data from the plurality of target detection sensors, applies threat criteria, and, when a target is identified as a threat, the system controller selects at least one of the plurality of adjustable identification sensors and adjusts a sensing input of the selected one of the plurality of adjustable identification sensors to capture information on the identified target. The system also includes a monitoring station that is adapted to receive signals from the selected one of the adjustable identification sensors and to display the captured information.

[0011] In the following detailed description, reference is made to the accompanying drawings that form a part hereof, and in which is shown by way of illustration specific illustrative embodiments in which the invention may be practiced. These embodiments are described in sufficient detail to enable those skilled in the art to practice the invention, and it is to be understood that other embodiments may be utilized and that logical, mechanical and electrical changes may be made without departing from the spirit and scope of the present invention. The following detailed description is, therefore, not to be taken in a limiting sense.

[0012] Embodiments of the present invention provide improved surveillance capability over traditional surveillance systems by leveraging the capabilities of one type of sensor to control the use of another type of sensor. In one embodiment, a surveillance system uses radar to detect a target and then gathers additional information on the target by steering an adjustable camera to capture video images of the target based on the information gathered by the radar. In one embodiment, the surveillance system also leverages existing systems, e.g., automatic identification systems that broadcast identification information by potential targets, to assist in selecting targets to monitor with the adjustable camera.

[0013] FIG. 1 is a block diagram of one embodiment of a surveillance system, indicated generally at 100, according to the teachings of the present invention. System 100 uses two types of sensors to provide improved surveillance over existing systems. For example, system 100 uses target detection sensors 102 and adjustable identification sensors 104-1, . . . , 104-N. Each of these sensors is discussed in more detail below. Essentially, system 100 uses target detection sensors 102 to acquire a target and then uses adjustable identification sensors 104, . . . , 104N to capture additional information about the targets.

[0014] System 100 identifies targets within a guard zone using target detection sensor 102. The guard zone is an area that is covered by system 100. This guard zone is an area that is monitored by system 100. In one embodiment, the guard zone is associated with any appropriate type of installation, e.g., a sea port, air port, manufacturing facility, chemical plant, power plant, military base, government building, financial institution, or other facility or location that is desired to be protected from attack or unauthorized intrusion.

[0015] In one embodiment, target detection sensor 102 comprises a radar sensor that is disposed in a location that enables the radar sensor to detect targets that enter the guard zone or a selected portion thereof. In other embodiments, target detection sensor 102 comprises one or more of sonar, acoustic and optical detection sensors that are similarly positioned relative to the guard zone. The number of target detection sensors 102 used in a particular application is determined by the size and shape of the guard zone as well as the particular capabilities of the target detection sensor. Target detection sensor 102, in one embodiment, comprises a sensor that is adapted to precisely detect targets as small as 2 square meters and at distances of up to several miles. Target detection sensor 102 provides excellent detection capabilities but does not need to provide classification and identification capabilities.

[0016] System 100 also includes a plurality of adjustable identification sensors 104-1, . . . , 104-N that provide classification and identification functions for system 100. The exact number of adjustable sensors 104-1, . . . , 104-N depends on the particular application, the area to be covered, and the volume of potential targets expected to pass through the guard zone. In one embodiment, the adjustable sensors 104-1, . . . , 104-N comprise adjustable video cameras, thermal imaging cameras, night vision cameras, and parabolic listening devices. The adjustable identification sensors 104-1, . . . , 104-N capture additional information on targets identified by target detection sensor 102.

[0017] System 100 coordinates the use of target detection sensor 102 and adjustable identification sensors 104-1, . . . , 104-N through system controller 106. System controller 106 is coupled to target detection sensor 102 and adjustable identification sensors 104-1, . . . , 104-N over a communication network. In one embodiment, the communication network comprises a TCP/IP network. In one embodiment, the communication network is a wireless network. Advantageously, the use of a wireless network reduces the installation cost of system 100. It is noted, however, that system 100 is not limited to use with wireless networks. System 100, in some embodiments, uses wired networks, e.g., coaxial cable, twisted pair, copper cable, fiber optic cable or other appropriate media for carrying data between the system controller 106 and the target detection sensor 102 and adjustable identification sensors 104-1, . . . , 104-N.

[0018] System 100 provides an output to an operator at monitoring station 108. In one embodiment, monitoring station 108 comprises one or more video consoles. In other embodiments, monitoring station 108 also includes audio speakers to present audio messages to the operator. In one embodiment, the monitoring station 108 includes a graphical user interface that provides a display of the output from target detection sensor 102 and adjustable identification sensors 104-1, . . . , 104-N.

[0019] Monitoring station 108 also provides an input for an operator to configure some of the settings of system 100. For example, in one embodiment, monitoring station 108 enables the operator to define the boundaries of the guard zone monitored by system 100. Further, in one embodiment, the graphical user interface enables the operator to adjust the guard zone by moving boundaries on the graphical display on the monitoring station 108, e.g., with a point-and-click interface device. In one embodiment, monitoring station 108 enables the operator to establish criteria for identifying a target as a threat. Further, in one embodiment, monitoring station 108 enables the operator to establish prioritization criteria for determining how to handle the presence of simultaneous threats.

[0020] In one embodiment, the monitoring station 108 provides the operator with a list of criteria to use in establishing a prioritization scheme. For example, at a first level, monitoring station 108 allows the user to identify one or more alarm zones in the guard zone. Each alarm zone, in one embodiment, is assigned a selected priority level. In other embodiments, monitoring station 108 provides other selections for the operator to prioritize various targets, e.g., time of day, speed, size, direction, etc. The operator creates various levels of priority based on the available selections.

[0021] In one embodiment, system 100 also leverages information from other systems to provide improved surveillance operation. For example, in one embodiment, system 100 include optional receiver 110. Receiver 110 receives signals from transmitters on the targets that enter the guard zone. These signals provide information that identifies the target. In one embodiment, these signals are signals from vessels that comply with the Automatic Identification System (AIS) for sea-going vessels. In one embodiment, system controller 106 uses these signals to determine whether a target is a threat or not. Further, in one embodiment, the information from the AIS signals is overlaid on the images displayed on the monitoring station 108.

[0022] In operation, system controller 106 controls the operation of adjustable identification sensors 104-1, . . . , 104-N based on data received from target detection sensor 102. In one embodiment, target detection sensor 102 detects a target that enters the guard zone. When the target is detected, target detection sensor 102 feeds this information to the system controller 106. The system controller 106 applies the threat criteria to determine whether the target is a threat. If so, the system controller 106 generates an alarm for display on the monitoring station 108. Further, the system controller 106 generates signals to control a selected one of the adjustable identification sensors 104-1, . . . , 104-N, e.g., 104-1. In one embodiment, system controller 106 generates pan, tilt and zoom (PTZ) commands for the adjustable sensor 104-1. These commands direct the adjustable identification sensor 104-1 to direct a sensing input at the target to gather more information, e.g., to capture video images of the target. The adjustable identification sensor 104-1 transmits the captured video signals back to the system controller 106 for display on the monitoring station 108.

[0023] FIG. 2 is a block diagram of another embodiment of a surveillance system, indicated generally at 200, according to the teachings of the present invention. System 200 uses two types of sensors: radar sensor 202 and adjustable cameras 204-1 and 204-2. In other embodiments, any appropriate number of radar sensors and adjustable cameras are used to cover a desired guard zone.

[0024] Radar sensor 202 detects when targets enter the guard zone. In one embodiment, radar sensor 202 comprises X-band marine radar sensors that provide coverage in a variety of weather conditions, e.g., rain, snow and heavy winds. Further, X-band radar is also advantageous because it is off-the-shelf equipment that is widely available. In one embodiment, the radar sensor 202 provides RS-422 raw data. In this case, radar sensor 202 also includes a converter, e.g., an Axis 2401 streamer, that converts the RS-422 data to TCP/IP packets for transmission to the system controller 206. This is not necessary when the radar sensor 202 produces TCP/IP compliant output data.

[0025] Adjustable cameras 204-1 and 204-2 capture additional information regarding targets identified by radar sensor 202. Adjustable cameras 204-1 and 204-2, in one embodiment, comprise steerable CCTV cameras such as KD6i cameras.

[0026] Advantageously, by using steerable cameras in conjunction with radar, system 100 is able to provide coverage of a larger area with fewer cameras. Further, system 100 also provides visual identification of targets via the adjustable cameras 204-1 and 204-2. With visual identification, system 100 produces fewer false alarms compared to conventional radar only systems. As with the radar sensor, the adjustable cameras 204-1 and 204-2 include a converter that converts the RS-422 data to Ethernet packets for transmission to the system controller 206.

[0027] Radar sensor 202 and adjustable cameras 204-1 and 204-2 communicate with system controller 206 over network 205. In one embodiment, communication network 205 is a wired network, e.g., a local or wide area network based on Ethernet or other appropriate communication protocol. In other embodiments, communication network 205 comprises a wireless network. Radar sensor 202 and adjustable cameras 204-1 and 204-2 are fitted with network interface units 230, 232-1 and 232-2, respectively. When a wireless network is used, network interface units 230, 232-1 and 232-2 Trango 5830 subscriber units that communicate in the 5.8 GHz range with a 4 mile radius. In this embodiment, network interface 234 comprises a Trango 5830 wireless access point. Advantageously, when a wireless communication network is used, the costs associated with installation of network 100 are substantially reduced. Further, the configuration of system 100 is more flexible and the system controller can be made more portable.

[0028] System controller 206 includes two main components for processing signals from radar sensor 202 and adjustable cameras 204-1 and 204-2. Radar server 220 receives signals from radar sensor 202. In one embodiment, radar server 220 receives target data from radar server 202 in the form of tracked target messages (TTM). In one embodiment, the TTMs include target position, velocity, and heading. Radar server 220 ingests these messages for further processing. Radar server 220 uses the TTMs along with user defined threat criteria and time of day to determine whether the target is a threat. In one embodiment, radar server 220 also uses information from optional receiver 210 to determine whether the target is threat. In one embodiment, receiver 210 receives signals compliant with the Automatic Identification System standard that provide information on the identity of the target. If the target is a threat, the radar server generates an alarm for presentation at monitoring station 208. Further, radar server 220 creates pan, tilt and zoom (PTZ) settings using the target locations relative to the adjustable camera 204-1 or 204-2 being used to track the target. In one embodiment, the PTZ settings are used to look-up preset values in a table to control the adjustable camera.

[0029] Camera server 222 responds to signals from radar server 220 to control a selected adjustable camera 204-1 or 204-2. In one embodiment, camera server 222 passes the preset values to the appropriate adjustable camera when radar server 220 indicates that the adjustable camera is needed to capture additional information on a threat. Camera server 222 also controls the recording of video from the selected one of cameras 204-1 and 204-2. Further, camera server 222 also provides the video signal from the selected camera to monitoring station 208 for display to an operator.

[0030] FIG. 3 is a graphical representation of an example of an installation with an embodiment of a surveillance system, indicated generally at 300, according to the teachings of the present invention. System 300 is a surveillance system for a port on a river 350. System 300 includes a radar sensor 302 that is positioned at a midpoint on the port to define a guard area 352 that is two miles along the river 350. The system 300 also includes first and second adjustable cameras 304-1 and 304-2. Each camera in located half a mile from the radar sensor 302 and covers half of the guard area. In one embodiment, radar sensor 302 and adjustable cameras 304-1 and 304-2 are coupled to system controller 306 over a wireless communication network. In other embodiments, a wired network is used.

[0031] In operation, system 300 provides surveillance over the guard area 352. When a target enters the guard area, e.g., target 354, radar sensor 302 detects the presence of the target. Radar sensor 302 provides signals to system controller 306 to indicate the presence of the target 354. System controller then uses operator established criteria, e.g., time of day, speed and trajectory, to determine whether the target is a threat. If the target is a threat, the system controller 306 selects one of the adjustable cameras to obtain additional detail regarding the threat. In this case, system controller 306 determines that the target 354 is in the sector of the guard zone 352 covered by adjustable camera 304-1. Thus, system controller 306 generates control signals for adjustable camera 304-1 to direct the camera at the target 354 and to zoom in to an appropriate level to provide a visual identification of the target 354. System controller 306 then displays the images from adjustable camera 304-1 and an alarm on monitoring station 308.

[0032] FIG. 4 is a block diagram of an embodiment of a radar server, indicated generally at 520, in a surveillance system according to the teachings of the present invention. Radar server 520 processes data from a plurality of sensors and generates a number of outputs. In this embodiment, radar server 520 includes radar manager 570 that performs the operations identified above with respect to radar server 220 of FIG. 2. In this embodiment, radar manager 570 performs its functions in a manner that is independent of the sensors and systems coupled to radar manager 570. Radar manager 570 accomplishes this through the use of adapters. Signals provided to each input of radar manager 570 are conditioned by an appropriate adapter 571-1 to 572-N. Each adapter is configured to accept data in a format native to the appropriate sensor and to convert the data to a standard format for radar manager 570. Similarly, radar manager 570 provides output signals in a format native to radar manager 570. Signals from radar manager 570 are conditioned for the appropriate device through response adapters 574-1 to 574-M. These adapters also convert signals from the format used by radar manager 570 to a format appropriate for the device coupled to the adapter. The number and types of specific adapters depends on the types of sensors and devices used with radar server 520.

[0033] FIG. 5 is a flow chart of one embodiment of a process for a surveillance system according to the teachings of the present invention. The process begins at block 500. At block 502, the process determines whether a target has been detected. In one embodiment, the process accomplishes this through use of a radar sensor that is configured to detect targets in a guard zone. If the process does not detect a target, the process returns to block 502 to wait for a target to be detected. If, however, a target is detected at block 502, the process transmits messages at block 504 indicating that a target has been detected. In one embodiment, the messages are generated by the radar sensor and include the position, speed and trajectory of the target.

[0034] Once the target has been detected, the process determines whether additional information is required on the target. First, the process determines whether the target is a threat at block 506. In one embodiment, the process applies user configurable rules to determine whether the target is a threat. For example, the process uses information such as the position, trajectory, speed, time of day, and any other information regarding the target to determine whether the target is a threat. In one embodiment, the process uses self-identification signals to assist in determining whether the target is a threat. If the target is not a threat, the process returns to block 502.

[0035] If the target is a threat, in one embodiment, the process uses a prioritization algorithm to select one or more targets on which to gather further information. At block 508, the process determines whether there are other threats in the guard zone. If so, the process prioritizes the targets at block 510 based on user defined criteria such as location, speed and bearing. For example, a target that is traveling at a high speed may be given priority over a slower of stationary target.

[0036] Once the target is identified as a threat and prioritized (if appropriate), the process proceeds to gather additional information on the target with a second senor. At block 512, the process generates control signals for the additional sensor, e.g., pan, tilt and zoom (PTZ) signals. In one embodiment, the process looks-up preset settings for the additional sensor based on the generated control signals at block 514. In other embodiments, the raw control signals are passed to the additional sensor. At block 516, the process generates an alarm based on the detected threat. Further, the process controls the additional sensor to gather information on the target at block 518. In one embodiment, the process steers an adjustable camera and focuses its site on the target to gather video data. At block 520, the process displays the data from the additional sensor for the operator on a monitoring station. In one embodiment, the process displays the video signal from an adjustable camera. In one embodiment, self-identification signals received from the target are also displayed on the monitoring station.