Security monitoring arrangement and method using a common field of view

[0001] This patent document claims benefit under 35 U.S.C. § 119(e) to U.S. Provisional Patent Application No. 60/719,369, entitled “Security Monitoring Arrangement and Method with Privacy Control,” filed on Sep. 22, 2005.

[0002] The present invention is directed to a security arrangement and method for monitoring the inside of a facility or residence.

[0003] In order to protect residents, employees, personal property, and the like, security monitoring systems are used to monitor a variety of facilities and to sense the presence of an unwanted intruder. Many such security systems are connected to a central control unit and monitored by an operator who can alert the appropriate emergency services in the event of an unwanted intruder. Typically, a home monitoring security system includes a combination of sensing devices and alarm devices and some also include cameras. To achieve the maximum monitoring coverage, these devices are distributed throughout the interior of the facility.

[0004] Security systems that employ cameras are advantageous in that they are able to record activity associated with a suspected breach of the facility. In some instances, however, the cameras record the regular activities of the facilities' residents and/or employees. The cameras also record activities that are falsely perceived to be security breaches such as pet behaviors and authorized users that have been accidentally locked out.

[0005] In specific situations, such as those having the potential to violate the privacy of authorized residents and/or employees of the facility, such comprehensive recordation by the security cameras may be undesirable. Since unwanted intruders could breach the security of a facility while the inhabitants are present, it is necessary for the security monitoring system to be functioning at all times. However, having cameras constantly being triggered to record the inhabitants' daily living and working routines is a dramatic invasion of the inhabitants' privacy, and is burdensome with respect to false triggers. Further, the monitoring and recording of guests' activities can be just as invasive.

[0006] The above-discussed issues have presented challenges to developing a home and/or facility security monitoring system that provides maximum coverage while minimizing one or more of the above-identified issues.

[0007] The present invention is directed to the above and related types of integrated security systems. These and other aspects of the present invention are exemplified in a number of illustrated implementations and applications, some of which are shown in the figures and characterized in the claims section that follows.

[0008] Various aspects of the present invention are applicable to an integrated security arrangement. The arrangement includes an intrusion sensor to sense an intrusion at a target area of a facility, a second sensor to sense movement, an image-capture device, and a base unit. The image-capture device captures images in response to an intrusion indication from the intrusion sensor and in response to a movement indication from the second sensor. The base unit integrates a direction of view of the second sensor and of the image-capture device, thereby directing the second sensor to sense in the target area in which the images are captured by the image-capture device.

[0009] Other aspects of the present invention are applicable to a method for manufacturing an integrated security apparatus that is responsive to an intrusion sensor that senses an intrusion at a target area of a facility. The method includes providing a base unit, a second sensor to sense movement, and an image-capture device. The image-capture device captures images in response to both an intrusion indication from the intrusion sensor and to a movement indication from the second sensor. The method also includes securing the second sensor and the image-capture device to the base unit to integrate a direction of view of the second sensor and of the image-capture device. This integration directs the second sensor to sense in the target area in which the images are captured by the image-capture device.

[0010] Other aspects of the present invention are applicable to a security system where a second sensor and image-capture device are not physically integrated inside the same housing. In one such example, an embodiment is arranged with an intrusion sensor to sense an intrusion at a target area of a facility, a second sensor to sense movement, and an image-capture device. The second sensor bears a special relationship ( e.g., located sufficiently near and aligned) with the image-capture device to form a common field of view, such that the fields of view for both devices overlap without the devices being located inside a common housing. The image-capture device captures images in response to an intrusion indication from the intrusion sensor and in response to a movement indication from the second sensor.

[0011] The above summary of the present invention is not intended to describe each illustrated embodiment or every implementation of the present invention. The figures and detailed description that follow more particularly exemplify these embodiments.

[0019] While the invention is amenable to various modifications and alternative forms, specifics thereof have been shown by way of example in the drawings and will be described in detail. It should be understood, however, that the intention is not necessarily to limit the invention to the particular embodiments described. On the contrary, the intention is to cover all modifications, equivalents, and alternatives falling within the spirit and scope of the invention as defined by the appended claims.

[0020] The present invention is believed to be applicable to a variety of different approaches and arrangements for providing security services. The invention has been found to be particularly advantageous for addressing security monitoring needs in a residence or private-office environment.

[0021] According to an example embodiment, a security system utilizes cameras to detect and identify intruders. The system includes an integrated camera/motion detector that is responsive to intrusion conditions. The camera's smart-behavior results in reduced power consumption and mitigates privacy concerns on various levels. A system user sets up zones with at least one intrusion sensor (e.g., door/window contacts or glass-break detectors) for each zone around the perimeter of a facility and sets up corresponding camera/motion detectors in the interior of the facility. The intrusion sensors are activated (armed) by a system user, using, e.g., a keypad on a security panel, a remote control fob, or a phone call with DTMF. This allows for a complete activation of the system when the system user leaves the facility as well as a partial perimeter activation of the facility when the system user (or other authorized person) is present. Thus, when the user is present the camera remains “off” unless appropriately triggered by the motion detector. However, the motion detector also remains “off” unless it is armed by a corresponding intrusion sensor. Therefore, cameras record images inside the facility when both an intrusion sensor has been tripped and a motion detector has detected motion.

[0022] Another example embodiment is directed to an integrated security arrangement. The arrangement includes an intrusion sensor to sense an intrusion at a target area of a facility, a second sensor to sense movement, an image-capture device, and a base unit. The image-capture device captures images in response to an intrusion indication from the intrusion sensor and in response to a movement indication from the second sensor. The base unit integrates a direction of view of the second sensor and of the image-capture device, thereby directing the second sensor to sense in the target area in which the images are captured by the image-capture device.

[0023] FIG. 1A illustrates an example embodiment of an integrated security system, according to the present invention. A base unit 35 is located in the interior of a facility and integrates a motion sensor 20, a camera 25, a data processor 30, and a communication interface 15. In one implementation the motion sensor is a passive infrared (PIR) sensor, which detects infrared energy in a target area and, in connection with a processor 30, recognizes changes in infrared energy (e.g., temperature changes) to detect motion. Depending on the size of the facility, multiple base units are located throughout the facility's interior, with a control panel 45 acting as a conventional communication hub for the facility. When the base unit 35 receives an intrusion signal 10 from an intrusion sensor (via communication interface 15), the motion sensor 20 is activated. As shown in FIG. 1A, this communication interface 15 interfaces the intrusion sensor input 10 to the control panel 45. This sensor input 10 can therefore inform either the base unit 35 or the control panel 45 to arm the motion sensor 20. When unarmed, the motion sensor 20 will not be able to activate camera 25 but may still detect motion. The motion sensor 20 can detect motion in its field of view, and once the motion sensor is armed, the motion sensor is able to activate the camera 25. The motion sensor 20 and the camera 25 are positioned such that both devices have overlapping fields of detection. Thus, images of the source of the detected motion are recorded by the camera without requiring any intervening adjustment or alignment. The recorded images are processed by a data processor 30, which can be integrated with the motion sensor 20 and the camera 25 in a base unit 35 as shown, or may be located remotely and electrically coupled to the base unit 35.

[0024] It will be appreciated that the data processor 30 can be implemented, for example, in the form of a high-speed processor such as a DSP (including an ALU) and/or a more general-purpose processor that may be optionally programmed for video data (de)compression. Thus, various embodiments may include a variety of combinations of processing operations with one or more aspects of the processing operations performed at one or more local or remote processors. For example, both video data storage and compression may be performed in the base unit 35 by the data processor 30. When the processor is located remotely, the data storage may still occur in base unit 35, but compression of the video data could be implemented in the remote processor. Another embodiment may involve data storage in the base unit 35 without any compression of the video data. Moreover, each of the above operations may be performed in combination with a central processor 55, as further discussed below.

[0025] In example implementations the base unit 35 is a battery-operated, wireless device having both motion sensing and image-capture capabilities. For further information on such a device, reference may be made to concurrently filed provisional application Ser. No. 60/785,570 filed on Mar. 24, 2006, entitled “Motion-Image Monitoring Method and Device” , which is herein fully incorporated by reference. In certain implementations, data processor 30 is configured to preserve battery life by communicating in accordance with appropriate power-saving protocols. For example implementations related to communicative coupling and data transfer among the above-discussed devices in accordance with appropriate protocols, reference may be made to U.S. application Ser. No. 11/389,673 filed on Mar. 24, 2006, entitled “Spread Spectrum Communications for Building-Security Systems” and European Patent Application Publication No. EP 1 363 260 filed on May 6, 2003, entitled “Procédé de communication radiofréquence entre plusieurs dispositifs et système de surveillance mettant en ceuvre un tel procédé,” which are herein fully incorporated by reference. The power-saving approaches also provide for limited activation of the above-discussed camera such that the privacy of the inhabitants of a residence or facility is largely maintained.

[0026] The recorded images are transmitted over a bi-directional sensor communication path 40 to a control panel 45. In one implementation, the sensor communication path 40 is wireless and can be employed, e.g., as described in the above two incorporated patent documents. The transmitted images may be encrypted by the data processor 30 before being transmitted to the control panel 45. The control panel 45 includes a local storage area for the recorded images 50, the central processing unit 55, and a transceiver 60. The control panel 45 is located within the same facility as the base unit 35. The central processor 55 receives images from each of the base units located within the facility. Similar to the above discussion, the central processor 55 may perform a variety of processing operations alone or in combination with data processor 30. The images may optionally be stored in data storage 50 for further review or processing. The control panel 45 includes a battery backup power source 65 in the event of a loss of power, e.g., a natural disaster or an intruder disables power to the facility. The transceiver 60 further transmits signals including system status reports or recorded images via a telephone channel 70 or cable channel 75 to outside monitoring facilities. The telephone channel 70 and cable channel 75 are not limited to PSTN or broadband channels; they may be part of a GSM/CDMA network. Outside monitoring facilities may include a private security company or a local law enforcement station.

[0027] In another example embodiment, when an intrusion sensor senses an intruder breaching the facility (e.g., door/window contact is tripped), the intrusion signal 10 is transmitted directly to the control panel 45. The control panel 45 arms one or more base units 35 in the same zone as where the intrusion signal 10 originated. The base unit(s) 35 respond as discussed above. In this system architecture, the control panel 45 is the master and the sensors and control devices (e.g., keypads, keyfobs) are slave devices. The radio link in this architecture is a star topology with the control panel 45 at the center of the network. The branches include base units 35 and external links, e.g., telephone channel 70 and broadband channel 75.

[0028] Other aspects of the present invention are applicable to a security system where a second sensor and image-capture device are not physically integrated inside the same housing. In one such example, an embodiment is arranged with an intrusion sensor to sense an intrusion at a target area of a facility, a second sensor to sense movement, and an image-capture device. The second sensor bears a special relationship (e.g., located sufficiently near and aligned) with the image-capture device to form a common field of view, such that the fields of view for both devices overlap without the devices being located inside a common housing. The image-capture device captures images in response to an intrusion indication from the intrusion sensor and in response to a movement indication from the second sensor.

[0029] In more specific embodiments, the various arrangements permit the devices to be situated in different ways to provide the common field of view. For example, horizontal movement, vertical movement, or horizontal and vertical movement can be provided for each of the motion sensor and the image-capture device, with their movements mirrored to maintain the integrated field of view. More particularly, such mirrored movement can be provided by using a ratchet-like mechanism with devices to provide increment adjustments in the horizontal and/or vertical directions; the skilled artisan would appreciate that such adjustment can be implemented using servo-control motors or be manually implemented using conventional position-stabilizers that permit step-wise/incremental rotation.

[0030] In a related embodiment, horizontal movement, vertical movement, or horizontal and vertical movement can be provided for either or both the motion sensor and the image-capture device by way of conventional electronically-implemented pan/tilt/zoom operation(s) but with their movements coordinated to maintain the integrated field of view. For image-capture, such pan/tilt/zoom operation is commonly used in digital video-recording devices. The motion detector may also be manipulated to alter the field of view.

[0031] In more specific embodiments, the various arrangements can be implemented with a spatial relationship between the motion sensor and the image-capture device by using a common backplate to which each of the motion sensor and the image-capture device are mounted and/or a template for aligning the motion sensor and the image-capture device for mounting on a wall, where contoured portions of the respective backs of the motion sensor and the image-capture device may provide an offset for biasing the direction of view.

[0032] In other specific embodiments, the various arrangements permit for such above-described devices to be situated such that their movement is pre-set before they are used or dynamically controlled while in use with automated or semi-automated coordination provided by the control circuitry and/or personnel at a remote-site center. Such coordinated movement, while maintaining a common field of view, benefits a variety of monitoring and/or security applications.

[0033] FIG. 1B illustrates a process for detecting an intruder, according to an example embodiment of the present invention. The process shown in FIG. 1B may be implemented, for example, using a security system such as that shown in FIG. 1A or otherwise described herein. An intrusion sensor, such as a window or door contact, located at a perimeter of a facility detects whether the contact subject, window or door, has been breached 110. If, for example, a window has been opened, the window contact (intrusion sensor) sends a signal to a corresponding integrated motion sensor/camera located at the interior of the facility. Upon receipt of the intrusion signal, the motion sensor is activated 120 and the integrated camera is set to a “ready” mode without initiating recording 130. The motion detector remains activated 140 and when motion is detected, the integrated motion sensor/camera is again triggered 150. Once motion is detected, the camera turns “on” and captures images of the source of the motion 160. The video images are sent to a central control panel for further evaluation 170. Further evaluation may include determining (manually or automatically using, e.g., machine visions) whether the source of the motion is human, an animal such as a pet, or another moving object. If the source is determined to be human, further evaluation may reveal whether any identifying images were captured, whether the human is an intruder or an inhabitant of the facility, and face recognition may be used to identify a previously unknown person intruding on the facility.

[0034] FIGS. 2A-C illustrate another example embodiment of a security system installed in a room. FIG. 2A shows the security system in a normal operating mode with the window contact 210 armed. In certain implementations a glass-break detector may be used as an intrusion sensor. The base unit 235, including both a motion sensor 220 and a camera 225, is located on a wall inside the bedroom. Both the motion sensor 220 and the camera 225 detect and monitor an area of the bedroom that includes the window and the bed. FIG. 2B illustrates the entrance of an intruder into the bedroom. For example, when the window is opened, the window contact 210 senses the breach of the facility and signals the base unit 235. In response to the signal, the motion sensor 220 is armed while the camera remains inactivated. FIG. 2C illustrates the intruder approaching the bed and the security system recording the unwanted activity as it occurs. The motion detector 220 detects the intruder walking toward the bed which triggers the camera to turn “on” and begin recording the intruder's movements. In one embodiment the security system may sound an alarm to scare the intruder into halting the unwanted activity. In other embodiments an alarm may be delayed until the recorded images are evaluated to verify that the intruder is an unwanted assailant and not a false alarm, e.g., a pet, or an inhabitant sneaking into the residence after curfew.

[0035] FIG. 3 illustrates an approach to processing recorded images in a security system, according to another embodiment of the present invention. An intrusion sensor is activated at block 310 when an intruder breaches the perimeter of a facility. If a motion sensor/image-capture device detects motion at block 320, an alarm condition is reported at block 330 and an image search is initiated at block 340. The alarm condition may be transmitted to, for example, a central control panel, a law enforcement agency, a private security monitoring facility, a cell phone, or a personal computer.

[0036] With the image search at block 340 the motion sensor/image-capture device generates video data. The video data is processed at block 350 to evaluate whether the source of the motion is captured in the video data and whether the source of the motion can be identified. For example, if the source is a false trigger such as a pet or authorized employee/inhabitant that was locked out, the system can identify the false trigger and cease further security or alarm activities. If the intruder is recorded, a status report is transmitted to the appropriate authorities at block 360. If the intruder is not detectable, the system determines whether a predetermined amount of time has been exceeded at block 370. If the video data searching has not exceeded the predetermined time delay, the system continues searching the data for images of the intruder. However, if the predetermined time delay has been exceeded, a status report is transmitted and other means are optionally implemented to identify and apprehend the intruder, such as by sounding an alarm and/or alerting authorities or other security personnel.

[0037] In another embodiment, the motion detectors, while always powered, are also always in a state of motion sensing. Thus, if motion is detected shortly before an intrusion signal is transmitted, the control panel and/or base unit can recognize the chain of events as an authorized person within the monitored zone merely opening a window or door. This aspect is also advantageous as a “privacy” feature insofar as maintaining the image sensor in a disabled mode; images of the authorized person within the monitored zone would not be captured when the window is opened. The system is programmed to recognize alternate orders of signal transmission as corresponding to permitted behavior, thereby reducing the potential for the security system creating, and responding to, a false alarm.

[0038] In another example embodiment, the home entry intrusion sensor (e.g., front door contact) corresponds to a delayed-response motion sensor such that the transmission of the motion indication is delayed to accommodate a security system control keypad located near the entrance. In another zone located nearby, such as a kitchen, the motion indication is not delayed when motion is detected. The system recognizes that motion sensed in the nearby room (e.g., person setting grocery bags down in the kitchen) following a delayed sensing of motion in the entry zone is likely an authorized user and an alarm will not sound for a predetermined length of time. If the system is not deactivated or reset before the predetermined length of time expires, the alarm will sound. The number of nearby zones configured with such a relationship with the delayed motion indication in the entry zone should be limited to ensure that an actual intruder is not provided enough time to traverse the premises without being detected.

[0039] While certain aspects of the present invention have been described with reference to several particular example embodiments, those skilled in the art will recognize that many changes may be made thereto without departing from the spirit and scope of the present invention. Aspects of the invention are set forth in the following claims.