Surveillance device by use of digital cameras linked to a cellular or wireless telephone

[0001] Provisional Patent Application 60/758,140

[0002] Application Number PCT/FI/03/00153

[0003] International Filing Date: 3 Mar. 2003

[0004] This application identifies the concept of a video surveillance system using video cameras linked through a camera application module to a terminal via a wireless connection. The camera application module mediates interchange of information and video data between the camera(s) and wireless connection which may be comprised of a fixed wireless terminal, an Email connection, or a cellular connection. The system may employ alarms relating to individual cameras An alarm will cause an alarm message to be sent to the wireless terminal via the application module. The camera will start and send frames at a rate which the radio path will allow. In the case of 2G (GSM and GPRS), the video will be compressed to accommodate the bandwidth of the radio path. Full speed streaming video is not contemplated in this application.

[0005] The system will also respond to a poll from the remote user terminal and will transmit video frames from a video camera selected by remote user command. In both cases the camera will start recording and transmitting after the triggering stimulus.

[0006] U.S. application Ser. No. 11/521,416

[0007] National Filing Date: 15 Sep. 2006

[0008] This application defines the means of sending or exchanging streaming video and voice over a fourth generation wireless network based on IEEE Specification 802.16 for both fixed and mobile wireless subscribers.

[0009] Not Applicable

[0010] Not Applicable

[0011] There is a prior patent application in which the stated objective is the definition of the means of surveillance using digital video cameras. In this case, the system is linked to a wireless, land line or Internet terminal using a radio link in lieu of hard wired connections. This application introduces the concept of a local alarm causing a local controller to start a camera and simultaneously initiate a wireless connection to a user. In this preceding case, the camera is inactive unless either an alarm or a call from a remote user occurs. This prior proposed system allows only stepped video frames or compressed video files to be sent. Streaming video is not contemplated because of lack of bandwidth in existing wireless facilities.

[0012] This specification explains the requirements and method for implementation of a surveillance system which will allow transmission of streaming video and voice from the system to a remote cellular or wireless terminal. Such a system will employ digital video cameras running continuously and sending their output into a storage device via a controller. The storage device will hold a predetermined amount of output from each camera. When the storage capacity is reached, video will be overwritten from the beginning storage address. A wireless call from a remote user will cause the controller to send the output of any user selected camera, properly compressed for transmission, from the storage device to a wireless communication interface and thus to the remote user. An alarm will cause notification to be sent to the user via a wireless call and a text message. The user may then call the surveillance system and sample various camera outputs along with sound. The user may retrieve video from the storage device to allow him to see events prior to triggering of the alarm. Since streaming video exchange is not practical using existing 2G and 3G cellular networks because of network congestion problems, 4G network technology will be employed.

[0021] The present wireless networks are configured for either cellular voice use (2g and 3G) or for higher speed data including downloads from the Internet, video downloads and music downloads. The three latter are being achieved by use of new broadband wireless networks such as UMTS and EV-DO which are base on third generation CDMA technology. These broadband networks are separate and distinct from voice networks. All existing broadband networks employ 2G or 3G technology. The new surveillance system will communicate both sound and video using wireless networks including both long range fixed and mobile wireless communication using new technology to achieve greater bandwidth. An example of this is OFDMA (Orthogonal Frequency Division Multiple Access) technology which will allow dynamic bandwidth allocation so that a single network may carry voice, video, Internet download and high speed data. The IEEE 802.16 series of specifications provides the building blocks for creation of a new interconnected fixed and mobile network which will replace the existing voice and broadband wireless networks with one (4G) network.

[0022] The ongoing rollout of 4G networks based on IEEE Specification 802.16 (a-n) will make possible the exchange of voice and text as well as broadband data on a single network. Both fixed and mobile subscribers will be served and potentially interconnected.

[0023] The proposed surveillance system will employ digital cameras interfacing a control unit. The camera interfaces may be hard wired or employ local wireless interfaces. Microphones associated with each camera will be similarly interfaced with the control unit. Various alarms adjacent to cameras will be monitored by the system and cause the system to notify a remote user of an alarm condition via a text message to hid wireless terminal.

[0024] The control unit will have the following functions:

[0025] Capture the video and sound outputs from each camera and microphone location and store these separate outputs continuously on non-volatile memory. There will be sufficient memory to capture video and sound for an extended period after which the storage will begin at the initial address, overwriting the old data.

[0026] Mark each video input with a time and date stamp.

[0027] Monitor the alarm inputs. In case of an alarm, compose and send a text message to the remote subscriber informing him of the alarm status, date/time and camera location.

[0028] Upon receipt of a call from the remote subscriber, await the selection of a camera. After camera selection, retrieve current video and sound from memory storage and send video and sound to the originator.

[0029] Monitor the remote subscriber connection for selection of video and sound prior to and after the alarm condition. The subscriber may select increments of time of one to several minutes.

[0030] The subscriber may select an interval prior to, including and post alarm output. This output range will be stored in a separate non-volatile event memory for later retrieval and conversion to a permanent storage medium outside of the surveillance system.

[0031] The originating wireless terminal will automatically configure itself to a speaker phone mode upon exercising of the surveillance option.

[0032] Selection of the surveillance option on the originating terminal will be table driven. Each user's wireless terminal will contain a list of his surveillance locations. All entities in the individual user's surveillance group will be displayed on a table. Each surveillance option table entry will be associated with a routing table which contains the selection number of the surveillance unit, a Class of Service code and an appropriate CDMA BW request code (IEEE 802.16).

[0033] Exercising the table entry and pressing the “call” button will cause the originating subscriber terminal to select the 4G network and send the CDMA BW request code. The CDMA BW request code will signal the network to assign the proper bandwidth Implementation of network configuration will be acknowledged by the network. The terminal will then send selection and the Class of Service Code. The Class of Service code for a surveillance entity will cause the network to access an alternate “caller ID” database in which the originator is identified as a surveillance subscriber for billing purposes. The alternate surveillance “caller ID” will contain a terminating class of service code which will be downloaded to the surveillance device as part of the “caller ID” package after call routing. Receipt of the class of service code by the surveillance device will confirm the call as a surveillance call and not a wrong number.

[0034] The surveillance system will answer the call through the integrated wireless terminal. After call connect, the surveillance system will ask for a password to ensure that loss or theft of the originator's wireless terminal will not allow access to the surveillance system by illicit users.

[0035] After connection is achieved, the originator will be able to select a table which will allow selection of an appropriate camera site (listed, for example, as “kitchen”, “back yard”, etc. Selection of a particular camera site on the camera site table will select a camera code sequence to be sent to the surveillance device. This will cause video from that site to be forwarded to the originator. Keypad functions will allow the originator to select a window of recording time from the camera output he is observing. This window may contain video and sound both before and after the initiation of the call. Video camera output and sound obtained during this window may be stored in an “Event Memory” for later retrieval.

[0036] Alarms will be communicated to the remote user via text message sent over a wireless connection initiated by the surveillance device.

[0037] Terminals may be configured to support the surveillance option on various transmission facilities which may be integrated with the new 4G network. These will include mobile broadband wireless networks, “wireless city” networks (including “Hot spot” interfaces with 802.11) and “wireless city” networks interconnected with other “wireless city” networks by satellite link or fiber optic link. Interconnection of mobile and stationary wireless terminals into one network will allow users to employ various paths to interrogate a surveillance device.

[0038] Because of direct linkage of the surveillance device to the subscriber over the 4G network, the device is not tied to a land line or Internet connection and thus may be installed in both fixed and mobile locations such as trains and motor vehicles.