Emergency situation detector

[0001] The present application is a continuation in part of PCT Patent Application No. PCT/IL2004/000288, filed on 29 Mar. 2004, which claims priority from Israel Patent Application No. 160783, filed on 8 Mar. 2004, the contents of which are hereby incorporated by reference in their entirety.

[0002] The present invention relates to an emergency situation detector and a method of use and also to relay system therefor.

[0003] In many typical security situations, the line of defense and many times the only line of defense at a secured area is a human attendant hereafter referred to as the guard.

[0004] Whether 9/11 type air crew assault events, or a security guard assault at a nuclear plant, or a cashier in a store, once the aggressor surprises the guard he is often free to inflict damage without disturbance.

[0005] The above described system in which the main line of defense at a secured area is the guard has certain weaknesses as follows:

[0006] The system is subject to the guard's reliability or lack thereof, his folly, and any professional misconduct.

[0007] The system is subject to the guard's ability to actively sound the alarm and call for help before an aggressor is able to neutralize him.

[0008] The system is subject to the guard's ability, following a hazardous event, to report reliably and coherently to HQ fully unveiling events taking place, while trying to repulse an aggressor.

[0009] The system is vulnerable to a decision makers ability, particularly at the initial stages of a hazardous event, to take critical decisions, often in virtual tactical blindness.

[0010] The above-mentioned security flaws are all well known to criminals/terrorists and as such present major unresolved security problems on a global scale.

[0011] It is desirable to know when personnel encounter emergency siphons or to keep watch on personnel in sensitive or dangerous situations. In particular security personnel including night watchman and guards, airline pilots, truck and van drivers and the like can be the subject of attacks and other emergencies with which they are unable to cope. In such a case it is desirable for the subject of the attack to call for help, but sometimes the name of the emergency renders calling for help impossible.

[0012] Beyond the security field altogether, elderly and other vulnerable persons, particularly those living on their own, can find themselves in difficulties and unable to reach a telephone to call for help, for example after a fall.

[0013] In cases where it is not possible to call for help, a number of systems exist for automatically deter that an emergency situation exists and calling for help.

[0014] Hospital-based systems that monitor a patient's pulse and call a doctor or nurse if the pulse falls are well known but are not suitable for anything other than the hospital environment.

[0015] Aircraft based hijack warning systems rely upon the pilot's standard radio-based voice link to air traffic control or include panic buttons for broadcasting an SOS signal. Hijackers however tend to be familiar with the presence of these systems and either use dim to their advantage or prevent their use altogether.

[0016] Other systems for protecting aircraft from emergencies tend to rely on pilots' reaction times. Certain types of emergencies happen too quickly for the pilots to be able to raise the alarm or divert the pilots to emergency activity without diverting their attention to raising the alarm.

[0017] Often, the ability to determine what has happened following an aviation disaster is dependent on finding the aircraft flight recorder or black box.

[0018] Israel Patent Application No. 145498 to the present applicant discloses a system for detecting cockpit emergencies comprising the following:

• [0019] a) an input unit for receiving body stress level information from at least two subjects,
• [0020] b) a detection unit, associated with said input unit, for comparing stress level information from said at least two subjects, to detect substantially simultaneous stress level increases in said subjects, the system being operable to threshold detected simultaneous stress level increases to infer the presence of an emergency situation and to enter an alarm state.

[0021] The system uses the physiological state of the pilots to determine that an emergency situation has arisen. In order to reduce false alarms it takes data from the two pilots and deduces the presence of an alarm when both pilots indicate stress. Such a system has the disadvantage that it is only useful in situations such as the cockpit of a civil aircraft where two or more persons are likely to undergo the same emergency. The system is not applicable to security guards, elderly people living alone and the like. Likewise it is not applicable for monitoring of persons being sent into dangerous situations such as troops into battle or firemen into a burning building.

[0022] According to the present invention there is provided emergency situation detection apparatus comprising:

[0023] a stress input unit for receiving body stress information from a subject,

[0024] a physical input unit for receiving body physical reaction data from the subject,

[0025] a comparator unit, associated with the stress input unit and the physical input unit, for comparing stress level information and physical reaction data, to detect substantially simultaneous stress level change and a physical reaction in the subject,

[0026] the apparatus being operable to threshold the simultaneous detection to infer the presence of an emergency situation and to enter an alarm stat.

[0027] Preferably, the thresholding is a thresholding of the changes.

[0028] The system is configured for attachment to the subject.

[0029] The system is configured for attachment to the trunk region of a user, above the hip region.

[0030] The system may be configured for attachment to the chest.

[0031] The system may be for attachment around the stomach.

[0032] The system may be configured for agent on the hips.

[0033] Preferably, the stress level information comprises pulse rate information.

[0034] Preferably, the stress level information comprises breathing rate information.

[0035] Preferably, the stress level information is sweat level information.

[0036] The system may comprise a sensor for detecting ECG information.

[0037] The system may be configured to interpret extremely low stress level information as the subject being in a state of sleep.

[0038] Preferably, the physical input unit comprises an inclination detector affixed to the subject

[0039] Preferably, the physical input unit comprises an accelerometer.

[0040] Preferably, the physical input unit is connected to detection logic to identify physical behavior patterns.

[0041] Preferably, the patterns comprise complexes of impact and sway behavior events.

[0042] Preferably, the input unit is responsive to transmitter units placed on the subject.

[0043] Preferably, the alarm stale comprises automatic opening of a communication channel to a central controller.

[0044] The system may be configured to use the communication channel for ongoing transmission during the course of an identified emergency situation.

[0045] Preferably, the alarm state comprises automatic opening of an audio chapel to a central controller.

[0046] Preferably, an end of the audio channel is located on the subject.

[0047] Preferably, the alarm state comprises automatic opening of a video link to a central controller.

[0048] Preferably, the alarm state is additionally triggerable by at least one of an instability monitor, and a loud sound monitor.

[0049] Preferably, the device is sized and configured for mounting unobtrusively on a subject

[0050] The apparatus may comprise location detection functionality for determining a location, the apparatus further being configured to report the location

[0051] Preferably, the location detection functionality is one of a group comprising a GPS detector and a triangulation system.

[0052] Preferably, there is provided a direction sensor, the direction sensor comprising a compass needle and functionality for measuring an angle of the compass needle in relation to a reference.

[0053] The device may be associated with a memory stick for storing a predetermined amount of immediately preceding data, the detector being configured to save all data in the stack upon entry into the alarm slate.

[0054] The system may comprise a short range communicator for communicating with a relay device.

[0055] Preferably, the relay device is connected to a telephone socket

[0056] The system may comprise a first relay associated with a user and a second relay associated with a telephone socket.

[0057] Preferably, the relay device is a cellular relay device.

[0058] The system may comprise a first relay associated with a user and a second relay being a cellular relay device.

[0059] Preferably, the relay device is a satellite telephony device.

[0060] The system may comprise a first relay associated with a user and a second relay being a satellite telephony device.

[0061] Preferably, the relay device is an r.f. relay.

[0062] The system may comprise a first relay associated with a user and a second relay being an R.F. relay.

[0063] Preferably, the short range communicator is configured to use a wireless local network protocol.

[0064] The detector may be adapted for use in a vehicle by fixing a second physical detector to the vehicle and obtaining a difference signal between the physical detectors for feeding to the comparator.

[0065] Preferably, the vehicle is any one of a group comprising a land vehicle, a road vehicle, an off-road vehicle, a railway vehicle, a ship and an aircraft

[0066] The system may be adapted for use in the vehicle by including a relay attached to the vehicle to relay signals from the user via the vehicle to the remote location.

[0067] According to a second aspect of the present invention there is provided an emergency situation detection method comprising:

[0068] receiving body stress level information from a subject,

[0069] receiving body physical reaction data from the subject, comparing stress level information and physical reaction data, to detect substantially simultaneous stress level change and physical reaction in the subject, and thresholding the simultaneous detection to infer the presence of an emergency situation and to enter an alarm state,

[0070] Preferably, the thresholding comprises thresholding of rates of change.

[0071] Preferably, the stress level information comprises pulse rate information.

[0072] Preferably, the stress level information is breathing information.

[0073] Preferably, the stress level information is sweat level information.

[0074] Preferably, the physical reaction data is body angular inclination data.

[0075] Preferably, the physical reaction data is body acceleration data.

[0076] The method may be responsive to transmitter units placed on the subject.

[0077] Preferably, the alarm state comprises automatic openings of a radio link to a central controller.

[0078] Preferably, the alarm state comprises automatic opening of a video link to a central controller.

[0079] The method may comprise carrying out short range communication for communicating to a central controller via a relay device.

[0080] According to a third aspect of the preset invention there is provided a system comprising rule based logic and at least one body sensor for location on a subject, the subject being expected to follow certain behavioral rules, the at least one sensor being usable in combination with the rule based logic to detect non-compliance with the behavioral rules, thereby to indicate an abnormal situation.

[0081] Preferably, the logic unit is configured to provide two level logic, a first level defining a plurality of events for giving rise to an alarm state, and a second level defining at least one combination of the events in the first level to provide at least one alarm state.

[0082] Preferably, the events comprise at least one of a group comprising:

[0083] a change in linear acceleration of at least a predetermined level within a predetermined time;

[0084] a change in angular acceleration of at least a predetermined level within a predetermined time,

[0085] an impact of greater than a told level;

[0086] an acoustic sound of a predetermined spectrum,

[0087] a voiced sound of a predetermined set with a predetermined voiceprint; a body attitude of a predetermined angle or greater held for a predetermined amount of time;

[0088] a left body attitude of a predetermined angle or greater held for a predetermined amount of time and a right body attitude of a predetermined angle or greater held for a predetermined amount of time and a forward body attitude of a predetermined angle or greater held for a predetermined amount of time and a backward body attitude of a predetermined angle or greater held for a predetermined amount of time;

[0089] a user being outside of a given area for a predetermined amount of time;

[0090] a user being or not being at a given location at a predetermined time;

[0091] a heartrate outside predetermined bounds for a predetermined amount of time;

[0092] sway of a predetermined pattern; and

[0093] a user taking longer than a predetermined time to reach a given location.

[0094] The system may be configured to measure a predetermine event using at least two sampling rates in order to obtain different kinds of information therefrom.

[0095] The system may comprise at least a second body sensor usable in combination with the behavioral rules.

[0096] Preferably, the behavioral rules include expected behaviors of a vehicle.

[0097] Preferably, the events include the user sleeping or dozing when he is not expected to.

[0098] Preferably, the events include the user walking when expected to be stationary or being stationary when expected to be walking.

[0099] Preferably, the behavioral rules define expected attitudes of user body positions.

[0100] Preferably, the behavioral rules define places where the user is expected to be located and where the user is expected not to be located.

[0101] Preferably, the behavioral rules include expected behaviors following major impacts.

[0102] Preferably, the behaviors include behavior complexes comprising combinations of behavior events.

[0103] The system may be configured to rank the behaviors in an order of severity.

[0104] The system may comprise a location detection device and wherein the rule based logic contains rules based on location.

[0105] The system may be programmable to allow dynamic changing of the rules.

[0106] According to a fourth aspect of the present invention there is provided a direction sensor for mounting on a mobile body, the direction sensor comprising a compass needle and functionality for measuring an angle of the compass needle in relation to a reference, the direction sensor being configured for mounting in orientation fixed manner on the mobile body.

[0107] Preferably, the mobile body is a person, the direction sensor being configured for mounting on a part of the person indicative of a direction that the person is facing.

[0108] According to a fifth aspect of the present invention there is provided an emergency situation detection apparatus comprising:

[0109] a physiological input unit for receiving body physiological information from a subject,

[0110] a physical input unit for receiving body physical reaction data from the subject, and

[0111] a logic unit, associated with the physiological input unit and the physical input unit, for applying at least one logical operation simultaneously to the physiological information and the physical information, to infer the presence of an emergency situation and to enter an alarm state.

[0112] Preferably, the logic unit is configured to provide two level logic, a first level defining a plurality of events for giving rise to an alarm state, and a second level defining at least one combination of the events in the fist level to provide at least one alarm state.

[0113] The apparatus may be configured for attachment to the subject.

[0114] The apparats may be configured for attachment to the trunk region of a user, above the hip region.

[0115] The physiological level information may comprise pulse rate information.

[0116] Preferably, the physiological level information comprises breathing rate information.

[0117] Preferably, the physiological level information is sweat level information.

[0118] Preferably, the physiological information is data indicating whether a user is asleep.

[0119] Preferably, the physical input unit comprises an inclination detector affixed to the subject.

[0120] Preferably, the physical input unit comprises an accelerometer.

[0121] Preferably, the input unit is responsive to transmitter units placed on the subjects.

[0122] Preferably, the alarm state comprises automatic opening of a communication channel to a central controller.

[0123] Preferably, the alarm state comprises automatic opening of an audio channel to a central controller.

[0124] Preferably, an end of the audio channel is located on the subject.

[0125] Preferably, the alarm state comprises automatic opening of a video link to a central controller.

[0126] Preferably, the alarm state is additionally triggerable by at least one of an instability monitor, and a loud sound monitor.

[0127] The apparatus may be sized and configured for mounting unobtrusively on a subject.

[0128] The system may comprise location detection functionality for determining a location, the apparatus further being configured to report the location.

[0129] Preferably, the location detection functionality is one of a group comprising a GPS detector and a triangulation system.

[0130] The system may comprise a direction sensor, the direction sensor comprising a compass needle and functionality for measuring an angle of the compass needle in relation to a reference.

[0131] The detector may be associated with a memory stack for storing a predetermined amount of immediately preceding data, the detector being configured to save all data in the stack upon entry into the alarm state.

[0132] Preferably, the indication of an alarm state comprises any of an impact, an impact causing a subject to falling down, and an impact causing physiological readings to change.

[0133] Preferably, the indication of an alarm state comprises any of an impact, an impact causing a subject to falling down, and an impact causing physiological readings to change.

[0134] Preferably, the indication of an alarm state comprises any of an impact, an impact causing a subject to falling down, and an impact causing physiological readings to change.

[0135] Preferably, the indication of an alarm state comprises any of an impact, an impact causing a subject to falling down, and an impact causing physiological readings to change.

[0136] Preferably, an additional detector is located on a wall of a vehicle carrying a subject, so as to cancel out vibrations of the vehicle.

[0137] According to a further aspect of the present invention there is provided a central co-ordination unit for controlling a plurality of remotely located emergency situation detectors, each detector comprising:

[0138] a stress input unit for receiving body stress information from a subject,

[0139] a physical input unit for receiving body physical reaction data from the subject,

[0140] a comparator unit, associated with the stress input unit and the physical input unit, for comparing stress level information and physical reaction data, to detect substantially simultaneous stress level change and a physical reaction in the subject,

[0141] the apparatus being operable to threshold the simultaneous detection to infer the presence of an emergency situation and to enter an alarm state,

[0142] the co-ordination unit comprising an alarm unit for indicating that one of the detectors has entered an alarm state and a contact unit for contacting and providing a location of one of the detectors having entered the alarm state.

[0143] According to a further aspect of the present invention there is provided a vehicle protection unit for emergency situation detection and monitoring of the vehicle, the protection unit comprising:

[0144] a sensor associated with the vehicle for sensing vehicle situation data;

[0145] a logical unit associated with the sensor for determining from the output of the sensor whether an emergency situation is present; and

[0146] an alarm unit for entering an alarm state on detection of the emergency situation, the alarm state comprising setting a transmitter to transmit vehicle situation data to a remote location.

[0147] Preferably, the sensor is an inclination sensor for detecting inclination information of the vehicle.

[0148] Preferably, the inclination unit is a multi-dimensional inclination unit.

[0149] Preferably, the logical unit comprises an expected behavior pattern for the vehicle and is configured to recognize deviations from the expected behavior patterns as indicative of the emergency situation.

[0150] Preferably, the sensor comprises an impact sensor for sensing an impact associated with the vehicle.

[0151] Preferably, the sensor comprises an audio detector for detecting audio disturbances in association with the vehicle.

[0152] Preferably, the sensor comprises a fume detector for detecting fumes in association with the vehicle.

[0153] Preferably, the sensor comprises a radiation detector for detecting radiation presence in association with the vehicle.

[0154] Preferably, the sensor comprises an accelerometer for detecting acceleration of the vehicle.

[0155] Preferably, the vehicle situation data comprises flight recorder data.

[0156] The unit may comprise a data buffer for storing previous data for a predetermined amount of time and wherein the vehicle situation data is data currently stored in the buffer.

[0157] Preferably, the transmitter is configured to transmit vehicle situation data throughout the emergency situation.

[0158] Preferably, the transmitter is configured during the emergency situation to open at least one of an audio and a video channel to allow a remote controller to be in contact with the vehicle.

[0159] Preferably, the vehicle is at least one of a group comprising an aircraft, a waterborne vessel, a land vehicle, a road vehicle, an offroad vehicle and a railway train.

[0160] Preferably, the logical unit is configured to rank different kinds of emergency situations.

[0161] The system may comprise a relatively short range communicator for communicating with a relay device.

[0162] The system may comprise a relay for relaying signals from persons on the vehicle to a central controller.

[0163] According to a further aspect of the present invention there is provided a system comprising rule based logic and at least one body sensor for location on a subject, the subject being expected to follow certain physical rules, the at least one sensor being usable in combination with the rule based logic to detect noncompliance with the physical rules, thereby to indicate an abnormal situation.

[0164] The system may comprise an event pattern comprising a complex of physical events, the event pattern indicating the abnormal situation.

[0165] Preferably, the complex comprises a first event being an impact event.

[0166] Preferably, the impact is accompanied by a change of inclination angle.

[0167] According to a further aspect of the present invention there is provided emergency situation detection apparatus comprising at least one of

• • [0168] a) a stress input unit for receiving body stress information from a subject,
  • [0169] b) a physical input unit for receiving body physical reaction data from the subject, and
  • [0170] c) a voice input unit for recognizing stress-indicating audio input;

[0171] a comparator unit, associated with the at least two input units, for comparing stress level information and physical reaction data, to detect substantially simultaneous stress level change and a physical reaction in the subject,

[0172] the apparatus being operable to threshold the simultaneous detection to infer the presence of an emergency situation and to enter an alarm state.

[0173] The apparatus may comprise at least two of the input units.

[0174] The apparatus may comprise a short range transmitter for transmitting to a relay device.

[0175] The apparatus may comprise a transmitter for transmitting to a central controller.

[0176] The apparatus may be configured for attachment to a person.

[0177] The apparatus may further comprise a location detector being one of a group comprising a triangulation device and a GPS device.

[0178] According to a further aspect of the present invention there is provided an emergency situation detection apparatus comprising

[0179] a voice input unit for recognizing stress-indicating audio input;

[0180] a comparator unit, associated with the at least two input units, for comparing stress level information and physical reaction data, to detect substantially simultaneous stress level change and a physical reaction in the subject,

[0181] the apparatus being fixable to a location and operable to threshold the simultaneous detection to infer the presence of an emergency situation and to enter an alarm state.

[0182] According to a further aspect of the present invention there is provided a relay device for an emergency situation detection apparatus, the relay device comprising a receiver for receiving alarm state data from an emergency situation detection apparatus within range, a data enhancer for enhancing the alarm state data and an output for sending the enhanced data onwards to a remote location.

[0183] Preferably, the data enhancer is configured to add location data of the relay device to the alarm state data.

[0184] Preferably, the data output is configured for attachment to a telephone socket to work through the PSTN network.

[0185] Preferably, the data output comprises a cellular unit to send data via a cellular telephony network.

[0186] The relay may be configured for mounting on a vehicle, vessel or aircraft, wherein the location data is obtained from a location sensor.

[0187] For a better understanding of the invention and to show how the same may be carried into effect, reference will now be made, purely by way of example, to the accompanying drawings.

[0188] With specific reference now to the drawings in detail, it is stressed that the particulars shown are by way of example and for purposes of illustrative discussion of the preferred embodiments of the present invention only, and are presented in the cause of providing what is believed to be the most useful and readily understood description of the principles and conceptual aspects of the invention. In this regard, no attempt is made to show structural details of the invention in more detail than is necessary for a fundamental understating of the invention, the description taken with the drawings making apparent to those skilled in the art how the several forms of the invention may be embodied in practice. In the accompanying drawings,

[0189] FIG. 1 is a simplified diagram of an emergency situation detection device according to a first embodiment of the present invention;

[0190] FIG. 2 is a simplified block diagram of internal components of the device shown in FIG. 1;

[0191] FIG. 3 is a simplified flow chart showing a method of using the device of FIG. 1;

[0192] FIG. 4 is a continuation of the flow chart of FIG. 3, showing the procedure within the alarm state;

[0193] FIG. 5 is a simplified diagram showing the display on a controller's sceen when a security guard on patrol reports an alarm state.

[0194] FIG. 6 is a simplified diagram illustrating a hierarchy of alarm state events, and showing the events being ordered according to severity of the event and secondarily according to the time of occurrence;

[0195] FIG. 7 illustrates a controller reacting to an event which appears on one of his screens;

[0196] FIGS. 8A to 8C illustrate alternative configurations for a communication system on board an aircraft for overriding the regular communication system to report alarm events; and

[0197] FIG. 9 is a tree diagram illustrating different fields to which embodiments of the present invention are applicable.

[0198] The present embodiments provide a personally mounted alarm device capable of indicating automatically & in real-time any breach of the human line of defense, to a remote location. The alarm device is able to establish at least some of the following: that the guard is under physical attack or has been injured and what his current state is, that the guard is being negligent on a professional mission, that the guard is dozing off or has fallen asleep, that the guard is reporting reliably, that the guard is exposed and/or exposing employer to a potentially hazardous situation and other similar information in accordance with the specific circumstances.

[0199] The alarm device allows the guard's post factum performance to be monitored. Furthermore one embodiment has a memory buffer which always stores the last minute's data, so that in the event of an emergency, the moments leading up to the emergency can be looked at.

[0200] In one preferred feature, the guard's medical condition can be monitored vie EKG & respiratory state evaluation in a post attack mode.

[0201] Further embodiments provide an emergency situation detector which uses a first sensor that detects features of the fight or flight physiological response of subjects to determine that an emergency situation exists and to automatically raise an alarm. A supporting signal can then be taken from an independent physical sensor which measures something other than body stress, such as physical body attitude, and forces in general which relate to the external environment, such as an external mechanical impact, a sudden acceleration, a sudden angular change, gases or other substances in the atmosphere and the like. The use of an average, or other combination, of the signals from the stress and the physical detector provides protection against false alarms caused by self-induced anger, pure fright unaccompanied by an attack, and the like to which individual subjects may be susceptible. The signals may be measured against a threshold, or a delta may be used.

[0202] In a broader sense the present embodiments provide indication of dangerous situations arising or of circumstances that could lead to dangerous situations. For example, the embodiments may be able to determine, from physiological and/or physical, measurements, that a security guard has fallen asleep or has left his post or has conducted a patrol in a negligent manner or has been attacked and is injured, and therefore is not doing his duty of guarding etc.

[0203] Before explaining at least one embodiment of the invention in detail, it is to be understood that the invention is not limited in its application to the details of construction and the arrangement of the components set forth in the following description or illustrated in the drawings. The invention is applicable to other embodiments or of being practiced or carried out in various ways. Also, it is to be understood that the phraseology and technology employed herein is for the purpose of description and should not be regarded as limiting.

[0204] Reference is now made to FIG. 1, which shows an emergency situation detection apparatus placed on a user.

[0205] In FIG. 1, a subject 10 has an emergency situation detector 12 attached thereto. The detector comprises a belt 14 and housing module 16. The housing module 16 comprises sensing devices and a transmitter. Preferably the detector 12 is concealed beneath the subject's clothing. The detector 12 is preferably able to send signals in non-contact manner to a nearby repeater, which will be discussed in grater detail below.

[0206] Reference is now made to FIG. 2, which is a simplified block diagram illustrating the interior of housing module 16. The housing module 16 comprises bodily function sensor 18 and physical reaction sensor 20. The bodily function sensor may for example detect pulse rate or sweat levels of the subject. It may also detect ECG or like signals.

[0207] The bodily function sensor 18 receives physiological body stress level information. The physical reaction detector 20, for example a 3D accelerometer, or a piezoelectric sensor or any other suitable sensor, preferably detects sudden movements, and/or may provide indications of an impact of some kind or the attainment of a horizontal position or like indicators of physical reaction. Neither physiological stress alone nor physical reaction alone are reliable indicators of an emergency situation but both taken together may be expected to increase the reliability of any determination of an emergency situation. Additional sensors such as an audio sensor, a GPS or other location sensor and the like may be provided as well as spare capacity for adding additional sensors.

[0208] Preferably a comparison unit 22 is associated with the bodily function and reaction detectors, for comparing signal information to determine substantially simultaneous occurrence of stress level increase and physical reaction in the subject. The sampling rate may be set to measure the same event at different rates to obtain different information. The detections may be thresholded as deemed sensible by the skilled person to increase reliability of detection. Different thresholds may be appropriate for different kinds of subject. Thus elderly people may be better served by a lower threshold than a security guard. As a further alternative, instead of a fixed threshold level, the system may monitor the change in signal level over time. The change or delta may then be thresholded. Thresholding the deltas can distinguish high signal levels which are due to a rapidly occurring event from high signal levels which may be due to background stress and the like.

[0209] The thresholded output of the comparison unit, follow a positive result of the thresholding, is passed to an alarm state manager 24 to imply the presence of a emergency situation and to enter an alarm state. A transmitter 26 responds to the alarm state manager 26 to transmit alarm signals say via Bluetooth, to the nearby repeater. As well as R.F. the transmitter 26 may be able to transmit using sonic ultrasonic, infra-red or like signals.

[0210] Reference is now made to FIG. 3, which is a simplified flow chart illustrating the process of detecting an emergency. When an individual comes under physical attack or finds himself in a hazardous situation, his body is subjected to changes in two identifiable parameter groups, physiological changes and physical changes. The physiological changes include changes in pulse rate, increased sweating and/or changes in the rate of respiration. Physical changes may include changes in the three dimensional angle of recline, a detectable directional impact, a directional sway, changes in motion, thus step count, etc, directional positioning sensing, unexpected changes in the GPS or other positioning fix, audio signals, and the like. Thus many persons may sway whilst walking, but the sway is measurably different from the sway of someone walking away with a serious injury, and is different again from someone undergoing an impact. Likewise a sequence such as impact, sway, impact, can be detected as a good sign of trouble.

[0211] A preferred embodiment of the present invention uses at least a two-layer logic system for describing events and deciding whether to derive an alarm state. In the first level different kinds of events that could indicate trouble are identified. On the second level various combinations of the events in the first level are defined as setting alarm states. The use of the two level system thus reduces the level of computation required in order to arrive at the alarm states.

[0212] Examples of the events are as follows: A sudden linear acceleration in any direction, sudden acceleration being defined in any suitable manner, say an acceleration in any direction of greater than 1G for a user not expected to be in a vehicle. The threshold may be altered automatically when the user enters a vehicle to a level suitable for the vehicle. As well as acceleration in general there is also angular acceleration. Thus a guard who rests his head on a table will have an angular acceleration below a certain level, but if the guard is hit from being the angular acceleration is likely to be a lot higher. Likewise the impact as his head hits the table is likely to be recognizable higher. Thus another event that can be identified is the impact event, which can again be thresholded. An event of no movement greater than 0.1G for a period of ten minutes could also be chosen for an event, with the time and acceleration being varied depending on whether the guard is supposed to be on patrol or sitting in a guard house or in a vehicle.

[0213] A user falling or leaning forward at a given angle or greater may be one kind of event and the same backwards may be another. Likewise sideways, either left or right can be defined as separate events, and typically different threshold levels would apply to these events.

[0214] Thus the system can define certain inclinations and the like as being important if they are for a certain amount of time or in a certain direction. Otherwise they are ignored. Thus the system is able to distinguish between a user being hit from behind over the user merely bending over to tie his shoelaces.

[0215] Sound and voice events can be defined as well. For example a sound event such as a gunshot or glass breaking or a scream cam be defined. A voice event such as a cry for help can also be defined. Voiceprint technology can be used to identify the source of the cry and to react only if it belongs to the recognized user. Events with the physiological detector, such as heartrate exceeding a high threshold for a certain amount of time, or being below a minimal threshold for a given amount of time can also be defined. An out of location event can also be defined, meaning the guard is not where he is supposed to be. Likewise if the guard moves between A and B and takes longer than he should, that too could be then as an event. Perhaps he bas met an intruder.

[0216] On the second level the individual events are combined in certain ways to achieve alarm states. Thus an out of location event plus a rise in heartrate may trigger an alarm state. Likewise a gunshot plus a drop on heartrate or blood pressure may trigger a high priority alarm state. Certain events taken alone may also trigger alarm states. The reader will appreciate that there are numerous events and numerous combinations of events that can be constructed in order to arrive at alarm states, and the skilled person will know how to customize the alarm states and combinations for different circumstances. Thus a system for soldiers on patrol may be customized in one way. A rape alarm system for women would be customized in another way and an elderly person's safety monitoring system would be customized in yet a third way. A guard who is supposed to be watching a screen in a control center could be monitored for body angle to determine whether he is at an angle at which he could or could not see his screen.

[0217] FIG. 3 shows physical disturbance being measured first and then physiological disturbance. It will be appreciated that that the disturbances can be measured in a different order, or if a disturbance in one exceeds a certain threshold or meets a given criterion, then the other need not be measured. Furthermore it is possible to build the system with two separate processors, one for each type of disturbance, so that the two are measured in parallel.

[0218] It is also possible to add voice recognition to the system. Thus, words such as “help” or screams can be automatically recognized and used as indicators of emergency situation. Furthermore the system can use voiceprint technology to ascertain that the genuine user is present and not an imposter. The voice information can be used alone, or in conjunction with physiological and/or physical information, for example using logic rules. For the purposes of FIG. 3, voice recognition is simply an additional decision box along with physical and physiological disturbances.

[0219] Prevention of false positive or false negative alarms can be achieved by monitoring both the physical & physiological parameter groups, that is data super positioning, by automatic audio monitor for verification, and by using algorithms to reject normal physiological & physical changes or electronic noise. As shown in FIG. 3, the physical and physiological parameters are taken together to decide whether an abnormal situation has occurred. If so an alarm state is set.

[0220] Reference is now made to FIG. 4, which is a simplified diagram illustrating a the continuation of the flow chart after the alarm state has been entered. Preferably the alarm state manager is able to call for assistance, for example via automatic opening of a radio link, or of a video link, to a central controller, thus to provide immediate indication of an emergency state. Preferably, the link, which is at least an audio link, includes at one end a speaker and or microphone located on the body of the user. The link may be a direct link, suitable for short ranges, or where a dedicated line is available. Typically the link may involve a wireless link from the guard to a relay device. Relay devices may be set up at regular intervals in the area being guarded. The relay device may then make use of the PSTN or cellular or any other suitable network to reach the central controller.

[0221] In a preferred embodiment the relay device may have additional functions. For example it may have its own sensors that are activated upon detection of an emergency situation at a nearby device. Thus it may be connected to a video camera or a microphone.

[0222] Once a real state of emergency is determined by the mounted alert device, the following occurs, preferably entirely automatically, as shown in FIG. 4.

[0223] The alarm device sends an Alert Signal, typically, but not necessarily, via RF.

[0224] The alarm device sends a GPS fix or other geographical fix via RF to the center, affixing guard's location on say a target area digital map.

[0225] The alarm device preferably opens an audio channel preferably again via RF, to the center, enabling a remote listener to evaluate the severity of a situation at fist hand. The alarm device may optionally open a Video channel, via RF or any other available medium, to the center, enabling a remote viewer to evaluate the severity of a situation from a visual point of view. Small video cameras may be mounted with the device on the user, or alteratively may be located on walls and the like in the area being guarded.

[0226] The alarm device preferably sends a 60 Second Audio/Data Memory Package to the center. The package contains full data for a predetermined period of time prior to the beginning of the hostile act.

[0227] The alarm device preferably sends (post event) the guard's online ECO & respiratory data, enabling real time remote evaluation of a victim's medical condition.

[0228] As well as dealing with emergency situations, the device is also able to deal with regular situations, reporting on day to day activities. Thus the personally mounted alarm device preferably constantly records all Data as a memory package. Then, upon request from the center, all audio & data content of the memory package can be downloaded for analysis according to predetermined parameters. It is thus possible to find out such things as whether the guard is or was reporting reliably, whether the guard is or was negligent on a patrol mission, whether the guard is or has been exposing his employer to a potentially hazardous situation, whether a person is in good health, and the like.

[0229] In a further preferred embodiment specifically for an aircraft cockpit, the alarm state manager is able to initiate an automatic download of the aircraft's flight recorder or black box data to a central controller, thus making available flight information even if the black box is never recovered. The embodiment may obtain information about the position or height or attitude of the aircraft or any other information regarding aircraft control, from the flight recorder or from sensors provided with the embodiment. In one preferred embodiment, a camera is positioned in the cockpit and simply photographs the control panel, thereby to transmit all of the information available from the control panel as a single image or a series of images.

[0230] In a further preferred embodiment, flight information is taken by splicing communication cables in order to monitor passing data.

[0231] The alarm state manager is preferably also able to enter an alarm state under the influence of other detectors, for example with detection of a loud noise or following prolonged instability. The alarm state manager may be able to enter different levels of alarm states prompting different actions.

[0232] It is often important with air and spacecraft to be aware of the situation on the outer surface of the craft. Therefore, in another preferred embodiment, the system includes cameras with external views as part of the system's sensors. Alternatively the cameras may be externally mounted to provide internal views. Cameras may be mounted in blisters on the aircraft skin, or small cameras may be included into the thickness of the skin. Thus it is possible for the pilot to verify say that the undercarriage is in the correct position or the pilot is able to estimate external damage etc.

[0233] As shown in FIG. 4, the emergency situation detector includes an audio or other confirmation channel which can be opened upon detection of an emergency in order to provide confirmation of the situation or allow two-way communication, or the like.

[0234] As mentioned above, the emergency situation detector 12 includes a GPS detector to provide positioning information. For use in a building or other places where GPS signals may not be available, a triangulation system may be installed for accurate positional information. As a further alternative, location information may not be provided by the detector 12 but rather by the relay device.

[0235] A further preferred embodiment intended for a user who stays within a predefined area such as a security guard on patrol, simply sends regular code signals from which the system infers that he is in position.

[0236] Further preferred embodiments are provided to determine attitude, position and motion of a subject. Thus the emergency situation detector may include an accelerometer. A detector for detection of a direction that a user is facing may be strapped to the chest or a like part of the body. The detector includes a compass needle and the relative alignment of the compass needle relative to a predefined forward direction of the body provides information as to the direction the user is facing. At the controller's end the individual user may be represented by a 3D animation which the direction and attitude of the guard.

[0237] In a further preferred embodiment, emergency situation detectors are provided to two or more persons in a team. The signals from different members of the team can be compared to determine who is the closest to an event. For example the intensity of an audio signal as received from two different users can be compared to determine who was the closest to an explosion. The team can then be instructed accordingly to deal with the situation.

[0238] As an alternative, the physical signal can be compared with a detector of the surroundings, for example a detector located on the wall of the aircraft. Thus vibrations due to the aircraft can be discounted by a simple subtraction operation involving the two sets of signals. It will be appreciated that the use of such a second sensor is applicable to any vehicle or vessel and not just an aircraft.

[0239] In one embodiment, data is stored for a predetermined time in a stack, for example a FIFO stack. The size of the stack may be a given amount of data, or may be a given amount of time, or some other factor as preferred. In the event of the detection of an emergency situation, all of the data currently in the stack is saved or immediately transmitted for remote saving, so as to allow subsequent analysis. The stack embodiment is useful because it makes available information from directly before the emergency, often extremely useful in any investigation.

[0240] Embodiments of the present invention may use a private communication channel. In one embodiment the equipment located on the user has a short range radio transmitter receiver and a corresponding transmitter receiver is located over a telephone socket, to provide the relay device referred to above. The device at the telephone socket includes an automatic dialer which makes a connection with the controller. For greater range the device at the user may transmit to a repeater which then transmits over a greater range. One embodiment of the repeater may be located at a convenient nearby power socket. Another embodiment may be located on the person. Other embodiments may make use of existing channels such as the cellular network. Yet other embodiments may comprise universal communicators which make use of public networks if detected and use their own channel of communication otherwise.

[0241] According to a further embodiment a system comprises rule based logic and one or more body sensors for location on the subject. The subject is expected to follow certain behavioral rules, for example a guard patrols by walking around within a certain area. If he were to run or lie down it would be apparent that an abnormal situation may have arisen. Thus the sensor is usable in combination with the rule based logic to detect non-compliance with the behavioral rules, to indicate an abnormal situation and if necessary to set off an alarm or otherwise summon help. It will be clear that the more independent sensors are used the more reliable the determination can be.

[0242] In other circumstances, a guard may be expected to run and lie down to observe suspicious circumstances. In such a case the system may not react under such circumstances, but may await an additional indication such as an impact or the sound of an explosion, or signs or rolling or the like or an indication of an impact prior to the guard lying/falling down and having his physiological ridings change, which may indicate that the guard is under attack.

[0243] In a preferred embodiment the detectors are programmable. The rules can be changed for different users or for allowing the same device to be given to different users having different requirements. The device can also be dynamically programmable according to parameters it is able to detect. Thus it may be able to use detected locations to change between different sets of rules. Or as another example a device programmed for use by a fireman may change the rules it is using depending on the temperature it detects. In a further example the change of rules may be carried out on line, for example over a radio connection.

[0244] A position or location detector may be used in combination with the above system and the rules preferably define location based behaviors.

[0245] At decision marker level the alarm system's primary operational implications is its ability to assist a decision maker to have a clear picture of the situation at a remote location. In emergency mode the decision maker is notified in real-time of any breach of the human line of defense. He obtains a first hand understanding of a hazardous situation in real time. The reaction time to take containment action is considerably reduced as is the likelihood that the correct containment action will be selected, real time monitoring of a guard's performance is possible so that it is clear whether he is coping, needs backup or even medical treatment and the like. Likewise it is possible to monitor in real time the guard's tactical or technical abilities or lack thereof and to spot redundancies. As mentioned above, it is possible to provide continuous monitoring of the guard's medical condition vie EKG & respiratory state evaluation.

[0246] Likewise, during day to day operation it is possible to dramatically improve or upgrade the level of guarding services rendered. The system can obligate guards to perform in an optimal way at all times, by providing real time monitoring of the guard's performance. It allows post factum analysis of the guard s performance. It dramatically improves the guard's reliability and dramatically improves the guard's personal safety.

[0247] Reference is now made to FIG. 5, which is a simplified diagram illustrating the controller's screen of a preferred embodiment of the present invention. The screen shows digital map 30 of a region. An event occurs and the location of the event is marked on the map by marking 32. A data window 34 displays data of the event such as the identity of the guard, the type of event etc. Three buttons at the top of the data window 34 provide respectively an audio link 36 to the guard, replay of the FIFO stack 38 and an e-mail link 40 to a designated responsible person.

[0248] Reference is now made to FIG. 6 which is a screen shot of an event monitoring and management screen. A series of events and timings are shown for different locations or patrols. The different kinds of events are assigned a position in a hierarchy and displayed accordingly. Thus an indication of “no vital signs” is shown as a highest priority event over “physical assault” and others. Secondary sorting is then carried out based on time.

[0249] The Alert System is designed to operate in a highly versatile multi task environment and three preferred embodiments are provided for three different environments, an airborne version, a seaborne version and a land version. It is pointed out that the following deals with security versions and not with versions for monitoring elderly or other persons at risk for medical reasons.

[0250] The airborne version, shown in FIG. 7 as being used by an air traffic controller as the central controller, is provided with double redundancy and deals with threat types such as hostile takeover attempts at the aircraft. The product is an alert device+monitoring service with full time remote monitoring and assistance via a control center.

[0251] Once a pilot or air marshal assault is detected by the mounted alert device, the following occurs automatically:

[0252] Firstly the alert device opens a real time Data channel (aircraft to HQ) via RF which relays GPS data fixing the aircraft location on a target area digital map, preferably an altimeter reading, preferably a 3D electronic gyroscope reading. Preferably a real time Audio channel is opened between the aircraft and the control center enabling a remote listener to evaluate the situation's severity at first hand. Preferably the alert device sends via RF a 60 Second Audio/Video/Data memory package to HQ Fully unveiling on-board events taking place prior to the beginning of the detected hostile act.

[0253] In a preferred embodiment, the alert device opens via RF a real time Video channel between the aircraft and the control center, enabling a remote viewer to evaluate the situation's severity visually.

[0254] It is noted that an aircraft has expected behavior patterns. Thus a passenger aircraft is not expected to carry out acrobatics, and aircraft are expected to keep to their planned courses. Deviations from the expected behavior, such as a passenger plane overturning, may be taken in whole or in part as indications of an emergency. In such a case the event may be used to trigger downloading of data from the flight recorder or black box or the buffer of the system of the present embodiments. It may also open the audio or video channel and transmit the ongoing event, or readings from the event.

[0255] The alert device sends, as post event data, again via RF, the pilot or sky marshal's online EKG & respiratory data enabling real time remote evaluation of a victim's medical condition.

[0256] Reference is now made to FIGS. 8A to 8C which show three different configurations for the communication system. In an aircraft, unlike in other environments, safety issues are raised by using additional communication systems. The preferred embodiment therefore makes use of the aircraft PTT communication system 50 via an override device 52 to take control of transmitter 54. In FIG. 8A the override lies outside the direct connection between the PTT and transmitter. In FIG. 8B it directly intercepts the connection and in FIG. 8C the overide device is a part of the transmitter 54.

[0257] As a further alternative, a satellite link can be used, as is currently being proposed for mobile telephones on passenger aircraft.

[0258] A seaborne version is similar and has double redundancy. It is intended for threat types such as hostile takeover, piracy and the like. The product is once again an alert device+monitoring service, with full time monitoring and remote assistance via a control center.

[0259] Once a bridge crew assault is detected by the mounted alert device, the following occurs automatically. First of all the alert device opens a real time Data channel between the Ship and the center, relaying GPS data fixing the ship's location on a target area digital map. Additionally, the alert device opens via RF a real time audio channel between the ship and the center, enabling a remote listener to evaluate the situation's severity at first hand. The alert device also preferably opens, via RF, a real time video channel between the ship and the center, enabling a remote viewer to evaluate the situation's severity at first hand.

[0260] The alert device sends via RF a 60-90 Second Audio/Video/Data memory package to HQ Fully revealing bridge crew evens taking place prior to the beginning of the hostile act.

[0261] The alert device preferably also sends, post event, the bridge crew online EKG & respiratory data enabling real time remote evaluation of the victim s medical condition.

[0262] Ships generally have expected behaviors and courses. Deviations from the course can be taken as suspicious events. The system can be hidden on the ship.

[0263] A land based version is for threat types such as hostile intrusion or takeover of a secured area/facility, as well as for monitoring of personnel on dangerous missions, say soldiers, police or firemen. Landbased vehicles include both road vehicles, off-road vehicles and railway vehicles.

[0264] There are two versions of the land based product, one for static or foot based users, and one for mobile or mechanized users. Again the product is an alert device with a full time remote monitoring service.

[0265] Once a guard assault is detected by the mounted alert device, the following occurs automatically. First of all the alert device sends an Alert Signal, preferably via RF. The device sends GPS co-ordinates fixing the guard's location on a target area digital map. The alert device opens via RF an audio channel to the center enabling a remote listener to evaluate situation's severity at first hand, and if possible talk to the guard. The alert device preferably sends via RF a 60 Second Audio/Data Memory Package to HQ Fully unveiling events taking place prior to the beginning of the hostile act. In addition the alert device sends, following the event, again typically via RF, the Guard's online EKG & respiratory data enabling real time remote evaluation of victim's medical condition.

[0266] Optionally, if video cameras are present in the vicinity, the alert device opens a video channel via available infrastructure to the center.

[0267] It is appreciated that certain features of the invention, which are, for clarity, described in the context of separate embodiments, may also be provided in combination in a single embodiment. Conversely, various features of the invention which are, for brevity, described in the context of a single embodiment, may also be provided separately or in any suitable subcombination.

[0268] It will be appreciated by persons skilled in the art that the present invention is not limited to what has been particularly shown and described herinabove. Rather the scope of the present invention is defined by the appended claims and includes both combinations and subcombinations of the various features described here inabove as well as variations and modifications thereof which would occur to persons skilled in the art upon reading the foregoing description.