CAMERA ACTIVATION IN RESPONSE TO FIREARM ACTIVITY

[0001] This application claims the benefit of U.S. Provisional Application No. 62/092,133, filed Dec. 15, 2014, which is incorporated by reference in its entirety.

[0002] The present invention relates to apparatuses, systems, computer readable media, and methods for providing services concerning control of a portable camera in response to activity involving a firearm.

[0003] Personal video recorders as used by security and law enforcement personnel, hereafter referred to as body cameras, face many challenges in practical use. Easily portable sources of power, such as batteries, are limited in capacity and adversely impact the duration of body-camera operation. Storage media are limited in capacity and constrain the amount of video information that may be recorded. When the cameras do operate and can store their video data, it can be challenging to identify the portion of video information relevant to a specific event or incident.

[0004] Serious incidents for security and law enforcement personnel often involve use or anticipated use of a firearm.

[0005] Systems involving linking firearms and video recording have been contemplated—for example, in U.S. Pat. No. 9,140,509 to Sullivan et al., a gun-mounted “electronic evidence-collecting device”—e.g., a camera—is activated by the removal of the gun from its holster. Specifically, a light sensor mounted on the gun is covered when the gun is holstered, and when the gun is removed from its holster, the light sensor receives light and initiates the collection of gun-related data from sensors on the gun, and the sensed, gun-related data is forwarded to a portable device (e.g., a smartphone), which may then automatically call the user's partner and/or the central station to request assistance and backup. However, Sullivan's system has drawbacks—for example, it only contemplates activating data recording in response to unholstering as measured by a light sensor, and the only types of sensors it discloses are a holster sensor, a video camera, a microphone, a direction finder, a clock, and a GPS component. Additionally, Sullivan's system does not contemplate data sensing and recording devices that are not mounted on a handgun, or enabling real-time, granular event and location-based remote monitoring by integrating with a distributed system. The Sullivan system further does not contemplate metadata, or associating metadata with recorded video, as included in certain embodiments of the invention described below.

[0006] There is a need for devices and systems that facilitate reducing unnecessary power consumption (e.g., turning off or powering down the camera when needed), and reducing the amount of irrelevant or unnecessary video data to be stored and analyzed, as well as services that enable granular, real-time monitoring of firearm-related activity by a local team as well as by a remote command center. When video is generated, there is a need for facilitating review and analysis of recorded video from cameras that may concern firearm-related activity. Disclosed herein are embodiments of an invention that address those needs.

[0022] Disclosed herein are devices/apparatuses, systems, methods, and machine readable media for implementing and using an improved service for controlling a camera. Embodiments of the present invention provide a firearm equipped with certain specialized electronic circuitry, hereafter referred to as a telematics sensor or sensor. In certain embodiments, the telematics sensor detects when a firearm is in motion, is being discharged (fired), and, in the case of handguns, the firearm's position within its holster.

[0023] As used herein, a “firearm” refers to a ranged weapon, including a handgun, rifle, Taser®, Conducted Electrical Weapon (CEV), or additional types of weapons capable of firing a bullet. Certain embodiments of the disclosure may be specifically adapted for one or more of handguns, rifles, or Tasers.

[0024] As used herein, a “camera” refers to a device comprising electrical and optical components for recording still images, video, and/or audio by imaging light from the visual spectrum, infrared spectrum, and/or other spectra. A “body camera” refers to a camera that is worn by a user.

[0025] As used herein, a “telematics sensor” refers to a device for detecting and/or recording information derived from the environment of the device, and where the device has two-way wireless communications capability.

[0026] In certain embodiments, the telematics sensor is equipped with a wireless transceiver. In some embodiments, the transceiver communicates directly with a body camera; in others it communicates indirectly, via an intermediary device, or devices, and one or more network topologies. One embodiment includes the telematics sensor communicating with a smartphone, which relays the sensor's messages via wide-area or personal-area networks, which in turn connect with and relay the sensor's messages to the body camera.

[0027] In certain embodiments, unholstering of a firearm (as detected by a telematics sensor) initiates recording of video by a body camera. That is, when the firearm is unholstered, the sensor detects the event and signals the body camera (either directly or indirectly) to power up (or wake from standby) and begin recording video information. The recording may be saved locally and/or may be transmitted to a remote facility where it is stored.

[0028] In some embodiments, the body camera is able to record additional, non-video metadata as part of its functionality. The telematics sensor and/or associated software may discover and detect when a camera possesses such capabilities. Upon detection, the telematics sensor may provide additional metadata and other data to the body camera for storage with its video recording. Examples of such data may include: time, date, event identifiers, location coordinates, altitude, temperature, ammunition discharged, ammunition remaining, ammunition reloads, firearm orientation, firearm movement, firearm translation, firearm bearing, recorded audio in front of and around the firearm, and recorded video in front of and around the firearm.

[0029] FIG. 1 shows views of exemplary holster telematics sensors 102. FIG. 1A shows an isolated exemplary holster telematics sensor 102. FIG. 1B shows components of an exemplary system 101 that makes use of holster telematics sensors 102. System 101 includes a utility belt 102 with attached holsters 104a-i. Each of holsters 104a-i may incorporate a holster telematics sensor 102, for use in detecting when an instrument, such as a firearm, pepper spray, baton, handcuffs, or a radio, is present or absent from the respective holster 104. As shown in FIG. 1C, for example, holsters 104c and 104d from system 101 may each be associated with a respective holster sensor 102. A holster sensor 102 may be attached to a flap of holster 104, or may be attached to the exterior of holster 104, or may be integrated between or within the materials of holster 104.

[0030] FIG. 2 shows views of a system 200 containing an exemplary firearm telematics sensor 202. As shown in FIG. 2B, firearm telematics sensor 202 may be integrated into the grip 206 of a handgun 201. In certain embodiments, firearm telematics sensor 202 may be mounted to the slide or sight, or the trigger guide 212 of handgun 201. In certain embodiments, firearm telematics sensor 202 may be charged by a charging device 208 that may be inserted into the magazine chamber of handgun 201. In certain embodiments, a firearm telematics sensor 202 may be used to detect, for example, one or more of: ambient temperature; firearm movement, translation, and bearing; and events such as discharge of a weapon (e.g., firing a bullet) and holstering or unholstering of the firearm.

[0031] FIG. 3 shows exemplary cameras for use in a service of the invention. FIG. 3A shows a camera 302a that includes a lens 301 that may be covered by a lens cover that is transparent or is remotely controlled; one or more light sources 304, e.g., a light-emitting diode (LED), that may provide a flash or infrared illumination for night vision. Camera 302a may include a clip 306 for attaching the camera to a vest, lapel, or epaulet. In certain embodiments, the camera 302 is worn on a lanyard or strapped to the body of a user such as a police officer or security personnel. Camera 302a may include a microphone 308 for recording audio, and a speaker 310 for playing audio or providing audio feedback. Camera 302a may further include one or more buttons 312, or switches, or other user interface elements for directly controlling the camera's operation, such as for starting or stopping a recording. FIG. 3B shows a camera 302b mounted to glasses 314. In certain embodiments, a user may wear more than one camera 302 (such as both chest-mounted camera 302a and glasses-mounted camera 302b) that are all controlled by embodiments of the system described herein.

[0032] FIG. 4 shows a block diagram of a device 400 that may embody a telematics sensor (e.g., holster telematics sensor 102 or firearm telematics sensor 202) or a camera 302. Device 400 includes a processor 402 that may be in communication with one or more sensors 404, a communication module 406, a storage component 408, and a power system and/or battery 410. The power system/battery 410 may be in communication with one or more port(s) 412.

[0033] Device 400 may include one or more sensors 404—e.g., a temperature sensor for monitoring thermal load or ambient temperature, an accelerometer, a magnetometer, a gyroscope, a metal sensor (e.g., pulse induction sensor components), optical/light sensor, microphone, etc. Communication module 406 may include a subscriber identity module (SIM) card, cellular radio, Bluetooth radio, ZigBee radio, Near Field Communication (NFC) radio, wireless local area network (WLAN) radio, GPS receiver, and antennas used by each for communicating data over various networks. Storage 408 may include one or more types of computer readable medium, such as RAM, optical storage devices, or flash memory, and may store an operating system, applications, and communication procedures. The power system/battery 410 may include a power management system, one or more power sources such as a battery and recharging system, AC, DC, a power status indicator, and the like

[0034] FIG. 5 shows views of an exemplary holster telematics sensor system 500, including a holster telematics sensor 102 attached to a holster 104 having a belt clip 502, and where the holster 104 is shown to contain a holstered handgun with trigger 504 and grip 206. Holster telematics sensor 102 may include a battery 508 and a port 510. Port 510 may be, e.g., a Universal Serial Bus (USB) port, a microUSB port, a Lightning™ port, and the like.

[0035] FIG. 6 shows views of an exemplary holster telematics sensor system 500. FIG. 6B shows a rotated view of the system 500 shown in FIG. 5. In the embodiment shown here, holster telematics sensor 102 includes a pulse induction coil 602 mounted on circuit board 604 with companion circuitry 606 for detecting the presence of a firearm based on the presence of the metal of the firearm (e.g., the receiver, muzzle 608, etc.). In other examples, holster telematics sensor 102 may use very low frequency (VLF) technology to detect whether a firearm is present based on the presence of metal, or components to measure the dielectric change when metal is present or absent, NFC to communicate between sensors on a firearm and a holster, or a light sensor to detect whether light is absent, indicating a firearm is holstered.

[0036] FIG. 7 is a block diagram showing exemplary data flows for an exemplary system 700. In certain embodiments, data regarding the status of a component of system 700 and or the environment of system 700 (including, for example, a firearm and a holster) may be generated at holster telematics sensor(s) 102, firearm telematics sensor(s) 202, camera(s) 302, beacon 702, and/or mobile device 704. In certain embodiments, this data may be shared between components of the system (e.g., holster telematics sensor(s) 102, firearm telematics sensor(s) 202, camera(s) 302, beacon 702, and/or mobile device 704) on a local area network such as a Bluetooth or ZigBee even in the absence of a wireless connection providing communication with geographically remote devices (e.g., the device executing web client 706 or computing device 708 hosting server 710).

[0037] In certain embodiments, beacon(s) 702 may be proximity beacons, such as devices using the Google Eddystone™, iBeacon™, FlyBell™, and/or BLE protocols for monitoring and ranging proximity of components of the system (e.g. holster telematics sensor(s) 102, firearm telematics sensor(s) 202, camera(s) 302, and/or mobile device 704) with respect to one or more beacons 702. In certain embodiments, one or more beacons 702 may be positioned at a fixed location or a moving location such as a vehicle.

[0038] In certain embodiments, mobile device 704 may be a smartphone, a tablet computer, or a radio, such as a police radio, and web client 706 may be executed at a command and control center (e.g., for police, military, or security professionals). All components of the system 700 are directly or indirectly connected using a combination of communication protocols represented by network 701. Network 701 may include a LAN, wired or wireless network, private or public network, or the internet, including wireless communication protocols such as General Packet Radio Service (GPRS), Enhanced Data rates for GSM Evolution (EDGE), 3G, 4G, Long Term Evolution (LTE) protocols, and communication standards such as Project 25 (P25), Terrestrial Trunked Radio (TETRA), and satellite and/or field radio protocols.

[0039] In certain embodiments, one or more computing devices 708 hosts a server 710, such as an HTTP server, and an application 714 that implements aspects of the remote monitoring system (e.g., a situational intelligence platform). For example, status-related files and/or user account information may be stored in data store 716. Application 714 may support an Application Programming Interface (API) 712 providing external access to methods for accessing data store 716. In certain embodiments, client applications running on on client devices 102, 202, 302, 702, 704, and 706 may access API 712 via server 710 using protocols such as HTTP or FTP.

[0040] FIG. 8 shows four exemplary user interfaces for use in a system including camera control relating to firearm activity. FIG. 5A shows a user interface 800 displaying a list of firearms 804 and cameras 805 (e.g., representing cameras 302) available in a firearm remote monitoring system. In one embodiment of such a system, each firearm 804 is associated with a battery-powered accessory device, and the status of the battery for each device is shown using icons 806. Icons 806 may also be used to represent the remaining battery life for the respective cameras 302. As shown, the accessory device associated with firearm 804a has greater charge remaining than firearm 804b. User interface 800 further includes an on-duty toggle 808 to control whether the system should monitor the associated firearms in “on duty mode” vs. “off duty mode”. For example, a user may desire a different rule set to apply with respect to camera activation while the user is on duty vs. off duty—for example, a user may desire to have an associated camera not be activated while the user is off duty (e.g., at the shooting range) and an associated firearm is discharged, because the resulting camera footage may not be of interest. User interface 800 may include a link to a settings menu 810 allowing the user to configure rules for on- and off-duty states. User interface 800 may further provide a drop-down menu 802 to access additional options, e.g., user interface 840 shown in FIG. 8C.

[0041] In certain embodiments, the system may distribute an updated rule set in real time to one or more local systems (where a local system is one or more of the following devices that may be associated with a single user: holster telematics sensors 102, firearm sensors 202, cameras 302, and mobile device 702). The updated rule set may change the configuration of behavior in response to the identification of one or more types of events, or may change how an event is identified. In certain embodiments, an updated rule set may include an instruction to change the status of the camera upon receiving the updated rule set. In certain embodiments, distribution of the updated rule set may be triggered by an instruction from a remote command center (e.g., by way of web client 706 and/or server 710). For example, if a team of users is entering a dangerous area, a user at a remote command center may cause the system to distribute an updated rule set to all users of the team instructing each local system to immediately turn on all cameras 302 and ensure that if a weapon discharge is identified at any single local system of the team, a notification is provided to all other members of the team and to the remote command center.

[0042] In some embodiments, selecting a particular firearm 804 in user interface 800 may display user interface 820, shown in FIG. 8B. User interface 820 may be used to register a firearm telematics sensor 202 upon selecting register button 822. Such an interface may be further modified to display additional information about the charging status for the firearm telematics sensor 202 that is associated with firearm 804a. User interface 820 may also display additional information about a firearm and its associated system components—e.g., firearm telematics sensor 202, charging devices, hub devices. A hub device may be a mobile device that is paired with or local to firearm telematics sensor 202 and/or holster telematics sensor 102, e.g., mobile device 704. For example, the information may include the location of each component plotted on a map, the serial number or ID for the components, the user associated with each component, whether/how each component is connected to a network and/or links to other UIs for displaying such information, such as the interfaces shown in FIGS. 9-10).

[0043] FIG. 8C shows an exemplary user interface 840 providing access to a home link 842, an events link 844 (see, e.g., FIG. 10), a range link 846 concerning use at a gun range, and a map link 848 for accessing a display of the locations of system components (see, e.g., FIGS. 9-10).

[0044] In some embodiments, selecting a particular camera 805 in user interface 800 may display user interface 860, shown in FIG. 8D. User interface 860 may be used to register a physical camera 302 upon selecting register button 822. User interface 860 may further display information about the status of a camera (see, e.g., status indicator 862 indicating that the camera represented by 805a is in power save mode and is not currently recording video or audio). Possible status information may include the location of the camera, camera is powered down, camera is in power save mode, active, ready to record, in infrared/night vision mode, currently recording audio and/or video, not currently recording, in playback mode, recording a firearm-related event, and the like. Menu 864 may provide a mechanism for a user to change the status of camera 302, e.g., from mobile device 704 or web client 706.

[0045] FIG. 9 shows an exemplary user interface for use in a system including camera control relating to firearm activity. Such an interface may be used for displaying the locations of system components (e.g., a firearm and associated sensors 102 and 202, and cameras 302). Panel 902 provides a listing of two users 904a and 904b; components associated with those users are displayed on a map in panel 920. Panel 902 further provides a link 906 to add an additional user to the display, and a link 908 to access an event feed (see FIG. 10). Toggle 910 controls a map centering option and toggle 912 controls whether the display in panel 920 updates to display live information or stops refreshing.

[0046] Map panel 920 marks the location of the components associated with the users on the map using location markers 924. The map may be stylized as shown, or may constitute a satellite photograph. A user may adjust the scale of the map using controls 926. Additional information associated with the components at each location 924 is displayed in an overlay window 922. For example, the overlay window 922 provides information about (1) the user associated with the component(s) at the location; (2) the time stamp associated with the information; (3) the coordinates of the location; (4) the accuracy/error estimate for the location; (5) information about the network type, strength, and operator; (6) hub device battery status. In certain embodiments, additional information about camera status could be provided as well.

[0047] FIG. 10 shows an exemplary user interface 1000 for use in a system including including camera control relating to firearm activity. User interface 1000 may be used to view an event feed (panel 1002) alongside the locations associated with each event (displayed in panel 1010, showing a satellite image for the map). Panel 1002 may display individual events 1006 (e.g., status change from “Weapon Holstered” to “Weapon Unholstered”, or the reverse, or simply a list of the status for each component being monitored each time it is reported by a hub device or directly from another component such as a holster telematics sensor 102), along with additional information such as the associated user name, a time stamp, and the event type. Events may be associated with icons 1008 to quickly indicate the category of event. An event feed may be manually refreshed using a control 1004—for example, in certain embodiments, this may cause the system to poll each component to report its current status, or in other embodiments, it may update the list of components being tracked and/or displayed in user interface 1000.

[0048] FIG. 11 is a flow chart depicting an exemplary process 1100 for controlling a camera. The process begins when the system has identified that a firearm-related event has occurred (1102). For example, one or more of holster telematics sensors 102, firearm sensors 202, beacons 702, or mobile device 702 may have detected an event. Events or event types that could be monitored using user interface 1000 in FIG. 10 above, or concern step 1102 in process 1100 may be, for example, user exits a vehicle with a firearm, user enters a vehicle with a firearm, holstering a firearm, unholstering a firearm, holstering or unholstering a policing implement such as a radio, discharging a firearm (e.g., discharging a Taser or firing a bullet), approaching a second user of the system, a firearm is separated from the user, loud noise is detected, and receiving a notification from a second user of the system or dispatch or command.

[0049] Additional examples regarding step 1102 may be, for example, using geofencing techniques and a beacon 702 located at a user's vehicle, when one or more of holster telematics sensors 102, firearm sensors 202, or mobile device 702 is no longer within range of the beacon 702 at the vehicle, or moves beyond a certain distance (e.g., 3, 5, 7, 10, 15 feet) from the beacon 702, the system may identify that the user has exited the vehicle (e.g., with a firearm). In another example, a holster telematics sensor 102 may detect the event of a user unholstering the firearm. In another example, a telematics sensor or mobile device 702 may detect the proximity of another user, causing the system to identify the event of approaching a second user of the system. In another example, dispatch or another member of the unit that the user is a member of, perhaps aware of a dangerous situation or that another user has unholstered her weapon, may cause the event of a notification having been received by the system by transmitting such a notification via a mobile device 702 or web client 706. In certain embodiments, the system may be configured to automatically provide a notification to all members of a group upon detecting an event concerning another member of the group.

[0050] In step 1104, the system may instruct one or more cameras 302 to change status in response to the event. For example, the instruction may be to turn on the camera, wake the camera, activate recording of video at the camera, mark existing video to be retained, and/or mark new video to be retained. In certain embodiments, the camera is constantly or usually recording (e.g., the camera may always be in a recording state when the user is in an on-duty status), and the old video may be periodically overwritten by newly recorded video. In such an embodiment, identification of an event (step 1102) may cause the existing video recording to be marked to be retained (e.g., prevent it from being overwritten by new video). In certain embodiments, a set buffer of recorded video is maintained by the camera 302, and identification of an event will cause the camera to save the existing buffer as well as video recorded after identification of the event. In certain embodiments, the buffer is 5, 10, 30, 60, 120, or 500 seconds. In certain embodiments, the buffer is 5, 10, or 15 minutes. In certain embodiments, the video may be saved by the camera, and in certain embodiments, the video may be streamed or transmitted to mobile device 704 or server 710. In certain embodiments, an instruction to change the status of a camera 302 may be received from mobile device 704 or computing device 708. Such a request may also be initiated by web client 706.

[0051] In step 1106, a component of the local system (e.g., holster telematics sensors 102, firearm sensors 202, cameras 302, or mobile device 702) may notify server 710 with the updated status for the camera(s). By this step, the system enables real time, remote monitoring of events and recording of events by the camera(s). In the absence of an available connection with remote devices (e.g., computing device 708/server 710), other local users, e.g., within a unit in the same geographical area, may share updated status across the unit using personal area networks and/or local area networks. In certain embodiments, the notification may constitute or include an alert message to communicate a dangerous situation to dispatch and/or unit members. An alert may be a prominent notification displayed on, for example, a mobile device 704 or web client 706.

[0052] In step 1108, a component of the local system (e.g., holster telematics sensors 102, firearm sensors 202, cameras 302, or mobile device 702) may record various metadata for association with the event and recorded video concerning the event. In certain embodiments, metadata are constantly recorded, and by step 1108 they are associated with the event and video. In certain embodiments, one or more types of metadata commence being recorded upon identification of the event in step 1102. In certain embodiments, each category of metadata may be saved as a separate track—for example, each category of metadata may be separately associated with the video recording. In one example, for each metadata measurement, the information is associated with a start time and an end time (or a single time point) that corresponds to the time parameter for the video recorded by each camera 302. In certain embodiments, the system may provide a user interface for selecting which categories of metadata should be displayed with the video recording (e.g., using the same mechanism used for displaying subtitles). In certain embodiments, the system may provide a user interface for rendering a video file that is “watermarked” with selected categories of metadata.

[0053] Categories of metadata may include, for example, a time stamp, the category of event, the current date, coordinates for the location of one or more components of the local system, altitude, temperature, firearm orientation, firearm movement, firearm translation, and firearm bearing (e.g., N30° E). Metadata may further include the ammunition type (e.g., 0.380 ACP, 0.45 ACP), and/or the remaining ammunition (e.g., 10 of 15 rounds).

[0054] The consequence of identifying an event (e.g., the rules concerning each event, and the particulars of process 1100 and, e.g., steps 1104 and 1106) may be configured, e.g. through a user interface accessed via link 810 in user interface 800, and such configurations may be retained in data store 716 and/or mobile device 704.

[0055] FIG. 12 is a block diagram showing an exemplary mobile computing device (e.g., mobile device 704). The device 1200 may have a memory 1202 which may include one or more types of computer readable medium, such as RAM, optical storage devices, or flash memory. Memory 1202 may store an operating system, applications, and communication procedures. Device 1200 may include one or more data processors, image processors, or central processing units 1204. Device 1200 may include peripherals interface coupled to RF module 1206, audio processor 1208, touch sensitive display 1216, other input modules/devices 1218, accelerometer 1220 and optical sensor 1222.

[0056] RF module 1206 may include a cellular radio, Bluetooth radio, NFC radio, WLAN radio, GPS receiver, and antennas used by each for communicating data over various networks.

[0057] Audio processor 1208 may be coupled to a speaker 1210 and microphone 1212. Touch sensitive display 1216 receives touch-based input. Other input modules or devices 1218 may include, for example, a stylus, voice recognition via microphone 1212, or an external keyboard.

[0058] Accelerometer 1220 may be capable of detecting changes in orientation of the device, or movements due to the gait of a user. Optical sensor 1222 may sense ambient light conditions, and acquire still images and video.

[0059] FIG. 13 is a block diagram showing an exemplary computing system 1300 that is representative any of the computer systems or electronic devices discussed herein. Note, not all of the various computer systems have all of the features of system 1300. For example, systems may not include a display inasmuch as the display function may be provided by a client computer communicatively coupled to the computer system or a display function may be unnecessary.

[0060] System 1300 includes a bus 1306 or other communication mechanism for communicating information, and a processor 1304 coupled with the bus 1306 for processing information. Computer system 1300 also includes a main memory 1302, such as a random access memory or other dynamic storage device, coupled to the bus 1306 for storing information and instructions to be executed by processor 1304. Main memory 1302 also may be used for storing temporary variables or other intermediate information during execution of instructions to be executed by processor 1304.

[0061] System 1300 includes a read only memory 1308 or other static storage device coupled to the bus 1306 for storing static information and instructions for the processor 1304. A storage device 1310, which may be one or more of a hard disk, flash memory-based storage medium, magnetic tape or other magnetic storage medium, a compact disc (CD)-ROM, a digital versatile disk (DVD)-ROM, or other optical storage medium, or any other storage medium from which processor 1304 can read, is provided and coupled to the bus 1306 for storing information and instructions (e.g., operating systems, applications programs and the like).

[0062] Computer system 1300 may be coupled via the bus 1306 to a display 1312 for displaying information to a computer user. An input device such as keyboard 1314, mouse 1316, or other input devices 1318 may be coupled to the bus 1306 for communicating information and command selections to the processor 1304.

[0063] The processes referred to herein may be implemented by processor 1304 executing appropriate sequences of computer-readable instructions contained in main memory 1304. Such instructions may be read into main memory 1304 from another computer-readable medium, such as storage device 1310, and execution of the sequences of instructions contained in the main memory 1304 causes the processor 1304 to perform the associated actions. In alternative embodiments, hard-wired circuitry or firmware-controlled processing units (e.g., field programmable gate arrays) may be used in place of or in combination with processor 1304 and its associated computer software instructions to implement the invention. The computer-readable instructions may be rendered in any computer language including, without limitation, Objective C, C#, C/C++, Java, assembly language, markup languages (e.g., HTML, XML), and the like. In general, all of the aforementioned terms are meant to encompass any series of logical steps performed in a sequence to accomplish a given purpose, which is the hallmark of any computer-executable application. Unless specifically stated otherwise, it should be appreciated that throughout the description of the present invention, use of terms such as “processing”, “computing”, “calculating”, “determining”, “displaying”, “receiving”, “transmitting” or the like, refer to the action and processes of an appropriately programmed computer system, such as computer system 1300 or similar electronic computing device, that manipulates and transforms data represented as physical (electronic) quantities within its registers and memories into other data similarly represented as physical quantities within its memories or registers or other such information storage, transmission or display devices.

[0064] FIG. 14 illustrates a computer system 1400 from the point of view of its software architecture. Computer system 1400 may be any of the electronic devices or, with appropriate applications comprising a software application layer 1402, may be a computer system for use with the monitoring system described herein. The various hardware components of computer system 1400 are represented as a hardware layer 1408. An operating system 1406 abstracts the hardware layer and acts as a host for various applications 1404, that run on computer system 1400. The operating system may host a web browser application 1404y, which may provide access for the user interfaces, etc.

[0065] The foregoing description includes references to the accompanying drawings, which form a part of the detailed description. The drawings show, by way of illustration, specific embodiments in which the invention can be practiced. These embodiments are also referred to herein as “examples.” Such examples can include elements in addition to those shown or described. However, the present inventors also contemplate examples in which only those elements shown or described are provided. Moreover, the present inventors also contemplate examples using any combination or permutation of those elements shown or described (or one or more aspects thereof), either with respect to a particular example (or one or more aspects thereof), or with respect to other examples (or one or more aspects thereof) shown or described herein.

[0066] In this document, the terms “a” or “an” are used, as is common in patent documents, to include one or more than one, independent of any other instances or usages of “at least one” or “one or more.” In this document, the term “or” is used to refer to a nonexclusive or, such that “A or B” includes “A but not B,” “B but not A,” and “A and B,” unless otherwise indicated. In this document, the terms “including” and “in which” are used as the plain-English equivalents of the respective terms “comprising” and “wherein.” Also, in the following claims, the terms “including” and “comprising” are open-ended, that is, a system, device, article, or process that includes elements in addition to those listed after such a term in a claim are still deemed to fall within the scope of that claim. Moreover, in the following claims, the terms “first,” “second,” and “third,” and the like are used merely as labels, and are not intended to impose numerical requirements on their objects.