US 8,583,402 B2Grant

Portable monitoring devices and methods of operating same

Issue Date:2013-11-12

•28 Claims

•51 Drawing Sheets

Abstract

The present inventions, in one aspect, are directed to an activity monitoring system including a portable activity monitoring device comprising a housing having a physical size and shape that is adapted to couple to the user's body, a motion sensor, disposed in the housing, to generate data which is representative of the user's motion, and an altitude sensor, disposed in the housing, to generate data which is representative of the change in the user's altitude. The system further includes a display to output data which is representative of a badge, wherein the badge is representative of an achievement computed using motion and/or altitude sensor data. The monitoring device may also include a physiological sensor to generate data which is representative of a user's physiological condition. Here, the display outputs data which is representative of a badge wherein the badge is representative of a physiological achievement.

Metadata

Assignee

Fitbit, Inc.

Inventors

Shelten Gee Jao Yuen
James Park
Eric Nathan Friedman

Application Information

Application Number:US 13/913,744

Filing Date:2013-06-10

Priority Date:2010-09-30

Art Unit:2857

Classifications

IPC:

G01C5/06G01C5/00G01P13/04G01P13/00

Patent Drawings (51 sheets)

Description

Related Application

[0001] This application is a divisional of U.S. patent application Ser. No. 13/667,242, filed Nov. 2, 2012, entitled “Portable Monitoring Devices and Methods of Operating Same” (now U.S. Pat. No. 8,463,576), which is a divisional of U.S. patent application Ser. No. 13/469,033, filed May 10, 2012, entitled “Portable Monitoring Devices and Methods of Operating Same” (now U.S. Pat. No. 8,311,770), which is a divisional of U.S. patent application Ser. No. 13/249,155, filed Sep. 29, 2011, entitled “Portable Monitoring Devices and Methods of Operating Same” (now U.S. Pat. No. 8,180,592), which is a divisional of U.S. patent application Ser. No. 13/156,304, filed on Jun. 8, 2011, entitled “Portable Monitoring Devices and Methods of Operating Same”, filed on September (still pending). This non-provisional application, and the aforementioned non-provisional applications, claim priority to U.S. Provisional Application. No. 61/388,595, entitled “Portable Monitoring Devices and Methods of Operating Same”, filed Sep. 30, 2010, and U.S. Provisional Application No. 61/390,811, entitled “Portable Monitoring Devices and Methods of Operating Same”, filed Oct. 7, 2010; the contents of these U.S. Provisional Applications are incorporated by reference herein in their entirety.

Introduction

[0002] The present inventions relate to portable monitoring devices, and method of operating and controlling same, wherein the portable monitoring devices include an altitude sensor, motion sensor and processing circuitry to calculate, assess and/or determine calorie burn and/or other activity-related quantities of the user (for example, a human or non-human animal such as a dog, cat or horse). In these aspects, the present inventions employ the altitude sensor data and the motion sensor data to calculate, assess and/or determine the calorie burn and/or other activity-related quantities of the user (for example, number of steps and/or stairs, number of stair flights, elevation gain/loss from ambulatory and/or non-ambulatory locomotion, absolute elevation, elevation and/or activity points, activity intensity, distance traveled and/or pace, number of swim strokes and/or kicks, strokes per lap, lap time, pace and/or distance, number of pedal rotations of a bicycle, arm or wheel rotation of a wheelchair, heart rate, heart rate variability, respiration rate, stress levels, skin temperature, body temperature). In the following disclosure, use of the term “activity” includes sedentary and nonsedentary activities. As such, the present inventions also may be used to monitor activities related to sleeping, lying, sitting, and standing stationary and may provide corresponding metrics (for example, time asleep, the onset, duration, and number of awakenings while attempting to sleep, the time spent in various stages of sleep, sleep latency, sleep efficiency and other sleep quality parameters, the presence of sleep apnea and other diagnostic measures, time spent in a prone non-standing state, and resting heart rate).

[0003] In other aspects, the portable monitoring device of the present inventions may include a physiological sensor, in addition to the altitude sensor, motion sensor and processing circuitry. In these aspects, the present inventions employ the physiological sensor data, altitude sensor data and motion sensor data to calculate, assess and/or determine the calorie burn and/or such other activity-related quantities of the user.

[0004] In certain aspects the processing circuitry is partially or wholly disposed external to the portable monitoring device wherein the external processing circuitry receives partially processed or “raw” sensor data. Here, the external processing circuitry partially or wholly calculates, assesses and/or determines the calorie burn and/or other activity-related quantities of the user.

[0005] Notably, the present inventions also relate to techniques or methods of calculating, assessing and/or determining the calorie burn and/or other activity-related quantities of the user based on or using sensor data acquired by a portable monitoring device, for example, devices according to any of the of the present inventions.

Brief Description of the Drawings

[0006] In the course of the detailed description to follow, reference will be made to the attached drawings. These drawings show different aspects of the present inventions and, where appropriate, reference numerals illustrating like structures, components, materials and/or elements in different figures are labeled similarly. It is understood that various combinations of the structures, components, and/or elements, other than those specifically shown, are contemplated and are within the scope of the present inventions.

[0007] Moreover, there are many inventions described and illustrated herein. The present inventions are neither limited to any single aspect nor embodiment thereof, nor to any combinations and/or permutations of such aspects and/or embodiments. Moreover, each of the aspects of the present inventions, and/or embodiments thereof, may be employed alone or in combination with one or more of the other aspects of the present inventions and/or embodiments thereof. For the sake of brevity, certain permutations and combinations are not discussed and/or illustrated separately herein.

[0008] FIGS. 1A-1L are block diagram representations of exemplary portable monitoring devices, according to at least certain aspects of certain embodiments of the present inventions, wherein the portable monitoring devices, according to at least certain aspects of certain embodiments of the present inventions, include processing circuitry, one or more altitude sensors, one or more motion sensors and, in certain embodiments, one or more physiological sensors, one or more mode sensors, transmitter circuitry and/or receiver circuitry;

[0009] FIGS. 1M-1X are block diagram representations of exemplary portable monitoring devices, according to at least certain aspects of certain embodiments of the present inventions, wherein the portable monitoring devices, according to at least certain aspects of certain embodiments of the present inventions, include one or more motion sensors, and, in certain embodiments, may also include processing circuitry, transmitter circuitry and/or receiver circuitry, one or more physiological sensors, and one or more mode sensors;

[0010] FIG. 2 is a block diagram representation of processing circuitry to calculate, assess and/or determine the calorie burn of the user based on sensor data; the processing circuitry may include memory (for example, Flash memory, DRAM and/or SRAM) to store, for example, (i) sensor data and (ii) information which is representative of calorie burn—for example, cumulative and/or over time; notably, the processing circuitry may be discrete or integrated logic, and/or one or more state machines, processors (suitably programmed) and/or field programmable gate arrays (or combinations of the aforementioned); indeed, any circuitry (for example, discrete or integrated logic, state machine(s), processor(s) (suitably programmed) and/or field programmable gate array(s) (or combinations of the aforementioned)) now known or later developed may be employed to calculate, determine, assess and/or determine the calorie burn of the user based on sensor data;

[0011] FIGS. 3A and 3B are block diagram representations of exemplary motion sensors which include, for example, one or more accelerometers, gyroscopes, compasses, switches (for example, mechanical), piezoelectric film and/or pedometers to determine, calculate and/or detect one or more steps of the user; notably, the exemplary motion sensor may be incorporated in any of the exemplary portable monitoring devices;

[0012] FIG. 3C is a block diagram representation of one or more altitude sensor(s) that may be incorporated in the exemplary portable monitoring devices according to any of the exemplary embodiments of the present inventions;

[0013] FIGS. 4A-4D, 4F, 4H-4J, and 4M-4R are flowcharts of exemplary processes of calculating, obtaining, assessing and/or determining calorie burn of the user based on certain sensor data, according to certain aspects of the present inventions;

[0014] FIGS. 4E and 4G are flowcharts of exemplary processes for calculating, obtaining, assessing and/or determining other activity-related metrics including, for example, steps taken by the user based on certain sensor data, according to certain aspects of the present inventions;

[0015] FIGS. 4K and 4L are flowcharts exemplary of processes for calculating, obtaining, assessing and/or determining the activity state of the user (for example, walking or running on relative flat or level ground, traversing stairs, on an escalator or in an elevator, traversing a hill or the like), based on certain sensor data including the attitude sensor data and/or physiological sensor data, according to certain aspects of the invention; notably, hereinafter the activity state of the user may be indicated as the “user state”;

[0016] FIGS. 5A and 5B are block diagram representations of the motion sensor in combination with flowcharts of exemplary processes of calculating, obtaining, assessing and/or determining calorie burn of the user based on speed data, according to certain aspects of the present inventions;

[0017] FIG. 6 is an example of determining the activity state of the user by evaluating the altitude sensor data based on or using algorithms or processes generally illustrated in the flowchart of FIG. 4K wherein altitude data is depicted in the top panel and acceleration data is depicted in the bottom panel; in this exemplary data set and activity state determination, the walking segments are marked A, B, C and are determined by the pedometer function with each step marked as a red dot in the bottom panel; drawing indicator 1 identifies a period of altimeter measurement artifact that is disregarded because the user has not performed any steps; drawing indicator 2 identifies a period of walking that includes a 20 ft drop in apparent altitude due to motion artifact—this is disregarded because the user only walked four steps during this interval, so Δh/Δstep=−5 ft/step, which is likely not humanly possible under normal circumstances; drawing indicator 3 identifies a period of walking on stairs: 20 steps for a total height increase of 10 ft (Δh/Δstep=0.5 ft/step) and is used to update the appropriate activity metrics; drawing indicator 4 identifies a period of walking up an escalator: 24 steps over 32 ft (Δh/Δstep=1.3 ft/step) and is used to update the appropriate activity metrics, taking into account that the activity was partially assisted; drawing indicator 5 identifies a period of walking up a hill: 350 steps for a height increase of 33 ft (Δh/Δstep=0.1 ft/step) and is used to update the appropriate activity metrics;

[0018] FIG. 7 is a block diagram representation of one or more physiological sensor(s) to determine, sense, detect, assess and/or obtain information which is representative of physiological information of the user, according to at least certain embodiments of the present inventions; notably, the one or more physiological sensor(s) may be incorporated in and/or coupled to the exemplary portable monitoring devices (for example, physically, electrically and/or optically coupled, including wired and/or wirelessly coupled) according to at least certain embodiments of the present inventions;

[0019] FIGS. 8A-8G are flowcharts of exemplary processes or logic employed by the processing circuitry (for example, a state machine) to determine, estimate and/or calculate changes in altitude), according to certain aspects of the present inventions;

[0020] FIG. 8H is a flowchart of an exemplary process or logic to compute, estimate and/or determine a number of stair steps traversed by the user (for example, the number of upward stair steps), according to certain aspects of the present inventions; notably, in this exemplary embodiment, when ΔH-S and ΔH-t meet a first criteria, the processing circuitry determines, calculates and/or estimates an onset of the first step of the stair sequence;

[0021] FIGS. 9A-9D are flowcharts of exemplary processes of controlling, adjusting and/or determining a sampling frequency of the altitude sensor (F_ALT) based on or using data which is representative of motion of the user (for example, from a motion sensor of the portable monitoring device), according to certain aspects of the present inventions; notably FIG. 9D illustrates an embodiment of the portable monitoring device where sampling of the altitude sensor is determined or triggered based on or using step events detected by a motion sensor (for example, a pedometer), or a maximum time T between samples (whichever occurs first);

[0022] FIGS. 10A-10F are block diagram representations of exemplary user interfaces of the exemplary portable monitoring devices according to at least certain embodiments of the present inventions; in these exemplary illustrative embodiments, the user interface includes output mechanisms (for example, a display and/or speaker) and input mechanism (for example, switches, a microphone, and vibration and gesture recognition sensor(s), wherein the user may input data and/or commands); notably, any manner of and/or mechanism for outputting and/or inputting of data and/or commands (for example, responses to, for example, queries) are intended to fall within the scope of the present inventions;

[0023] FIGS. 11A and 11B are flowcharts of exemplary processes of calculating, obtaining, assessing and/or determining calorie burn and other activity-related metrics for the user based on, among other things, data from one or more mode sensors; notably, with respect to FIG. 11B, “Body-Mounted Ambulation Metrics” includes Output Steps, Pace, Distance, Calorie Burn, Heart Rate, HRV, Activity Intensity, Heart Rate Zones, Altitude Gain, Stair Steps and/or Elevation Points, “Foot-Mounted Ambulation Metrics” includes Output Steps, Pace, Distance, Calorie Burn, Activity Intensity, Heart Rate Zones, Altitude Gain, Stair Steps and/or Elevation Points, “Bicycle Metrics” includes Output Altitude Gain, Speed, Distance, Cadence, Calorie Burn, Activity Intensity and/or Elevation Points, “Wheelchair Metrics” includes Output Altitude Gain, Speed, Distance, Wheel Spins, Cadence, Calorie Burn, Activity Intensity and/or Elevation Points, “Swimming Metrics” includes Output Depth, Speed, Distance, Laps, Lap Time, Strokes, Drift Time, Turnaround Time, Calorie Burn, Stroke Type, Heart Rate, HRV, Activity Intensity and/or Heart Rate Zones, and “Sleeping Metrics” includes Output Sleep Latency, Number, Duration, and Onset of Awakenings, Sleep Apnea Detection, Resting Heart Rate, Calorie Burn, Duration and Onset of Sleep Stages;

[0024] FIG. 12A is a block diagram representation of exemplary portable monitoring devices, according to at least certain aspects of certain embodiments of the present inventions, wherein the portable monitoring devices, according to at least certain aspects of certain embodiments of the present inventions, includes an altitude sensor and a motion sensor, and wherein the processing circuitry is external to the portable monitoring devices calculates or determines energy and/or calorie “burn” and/or other activity metrics due to activity of the user using altitude and motion sensor data; notably, other embodiments of the portable monitoring device of this aspect may also include one or more physiological sensors, one or more mode sensors, transmitter circuitry and/or receiver circuitry; for example, any portable monitoring device of the present inventions may employ or be implemented in any embodiment where the processing circuitry is disposed external to the portable monitoring device;

[0025] FIG. 12B is a block diagram representation of exemplary portable monitoring devices, according to at least certain aspects of certain embodiments of the present inventions, wherein the portable monitoring devices, according to at least certain aspects of certain embodiments of the present inventions, includes an altitude sensor, a motion sensor, and certain processing circuitry—wherein certain other processing circuitry is external to the portable monitoring devices and the processing circuitry, in combination, calculates or determines energy and/or calorie “burn” and/or other activity metrics due to activity of the user using altitude and motion sensor data; notably, other embodiments of the portable monitoring device of this aspect may also include one or more physiological sensors, one or more mode sensors, transmitter circuitry and/or receiver circuitry; for example, any portable monitoring device of the present inventions may employ or be implemented in any embodiment where the processing circuitry is disposed external to the portable monitoring device;

[0026] FIG. 13 is a cross-sectional representational view of an altitude sensing microelectromechanical system (MEMS) to sense, sample, determine and/or obtain altitude data, according to at least certain aspects of certain embodiments of the present inventions; notably, the altitude sensing MEMS of FIG. 13 may be incorporated in any of the exemplary portable monitoring devices of the present inventions;

[0027] FIG. 14 illustrates an exemplary gesture of the portable monitoring device that is mostly contained in the orthogonal plane to the gravitational vector which may be used as a user interface mechanism (e.g., to navigate a menu system);

[0028] FIGS. 15A-15C are block diagram representations of exemplary portable monitoring devices including energy storage device (for example, a battery and/or ultracapacitor(s)) and/or energy harvesting circuitry wherein energy acquired, obtained and/or generated by the energy harvesting circuitry is employed to immediately power the device or stored in energy storage device; according to at least certain embodiments of the present inventions;

[0029] FIGS. 16A and 16B illustrates different views of an exemplary embodiment of the portable monitoring device according to certain aspects of the present inventions; notably, exemplary physical specifications or dimensions (in millimeters) are outlined in connection with the top down and side views of FIG. 16A;

[0030] FIG. 16C illustrates an exemplary embodiment of the portable monitoring device of FIGS. 16A and 16B disposed on a base station; and

[0031] FIG. 17 illustrates, in exploded view form, an exemplary embodiment of the portable monitoring device of FIGS. 16A and 16B, according to certain aspects of the present inventions; notably, the sensors (for example, motion, altitude and/or physiological sensors) may be disposed on the main PCB.

[0032] Again, there are many inventions described and illustrated herein. The present inventions are neither limited to any single aspect nor embodiment thereof, nor to any combinations and/or permutations of such aspects and/or embodiments. Each of the aspects of the present inventions, and/or embodiments thereof, may be employed alone or in combination with one or more of the other aspects of the present inventions and/or embodiments thereof. For the sake of brevity, many of those combinations and permutations are not discussed separately herein.

Detailed Description

[0033] There are many inventions described and illustrated herein. In one aspect, the present inventions are directed to portable monitoring devices, and method of operating and controlling same, which monitor, calculate, determine and/or detect energy and/or calorie “burn” due to physical activity of the user (for example, a human or non-human animal) and/or other activity-related metrics. The portable monitoring devices of the present inventions include an altitude sensor, motion sensor and processing circuitry to calculate, assess and/or determine the calorie burn of the user and/or other activity-related metrics. (See, for example, FIG. 1A). In one embodiment, at least a portion of the portable monitoring device (including the one or more altitude sensors and/or motion sensors) is affixed to the user during operation wherein the housing of the device includes a physical size and shape that facilitates coupling to the user, for example, the body of the user (such as, for example, arm, wrist, angle, waist and/or foot) and allows the user to perform normal or typical user activities (including, for example, exercise of all kinds and type) without hindering the user from performing such activities. The portable monitoring device may include a mechanism (for example, a clip, strap and/or tie) that facilitates coupling or affixing the device to the user during such normal or typical user activities.

[0034] Briefly, during operation, the altitude sensor generates data which is representative of the altitude and/or changes in altitude of the user. The motion sensor generates data which is representative of motion of the user. The processing circuitry, using (i) data which is representative of the altitude and/or changes in altitude and (ii) data which is representative of the motion of the user, determines, calculates, assesses, estimates and/or detects energy and/or calorie “burn” of the user. (See, FIG. 2).

[0035] Notably, the processing circuitry may also calculate, assess, estimate and/or determine other activity-related metrics including, for example, (i) in the context of running/walking on level, substantially level, or relatively level ground, (a) number of steps, which may be categorized according to the number of steps associated with a user state, for example, walking, jogging and/or running, (b) distance traveled and/or (c) pace, (ii) in the context of running/jogging/walking/jumping on stairs, hills or ground having a grade of greater than, for example, about 3%, (a) number of stair and/or hill steps, which may be categorized, correlated or organized/arranged according to the number of stair and/or hill steps pertaining to, for example, the speed, pace and/or user state of the user (for example, walking, jogging and/or running), (b) number of flights of stairs, (c) ascent/descent distance on stairs and/or hills, (d) pace, (e) ascent/descent on elevators and/or escalators, (f) number of calories burned or expended by walking/running on stairs and/or hills and/or (g) quantify/compare the additional calories expended or burnt from stairs/hills relative to, versus or over level ground, (iii) in the context of swimming, number of strokes, time between strokes, leg kicks and similar metrics (variance of stroke time, mean stroke time, etc.), depth underwater, strokes per lap, lap time, pace and/or distance, (iv) in the context of using a bicycle, wheelchair, skateboard, skis, snowboard, ladder, etc., (a) ascent/descent distance traversed, (b) number of additional calories expended, (c) time of a downward “run” or upward “climb”, (d) number of calories expended, (e) number of pedal rotations, (f) arm or wheel rotation, (g) the grade of the surface, (h) pushes, kicks and/or steps. This list of activities (if applicable to the particular embodiment) is merely exemplary and is not intended to be exhaustive or limiting of the inventions to, for example, the precise forms, techniques, flow, and/or configurations disclosed.

[0036] The processing circuitry may be discrete or integrated logic, and/or one or more state machines, processors (suitably programmed) and/or field programmable gate arrays (or combinations thereof); indeed, any circuitry (for example, discrete or integrated logic, state machine(s), special or general purpose processor(s) (suitably programmed) and/or field programmable gate array(s) (or combinations thereof)) now known or later developed may be employed to calculate, determine, assess, estimate and/or determine the calorie burn of the user based on sensor data. In operation, the processing circuitry may perform or execute one or more applications, routines, programs and/or data structures that implement particular methods, techniques, tasks or operations described and illustrated herein. The functionality of the applications, routines or programs may be combined or distributed. Further, the applications, routines or programs may be implemented by the processing circuitry using any programming language whether now known or later developed, including, for example, assembly, FORTRAN, C, C++, and BASIC, whether compiled or uncompiled code; all of which are intended to fall within the scope of the present invention.

[0037] With reference to FIG. 3A, in one embodiment, the motion sensor may include an accelerometer and pedometer to assess the character of the motion/step and determine the number of user steps. In this embodiment, the output of the accelerometer is analyzed by the pedometer to assess the character of the motion/step and determine the number of user steps. With reference to FIG. 3B, in addition to the accelerometer(s), or in lieu thereof, the motion sensor may include one or more gyroscopes, piezofilms, contact switches, and all combinations thereof, with or without the pedometer. Moreover, motion as inferred through GPS, compasses, wireless methods such as proximity sensing to a reference position/device, and other non-inertial sensing approaches (and their combinations with the aforementioned inertial sensors) may also be employed alone or in conjunction with any of the other configurations and/or techniques. Indeed, all types of sensors and sensing techniques, whether now known or later developed, that generate data which is representative of motion of the user are intended to fall within the scope of the present inventions.

[0038] With reference to FIG. 3C, in one embodiment, the altitude sensor may include a pressure sensor (relative/differential or absolute), GPS, barometer, radar, ladar (i.e., laser detection and ranging), and/or infrared proximity sensor. The portable device may also employ wireless signal strength, visual landmark identification, or optical proximity sensing to a known reference position/device to provide data which is representative of elevation. In this regard, the altitude sensor provides data which is representative of the altitude and/or changes in altitude of the user. Indeed, all types of sensors and sensing techniques, whether now known or later developed, that generate data which is representative of the altitude and/or changes in altitude of the user are intended to fall within the scope of the present inventions.

[0039] As mentioned above, the processing circuitry employs (i) data which is representative of the altitude and/or changes in altitude and (ii) data which is representative of the motion of the user, to determine, calculate and/or detect energy and/or calorie “burn” of the user. (See, FIG. 2). In one embodiment, the processing circuitry implements algorithms and/or processes data based on the flowchart of FIG. 4A. For example, with reference to FIGS. 4A and 4B, the processing circuitry receives the motion sensor data and determines or calculates the calorie burn based on, for example, the character of the motion/step and the number of user steps. The processing circuitry, using the altitude sensor data, may adjust the calorie burn based on consideration or analysis of the data from the altitude sensor. In this regard, the processing circuitry may assess or determine the type of motion that produces/causes the altitude or change in altitude and, in response thereto, determine or calculate the user state—that is, activity state of the user which temporally coincides with the motion sensor data—for example, walking or running on relatively flat or level ground, traversing stairs, on an escalator or in an elevator, traversing a hill or the like. In response to the user state, the processing circuitry may generate an adjusted calorie burn. Here, the processing circuitry adjusts the calculated calorie burn with a factor that is based on the activity state of the user as determined by the altitude sensor data. Thus, the processing circuitry correlates the (i) data which is representative of the altitude and/or changes in altitude and (ii) data which is representative of the motion of the user, to determine or calculate energy and/or calorie “burn” of the user.

[0040] With reference to FIGS. 4C and 4D, in one embodiment, the processing circuitry evaluates (i) data which is representative of the altitude and/or changes in altitude and (ii) data which is representative of the motion of the user, to identify, determine or calculate the user state and, in response thereto, implement a user state specific algorithm or methodology to determine or calculate energy and/or calorie “burn” of the user. For example, where the processing circuitry evaluates such data to determine that the user is traversing a hill, the processing circuitry employs a “hill” specific algorithm to determine or calculate the energy and/or calorie “burn” using the (i) data which is representative of the altitude and/or changes in altitude and (ii) data which is representative of the motion of the user. In this way, the determination or calculation of the energy and/or calorie “burn” may be more accurate in that the specific or dedicated algorithm may employ considerations or features that are “unique” and/or specific to the associated activity; and, as such, the specific or dedicated algorithm may be tailored to the considerations or features that are “unique” and/or specific to the associated activity.

[0041] The processing circuitry may calculate, determine and/or estimate calorie consumption, burn and/or expenditure using any technique now known, described herein, and/or later developed. In one exemplary embodiment, the processing circuitry employs a calorie consumption technique that estimates consumption, burn and/or expenditure for walking, running, and lifestyle activities as follows.

[0042] Speed-Based Estimation, Calculation and/or Determination

[0043] In one embodiment, the processing circuitry may estimate calorie expenditure and activity level based on or using, partially or entirely, the ambulatory speed of the user. For example, with reference to FIG. 5A, in one embodiment, the calorie consumption, burn and/or expenditure is calculated, determined and/or estimated as a function of the speed of the user. Representative energy expenditure rates expressed as metabolic equivalents per minute (MET/min) at different speeds are provided in TABLE 1.

[0044]

	TABLE 1

		Metabolic Equivalents
	Speed (mph)	(MET/min)


	Running, 5.0	8.0
	Running, 5.2	9.0
	Running, 6.0	10.0
	Running, 6.7	11.0
	Running, 7.0	11.5
	Running, 7.5	12.5
	Running, 8.0	13.5
	Running, 8.6	14.0
	Running, 9	15.0
	Running, 10.0	16.0
	Running, 10.9	18.0
	Walking, 1.86	1.5
	Walking, 2.24	1.9
	Walking, 2.61	2.4
	Walking, 2.98	3.2
	Walking, 3.36	4.0
	Walking, 3.73	5.0
	Walking, 4.10	6.4

[0045] Exemplary Running and Walking Energy Expenditure (MET/Min) by Speed

[0046] In one embodiment, the speed of the user may be calculated, determined and/or estimated as the user's step count over a time epoch multiplied by one or more step lengths of the user (which may be programmed, predetermined and/or estimated (for example, based on attributes of the user (for example, height, weight, age, leg length, and/or gender))), which may be estimated, obtained (for example, from a look-up table or database) and/or interpolated from the MET table to obtain the user's energy expenditure. In one embodiment, step length may take one of two values that are indicative of a walking and a running step length dependent on the step frequency and/or acceleration characteristics of the user. In a preferred embodiment, step length may be described as a linear function of step frequency:
step length=A+B*step frequency,

- [0047] where A and B are parameters that may be associated with or calibrated to the user; notably, such parameters may be stored in memory in the portable monitoring device.

[0048] In another embodiment, step length may be described as a function of step frequency and characteristics of the user acceleration:
step length=A+B*step frequency+C*variance of acceleration,

- [0049] where A, B, and C are parameters that may be calibrated to the user; notably, such parameters may be stored in memory in the portable monitoring device.

[0050] In yet another embodiment, step length may be obtained, acquired and/or determined via a look-up table or database, or interpolated (e.g., spline interpolation, neural network) between known (step frequency, step length) pairs or (step frequency, acceleration variance, step length) triplets that have been predetermined or specified by the user and/or pre-programmed or calibrated using the device. For example, the user may start an annotated walking or running sequence on the portable monitoring device, then specify the distance traveled either on the device or through another service (e.g., www.fitbit.com), which may be employed to calibrate or reference for the device by one or more of the following:

- [0051] estimating the regression coefficients (A, B) or (A, B, C),
- [0052] calculating a walking and/or running step length, and
- [0053] building a lookup table for (step frequency, step length) or (step frequency, acceleration variance, step length).

[0054] In addition thereto, or in lieu thereof, the user may calibrate the portable monitoring device by attaching the device to the foot of the user and placing the device into an annotated foot-mounted mode in which speed and distance are tracked and need not be entered by the user. In this mode, the portable monitoring device also acquires data which is representative of, for example, the user's step frequency, acceleration variance, step length. Likewise, distance may be derived from other sources such as a GPS-enabled mobile device, a software mapping utility, or other distance tracking device (e.g., Nike+) and employed to determine the step frequency, acceleration variance, and step length of the user. Under certain conditions, in the absence or interruption of GPS signal, the combination of user altitude over time, two or more geophysical positions on a map and the times at which the user was there, a corresponding altitude map, and the distance over time of the user may be used to estimate the complete route traveled by the user.

[0055] Although, in the preceding examples, the step length has been characterized, expressed and/or estimated as a linear function of one or more parameters such as step frequency and variance of acceleration, the step length and other parameter may be characterized, expressed and/or estimated to a higher order or different functional form. Accordingly such parameters may be expressed as polynomial functions, transcendental functions, etc. as well and may include other input variables such as elevation change (as discussed in detail herein). Indeed, the function need not be monotonically increasing or monotonically decreasing, as implied by the preceding illustrative linear functions. Additionally, different equations may be employed for specific activity states or operating modes (e.g., walking, running, jumping, speed walking).

[0056] The speed value may be converted to calorie expenditure by multiplying the corresponding MET value by the user's BMR. BMR may be obtained through any of a number of well-known equations based on height, weight, gender, age, and/or athletic ability or through designated BMR measurement devices. For example, a user may have a running step length of 57 inches and take 180 running steps during 1 min. Using the method described above, the user's speed estimate is 9.8 miles per hour, which may be linearly interpolated to provide a BMR value of 15.8 MET from the MET table above. Assuming the user's BMR to be 1.10 kcal/MET, the calorie burn of the user in the preceding minute is 17.4 kcal. For the avoidance of doubt, this description is intended to be exemplary.

[0057] Speed estimation may be determined using a different time epoch or a plurality of time epochs. Multiple step lengths may be used. The MET table may be calibrated to the specific user and/or may be expressed as a function of speed in some method, such as an analytical function, discontinuous function, or otherwise. For example, in one embodiment, the relationship between speed and calories may be expressed as:
cal_speed=(A+B*speed)*time*BMR,

- [0058] where speed is the speed of the user, time is the length of time under consideration, and (A,B) are parameters that may be calibrated to the user; notably, such parameters may be stored in memory in the portable monitoring device.

[0059] Likewise, it is noted that an intermediate MET calculation step is not required in this and similar methods. Calorie expenditure may be calculated directly based on speed and one or more physiological parameters of the user such as age, gender, height, weight, and/or athletic ability. Speed may also be filtered over time rather than accepted as a “raw” measurement for a given time epoch.

[0060] FIG. 5B illustrates another embodiment in which the portable monitoring device may calculate, estimate and/or determine the speed of the user based on linear and angular acceleration measurements from, for instance, the foot. Linear acceleration may be obtained from one or more accelerometers. Angular acceleration may be obtained by one or more accelerometers, one or more gyroscopes, and/or one or more orientation sensors (e.g., compass).

[0061] Notably, the portable monitoring device may employ such techniques as those set forth in U.S. Pat. Nos. 6,513,381 and/or 5,724,265. Alternatively, the portable monitoring device may employ the techniques set forth in U.S. Pat. Nos. 4,578,769 and 6,018,705 wherein the device is mounted to the foot of the user and the speed of the user may be estimated by the time of contact of the foot on the ground.

[0062] In one embodiment, the speed of the user may be determined, calculated and/or estimated from the signal energy from a motion sensor in the following form:
speed=A*log(energy)+B

- [0063] where (A,B) are parameters that may be estimated or associated with and/or calibrated or tuned to an individual (for example, based on the physical or motion attributes of the user); notably, such parameters may be stored in memory in the portable monitoring device.

[0064] In yet another embodiment, the portable monitoring device (or associated device) may be location aware and the travel that coincides with motion detected by the motion sensor may be used to estimate speed. For example, the portable monitoring device may include or incorporate GPS to determine its location, or communicate with a GPS-enabled device to receive data which is representative of location or change in location (absolute or relative location data). In addition thereto, or in lieu thereof, the portable monitoring device may communicate wirelessly with RF location beacons to determine position and/or change in position. Indeed, the portable monitoring device may also use signal strength to the beacons to determine or estimate position and/or change therein.

[0065] In one embodiment, the portable monitoring device includes a camera (or communicates with a device that includes a camera). In this embodiment, the portable monitoring device may determine location visually by recognizing location landmarks and/or features.

[0066] Notably, the aforementioned location sensors and methods may also be used to infer user altitude. For example, the user's location as determined by GPS may enable altitude estimates when combined with an altitude map. GPS itself may also provide altitude measurements. Wireless communications may also be used to determine altitude. For example, a RF location beacon may be programmed with its altitude or the portable monitoring device may use any of a number of well known methods for three-dimensional point locating such as multilateration and trilateration.

[0067] Notably, the present inventions not intended to limit the method or means by which speed may be calculated, estimated and/or determined. Indeed, all forms of speed estimation, and mechanisms to implement such techniques, whether now known, described herein, a combination and/or fusion of the methods described herein, and/or later developed may be employed or implemented and, as such, are intended to fall within the scope of the present inventions.

[0068] Accelerometry for Calorie Estimation, Calculation and/or Determination

[0069] In addition to speed based techniques, or in lieu thereof, the portable monitoring device may estimate, calculate and/or determine, calorie consumption, burn and/or expenditure using data which is representative of the intensity of user motion—for example, as provided or determined by one or more single axis or multi-axis accelerometers. In one embodiment, the signals from the one or more accelerometers may be filtered using time domain or frequency domain filtering techniques to produce a parameter indicative of the intensity of user motion, often referred to as a “count”. A count may be computed as the sum of the rectified filtered accelerometer output taken over a suitable time epoch, for example, 10 sec, with or without additional processing such as thresholding and/or saturation. The portable monitoring device may calculate, determine and/or estimate calorie consumption, burn and/or expenditure as a function of the current count value or a sequence of count values. For example, the portable monitoring device may calculate, determine and/or estimate calorie consumption, burn and/or expenditure using one or more of the following techniques:
MET=(A+B*count)*time,
MET=(A+B*count+C*count²+D*count³+ . . . )*time, and
MET=(A*exp(B*count))*time,

- [0070] which are, respectively, linear, polynomial, and exponential relationships between counts and calorie expenditure expressed in METs.

[0071] Notably, the preceding equations may likewise be expressed directly in terms of kilocalories through the inclusion of one or more physiological parameters such as the user's age, gender, height, weight, and/or athletic ability (wherein such parameters may also be set to default values). A representative example is the following:
cal=((A+B*age+C*gender+D*weight+E*height+F*athleticism)*count)*time.

[0072] Indeed, all accelerometry methods, whether now known or later developed, that generate data which is representative of the calorie burn of the user are intended to fall within the scope of the present inventions.

[0073] Heart Rate for Calorie Estimation, Calculation and/or Determination

[0074] In addition to speed based techniques and/or acceleration based techniques, or in lieu thereof, the portable monitoring device may estimate, calculate and/or determine calorie consumption, burn and/or expenditure using or based on a heart rate of the user. For example, in one embodiment, the portable monitoring device may estimate, calculate and/or determine calorie consumption, burn and/or expenditure as follows:
cal=(A*HR+B)*time,

- [0075] where HR is heart rate, time is the length of time under consideration, and A and B are parameters that may be adjusted or calibrated to the user based on, for example, the user's height, weight, age, gender, and/or athletic ability; notably, such parameters may be stored in memory in the portable monitoring device.

[0076] In one embodiment, the portable monitoring device may estimate, calculate and/or determine calorie consumption, burn and/or expenditure using a plurality of equations. For instance, at low or normal heart rates, it may be desirable to use one form of the above equation with parameters (A1, B1) and at higher heart rates, it may be desirable to use the above equation with parameters (A2, B2).

[0077] “Combined” Calorie Consumption Estimation, Calculation and/or Determination

[0078] As indicated above, the portable monitoring device may estimate, calculate and/or determine calorie consumption, burn and/or expenditure using a combination of the techniques described herein. For example, with reference to FIG. 4P, the portable monitoring device may employ motion data and heart rate data to estimate, calculate and/or determine calorie consumption, burn and/or expenditure. In this exemplary embodiment, under certain criteria such as low or normal heart rate in the absence of user steps, calorie burn is calculated, determined or estimated (for example, solely) using data which is representative of accelerometry while under other criteria such as elevated heart rate in the absence of user steps, calorie burn is calculated, determined or estimated (for example, solely) using data which is representative of the heart rate, otherwise calorie burn is calculated, determined or estimated using data which is representative heart rate, speed, and accelerometry. An example would be the following equation:
cal_total=(p1*cal_—HR+p2*cal_speed+p3*cal_accelerometry)*time,

- [0079] where cal_HR is the calorie estimate derived solely from heart rate, cal_speed is the calorie estimate derived solely from speed, and cal_accelerometry is the calorie estimate derived solely from accelerometry, time is the length of time under consideration, and pi (1, 2, 3) are either fixed parameters or dynamically adjusted parameters indicative of the certainty and/or quality of the preceding calorie estimates.

[0080] As such, the portable monitoring device may estimate, calculate and/or determine calorie consumption, burn and/or expenditure based on:
cal_total=f(heart rate data, motion data, mode data, time data),

- [0081] where f(•) is an arbitrary function that employs, fuses and/or implements information from the heart rate, motion, mode, and/or time, when such data is present and desirable or required.

[0082] In this context, information includes heart rate, heart rate variability, respiration as obtained as a modulated signal in an optical heart rate sensor, acceleration (raw, filtered, rectified, etc.), steps, speed, type of activity (e.g., bicycle, swimming, running, sleeping, sitting), surface slope, stairs, etc.

[0083] Notably, the aforementioned expression is intended to describe the case in which a plurality of equations are maintained and the portable monitoring device employs or selects a suitable, correct or predetermined equation is depending on, for example, the heart rate and/or motion as measured by the motion sensor and/or mode sensor.

[0084] The portable monitoring device may be mounted on or to different locations on the body of the user and/or exercise equipment and provides different capabilities based on its body location. In one embodiment, the portable monitoring device may obtain or determine its body location through a user input, a mode sensor that senses its body location and/or the presence of or coupling to a mounting or attachment mechanism or system (for example, which provides information to the device which indicates a mode).

[0085] In addition thereto, or in lieu thereof, the portable monitoring device may determine its body location automatically based on the signals derived from its other sensors. For example, the motion as observed by the accelerometer and/or gyroscope and/or compass and/or altimeter may be indicative of the device being mounted or affixed to the user's foot, hip, chest, back, or on the user's bicycle hub or wheelchair wheel. Moreover, an optical heart rate sensor may provide information (for example, supplementary information) to determine if the portable monitoring device is in contact with the user's skin and able to observe cardiac signal or otherwise in contact with a housing and/or mounting device. FIG. 4Q illustrates an exemplary flow to calculate, estimate and/or determine calorie burn in such a system/technique. Notably, the portable monitoring device may calculate other parameters (in addition to or in lieu of calorie burn) which are not depicted in FIG. 4Q and that are specific to the activity/mode that the device is currently in (for example, number of steps and/or stairs, number of stair flights, elevation gain/loss from ambulatory and/or non-ambulatory locomotion, absolute elevation, activity intensity, distance traveled and/or pace, number of swim strokes and/or kicks, strokes per lap, lap time, pace and/or distance, number of pedal rotations of a bicycle, arm or wheel rotation of a wheelchair, heart rate, heart rate variability, respiration rate, stress levels, skin temperature, body temperature). Calorie burn may be determined in a multitude of ways not depicted here. For example, the calories burned during swimming may be expressed as:
cal_swim=(A+B*speed)*time,

- [0086] where speed is the swimming speed of the user, time is the length of time under consideration, and (A,B) are parameters that may be associated with and/or calibrated or tuned to the user; notably, such parameters may be stored in memory in the portable monitoring device.

[0087] Where the portable monitoring device determines or is instructed that the user is swimming, speed may be calculated as the length of the pool divided by the time taken to cover that distance; from which an average distance traveled per stroke (as observed by the motion sensor) may be calculated, estimated and/or determined and subsequent calculations or estimates of speed may be determined by the observance of swim strokes in real-time:
cal_swim=A+B*stroke,

- [0088] where stroke is the stroke count of the user and (A,B) are that may be associated with and/or calibrated or tuned to the user; notably, such parameters may be stored in memory in the portable monitoring device. Different or multiple equations may be employed to account for different swimming stroke types.
  Calorie burn may also be calculated roughly as a function of one or more of the following variables: stroke type, lap count, and swimming duration.

[0089] Where the portable monitoring device determines or is instructed that the user is bicycling, calorie burn may be calculated, estimated and/or determined by:
cal_bike=(A+B*cadence)*time,

- [0090] where cadence is the number of foot pedal rotations of the user over a time epoch, time is the length of time under consideration, and (A,B) are that may be associated with and/or calibrated or tuned to the user; notably, such parameters may be stored in memory in the portable monitoring device.

[0091] Augmentation Using Altitude Data

[0092] In other embodiments, the portable monitoring device augments and/or adjusts the estimation, calculation and/or determination of calorie consumption, burn and/or expenditure, using or based on altitude related information (for example, from an altimeter disposed on the portable monitoring device). In these embodiments, the portable monitoring device may employ the speed-based calorie consumption, burn and/or expenditure techniques described herein in conjunction with altimeter or altitude (or change in altitude) related information. For example, in the MET-table based approach disclosed herein, the resulting calorie output may be expressed, characterized, determined, calculated and/or estimated as:
cal=(MET(speed)*k1(ΔH-S))*time*BMR,
or
cal=(MET(speed)+k2(speed,ΔH-S))*time*BMR,
or
cal=(MET(speed)*k1(ΔH-S)+k2(speed,ΔH-S))*time*BMR,

- [0093] where MET(speed) is the nominal calorie output over flat land as a function of speed, k1(ΔH-S) and k2(speed, ΔH-S) are a scaling and offset term that are functions of ΔH-S (i.e., the change in elevation per step) and/or speed, and time is the length of time under consideration. k1(ΔH-S) and k2(speed, ΔH-S) are parameters or functions that may be tuned to the user.

[0094] In another embodiment, calorie burn may be expressed or characterized as (and determined, calculated and/or estimated using) a linear function of speed and as a function of ΔH-S:
cal=((A+B*speed)*k1(ΔH-S)+k2(speed,ΔH-S))*time*BMR,

- [0095] where (A,B) are parameters are that may be associated with and/or calibrated or tuned to the user, and time is the length of time under consideration; notably, such parameters may be stored in memory in the portable monitoring device.

[0096] In the preceding equations, the terms dependent on ΔH-S may equivalently be written as functions of the surface slope or grade by substituting the distance traveled per step. Notably, this may be a more natural expression when speed is calculated by means other than step counting as in, for instance, foot-mounted speed and distance tracking or GPS:
cal=(MET(speed)*k1(slope)+k2(speed, slope))*time*BMR,
or
cal=((A+B*speed)*k1(slope)+k2(speed, slope))*time*BMR.

[0097] The preceding two equations are equivalent to adjusting the calorie burn estimate obtained on a level surface, adjusted with an additive and/or multiplicative factor that is dependent on user slope and/or speed.

[0098] Furthermore, step length may be written as a function of step frequency, ΔH-S, or characteristics of the user acceleration (or combinations therein). For instance,
step length=A+B*step frequency+C*variance of acceleration+D*ΔH-S,

- [0099] where (A,B,C,D) are parameters. These parameters may be tailored to an individual based on the calibration methods described above or equivalent techniques.

[0100] In one embodiment, the altitude correction to energy expenditure may be an additive term calculated as:
dcal=k*speed*grade*BMR.

[0101] This equation naturally accounts for reduced energy expenditure when going downhill (i.e., grade<0) and increased energy expenditure when going uphill (i.e., grade>0). However, energy expenditure may also increase when going down steep grades in excess of roughly 0.10. In such cases, the altitude correction term may be adapted with an offset and different multiplication constant k. Indeed, in a variety of scenarios, the correction term may be adapted with offsets and multiplication constants that are appropriate for the given activity state and/or mode (e.g., running, walking, jumping, etc.).

[0102] Certain numerical simplifications may be used to reduce the number of computations performed on the portable monitoring device. For instance, by observing that the speed over a time epoch may be estimated as the number of user steps multiplied by the user's step length and the surface grade may be approximated as the change in user elevation divided by the change in user horizontal distance, the preceding additive adjustment term may be calculated as:
dcal=k′*steps*ΔH-S*BMR.

[0103] Notably, all such mathematical manipulations of the preceding methods that yield identical or substantially equivalent results are considered within the scope of the present inventions.

[0104] Notably, in one embodiment, if ΔH-S exceeds a predetermined threshold, the processing circuitry may determine that the user is traversing stairs, in which case, specific stair estimation algorithms may be employed. With reference to FIG. 4R, the processing circuitry may employ an embodiment in which upstairs walking and running are given specific calorie burn algorithms based on ΔH-S. Downstairs logic may be incorporated therein. Likewise, specific equations and/or logic may be employed for different grade hills, both upwards and downwards in accordance with the preceding linear equations, or alternate nonlinear equations and means (e.g., lookup tables, polynomials, transcendentals, interpolations, neural nets, maximum likelihood estimates, expected value estimates, etc.).

[0105] For example, in the context of running/walking on stairs, hills or ground having a grade of greater than about 2-3%, the algorithm, determination or calculation of the energy and/or calorie “burn” may employ such considerations or factors as number of stair and/or hill steps, surface grade, ascent/descent distance on stairs and/or hill, pace thereof, ascent/descent on elevators. Indeed, in the context of swimming, the algorithm, determination or calculation of the energy and/or calorie “burn” may employ such considerations or factors as number of strokes, time between strokes and similar metrics (variance of stroke time, mean stroke time, etc.), depth underwater, stroke type, strokes per lap, lap time, pace and/or distance. Further, in the context of using a bicycle, wheelchair, skateboard, skis, snowboard, ladder, etc., the algorithm, determination or calculation of the energy and/or calorie “burn” may employ such considerations or factors as ascent/descent distance traversed, number of additional calories expended, time of a downward “run” or upward “climb”, number of calories expended, number of pedal rotations, arm or wheel rotation, the grade of the surface, pushes, kicks and/or steps.

[0106] As intimated above, data which is representative of the altitude and/or changes in altitude and data which is representative of the motion of the user may also be used to determine and/or classify other activity-related metrics such as, for example, user steps, distance and pace (FIG. 4E). For example, user distance may be calculated as the number of user steps multiplied by the user's step length, which in turn is calculated as a function of ΔH-S and/or the change in altitude over time (“ΔH-t”). Notably, other activity-related metrics may be determined by the processing circuitry, including, for example, (i) in the context of running/walking on level or substantially level ground, number of steps, also broken down as walking or running, distance traveled and/or pace (ii) in the context of running/walking on stairs, hills or ground having a grade of greater than about 3%, number of stair and/or hill steps, which may be categorized or broken down, correlated or organized/arranged according to, for example, the speed, pace and/or activity state of the user (for example, as walking, jogging or running), number of flights of stairs, ascent/descent distance on stairs and/or hills, pace, ascent/descent on elevators and/or escalators, surface grade, and/or number of calories expended by walking/jogging/running on stairs and/or hills as well as quantify/compare the additional calories burnt from stairs/hills over level ground.

[0107] In another embodiment, data from one or more physiological sensors may be employed, alone or in combination with data of the motion sensor(s) and altitude sensor(s), to determine or assess the user state. (See, for example, FIGS. 4F and 4O). As discussed in more detail below, physiological sensor(s) determine, sense, detect, assess and/or obtain information which is representative of physiological condition and/or information of the user (for example, blood pressure, pulse rate, blood sugar and the waveform shape corresponding to the heart beat). Such an embodiment may, among other things, enhance the accuracy of identifying the user state and/or improve the confidence of the correctness/accuracy of the identified user state.

[0108] The data from the altitude, motion and physiological sensors may also be used to determine, calculate, estimate, improve and/or classify other activity-related metrics such as, for example, user speed and distance (FIG. 4G). Indeed, the same sensor combinations may also be used to determine, identify and/or classify the user state in order to select the appropriate activity quantification algorithm—see, for example, FIG. 4H wherein calorie burn corresponding to level ground, up/down hill, up/down stairs walking or running. Likewise this set or subset of sensors may be used to estimate and/or calculate the probability of each user state, which may then be used to select the activity quantification algorithm with maximum likelihood (see FIG. 4I or 4M) or merged together to provide the expected value (see FIG. 4J or 4N). A number of methods may be devised to implement each of the embodiments shown in FIGS. 4A-4J and 4M-4R, including but not limited to, iterative and batch algorithms that use ad hoc logic, statistical filtering and classification techniques, neural networks, k-means classifiers, and decision trees. Such conventional techniques or methods may be implemented in the present inventions or adaptively modified as they are used in the invention. As such, these embodiments of the inventions are merely exemplary and are not intended to be exhaustive or limiting of the inventions to, for example, the precise forms, techniques, flow, and/or configurations disclosed.

[0109] In one embodiment, the processing circuitry may evaluate the output of the altitude sensor to determine, calculate and/or estimate the activity state of the user by evaluating the altitude sensor data based on algorithms or processes based on the flowchart of FIG. 4K. With reference to FIG. 4K, in one embodiment, the processing circuitry determines the type of activity by evaluating the change in altitude of the user on a change in height or altitude per step basis (“ΔH-S”) or the use of an elevator by a sustained rate of height change pre time period (for example, per second) (“ΔH-t”) in the absence of steps. The change in height or altitude per step and change in height or altitude per second are evaluated against a plurality of thresholds and/or ranges to determine whether the user is, for example, moving (for example, running or walking) on level ground, on an escalator or in an elevator, traversing stairs and/or traversing a hill or the like. In one embodiment, Threshold 1, Threshold 2, Threshold 3 and Threshold 4 have the relationship Threshold 1>Threshold 2>Threshold 3>Threshold 4 wherein the process seeks to detect and identify the causes of increases in user altitude. In other embodiments, the flow may be modified to detect and classify decreases or both increases and decreases in user altitude. Thus, in these embodiments, the processing circuitry employs data from the motion sensor to assess the user state based on data from the altitude sensor. An exemplary implementation is illustrated in FIG. 6.

[0110] Notably, for the avoidance of doubt, the inventions are not limited to processes and/or algorithms implemented in accordance with the flow charts of FIGS. 4A-4R. Such flow charts are merely exemplary. The present inventions may also implement batch processing algorithms (as opposed to the real-time algorithm), the use of probabilistic classification and estimation methods such as, for example, bayesian networks, Kalman filters, particle filters, unscented Kalman filters (aka sigma point Kalman filters), EM algorithm and Metropolis-Hastings algorithm, Gibbs sampling, Wiener filter, alpha-beta filter, or artificial neural networks. All permutations and combinations of the physiological conditions are intended to fall within the scope of the present inventions.

[0111] In another embodiment, the portable monitoring device of the present inventions includes one or more physiological sensors to further assess the activity state of the user. For example, with reference to FIGS. 1B and 7, the physiological sensor(s) may provide data which is representative of the physiological condition of the user. The processing circuitry may correlate the data from the physiological sensor(s) with the (i) data which is representative of the altitude and/or changes in altitude and (ii) data which is representative of the motion of the user, to determine, estimate and/or calculate energy and/or calorie “burn” of the user. For example, an apparent increase in altitude coupled with the expected number of human steps and a correspondingly increase in heart rate enables the processing circuitry (and techniques implemented thereby) to assess such data and more accurately correlate the activity to a user state—for example, distinguish stair steps from a measurement artifact.

[0112] In one embodiment, the processing circuitry may employ a decision-tree based technique/algorithm to interpret or assess changes in altitude, motion and physiological condition of the user. The decision tree based technique/algorithm may employ the flow chart of FIG. 4L in which, as another embodiment, the processing circuitry determines the type of activity by evaluating the change in altitude of the user on a change in height per step basis (“ΔH-S”) or the use of an elevator by a sustained rate of height change per temporal period (for example, seconds) (“ΔH-t”) in the absence of steps in conjunction with heart rate (“HR”). The change in height per step, change in height per second, and heart rate are evaluated against a plurality of thresholds and/or ranges to determine whether the user is, for example, moving (for example, running or walking) on level ground, on an escalator or in an elevator, traversing stairs and/or traversing a hill or the like. In one embodiment, Threshold 1, Threshold 2, Threshold 3 and Threshold 4 have the relationship Threshold 1>Threshold 2>Threshold 3>Threshold 4. Thus, in this embodiment, the processing circuitry employs data from the motion sensor to assess the user state based on data from the altitude sensor and physiological sensor. Similar techniques/algorithms may employ the flow of FIG. 4L and a similar flowchart based on thresholds in relation to other certain physiological conditions including blood pressure, pulse rate, blood sugar and the waveform shape corresponding to the heart beat.

[0113] In one embodiment, rather than making a firm “decision” based on thresholds, the processing circuitry may employ the sensor data individually or in combination in a statistical or ad hoc framework to provide probabilities for each potential user state. Such techniques may provide a higher degree of confidence in connection with determining the user state.

[0114] The processing circuitry may employ filtering methods and state estimation to mitigate, address and/or alleviate noise (for example, random noise) and outliers present or inherent in the altimeter data. For example, in a preferred embodiment, several parameters of interest may be described in state-space notation:
x(t)=[H(t)dH(t)]^T,

- [0115] where x is the state vector, H is altitude or height, and dH is the first derivative of H with respect to time.
  In this notation, dH(t) is similar or equivalent to the parameter ΔH-t described previously. Note that these parameters are expressed as functions of time.

[0116] In another preferred embodiment, several parameters of interest may be described in an alternate state space:
x(step)=[H(step)dH(step)]^T,

- [0117] where x is the state vector, H is the altitude, and dH is the first derivative of H now expressed as functions of step, where the implicit relationship on time for step is omitted for notational simplicity.
  Notably, dH(step) is similar or equivalent to the parameter ΔH-S described previously. The time-space and step-space representations may be employed together or separately in one or more estimation techniques. Indeed, when used separately, many methods may be used to estimate the derivative that is not covered in the representation. For example, when only the time-space representation is used, the parameter dH(step) may be estimated as:
  dH_EST(step)=(H_EST(t)−H_EST(t−dT))/(step(t)−step(t−dT)),
- [0118] where dT is a time interval, step(t) is the step count at time t, and the EST subscript denotes an estimate.

[0119] Similarly, when the step-space representation is used, the parameter dH(t) may be estimated as:
dH_EST(t)=(H_EST(step(t))−H_EST(step(t)−step(t−dT)))/(t−dT),

[0120] where dT is a time interval.

[0121] Given the state vector x, many models may be employed to regularize the estimates of x in a model-based observer such as a Luenberger observer, Kalman filter, least squares estimator, recursive least squares estimator, intermediate multiple model filter (IMM), extended Kalman filter, particle filter, unscented Kalman filter (aka sigma point filter), etc. In a time-space representation, the altitude of the user may be described by a constant velocity model:

[0122]

x (t + dT) = Fx (t) + w, F = [\begin{matrix} 1 & dT \\ 0 & 1 \end{matrix}],

[0123] where dT is a time interval and w is process noise.

In a step-space representation, the altitude of the user may be described by a constant velocity model:

[0124]

x (step + dStep) = Fx (step) + w, F = [\begin{matrix} 1 & dStep \\ 0 & 1 \end{matrix}],

[0125] where dStep=x(step(t+dT))−x(step(t)) and w is process noise.

[0126] Note that in both models, a constant altitude may be obtained by fixing dH=0. One or more constant altitude models and constant velocity models may be desirable in a multiple model filter. In certain cases, it may be useful to use a multiple model filter such as an IMM or multiple hypothesis filter in order to obtain fast estimate convergence during transitions that are not constant velocity. Process noise in a constant velocity model may be tuned through historical analysis of pressure measurements while the user is not moving.

[0127] The model-based approach permits the prediction of future altitude measurements as:
x_PRED(t+dT)=CFx_EST(t),
x_PRED(step+dStep)=CFx_EST(step),

[0128] C=[1 0],

[0129] for both models.

[0130] Defining z=H+v to be a noise corrupted measurement of altitude, a residual may be calculated as:
resid=z−x_PRED

[0131] which allows the statistical rejection of outliers against known measurement and process noise statistics through, for instance, hypothesis testing. Other outlier rejection and step offset compensation methods may be employed including those apparent to those skilled in the art.

[0132] By setting C=[1 0], we have implicitly assumed that the measurements obtained are altitude measurements. However, the present inventions are not limited to such, nor are they limited to the set of linear models as described thus far. For instance, a raw measurement may be barometric pressure and it may relate to altitude by the function H=C(pressure), where C(•) is a standard, nonlinear barometric equation. In such cases, the system may be linearized to work within the framework of a linear estimator (e.g., extended Kalman filter) or a nonlinear estimator may be used (e.g., particle filter).

[0133] The processing circuitry may employ other estimation and filtering methods. For instance, in one embodiment, H may be estimated with a median, moving average, exponentially weight moving average, low pass filter, etc. dH(step) and dH(t) may likewise be estimated in a variety of ways involving finite differencing with or without smoothing, etc. All such techniques are intended to fall within the scope of the present inventions.

[0134] The processing circuitry may employ state machine logic to determine, estimate and/or calculate a change in altitude. FIGS. 8A-8F illustrates several embodiments of exemplary state machine logic for calculating human-derived altitude. In some embodiments for calculating human-derived altitude (FIGS. 8A-8C), data of the motion sensor is used to determine if the user is currently walking/running as well as if the user recently executed a step. This may be achieved, for instance, with a pedometer. For example, FIG. 8A depicts an embodiment where, although data of the motion sensor is used to determine if the user is currently walking/running, the sampling of the altitude sensor (to acquire data which is representative of the altitude and/or change in altitude of the user) is performed independent of the data from the motion sensor. In contrast, FIG. 8B depicts an alternate embodiment where the sampling rate of the altitude sensor is calculated as a function of the data from the motion sensor. In this case, the sampling frequency F_ALTis a function of the user's step frequency. FIG. 8C depicts an embodiment where sampling of the altitude sensor is triggered from events detected by the motion sensor. In this exemplary embodiment, the event is detection of a step by the user. Although not depicted in FIG. 8C, altitude measurements may be obtained following some delay after the detection of the triggering event. This may be useful in systems where a change in measured altitude occur after some latency, as in cases where a barometric pressure sensor is mounted in a sealed enclosure and samples the external atmospheric pressure through a vent. Altitude sensor measurements may also be triggered by events related to the stop of motion as in, for instance, when the user stops walking for several seconds.

[0135] Notably, in other embodiments, characteristics of the motion sensor are used to determine if the user is currently moving as well as if the user recently executed a motion event. (See, for example, FIGS. 8D-8F). Thus, in these embodiments for calculating human-derived altitude (FIGS. 8A-8C), data of the motion sensor is used to determine if the user is currently walking/running as well as where the user recently (for example, within a previous predetermined amount of time) executed a motion event.

[0136] FIG. 8G provides exemplary state machine logic that may be used to accumulate human-derived elevation gain. In this exemplary embodiment, the state machine logic employs a plurality of thresholds to indicate the start, stop, and continuation of sustained elevation changes. These thresholds are denoted by T_ij, iε {A, B, C, D}, jε{1, 2, 3, 4}; however, these are intended as examples and in other embodiments of the inventions, there may be differing numbers and combinations of thresholds. Elevation gain is accumulated when the current estimate of elevation H_ESTexceeds a reference H_REFby at least the amount given by the threshold, as well as when ΔH-S and ΔH-t are within certain thresholds. Appropriate settings of the thresholds may provide “hysteresis” in the accumulation of elevation gain and likewise restrict impossible or improbable conditions. For instance, setting T_A2=1 ft/step and T_A3=0 ft/step restrict user elevation gains to fall within those prescribed by typical staircases. A typical stair step is 6 inches and a user walking up two stairs a time may cover 1 ft per step.

[0137] As mentioned above, in one embodiment, the processing circuitry computes, estimates and/or determines a number of stair steps traversed by the user (for example, the number of upward stair steps). For example, with reference to FIG. 8H, in one exemplary embodiment, when ΔH-S and ΔH-t first meet a first criteria, the processing circuitry determines, calculates and/or estimates an onset of the first step of the stair sequence. An exemplary value for the threshold T_S2is 5 inches, which is a low riser height for a staircase. Stair steps are accumulated thereafter until ΔH-S and ΔH-t do not meet a second criteria.

[0138] Notably, the processing circuitry may determine, calculate and/or estimate a first step in a stair sequence using any technique now known or later developed. For example, the processing circuitry may employ the following: One or both of the derivatives (ΔH-S and ΔH-t) may be back-propagated to their intersection with a relatively flat region of the measured and/or filtered altitude curve. Indeed, the first step may be identified as the changepoint between two intersecting lines in either the time or step-space representations (or both) and well-known estimation techniques may be employed.

[0139] The method described here may be adapted to calculate the number of downward stair steps, and/or the altitude gain/loss from upward/downward stair steps, and/or the calorie expenditure from the upward/downward traversal of stairs and/or the number of stair flights traversed upward/downward and/or the number of stair flight/step equivalents traversed upward/downward (e.g., by dividing the altitude gain/loss by a nominal stair flight/step height). All combinations and permutations are intended to fall within the scope of the present inventions. In one embodiment, the portable monitoring device may be used to determine, calculate and/or estimate the step rise and/or step tread on a staircase.

[0140] In lieu of or in combination with stair steps, altitude gain, etc., the portable monitoring device may also calculate metrics (for example, motivational metrics) and/or calculate the state of avatars (for example, a digital “pet”, a graphical representation of the user or his/her alter ego, a game character, or physical object that glows and/or changes physical configuration) that are partially or completely determined by user altitude changes. For example, the device may calculate (and, in addition, may display to the user) “elevation points”, where one elevation point is representative of a change in altitude, a stair, and/or a flight of stairs (for example, one elevation point is equal to approximately ten feet, or one flight of stairs). A user may then be motivated to increase an elevation point score or total by, for example, traversing more stairs, flights of stairs and/or hills. Moreover, the device may also maintain the state of a virtual avatar, for example, a flower, whose growth and/or health is related to user altitude changes, or a building, whose size and/or growth is related to user altitude changes, or an entity that morphs between states that are indicative of increased or decreased elevation gains such as a stair case, ladder, hill, or mountain, or specific landmarks like the Eiffel Tower, Mt. Everest, and the Moon. Indeed, all games and/or avatars that are controlled in part or wholly by changes in altitude sensor data are intended as embodiments of the present inventions.

[0141] In other aspects of the present inventions, the altitude changes may be combined, integrated and/or fused with other information such as user speed, step frequency, surface grade, stair steps, calorie burn, energy expenditure, heart rate, etc. to obtain more general “activity points”, where, for example, activity points may be described as:
AP=k1*MET+k2*ΔH+k3*(HR−HR₀),

- [0142] where k1, k2, and k3 are parameters, MET are metabolic equivalent units expended, HR is the user's heart rate and HR₀is a nominal at-rest heart rate.
  This equation is provided merely for illustration. Indeed, all relationships that describe activity points and/or “grades” and/or activity metrics that are not inherently physical quantities (e.g., calorie burn) and/or avatar states as an integrated, combined and/or fused output from one or more of user motion data, user physiological data, user elevation data, and/or user location data are simply embodiments of the present inventions. Likewise, all relationships that describe elevation points, and/or “grades” and/or metrics that are not inherently physical quantities (e.g., elevation gain) and/or avatar states as an output from either altitude data alone or in combination with user motion data, user physiological data, and/or user location data are simply embodiments of the present inventions. In some embodiments, the motivational metrics and/or avatars may be computed and/or displayed on the portable monitoring device. In other embodiments, the motivational metrics and/or avatars may be computed and/or displayed on other media (e.g., www.fitbit.com) using data from the portable monitoring device. In yet other embodiments, the motivational metrics and/or avatars may be computed and/or displayed on both the portable monitoring device and other media.

[0143] Notably, in one embodiment, the processing circuitry may adjust certain thresholds (for example, thresholds employed in conjunction with the techniques described herein) dynamically according to a variety of parameters to mitigate noise and drift from appearing in the output accumulated elevation gain. For example, such parameters may be based on surface conditions, weather, temperature, humidity, user motion, and physiological data from the user. Examples include the surface grade, user speed, user step frequency, user energy expenditure rate, user activity state (e.g., walking versus running versus jumping), ΔH-S, ΔH-t, weather conditions (e.g., incoming storm, wind, rain), the rate of change in barometric pressure while the user is not moving, the rate of change of temperature change, variation in the barometric pressure signal and/or altitude measurement (e.g., random noise), motion sensor data energy, motion sensor data variation, and/or heart rate.

[0144] In an exemplary embodiment, the thresholds required to accumulate an elevation gain follow a decreasing function with respect to surface grade, such that shallower grades require larger altitude gains and steeper grades permit smaller altitude gains. Furthermore in this regard, different functions may be used for walking and running such that shallower grades have lower thresholds for running than they do in comparison to walking. This is motivated by the fact that humans selectively perceive surface grades according to how fast they move on the surface. That is, shallower grades are easier to detect when the user is running rather than walking. Similar effects may be achieved by setting the thresholds as a function of surface grade and user speed or surface grade and user step frequency. Indeed, all possible combinations of the previously mentioned parameters may be used. Note that certain surface grades may be rejected from accumulation by setting their respective thresholds to infinity. In one embodiment, elevation gains and/or losses are only permitted for grades in excess of ±2%. The thresholds may also be adapted according to the drift and/or noise present on the altitude sensor while the user is not moving. In this way, the algorithm may adjust for changing weather conditions as observed by a barometric pressure sensor.

[0145] Surface grade may be expressed as the elevation change over a horizontal distance:
g=ΔH/d.

[0146] When d is not directly measured (as in the case of GPS tracking), it may be calculated as:
d=sqrt(d_s²+ΔH²),

[0147] where d_sis the distance traveled overland by the user.

[0148] For typical walking and running surface grades, it is sufficient to approximate d=d_s. Other numerical approximations exist and are apparent to one skilled in the art. The overland distance may be measured by any of a variety of methods, some of which were described above. They include use of a pedometer function or foot-mounted distance tracking. In other embodiments, the inventions may have functionality that determines the elevation change and/or slope between two points through, for instance, the use of GPS with an altimeter.

[0149] Notably, FIGS. 8A-8H are illustrative and are not intended to limit the implementation of the present inventions. For the avoidance of doubt, the thresholds depicted in the figures may be implemented on the measurements and/or estimates of altitude. The threshold logic may also be implemented over a sequence of points or over a time interval or both. In certain circumstances, it may not be useful or desirable to include all of the threshold parameters described. For instance, it may not always be useful to include thresholds against ΔH-S or ΔH-t. The thresholds may also be supplanted with probabilistic functions evaluated jointly or conditionally over (ΔH, ΔH-S, ΔH-t) or individually over some or all of the same parameters. The portable monitoring device may also employ a variety of timers and event counters to block certain calculation steps when, for instance, significant jumps in elevation are seen, noise increases, or outliers are encountered. Timers and/or counters may also be employed to reset the state of the algorithm (for example, state=0) and/or filter when a downward or upward accumulation event has not occurred within a certain time interval or number of iterations. The reference altitude H_REFmay also be refined over time or reinitialized according to certain criteria through a variety of filtering and estimation techniques. The methods described herein may be adapted to calculate elevation loss, or to calculate elevation gains/losses distinguished by surface grade and/or stair conditions.

[0150] The sampling rate of the sensors of the portable monitoring device may be predetermined or fixed. In one embodiment, the sampling rate is programmable or controllable. For example, in one embodiment, the portable monitoring device may control and/or determine the sampling rate of the sensors based on considerations of electrical power consumption and the rate thereof. In this regard, the portable monitoring device may employ electrical power saving circuitry and/or techniques to control and/or determine the sampling rate of the sensors.

[0151] In one embodiment, the sampling frequency of the altitude sensor (F_ALT) may be controlled, determined and/or calculated based on data from the motion sensor. For example, with reference to FIG. 9A, in one embodiment, if the motion of the user does not exceed a threshold within a time period (for example, a predetermined or programmable time period), the altitude sensor may be placed into a mode that does not sample (for example, a low power mode), or F_ALTmay be reduced or decreased. Subsequently, if the motion exceeds a threshold, for example, for a predetermined or minimum time duration, F_ALTmay be increased.

[0152] Notably, “motion” in this context is meant generally and includes features derived from raw motion sensor data. Examples would be the signal energy, variance, range, etc. The mapping of motion to F_ALTmay be a continuous function or discrete settings. In the case of one or more discrete settings (e.g., sampling modes), the features used to transition between modes are not necessarily the same, nor are the thresholds and other parameters dictating the transitions.

[0153] FIGS. 9B and 9C depict other exemplary embodiments in which the sampling mode or frequency of the altitude sensor is determined by the output of a pedometer.

[0154] Here again, the portable monitoring device senses the motion of the user and, based thereon, controls and/or determines the sampling rate of the altitude sensor. In this way, the portable monitoring device manages or controls the electrical power consumption, and the rate thereof.

[0155] FIG. 9D illustrates another embodiment where altitude sensor readings are triggered from step events detected by a pedometer, or a maximum time T between samples (whichever occurs first). Although not depicted in FIG. 9D, altitude sensor readings may be scheduled to occur after a delay from the step event. The step-space representation and models described above are suited to this type of sampling. Setting T=∞ reduces to the case where altitude readings are only generated through triggering from a pedometer.

[0156] In another embodiment, the altitude sensor may be read or its sampling mode/frequency may be controlled or set according to peaks and/or other morphological features derived from the motion sensor. For example, the sampling rate of the altimeter may be set higher and/or its measurement settings may be adjusted (e.g., to a finer setting) if the motion sensor provides a signal that is indicative of the user losing balance and/or about to fall or falling (e.g., free fall). Similarly, the sampling settings may be adjusted to capture fast transient elevation changes that may be experienced during jumping with one's legs or by other means (e.g., skateboard, skis and snowboard, pole vaulting, and the like—the settings being determined by data from the motion sensor that is indicative of the activity).

[0157] The aforementioned discussions in connection with FIGS. 8A-8H and 9A-9D may be implemented in conjunction with any of technique to calculate calorie burn, including the techniques described and illustrated herein. All permutations and combinations of (i) calculating elevation or altitude change and (ii) altitude sampling techniques, and (iii) techniques to calculate calorie burn are intended to fall within the scope of the present inventions. Moreover, as stated above, the inventions are not limited to processes and/or algorithms implemented in accordance with the flow charts of FIG. 8A-8H and 9A-9D. Such flow charts are merely exemplary. The present inventions may also implement batch processing algorithms (as opposed to the real-time algorithm), the use of probabilistic classification and estimation methods such as, for example, bayesian networks, Kalman filters, EM algorithm and Metropolis-Hastings algorithm, or artificial neural networks.

[0158] The portable monitoring device of the present inventions may also include a user interface to facilitate communication with the user. (See, for example, FIG. 1C) The user interface may include one or more displays, one or more of a speaker, microphone, vibramotor, and/or an input mechanism. (See, for example, FIGS. 10A-10F). Indeed, any manner of or mechanism for outputting and/or inputting of data and/or commands are intended to fall within the scope of the present inventions.

[0159] In one embodiment, the portable monitoring device includes one or more mode sensors to input, detect and/or determine a mode of movement by the user. (See, for example, FIG. 1D). For example, the user may input, detect and/or determine that the user is in a wheelchair, on a ladder, skate board, skis, snowboard and/or a bicycle. In response thereto, the processing circuitry may correlate and/or employ the data from the mode sensor(s) with the (i) data which is representative of the altitude and/or changes in altitude and (ii) data which is representative of the motion of the user, to determine, estimate, and/or calculate energy and/or calorie “burn” of the user. For example, where the user is on a bicycle, the processing circuitry may determine or calculate energy and/or calorie “burn” of the user using the (i) data which is representative of the altitude and/or changes in altitude and (ii) data which is representative of the motion of the user. Notably, the mode sensor may be responsive to a user input or detected mode of movement.

[0160] In one embodiment, FIG. 11A depicts the processing flow for the use of the mode sensor in selecting the appropriate algorithm for determining calorie “burn” of the user. Similarly, FIG. 11B depicts the processing flow for the use of the mode sensor in selecting the appropriate activity-tracking algorithms for the user based on the mode of motion or movement.

[0161] There are many mechanisms and techniques by which the mode sensor(s) may be implemented. One embodiment employs buttons and a feedback mechanism such as a graphical display, flashing lights, haptic device, piezoelectric buzzer, vibramotor, and/or speaker (all, for example, elements of the user interface) to navigate a menu system to select different modes. Another embodiment uses one or more of the motion sensors to recognize user gestures to select and deselect certain modes. In yet another embodiment, the portable monitoring device may include a user interface having an input device (for example, one or more buttons) and/or sensors that mate with specialized housings for each mode. For example, placing the device onto a designated wheelchair mounting device could push a button on the device to select a wheelchair mode. In another embodiment, device may be placed near a designated RF beacon that is affixed to a bicycle spoke, in which case the device would execute bicycle mode functionality. Other implementations may use, for example, RFIDs, magnetic sensors, LEDs and photodetectors, piezoelectric strip/material and/or strain gauges, to detect the presence of the specialized mounting apparatus. In yet another embodiment, the motion sensor(s), altitude sensor(s), and physiological sensor(s) are employed to recognize user activity and automatically select the mode.

[0162] Notably, the mode may be selected and/or determined from a plurality of pre-programmed or predetermined modes (for example, during manufacture). Such pre-programmed or predetermined modes may be stored in memory in the processing circuitry of the device. In addition thereto, or in lieu thereof, the modes may be user defined (after manufacture—for example, in situ or during operation) and programmed into or onto the device by the user at a later time and corresponding activity quantification algorithms may be adaptively “trained” or “taught” by the user.

[0163] In yet another embodiment, the portable monitoring device includes the motion sensor, altitude sensor, physiological sensor and mode sensor. Indeed, all permutations and combinations of sensors, whether in conjunction with a user interface or not, may be employed or implemented in a portable monitoring device according to the present inventions. All such combinations and permutations are intended to fall with in the scope of the present inventions.

[0164] The portable monitoring device may include transmitter circuitry to communicate energy and/or calorie “burn” of the user to, for example, an external user interface, the Internet, social or media site (for example, Fitbit or Facebook) and/or computing system. (See, for example, FIG. 1F). The portable monitoring device may also output raw or pseudo-raw sensor data as well as a correlation thereof (see, for example, FIG. 6). Indeed, the portable monitoring device may output the other activity-related metrics, including, for example, (i) in the context of running/walking on level, substantially level, or relatively level ground, (a) number of steps, which may be categorized according to the number of steps associated with a user state, for example, walking, jogging and/or running, (b) distance traveled and/or (c) pace, (ii) in the context of running/walking on stairs, hills or ground having a grade of greater than, for example, about 3%, (a) number of stair and/or hill steps, which may be categorized, correlated or organized/arranged according to, for example, the speed, pace and/or activity state of the user (for example, the number of stair and/or hill steps pertaining to walking, jogging and/or running), (b) number of flights of stairs, (c) ascent/descent distance on stairs and/or hills, (d) pace, (e) ascent/descent on elevators, (f) number of calories expended by walking/jogging/running on stairs and/or hills and/or (g) quantify/compare the additional calories expended or burnt from stairs/hills relative to, versus or over level ground, (iii) in the context of swimming, number of strokes, time between strokes, leg kicks and similar metrics (variance of stroke time, mean stroke time, etc.), depth underwater, strokes per lap, lap time, pace and/or distance, (iv) in the context of using a bicycle, wheelchair, skateboard, skis, snowboard, ladder, etc., (a) ascent/descent distance traversed, (b) number of additional calories expended, (c) time of a downward “run” or upward “climb”, (d) number of calories expended, (e) number of pedal rotations, (f) arm or wheel rotation, (g) the grade of the surface, (h) pushes, kicks and/or steps. This list of activities (if applicable to the particular embodiment) is merely exemplary and is not intended to be exhaustive or limiting of the inventions to, for example, the precise forms, techniques, flow, and/or configurations disclosed.

[0165] The portable monitoring device of the present inventions may include communication circuitry which implements or employs any form of communications (for example, wireless, optical, or wired) and/or protocol (for example, standard or proprietary) now known or later developed, all forms of communications and protocols are intended to fall within the scope of the present inventions (for example, Bluetooth, ANT, WLAN, Wi-Fi, power-line networking, all types and forms of Internet based communications, and/or SMS); all forms of communications and protocols are intended to fall within the scope of the present inventions.

[0166] The portable monitoring device may include receiver circuitry to more fully communicate with the user and/or external circuitry. (See, for example, FIG. 1G). For example, the portable monitoring device may receive external data or commands regarding exercise time, energy use and/or calorie “burn”, and milestones, for example, from the internet, social or media site (for example, Fitbit or Facebook) and/or computing system; all forms of receiver circuitry and receiving protocols are intended to fall within the scope of the present inventions.

[0167] Again, all permutations and combinations of sensors, user interface, transmitter circuitry and receiver circuitry, may be employed or implemented in a portable monitoring device according to the present inventions. (See, for example, FIGS. 1A-1X). All such combinations and permutations are intended to fall with in the scope of the present inventions.

[0168] As such, the portable monitoring device of the present inventions may interface or communicate via any connectivity and protocol (for example, wired, wireless, electrical and/or optical and/or all types and forms of USB and/or removable memory). All communication mechanisms, techniques and architectures are intended to fall within the scope of the present inventions. Thus, the portable monitoring device may employ wired and/or wireless transmitter circuitry to communicate energy and/or calorie “burn” of the user to, for example, an external user interface, the internet, social or media site (for example, Fitbit or Facebook) and/or computing system. (See, for example, FIG. 1F). As noted above, the portable monitoring device may also output raw or pseudo-raw sensor data as well as a correlation thereof (see, for example, FIG. 6). Indeed, the portable monitoring device may be communicate energy and/or calorie “burn” or expenditure of the user (or such raw or pseudo-raw sensor data), for example, via transmitter circuitry, removable memory, wireless and/or wired (for example, electrical or optical) communication.

[0169] For example, in one embodiment, the portable monitoring device may be placed into a data transfer mode (for example, via engagement with a dock station, user input/instruction and/or proximity to base device) in which the display and/or suitable visual elements are used to transmit data, for example, to a base device (for example, a mobile phone, computer and/or internet portal device (for example, a router)). The base device may include one or more visual monitoring devices. In one embodiment, for example, the portable monitoring device may transmit data by switching on/off LCD segments, switching on/off individual or clusters of display pixels, and/or modulating the intensity and/or color of display pixels in the display of the user interface while base device (for example, mobile phone) monitors the display sequence with a camera and/or video camera. The data may be transmitted in any format now known or later developed including a suitable human readable format (for example, numbers and words), a binary sequence of bits (for example, bar code), or otherwise.

[0170] In another embodiment, the portable monitoring device includes or provides for bidirectional communication of the second portable monitoring device and/or a base device. In this embodiment, the second device controls a light source (e.g., camera phone flash, different colors on screen, pixels on/off) and the portable monitoring device analyzes and/or monitors the visual sequence with one or more visual sensors. This method of data transfer and communication may remove the need for additional wireless and/or wired hardware for transmitting data from the invention to another device, which itself may transfer the data to another service (e.g., www.fitbit.com).

[0171] As discussed herein, the display of the user interface may be the primary mechanism of displaying information to the user. That display may be placed into a mode to facilitate or execute an optical transfer communication. In other embodiments, the portable monitoring device may have specific visual sources that are only intended for data transfer, as well as the combination of both the primary user display and a data transfer display.

[0172] Notably, because alignment and placement of the portable monitoring device with a second device are important to the transfer process, either or both of the devices may have on-screen guides or instructions to aid alignment and placement. In one embodiment, the second device may show a template overlaid in its video display to help the user place the invention correctly relative to the second device. The portable monitoring device may have visual landmarks (e.g., borders, buttons, colors, and/or display elements) that enable the second device to visually track certain aspects of the portable monitoring device during data transfer. Visual tracking may also provide the user with alignment cues to improve placement (e.g., arrows). These same strategies may be employed by the portable monitoring device in cases of bidirectional communication.

[0173] The portable monitoring device may be equipped with one or more vibramotors, buzzers, and/or speakers with which to alert the user. For instance, the device may buzz or emit a sound to encourage the user to walk or move after observing a sedentary period of 30 minutes or more. The device may buzz or emit a sound in order to notify the user that the battery level is low. The device may buzz or emit a sound to act as a time-based alarm. Indeed, all manner of audible and/or haptic alerts are considered to be within the scope of the present inventions.

[0174] There are many inventions described and illustrated herein. While certain embodiments, features, attributes and advantages of the inventions have been described and illustrated, it should be understood that many others, as well as different and/or similar embodiments, features, attributes and advantages of the present inventions, are apparent from the description and illustrations. As such, the above embodiments of the inventions are merely exemplary. They are not intended to be exhaustive or to limit the inventions to the precise forms, techniques, materials and/or configurations disclosed. Many modifications and variations are possible in light of this disclosure. It is to be understood that other embodiments may be utilized and operational changes may be made without departing from the scope of the present inventions. As such, the scope of the inventions is not limited solely to the description above because the description of the above embodiments has been presented for the purposes of illustration and description.

[0175] For example, in one embodiment, the portable monitoring device of the present invention includes an altitude sensor and motion sensor (and in certain embodiments other sensors such as one or more physiological sensors and/or one or more mode sensors). In this embodiment, the portable monitoring device, however, may not include processing circuitry to monitor, calculate, determine and/or detect energy and/or calorie “burn” due to physical activity of the user (for example, a human or non-human animal). In this embodiment, some or all of the monitoring, calculating, determining and/or detecting may be implemented “off-device” or external to the portable monitoring device. Here, the portable monitoring device may store and/or communicate (i) data which is representative of the altitude and/or changes in altitude of the user and/or (ii) data which is representative of motion of the user to external processing circuitry wherein such external processing circuitry may monitor, calculate, determine and/or detect energy and/or calorie “burn” due to physical activity of the user. (See, FIG. 12A). Such external circuitry may implement the calculation processes and techniques in near real-time or after-the-fact. The data which is representative of the (i) altitude and/or changes in altitude of the user and/or (ii) motion of the user may be communicated to such external processing circuitry, for example, via transmitter circuitry (see FIG. 12A), removable memory, electrical or optical communication (for example, hardwired communications via USB). Importantly, such an architecture/embodiment is intended to fall within the scope of the present inventions.

[0176] Moreover, the portable monitoring device of this embodiment (i.e., external processing circuitry) may include all permutations and combinations of sensors (for example, one or more physiological sensor(s) and/or mode sensor(s). For example, the portable monitoring device of the present inventions may include one or more altitude sensors (see, for example, FIGS. 1A-1L); in other embodiments, the portable monitoring device does not include one or more an altitude sensors (see, for example, FIGS. 1M-1X).

[0177] Notably, in one embodiment, the processing circuitry to monitor, calculate, determine and/or detect energy and/or calorie “burn” due to physical activity of the user may be distributed between resident circuitry and external circuitry. (See, FIG. 12B). In this embodiment, circuitry disposed in the portable monitoring device may implement certain processes and algorithms and the external processing circuitry may implement other processes and algorithms wherein, the circuitry, in combination, monitors, calculates, determines and/or detects energy and/or calorie “burn” due to physical activity of the user.

[0178] In another embodiment, the exemplary portable monitoring devices may employ a MEMS altitude sensor. In this regard, the altitude sensor includes a MEMS pressure sensing structure to generate data which is representative of the altitude of the structure. For example, with reference to FIG. 13, in one embodiment, the MEMS pressure sensing structure includes a multi-diaphragm structure wherein a first diaphragm 1 is more fully exposed to changes in the ambient environment relative to a second diaphragm which is less exposed to changes in the ambient environment due to a plurality of micro-pores 3. The diaphragms 1 and 2 form a portion of a sealed chamber (for example, vacuum-sealed chamber). In one embodiment, the MEMS pressure sensing structure includes a pressure sensing element 5 to sense, sample, determine and/or obtain changes in pressure. Here, first diaphragm 1 is responsive to the environment with low pneumatic impedance so that there is effectively no latency. The second diaphragm is responsive to the environment through micro-pores that “delay” the rate of change of the pressure. This difference may deflect the bidirectional pressure sensing element 5 toward the side with lower pressure.

[0179] The sensor structure depicted in FIG. 13 is just one embodiment of one aspect of the inventions. The chambers on either side of the bi-directional sensing element need not be equal in size and either or both sealing diaphragms 1 and 2 may be omitted in some embodiments. For instance, the element producing the pneumatic impedance that delays pressure changes may effectively seal the chamber from contaminants because the element is a continuous polymer film.

[0180] In operation, the deflection in pressure sensing element 5 provides information which is representative of the change in altitude (due to changes in pressure). That is, the micro-pores “delay” the rate of pressure change caused by the second diaphragm in response to small changes in altitude relative to the first diaphragm (which has a low pneumatic impedance path to ambient). The deflection of in pressure sensing element 5 may be measured via changes in stress or strain in pressure sensing element 5. In addition thereto, or in lieu thereof, the deflection may be measured by changes in capacitance or voltages of sensing plates (not illustrated).

[0181] Pressure equalization in a single-pore system can be expressed analytically for a simplified system. Assuming the inner chamber has volume V and is subject to a pressure difference of Δp which is much less than the absolute pressure p (i.e., Δp<<p) and that the inner chamber is exposed to the external environment through a hole of radius r and that the system has low Knudsen number, the mean velocity of gas flow at the orifice is

[0182]

u = - \frac{r}{3 π η} Δ p,

[0183] where η is the viscosity of the gas (Roscoe 1949, Yu, et al. 1988).

The rate of change of the mass of gas in the chamber is
{dot over (m)}=ρπr²u,

[0184] where ρ is the density of the gas.

Finally, assuming the gas to be ideal and the system to be isovolumetric and isothermal, it can be shown that the rate of change of pressure in the chamber p_cis

[0185]

{\dot{p}}_{c} = (\frac{ρ RT}{3 η M}) (\frac{r^{3}}{V}) Δ p,

[0186] where R is the universal gas constant, T is the temperature, and M is the molar mass of the gas.

[0187] As such, it can then be shown that the time constant for the system τ is

[0188]

τ = (\frac{3 η M}{ρ RT}) (\frac{V}{r^{3}}) .

For illustration, operating at standard temperature and pressure, representative numbers for air are M=0.0289 kg mol⁻¹, η=1.8369×10⁻⁵Ns m⁻², ρ=1.2041 kg m⁻³. Assuming the chamber to be a 1 mm cube (V=10⁻⁹m³), a 1 sec time constant (i.e., τ=1 sec) can be achieved with a hole of size r=0.816 μm. The Knudsen number of the system is 0.04<<1 so the preceding assumption of small Knudsen number is appropriate.

[0189] In the preceding analysis, the effects of a finite length to the orifice (so that it acts as a channel) and other parasitic effects such as surface tension are omitted. These effects increase the pneumatic resistance of the pore and enable it to be sized larger for a given time constant τ. It is assumed that one skilled in the art can derive a similar expression or use simulation to account for these effects. The atmospheric permeability of thin polymeric membranes that can also be applied across macro-sized holes in the relatively deep silicon walls of a MEMS produced pressure chamber, or cover arrays of micro-machined surface channels leading to such a chamber can be employed and are well understood. For instance, the O₂permeability of various common polymers was documented by Robb (1968) to span more than 5 orders of magnitude, making selection of a suitable thickness of gas permeable membrane more a choice of manufacturing convenience then of limited alternative chemistries.

[0190] Similarly, gas porous silicon membranes capping a chamber or channels leading to a chamber can be made by MEMS processes with bulk etching & processing techniques to produce predictable gas permeability characteristics. For instance, Galambos, et al. (1999) demonstrated that silicon nitride (Si₃N₄) could itself be etched to produce a gas permeable filter in a micromachined channel. More generally, Wu (2004) described the properties of porous polycystalline membranes etched on Si₃N₄using MEMS technology to cover cavities. MEMS processing techniques may produce a membrane structure with stochastically predictable micro cracks or pores that facilitate atmospheric gas flow, without the need for precisely machined orifices.

[0191] Importantly, the present inventions are neither limited to any single aspect nor embodiment, nor to any combinations and/or permutations of such aspects and/or embodiments. Moreover, each of the aspects of the present inventions, and/or embodiments thereof, may be employed alone or in combination with one or more of the other aspects and/or embodiments thereof. For example, while many of the inventions have been described in connection with a portable monitoring device including one or more altitude sensors (see, for example, FIGS. 1A-1L), many of the inventions may be implemented in connection with a portable monitoring device which does not include one or more an altitude sensors (see, for example, FIGS. 1M-1X). For the sake of brevity, many of those permutations and combinations will not be discussed and/or illustrated separately herein.

[0192] Notably, although exemplary embodiments and/or processes have been described above, the inventions described and/or illustrated herein may also be implemented in conjunction with other activity metric determination techniques. As such, the inventions are not limited to processes and/or algorithms implemented in accordance with the flow charts of FIGS. 4A-4R; rather, such flowcharts are merely exemplary.

[0193] Further, the portable monitoring device may communicate with external circuitry using the transmitter circuitry (see, for example, FIGS. 1F, 1H-1L, 1R and 1T-1X), receiver circuitry (see, for example, FIGS. 1G, 1J-1L, 1S, and 1V-1X), removable memory, electrical or optical communication or connector (for example, hardwired communications via USB).

[0194] As mentioned above, the portable monitoring device may store and/or transmit the raw data or pseudo-raw (i.e., processed) data from on or more (or all) of the sensor(s). For example, in the context of the motion sensor, the portable monitoring device may store and/or transmit data which is representative of acceleration, angular rate, location and/or compass bearing. In the context of the altitude sensor, in one embodiment, the portable monitoring device may store and/or transmit data which is representative of pressure, altitude, time of flight and/or radar cross section. Further, in the context of the physiological sensor(s) and naturally-derived metrics, the portable monitoring device may store and/or transmit data which is representative of heart waveform (for example, ECG trace), heart rate, blood sugar, blood pressure and/or EEG. In addition, in one embodiment, the portable monitoring device may store and/or transmit data provided by the mode sensor(s) including, for example, bicycling, swimming, skateboard or wheel chair.

[0195] Notably, the data which is stored and/or transmitted may be filtered versions of the aforementioned, for example, filtered using passive elements (for example, RC networks) and/or active elements (for example, active electronics), frequency-domain methods (Butterworth filter, etc), statistical methods (Kalman filter, etc), time-series analysis (ARX models, etc) and/or wavelets.

[0196] The raw or pseudo-raw (for example, filtered versions) of the aforementioned data may be stored and/or transmitted in time epochs that differ from the original (e.g., 1 Hz instead of 100 Hz) or in summary versions (e.g., mean, variance, integral, power, coefficient of variation, etc.) and may include signal quantities that are derived typically for use in a classification algorithm and other downstream calculations. In addition, the raw or pseudo-raw (for example, filtered versions) of the aforementioned data may be stored and/or transmitted in compressed or uncompressed formats. Such data may also be stored and/or transmitted in a matched to a value format that, for example, captures the approximate or exact value of the data (e.g., look-up table, ranges like “small”, “medium” and “large”).

[0197] The data and parameters derived by the portable monitoring device may be transferred, displayed, and/or modified remotely as in, for example, a computer program or website such as www.fitbit.com. Such content may furthermore be modified by the remote application and transferred back to the device for storage and display. For example, the user may adjust information regarding one or more physiological parameters that effect metabolism, which in turn are used to correct calorie burn estimates on the portable monitoring device. Likewise, the user may adjust information regarding height, step length, the intensity of a workout, the type of activity over a particular time duration (e.g., walking, running, weight lifting, driving or riding in an automobile, etc.) and this information may be used to adjust estimates of calorie burn, distance traveled, speed, avatar state, and other activity-related metrics stored and/or displayed on the portable monitoring device.

[0198] Data and derived parameters from one or more of the present inventions and/or one or more other devices may be stored, displayed, and/or modified remotely as in, for example, a computer program or website such as www.fitbit.com. The devices may generate their data independently, operate dependently upon one another (e.g., as accessories to one another), or both. The remote application may combine the data or generate new data which is then displayed in the remote application and/or other remote applications and/or the portable monitoring device of the present inventions and/or other devices. The remote application may also overlay the data to the user to present a holistic view of the data streams obtained from multiple devices. For example, two devices (called “Device A” and “Device B” for simplicity here which are respectively a pedometer and heart rate monitor) may generate data streams representative of user activity and/or physiological information which is transferred to www.fitbit.com. The user may create a data stream of manually or automatically annotated events on Device B, which are subsequently used by www.fitbit.com to override or modify the data from Device A during the same periods of time as the annotated events. The annotated events may likewise be presented in a manner that attracts user attention preferentially to the data of Device B. Notably, the data that is overridden or modified may be transferred back to Devices A and B for storage and/or display to the user.

[0199] In addition, the portable monitoring device may also facilitate social interaction features. In one embodiment, the portable monitoring device may contain user identification “credentials” (for example, stored in memory) that communicate with second or base devices to link a plurality of users (for example, two users) in a social network (for example, via the internet or device-to-device). The second device may or may not be a portable monitoring device according to one or more of the embodiments of the present inventions. As an example, two people may link their devices to become “friends” on www.facebook.com, www.fitbit.com, www.linkedin.com, and/or other social networks. The “friend” status may be may be passed to the internet directly from the device or routed through intermediate devices (e.g., Fitbit Tracker to mobile phone to internet). Linking of devices may be achieved in a variety of well-known ways for pairing two devices. In one embodiment, the two devices may be linked through a bump gesture or physical tapping (e.g., contact) of the two devices that initiates wireless communication between the two. A combination of motion sensing (e.g., accelerometer and/or gyro), and/or magnetic signature sensing, and/or wireless (e.g., NFC, RFID, RF proximity sensing) may be employed.

[0200] In other embodiments, the portable monitoring device may provide user contact information such as email addresses, telephone numbers and/or a user name, which may be transmitted when the devices are linked. The device may be configured to transmit only specific pieces of contact information.

[0201] In other embodiments, the portable monitoring device may monitor, catalog and/or track the number, duration, frequency, and quality of social interactions between two or more people in a social network. As an example, the portable monitoring device may use wireless proximity detection between portable monitoring devices to determine, monitor, catalog and/or track episodes in which the devices were in the same proximity, for example, to determine, monitor, catalog and/or track the amount of time two users spent time with one another. Summary metrics like the duration of interaction, frequency of meetings, physical distance, etc. are exemplary parameters of interest.

[0202] In another embodiment, the portable monitoring device may include one or more audio sensors to monitor, determine and/or track the quality and/or tone of conversation between the user and others (with or without a similarly-equipped device). In yet another embodiment, the same interactions between “friends” in a social network are specifically monitored, cataloged and/or tracked.

[0203] In another embodiment, the portable monitoring device may interact with other devices through wireless communication to allow the user to play a game. For example, a pair of devices may be bumped together to initiate a game-like contest between the two users based on their step counts. Other examples may include animated virtual “fight” sequences between avatars placed on both devices. The users' devices may buzz, glow, etc. to notify the users that there is another contestable device nearby. It may do this for “friends” only or for anyone with an appropriate device. The contest may follow deterministic behavior or probabilistic behavior.

[0204] Again, in the context of the aforementioned embodiments, the devices may consist of the portable monitoring device according to any of the embodiments described herein and a second device, which may be a second portable monitoring device or may be a different device (for example, a mobile phone or tablet).

[0205] Notably, the use of “wireless” also extends to visual and/or magnetic detection and identification of compatible devices. For instance, the invention may have a magnetic field sensor that can recognize the magnetic signature of compatible devices.

[0206] As noted above, the portable monitoring device may contain user identification credentials (for example, stored in memory). Here, the portable monitoring device may enable the user to authenticate to certain services or be automatically recognized. For instance, a user attempting to login to “www.fitbit.com” from a computer may be automatically routed to the appropriate, designated, associated and/or correct user account and bypass authentication steps by placing the portable monitoring device into a specific authentication mode, or by virtue of proximity detection of the device by the computer.

[0207] Likewise, the user may be automatically identified when approaching other devices that are configured to recognize the invention. For instance, the user may be recognized as she approaches a weight scale that communicates with her device.

[0208] In situations where a plurality of portable monitoring devices are “present” in a single location (e.g., a family where each family member owns a device), it may be useful for each portable monitoring device to have a unique identifier so that a user associated with which device may be determined. The indicator may be chosen by the user or it may be preprogrammed onto the device. The indicator may be turned off or disabled by the user. In one embodiment, when the device is placed stationary (e.g., display side up on a table surface) and then subsequently moved or jolted, it displays the indicator. The display may also show other content such as motivational messages, general messages, animations, graphics, etc. In another embodiment, the device may show the same or similar information through an input from the user through the user interface. In yet another embodiment, the device may display the same or similar information when the device is coupled to or removed from a specific fixture (e.g., charger) or put in proximity of fixture (e.g., RF beacon, magnetic source). The unique identifiers comprise a specific color shown on a multicolor LED, color/animation sequence, nickname/keyword, word sequence, vibration sequence, custom avatar, or image.

[0209] In one embodiment, the portable monitoring device has a RFID and/or NFC tag embedded in it. The tag may be either read or write. If the tag is read-only, then it stores some static information about the device, for instance, a unique identification number. If the tag is read and write, then either a NFC writer device can write to it or an onboard MCU is connected to the tag and can write to it. If another device equipped with a NFC reader (e.g., smartphone) is brought in proximity to the device, then an app (e.g., Fitbit mobile app) launches automatically and transfers data with the device (e.g., communication to and from www.fitbit.com). If the application “knows” the portable monitoring device (e.g., it is set up to recognize the device), then it transfers data. If the application sees that the device belongs to someone else, it offers the ability to “friend” that person or establish a similar relationship. It may also show some personal information about the user, who may be a human or nonhuman animal. If the application sees that the device is an unknown device, it offers a setup option. Data transfer functionality may occur directly through the RFID tag itself (e.g., the RFID antenna is connected to an EEPROM that the onboard microprocessor can write to) or the RFID/NFC may act as just an automatic discovery mechanism while data transfer is over another system such as ANT, Bluetooth, Zigbee, Wifi, etc.

[0210] In one embodiment, the portable monitoring device is a multi-protocol local area network (LAN) to wide area network (WAN) gateway where local devices may be Bluetooth, ANT, Zigbee, etc. and the gateway communicates to the internet via or over a communication path (for example, a cell phone network, WLAN, etc.). The portable monitoring device may operate as an “open hotspot” so that no user setup is required for subsequent devices. For instance, a user may have elsewhere established a network account (e.g., www.fitbit.com or another website) to the device (e.g., Fitbit Tracker) through its unique device ID, then the device automatically recognizes compatible devices and sends their data to the correct account and location. The data may go directly to the destination or through an intermediary first. Destinations or intermediaries could be other devices or a network service (e.g., www.fitbit.com). The “original” portable monitoring device to account/location link setup could have been done as part of a user initiated setup process or could have been pre-configured as part of the purchasing or acquisition process at the manufacturer or another intermediary. The following is an additional exemplary embodiment:

- [0211] A user owns a Garmin ANT device that is set up to sync data to Garmin's website. She then acquires the current invention. Once she connects the invention to the internet, the Garmin device can automatically send its data to Garmin's website through the invention without any further setup. The invention could also send the data to Garmin's website via an intermediary website (e.g., www.fitbit.com).
  The user may also turn off and on (disable or enable) the ability for data destinations to receive the data.

[0212] The communication circuitry of the portable monitoring device may provide for one-way or two-way communication to, for example, facilitate or provide input of data and/or commands. Indeed, where the device includes two-way communications, the communication circuitry facilitates or provides data or command transmission to and from peripheral devices and/or the Internet. Thus, in certain embodiments, the communication circuitry facilitates or provides external connectivity to, for example, the Internet and/or remote or local external devices and/or appliances.

[0213] Where the communication circuitry provides one-way or two-way communication to the Internet and/or (remote or local) external devices and/or appliances, the portable monitoring device may upload data and/or commands to and/or download data and/or commands from, for example, selected websites, health professionals, trainers, weight or health oriented monitoring groups/organizations or specialists, and/or the like (hereinafter collectively “third party” or “third parties”). In this way, the portable monitoring device may manually or automatically provide data to such third parties. The portable monitoring device may also receive data and/or instructions/comments, for example, health or training guidance or feedback via the device. For example, where the portable monitoring device provides data (for example, activity levels, steps and/or sleep quality) to one or more third party devices or websites, such third parties (for example, health professionals or trainers) may monitor and/or provide feedback based on such data. In this way, such third party or parties may provide periodic, continuous and/or intermittent monitoring and/or feedback, notwithstanding the user/patient is substantially remote or distant from such third parties, or where significant monitoring of the user/patient is inconvenient or not feasible (for example, due to costs or locations).

[0214] The communication circuitry may also facilitate programming of the portable monitoring device, for example, programming the device to acquire selected data (via enabling and/or disabling selected sensors) and/or calculate, monitor and/or determine selected physiological parameters (via enabling or disabling the processing circuitry accordingly). The programming of the portable monitoring device may be via the user or third party. In this way, for example, a third party may customize or tailor the acquisition of physiological data based on the user, the situation (for example, physical condition of the user), and the acquisition of desired information.

[0215] In certain embodiments, the portable monitoring device may also operate, program and/or control local external devices and/or appliances. For example, the communication circuitry of the device may also function as a relay or hub to provide or facilitate communication for external devices to each other or to the Internet. For example, the device may connect to the Internet via WLAN but also be equipped with an ANT radio. An ANT device may communicate with the device to transmit its data to the Internet through the WLAN of the device (and vice versa). Moreover, where the communication circuitry is equipped with Bluetooth, other Bluetooth-enabled devices (for example, mobile or smart telephones) that come within suitable or effective reach or range, the device may transmit data to or receive data from such Bluetooth-enable device and/or the Internet through the network of the mobile or smart telephones. Indeed, data from another device may also be transmitted to the device and stored (and vice versa) or subsequently transmitted at a later time.

[0216] In another preferred embodiment, the portable monitoring device is a single protocol or multi-protocol wireless bridge that may relay, store, and/or display data from compatible wireless devices. Compatible devices need not be activity monitors. For example, a weight scale may transmit data of the user's weight to the device and it may display an historical graph of the user's weight. Data transfer may be bidirectional. Data may be stored and later transferred through the device's wireless communication circuitry to other services such as the Internet.

[0217] In a preferred embodiment, when the portable monitoring device is placed stationary (e.g., display side up or display side down on a table surface), it attempts wireless communication with nearby compatible wireless devices. Indeed, in several embodiments a wireless communication attempt is initiated by the portable monitoring device through one or more gestures detected by the motion sensor. For instance, the device may be placed display side up on a surface for a fixed time interval then subsequently flipped to the display side down position.

[0218] As mentioned above, the portable monitoring device may include a user interface having a display. In one embodiment, the display is customizable in that the information and content of the display may be customized by the user. The user may configure the types of information “screens” as they show up on the device and in which order. This may be achieved through configuration on the device or an external application (e.g., a settings manager on www.fitbit.com). As indicated above, the portable monitoring device, in addition to monitoring, calculating and/or determining of one or more activity and physiological parameters (based on or using data from resident sensors), may receive web content for display on the user interface of the portable monitoring device. The following are examples of the types and/or content of information that may be provided to the user.

- [0219] Historical and current graphs and/or data of user activity and/or foods consumed and/or sleep data that are measured by the device and/or stored remotely (e.g., fitbit.com);
- [0220] Historical graphs and data of user weight and/or body fat data measured by a weight scale and transferred to the device (either over the Internet or by the scale itself);
- [0221] Historical graphs and data of other user-tracked data measured by the device or stored remotely. Examples include heart rate, blood pressure, arterial stiffness, blood glucose levels, cholesterol, duration of TV watching, duration of video game play, mood, etc.;
- [0222] Physiological data corresponding to average or norms, for example, for comparison purposes wherein, in one embodiment, the user's physiological data is compared to or contrasted with average physiological data (for example, on an age, gender or condition basis (for example, a pregnant women's physiological data is compared with typical physiological data based on stage, size and age));
- [0223] “Mash-up” data pertaining to user's physiologic data and user's water intake—for example, correlations of (i) hydration levels to manually logged water consumption and (ii) hydration levels to automatically measured water consumption via a “smart” water bottle (e.g., Camelbak flow meter hydration gauge system);
- [0224] “Mash-up” data pertaining to user's physiologic data and user's sleep—for example, correlations of (i) heart rate to blood pressure and (ii) body weight and/or fat to sleep time, patterns and/or quality;
- [0225] “Mash-up” data pertaining to user's physiologic data and user's activity—for example, correlations of (i) hydration to activity levels and (ii) heart rate and/or variability to activity levels and/or patterns;
- [0226] “Mash-up” data pertaining to physiologic data and potentially related external events such as correlations of (i) user's body weight and/or fat to ambient environment for example, geography, temperature and/or weather, (ii) user's heart rate and/or blood pressure to financial markets (for example, S&P 500, NASDAQ or Dow Jones); here the data analysis of the user's biometric or physiologic data is correlated to web content and/or external devices that are in communication with the biometric monitoring device;
- [0227] Coaching and/or dieting data based on one or more of the user's current weight, weight goals, food intake, activity, sleep, and other data;
- [0228] User progress toward weight, activity, sleep, and/or other goals;
- [0229] Summary statistics, graphics, badges, and/or metrics (e.g., “grades”) to describe the aforementioned data;
- [0230] The aforementioned data displayed for the user and his/her “friends” with similar devices and/or tracking methods;
- [0231] Social content such as Twitter feeds, instant messaging, and/or Facebook updates;
- [0232] Other online content such as newspaper articles, horoscopes, stock, sports or weather reports, RSS feeds, comics, crossword puzzles, classified advertisements, and websites; and
- [0233] Motivational messages, system messages (e.g., battery status, “sync data” notifier), device communications that may be similar to social content (e.g., the device may communicate greetings to the user like “Hello”, “Good Morning”), and/or other messages similar in content to a fortune cookie; and
- [0234] Email messages and calendar schedules; and
- [0235] Clock and/or stop watch.

[0236] For the avoidance of doubt, it should be understood that these examples are provided for illustration and are not intended to limit the inventions, including the scope of data that may be transmitted, received, or displayed by the device, nor any intermediate processing that may employed during such transfer and display.

[0237] Notably, selected content may be delivered according to different contexts. For example, in the morning, motivational messaging may be displayed along with the user's sleep data from the previous night. In the evening, a daily summary of the day's activities may be displayed. Notably, sleep and activity may be monitored and derived from other devices, manual log entries on a website, etc.—not the present invention. Such information, however, may be communicated to, for example, the user and/or the Internet via the device.

[0238] Furthermore, in several embodiments the device has a motivational avatar whose state is dependent on user activity. Nominally, the avatar may be a “flower” or plant that grows and shrinks as a function of the duration and intensity of a user's physical activity over a period of several hours. In a preferred embodiment, the device may be programmed with a customizable avatar and the behavior of the avatar may change over time as the user interacts with the device. The device may also be programmed with optional games and interventions to help the user meet goals.

[0239] Programming or customizing may be implemented via the user interface, an external device via the communication circuitry (for example, via wired or wireless connection to a computer or personal computing device) and/or through a web interface (e.g., www.fitbit.com) on the user interface of the device. Similarly, the firmware loaded on the device may be updated and configured by the user through the communication circuitry (for example, via wireless connection). Indeed, functions and features of the device (for example, certain sensors or data processing) as described here may also be modified, enabled and/or disabled (for example, on an individual basis or global basis).

[0240] In a preferred embodiment, the portable monitoring device may be mounted to different parts of the user and/or exercise equipment to perform functions that are specific or adapted to its location. For example, when mounted on the torso, the portable monitoring device may monitor the user's steps, distance, pace, calorie burn, activity intensity, altitude gain/loss, stair steps, etc. based on data from the motion sensor and altitude sensor using one set of algorithms. When the portable monitoring device is mounted to the user's foot, the device may monitor the same or similar parameters using possibly a different sensor configuration and another set of algorithms. Additionally, it the portable monitoring device may monitor the impact accelerations present on the foot to determine 1) if the user is running with soft or hard footfalls or 2) if the user is running on a soft or hard surface (e.g., the amount of time spent running on concrete vs. grass). When the portable monitoring device is mounted to the wrist, arm, hand, it may perform sleep tracking functionality, swimming functionality, ambulatory activity functionality, or stress biofeedback functionality using, in part or wholly, a heart rate and/or respiratory rate sensor and/or galvanic skin response (GSR) sensor—the determination of which mode of operation may be determined automatically through mode or motion sensor data, or the user may place the device into the appropriate mode manually.

[0241] Note that in the case of the hand, the portable monitoring device may be held rather than mounted. In a preferred embodiment, a gesture of the device mostly contained in the orthogonal plane to the gravitational vector may be used as a user interface mechanism (e.g., to navigate a menu system). Because the gesture is mostly orthogonal to gravity, it may be reliably distinguished between other motions that produce signals that are mostly parallel to gravity (e.g., walking, running, and jumping). In a preferred embodiment, the gesture is similar to the flick of the wrist (as typically produced when dealing cards or throwing a flying disc) and/or the reverse motion toward the body. Due to the fast motion of this gesture, it may be readily distinguished from other motions that are orthogonal to gravity (e.g., hip rotations). In lieu of or in combination with the preceding gesture, the device may incorporate another gesture wherein the direction of gravity relative to one or more axes of an accelerometer begins in a first orientation, then is moved to a second orientation that is roughly 90° degrees different, then returned to the first orientation. For example, in the case of a device with a 3D accelerometer, a 1 g acceleration may be sensed on one accelerometer axis in the first orientation (and close to 0 g on both other axes), then go to near 0 g in the second orientation (and close to 1 g on one of the other axes), then return to 1 g when the device is returned to the first orientation. Because such rotations do not occur often in natural use of an activity monitoring device, it may be readily used as a gesture for user interactions. Notably, these gestures may be recognized with a variety of sensors other than or in combination with an accelerometer such as a magnetic compass, gyroscope, mechanical switch, etc.

[0242] In regards to swim tracking, the use of inertial and/or magnetic sensors (e.g., compasses) may be used to determine the lap count of the user. Speed and distance may subsequently be calculated based on a configured lap length. When the device is placed on a bicycle hub or wheel, it may perform bicycle activity tracking (e.g., cadence, calorie burn).

[0243] As mentioned before, the portable monitoring device may also transmit its data to a secondary display device so that the user may see its output in real-time. In another embodiment, the device may communicate with another activity monitoring device (e.g., ANT-enabled heart rate monitor) either directly or indirectly through a wireless bridge (e.g., a smart phone that routes data from one device to another, or between both). When the portable monitoring device is placed on a free weight or weight training apparatus, it may perform functions related to weight training (e.g., tracking repetitions, sets, time between repetitions/sets, type of exercise, form.).

[0244] In another aspect of the present inventions, the portable monitoring device may select which sensors and algorithms to use based on its mounting condition. For instance, if the device is mounted to the arm, it uses an optical heart rate monitor to calculate calorie burn. If the portable monitoring device is mounted to the torso, it uses an accelerometer to calculate calorie burn. In this example, the device may determine its location partially or wholly from the quality of the heart rate signal: if no signal is present, the device is not mounted to the arm. In this example, mounting conditions may furthermore be determined through the design of the mounting fixtures. For example, the fixtures may have reflective and anti-reflective materials which enable the device to optically distinguish between a mounting to the torso and/or to the foot. Notably, the optical module in the portable monitoring device may incorporate an array of emitters (e.g., LEDs) and/or an array of detectors (e.g., photodiodes, photodetectors, photoresistors) wherein the emitters/detectors have different locations relative to the body and may be used to find the best signal locations while reducing power consumption (by, for instance, dimming or turning off some emitters/detectors).

[0245] Other embodiments may employ fixtures and devices which have magnets and/or magnetic sensors (e.g., Hall effect sensors), RF beacons and transmitters, buttons, electrical contacts, proximity sensors, etc. The portable monitoring device may also be equipped with a magnetic field sensor which is used to recognize the magnetic signature of fixtures and other devices.

[0246] Note that an optical system for heart rate sensing may also be used to sense respiratory rate. The two signals are modulated into a single photoplethysmography (PPG) signal. When applied to stress biofeedback, the PPG sensor may provide information on heart rate, heart rate variability, and respiratory rate. This may be supplemented or supplanted with information from a GSR sensor in the device. The same information may be used with or without the motion sensor to assist in sleep tracking, specifically as they relate to sleep onset and sleep stages. In other embodiments of the invention, the device may also include ambient light sensing, noise sensing, as well as all possible combinations of the previously mentioned sensors. When mounted to the arm and used in ambulatory activity monitoring, the PPG-derived information may be displayed to the user on a secondary device such as a wrist-mounted watch.

[0247] Notably, when the portable monitoring device is mounted to the torso, a combination of motion sensing and altitude sensing may be used to detect periods in which the user is sitting, standing, and lying down.

[0248] The portable monitoring device may also include one or more environmental sensors to detect, measure and/or sense ambient environmental conditions. For example, the one or more environmental sensors may detect, measure and/or sense ambient pressure, temperature, sound, light, humidity, location and/or atmosphere. In this manner, the portable monitoring device may monitor, in addition to user activity, other metrics related to noise pollution/levels, weather, UV exposure, lighting conditions, and/or air quality.

[0249] In another embodiment, the portable monitoring device may monitor the RF signature of nearby devices in order to determine its location. For instance, a home may have a set of Bluetooth or ANT devices that are beaconing to form a signature for the home. Indeed, the portable monitoring device may monitor the signature in order to determine its location in the home. The portable monitoring device may also determine its location directly from a GPS-enabled device that has a compatible communication protocol with the invention (e.g., a Bluetooth enabled smart phone). The portable monitoring device may also use a barometric pressure sensor to determine the user's altitude. (Obviously, other communication protocols can be used too, like RFID, WiFi, NFC, etc).

[0250] The portable monitoring device may include a rechargeable battery or ultracapacitor to provide electrical power to the circuitry and other elements of the portable monitoring device. In one embodiment, the energy storage element (for example, battery or ultracapacitor) may obtain energy from, for example, a charger.

[0251] In one embodiment, the portable monitoring device includes an active or passive energy harvesting circuitry wherein the energy acquired, obtained and/or generated by the circuitry is employed to immediately power the device or stored in, for example a rechargeable battery or ultracapacitor for later use by the a rechargeable battery or ultracapacitor.

[0252] With references to FIGS. 15A-15C, the energy harvesting circuitry portable monitoring device may convert the movement of the user to energy, using, for example, elements, circuitry and/or techniques which generate energy in response to the movement of the user (for example, moving magnets and/or piezoelectric elements). In this regard, the portable monitoring device passively “harvests” or converts the kinetic energy supplied by the user (for example, via movement) to charge the battery or ultracapacitor, supplement such charge, and/or immediately power the device. For example, the device may incorporate piezoelectric elements that generate current in response to user motion and associated circuitry to rectify and store said current. In lieu of or in combination, the device may incorporate a magnet that may move within an inductive coil such that motion of the device induces a current through the coil. The coil may be shaped as a cylinder, for example, to capture the motion shocks during user movement or ambulation, or it may be shaped as a toroid so that the magnet may move easily under other conditions.

[0253] In another embodiment, the portable monitoring device includes circuitry to “harvest” or acquire the energy from signals in the surrounding atmosphere. In this embodiment, the energy harvesting circuitry converts the energy of or in those signals to charge the battery or ultracapacitor, supplement such charge, and/or immediately power the device.

[0254] As mentioned above, at least a portion of the portable monitoring device (including the one or more altitude sensors and/or motion sensors) may be affixed to the user during operation wherein the portable monitoring device includes a physical size and/or shape that facilitates coupling to the user, for example, the body of the user (such as, for example, arm, wrist, angle, waist and/or foot) and allows the user to perform normal or typical user activities (including, for example, exercise of all kinds and type) without hindering the user from performing such activities. (See, for example, FIGS. 16A-16D and 17). The portable monitoring device may include a mechanism (for example, a clip, strap and/or tie) that facilitates coupling or affixing the device to the user during such normal or typical user activities. A base station may facilitate interface to a second device (for example, computer) and/or recharging of the battery. (See, for example, FIG. 16D).

[0255] It should be noted that the term “circuit” may mean, among other things, a single component or a multiplicity of components (whether in integrated circuit form or otherwise), which are active and/or passive, and which are coupled together to provide or perform a desired function. The term “circuitry” may mean, among other things, a circuit (whether integrated or otherwise), a group of such circuits, one or more processors, one or more state machines, one or more processors implementing software, one or more gate arrays, programmable gate arrays and/or field programmable gate arrays, or a combination of one or more circuits (whether integrated or otherwise), one or more state machines, one or more processors, one or more processors implementing software, one or more gate arrays, programmable gate arrays and/or field programmable gate arrays. The term “data” may mean, among other things, a current or voltage signal(s) whether in an analog or a digital form, which may be a single bit (or the like) or multiple bits (or the like).

[0256] It should be further noted that the various circuits and circuitry disclosed herein may be described using computer aided design tools and expressed (or represented), as data and/or instructions embodied in various computer-readable media, for example, in terms of their behavioral, register transfer, logic component, transistor, layout geometries, and/or other characteristics. Formats of files and other objects in which such circuit expressions may be implemented include, but are not limited to, formats supporting behavioral languages such as C, Verilog, and HLDL, formats supporting register level description languages like RTL, and formats supporting geometry description languages such as GDSII, GDSIII, GDSIV, CIF, MEBES and any other suitable formats and languages. Computer-readable media in which such formatted data and/or instructions may be embodied include, but are not limited to, non-volatile storage media in various forms (e.g., optical, magnetic or semiconductor storage media) and carrier waves that may be used to transfer such formatted data and/or instructions through wireless, optical, or wired signaling media or any combination thereof. Examples of transfers of such formatted data and/or instructions by carrier waves include, but are not limited to, transfers (uploads, downloads, e-mail, etc.) over the Internet and/or other computer networks via one or more data transfer protocols (e.g., HTTP, FTP, SMTP, etc.). The present inventions are also directed to such representation of the circuitry described herein, and/or techniques implemented thereby, and, as such, are intended to fall within the scope of the present inventions.

[0257] Indeed, when received within a computer system via one or more computer-readable media, such data and/or instruction-based expressions of the above described circuits may be processed by a processing entity (e.g., one or more processors) within the computer system in conjunction with execution of one or more other computer programs including, without limitation, net-list generation programs, place and route programs and the like, to generate a representation or image of a physical manifestation of such circuits. Such representation or image may thereafter be used in device fabrication, for example, by enabling generation of one or more masks that are used to form various components of the circuits in a device fabrication process.

[0258] Moreover, the various circuits and circuitry, as well as techniques, disclosed herein may be represented via simulations and simulation instruction-based expressions using computer aided design, simulation and/or testing tools. The simulation of the various sensors, processing circuitry, user interface, transmitter circuitry and/or receiver circuitry of the present inventions (regardless of combination or permutation of sensors, processing circuitry, transmitter circuitry and/or receiver circuitry), including the processes or techniques implemented thereby, may be implemented by a computer system wherein characteristics and operations of such circuitry, and techniques implemented thereby, are simulated, imitated, replicated, analyzed and/or predicted via a computer system. The present inventions are also directed to such simulations and testing of the inventive portable monitoring device (or portions thereof including, for example, the various sensors, processing circuitry, user interface, input/output circuitry (although not illustrated—the input/output circuitry may be discrete circuitry or circuitry which is integrated into the processing circuitry), transmitter circuitry and/or receiver circuitry), and/or techniques implemented thereby, and, as such, are intended to fall within the scope of the present inventions. The computer-readable media and data corresponding to such simulations and/or testing tools are also intended to fall within the scope of the present inventions.

[0259] The term “calculate” and other forms (i.e., calculating, calculated and calculation) in the claims means, among other things, calculate, assesses, determine and/or estimate and other forms thereof. In addition, the term “calorie burn” in the claims means, among other things, calorie burn or calorie expenditure and/or energy burn or energy expenditure—or the like.

[0260] Further, in the claims, the phrase “data which is representative of a change in altitude” means data which is representative of an altitude of the user (absolute altitude) and data which is representative of a change in altitude (relative altitude). Further, in the claims, the phrase “a change in altitude” means a change in altitude or height. Moreover, for the avoidance of doubt, in the claims, the term “flights of stairs” means “flights of stairs”, “floors” and the like.

[0261] Notably, the terms “first,” “second,” and the like, herein do not denote any order, quantity, or importance, but rather are used to distinguish one element from another. Moreover, in the claims, the terms “a” and “an” herein do not denote a limitation of quantity, but rather denote the presence of at least one of the referenced item.

Claims

What is claimed is:

1. An activity monitoring system comprising:

a portable activity monitoring device comprising:

a housing having a physical size and shape that is adapted to couple to the body of the user,

a motion sensor, disposed in the housing, to generate data which is representative of motion of the user, and

an altitude sensor, disposed in the housing, to generate data which is representative of the change in altitude of the user; and

a display to output data which is representative of a badge, wherein the badge is representative of an achievement computed using data from the motion sensor and/or altitude sensor.

2. The activity monitoring system of claim 1 wherein the badge corresponds to one of a swimming, distance, sleep and motion activity metric.

3. The activity monitoring system of claim 1 wherein the badge corresponds to one of a biking, location and walking/running activity metric.

4. The activity monitoring system of claim 1 wherein the display is disposed in and/or affixed to the housing.

5. The activity monitoring system of claim 1 wherein the display to further output data which is representative of the progress towards a user activity goal calculated using data from the motion sensor and/or altitude sensor.

6. The activity monitoring system of claim 5 wherein the user activity goal corresponds to one of a swimming, distance, sleep and motion activity metric.

7. The activity monitoring system of claim 5 wherein the user activity goal corresponds to one of a biking, location and walking/running activity metric.

8. The activity monitoring system of claim 1 further including processing circuitry to compute the data which is representative of the badge.

9. The activity monitoring system of claim 8 wherein the processing circuitry is disposed in the housing of the portable activity monitoring device.

10. The activity monitoring system of claim 1 wherein the portable activity monitoring device further includes:

a user interface, and

processing circuitry, disposed in the housing and coupled to the motion sensor and the user interface, to:

detect one or more user inputs to the user interface using data generated by the motion sensor, and

generate display data in response to detecting the one or more user inputs to the user interface.

11. An activity monitoring system comprising:

a portable activity monitoring device comprising:

a housing having a physical size and shape that is adapted to couple to the body of the user,

a motion sensor, disposed in the housing, to generate data which is representative of motion of the user,

an altitude sensor, disposed in the housing, to generate data which is representative of the change in altitude of the user, and

one or more physiological sensors to generate data which is representative of a physiological condition of the user; and

a display to output data which is representative of a badge wherein the badge is representative of an achievement and is generated using data from the one or more physiological sensors.

12. The activity monitoring system of claim 11 wherein the badge corresponds to heart rate and/or pulse rate of the user.

13. The activity monitoring system of claim 11 wherein the display is disposed in and/or affixed to the housing.

14. The activity monitoring system of claim 11 further including processing circuitry to compute the data which is representative of the badge.

15. The activity monitoring system of claim 14 wherein the processing circuitry is disposed in the housing of the portable activity monitoring device.

16. The activity monitoring system of claim 11 wherein the one or more physiological sensors are disposed in the housing of the portable activity monitoring device.

17. The activity monitoring system of claim 11 wherein the portable activity monitoring device further includes:

a user interface, and

processing circuitry, disposed in the housing and coupled to the motion sensor and the user interface, to:

detect one or more user inputs to the user interface using data generated by the motion sensor, and

generate display data in response to detecting the one or more user inputs to the user interface.

18. An activity monitoring system comprising:

a portable activity monitoring device comprising:

a housing having a physical size and shape that is adapted to couple to the body of the user,

a motion sensor, disposed in the housing, to generate data which is representative of motion of the user,

an altitude sensor, disposed in the housing, to generate data which is representative of the change in altitude of the user, and

one or more physiological sensors to generate data which is representative of a physiological condition of the user; and

a display to output data which is representative of:

a first badge, wherein the first badge is representative of a motion and/or an altitude activity achievement computed using data from the motion sensor and/or altitude sensor, and

a second badge wherein the badge is representative of a physiological achievement and is generated using data from the one or more physiological sensors.

19. The activity monitoring system of claim 18 wherein the first badge corresponds to one of a swimming, distance, sleep and motion activity metric.

20. The activity monitoring system of claim 18 wherein the first badge corresponds to one of a biking, location and walking/running activity metric.

21. The activity monitoring system of claim 18 wherein the display is disposed in and/or affixed to the housing.

22. The activity monitoring system of claim 18 further including processing circuitry to compute the data which is representative of the first badge or second badge.

23. The activity monitoring system of claim 22 wherein the processing circuitry is disposed in the housing of the portable activity monitoring device.

24. The activity monitoring system of claim 18 wherein the second badge corresponds to heart rate and/or pulse rate of the user.

25. The activity monitoring system of claim 18 wherein the one or more physiological sensors are disposed in the housing of the portable activity monitoring device.

26. The activity monitoring system of claim 18 further including processing circuitry to compute the data which is representative of the first and second badge.

27. The activity monitoring system of claim 26 wherein the processing circuitry is disposed in the housing of the portable activity monitoring device.

28. The activity monitoring system of claim 18 wherein the portable activity monitoring device further includes:

a user interface, and

processing circuitry, disposed in the housing and coupled to the motion sensor and the user interface, to:

detect one or more user inputs to the user interface using data generated by the motion sensor, and

generate display data in response to detecting the one or more user inputs to the user interface.

Patent Citations (68)

Patent	Date	Inventor	Cited By
US4312358(A)	1982-01-01	Barney	Applicant
US4367752(A)	1983-01-01	Jimenez et al.	Applicant
US4578769(A)	1986-03-01	Frederick	Applicant
US4977509(A)	1990-12-01	Pitchford et al.	Applicant
US5058427(A)	1991-10-01	Brandt	Applicant
US5224059(A)	1993-06-01	Nita et al.	Applicant
US5295085(A)	1994-03-01	Hoffacker	Applicant
US5323650(A)	1994-06-01	Fullen et al.	Applicant
US5583776(A)	1996-12-01	Levi et al.	Applicant
US5671162(A)	1997-09-01	Werbin	Applicant
US5724265(A)	1998-03-01	Hutchings	Applicant
US5891042(A)	1999-04-01	Sham et al.	Applicant
US5899963(A)	1999-05-01	Hutchings	Applicant
US5947868(A)	1999-09-01	Dugan	Applicant
US5955667(A)	1999-09-01	Fyfe	Applicant
US5976083(A)	1999-11-01	Richardson et al.	Applicant
US6018705(A)	2000-01-01	Gaudet et al.	Applicant
US6145389(A)	2000-11-01	Ebeling et al.	Applicant
US6183425(B1)	2001-02-01	Whalen et al.	Applicant
US6287262(B1)	2001-09-01	Amano et al.	Applicant
US6301964(B1)	2001-10-01	Fyfe et al.	Applicant
US6305221(B1)	2001-10-01	Hutchings	Applicant
US6309360(B1)	2001-10-01	Mault	Applicant
US6478736(B1)	2002-11-01	Mault	Applicant
US6513381(B2)	2003-02-01	Fyfe et al.	Applicant
US6513532(B2)	2003-02-01	Mault et al.	Applicant
US6529827(B1)	2003-03-01	Beason et al.	Applicant
US6571200(B1)	2003-05-01	Mault	Applicant
US6678629(B2)	2004-01-01	Tsuji	Applicant
US6761064(B2)	2004-07-01	Tsuji	Applicant
US6790178(B1)	2004-09-01	Mault et al.	Applicant
US6813582(B2)	2004-11-01	Levi et al.	Applicant
US7062225(B2)	2006-06-01	White	Applicant
US7162368(B2)	2007-01-01	Levi et al.	Applicant
US7171331(B2)	2007-01-01	Vock et al.	Applicant
US7200517(B2)	2007-04-01	Darley et al.	Applicant
US7261690(B2)	2007-08-01	Teller et al.	Applicant
US7373820(B1)	2008-05-01	James	Applicant
US7457724(B2)	2008-11-01	Vock et al.	Applicant
US7505865(B2)	2009-03-01	Ohkubo et al.	Applicant
US7690556(B1)	2010-04-01	Kahn et al.	Applicant
US7774156(B2)	2010-08-01	Niva et al.	Applicant
US7789802(B2)	2010-09-01	Lee et al.	Applicant
US7927253(B2)	2011-04-01	Vincent et al.	Applicant
US7983876(B2)	2011-07-01	Vock et al.	Applicant
US8028443(B2)	2011-10-01	Case, Jr.	Examiner
US8311769(B2)	2012-11-01	Yuen et al.	Examiner
US8311770(B2)	2012-11-01	Yuen et al.	Examiner
US8463576(B2)	2013-06-01	Yuen et al.	Examiner
US2005/0054938(A1)	2005-03-01	Wehman et al.	Applicant
US2005/0107723(A1)	2005-05-01	Wehman et al.	Applicant
US2006/0020177(A1)	2006-01-01	Seo et al.	Applicant
US2006/0047208(A1)	2006-03-01	Yoon	Applicant
US2006/0143645(A1)	2006-06-01	Vock et al.	Applicant
US2007/0050715(A1)	2007-03-01	Behar	Applicant
US2007/0051369(A1)	2007-03-01	Choi et al.	Applicant
US2008/0140338(A1)	2008-06-01	No et al.	Applicant
US2009/0018797(A1)	2009-01-01	Kasama et al.	Applicant
US2009/0043531(A1)	2009-02-01	Kahn et al.	Applicant
US2009/0048044(A1)	2009-02-01	Oleson et al.	Applicant
US2011/0003665(A1)	2011-01-01	Burton et al.	Applicant
US2011/0022349(A1)	2011-01-01	Stirling et al.	Applicant
US2011/0106449(A1)	2011-05-01	Chowdhary et al.	Applicant
US2011/0131005(A1)	2011-06-01	Ueshima et al.	Applicant
US2011/0275940(A1)	2011-11-01	Nims et al.	Applicant
US2012/0094649(A1)	2012-04-01	Porrati et al.	Applicant
US2012/0245716(A1)	2012-09-01	Srinivasan et al.	Applicant
JP11347021	1999-12-01		Applicant

Non-Patent Literature (19)

“Automatic classification of ambulatory movements and evaluation of energy consumptions utilizing accelerometers and a barometer”, Ohtaki, et al, Microsystem Technologies, vol. 11, No. 8-10, Aug. 2005, pp. 1034-1040.Applicant
“Classification of Human Moving Patterns Using Air Pressure and Acceleration”, Sagawa, et al, Proceedings of the 24th Annual Conference of the IEEE Industrial Electronics Society, vol. 2, Aug.-Sep. 1998, pp. 1214-1219.Applicant
“Non-restricted measurement of walking distance”, Sagawa, et al, IEEE Int'l Conf. on Systems, Man, and Cybernetics, vol. 3, Oct. 2000, pp. 1847-1852.Applicant
“Activity Classification Using Realistic Data From Wearable Sensors”, Parkka, et al, IEEE Transactions on Information Technology in Biomedicine, vol. 10, No. 1, Jan. 2006, pp. 119-128.Applicant
“Indoor Navigation with MEMS sensors”, Lammel, et al, Proceedings of the Eurosensors XXIII conference, vol. 1, No. 1, Sep. 2009, pp. 532-535.Applicant
“Design of a Wireless Assisted Pedestrian Dead Reckoning System—The NavMote Experience”, Fang, et al, IEEE Transactions on Instrumentation and Measurement, vol. 54, No. 6, Dec. 2005, pp. 2342-2358.Applicant
“On Foot Navigation: When GPS alone is not enough”, Ladetto, et al, Journal of Navigation, vol. 53, No. 2, Sep. 2000, pp. 279-285.Applicant
“A Hybrid Discriminative/Generative Approach for Modeling Human Activities”, Lester, et al, Proc. of the Int'l Joint Conf. Artificial Intelligence, 2005, pp. 766-772.Applicant
“Using MS5534 for altimeters and barometers”, Intersema App., Note AN501, Jan. 2006.Applicant
“Validated caloric expenditure estimation using a single body-worn sensor”, Lester, et al, Proc. of the Int'l Conf. on Ubiquitous Computing, 2009, pp. 225-234.Applicant
“Drift-free dynamic height sensor using MEMS IMU aided by MEMS pressure sensor”, Tanigawa, et al, Workshop on Positioning, Navigation and Communication, Mar. 2008, pp. 191-196.Applicant
“Improvement of walking speed prediction by accelerometry and altimetry, validated by satellite positioning”, Perrin, et al, Medical & Biological Engineering & Computing, vol. 38, 2000, pp. 164-168.Applicant
“An Intelligent Multi-sensor System for Pedestrian Navigation”, Retscher, Journal of Global Positioning Systems, vol. 5, No. 1, 2006, pp. 110-118.Applicant
“Evaluation of a New Method of Heading Estimation for Pedestrian Dead Reckoning Using Shoe Mounted Sensors”, Stirling et al., Journal of Navigation, vol. 58, 2005, pp. 31-45.Applicant
“Direct measurement of human movement by accelerometry”, Godfrey, et al, Medical Engineering & Physics, vol. 30, 2008, pp. 1364-1386.Applicant
“Foot mounted inertial system for pedestrian navigation”, Godha et al., Measurement Science and Technology, vol. 19, No. 7, May 2008, pp. 1-9.Applicant
“Altimeter and Barometer System”, Clifford, et al, Freescale Semiconductor Application Note AN1979, Rev 3, Nov. 2006.Applicant
“SCP1000-D01/D11 Pressure Sensor as Barometer and Altimeter”, VTI Technologies Application, Jun. 2006, Note 33.Applicant
“Suunto LUMI User Guide”, Jun. and Sep. 1997.Applicant

Abstract

Patent Drawings (51 sheets)

Description

Related Application

Introduction

Brief Description of the Drawings

[0030] FIG. 16C illustrates an exemplary embodiment of the portable monitoring device of FIGS. 16A and 16B disposed on a base station; and

Detailed Description

[0042] Speed-Based Estimation, Calculation and/or Determination

[0044]

	TABLE 1

		Metabolic Equivalents
	Speed (mph)	(MET/min)


	Running, 5.0	8.0
	Running, 5.2	9.0
	Running, 6.0	10.0
	Running, 6.7	11.0
	Running, 7.0	11.5
	Running, 7.5	12.5
	Running, 8.0	13.5
	Running, 8.6	14.0
	Running, 9	15.0
	Running, 10.0	16.0
	Running, 10.9	18.0
	Walking, 1.86	1.5
	Walking, 2.24	1.9
	Walking, 2.61	2.4
	Walking, 2.98	3.2
	Walking, 3.36	4.0
	Walking, 3.73	5.0
	Walking, 4.10	6.4

[0045] Exemplary Running and Walking Energy Expenditure (MET/Min) by Speed

- [0047] where A and B are parameters that may be associated with or calibrated to the user; notably, such parameters may be stored in memory in the portable monitoring device.

[0048] In another embodiment, step length may be described as a function of step frequency and characteristics of the user acceleration:
step length=A+B*step frequency+C*variance of acceleration,

- [0049] where A, B, and C are parameters that may be calibrated to the user; notably, such parameters may be stored in memory in the portable monitoring device.

- [0051] estimating the regression coefficients (A, B) or (A, B, C),
- [0052] calculating a walking and/or running step length, and
- [0053] building a lookup table for (step frequency, step length) or (step frequency, acceleration variance, step length).

- [0058] where speed is the speed of the user, time is the length of time under consideration, and (A,B) are parameters that may be calibrated to the user; notably, such parameters may be stored in memory in the portable monitoring device.

[0062] In one embodiment, the speed of the user may be determined, calculated and/or estimated from the signal energy from a motion sensor in the following form:
speed=A*log(energy)+B

- [0063] where (A,B) are parameters that may be estimated or associated with and/or calibrated or tuned to an individual (for example, based on the physical or motion attributes of the user); notably, such parameters may be stored in memory in the portable monitoring device.

[0068] Accelerometry for Calorie Estimation, Calculation and/or Determination

- [0070] which are, respectively, linear, polynomial, and exponential relationships between counts and calorie expenditure expressed in METs.

[0073] Heart Rate for Calorie Estimation, Calculation and/or Determination

- [0075] where HR is heart rate, time is the length of time under consideration, and A and B are parameters that may be adjusted or calibrated to the user based on, for example, the user's height, weight, age, gender, and/or athletic ability; notably, such parameters may be stored in memory in the portable monitoring device.

[0077] “Combined” Calorie Consumption Estimation, Calculation and/or Determination

- [0079] where cal_HR is the calorie estimate derived solely from heart rate, cal_speed is the calorie estimate derived solely from speed, and cal_accelerometry is the calorie estimate derived solely from accelerometry, time is the length of time under consideration, and pi (1, 2, 3) are either fixed parameters or dynamically adjusted parameters indicative of the certainty and/or quality of the preceding calorie estimates.

- [0081] where f(•) is an arbitrary function that employs, fuses and/or implements information from the heart rate, motion, mode, and/or time, when such data is present and desirable or required.

- [0086] where speed is the swimming speed of the user, time is the length of time under consideration, and (A,B) are parameters that may be associated with and/or calibrated or tuned to the user; notably, such parameters may be stored in memory in the portable monitoring device.

- [0088] where stroke is the stroke count of the user and (A,B) are that may be associated with and/or calibrated or tuned to the user; notably, such parameters may be stored in memory in the portable monitoring device. Different or multiple equations may be employed to account for different swimming stroke types.
  Calorie burn may also be calculated roughly as a function of one or more of the following variables: stroke type, lap count, and swimming duration.

[0089] Where the portable monitoring device determines or is instructed that the user is bicycling, calorie burn may be calculated, estimated and/or determined by:
cal_bike=(A+B*cadence)*time,

- [0090] where cadence is the number of foot pedal rotations of the user over a time epoch, time is the length of time under consideration, and (A,B) are that may be associated with and/or calibrated or tuned to the user; notably, such parameters may be stored in memory in the portable monitoring device.

[0091] Augmentation Using Altitude Data

- [0093] where MET(speed) is the nominal calorie output over flat land as a function of speed, k1(ΔH-S) and k2(speed, ΔH-S) are a scaling and offset term that are functions of ΔH-S (i.e., the change in elevation per step) and/or speed, and time is the length of time under consideration. k1(ΔH-S) and k2(speed, ΔH-S) are parameters or functions that may be tuned to the user.

- [0095] where (A,B) are parameters are that may be associated with and/or calibrated or tuned to the user, and time is the length of time under consideration; notably, such parameters may be stored in memory in the portable monitoring device.

- [0099] where (A,B,C,D) are parameters. These parameters may be tailored to an individual based on the calibration methods described above or equivalent techniques.

[0100] In one embodiment, the altitude correction to energy expenditure may be an additive term calculated as:
dcal=k*speed*grade*BMR.

[0103] Notably, all such mathematical manipulations of the preceding methods that yield identical or substantially equivalent results are considered within the scope of the present inventions.

- [0115] where x is the state vector, H is altitude or height, and dH is the first derivative of H with respect to time.
  In this notation, dH(t) is similar or equivalent to the parameter ΔH-t described previously. Note that these parameters are expressed as functions of time.

[0116] In another preferred embodiment, several parameters of interest may be described in an alternate state space:
x(step)=[H(step)dH(step)]^T,

- [0117] where x is the state vector, H is the altitude, and dH is the first derivative of H now expressed as functions of step, where the implicit relationship on time for step is omitted for notational simplicity.
  Notably, dH(step) is similar or equivalent to the parameter ΔH-S described previously. The time-space and step-space representations may be employed together or separately in one or more estimation techniques. Indeed, when used separately, many methods may be used to estimate the derivative that is not covered in the representation. For example, when only the time-space representation is used, the parameter dH(step) may be estimated as:
  dH_EST(step)=(H_EST(t)−H_EST(t−dT))/(step(t)−step(t−dT)),
- [0118] where dT is a time interval, step(t) is the step count at time t, and the EST subscript denotes an estimate.

[0119] Similarly, when the step-space representation is used, the parameter dH(t) may be estimated as:
dH_EST(t)=(H_EST(step(t))−H_EST(step(t)−step(t−dT)))/(t−dT),

[0120] where dT is a time interval.

[0122]

x (t + dT) = Fx (t) + w, F = [\begin{matrix} 1 & dT \\ 0 & 1 \end{matrix}],

[0123] where dT is a time interval and w is process noise.

In a step-space representation, the altitude of the user may be described by a constant velocity model:

[0124]

x (step + dStep) = Fx (step) + w, F = [\begin{matrix} 1 & dStep \\ 0 & 1 \end{matrix}],

[0125] where dStep=x(step(t+dT))−x(step(t)) and w is process noise.

[0127] The model-based approach permits the prediction of future altitude measurements as:
x_PRED(t+dT)=CFx_EST(t),
x_PRED(step+dStep)=CFx_EST(step),

[0128] C=[1 0],

[0129] for both models.

[0130] Defining z=H+v to be a noise corrupted measurement of altitude, a residual may be calculated as:
resid=z−x_PRED

- [0142] where k1, k2, and k3 are parameters, MET are metabolic equivalent units expended, HR is the user's heart rate and HR₀is a nominal at-rest heart rate.
  This equation is provided merely for illustration. Indeed, all relationships that describe activity points and/or “grades” and/or activity metrics that are not inherently physical quantities (e.g., calorie burn) and/or avatar states as an integrated, combined and/or fused output from one or more of user motion data, user physiological data, user elevation data, and/or user location data are simply embodiments of the present inventions. Likewise, all relationships that describe elevation points, and/or “grades” and/or metrics that are not inherently physical quantities (e.g., elevation gain) and/or avatar states as an output from either altitude data alone or in combination with user motion data, user physiological data, and/or user location data are simply embodiments of the present inventions. In some embodiments, the motivational metrics and/or avatars may be computed and/or displayed on the portable monitoring device. In other embodiments, the motivational metrics and/or avatars may be computed and/or displayed on other media (e.g., www.fitbit.com) using data from the portable monitoring device. In yet other embodiments, the motivational metrics and/or avatars may be computed and/or displayed on both the portable monitoring device and other media.

[0145] Surface grade may be expressed as the elevation change over a horizontal distance:
g=ΔH/d.

[0146] When d is not directly measured (as in the case of GPS tracking), it may be calculated as:
d=sqrt(d_s²+ΔH²),

[0147] where d_sis the distance traveled overland by the user.

[0153] FIGS. 9B and 9C depict other exemplary embodiments in which the sampling mode or frequency of the altitude sensor is determined by the output of a pedometer.

[0182]

u = - \frac{r}{3 π η} Δ p,

[0183] where η is the viscosity of the gas (Roscoe 1949, Yu, et al. 1988).

The rate of change of the mass of gas in the chamber is
{dot over (m)}=ρπr²u,

[0184] where ρ is the density of the gas.

Finally, assuming the gas to be ideal and the system to be isovolumetric and isothermal, it can be shown that the rate of change of pressure in the chamber p_cis

[0185]

{\dot{p}}_{c} = (\frac{ρ RT}{3 η M}) (\frac{r^{3}}{V}) Δ p,

[0186] where R is the universal gas constant, T is the temperature, and M is the molar mass of the gas.

[0187] As such, it can then be shown that the time constant for the system τ is

[0188]

τ = (\frac{3 η M}{ρ RT}) (\frac{V}{r^{3}}) .

- [0211] A user owns a Garmin ANT device that is set up to sync data to Garmin's website. She then acquires the current invention. Once she connects the invention to the internet, the Garmin device can automatically send its data to Garmin's website through the invention without any further setup. The invention could also send the data to Garmin's website via an intermediary website (e.g., www.fitbit.com).
  The user may also turn off and on (disable or enable) the ability for data destinations to receive the data.

- [0219] Historical and current graphs and/or data of user activity and/or foods consumed and/or sleep data that are measured by the device and/or stored remotely (e.g., fitbit.com);
- [0220] Historical graphs and data of user weight and/or body fat data measured by a weight scale and transferred to the device (either over the Internet or by the scale itself);
- [0221] Historical graphs and data of other user-tracked data measured by the device or stored remotely. Examples include heart rate, blood pressure, arterial stiffness, blood glucose levels, cholesterol, duration of TV watching, duration of video game play, mood, etc.;
- [0222] Physiological data corresponding to average or norms, for example, for comparison purposes wherein, in one embodiment, the user's physiological data is compared to or contrasted with average physiological data (for example, on an age, gender or condition basis (for example, a pregnant women's physiological data is compared with typical physiological data based on stage, size and age));
- [0223] “Mash-up” data pertaining to user's physiologic data and user's water intake—for example, correlations of (i) hydration levels to manually logged water consumption and (ii) hydration levels to automatically measured water consumption via a “smart” water bottle (e.g., Camelbak flow meter hydration gauge system);
- [0224] “Mash-up” data pertaining to user's physiologic data and user's sleep—for example, correlations of (i) heart rate to blood pressure and (ii) body weight and/or fat to sleep time, patterns and/or quality;
- [0225] “Mash-up” data pertaining to user's physiologic data and user's activity—for example, correlations of (i) hydration to activity levels and (ii) heart rate and/or variability to activity levels and/or patterns;
- [0226] “Mash-up” data pertaining to physiologic data and potentially related external events such as correlations of (i) user's body weight and/or fat to ambient environment for example, geography, temperature and/or weather, (ii) user's heart rate and/or blood pressure to financial markets (for example, S&P 500, NASDAQ or Dow Jones); here the data analysis of the user's biometric or physiologic data is correlated to web content and/or external devices that are in communication with the biometric monitoring device;
- [0227] Coaching and/or dieting data based on one or more of the user's current weight, weight goals, food intake, activity, sleep, and other data;
- [0228] User progress toward weight, activity, sleep, and/or other goals;
- [0229] Summary statistics, graphics, badges, and/or metrics (e.g., “grades”) to describe the aforementioned data;
- [0230] The aforementioned data displayed for the user and his/her “friends” with similar devices and/or tracking methods;
- [0231] Social content such as Twitter feeds, instant messaging, and/or Facebook updates;
- [0232] Other online content such as newspaper articles, horoscopes, stock, sports or weather reports, RSS feeds, comics, crossword puzzles, classified advertisements, and websites; and
- [0233] Motivational messages, system messages (e.g., battery status, “sync data” notifier), device communications that may be similar to social content (e.g., the device may communicate greetings to the user like “Hello”, “Good Morning”), and/or other messages similar in content to a fortune cookie; and
- [0234] Email messages and calendar schedules; and
- [0235] Clock and/or stop watch.