US 8,285,344 B2Grant
Method and apparatus for adjusting audio for a user environment
Issue Date:2012-10-09
•22 Claims
•8 Drawing Sheets
Abstract
The method defines a user environment based on detected motion data and/or ambient noise data. The user environment is then used to apply an appropriate audio adjustment mode. In one embodiment, the user environment definition further includes location data. In one embodiment, the location data is obtained from one of: a global positioning system (GPS), and network triangulation.
Metadata
Assignee
- DP Technlogies, Inc.
Inventors
- Philippe Kahn
- Arthur Kinsolving
Application Information
Application Number:US 12/469,633
Filing Date:2009-05-20
Priority Date:2008-05-21
Art Unit:2618
Classifications
IPC:
H04M1/00H04B1/38
Patent Drawings (8 sheets)
Description
Related Application
[0001] This patent application claims the benefit under 35 U.S.C. §119(e) of U.S. provisional application No. 61/055,137, filed May 21, 2008, which is incorporated by reference.
Field of the Invention
[0002] The present invention relates to adjusting headset or handset audio to a user's environment, and more precisely to adjusting an audio adjustment mode to a current environment.
Background
[0003] As people are using mobile devices more and more often, noise becomes an issue. People are calling from environments like buses, restaurants, as well as while walking or jogging. Noise affects both mobile handsets as well as the audio headsets that are used with these handsets (both wired and wireless). The ambient noise is becoming more of an issue. There are many factors that contribute to this noise including background machine noise (vehicles, construction equipment, home/lawn equipment, etc.), wind moving over the microphone, wireless device transmission artifacts, echo, interference, etc.
[0004] In the prior art, there are some noise reduction mechanisms. However, noise reduction mechanisms have the unfortunate side-effect of reducing sound quality for the voice as well.
Summary
[0005] A method and apparatus to define a user environment based on detected motion data and/or ambient noise data is disclosed. The user environment is then used to apply an appropriate audio adjustment mode. In one embodiment, the user environment definition further includes location data. In one embodiment, the location data is obtained from one of: a global positioning system (GPS), and network triangulation.
Brief Description of the Drawings
[0006] The present invention is illustrated by way of example, and not by way of limitation, in the figures of the accompanying drawings and in which like reference numerals refer to similar elements and in which:
[0007] FIG. 1 is a block diagram of one embodiment of the improved environmental response system.
[0008] FIG. 2 is a flowchart of one embodiment of the environmental response system.
[0009] FIG. 3 is a flowchart of one embodiment of identifying user motion.
[0010] FIG. 4 is a flowchart of one embodiment of identifying ambient noise.
[0011] FIG. 5 is a flowchart of one embodiment of identifying location.
[0012] FIG. 6 is an exemplary chart of relating a user environment to a noise reduction
[0013] FIG. 7 is a block diagram of one embodiment of the processing system which may be used to implement the environmental response system.
Detailed Description
[0014] The method and apparatus described are to add intelligence to an audio adjustment system. The audio adjustment systems can be useful in reducing ambient noise for telephone conversations, increasing volume of the ringer or speaker in a louder environment, and otherwise adjusting the audio input and output for the current environment. However, prior art noise reduction mechanisms are either applied indiscriminately to all conversations, or require user input to control when they are utilized. An unfortunate side-effect of most noise reduction mechanisms is that the voice is altered, clipped, blurred, etc.
[0015] The present system applies motion data and ambient noise data to determine when audio adjustment should be utilized, and which audio adjustment mode(s) should be utilized. In one embodiment, location information is also applied. The entire data set, e.g. motion data, ambient noise data, and when available location data, are used to identify a user environment. The user environment information is then used to select an audio adjustment mode. The audio adjustment mode identifies zero, one, or more noise cancellation, noise decreasing, and audio output altering mechanisms that are applied to the device. In one embodiment, the present system may be utilized with any noise cancellation techniques.
[0016] The following detailed description of embodiments of the invention makes reference to the accompanying drawings in which like references indicate similar elements, showing by way of illustration specific embodiments of practicing the invention. Description of these embodiments is in sufficient detail to enable those skilled in the art to practice the invention. One skilled in the art understands that other embodiments may be utilized and that logical, mechanical, electrical, functional and other changes may be made without departing from the scope of the present invention. The following detailed description is, therefore, not to be taken in a limiting sense, and the scope of the present invention is defined only by the appended claims.
[0017] FIG. 1 is a block diagram of one embodiment of the improved environmental response system. In one embodiment, the system is part of a mobile device, which includes a telephone or other communications mechanism. The mobile device may be a mobile phone, a headset coupled to a mobile phone, a Voice-over-Internet Protocol (VoIP) phone, a cordless phone, or another communications mechanism which includes at least one microphone or motion detection system. In one embodiment, the device may further include audio output capability. In another embodiment, the mobile device may not include a communications mechanism, but may instead include only audio output mechanisms, e.g. a speaker. In one embodiment, the environmental response system may include portions located on a mobile device and portions remotely located.
[0018] Motion data receiver logic 110 receives motion data. In one embodiment, motion data is received from one or more accelerometers which part of one or more mobile devices which communicate. Motion data is then passed to motion analysis logic 120 in a processor. In one embodiment, motion data is buffered, and the processor obtains the buffered motion data. Motion analysis logic 120 uses the motion data to determine what the user is doing. In one embodiment, motion analysis logic 120 utilizes independent component analysis to analyze motion data for each of the accelerometers. The motion analysis logic 120 then combines the analyzed data to obtain a better result. For example, if there is a separate accelerometer in a headset and in a mobile device coupled to the headset, the motion data from both devices may be combined to get a better indicator of the user's actual activity.
[0019] In one embodiment, the motion analysis logic 120 categorizes the user's current activity level. In one embodiment, the motion categories include: laying down, sitting, standing, walking (may differentiate between various speeds, e.g. ambling v. speed walking), running (may differentiate between various speeds), travelling in a vehicle, etc. Note that these are just exemplary categorizations. The system may use any categories which can be identified based on the motion data received. In one embodiment, the motion analysis logic 120 utilizes a database of motion signatures 125, to determine what the user is doing. In one embodiment, the analysis of the motion may be done in accordance with the technique described in co-pending U.S. patent application Ser. No. 12/069,267, titled “Human Activity Monitoring Device with Activity Identification,” which is incorporated herein by reference.
[0020] The system in one embodiment further includes a sound receiving logic 130. Sound receiving logic 130 receives sound data from one or more microphones or other systems. In one embodiment, the sound receiving logic 130 may receive data from remote microphones (for example a microphone in a headset, while the system is located in a paired handset). The sound data is sent to ambient noise analysis 140. Ambient noise analysis 140 includes a microphone qualifying logic 145. The microphone qualifying logic 145 determines whether the microphone is in close enough vicinity to the user to be relevant to the analysis. If not, the data from the microphone is discarded. This is relevant for example when the microphone is on a handheld device which is located remotely from the user who is wearing a headset. Otherwise, the data from the microphone is passed on to normalization logic 150. Normalization logic 150 normalizes the microphone data to account for different relative locations on the user's body (e.g. worn on the head, in a pocket, in a holster, etc.)
[0021] The normalized sound data is then passed to noise level calculator 155, which calculates the actual ambient noise level based on data from all qualified microphones. In one embodiment, the ambient noise level being calculated is ideally at the user's ears, as that is where the user will be hearing a conversation, music, etc.
[0022] The system in one embodiment further includes location logic 160. Location logic 160 may receive data from a global positioning system (GPS) receiver, a network triangulation system, dead reckoning based on accelerometer data, or another means of determining an approximate location of the user. In one embodiment, the output of location logic 160 is coordinates identifying the user's current location. Mapping logic 165 converts the coordinate information into location information. In one embodiment, mapping logic 165 then converts the map location information into a location category. In one embodiment, the location category information includes: on a street in a city, on a street in a rural area, inside an office building, inside a restaurant, at a running track, etc. In one embodiment, mapping logic 165 indicates whether the user is inside or outside. In one embodiment, in addition to location data, barometric pressure data and temperature data may be used to confirm whether the user is inside or outside. In general, outside temperatures can be verified in various databases providing local temperature data. Inside temperatures are regulated based on air-conditioning and heating preferences. Thus, temperature data can help differentiate. Similarly, barometric pressure may indicate whether the user is on the ground floor, or at a second floor level or higher, indicating that the user is inside a building.
[0023] In one embodiment, location logic 160 receives data from the GPS or other system on a periodic basis. In another embodiment, location logic 160 polls the GPS or other system on a periodic basis. In one embodiment, whenever motion analysis logic 120 has determined that the user has travelled a certain distance, the location logic 160 polls the GPS or other system. In another embodiment, the GPS system may be providing continuous data to the system.
[0024] User environment generation logic 170 receives the available ones of the motion data, ambient noise data, and location data. In one embodiment, additional sensors such as pressure monitor (barometric pressure sensor), temperature sensor, or other sensor data may also be included in the analysis. User environment generation logic 170 generates an overall environment evaluation, based on the available data. In one embodiment, the overall environment is a set of variables which are selected based on the available data. In one embodiment, user environment generation logic 170 uses a set of profiles to identify the appropriate environment.
[0025] Audio adjustment mode selection logic 180 then receives the user environment, and selects an appropriate audio adjustment mode. The audio adjustment mode may include various noise reduction 185 and noise cancellation 190 mechanisms. The audio adjustment mode may also control the variables for the noise reduction mechanisms. In one embodiment, the audio adjustment mode may also include audio output 195 which can make changes to the output of other sounds. Audio output 195 may be used for adjusting ringer tone, tune, or volume, altering other notifications, or increasing/decreasing speaker volume. Other mechanisms to improve the user's experience in various audio environments may also be part of the audio adjustment modes available to audio adjustment mode selection logic 180.
[0026] For example, noise reduction mechanisms may include one or more of the following: a high, low, or bandpass filter (may include variable settings); microphone or speaker gain, noise removal algorithm to remove noise/sounds that have a frequency uncharacteristic of human speech, filters, equalization, signal clipping, smoothing for packet loss.
[0027] Noise cancellation mechanisms calculate a reversed version of ambient noise, and apply it to cancel out the noise.
[0028] FIG. 6 is an exemplary chart of relating a user environment to an audio adjustment mode. Note that this is simply exemplary. The set of audio adjustment tools which may be available may vary from system to system. The set of audio adjustment modes which may be available can vary from system to system.
[0029] FIG. 2 is a flowchart of one embodiment of environmental response system. The process starts at block 205. At block 210, the user motion is identified. This is used, in one embodiment, to determine what the user is doing. User motion may be determined based on data from one or more accelerometers. For example, in a mobile system which includes a handset and a headset, one or both may include accelerometers. The accelerometer data, in one embodiment from both devices when available, is utilized to identify the user motion.
[0030] At block 220, the ambient noise level is identified. The ambient noise level, in one embodiment, includes all noises detected by a microphone. In one embodiment, multiple microphones may be used.
[0031] At block 230, in one embodiment, the user location is identified. In one embodiment, this feature is available when a location identification tool is available within the system. This step may be skipped, if no location information is available. User location data may be an address, or an indication that the user is inside a building or outside.
[0032] At block 240, a combined “user environment” data set is generated. The user environment data may include information from other available sensors. For example, in one embodiment, the user environment data may include information from one or more of the following sensors: clock, camera, temperature sensor, barometer, heart rate. Any sensor which may be used to gauge a user's environment may be part of the combined “user environment” data.
[0033] At block 250, an audio adjustment mode is selected, based on the identified user environment. The audio adjustment mode may include one or more noise cancellation algorithms and/or settings for algorithms, one or more noise reduction algorithms and/or settings for algorithms, and adjustments in audio output. In one embodiment, one mode is to have no changes made.
[0034] The process then ends at block 260. In one embodiment, this monitoring occurs continuously. In one embodiment, a “user environment” evaluation occurs continuously. In another embodiment, the system monitors the user's environment periodically. In one embodiment, whenever a change is detected—e.g. substantial movement by the user, a change beyond a set range in any of the sensor outputs—the user's environment is reevaluated. In another embodiment, the system monitors only when there is an active call in progress, the user is listening to the device, or when there is other activity with the device which makes audio input and/or output adjustment relevant.
[0035] FIG. 3 is a flowchart of one embodiment of identifying user motion. As noted above, this may be done using one or more accelerometers, or other motion detection mechanisms. The process starts at block 310. At block 315, the process determines whether the user is taking steps. In one embodiment, a step detection system may be used.
[0036] If the user is taking steps, the process continues to block 320. At block 320, the type of steps being taken is identified. In one embodiment, the system can detect the difference between a leisurely amble, a walk, a jog, a sprint, and other types of steps that the user can take. The various types of steps indicate various modes of travel. For example, a user who is jogging has a different environment than one who is ambling, from a noise perspective. In one embodiment, the algorithm described in co-pending application Ser. No. 12/069,267 is used. The algorithm in one embodiment determines the cadence and speed of the user. For example, the optimal noise reduction mode for a user who is running is different from the optimal mode for a user who is walking at a slow pace. For example, the user's speed generates wind over the microphone and thus noise. The process then ends at block 350.
[0037] If the user was found not to be taking steps, the process continues to block 325. At block 325, if possible, the process determines whether the user is stationary. A stationary user is one that is not travelling. In one embodiment, a user who is not moving by a certain minimum amount is considered stationary. That is, a user who is shifting from one foot to another, while not moving, is considered a stationary user. In one embodiment, stationary users are generally standing or sitting. At block 330, the process determines whether the user is standing or sitting. In one embodiment, the system can also determine if the user is lying down. While sitting down, a user's waist area is moving in quite a different manner than while standing up.
[0038] In one embodiment, the determination is made based on minute motions made by the user's body. In one embodiment, this determination may be made using multiple accelerometers. In that instance, for example if there is an accelerometer in a headset and a handset worn at the waist. The process then ends at block 350.
[0039] If the user was not determined to be stationary, the process continues to block 335. At block 335, the process determines whether the user is in a vehicle. Vehicle motion has certain characteristics. The accelerations in a moving vehicle are quite characteristic. If the user is in a vehicle, the process continues to block 340. At block 340, the vehicle is identified, if possible. Generally, the driving characteristics of various vehicles differ. For example, a train has no side-to-side movement compared to a car. Once the vehicle is identified, the process ends at block 350.
[0040] In one embodiment, any other patterns that are known or developed can be utilized to attempt to identify the type of motion the user is undergoing at this time. However, if no motion is identified—or in one embodiment if no motion data is available—the process assigns an unidentified motion type to the detected motion at block 345. The process then ends at block 350. In one embodiment, this process is continuously evaluated, when the system is in operation.
[0041] FIG. 4 is a flowchart of one embodiment of identifying ambient noise. The process starts at block 405. In one embodiment, this process is activated only when there is at least one available microphone that can be used to measure ambient noise levels. At block 410, the process determines if there is a single microphone. If there is a single microphone, at block 420, the ambient noise level at the microphone is identified as the overall ambient noise level. The process then ends at block 495.
[0042] If there is more than one microphone, the process continues to block 430. There may be more than one microphone when there is, for example, a handset including a telephone and a Bluetooth connected headset including a microphone.
[0043] At block 440, the location of each microphone is identified based on location data. In one embodiment, location on or off the user's body is relevant in order to calculate the relevant ambient noise for any conversation.
[0044] At block 450, the process determines whether the microphones are close enough to be relevant. In one embodiment, since the devices including the microphones are linked in some wireless manner, a wireless packet may be sent to determine the microphone's proximity. Since the speed that such packets travel is known, by exchanging a set of packets, the processing mechanism can determine the distance between the microphones. If the microphones are not both close enough to be relevant, the process continues to block 460. At block 460, the microphone associated with the element that is worn by the user (e.g. the headset or handset or other device) is selected. The process then continues to block 420, to identify the ambient noise level at the selected microphone. In this way, when the two portions of the device are separated, the system selects the appropriate device to determine actual ambient noise in the vicinity of the user. In one embodiment, the multiple microphones are contained within the headset and situated in different directions.
[0045] If the microphones were close enough to be relevant, at block 450, the process continues to block 470. At block 470, an ambient noise level at each microphone is identified.
[0046] At block 480, the noise level data is normalized. For example, a device in a backpack worn by the user would detect a different ambient noise level than a headset worn by the same user. The location data—determined above—would be used, in one embodiment, to identify a basis for normalization.
[0047] At block 490, the normalized noise levels are used to create an ambient noise level. The ambient noise level corresponds to a noise level not including the user's own contribution. The process then ends at block 495
[0048] FIG. 5 is a flowchart of one embodiment of identifying location. The process starts at block 510. In one embodiment, this process occurs only if the environmental response system generally includes location capability. If the environmental response system doesn't include location capability at all, this process would not start.
[0049] At block 515, the process determines if GPS data is available. If so, at block 520, the user's coordinates are determined based on GPS data. At block 550, map information is obtained based on the coordinate information. In one embodiment, the mapping data may be part of the system. In another embodiment, the mapping data may be obtained from an external source. At block 560, mapping data is used to determine the user's location. The user's location may be on a street, in a restaurant, at a running track, etc.
[0050] At block 570, other sensor data is used to refine location data. Other sensors may include barometric sensors, which can indicate when a user is on a higher floor of a building. Other sensors may also include temperature sensors, which can indicate whether the user is in the open environment or in a heated or air-conditioned location (e.g. inside.).
[0051] If no GPS data is available, at block 525 the process determines whether network triangulation data is available. If so, at block 530, the user's coordinates are determined based on triangulation data. The process then continues to block 550 to obtain location from the triangulation data.
[0052] If no triangulation data is available, the process continues to block 535. At block 535, the process determines whether an alternate location determination system is available. If so, location data, coordination or other data, is obtained at block 540. If the data is coordinate data, or other data which requires conversion, the process continues to block 550, to obtain location information.
[0053] If no location determination system is available, the process tags the location as unknown at block 545. This would generally mean that no GPS or triangulation data is available, although the systems are available. The process then ends at block 580.
[0054] In one embodiment, this process actually doesn't flow in this way, but rather whatever system, or systems, are available, are utilized to obtain location information. In one embodiment, whenever the location determination mechanism receives incoming data—e.g. triangulation data, GPS data, or other data—an updated location is calculated. In one embodiment, the system may use these separate tools in combination to improve the coordinate quality.
[0055] FIG. 6 shows some possible adjustment modes which may be created, and the associated alterations to the input/output. For example, the modes may include: in office, in restaurant, on street, jogging, in car, etc. Each of these modes describes a particular set of local noise effects. For example, an office is generally relatively quiet, has other speakers, and echoes. In contrast, someone jogging is likely not going to be hearing as well (loud heart beat, and foot), but it is relatively unlikely to be hearing other speakers or experiencing echoes. These factors can be corrected-for.
[0056] FIG. 7 is a block diagram of a computer system which may be used in the present invention. The block diagram may apply to a mobile device, which is carried by the user.
[0057] The specific machine illustrated in FIG. 7 includes a bus or other internal communication means 715 for communicating information, and a processor 710 coupled to the bus 715 for processing information. The system further comprises a random access memory (RAM) or other volatile storage device 750 (referred to as memory), coupled to bus 715 for storing information and instructions to be executed by processor 710. Main memory 750 also may be used for storing temporary variables or other intermediate information during execution of instructions by processor 710. The system also comprises a read only memory (ROM) and/or static storage device 720 coupled to bus 715 for storing static information and instructions for processor 710, and a data storage device 725 such as a magnetic disk, optical disk and its corresponding disk drive, or flash memory. Data storage device 725 is coupled to bus 715 for storing information and instructions. In one embodiment, the accelerometer data and other temporary data are stored in main memory 750, which data such as motion characteristics are stored in static storage device 720.
[0058] The system may further be coupled to a visual display device 770, such as a cathode ray tube (CRT) or a liquid crystal display (LCD) coupled to bus 715 through bus 765 for displaying information to a computer user. An input device 775, which in one embodiment may include alphanumeric and other keys, may also be coupled to bus 715 through bus 765 for communicating information and command selections to processor 710. Input device 770 may also include cursor control device 780 for controlling cursor movement on display device 770.
[0059] Audio output device 780 is designed to output sounds, for example music or conversation. Audio output device 780 in general is a speaker, including volume adjusting mechanisms. Audio output device 780 in one embodiment includes various structures such as filters (bandpass, bandgap, high pass, low pass, linear filter) to alter the sound quality being output. Audio output device 780 in one embodiment further includes controls to provide for packet loss recovery. In another embodiment, these mechanisms are provided via processor 710, and applied to audio output device 780.
[0060] Audio input device 785 is designed to receive sounds from the user. In one embodiment, audio input device 785 is designed to receive data, and the data is packetized by processor 710, and transmitted via communication device 790. Audio input device 785 in one embodiment is a microphone or other receiver. In one embodiment, audio input device 785 includes filters (linear filter, bandpass, bandgap, high pass, low pass) to remove extraneous noise from the sound received. In one embodiment, audio input device 785 also incorporates signal clipping, adjustment of gain, and adjusting of volume. In another embodiment, these mechanisms are provided via processor 710, and applied to audio input device 785.
[0061] Another device, which may optionally be coupled to computer system 700, is a communication device 790 for accessing other nodes of a distributed system via a network. The communication device 790 may include any of a number of commercially available networking peripheral devices such as those used for coupling to an Ethernet, token ring, Internet, personal area network (PAN), cellular network, wireless network, or other network. The communication device 790 may further be a null-modem connection, or any other mechanism that provides connectivity between the computer system 700 and the outside world. Note that any or all of the components of this system illustrated in FIG. 7 and associated hardware may be used in various embodiments of the present invention.
[0062] It will be appreciated by those of ordinary skill in the art that any configuration of the system may be used for various purposes according to the particular implementation. The control logic or software implementing the present invention can be stored in main memory 750, mass storage device 725, or other storage medium locally or remotely accessible to processor 710.
[0063] It will be apparent to those of ordinary skill in the art that the system, method, and process described herein can be implemented as software stored in main memory 750 or read only memory 720 and executed by processor 710. This control logic or software may also be resident on an article of manufacture comprising a computer readable medium having computer readable program code embodied therein and being readable by the mass storage device 725 and for causing the processor 710 to operate in accordance with the methods and teachings herein.
[0064] The present invention may also be embodied in a handheld or portable device containing a subset of the computer hardware components described above. For example, the handheld device may be configured to contain only the bus 715, the processor 710, and memory 750 and/or 725, and audio output 780 and input 785 devices. The handheld device may also be configured to include a set of buttons or input signaling components with which a user may select from a set of available options. The handheld device may also be configured to include an output apparatus such as a liquid crystal display (LCD) or display element matrix for displaying information to a user of the handheld device. The implementation of the present invention for such a device would be apparent to one of ordinary skill in the art given the disclosure of the present invention as provided herein.
[0065] The present invention may also be embodied in a special purpose device, such as a headset, including a subset of the computer hardware components described above. For example, the headset may include a processor 710, a data storage device 725, a bus 715, and memory 750, and only rudimentary communications mechanisms, such as audio input and output that permits the user to communicate in a basic manner with the device. In general, the more special-purpose the device is, the fewer of the elements need be present for the device to function. In some devices, communications with the user may be through a voice based system, or similar mechanism.
[0066] It will be appreciated by those of ordinary skill in the art that any configuration of the system may be used for various purposes according to the particular implementation. The control logic or software implementing the present invention can be stored on any machine-readable medium locally or remotely accessible to processor 710. A machine-readable medium includes any mechanism for storing information in a form readable by a machine (e.g. a computer). For example, a machine readable medium includes read-only memory (ROM), random access memory (RAM), magnetic disk storage media, optical storage media, flash memory devices, or other storage media which may be used for temporary or permanent data storage. In one embodiment, the control logic may be implemented as transmittable data, such as electrical, optical, acoustical or other forms of propagated signals (e.g. carrier waves, infrared signals, digital signals, etc.).
[0067] In the foregoing specification, the invention has been described with reference to specific exemplary embodiments thereof. It will, however, be evident that various modifications and changes may be made thereto without departing from the broader spirit and scope of the invention as set forth in the appended claims. The specification and drawings are, accordingly, to be regarded in an illustrative rather than a restrictive sense.
Claims
What is claimed is:
1. A method and to define a user environment comprising:
detecting motion data;
detecting ambient noise data;
identifying a user environment based on the motion data and the ambient noise data, wherein the user environment is selected from a plurality of predefined environments, each predefined environment associated with a certain user activity level, ambient noise data, and location data when available; and
selecting an appropriate audio input and output adjustment mode based on the selected user environment data.
2. The method of claim 1, further comprising:
detecting location data; and
utilizing the location data in defining the user environment.
3. The method of claim 2, wherein the location data is obtained from one of: a global positioning system (GPS), and network triangulation.
4. The method of claim 2, wherein detecting location data comprises:
receiving coordinate data from a location sensor; and
mapping the coordinate data onto a map to determine the location data.
5. The method of claim 2, wherein detecting location data comprises:
determining whether a user is in an inside environment or an outside environment, based on one or more of: temperature data, barometer data, global positioning.
6. The method of claim 1, wherein the audio input adjustment mode includes one or more of the following: noise reduction, noise cancellation, and audio output adjustment mode includes one or more of: speaker adjustment, and audio output mode selection.
7. The method of claim 1, wherein the defined environments comprise: in office, on street, in moving vehicle, at exercise, in home, in restaurant or store.
8. The method of claim 1, wherein the user environment is identified continuously during a telephone call, and a change in the predefined environment results in adjusting an audio input and/or an audio output to improve communication quality based on the user environment.
9. A mobile device comprising:
a motion data receiver logic to receive motion data;
a sound receiving logic to receive ambient noise data;
a user environment generation logic to identify a user environment associated with the mobile device based on a user activity level based on the motion data, the ambient noise data, and location information when available, the user environment being one of a plurality of predefined environments; and
an audio adjustment mode selection logic to select an appropriate adjustment to be applied to an audio output and an audio input of the mobile device based on the identified environment.
10. The mobile device of claim 9, further comprising:
a motion analysis logic to categorize how a user is using the mobile device based on the motion data; and
a memory coupled with the motion analysis logic to store one or more motion signatures, each motion signature associated with a category of user motion.
11. The mobile device of claim 10, further comprising:
the motion analysis logic to receive motion data from two or more motion sensing components, analyze motion data associated with each of the motion sensing components, and combine the analyzed motion data before determining how a user is using the mobile device.
12. The mobile device of claim 9, further comprising:
an ambient noise analysis logic to determine whether one or more microphones coupled with the mobile device are relevant to identifying a user environment,
when a plurality of microphones are identified as relevant, a normalization logic to normalize microphone data based on a relative location with respect to a user's ear of the plurality of microphones, and a noise level calculator to calculate an ambient noise level based on data from all microphones that have been determined relevant.
13. The mobile device of claim 9, further comprising:
a location logic to receive location data from one of a global positioning system (GPS) and network triangulation; and
a mapping logic coupled with the location logic to convert the location data to a location, and to provide the location to the user environment generation logic.
14. The mobile device of claim 9, further comprising:
the user environment generation logic to receive additional environmental data from one or more of a pressure monitor and a temperature sensor to evaluate when identifying the user environment.
15. The mobile device of claim 9, wherein the adjustment to be applied to the audio input of mobile device includes one or more of the following: noise reduction, noise cancellation, and/or the adjustment applied to the audio output includes one or more of: speaker adjustment, and audio output mode selection.
16. The apparatus of claim 9, wherein the defined environments comprise one of: in office, on street, in moving vehicle, at exercise, in home, in restaurant or store.
17. The apparatus of claim 9, wherein the user environment generation logic determines changes to the user environment during a telephone call made with the mobile device, such that the audio adjustment mode selection logic changes the appropriate adjustment during the telephone call, when the predefined environment changes.
18. An apparatus comprising:
an accelerometer to receive motion data, and send the motion data to a motion data receiver logic;
a processor to classify a user environment as one of a plurality of possible predefined environments based on user activity data based on the motion data and ambient noise data detected by the apparatus and location data; and
a speaker capable of adjustment, and the processor to adjust the speaker volume based on the classification of the user environment; and
a microphone to receive sound from the user, the microphone capable of being adjusted based on the classification of the user environment.
19. The apparatus of claim 18, further comprising;
a filter to adjust a sound response of the speaker, based on the user environment.
20. The apparatus of claim 19, wherein the filter is one of: a low pass filter, a high pass filter, and band pass filter, and a band gap filter, and further,
where the filter is implemented as one of: a hardware filter connected inline, a software filter implemented by the processor, and a combination of hardware and software element.
21. The apparatus of claim 18, further comprising:
a global positioning system (GPS) receiver to receive GPS data; and
the processor to adjust the user environment based on the GPS data.
22. The apparatus of claim 18, further comprising:
the processor monitoring for changes in the user environment during a telephone call, and changes the appropriate adjustment during the telephone phone call when the predefined environment changes.
Patent Citations (339)
| Patent | Date | Inventor | Cited By |
|---|---|---|---|
| US4285041(A) | 1981-08-01 | Smith | Applicant |
| US4571680(A) | 1986-02-01 | Wu | Applicant |
| US4578769(A) | 1986-03-01 | Frederick | Applicant |
| US4700369(A) | 1987-10-01 | Seigal et al. | Applicant |
| US4776323(A) | 1988-10-01 | Spector | Applicant |
| US5313060(A) | 1994-05-01 | Gast et al. | Applicant |
| US5386210(A) | 1995-01-01 | Lee | Applicant |
| US5430480(A) | 1995-07-01 | Allen et al. | Applicant |
| US5446725(A) | 1995-08-01 | Ishiwatari | Applicant |
| US5446775(A) | 1995-08-01 | Wright et al. | Applicant |
| US5454114(A) | 1995-09-01 | Yach et al. | Applicant |
| US5506987(A) | 1996-04-01 | Abramson et al. | Applicant |
| US5583776(A) | 1996-12-01 | Levi et al. | Applicant |
| US5593431(A) | 1997-01-01 | Sheldon | Applicant |
| US5654619(A) | 1997-08-01 | Iwashita | Applicant |
| US5737439(A) | 1998-04-01 | Lapsley et al. | Applicant |
| US5771001(A) | 1998-06-01 | Cobb | Applicant |
| US5778882(A) | 1998-07-01 | Raymond et al. | Applicant |
| US5911065(A) | 1999-06-01 | Williams et al. | Applicant |
| US5955667(A) | 1999-09-01 | Fyfe | Applicant |
| US5960085(A) | 1999-09-01 | de la Huerga | Applicant |
| US5976083(A) | 1999-11-01 | Richardson et al. | Applicant |
| US6013007(A) | 2000-01-01 | Root et al. | Applicant |
| US6061456(A) | 2000-05-01 | Andrea et al. | Applicant |
| US6122595(A) | 2000-09-01 | Varley et al. | Applicant |
| US6135951(A) | 2000-10-01 | Richardson et al. | Applicant |
| US6145389(A) | 2000-11-01 | Ebeling et al. | Applicant |
| US6246321(B1) | 2001-06-01 | Rechsteiner et al. | Applicant |
| US6282496(B1) | 2001-08-01 | Chowdhary | Applicant |
| US6353449(B1) | 2002-03-01 | Gregg et al. | Applicant |
| US6369794(B1) | 2002-04-01 | Sakurai et al. | Applicant |
| US6396883(B2) | 2002-05-01 | Yang et al. | Applicant |
| US6408330(B1) | 2002-06-01 | de la Huerga | Applicant |
| US6428490(B1) | 2002-08-01 | Kramer et al. | Applicant |
| US6470147(B1) | 2002-10-01 | Imada | Applicant |
| US6478736(B1) | 2002-11-01 | Mault | Applicant |
| US6493652(B1) | 2002-12-01 | Ohlenbusch et al. | Applicant |
| US6496695(B1) | 2002-12-01 | Kouji et al. | Applicant |
| US6513381(B2) | 2003-02-01 | Fyfe et al. | Applicant |
| US6522266(B1) | 2003-02-01 | Soehren et al. | Applicant |
| US6532419(B1) | 2003-03-01 | Begin et al. | Applicant |
| US6539336(B1) | 2003-03-01 | Vock et al. | Applicant |
| US6595929(B2) | 2003-07-01 | Stivoric et al. | Applicant |
| US6607493(B2) | 2003-08-01 | Song | Applicant |
| US6611789(B1) | 2003-08-01 | Darley | Applicant |
| US6628898(B2) | 2003-09-01 | Endo | Applicant |
| US6634992(B1) | 2003-10-01 | Ogawa | Applicant |
| US6665802(B1) | 2003-12-01 | Ober | Applicant |
| US6672991(B2) | 2004-01-01 | O'Malley | Applicant |
| US6685480(B2) | 2004-02-01 | Nishimoto et al. | Applicant |
| US6700499(B2) | 2004-03-01 | Kubo et al. | Applicant |
| US6731958(B1) | 2004-05-01 | Shirai | Applicant |
| US6766176(B1) | 2004-07-01 | Gupta et al. | Examiner |
| US6771250(B1) | 2004-08-01 | Oh | Applicant |
| US6786877(B2) | 2004-09-01 | Foxlin | Applicant |
| US6788980(B1) | 2004-09-01 | Johnson | Applicant |
| US6790178(B1) | 2004-09-01 | Mault et al. | Applicant |
| US6813582(B2) | 2004-11-01 | Levi et al. | Applicant |
| US6823036(B1) | 2004-11-01 | Chen | Applicant |
| US6826477(B2) | 2004-11-01 | Ladetto et al. | Applicant |
| US6836744(B1) | 2004-12-01 | Asphahani et al. | Applicant |
| US6881191(B2) | 2005-04-01 | Oakley et al. | Applicant |
| US6885971(B2) | 2005-04-01 | Vock et al. | Applicant |
| US6898550(B1) | 2005-05-01 | Blackadar et al. | Applicant |
| US6928382(B2) | 2005-08-01 | Hong et al. | Applicant |
| US6941239(B2) | 2005-09-01 | Unuma et al. | Applicant |
| US6959259(B2) | 2005-10-01 | Vock et al. | Applicant |
| US6975959(B2) | 2005-12-01 | Dietrich et al. | Applicant |
| US7010332(B1) | 2006-03-01 | Irvin et al. | Applicant |
| US7020487(B2) | 2006-03-01 | Kimata | Applicant |
| US7027087(B2) | 2006-04-01 | Nozaki et al. | Applicant |
| US7028547(B2) | 2006-04-01 | Shiratori et al. | Applicant |
| US7042509(B2) | 2006-05-01 | Onuki | Applicant |
| US7054784(B2) | 2006-05-01 | Flentov et al. | Applicant |
| US7057551(B1) | 2006-06-01 | Vogt | Applicant |
| US7072789(B2) | 2006-07-01 | Vock et al. | Applicant |
| US7092846(B2) | 2006-08-01 | Vock et al. | Applicant |
| US7096619(B2) | 2006-08-01 | Jackson et al. | Applicant |
| US7148797(B2) | 2006-12-01 | Albert | Applicant |
| US7155507(B2) | 2006-12-01 | Hirano et al. | Applicant |
| US7158912(B2) | 2007-01-01 | Vock et al. | Applicant |
| US7169084(B2) | 2007-01-01 | Tsuji | Applicant |
| US7171331(B2) | 2007-01-01 | Vock et al. | Applicant |
| US7173604(B2) | 2007-02-01 | Marvit et al. | Applicant |
| US7176886(B2) | 2007-02-01 | Marvit et al. | Applicant |
| US7176887(B2) | 2007-02-01 | Marvit et al. | Applicant |
| US7176888(B2) | 2007-02-01 | Marvit et al. | Applicant |
| US7177684(B1) | 2007-02-01 | Kroll et al. | Applicant |
| US7180500(B2) | 2007-02-01 | Marvit et al. | Applicant |
| US7180501(B2) | 2007-02-01 | Marvit et al. | Applicant |
| US7180502(B2) | 2007-02-01 | Marvit et al. | Applicant |
| US7200517(B2) | 2007-04-01 | Darley et al. | Applicant |
| US7212230(B2) | 2007-05-01 | Stavely | Applicant |
| US7212943(B2) | 2007-05-01 | Aoshima et al. | Applicant |
| US7220220(B2) | 2007-05-01 | Stubbs et al. | Applicant |
| US7254516(B2) | 2007-08-01 | Case et al. | Applicant |
| US7280096(B2) | 2007-10-01 | Marvit et al. | Applicant |
| US7297088(B2) | 2007-11-01 | Tsuji | Applicant |
| US7301526(B2) | 2007-11-01 | Marvit et al. | Applicant |
| US7301527(B2) | 2007-11-01 | Marvit et al. | Applicant |
| US7301528(B2) | 2007-11-01 | Marvit et al. | Applicant |
| US7301529(B2) | 2007-11-01 | Marvit et al. | Applicant |
| US7328611(B2) | 2008-02-01 | Klees et al. | Applicant |
| US7334472(B2) | 2008-02-01 | Seo et al. | Applicant |
| US7353112(B2) | 2008-04-01 | Choi et al. | Applicant |
| US7365735(B2) | 2008-04-01 | Reinhardt et al. | Applicant |
| US7365736(B2) | 2008-04-01 | Marvit et al. | Applicant |
| US7365737(B2) | 2008-04-01 | Marvit et al. | Applicant |
| US7379999(B1) | 2008-05-01 | Zhou et al. | Applicant |
| US7387611(B2) | 2008-06-01 | Inoue et al. | Applicant |
| US7397357(B2) | 2008-07-01 | Krumm et al. | Applicant |
| US7451056(B2) | 2008-11-01 | Flentov et al. | Applicant |
| US7457719(B1) | 2008-11-01 | Kahn et al. | Applicant |
| US7457872(B2) | 2008-11-01 | Aton et al. | Applicant |
| US7467060(B2) | 2008-12-01 | Kulach et al. | Applicant |
| US7512515(B2) | 2009-03-01 | Vock et al. | Applicant |
| US7526402(B2) | 2009-04-01 | Tanenhaus et al. | Applicant |
| US7608050(B2) | 2009-10-01 | Sugg | Applicant |
| US7640804(B2) | 2010-01-01 | Daumer et al. | Applicant |
| US7647196(B2) | 2010-01-01 | Kahn et al. | Applicant |
| US7653508(B1) | 2010-01-01 | Kahn et al. | Applicant |
| US7664657(B1) | 2010-02-01 | Letzt et al. | Applicant |
| US7689107(B2) | 2010-03-01 | Enomoto | Applicant |
| US7705884(B2) | 2010-04-01 | Pinto et al. | Applicant |
| US7752011(B2) | 2010-07-01 | Niva et al. | Applicant |
| US7753861(B1) | 2010-07-01 | Kahn et al. | Applicant |
| US7765553(B2) | 2010-07-01 | Douceur et al. | Applicant |
| US7774156(B2) | 2010-08-01 | Niva et al. | Applicant |
| US7857772(B2) | 2010-12-01 | Bouvier et al. | Applicant |
| US7881902(B1) | 2011-02-01 | Kahn et al. | Applicant |
| US7892080(B1) | 2011-02-01 | Dahl | Applicant |
| US7987070(B2) | 2011-07-01 | Kahn et al. | Applicant |
| US2001/0047488(A1) | 2001-11-01 | Verplaetse et al. | Applicant |
| US2002/0006284(A1) | 2002-01-01 | Kim | Applicant |
| US2002/0023654(A1) | 2002-02-01 | Webb | Applicant |
| US2002/0027164(A1) | 2002-03-01 | Mault et al. | Applicant |
| US2002/0054214(A1) | 2002-05-01 | Yoshikawa | Applicant |
| US2002/0089425(A1) | 2002-07-01 | Kubo et al. | Applicant |
| US2002/0109600(A1) | 2002-08-01 | Mault et al. | Applicant |
| US2002/0118121(A1) | 2002-08-01 | Lehrman et al. | Applicant |
| US2002/0138017(A1) | 2002-09-01 | Bui et al. | Applicant |
| US2002/0142887(A1) | 2002-10-01 | O'Malley | Applicant |
| US2002/0150302(A1) | 2002-10-01 | McCarthy et al. | Applicant |
| US2002/0151810(A1) | 2002-10-01 | Wong et al. | Applicant |
| US2002/0173295(A1) | 2002-11-01 | Nykanen et al. | Applicant |
| US2002/0190947(A1) | 2002-12-01 | Feinstein | Applicant |
| US2003/0018430(A1) | 2003-01-01 | Ladetto et al. | Applicant |
| US2003/0033411(A1) | 2003-02-01 | Kavoori et al. | Applicant |
| US2003/0048218(A1) | 2003-03-01 | Milnes et al. | Applicant |
| US2003/0083596(A1) | 2003-05-01 | Kramer et al. | Applicant |
| US2003/0093187(A1) | 2003-05-01 | Walker et al. | Applicant |
| US2003/0101260(A1) | 2003-05-01 | Dacier et al. | Applicant |
| US2003/0109258(A1) | 2003-06-01 | Mantyjarvi et al. | Applicant |
| US2003/0139692(A1) | 2003-07-01 | Barrey et al. | Applicant |
| US2003/0139908(A1) | 2003-07-01 | Wegerich et al. | Applicant |
| US2003/0149526(A1) | 2003-08-01 | Zhou et al. | Applicant |
| US2003/0151672(A1) | 2003-08-01 | Robins et al. | Applicant |
| US2003/0187683(A1) | 2003-10-01 | Kirchhoff et al. | Applicant |
| US2003/0208110(A1) | 2003-11-01 | Mault et al. | Applicant |
| US2003/0208113(A1) | 2003-11-01 | Mault et al. | Applicant |
| US2003/0227487(A1) | 2003-12-01 | Hugh | Applicant |
| US2003/0236625(A1) | 2003-12-01 | Brown et al. | Applicant |
| US2004/0017300(A1) | 2004-01-01 | Kotzin et al. | Applicant |
| US2004/0024846(A1) | 2004-02-01 | Randall et al. | Applicant |
| US2004/0043760(A1) | 2004-03-01 | Rosenfeld et al. | Applicant |
| US2004/0044493(A1) | 2004-03-01 | Coulthard | Applicant |
| US2004/0047498(A1) | 2004-03-01 | Mulet-Parada et al. | Applicant |
| US2004/0078219(A1) | 2004-04-01 | Kaylor et al. | Applicant |
| US2004/0078220(A1) | 2004-04-01 | Jackson | Applicant |
| US2004/0081441(A1) | 2004-04-01 | Sato et al. | Applicant |
| US2004/0106958(A1) | 2004-06-01 | Mathis et al. | Applicant |
| US2004/0122294(A1) | 2004-06-01 | Hatlestad et al. | Applicant |
| US2004/0122295(A1) | 2004-06-01 | Hatlestad et al. | Applicant |
| US2004/0122296(A1) | 2004-06-01 | Hatlestad et al. | Applicant |
| US2004/0122297(A1) | 2004-06-01 | Stahmann et al. | Applicant |
| US2004/0122333(A1) | 2004-06-01 | Nissila | Applicant |
| US2004/0122484(A1) | 2004-06-01 | Hatlestad et al. | Applicant |
| US2004/0122485(A1) | 2004-06-01 | Stahmann et al. | Applicant |
| US2004/0122486(A1) | 2004-06-01 | Stahmann et al. | Applicant |
| US2004/0122487(A1) | 2004-06-01 | Hatlestad et al. | Applicant |
| US2004/0125073(A1) | 2004-07-01 | Potter et al. | Applicant |
| US2004/0130628(A1) | 2004-07-01 | Stavely | Applicant |
| US2004/0135898(A1) | 2004-07-01 | Zador | Applicant |
| US2004/0146048(A1) | 2004-07-01 | Cotte | Applicant |
| US2004/0148340(A1) | 2004-07-01 | Cotte | Applicant |
| US2004/0148341(A1) | 2004-07-01 | Cotte | Applicant |
| US2004/0148342(A1) | 2004-07-01 | Cotte | Applicant |
| US2004/0148351(A1) | 2004-07-01 | Cotte | Applicant |
| US2004/0185821(A1) | 2004-09-01 | Yuasa | Applicant |
| US2004/0219910(A1) | 2004-11-01 | Beckers | Applicant |
| US2004/0225467(A1) | 2004-11-01 | Vock et al. | Applicant |
| US2004/0236500(A1) | 2004-11-01 | Choi et al. | Applicant |
| US2004/0247030(A1) | 2004-12-01 | Wiethoff | Applicant |
| US2004/0259494(A1) | 2004-12-01 | Mazar | Applicant |
| US2005/0015768(A1) | 2005-01-01 | Moore | Applicant |
| US2005/0027567(A1) | 2005-02-01 | Taha | Applicant |
| US2005/0033200(A1) | 2005-02-01 | Soehren et al. | Applicant |
| US2005/0038691(A1) | 2005-02-01 | Babu | Applicant |
| US2005/0048955(A1) | 2005-03-01 | Ring | Applicant |
| US2005/0078197(A1) | 2005-04-01 | Gonzales | Applicant |
| US2005/0079873(A1) | 2005-04-01 | Caspi et al. | Applicant |
| US2005/0101841(A9) | 2005-05-01 | Kaylor et al. | Applicant |
| US2005/0102167(A1) | 2005-05-01 | Kapoor | Applicant |
| US2005/0107944(A1) | 2005-05-01 | Hovestadt et al. | Applicant |
| US2005/0113649(A1) | 2005-05-01 | Bergantino | Applicant |
| US2005/0113650(A1) | 2005-05-01 | Pacione et al. | Applicant |
| US2005/0131736(A1) | 2005-06-01 | Nelson et al. | Applicant |
| US2005/0146431(A1) | 2005-07-01 | Hastings et al. | Applicant |
| US2005/0157181(A1) | 2005-07-01 | Kawahara et al. | Applicant |
| US2005/0165719(A1) | 2005-07-01 | Greenspan et al. | Applicant |
| US2005/0168587(A1) | 2005-08-01 | Sato et al. | Applicant |
| US2005/0182824(A1) | 2005-08-01 | Cotte | Applicant |
| US2005/0183086(A1) | 2005-08-01 | Abe et al. | Applicant |
| US2005/0202934(A1) | 2005-09-01 | Olrik et al. | Applicant |
| US2005/0203430(A1) | 2005-09-01 | Williams et al. | Applicant |
| US2005/0210300(A1) | 2005-09-01 | Song et al. | Applicant |
| US2005/0212751(A1) | 2005-09-01 | Marvit et al. | Applicant |
| US2005/0212752(A1) | 2005-09-01 | Marvit et al. | Applicant |
| US2005/0212753(A1) | 2005-09-01 | Marvit et al. | Applicant |
| US2005/0212760(A1) | 2005-09-01 | Marvit et al. | Applicant |
| US2005/0222801(A1) | 2005-10-01 | Wulff et al. | Applicant |
| US2005/0232388(A1) | 2005-10-01 | Tsuji | Applicant |
| US2005/0232404(A1) | 2005-10-01 | Gaskill | Applicant |
| US2005/0234676(A1) | 2005-10-01 | Shibayama | Applicant |
| US2005/0235058(A1) | 2005-10-01 | Rackus et al. | Applicant |
| US2005/0238132(A1) | 2005-10-01 | Tsuji | Applicant |
| US2005/0240375(A1) | 2005-10-01 | Sugai | Applicant |
| US2005/0243178(A1) | 2005-11-01 | McConica | Applicant |
| US2005/0245988(A1) | 2005-11-01 | Miesel | Applicant |
| US2005/0248718(A1) | 2005-11-01 | Howell et al. | Applicant |
| US2005/0256414(A1) | 2005-11-01 | Kettunen et al. | Applicant |
| US2005/0262237(A1) | 2005-11-01 | Fulton et al. | Applicant |
| US2005/0281289(A1) | 2005-12-01 | Huang et al. | Applicant |
| US2006/0017692(A1) | 2006-01-01 | Wehrenberg et al. | Applicant |
| US2006/0020177(A1) | 2006-01-01 | Seo et al. | Applicant |
| US2006/0029284(A1) | 2006-02-01 | Stewart | Applicant |
| US2006/0063980(A1) | 2006-03-01 | Hwang et al. | Applicant |
| US2006/0064276(A1) | 2006-03-01 | Ren et al. | Applicant |
| US2006/0080551(A1) | 2006-04-01 | Mantyjarvi et al. | Applicant |
| US2006/0090088(A1) | 2006-04-01 | Choi et al. | Applicant |
| US2006/0098097(A1) | 2006-05-01 | Wach et al. | Applicant |
| US2006/0100546(A1) | 2006-05-01 | Silk | Applicant |
| US2006/0109113(A1) | 2006-05-01 | Reyes et al. | Applicant |
| US2006/0136173(A1) | 2006-06-01 | Case et al. | Applicant |
| US2006/0149516(A1) | 2006-07-01 | Bond et al. | Applicant |
| US2006/0154642(A1) | 2006-07-01 | Scannell, Jr. | Applicant |
| US2006/0161377(A1) | 2006-07-01 | Rakkola et al. | Applicant |
| US2006/0161459(A9) | 2006-07-01 | Rosenfeld et al. | Applicant |
| US2006/0167387(A1) | 2006-07-01 | Buchholz et al. | Applicant |
| US2006/0167647(A1) | 2006-07-01 | Krumm et al. | Applicant |
| US2006/0167943(A1) | 2006-07-01 | Rosenberg | Applicant |
| US2006/0172706(A1) | 2006-08-01 | Griffin et al. | Applicant |
| US2006/0204214(A1) | 2006-09-01 | Shah et al. | Applicant |
| US2006/0206258(A1) | 2006-09-01 | Brooks | Applicant |
| US2006/0223547(A1) | 2006-10-01 | Chin et al. | Applicant |
| US2006/0249683(A1) | 2006-11-01 | Goldberg et al. | Applicant |
| US2006/0256082(A1) | 2006-11-01 | Cho et al. | Applicant |
| US2006/0257042(A1) | 2006-11-01 | Ofek et al. | Applicant |
| US2006/0259268(A1) | 2006-11-01 | Vock et al. | Applicant |
| US2006/0284979(A1) | 2006-12-01 | Clarkson | Applicant |
| US2006/0288781(A1) | 2006-12-01 | Daumer et al. | Applicant |
| US2006/0289819(A1) | 2006-12-01 | Parsons et al. | Applicant |
| US2007/0004451(A1) | 2007-01-01 | Anderson | Applicant |
| US2007/0005988(A1) | 2007-01-01 | Zhang et al. | Applicant |
| US2007/0017136(A1) | 2007-01-01 | Mosher et al. | Applicant |
| US2007/0024441(A1) | 2007-02-01 | Kahn et al. | Applicant |
| US2007/0037605(A1) | 2007-02-01 | Logan | Applicant |
| US2007/0038364(A1) | 2007-02-01 | Lee et al. | Applicant |
| US2007/0040892(A1) | 2007-02-01 | Aoki et al. | Applicant |
| US2007/0050157(A1) | 2007-03-01 | Kahn et al. | Applicant |
| US2007/0061105(A1) | 2007-03-01 | Darley et al. | Applicant |
| US2007/0063850(A1) | 2007-03-01 | Devaul et al. | Applicant |
| US2007/0067094(A1) | 2007-03-01 | Park et al. | Applicant |
| US2007/0073482(A1) | 2007-03-01 | Churchill et al. | Applicant |
| US2007/0075127(A1) | 2007-04-01 | Rosenberg | Applicant |
| US2007/0075965(A1) | 2007-04-01 | Huppi et al. | Applicant |
| US2007/0082789(A1) | 2007-04-01 | Nissila et al. | Applicant |
| US2007/0106991(A1) | 2007-05-01 | Yoo | Applicant |
| US2007/0125852(A1) | 2007-06-01 | Rosenberg | Applicant |
| US2007/0130582(A1) | 2007-06-01 | Chang et al. | Applicant |
| US2007/0142715(A1) | 2007-06-01 | Banet et al. | Applicant |
| US2007/0145680(A1) | 2007-06-01 | Rosenberg | Applicant |
| US2007/0150136(A1) | 2007-06-01 | Doll et al. | Applicant |
| US2007/0156364(A1) | 2007-07-01 | Rothkopf | Applicant |
| US2007/0161410(A1) | 2007-07-01 | Huang et al. | Applicant |
| US2007/0169126(A1) | 2007-07-01 | Todoroki et al. | Applicant |
| US2007/0176898(A1) | 2007-08-01 | Suh | Applicant |
| US2007/0192483(A1) | 2007-08-01 | Rezvani et al. | Applicant |
| US2007/0208531(A1) | 2007-09-01 | Darley et al. | Applicant |
| US2007/0213126(A1) | 2007-09-01 | Deutsch et al. | Applicant |
| US2007/0239399(A1) | 2007-10-01 | Shyenblat et al. | Applicant |
| US2007/0250261(A1) | 2007-10-01 | Soehren | Applicant |
| US2007/0259685(A1) | 2007-11-01 | Engblom et al. | Applicant |
| US2007/0259716(A1) | 2007-11-01 | Mattice et al. | Applicant |
| US2007/0259717(A1) | 2007-11-01 | Mattice et al. | Applicant |
| US2007/0260418(A1) | 2007-11-01 | Ladetto et al. | Applicant |
| US2007/0260482(A1) | 2007-11-01 | Nurmela et al. | Applicant |
| US2007/0263995(A1) | 2007-11-01 | Park et al. | Applicant |
| US2008/0005738(A1) | 2008-01-01 | Imai et al. | Applicant |
| US2008/0030586(A1) | 2008-02-01 | Helbing et al. | Applicant |
| US2008/0046888(A1) | 2008-02-01 | Appaji | Applicant |
| US2008/0052716(A1) | 2008-02-01 | Theurer | Applicant |
| US2008/0072014(A1) | 2008-03-01 | Krishnan et al. | Applicant |
| US2008/0082994(A1) | 2008-04-01 | Ito et al. | Applicant |
| US2008/0113689(A1) | 2008-05-01 | Bailey | Applicant |
| US2008/0140338(A1) | 2008-06-01 | No et al. | Applicant |
| US2008/0153671(A1) | 2008-06-01 | Ogg et al. | Applicant |
| US2008/0165022(A1) | 2008-07-01 | Herz et al. | Applicant |
| US2008/0168361(A1) | 2008-07-01 | Forstall et al. | Applicant |
| US2008/0171918(A1) | 2008-07-01 | Teller et al. | Applicant |
| US2008/0214358(A1) | 2008-09-01 | Ogg et al. | Applicant |
| US2008/0231713(A1) | 2008-09-01 | Florea et al. | Applicant |
| US2008/0231714(A1) | 2008-09-01 | Estevez et al. | Applicant |
| US2008/0232604(A1) | 2008-09-01 | Dufresne et al. | Applicant |
| US2008/0303681(A1) | 2008-12-01 | Herz et al. | Applicant |
| US2008/0311929(A1) | 2008-12-01 | Carro et al. | Applicant |
| US2009/0017880(A1) | 2009-01-01 | Moore et al. | Applicant |
| US2009/0031319(A1) | 2009-01-01 | Fecioru | Applicant |
| US2009/0043531(A1) | 2009-02-01 | Kahn et al. | Applicant |
| US2009/0047645(A1) | 2009-02-01 | Dibenedetto et al. | Applicant |
| US2009/0067826(A1) | 2009-03-01 | Shinohara et al. | Applicant |
| US2009/0088204(A1) | 2009-04-01 | Culbert et al. | Applicant |
| US2009/0099668(A1) | 2009-04-01 | Lehman et al. | Applicant |
| US2009/0124348(A1) | 2009-05-01 | Yoseloff et al. | Applicant |
| US2009/0128448(A1) | 2009-05-01 | Riechel | Applicant |
| US2009/0174782(A1) | 2009-07-01 | Kahn et al. | Applicant |
| US2009/0213002(A1) | 2009-08-01 | Rani et al. | Applicant |
| US2009/0234614(A1) | 2009-09-01 | Kahn et al. | Applicant |
| US2009/0274317(A1) | 2009-11-01 | Kahn et al. | Applicant |
| US2009/0296951(A1) | 2009-12-01 | De Haan | Applicant |
| US2009/0319221(A1) | 2009-12-01 | Kahn et al. | Applicant |
| US2010/0056872(A1) | 2010-03-01 | Kahn et al. | Applicant |
| US2010/0057398(A1) | 2010-03-01 | Darley et al. | Applicant |
| EP1104143 | 2001-05-01 | Applicant | |
| EP833537 | 2002-07-01 | Applicant | |
| JP7020547(A) | 1995-01-01 | Applicant | |
| WO99/22338 | 1999-05-01 | Applicant | |
| WO/63874 | 2000-10-01 | Applicant | |
| WO2/088926 | 2002-11-01 | Applicant |
Non-Patent Literature (42)
- International Search Report and Written Opinion, PCT/US2009/044914, mailed Aug. 27, 2009, 8 pgs.Applicant
- Bourzac, Katherine “Wearable Health Reports,” Technology Review, Feb. 28, 2006, http://www.techreview.com/printer—friendly—article—aspx?id+16431, Mar. 22, 2007, 3 pages.Applicant
- Cheng, et al, “Periodic Human Motion Description for Sports Video Databases,” Proceedings of the Pattern Recognition, 2004, 8 pages.Applicant
- Dao, Ricardo, “Inclination Sensing with Thermal Accelerometers”, MEMSIC, May 2002, 3 pages.Applicant
- Lee, Seon-Woo, et al., “Recognition of Walking Behaviors for Pedestrian Navigation,” ATR Media Integration & Communications Research Laboratories, Kyoto, Japan, 4 pages.Applicant
- Margaria, Rodolfo, “Biomechanics and Energetics of Muscular Exercise”, Chapter 3, Oxford: Clarendon Press 1976, pp. 105-125.Applicant
- Ormoneit, D., et al, “Learning and Tracking Cyclic Human Motion” Proceedings of NIPS 2000 (Neural Information Processing Systems), 2000, Denver, CO, pp. 894-900.Applicant
- PCT/US2009/044914, International Preliminary Report on Patentability, mailed Mar. 29, 2011, 14 pages.Applicant
- Weinberg, Harvey, “MEMS Motion Sensors Boost Handset Reliability” Jun. 2006, http://www.mwrf.com/Articles/Print.cfm?ArticleID=12740, Feb. 21, 2007, 4 pages.Applicant
- “Access and Terminals (AT); Multimedia Message Service (MMS) for PSTN/ISDN; Multimedia Message Communication Between a Fixed Network Multimedia Message Terminal Equipment and a Multimedia Message Service Centre,” ETSI AT-F Rapporteur Meeting, Feb. 4-6, 2003, Gothenburg, DES/AT-030023 V0.0.1 (Mar. 2003).Applicant
- “Decrease Processor Power Consumption using a CoolRunner CPLD,” XILINX XAPP347 (v1.0), May 16, 2001, 9 pages.Applicant
- “Sensor Fusion,” <www.u-dynamics.com>, accessed Aug. 29, 2008, 2 pages.Applicant
- Anderson, Ian, et al, “Shakra: Tracking and Sharing Daily Activity Levels with Unaugmented Mobile Phones,” Mobile Netw Appl, Aug. 3, 2007, pp. 185-199.Applicant
- Ang, Wei Tech, et al, “Zero Phase Filtering for Active Compensation of Period Physiological Motion,” Proc 1st IEEE / RAS-EMBS International Conference on Biomedical Robotics and Biomechatronics, Feb. 20-22, 2006, pp. 182-187.Applicant
- Aylward, Ryan, et al, “Sensemble: A Wireless, Compact, Multi-User Sensor System for Interactive Dance,” International Conference on New Interfaces for Musical Expression (NIME06), Jun. 4-8, 2006, pp. 134-139.Applicant
- Baca, Arnold, et al, “Rapid Feedback Systems for Elite Sports Training,” IEEE Pervasive Computing, Oct.-Dec. 2006, pp. 70-76.Applicant
- Bakhru, Kesh, “A Seamless Tracking Solution for Indoor and Outdoor Position Location,” IEEE 16th International Symposium on Personal, Indoor, and Mobile Radio Communications, 2005, pp. 2029-2033.Applicant
- Bliley, Kara E, et al, “A Miniaturized Low Power Personal Motion Analysis Logger Utilizing MEMS Accelerometers and Low Power Microcontroller,” IEEE EMBS Special Topic Conference on Microtechnologies in Medicine and Biology, May 12-15, 2005, pp. 92-93.Applicant
- Fang, Lei, et al, “Design of a Wireless Assisted Pedestrian Dead Reckoning System—The NavMote Experience,” IEEE Transactions on Instrumentation and Measurement, vol. 54, No. 6, Dec. 2005, pp. 2342-2358.Applicant
- Healey, Jennifer, et al, “Wearable Wellness Monitoring Using ECG and Accelerometer Data,” IEEE Int. Symposium on Wearable Computers (ISWC'05), 2005, 2 pages.Applicant
- Hemmes, Jeffrey, et al, “Lessons Learned Building TeamTrak: An Urban/Outdoor Mobile Testbed,” 2007 IEEE Int. Conf. on Wireless Algorithms, Aug. 1-3, 2007, pp. 219-224.Applicant
- Jones, L, et al, “Wireless Physiological Sensor System for Ambulatory Use,” <http://ieeexplore.ieee.org/xpl/freeabs—all.jsp?tp=&arnumber=1612917&isnumber=33861>, Apr. 3-5, 2006.Applicant
- Jovanov, Emil, et al, “A Wireless Body Area Network of Intelligent Motion Sensors for Computer Assisted Physical Rehabilitation,” Journal of NeuroEngineering and Rehabilitation, Mar. 2005, 10 pages.Applicant
- Kalpaxis, Alex, “Wireless Temporal-Spatial Human Mobility Analysis Using Real-Time Three Dimensional Acceleration Data,” IEEE Intl. Multi-Conf. on Computing in Global IT (ICCGI'07), 2007, 7 pages.Applicant
- Lee, Hyunseok, et al, A Dual Processor Solution for the MAC Layer of a Software Defined Radio Terminal, Advanced Computer Architecture Laboratory, University of Michigan, Apr. 14, 2009, 25 pages.Applicant
- Milenkovic, Milena, et al, “An Accelerometer-Based Physical Rehabilitation System,” IEEE SouthEastern Symposium on System Theory, 2002, pp. 57-60.Applicant
- Mizell, David, “Using Gravity to Estimate Accelerometer Orientation”, Seventh IEEE International Symposium on Wearable Computers, 2003, 2 pages.Applicant
- Otto, Chris, et al, “System Architecture of a Wireless Body Area Sensor Network for Ubiquitous Health Monitoring,” Journal of Mobile Multimedia, vol. 1, No. 4, 2006, pp. 307-326.Applicant
- Park, Chulsung, et al, “Eco: An Ultra-Compact Low-Power Wireless Sensor Node for Real-Time Motion Monitoring,” IEEE Int. Symp. on Information Processing in Sensor Networks, 2005, pp. 398-403.Applicant
- Ricoh, “Advanced Digital Technology Changes Creativity,” <http://www.ricoh.com/r—dc/gx/gx200/features2.html>, Accessed May 12, 2011, 4 pages.Applicant
- Shen, Chien-Lung, et al, “Wearable Band Using a Fabric-Based Sensor for Exercise ECG Monitoring,” IEEE Int. Symp. on Wearable Computers, 2006, 2 pages.Applicant
- Tapia, Emmanuel Munguia, et al, “Real-Time Recognition of Physical Activities and Their Intensities Using Wireless Accelerometers and a Heart Rate Monitor,” IEEE Cont. on Wearable Computers, Oct. 2007, 4 pages.Applicant
- Tech, Ang Wei, “Real-time Image Stabilizer,” <http://www.mae.ntu.edu.sg/Aboutmae/Divisions/RRC—BIOROBOTICS/Pages/rtimage.aspx>, Mar. 23, 2009, 3 pages.Applicant
- Wang, Shu, et al, “Location Based Services for Mobiles: Technologies and Standards, LG Electronics MobileComm,” IEEE ICC 2008, Beijing, pp. 1-66 (part 1 of 3).Applicant
- Wang, Shu, et al, “Location Based Services for Mobiles: Technologies and Standards, LG Electronics MobileComm,” IEEE ICC 2008, Beijing, pp. 67-92 (part 2 of 3).Applicant
- Wang, Shu, et al, “Location Based Services for Mobiles: Technologies and Standards, LG Electronics MobileComm,” IEEE ICC 2008, Beijing, pp. 93-123 (part 3 of 3).Applicant
- Weckesser, P, et al, “Multiple Sensorprocessing for High-Precision Navigation and Environmental Modeling with a Mobile Robot,” IEEE, 1995, pp. 453-458.Applicant
- Weinberg, Harvey, “Minimizing Power Consumption of iMEMS® Accelerometers,” Analog Devices, <http://www.analog.com/static/imported-files/application—notes/5935151853362884599AN601.pdf>, 2002, 5 pages.Applicant
- Wixted, Andrew J, et al, “Measurement of Energy Expenditure in Elite Athletes Using MEMS-Based Triaxial Accelerometers,” IEEE Sensors Journal, vol. 7, No. 4, Apr. 2007, pp. 481-488.Applicant
- Wu, Winston H, et al, “Context-Aware Sensing of Physiological Signals,” IEEE Int. Conf. on Engineering for Medicine and Biology, Aug. 23-26, 2007, pp. 5271-5275.Applicant
- Yoo, Chang-Sun, et al, “Low Cost GPS/INS Sensor Fusion System for UAV Navigation,” IEEE, 2003, 9 pages.Applicant
- Zypad WL 1100 Wearable Computer, http://www.eurotech.fi/products/manuals/Zypad%20WL%/201100—sf.pdf, Jan. 16, 2008, 2 pgs.Applicant