US 9,646,137 B2Grant
Systems and methods for providing audio and visual cues via a portable electronic device
Issue Date:2017-05-09
•20 Claims
•27 Drawing Sheets
Abstract
Methods and systems for providing a lifestyle companion system are provided. The lifestyle companion system can provide a platform to conduct a user interview. Based on the user interview responses, the system can suggest activities, references, and/or plug-in modules. During performance of activities, the system can provide audio and/or visual cues related to the activities and collect data indicative of the user's performance. Based on the collected data, the system can dynamically adapt the user's goals and/or activities the user is performing or will perform. In some embodiments of the present invention, the lifestyle companion system of the present invention can be applied to fitness, nutrition, and/or medical modules. The system also can be used to facilitate synchronous group activities.
Metadata
Assignee
- APPLE INC.
Inventors
- Glenn Gregory Gilley
- Sarah A. Brody
- Randall Hayes Ubillos
- Mihnea Calin Pacurariu
- Jesse Lee Dorogusker
- Robert Edward Borchers
- Donald Ginsburg
Application Information
Application Number:US 13/187,140
Filing Date:2011-07-20
Priority Date:2006-09-21
Art Unit:2171
Classifications
IPC:
G06F11/30G06F15/00A63B71/00G06F19/00
Patent Drawings (27 sheets)
Description
Cross-Reference to Related Applications
[0001] This application is a divisional of U.S. patent application Publication No. 2008-0077620 to Gilley et al., filed on Mar. 27, 2007, which claims priority to U.S. Provisional Patent Application No. 60/846,414 to Gilley et al., filed on Sep. 21, 2006 (referred to below as “the incorporated provisional patent application”), the entirety of which are incorporated herein by reference.
[0002] This also is related to:
[0003] U.S. patent application Publication No. 2008-0086318 to Gilley et al., filed on Mar. 27, 2007, entitled “LIFESTYLE COMPANION SYSTEM,” (referred to herein as “the incorporated LIFESTYLE COMPANION document”), the entirety of which is incorporated herein by reference;
[0004] U.S. patent application Publication No. 2008-0076637 to Gilley et al., filed on Mar. 27, 2007, entitled “DYNAMICALLY ADAPTIVE SCHEDULING SYSTEM,” (referred to herein as “the incorporated ADAPTIVE SCHEDULING SYSTEM document”), the entirety of which is incorporated herein by reference;
[0005] U.S. patent application Publication No. 2008-0077619 to Gilley et al., filed on Mar. 27, 2007, entitled “SYSTEMS AND METHODS FOR FACILITATING GROUP ACTIVITIES,” (referred to herein as “the incorporated GROUP ACTIVITIES document”), the entirety of which is incorporated herein by reference;
[0006] U.S. patent application Publication No. 2008-0077881 to Gilley et al., filed on Mar. 27, 2007, entitled “VARIABLE I/O INTERFACE FOR PORTABLE MEDIA DEVICE,” (referred to herein as “the incorporated VARIABLE I/O document”), the entirety of which is incorporated herein by reference;
[0007] U.S. patent application Publication No. 2008-0077489 to Gilley et al., filed on Mar. 27, 2007, entitled “REWARDS SYSTEMS,” (referred to herein as “the incorporated REWARDS SYSTEMS document”), the entirety of which is incorporated herein by reference; and
[0008] U.S. patent application Publication No. 2008-0076972 to Dorogusker et al., filed on Mar. 27, 2007, entitled “INTEGRATED SENSORS FOR TRACKING PERFORMANCE METRICS,” (referred to herein as “the incorporated INTEGRATED SENSORS document”), the entirety of which is incorporated herein by reference.
Background of the Invention
[0009] The present invention can generally relate to a lifestyle companion system. More particularly, the present invention can relate to a system that coordinates multiple corridors of experiences in a person's life.
[0010] Conventional systems typically focus only on one aspect of a person's experiences. Conventional systems typically do not intelligently integrate multiple aspects of a person's experiences. For example, a typical piece of software may be implemented to measure a user's heart rate during an exercise routine. But, that software typically cannot coordinate the heart rate information to the user's general fitness goals, nor intelligently use that information to assist the user in reaching his goals.
[0011] Accordingly, it would be desirable to provide a system that can bridge numerous corridors of experiences in a person's life and coordinate them for maximum efficiency and enjoyment.
Summary of the Invention
[0012] In accordance with one embodiment of the present invention, a lifestyle companion system can be provided for coordinating multiple corridors of a user's life. The lifestyle companion system can include devices and methods for providing a platform for conducting user interviews, suggesting activities and references based on interview responses, providing a platform for a user to schedule activities, collecting data about a user during performance of activities or throughout the user's day, and/or providing progress reports. The method also can include assigning user category levels (e.g., activity levels) based on interview responses. In some embodiments of the present invention, the lifestyle companion system can coordinate a user's fitness, nutrition, and medical experiences.
[0013] The lifestyle companion system can integrate user-selectable plug-in modules that are focused on specialized topics. For example, plug-in modules can be specialized for particular periods in a child's development, students, expectant parents, new parents, seniors, specific sports enthusiasts, food connoisseurs, geographical regions, health conditions, holidays, etc. Each module can have coordinating questionnaires, suggested activities, suggested references, instructions, logging tools, audiobooks, videos, podcasts and other types of activities or information tailored for the specialty of the module.
[0014] In one embodiment of the present invention, user data can be collected using a tracking device that stores the data itself or transmits the data to a local server, a central server, a server dedicated to storage of user profile information, or any combination thereof. Tracking devices can include passive tracking devices that require the user and/or another authorized entity to manually enter user data, active tracking devices having sensors that automatically gather data about the user and/or activities performed by the user, or any combination thereof. In one embodiment of the present invention, sensors of the active tracking devices can be attached to the user (e.g., in clothing or accessories) or disposed in equipment used by the user.
[0015] In one embodiment of the present invention, the tracking device also can provide a user interface for the user to, e.g., access the user's profile. Information stored in the user's profile can include medical information, the user's goals and progress towards the goals, reference information, activity information, the user's responses to the user interview, and any other information related to the user's interaction with the lifestyle companion system. Activity information can include, for example, media files and adjustable parameters associated with an activity.
[0016] In one embodiment of the present invention, media (e.g., audio and/or visual) cues can be provided to the user during the user's performance of activities. Audio and visual cues can include, for example, instructions for the activity, feedback on a user's progress, motivational feedback, and/or entertainment information. The media cues can be played at predetermined points during an activity, based on performance metrics, or at the initiation of the user. Visual cues can include graphical information (e.g., text, still images, and/or videos).
[0017] In one embodiment of the present invention, a user's short-term and/or long-term goals and activities can be dynamically adapted in response to data collected about the user. The data can include that collected during a user's performance of an activity (e.g., performance metrics), and/or collected about the user throughout the user's day.
[0018] In one embodiment of the present invention, the lifestyle companion system can be used to coordinate group activities. Each person in the group can be provided with a tracking device to facilitate their performance of predetermined group activities. A common activity file or complementary activity files can be loaded onto each of the tracking devices and, in one embodiment of the present invention, synchronized by a synchronization signal. Audio and visual cues can be provided to the users in response to each user's own performance metrics or the performance metrics of other group members. Data can be collected about each user's performance, individually and as a group. Responsive to such data, the lifestyle companions system can adjust current or future activities of each user and/or the group.
Brief Description of the Drawings
[0019] The above and other advantages of the present invention will be apparent upon consideration of the following detailed description, taken in conjunction with accompanying drawings, in which like reference characters refer to like parts throughout, and in which:
[0020] FIG. 1 illustrates a flowchart for implementing a lifestyle companion system in accordance with one embodiment of the present invention;
[0021] FIG. 2 illustrates hardware for the lifestyle companion system in accordance with one embodiment of the present invention;
[0022] FIG. 3 shows an illustrative graphic user interface of a fitness welcome screen in accordance with one embodiment of the present invention;
[0023] FIG. 4 shows an illustrative graphic user interface of a current fitness level screen in accordance with one embodiment of the present invention;
[0024] FIG. 5 shows an illustrative graphic user interface of a fitness interest screen in accordance with one embodiment of the present invention;
[0025] FIG. 6 shows an illustrative graphic user interface of a fitness goals screen in accordance with one embodiment of the present invention;
[0026] FIG. 7 shows an illustrative graphic user interface of a fitness schedule screen in accordance with one embodiment of the present invention;
[0027] FIG. 8 shows an illustrative graphic user interface of a fitness summary screen in accordance with one embodiment of the present invention;
[0028] FIG. 9 shows an illustrative graphic user interface of a health history screen in accordance with one embodiment of the present invention;
[0029] FIG. 10 shows an illustrative graphic user interface of a workout review screen in accordance with one embodiment of the present invention;
[0030] FIG. 11 shows an illustrative graphic user interface of an alternative workout review screen with a repetition feature in accordance with one embodiment of the present invention;
[0031] FIG. 12 shows an illustrative graphic user interface of a user workout composition screen in accordance with one embodiment of the present invention;
[0032] FIG. 13 shows an illustrative graphic user interface of a user workout composition screen having a media playlist menu in accordance with one embodiment of the present invention;
[0033] FIGS. 14-21 show illustrative graphic user interfaces during playback of a workout compilation on a portable electronic device in accordance with one embodiment of the present invention;
[0034] FIG. 22 shows an illustrative fitness system for facilitating collection of data about a user's fitness performance and adaptation of a fitness activity based on the collected data in accordance with one embodiment of the present invention;
[0035] FIG. 23A shows an illustrative progress report in accordance with one embodiment of the present invention;
[0036] FIG. 23B shows a portion of the illustrative progress report of FIG. 23A after it is adapted based on the user's performance metrics in accordance with one embodiment of the present invention;
[0037] FIG. 24 shows an illustrative flow chart for facilitating synchronous group activities in accordance with one embodiment of the present invention; and
[0038] FIG. 25 shows an illustrative flow chart for implementing a nutrition program with the lifestyle companion system in accordance with one embodiment of the present invention.
Detailed Description of the Invention
[0039] The present invention can include a lifestyle companion system for coordinating multiple corridors of a user's life. The lifestyle companion system can intelligently recommend lifestyle choices and activities based on information and data collected about the user. As described in greater detail below with respect to FIG. 1 , the lifestyle companion system can provide a platform for conducting user interviews, suggest activities and references based on interview responses, provide a platform for a user to schedule activities, collect data about a user during performance of activities or throughout the user's day, and/or provide progress reports. The system also can assign user category levels (e.g., activity levels) based on interview responses. Responsive to the data collected about the user, the lifestyle companion system can adjust or adapt a user's goals or activities.
[0040] FIG. 1 illustrates a flowchart for implementing a lifestyle companion system in accordance with one embodiment of the present invention. In step 100, the lifestyle companion system can provide a platform for conducting user interviews.
[0041] In one embodiment of the present invention, the lifestyle companion system can request that the user input information about the user's physical and mental health. Physical health information can include information about the medications the user is taking, the user's physical limitations, illnesses, medical conditions (e.g., pregnancy), and/or risk factors. A health interview also can address nutrition, weight, breathing metrics (e.g., breaths per minute or some other related metric), relaxation and/or sleep. Interview questions about nutrition and weight can address weight goals and the user's current nutritional habits. Interview questions about illnesses and medical conditions can address, e.g., sexually transmitted diseases, allergies and sinus problems, asthma, arthritis, conditions related to the brain and nervous system, cancer, cerebral palsy, chronic diseases, chronic pain, diabetes, fatigue, fibromyalgia, headaches and migraines, heart disease and cardiovascular issues, infections, joints and muscle problems, liver conditions, multiple sclerosis, Parkinson's disease, respiratory conditions, surgery recovery, or any other medical condition.
[0042] Interview topics also can be gender or age specific. A women's health interview can address, for example, menopause, pregnancy, fertility, etc. A men's health interview can address, e.g., fertility, impotence, prostate concerns, etc. A children's health interview can be divided into sub-categories, e.g., issues related to infants and toddlers, children, and teenagers.
[0043] A mental health interview can address, for example, anxiety, caregiving and coping, depression, and/or drug & alcohol addiction.
[0044] The lifestyle companion system also can interview the user about non-health related topics, e.g., spirituality/religion, identity (e.g., sense of belonging), relationships, career, financial condition, environment, hobbies, interests, other personal information, and goals regarding the same. An identity (sense of belonging) interview may address, for example, the organizations to which the user belongs socially and/or professionally. A relationships interview can address, for example, the marital and/or familial status of the user. The relationship interview also can address the quality of the user's relationships with his/her family. A career interview can address, for example, the length of time the user has worked in the present job, the user's current occupational position, and/or the user's level of enjoyment of the user's occupation. A finance interview can address, for example, net wealth, credit situation, spending habits, etc. An environment interview can address, for example, the user's home, office, clothing, transportation, fitness memberships, access to exercise equipment, etc.
[0045] Once the user completes the user interview provided in step 100, the lifestyle companion system can establish a user profile for the user based on the user's interview responses. As the user's lifestyle changes (e.g., the user's goals change or the user's familial status changes), this profile can be updated by the user at a later date by changing responses to the interview questions. In response to updates to the user profile, the lifestyle companion system can alter the activities, references, and plug-in modules suggested (e.g., as described below with respect to step 104) and/or adapt the user's goals or scheduled activities (e.g., as described below with respect to step 112).
[0046] The user profile also can store user-associated information generated by the lifestyle companion system in later steps. For example, the user profile can store information related to categories to which the user is assigned in step 102, activities and references suggested by the lifestyle companion system in step 104, activities created by the user in step 105, data collected about the user in step 110, and/or rewards distributed to the user in step 111. The user profile can store information about activities in activity files. In one embodiment, an activity file can include, for example, adjustable parameters associated with an activity, media files associated with the activity for providing media cues to the user, and any other information related to the activity.
[0047] In step 101, the lifestyle companion system can supplement the user's profile with data from profiles of user-authorized entities (e.g., relatives, doctor, therapist, fitness trainer, etc.). For example, the user profile can be supplemented with data from the profiles of family members so that the lifestyle companion system can suggest medical activities (e.g., exams) and references in step 104 based on a more accurate profile of potential genetic health risks. The user's profile also can be supplemented with data from the profiles of workout partners so that the lifestyle companion system can suggest, for example, fitness activities that are appropriate for the user and his workout partners. The user's profile also can be supplemented with the profiles of dining partners so that the lifestyle companion system can suggest, for example, nutritional activities (e.g., recipes, restaurants, etc.) that are appropriate for the user and his dining partners. Illustrative nutrition-based applications of the present invention are described in greater detail with respect to FIG. 25 .
[0048] As used herein, an entity is authorized by the user when the user has granted the entity permission to obtain information from the user's profile or transfer information into the user's profile. For example, user-authorized entities can include a family member, employer, physical therapist, psychologist, doctor, physical trainer, coach, etc.
[0049] In step 102, the lifestyle companion system can assign or associate certain categories to the user profile based on the user's responses to the interview. For example, based on the user's responses to fitness questions, the lifestyle companion system can assign an activity level to the user's profile, e.g., beginner, intermediate, or advanced. Based on the assigned activity level, the lifestyle companion system can later suggest fitness activities in step 104 that are more suited to the fitness category assigned to the user profile, and, thus, more suited to the capabilities of the user.
[0050] In step 104, the lifestyle companion system can suggest activities for the user based on the user's responses to the user interview, either directly or indirectly (e.g., based on the category level assigned in step 102). For example, if a user provides information about alcohol addiction in the interview, the lifestyle companion system can limit suggestions to activities that may be alcohol-related and/or provide suggestions to alternatives to alcohol-related activities. If a user indicates in the interview that he/she is a single parent, the lifestyle companion system can provide suggestions of activities to accommodate these circumstances, such as more nutritious “eating out” options instead of time-consuming home food preparation. If a user indicates in the interview that he is diabetic, the lifestyle companion system can suggest food choices that accommodate a low-sugar, low-carbohydrate diet. If a user inputs into the system that he/she has an asthma condition, the system can suggest hobbies or jobs in arid and pollution-free areas.
[0051] In step 104, the lifestyle companion system also can suggest references for the user to consult based directly or indirectly on the user's interview responses. For example, the lifestyle companion system can provide information and/or website links to specialized counselors, support groups, or specialized organizations that are tailored to the conditions indicated by the user's interview responses.
[0052] The lifestyle companion system can provide access to one or more of the suggested references via a personal webpage customized for the user. The personal webpage also can include a journal, blog, or secure data vault in which the user can store highly sensitive data that can be accessed, e.g., via the internet by any entity authorized by the user. The secure data vault can be compartmentalized by topics, e.g., medical and alternative therapy records, family health conditions, financial information, travel documents, etc. The personal webpage also can permit a user to store any other information in a data repository.
[0053] In step 104, the lifestyle companion system also can suggest plug-in modules based directly or indirectly on the user's interview responses. Plug-in modules can contain information tailored for a specialized topic. For example, the modules can be specialized for particular periods in a child's development, students, expectant parents, new parents, seniors, specific sports enthusiasts, food connoisseurs, geographical regions, health conditions, themed or seasonal projects, mental wellness, life satisfaction assessment and goal setting, etc.
[0054] In one embodiment of the present invention, plug-in modules can be co-branded by third parties (e.g., content partners). For example, for modules tailored to food connoisseurs, the information contained in the module can be provided and co-branded by the Food Network.
[0055] Each module can have coordinating questionnaires, suggested activities, suggested references, instructions, logging tools, podcasts and other types of activities or information tailored for the specialty of the module.
[0056] The suggested modules can be offered to a user free of charge or for purchase, e.g., from a media management and distribution server similar to that offered under the trademark iTunes™ by Apple Inc. of Cupertino, Calif.
[0057] Once a user selects desired plug-in modules, the modules can be installed into a user's lifestyle companion system. For those modules containing specialized questionnaires, the lifestyle companion system can return to step 100 to continue the user interview using the specialized questionnaire.
[0058] The lifestyle companion system also can be pre-loaded with one or more plug-in modules, permit a user to search for and download specific modules from a database, permit a user to directly identify and download a plug-in module offered by a user-authorized entity, and/or permit user-authorized entities to download modules into the user profile.
[0059] In one embodiment of the present invention, in step 104, the lifestyle companion system can provide a selection of activities, references, and plug-in modules from which the user can choose. That selection can themselves be selected from a predetermined list of activities, references, and plug-in modules provided or pre-approved by the user or a user-authorized entity.
[0060] In one embodiment of the present invention, the lifestyle companion system also can suggest activities, references, and/or plug-in modules based on other information stored in the user's profile, e.g., data the system collects about the user in step 110. For example, if the lifestyle companion system collects data about the user that indicates the user is in poor physical shape, the lifestyle companion can suggest less physically-active activities for the user in step 104, irrespective of the level of fitness the user indicates in the user interview of step 100. The lifestyle companion system also can suggest activities that a user has not performed over a predetermined amount of time or that a user has not performed satisfactorily, as indicated by the data previously collected in accordance with step 110.
[0061] In one embodiment of the present invention, the lifestyle companion system can suggest activities based on a pseudo-random protocol. The lifestyle companion system can randomly suggest activities within a certain category. For example, the system can randomly suggest fitness activities adapted to the same muscle group or type of exercise.
[0062] In one embodiment of the present invention, the lifestyle companion system can suggest activities based on the frequency in which the user has performed the activities. For example, the system can suggest activities that the user has not performed over a predetermined amount of time. The system also can suggest activities that the user frequently schedules based on the assumption that the user enjoys those activities more.
[0063] In one embodiment of the present invention, the lifestyle companion system can select suggested activities, references, and plug-in modules from a database. The database can be stored, for example, in a central server, local server, or a portable electronic device, as discussed in greater detail below with respect to FIG. 2 .
[0064] In step 105, the lifestyle companion system can provide a platform for the user to create activities. This can include providing a platform for the user to download activities created by a third party into the user's profile. Third parties can include user-authorized entities (e.g., the user's doctor, personal fitness trainer, physical therapist, friend, family member, real estate agent, financial advisor, etc.) and/or companies that offer themed and/or branded activities or compilations thereof (e.g., gyms, television networks, diet plans, nutrition-oriented companies, etc.). The third party activities can be can be offered to a user free of charge or for purchase, e.g., from a media management and distribution server similar to iTunes™.
[0065] Activities created by the user also can include customizations of activities suggested by the lifestyle companion system in step 104, customizations of activities created by third parties, activities the user creates from scratch, or compilations of activities that are suggested, customized, or otherwise created by the user. In one embodiment of the present invention, the lifestyle companion system can permit a user to customize an activity by permitting the user to set the value of one or more adjustable parameters associated with the activity. Adjustable parameters of an activity are discussed in greater detail below. Once the user has completed creating activities, the user can share these activities with user-authorized entities, e.g., the user's doctor, trainer, physical therapist, friend, etc.
[0066] In step 106, the lifestyle companion system can provide a platform for the user to schedule one or more activities. The lifestyle companion system can permit the user to choose from the activities suggested in step 104 or created or downloaded by the user in step 105. Activities created or downloaded by the user can include activities that the user created or downloaded in step 105 or that the user has previously created or downloaded, e.g., from previous sessions with the lifestyle companion system.
[0067] In step 108, the lifestyle companion system can assist or motivate the user during performance of activities by providing audio and/or visual cues, individually or simultaneously, that are related to the activities. Audio and visual cues can include, for example, instructions for an activity, feedback on a user's progress, and/or motivational feedback. The cues can be pre-loaded or dynamically built based on a user's performance metrics, as determined from data collected in step 110. The media cues can be intelligently mixed with entertainment media (e.g., music or video) the user is playing during performance of a scheduled activity. Visual cues can include text, still images, and/or videos.
[0068] In one embodiment of the present invention, performance metrics can include metrics that track the amount or quality of a fitness activity that a user has performed, physiological metrics or rate of change thereof, or any combination thereof.
[0069] The media cues can be played at predetermined points during an activity, at unscheduled points during an activity based on performance metrics, or at the initiation of the user. For example, when data collected about the user's performance in step 110 indicates that a user has run his/her fastest mile, the lifestyle companion system can provide the user with audio and/or visual cues indicating that he has achieved a personal best and congratulating the user for reaching a particular performance metric. In one embodiment of the present invention, the congratulatory cue can be in the form of a predetermined song or a predetermined video that the user has earned through his performance.
[0070] In step 110, the lifestyle companion system can collect additional data about the user's performance of specific activities and/or throughout the user's day. User data can be collected using a tracking device that stores the data itself or transmits the data to a local server, a central server, a server dedicated to storage of user profile information, or any combination thereof. Tracking devices can include passive tracking devices that require the user and/or another authorized entity to manually enter user data, active tracking devices that automatically log data about the user and/or activities performed by the user, or any combination thereof.
[0071] Active tracking devices for use with the methods and systems according to the invention can include any electronic device coupled to or incorporating sensors that can capture information about a user, e.g., pedometers, devices having accelerometers, heart rate monitors, oximeters, location-tracking (e.g., GPS) devices, devices having temperature sensors, devices having heat flux sensors, electrocardiogram devices, scales, glucometer devices, devices having activity tracking sensors, any other suitable tracking device useful for capturing data about a person's activities, any other suitable tracking device useful for capturing data about a person's physical or mental state, or any combination thereof. In one embodiment of the present invention, the active tracking device can include a portable media device operatively coupled to sensors attached to the user (e.g., in clothing or accessories) or in equipment used by the user. The sensors and active tracking device also can be similar to those described in the incorporated INTEGRATED SENSORS document.
[0072] The data collected in step 110 can be stored and thereafter analyzed, for example, by analysis software, the user, or a user-authorized entity. The data collected in step 110 also can be used by the lifestyle companion systems in other steps of FIG. 1 . For example, the lifestyle companion system can change the category level assigned to a user in step 102 based on the collected data. The lifestyle companion system also can use the collected data to suggest activities, references, and/or plug-in modules in step 104. The lifestyle companion system also can use the collected data to determine when to provide audio and/or visual cues to the user and the type or content of the cues, e.g., as described with respect to step 108. The lifestyle companion system also can use the collected data to dynamically adapt a user's goals and/or activities in step 112.
[0073] To motivate the user to perform the scheduled activities, the lifestyle companion system also can use the collected data to distribute rewards to the user in step 111, e.g., in accordance with the incorporated REWARDS SYSTEMS document and the incorporated provisional patent application. For example, the lifestyle companion system can distribute rewards to users based on the user's performance metrics (over a period of time or during a single activity). Rewards can include monetary rewards, rewards points that can be exchanged for merchandise or services, access to features or activities, or any other reward described in the incorporated REWARDS SYSTEMS document and the incorporated provisional patent application.
[0074] Data collected in step 110 also can be stored and shared with authorized entities, e.g., the user's personal fitness trainer, doctor, physical therapist, sports coach, etc.
[0075] In step 112, the lifestyle companion system can dynamically adapt the user's short-term or long-term goals based on the data collected in step 110. For example, if the collected data (e.g., sensor data) indicates that the user will not reach a target performance metric based on his performance during an individual workout (e.g., the number of calories burned), the lifestyle companion system can temporarily reduce the target performance metric to a level that is more attainable during the workout in order to maintain the user's motivation. If the collected data indicates that the user will not reach his fitness goals based on his performance over multiple workouts, the lifestyle companion system can adjust the user's long-term goals to a level that may be more attainable for the user based on his past performance. Thus, a user's goals can be adapted either immediately or over time. In one embodiment of the present invention, a user's goals can be stored as goal data in the user's profile and the present invention can adapt the user's goals by adjusting the goal data.
[0076] In step 112, the lifestyle companion system also can dynamically adapt the user's activities based on the data collected in step 110. The lifestyle companion system can adjust a parameter of a current or future activity based on the collected data. For example, if the collected data indicates that the user will not reach a target performance metric (e.g., target number of calories burned or target heart rate) during a current fitness activity, the lifestyle companion system can increase the intensity or duration of the current fitness activity or a future fitness activity. If the collected data indicates that the user experienced activity levels over a predetermined period of time (e.g., during one day or over a number of days) that are lower than recommended or lower than that needed (e.g., to reach the user's weight loss goal), the lifestyle companion system can increase the level or intensity of future workout(s). If the collected data indicates that the user will not reach his fitness goals based on his performance over multiple workouts, the lifestyle companion system can increase the intensity or frequency of future workouts. Thus, a user's activities can be adapted either immediately or over time based on the collected data.
[0077] In step 114, the lifestyle companion system can provide the user with progress reports based on the goals expressed by the user in the user interview and the data collected about the user's activities. Progress reports can include information about the user's progress to date and trends in the user's progress. The information can be provided in charts and/or text. Progress reports also can include other information, e.g., personalized bio-rhythm charts (with automatic feeds from local weather), women's menstrual cycle, food types eaten, etc. Such functionality may allow a user to determine various patterns in the user's life.
[0078] Although FIG. 1 illustrates a flowchart having sequential steps, steps 100-114 do not have to be performed in the sequence shown. For example, as described above, the lifestyle companion system can suggest activities, references, and plug-in modules in step 104 based on data previously collected in accordance with step 110. Thus, one or more steps 100-114 can be reiterated. The lifestyle companion system also can perform one or more steps simultaneously. For example, the lifestyle companion system can simultaneously perform steps 108-112. In some embodiments of the present invention, some steps may be subsumed in other steps. For example, as described in greater detail below with respect to FIG. 7 , the lifestyle companion system can provide a platform for a user to schedule activities during a user interview.
[0079] In some embodiments of the present invention, the lifestyle companion system can communicate with (e.g., obtain information from or provide information to) third party resources that can operate independently of the lifestyle companion system. For example, since many lifestyle planning and tracking activities revolve around timelines, the lifestyle companion system can be integrated with a calendar program similar to that offered under the trademark iCal™ by Apple Inc. Additional integrated programs also can include, for example, contacts lists, task lists, and/or group calendaring programs that permit participants, such as family members, to coordinate their respective schedules and exercise routines (e.g., MeetingMaker™ offered by PeopleCube of Waltham, Mass.). In one embodiment of the present invention, the task lists can include themed information, e.g., reading lists. The lifestyle companion system can obtain information from, for example, automatic feeds from local meteorological resources, food menus for restaurants, movie/theater schedules, TV schedules, etc. The progress reports provided in step 114 can be integrated into themed logs (e.g., food diary or pregnancy log), journals, and/or planning tools. In an alternative embodiment of the present invention, the lifestyle companion system can be configured to offer one or more of these resources itself (i.e., without communication with independent third party resources).
[0080] FIG. 2 illustrates hardware for the lifestyle companion system in accordance with one embodiment of the present invention. Lifestyle companion system 200 can include active tracking device 202 and central server 204. Tracking device 202 can incorporate electronic device 206 and one or more sensors 208. Electronic device 206 can include a controller, memory, first communication module 210 for receiving signals transmitted from sensors 208, and second communication module 212 for communicating with central server 204 and/or a local server. In an alternative embodiment of the present invention, first and second communication modules 210 and 212 can be combined as one component.
[0081] The controller of electronic device 206 can be configured to perform one or more of the steps described above with respect to FIG. 1 . For example, the controller can be configured to accept sensor data from sensors 208 via communication module 210, direct the sensor data to be stored as part of the user's profile in the memory, determine how to adapt a user's goals based on the sensor data and goal data stored in the user's profile, and provide media cues to the user based on the sensor data and the adapted goals.
[0082] Sensors 208 can transmit data to first communication module 210 through a wire or by using a wireless communication protocol known in the art or otherwise. Sensors 208 can be attached to the user (e.g., in clothing or accessories). Alternatively, sensors 208 can be disposed within electronic device 206 or another device utilized by the user (e.g., fitness equipment described in greater detail below with respect to FIG. 22 ). If sensors 208 are disposed only within electronic device 206, the tracking device may not need first communication module 210. In one embodiment of the present invention, active tracking device 202 can include a portable media player similar to that sold under the trademark iPod™ by Apple Inc., and a sensor/receiver kit similar to the Nike+iPod Sport Kit sold by Apple Inc. and Nike, Inc. of Beaverton, Oreg.
[0083] In alternative embodiments of the present invention, data from sensors 208 can be transmitted directly or indirectly to central server 204 or local server 216. For example, sensors 208 can directly transmit its signals to central server 204 and/or local server 216, in addition to or instead of electronic device 206. Sensors 208 can indirectly transmit its signals to central server 204 and/or local server 216 using electronic device 206 as a conduit or through another conduit. If sensor data is transmitted indirectly through a conduit, the sensor data can undergo processing before it is transmitted to the central and/or local servers. As used herein, the term “sensor data” means any data directly generated by sensors 208 or any data derived from data directly generated by sensors 208.
[0084] In one embodiment of the present invention, central server 204 can include a controller, memory, and communication module 214. The controller of central server 204 can perform one or more of the steps described above with respect to FIG. 1 . A user may download data collected about his activities from his active tracking devices 202 into central server 204. The memory of central server 204 can store the user's data in his user profile. Communication modules 212 and 214 can be configured to transmit signals between portable device 206 and central server 204 over a hard-wired or wireless network (e.g., the internet). Controllers of electronic device 206 and central server 204 can include one or more processors, ASICs, other types of circuits, or any combination thereof.
[0085] Lifestyle companion system 200 also can include local server 216, e.g., a user's personal computer. Local server 216 can serve as an intermediary between active tracking device 202 and central server 204. In some embodiments of the present invention, a user may interact with central server 204 through local server 216. A controller of local server 216 also can perform one or more of the steps described above with respect to FIG. 1 . Thus, the process described above with respect to FIG. 1 can be executed by one or more of the controllers disposed in tracking device 202, central server 204, and local server 216. Local server 216 can communicate with active tracking device 202 and central server 204 using communication modules 218 and 220, which can be combined into one component.
[0086] User profiles can be stored in the respective memories of central server 204, local server 216, and/or tracking device 202. For example, user profile information can be stored in local server 216 for privacy reasons. User profile information also can be stored in central server 204 to facilitate access thereto by multiple user authorized entities or by the user from different geographic regions. For example, in one embodiment of the present invention, a user can authorize access of his user profile by the user's family member, employer, doctor, trained therapist or physical trainer, or other authorized entity. This can permit these user-authorized entities to review information associated with the user's profile (e.g., data collected about the user's activities) and/or suggest activities, references, and/or plug-in modules as described above with respect to step 104 of FIG. 1 . User profile information also can be divided among device 202, central server 204, and/or local server 216.
[0087] In one embodiment of the present invention, central server 204 can provide a database from which the lifestyle companion system can select activities, references, and/or plug-in modules for suggestion to the user in step 104 of FIG. 1 . Central server 204 also can permit the user to download activities, references, and/or modules from the same database and/or from a different database. Local server 216 can provide the platform for conducting the user interview and creating and scheduling user activities. This information, along with any media files providing audio and/or visual cues related to activities the user intends to perform, can be downloaded onto portable electronic device 206. Portable electronic device 206, in turn, can instruct the user in performing the activities. Advantageously, this can permit users to carry their most important information, lists, schedules, etc. with them. This also can permit a user to easily share such information with other authorized entities using, e.g., infra-red technology or via wireless or wired access to the internet or another type of network.
[0088] In alternative embodiments of the present invention, the central and local servers can be combined into one server. In another alternative embodiment of the present invention, the central server, the local server, and the portable electronic device can be combined into one device. For example, the portable electronic device can be configured to perform all the steps described with respect to FIG. 1 .
[0089] In one embodiment of the present invention, electronic device 206 can include any portable, mobile, hand-held, or miniature consumer electronic device. Illustrative electronic devices can include, but are not limited to, music players, video players, still image players, game players, other media players (e.g., an iPod™ sold by Apple Inc.), music recorders, video recorders, cameras, other media recorders, radios, medical equipment, calculators, cellular phones, other wireless communication devices, personal digital assistances, programmable remote controls, pagers, laptop computers, printers, or combinations thereof.
[0090] Miniature electronic devices can have a form factor that is smaller than that of hand-held devices. Illustrative miniature electronic devices can include, but are not limited to, watches, rings, necklaces, belts, accessories for belts, headsets, accessories for shoes, virtual reality devices, other wearable electronics, accessories for sporting equipment, accessories for fitness equipment, key chains, or combinations thereof. Incorporation of miniature, wearable devices into existing items can be desirable because they require no additional effort by the user to use them.
[0091] FIGS. 3-23 show an illustrative application of the lifestyle companion system of FIGS. 1-2 to a fitness module in accordance with some embodiments of the present invention. While FIGS. 3-23 illustratively relate to a fitness module for the lifestyle companion system of the present invention, the systems and methods described herein can be applied to any other plug-in modules, including the nutrition module described in greater detail with respect to FIG. 25 .
[0092] FIG. 3 shows an illustrative graphic user interface of a fitness welcome screen in accordance with one embodiment of the present invention. Screen 300 can include user input section 302 in which a user can input personal information and statistics as part of a user interview. For example, user input section 302 can include fields for the user's name, birth date, gender, and various bodily characteristics (e.g., weight, frame size, and a body fat metric). Other suitable fields also can be included on screen 300. Screen 300 also can include one or more links 306 to websites or other functionalities, e.g., a body fat calculator that allows a user to determine their individual body fat metric.
[0093] Screen 300 also can include interview progress indicator 304, which can indicate the user's progress through the user interview. Interview progress indicator 304 also can include selectable tabs that permit a user to navigate to other parts of the user interview. For example, in the embodiment shown in FIG. 3 , the selectable tabs can permit a user to navigate to the parts of the fitness interview for user input of current fitness level, user input of fitness interests, user input of fitness goals, user input of a preferred fitness schedule, or display of a fitness summary.
[0094] FIG. 4 shows an illustrative graphic user interface of a current fitness level screen in accordance with one embodiment of the present invention. Current fitness level screen 400 can include various fields for obtaining information about the user's current physical abilities. For example, fields can include a user's current fitness level 402, activity level 404, or any other suitable indicator. In one embodiment of the present invention, fields 402 and 404 can have selectable menus of predetermined options. This can permit the lifestyle companion system to define the predetermined options in instructional section 406 of screen 400.
[0095] FIG. 5 shows an illustrative graphic user interface of a fitness interest screen in accordance with one embodiment of the present invention. Fitness interest screen 500 can include selectable menu of fitness interests 502, gym membership indicator field 504, and gym identifier field 506. Gym identifier field 506 can permit the user to identify the gym company and/or the specific branch of the gym that the user visits most frequently.
[0096] FIG. 6 shows an illustrative graphic user interface of a fitness goals screen in accordance with one embodiment of the present invention. Fitness goals screen 600 can include a selectable menu of fitness goals 602. Screen 600 also can have fields 604 in which a user can input specific values for one or more goals (e.g., the user's weight goals). In one embodiment, fields 604 can include fields for the user's current weight, target weight, and target date on which the user would like to achieve his target weight. Fitness goals screen 600 also can include instructional section 606, in which the lifestyle companion system can provide the user with graphic (e.g., text, still image and/or video) instructions and/or information related to the selectable menu 602 and fields 604.
[0097] FIG. 7 shows an illustrative graphic user interface of a fitness schedule screen in accordance with one embodiment of the present invention. Fitness schedule screen 700 can include menu of types of fitness activities 702 and selectable daily schedule 704. This can permit a user to identify the type of fitness activities the user prefers to undertake on each day of the week. This also can permit the user to identify the day(s) of the week in which the user is unavailable or unwilling to perform a fitness activity. Again, screen 700 can include instructional section 706 for providing the user with graphic instructions and/or information about the screen.
[0098] In one embodiment of the present invention, menu 702 can include fitness activity types suggested by the fitness module of the lifestyle companion system based on the user's interview responses to user fitness interests and goals (FIGS. 5-6 ). Alternatively, the categories can include a generic list that is not customized to the user.
[0099] FIG. 8 shows an illustrative graphic user interface of a fitness summary screen in accordance with one embodiment of the present invention. For example, in section 802, fitness summary screen 800 can show a summary of the types of fitness activities and the corresponding days the user identified in fitness schedule screen 700 of FIG. 7 . In section 804, fitness summary screen 800 also can show a summary of the user's weight statistics (e.g., the user's current weight, the amount by which the user is overweight, the user's target weight, and the date by which the user wishes to achieve the target weight). The lifestyle companion system also can calculate a user's target daily calorie burn-rate and weekly weight loss target based on the user's interview responses, and display that information in fitness summary screen 800 (e.g., in section 804). Again, screen 800 can include instructional section 806 for providing the user with instructions and/or information about the screen.
[0100] In one embodiment of the present invention, the lifestyle companion system can provide the user with the option to extend the user interview into additional interview functions, e.g., to compile the user's health record. Additional interview functions can be part of advanced functions of the fitness module or part of another plug-in module. For example, in the embodiment shown in FIG. 8 , the interview function for compiling the user's health record can be part of the fitness module or part of a medical module that also is installed in the lifestyle companion system of the present invention. Thus, the lifestyle companion system of the present invention can seamlessly integrate multiple plug-in modules.
[0101] FIG. 9 shows an illustrative graphic user interface of a health history screen in accordance with one embodiment of the present invention. Health history screen 900 can permit the user to identify medical concerns that, for example, can affect the user's ability to perform fitness activities. Health history screen 900 can include selectable menu 902 of health conditions that a user may have or have had. Health history screen 900 also can have medication indication field 904 through which the user can advise the lifestyle companion system of the present status of medication the user is taking. If the user indicates that he currently is taking medication, screen 900 can be updated to permit the user to input the name(s) of the medications the user is taking. The lifestyle companion system then can link to an internal or external database that can provide information about side effects of the medication or warnings. For example, some medications caution against increased sensitivity to sunlight. Thus, the lifestyle companion system may suggest activities that reduce sun exposure.
[0102] FIG. 10 shows an illustrative graphic user interface of a workout review screen in accordance with one embodiment of the present invention. Workout review screen 1000 can provide a platform through which the lifestyle companion system can permit a user to review a pre-compiled workout compilation that is suggested by the lifestyle companion system, composed by a third party and downloaded by the user, or previously composed by the user (e.g., as described in greater detail below with respect to FIG. 12 ). Each pre-compiled workout compilation can have one or more activities associated therewith. Thus, the lifestyle companion system of the present invention can select fitness activities for suggestion to the user by selecting a pre-compiled workout compilation.
[0103] In one embodiment of the present invention, the lifestyle companion system can provide a platform through which a user can purchase pre-compiled workout compilations from a central database of workout compilations (e.g., iTunes™). Those workout compilations can be choreographed workouts from third parties (e.g., for specific fitness facilities). Third parties can include, for example, fitness content partners (e.g., Gold's Gym) or user-authorized entities (e.g., the user's personal fitness trainer).
[0104] Workout review screen 1000 can include navigation section 1002 for navigating among the user's different workout compilations. Screen 1000 also can include compilation section 1004, in which building blocks 1006 of the workout compilation can be graphically shown. Each building block 1006 can represent an individual fitness activity or a rest time activity. As described in greater detail below with respect to FIG. 12 , each building block 1006 can be associated with adjustable fitness parameters (or settings) preset by the lifestyle companion system (e.g., based on the user's interview responses or based on default values) and adjusted by the user, e.g., in a manner described in greater detail below with respect to FIG. 12 . The associated fitness parameters (or settings) can include duration, intensity, equipment needed, repetitions, sets, any other suitable parameter (or setting) related to a fitness activity, or any combination thereof. Each building block 1006 can provide one or more graphic representation of the associated fitness activity and/or the associated fitness parameters (or settings).
[0105] In one embodiment of the present invention, the workout compilation illustrated in FIG. 10 can be one that is suggested by the lifestyle companion system based on a user's interview responses (e.g., an interest in weight loss, an interest in walking, and no access to fitness facilities or equipment). The lifestyle companion system can select the entire workout compilation from a database of pre-compiled workout compilations based on the user's interview responses. Alternatively, the lifestyle companion system can select the workout compilation from the database and customize the adjustable fitness parameters (or settings) of each building block based on the user's interview responses.
[0106] Alternatively, the lifestyle companion system can compose the workout compilation entirely based on the user's interview responses. For example, the lifestyle companion system can select each building block, arrange the order in which the user will be instructed to perform the fitness activities associated with the building blocks, and customize the fitness parameters (or settings) associated with each building block based on the user's interview responses. In one embodiment of the present invention, the lifestyle companion system can select one or more of the building blocks pseudo-randomly from a subset of a database of activities (e.g., a subset that includes activities that themselves are selected from the database based on the user's profile).
[0107] FIG. 11 shows an illustrative graphic user interface of an alternative workout review screen in accordance with one embodiment of the present invention. Like workout review screen 1000, workout review screen 1100 also can include compilation section 1104 in which building blocks 1102 can be provided. Workout review screen 1100 also can include repetition indicator 1106 and completion indicator 1108. Repetition indicator 1106 can graphically indicate the number of times the workout compilation is encoded to instruct the user to repeat a set of fitness activities. The fitness activities to be repeated can include those represented by the building blocks spanned by the repetition indicator. In the embodiment of FIG. 11 , the repeated fitness activities include jumping jacks, squats, and push-ups.
[0108] FIG. 12 shows an illustrative graphic user interface of a user workout composition screen in accordance with one embodiment of the present invention. Composition screen 1200 can provide a platform through which the lifestyle companion system can permit a user to (1) compose his own workout compilation, (2) customize suggested workout compilations and fitness activities, and/or (3) customize workout compilations and fitness activities composed by a third party.
[0109] Composition screen 1200 can include selectable menu 1202 of building blocks 1204. When composing a workout compilation, a user or other authorized entity can select building blocks 1204 of fitness activities from menu 1202 and arrange the selected building blocks in compilation section 1206 in the order in which the workout compilation should instruct the user to perform the selected fitness activities. In menu 1202, fitness building blocks 1204 can be sorted according to the exercise type indicated by user-selectable field 1208, body area or muscle group indicated by user selectable field 1210, and the phase of the workout compilation (e.g., warm-up, cool-down, etc.) indicated by fields 1212.
[0110] The fitness building blocks included in menu 1202 can include a default group of building blocks, selections culled from a database of building blocks based on the user's interview responses, or building blocks suggested by a third party that may or may not be authorized by the user. For example, the building blocks included in menu 1202 can be suggested based on the user's fitness interests, preferred types of fitness activities, availability of equipment at the gyms frequented by the user, etc.
[0111] Each building block can be associated with one or more adjustable fitness parameters. By adjusting the fitness parameter(s) associated with a fitness activity, the fitness activity can be customized to the abilities and goals of a user. The fitness parameters (or settings) associated with each building block can have default values, values suggested by the lifestyle companion system based on the user's profile (e.g., the user's fitness or weight loss goals, the user's access to fitness facilities and equipment), or values suggested by a third party that may or may not be authorized by the user.
[0112] The fitness parameters also can be set based on user-specified values. To permit a user to set one or more fitness parameters associated with a fitness activity, screen 1200 also can incorporate instructional section 1214, in which instructional fitness parameters 1216 are provided. The lifestyle companion system can permit a user or other user authorized entity to set one or more of the displayed instructional fitness parameters by adjusting the value of the parameter shown in instructional section 1214. Instructional section 1214 also can provide graphic instructions on how to perform the fitness activity associated with the selected building block. For example, instructional section 1214 can provide textual instructions, still images, and/or an instructional video.
[0113] FIG. 13 shows an illustrative graphic user interface of a user workout composition screen having a media entertainment playlist menu in accordance with one embodiment of the present invention. Composition screen 1300 can provide a platform through which the lifestyle companion system can permit a user to associate entertainment media playlists with individual fitness activities and/or the entire workout compilation. Media entertainment playlists can include playlists of audio and/or visual (e.g., still image or video) entertainment files. Thus, when the user is exercising in accordance with the fitness activities associated with a workout compilation, the user can be entertained and motivated.
[0114] An entertainment playlist can include one or more media files. As used herein, an entertainment playlist refers to one or more media files containing information that is unrelated to an activity that the user will be directed to perform during playback of the entertainment playlist. For example, an entertainment playlist can include one or more music files, podcasts, music video files, TV show files, movie files, etc. In contrast, media files that instruct the user on performance of an activity associated with a workout compilation are considered instructional files.
[0115] Composition screen 1300 can include entertainment playlist menu 1302. Entertainment playlist menu 1302 can include, for example, a user's iTunes™ playlist menu, a video menu, a photo menu, a song menu, a podcast menu, a radio station broadcast menu, or any combination thereof. The user can select one or more entertainment playlists from entertainment playlist menu 1302 and assign an energy rank to each of the selected entertainment playlists according to energy level of the corresponding media tracks. The ranked entertainment playlists can be displayed in section 1304 of screen 1300. The entertainment playlists can be manually assigned energy ranks by the user or automatically assigned energy ranks by the lifestyle companion system in accordance with, for example, the tempo of songs in each entertainment playlist.
[0116] In one embodiment of the present invention, the lifestyle companion system can suggest associations of entertainment playlists with fitness activities. For example, the lifestyle companion system can select one or more playlists to associate with one or more fitness activities based on the expected intensity of the activities and the energy ranks of the entertainment playlists.
[0117] During performance of an activity, one or more of the entertainment playlists can be played. The present invention can playback entertainment playlists that have been pre-associated with a workout or fitness activity, permit the user to manually control the specific entertainment playlist played during an activity, or allow the lifestyle companion system to automatically select entertainment playlists based, for example, on the energy rank of the entertainment playlist and the intensity of the activity.
[0118] In one embodiment of the present invention, the lifestyle companion system also can permit a user to assign one or more media files as “power songs.” Power songs may be predetermined audio files that a user can preferably and instantly queue up at the push of a button for extra motivation.
[0119] In one embodiment of the present invention, the lifestyle companion system can permit a user to manually associate one or more playlists with one or more building blocks. Alternatively, the lifestyle companion system can automatically associate one or more playlists with one or more building blocks according to the relative expected energy level required by the fitness activities associated with the building blocks. For example, the lifestyle companion system can automatically associate lower energy playlists with fitness activities to be performed during the beginning or end of a workout (e.g., warm-up or cool-down). Similarly, higher energy playlists automatically can be associated with fitness activities to be performed during the middle of the workout. Thus, when the user is exercising in accordance with the workout compilation, the lifestyle companion system can play media having energy levels that are appropriate for the types of fitness activities being performed by the user.
[0120] In operation, a user can begin composing a workout composition by dragging one or more selected building blocks to composition section 1206 and arrange them in the order desired. Alternatively, the user can retrieve a pre-compiled workout compilation from memory or download a pre-compiled workout compilation from a database. If the user so desires, the user then can set or adjust the value of one or more fitness parameters 1216 of one or more fitness activities. Thereafter, the user can associate entertainment media playlists to the workout compilation or permit the lifestyle companion system to associate entertainment media playlists to the workout compilation based on the energy rank of the playlist and the expected energy levels of individual fitness activities and/or all of the activities associated with the workout compilation. Thereafter, the lifestyle companion system can compile the workout compilation, creating an activity file. The activity file can associate all of the media files, fitness parameters, and other information related to the workout compilation composed by the user.
[0121] Once a user has completed the user interview and has reviewed and/or composed one or more workout compilations, the user can begin exercising in accordance with one or more of the workout compilations. In one embodiment of the present invention, the user can compose workout compilations on a local server (e.g., the user's PC) and download the workout compilations onto a portable electronic device that the user can carry with him while exercising. The portable electronic device can provide both audio and visual cues to the user that relate to the workout compilation and to any entertainment playlists being played back during the workout.
[0122] Once the user has composed one or more workout compilations, the user also can share the workout compilation with user-authorized entities, e.g., with the user's doctor, trainer, physical therapist, friend, or any other entity authorized by the user.
[0123] FIGS. 14-21 show illustrative graphic user interfaces during playback of a workout compilation on an electronic device in accordance with one embodiment of the present invention. Electronic device 1400 can include touchscreen display 1402 on which the electronic device can display visual cues and user input components 1404-1412 to permit user interaction with the electronic device and/or the workout compilation. Touchscreen display 1402 can sense when a user's finger(s) and/or hands approaches, touches, or slides across the screen. User input components 1404-1412 can be hard-wired user input components or virtual user input components that are part of touchscreen display 1402. For example, user input components 1404-1412 can include one or more buttons, a touchpad, a touchscreen display, electronics for accepting voice commands, antennas, infrared ports, or combinations thereof. User input components 1404-1412 also can include a hard-wired and/or virtual clickwheel similar to that incorporated into some models of the iPod™. The clickwheel can have hardwired or virtual buttons and a track around which a user can run his finger to initiate scrolling.
[0124] FIG. 14 shows an illustrative graphic user interface of a welcome screen on electronic device 1400 in accordance with one embodiment of the present invention. Interface 1414 can provide visual cues related to a workout compilation being played back by the electronic device. For example, visual cues can include fitness activity filmstrip 1416, progress indicator 1418, instructional section 1420, and exercise type indicator 1422.
[0125] Fitness activity filmstrip 1416 can include graphic representations of previous, current, and future fitness activities that the workout compilation has, is, and will direct the user to perform. As the user advances through the workout compilation, electronic device 1400 will update fitness activity filmstrip 1416 accordingly based on data received by sensors 208 and/or manual user input informative of advancement from a current activity to a future activity. For example, when the sensor data indicates that the user has completed the current activity (e.g., performed the current activity in accordance with the associated fitness parameters), electronic device 1400 can update the filmstrip by updating the graphics (e.g., by adding a graphic representing the next future activity and removing the graphic of the last previous activity).
[0126] Progress indicator 1418 can indicate the progress of the user in performing the fitness activities of the currently loaded workout compilation. In one embodiment of the present invention, progress indicator 1418 can indicate the total number of fitness activities associated with the currently loaded workout compilation and the location of the current fitness activity within the total number. In one embodiment, electronic device 1400 can automatically update progress indicator 1418 based on data collected from sensor(s) 208 of FIG. 2 about the user's performance. For example, once data collected from sensors 208 indicates that the user has completed a fitness activity of the current workout compilation in accordance with the associated fitness parameters, electronic device 1400 can automatically update progress indicator 1418 accordingly, in addition to displaying visual cues for the next fitness activity associated with the current workout compilation. The electronic device also can update progress indicator 1418 based on user input signals that indicate the user's desire to advance onto the next activity.
[0127] In the welcome screen of FIG. 14 , instructional section 1420 can provide visual instructions for initiating the workout and information about the workout itself (e.g., total duration, name of the workout, etc.). Instructional section 1420 also can include virtual user input component 1404, which the user can actuate to obtain more detailed information about the currently loaded workout compilation. In one embodiment of the present invention, detailed information accessible via virtual user input component 1404 can include an index of the fitness activities associated with the currently loaded workout compilation, an example of which is described in greater detail below with respect to FIG. 21 .
[0128] Exercise type indicator 1422 can indicate the type of exercise(s) for which the currently loaded workout compilation is targeting (e.g., strength training). Other types of exercise types can include, for example, weight loss, yoga, calisthenics, etc.
[0129] Interface 1414 also can provide visual representations of entertainment playlist(s) associated with the workout compilation, e.g., as described in greater detail above with respect to FIG. 13 . For example, interface 1414 can provide entertainment filmstrip 1424 having graphics indicative of the entertainment tracks associated with the entertainment playlist currently being played. Interface 1414 also can provide graphics 1426 identifying the title and artist of the entertainment track currently being played. Interface 1414 also can provide virtual user input components 1406 and 1408, which the user can actuate to change the entertainment playlist currently being played. For example, the user can actuate virtual user input component 1406 when the user desires to play an entertainment playlist having an energy rank that corresponds to a lower energy level. The user can actuate virtual user input component 1408 when the user desires to play an entertainment playlist ranked having an energy rank that corresponds to a higher energy level (e.g., when the user wants to be motivated by songs having a faster tempo). Alternatively, electronic device 1400 can automatically link entertainment playlists to fitness activities and/or workout compilations based respectively on the energy ranks of the entertainment playlists and the expected intensity of the fitness activities and workout compilations. As described with respect to FIG. 13 , the energy levels of the entertainment playlists can be manually ranked by the user or automatically rated by the lifestyle companion system.
[0130] FIG. 15 shows an illustrative graphic user interface provided by electronic device 1400 during one fitness activity in accordance with one embodiment of the present invention. In addition to one or more of the visual cues provided by interface 1414 of FIG. 14 , interface 1502 also can provide additional visual cues related to the workout compilation being played back by the electronic device. Such additional visual cues can include timer 1504 and textual information 1506 regarding the fitness activity the workout compilation is instructing the user to perform. Timer 1504 can be a countdown timer that indicates the amount of time remaining in the current fitness activity or the amount of time elapsed since the beginning of the current fitness activity. Textual information 1506 can provide information about the fitness activity the workout compilation is directing the user to perform, e.g., the phase of the workout compilation (e.g., warm-up, cool-down, etc.), the title of the fitness activity, the amount of time in which the user should perform the indicated fitness activity, etc. In one embodiment of the present invention, electronic device 1400 also can provide audio cues about information similar or identical to that provided as textual information 1506.
[0131] Electronic device 1400 also can provide hard-wired or virtual user input components 1410, 1412, 1508 for the user to interact with the workout compilation currently being played. For example, a user can actuate user input component 1508 to obtain more detailed information about the current fitness activity. In one embodiment of the present invention, detailed information accessible via virtual user input component 1508 can include instructions for performing the current fitness activity and/or more detailed information about the fitness parameters associated with the current fitness activity (e.g., as described in greater detail below with respect to FIGS. 17 and 18 ).
[0132] A user can actuate user input component 1410 to play, pause, and/or stop playback of the current workout compilation. For example, a single short press of the user input component can instruct the electronic device to pause playback of the workout compilation, while a two short presses of the user input component can instruct the electronic device to stop the playback of the workout compilation.
[0133] A user also can actuate virtual user input component 1412 to advance onto the next successive fitness activity in the workout compilation. In an alternative embodiment of the present invention, electronic device 1400 also can be configured to permit the user to navigate to a different fitness activity associated with the current workout compilation by actuating one of the graphic representations of fitness activity filmstrip 1416. For example, to advance onto the next fitness activity or return to a previous fitness activity, the user can actuate the graphic representation of that fitness activity on filmstrip 1416, e.g., by pressing on the appropriate representation. As described in greater detail below with respect to FIG. 19 , electronic device 1400 also can advance onto the next successive fitness activity automatically when the collected sensor data indicates that the user has completed the current activity. When electronic device 1400 advances onto the next successive fitness activity, the electronic device can update the activity information displayed on its display to reflect information (e.g., instructions) for that next activity.
[0134] FIG. 16 shows an illustrative graphic user interface provided by electronic device 1400 during a rest time activity in accordance with one embodiment of the present invention. Like interface 1502 of FIG. 15 , interface 1602 also can have timer 1604. To indicate that the present activity is a rest time activity, fitness activity filmstrip 1416 can depict a graphical representation of time (e.g., a clock). If a user is ready to begin the next fitness activity before the time allocated for the rest time activity has timed out, the user may manually advance the workout compilation to the next fitness activity by actuating the representation of the desired fitness activity on filmstrip 1416 or actuating user input component 1412.
[0135] Interface 1602 also can incorporate instructional section 1606 to provide visual instructions for the next fitness activity. For example, in the embodiment shown in FIG. 16 , instructional section 1606 can instruct the user to prepare for the next fitness activity (e.g., biceps curl) by gathering the proper equipment for the activity (e.g., 10 lbs. barbells). Instructional section 1606 also can include user input component 1608, which, when actuated, can reveal more detailed information about the next fitness activity, e.g., as described in greater detail below with respect to FIGS. 17 and 18 .
[0136] FIG. 17 shows an illustrative graphic user interface provided by electronic device 1400 in accordance with one embodiment of the present invention. Interface 1702 can provide a platform through which the lifestyle companion system can provide the user with more detailed information about a fitness activity. For example, interface 1702 can provide a platform through which the lifestyle companion system can provide the user with pictorial instructions 1704 for the fitness activity, detailed textual instructions 1706 for the fitness activity, and instructional fitness parameters 1708 associated with the fitness activity.
[0137] Pictorial instructions 1704 and textual instructions 1706 can provide instructions related to the proper way to perform the fitness activity currently being displayed on interface 1702. For example, the instructions can relate to proper posture during the routine, proper breathing techniques, and/or other information related to the proper way to perform the fitness activity. If the textual instructions require more space than available on interface 1702, electronic device 1400 can permit the user to scroll through the textual instructions by using user-actuable scroll bar 1710 on interface 1702 or another user interface component (e.g., a hard-wired scroll wheel). Pictorial instructional 1704 can include one or more still images and/or videos.
[0138] As discussed above with respect to FIG. 12 , adjustable fitness parameters 1708 can be considered as instructions that guide the user in performing a fitness activity. Fitness parameters 1708 can include, e.g., the number of sets the workout compilation is instructing the user to perform, the number of repetitions per set the workout compilation is instructing the user to perform, the equipment the workout compilation is instructing the user to use in performing the fitness activity, the amount of time the workout compilation is instructing the user to allocate in performing the fitness activity, the entertainment playlist or file the user programmed the workout module to play during the fitness activity, etc. Fitness parameters 1708 can reflect default values, values suggested by the lifestyle companion system based on the user's profile or previously collected sensor data, values programmed by a third party and downloaded by the user in step 105 of FIG. 1 , or values programmed by the user in step 105 using, for example, interface 1200 of FIG. 12 . Thus, the fitness parameters can have default values or values customized for the user.
[0139] In one embodiment of the present invention, electronic device 1400 can permit the user to adjust one or more user-programmable parameters of a fitness activity in real-time during playback of the workout compilation. The user can select and adjust the parameters by using a virtual or hard-wired user input component. The electronic device can facilitate the selection by visually distinguishing the selected parameter. Once the user has adjusted one or more parameters, the electronic device can proceed to continue playing back the currently loaded workout compilation in accordance with the adjustments to the fitness parameters. For example, if the user changes the number of sets from 3 sets to 2 sets, the adjustment can be reflected in the fitness parameters displayed by the electronic device and in the stored information associated with the current workout compilation. Adjustments to fitness parameters also can be considered data collected about a user's performance of scheduled activities. Thus, the lifestyle companion system can adapt the user's goals, adapt later scheduled activities, and/or suggest activities, references, and/or plug-in modules for the user's consideration based on user-adjustments to the fitness parameters.
[0140] Electronic device 1400 also can adjust fitness parameters 1708 and/or a user's fitness goals in real-time based on data collected from sensors 208 of FIG. 2 . For example, if the sensor data indicates that the user is in poor physical shape, the electronic device can adjust one or more fitness parameters associated with one or more fitness activities to reduce, for example, the amount of time allocated to the fitness activities and/or the intensity level of the fitness activities. The electronic device also can adjust the user's fitness goals to be less ambitious to maintain the user's motivational level.
[0141] In one embodiment of the present invention, electronic device 1400 can adjust fitness parameters 1708 and/or the user's fitness goals based on whether the user's performance metrics indicate that the user is becoming fatigued. For example, electronic device 1400 can detect fatigue by measuring changes in one or more physiological metrics (e.g., breaths per minute, heart rate, or pace) as compared to a predetermined value. Electronic device 1400 also can detect fatigue by measuring changes in one or more physiological metrics as weighted by a weighting factor indicative of an expected intensity of the fitness activity. If the user's physiological metrics indicate fatigue, for example, electronic device 1400 may immediately reduce the intensity of the current fitness activity, e.g., by reducing the number of reps or sets the workout compilation is instructing the user to perform in the present workout.
[0142] In another embodiment of the present invention, electronic device 1400 can adjust fitness parameters 1708 and/or the user's fitness goals based on whether the user's performance metrics indicate the user will meet the user's short-term or long-term calorie burning goal. For example, electronic device 1400 can determine the number of calories a user burns by measuring the heat flux radiating from a predetermined location on a person's skin or tracking the amount of movement a user undertakes (e.g., the distance the user runs) with respect to the user's weight. Based on the number of calories burned, the electronic device then can project, for example, whether the user can attain the user's calorie burning goals. If the electronic device determines that the user will not be able to meet his goals, the electronic device can, for example, immediately increase the intensity of the current fitness activity by increasing the number of reps or sets the workout compilation is instructing the user to perform in the present workout.
[0143] Additional information about systems and methods for adjusting of user-programmable parameters of a media file (such as the workout compilation of the present invention) during playback of the media file can be found in the incorporated VARIABLE I/O document and the incorporated provisional patent application.
[0144] In addition to instructions 1704-1708, interface 1702 also can provide additional visual cues related to the workout compilation, including, e.g., title 1712 of the fitness activity, progress indicator 1714, etc. Progress indicator 1714 can indicate the user's progress through the fitness activities associated with the workout compilation currently being played back by electronic device 1400.
[0145] Interface 1702 also can include icon 1716, which closes interface 1702 when actuated by the user. When interface 1702 is closed, electronic device 1400 can return to, for example, interface 1502 of FIG. 15, 1602 of FIG. 16 , or 1902 of FIG. 19 .
[0146] FIG. 18 shows an illustrative graphic user interface provided by electronic device 1400 in accordance with one embodiment of the present invention. Interface 1802 can provide a platform through which the lifestyle companion system can provide the user with more detailed information about a fitness activity. Interface 1802 can be similar to interface 1702 of FIG. 17 . For example, interface 1802 also can incorporate pictorial instructions 1804 related to performance of the fitness activity, user-adjustable fitness parameters 1806, title 1808 of the fitness activity, progress indicator 1810, and user-actuable close-interface icon 1812. In one embodiment of the present invention, pictorial instructions 1804 can be larger than that of interface 1702 of FIG. 17 . Depending on the area occupied by pictorial instructions 1804, interface may or may not incorporate textual instructions related to performance of the fitness activity.
[0147] FIG. 19 shows an illustrative graphic user interface provided by electronic device 1400 during one fitness activity in accordance with one embodiment of the present invention. Interface 1902 can incorporate user-adjustable fitness parameters 1904, performance metric 1906, and progress indicator 1908. In one embodiment of the present invention, electronic device 1400 can automatically update performance metric 1906 based on data collected by sensors 208 of FIG. 2 . For example, if performance metric 1906 tracks the number of sets completed by the user, electronic device 206 can update the performance metric when the sensor data indicates that the user has completed a set of the prescribed activity.
[0148] Interface 1902 also can include user-actuable user input component 1910. When actuated by the user, electronic device 1400 can display information about the current fitness activity, e.g., as described in greater detail above with respect to FIGS. 17 and 18 .
[0149] FIG. 20 shows an illustrative graphic user interface of a finish screen on electronic device 1400 in accordance with one embodiment of the present invention. Interface 2002 can be similar to interface 1414 of FIG. 14 , except that instructional section 2004 can display a graphic message appropriate for the completion of the workout compilation.
[0150] FIG. 21 shows an illustrative graphic user interface of an index of fitness activities associated with a workout compilation in accordance with one embodiment of the present invention. Interface 2102 can provide a platform in which a user can keep track of his progress through a workout compilation. Interface 2102 can incorporate graphic representations 2104 of the fitness activities. The representations can be sorted in the order in which the associated activities are to be performed.
[0151] Interface 2102 also can incorporate progress indicator 2106, which can visually distinguish the fitness activities that the user has already performed from the fitness activities that the user has yet to perform. In one embodiment, electronic device 1400 can be configured to determine which activities the user has already performed based on collected sensor data. The electronic device also can be configured to determine which activities the user has already performed based on user input (e.g., user input that indicates the user's desire to advance onto successive activities).
[0152] Interface 2102 also can permit a user to jump around to different activities in the workout compilation. For example, if the user has just completed the legs lunge activity and would like to skip to the back superman activity next, the user can indicate this by actuating the graphic representation for the back superman activity. Electronic device 1400 then would advance onto the back superman activity next, rather than the biceps curl activity that originally was scheduled next.
[0153] In one embodiment of the present invention, electronic device 1400 can remember the location in the workout compilation at which a user has paused a workout compilation. When a user returns to the paused workout compilation, e.g., after a few minutes, hours, or days, electronic device 1400 can display index interface 2102 to remind the user of his progress through the workout compilation.
[0154] In one embodiment of the present invention, electronic device 1400 also can provide audio cues related to the workout compilation and/or a user performance metric. For example, in addition to the visual instructions on instructional section 1420 for initiating the workout, electronic device 1400 also can provide the same instructions audibly. Other audible cues can be related to, for example, the exercise type, the next fitness activity to be performed, the progress of the user through the workout compilation, instructions for a fitness activity (e.g., fitness parameters associated with a fitness activity and/or the proper way to perform a fitness activity), etc. In one embodiment of the present invention, the audio cues can be provided simultaneously with visual cues or in lieu of visual cues.
[0155] The audio cues can be provided at predetermined points in the workout compilation (e.g., at the end of each fitness activity) or dynamically provided based on a user's performance metrics. For example, electronic device 1400 can provide audio cues about the user's performance metrics, e.g., in isolation, as compared to the user's long-term or short-term performance goals, and/or as compared to the performance metrics of other people. The audio cues can be motivational in nature. For example, the audio cues can congratulate the user when the user runs her fastest mile or has met a performance goal.
[0156] FIG. 22 shows an illustrative fitness system for facilitating collection of data about a user's fitness performance and adaptation of a fitness activity based on the collected data in accordance with one embodiment of the present invention. System 2000 can include exercise machine (e.g., treadmill) 2002, integrated exercise machine sensor 2004, portable electronic device 2006 (e.g., iPod™), and wearable sensors 2008 and 2010 (e.g., the sensor from the Nike+iPod Sport Kit and heat flux sensor).
[0157] In one embodiment of the present invention, one of the activities of a user's workout compilation can include exercising on exercise machine 2002. Portable electronic device 2006 can collect data from sensors 2004 and 2008-2010 and from other data sources (e.g., manual entry by the user). Based on the collected data and on a user profile stored in memory of the portable electronic device, the portable electronic device can provide media cues to the user and control exercise machine 2002. Portable electronic device 2006 also can store the collected data for future analysis or for transmission to user-authorized entities.
[0158] To collect data from the sensors, portable electronic device 2006 can be equipped with a communication module (e.g., communication module 210 of FIG. 2 ) for receiving signals transmitted by sensors 2004, 2008, 2010 and/or other data sources. If one or more sensors are configured to transmit their data wirelessly, the communication module can be configured to accept the data using the same wireless protocol. If one or more of the sensors (e.g., integrated exercise sensor 2004) are configured to transmit data via a hard-wired connection (e.g., through a dock or cable), the communication module also can be configured to accept the data in the same manner.
[0159] Based on the data collected from data sources and the user profile, portable electronic device 2006 can dynamically adapt (in real-time) any of the adjustable fitness parameters of exercise machine 2002 (e.g., speed setting or inclination setting). That is, based on the collected data and the user profile, the portable electronic device can generate control signals to influence operation of the exercise machine. For example, if collected data indicates that the user's heart rate is too high for his weight class, portable electronic device can generate control signals that instruct exercise machine 2002 to immediately reduce its speed and/or reduce its inclination.
[0160] The computation for adjusting an exercise parameter of the exercise machine can at least partially be based on comparison of the user's performance metric(s) (e.g., heart rate) to target performance metric(s) (e.g., a target heart rate for the user's weight).
[0161] To facilitate communication and other interaction between portable electronic device 2006 and exercise machine 2002, the two devices can undergo a handshaking operation at the start of their interaction. For example, at the beginning of any interaction between the portable electronic device and the exercise machine, exercise machine 2002 can transmit identification data to portable electronic device 2006 to identify the exercise machine. The portable electronic device can use the identification data to determine the proper fitness parameters to adjust. The portable electronic device also can use the identification data to ensure that the collected data is linked with the correct exercise machine when the data is stored in memory. Thus, when the stored data is reviewed later, it can be reviewed in the proper context.
[0162] In one embodiment of the present invention, system 2000 can have duplicative data sources. Duplicative data sources can include multiple independent sensors that can provide data about the same performance metric. As used herein, while duplicative data sources can provide data about the same performance metric, duplicative data sources also can provide data about different performance metrics.
[0163] One advantage of using duplicative data sources to track a user's performance of an activity is the opportunity to select and use data from the data source providing the more accurate data. For example, a treadmill can provide calorie count based on the weight of the user and the miles the user has traversed. However, portable electronic device 2006 also can receive calorie information from a heat flux sensor (e.g., sensor 2008) that measures heat radiating from the user. Under some circumstances, heat flux information may be a more accurate indication of calories burned than the treadmill information. In one embodiment of the present invention, system 2000 can determine the duplicative data source providing the more accurate information by comparing data from each duplicative data source to the user's historic data and/or to a reference or calibration value or range of values. Thus, the present invention can include the ability to manually or automatically select among two or more data sources. Other embodiments of the present invention described herein also can include duplicative data sources.
[0164] While FIG. 22 illustrates a treadmill for use with the lifestyle companion system of the present invention, other exercise machines having adjustable exercise parameters also may be equipped to communicate with portable electronic device 2006 in the manner described. For example, adjustable weight machines, adjustable elliptical trainers, adjustable rowers, adjustable stationary bicycles, or any other suitable exercise machine can be equipped to communicate with (e.g., be controlled by and provide data to) portable electronic device 2006.
[0165] In one embodiment of the present invention, multiple exercise machines in a fitness facility can be equipped to communicate with portable electronic devices 2006. This can permit a user to aggregate his performance metrics from multiple exercise machines onto a single device (e.g., portable electronic device 2006). For example, the user can collect and store data from multiple exercise machines during a single workout or multiple workouts using portable electronic device 2006. Advantageously, rather than aggregating and analyzing data about the user's performance metrics in a piecemeal fashion, the user or an authorized entity can efficiently obtain a more complete picture of the user's performance and fitness abilities using the present invention.
[0166] Portable electronic device 2006 can provide audio and visual cues based on the data collected from sensors that track the user's performance and from sensors that track other people's performance(s) in accordance with the principles of the present invention. For example, a user and his workout partner may be jogging together, exercising on separate exercise machines, or otherwise working out together. A user's portable electronic device can be configured to accept data indicative of his own performance metrics from sensors associated with his own user profile (or portable electronic device) and data indicative of his partner's performance metrics. The data indicative of the user's partner's performance metrics can be transmitted from the partner's portable electronic device or from sensors associated with the partner's user profile or portable electronic device.
[0167] The user's electronic device may compare the partner's performance metrics to that of his own, and, based thereon, provide the user with a media cue. In one embodiment, the media cues can be indicative of the user's performance metrics and/or the partner's performance metrics. For example, if the user's performance metrics do not compare favorable with the partner's performance metrics, the user's portable electronic device can instruct the user to “Speed it up. Partner has already run 3 miles and you have only run 2 miles!”
[0168] In an alternative example, the user and his exercise partner may be exercising on different types of exercise machines equipped to communicate with portable electronic devices 2006. The user's electronic device and the partner's electronic device can each log the performance metrics of each person. The partner's electronic device can send the partner's performance metrics to the user's electronic device. The user's electronic device then can compare the user's performance metrics to those of the partner with respect to, for example, calories burned. After a predetermined period of time, the user's electronic device can instruct the user to “Speed it up. You have burned 50 calories in 20 minutes, while your partner has burned 70 calories in 20 minutes.”
[0169] FIG. 23A shows an illustrative progress report in accordance with one embodiment of the present invention. Progress screen 2300 can include textual indications 2302 and pictorial indications 2304 of a user's progress towards fitness goals. Progress screen 2300 also can incorporate motivational messages 2306 tailored to the user's performance metrics (e.g., as compared with the target metrics). For example, in the embodiment shown in FIG. 23A , screen 2300 displays the following motivational message: “You are doing great!” Progress toward other fitness goals or lifestyle goals also can be shown in graphical interfaces (e.g., similar to screen 2300) without departing from the spirit of the invention.
[0170] FIG. 23B shows illustrative progress report 2300 after goal adaptation based on the user's performance metrics in accordance with one embodiment of the present invention. For example, textual indication 2302 and pictorial indication 2304 can be updated to show a decrease in the total number of walks the user has to perform over a predetermined period as compared to the original goal. In one embodiment of the present invention, the adjustment can be visually distinguished, e.g., as blinking graphic 2308. The adjustment can be implemented in response to the user's performance metrics, as determined from data collected from data sources, e.g., sensors 208 of FIG. 2 . For example, the target number of walks can be reduced as a result of the user's poor performance through a first predetermined time period (e.g., four weeks) of the fitness schedule.
[0171] In accordance with another embodiment, the lifestyle companion system of the present invention can facilitate synchronous group activities. For example, the lifestyle companion system can be used to ensure that each participant in a group activity is being instructed to perform activities in concert with the other participants of the activity. That is, each participant can be instructed to perform the same activities as the other participants (e.g., in group workouts) or activities that complement the activities the other participants are being instructed to perform (e.g., in a band, theatrical production, or interactive sport activity).
[0172] FIG. 24 shows an illustrative flowchart for facilitating synchronous group activities in accordance with one embodiment of the present invention. In step 2402, the lifestyle companion system can transmit activity files to multiple member electronic devices to be used by the members of the group. The activity files can be downloaded onto each member electronic device (e.g., a portable media device similar to the iPod™) from a local server, a central server, or a participating electronic device (e.g., a master electronic device). In one embodiment of the present invention, the activity file can be created by a group organizer (e.g., fitness trainer, band leader, drill sergeant, theatrical director, athletic coach, etc.) in accordance with the systems and methods described herein.
[0173] In one embodiment of the present invention, the same activity file (e.g., a workout compilation) can be downloaded to all of the member devices. Alternatively, each member electronic device can be provided with different activity files. For example, the activity files can be different because the activity files may store different media items corresponding to different but complementary activities. When the activity files are played back on the member devices, the different activity files can instruct each group participant to perform at least one activity that is different than an activity another group participant is being directed to perform (e.g., in a band, theatrical production, or interactive sport activity). Alternatively, the activity files can be different because the activity files may store different parameters associated with the same activities. When the activity files are played back on the member devices, the activity files can instruct the group participants to perform the same activity, but in accordance with different parameters (e.g., different weights in a bicep curl activity).
[0174] In one embodiment of the present invention, an activity file can include a file in which all media items and parameters associated with an activity or compilation of activities are stored. Alternatively, an activity file can include multiple files in which all media items and parameters associated with an activity or compilation of activities are stored. For example, an activity file can include a first file in which the media items are stored and a second file in which the parameters are stored. Activity files can be considered different when they share the same media items but different parameters.
[0175] Once the activity file has been downloaded into each participating electronic device, the group members can begin performing the activity. In step 2404, one or more member electronic devices can send one or more synchronization signals to one or more of the other member electronic devices via wired or wireless communication protocols. For example, a master electronic device (e.g., used by the group organizer) can send out a synchronization signal to the other electronic devices to indicate that each device should begin playback of the downloaded activity file. During subsequent playback of the activity file, the master electronic device can continue to periodically send synchronization pulses to the other member devices to ensure that each member electronic device continues to play back the downloaded activity file in concert with the other member electronic devices.
[0176] In step 2406, each member electronic device can provide audio and/or visual cues to their respective participants in accordance with the systems and methods described herein. The audio and/or visual cues provided by each member device can be the same as those provided to the other members. Alternatively, the audio and/or visual cues provided by one or more of the member devices can be different than those provided to the other members. For example, when two or more participants are instructed to perform different but complementary activities (e.g., in a band, theatrical production, or interactive sport activity), each participant's electronic device can provide audio and/or visual cues that are appropriate for the activity that participant is being instructed to perform.
[0177] In one embodiment, the media cues can be related to data collected in step 2408. For example, the portable electronic devices can collect data indicative of the users' performance metrics before the devices provide media cues related thereto. The media cues also can be related to a member's performance as compared to the performance of one or more other members (as discussed above with respect to FIG. 22 ). For example, a first member device can receive data indicative of performance metrics of first and second members of the group activity. The first member device can compare the two sets of data and transmit a media cue to the first member based on the comparison.
[0178] In one embodiment of the present invention, the audio and/or visual cues related to the group activity can be blended or overlaid with entertainment media tracks that each participant has selected for playback on their respective electronic device. For example, each participant may choose to play different music while working out to a group fitness activity. The present invention can blend audio cues for the group fitness activity into the different music being played on each member electronic device.
[0179] In step 2408, the lifestyle companion system can collect data about the performance of the group participants. For example, each participating device can collect data from sensors associated therewith in accordance with the systems and methods described herein. The participating devices also can transmit the sensor data to other participating devices, such as the master device and/or another member device. Alternatively, the master device can be configured to accept the sensor data from the sensors directly without having to wait for transmission from another participating device.
[0180] In step 2410, one or more participating electronic devices (including a master electronic device) can be provided with at least partial operational control of one or more of the other member electronic devices. For example, a master electronic device can be provided with the ability to dynamically adjust parameters of the activity as discussed in greater detail below with respect to step 2412. Alternatively, each participating electronic device can have the ability to generate and send control signals to influence operation of the other participating electronic devices and/or the master device. The control signals can, for example, pause playback of the activity file or temporarily reduce the volume on the other electronic device(s) in the group. For example, when one person wants to communicate with the other person(s) in the group activity, the participating electronic devices can have the ability to lower the volume on or pause the other electronic device(s), e.g., in response to speech or activation of a user input by the first group member.
[0181] In step 2412, the lifestyle companion system can permit a member's own electronic device and/or a master electronic device to dynamically adapt one or more of the user's goals based on the data collected in step 2408. The lifestyle companion system also can permit a member's own electronic device and/or a master electronic device to dynamically adapt the parameters of the current activity based on the collected data. For example, a master electronic device can be configured to adapt a user's goals or the parameters of an activity on one or more of the participating electronic devices by generating and transmitting control signals to the target electronic device over a wireless or wired link, even while the participating electronic devices are playing the currently loaded activity file. The control signals can influence operation of the recipient electronic device by, for example, changing the parameters of the activities stored in the activities files on those electronic devices.
[0182] In step 2414, the lifestyle companion system can distribute rewards to the users, as described, for example, in the incorporated REWARDS SYSTEMS document and the incorporated provisional patent application.
[0183] FIG. 25 shows an illustrative flow chart for implementing a nutrition program with the lifestyle companion system in accordance with one embodiment of the present invention. In step 2502, the lifestyle companion system can provide a platform for conducting an interview related to nutrition. Interview questions can be directed to, e.g., weight-loss goals, the user's current diet, food allergies, food preferences, medical conditions, medications, financial allocation for nutritional needs, religion, time available to prepare food, other lifestyle information, etc. Based on the user interview responses, the lifestyle companion system can generate a user nutritional profile to which the lifestyle companion system can later refer in steps 2504-2506 and 2516-2520.
[0184] In step 2503, the lifestyle companion system can supplement the user's profile with the profiles of dining partners so that the lifestyle companion system can suggest, for example, nutritional activities (e.g., recipes, restaurants, etc.) that are appropriate for the user and his dining partners.
[0185] In step 2504, the lifestyle companion system can assign nutritional category levels based on the user's interview responses. For example, users may be labeled as vegan, vegetarian, kosher, lactose intolerant, dieter, etc.
[0186] In step 2506, the lifestyle companion system can suggest nutrition activities, references, and/or plug-in modules based directly or indirectly on the user's interview responses. For example, the lifestyle companion system can recommend the user patronize certain restaurants in the area's hometown. In one embodiment of the present invention, the lifestyle companion system can be linked to the menus of restaurants and the lifestyle companion system can suggest menu selections based, for example, on the user's nutritional needs and restrictions and/or on the user's availability of funds.
[0187] In one embodiment of the present invention, a user can be provided with a portable electronic device on which is stored his user nutrition profile. The user can be dining at a suggested restaurant and desire the lifestyle companion system to suggest menu selections based on his dietary and financial restrictions. If the user's portable electronic device already has the restaurant's menu stored in its memory, the user's device can immediately cross-reference the user's profile with the menu to select appropriate menu selections. However, if the user's portable electronic device does not have the restaurant's menu stored in its memory, the user can download the menu by linking his device to the restaurant's server. This can be accomplished, for example, by coupling the communication module on the user's device to an internet link or a dock coupled to the restaurant's server. Once the restaurant's menu is downloaded into the user's device, the device can select the appropriate menu selections. The user's device can provide the suggestions audibly and/or through graphics (e.g., text, still images, and/or video) on a display.
[0188] The lifestyle companion system also can suggest recipes and/or meal plans tailored to the needs of the user. The recipes and meal plans can be suggested based on the user's nutritional needs and/or restrictions, any specific diets the user is trying, relevant life events (e.g., a user's birthday and/or the user's exercise schedule), etc. In one embodiment of the present invention, the system can receive input from local food providers (e.g., grocery stores). Thus, the recipes and meal plans suggested by the lifestyle companion system also can be influenced by a variation of prices at the local food providers.
[0189] The lifestyle companion system also can suggest websites or plug-in modules for special diet plans, e.g., diet plans branded by Jenny Craig or Weight Watchers. The lifestyle companion system can be pre-loaded with plug-in modules related to nutrition or the user can download nutrition plug-in modules from a database of such offerings, e.g., from iTunes™.
[0190] In step 2508, the lifestyle companion system can provide a platform for the user to create nutrition activities. For example, the lifestyle companion system can provide an interface similar to interface 1200 of FIG. 12 for the user to plan meals or customize meal plans suggested by the lifestyle companion system in step 2506. However, rather than building blocks of fitness activities, the nutrition interface can offer building blocks of recipes or food dishes sorted, for example, by the food groups and/or courses (e.g. appetizer, entrée, or dessert).
[0191] In step 2510, the lifestyle companion system can provide a platform for the user to schedule nutrition activities. For example, the user can schedule shopping trips to local food providers identified with respect to the recipes suggested in step 2506. The user also can schedule dining out opportunities at the restaurants suggested in step 2506.
[0192] In step 2512, the lifestyle companion system can provide audio and/or visual cues related to the nutritional activities. For example, the lifestyle companion system can provide nutritional information about a selected restaurant and/or menu selection. The lifestyle companion system also can indicate how the menu selections affect the user's nutritional plan and/or goals.
[0193] Another example of a visual cue can include graphic indications of suggested portion size. For example, if a recipe or diet plan calls for a certain portion of an ingredient or food, the lifestyle companion system can provide visual comparisons of the suggested portion size to an everyday object. Illustratively, if a recipe or meal plan calls for a cup of broccoli, the lifestyle companion system can graphically indicate that a cup of broccoli may have a size comparable to a baseball.
[0194] In step 2514, the lifestyle companion system can collect data about the user's performance of an activity. For example, the user can carry a portable electronic device having a scanner that can scan a barcode representing the food purchased and/or eaten by the user. Alternatively, the user can couple his portable electronic device into a dock at a restaurant. A server at the restaurant then can download nutritional information about the user's meal into the user's device.
[0195] In step 2516, the lifestyle companion system can dynamically adapt the user's nutritional goals and/or activities based on the data collected in step 2514. For example, if a user consumes too many calories, the lifestyle companion system can reduce the user's future allotment of calories by, for example, suggesting different recipes or menu selections in step 2506, suggesting different portions in steps 2506 and 2512, and/or changing the ingredients in suggested recipes. The lifestyle companion system also can adjust the user's nutritional goals if data collected over a predetermined period of time indicate that the user's nutritional habits will not enable the user to reach the user's nutritional goals.
[0196] In step 2518, the lifestyle companion system can provide progress reports related to the user's nutritional habits, goals, and/or activities.
[0197] In step 2520, the lifestyle companion system can distribute rewards to the user based on nutrition data collected in step 2514, as described, for example, in the incorporated REWARDS SYSTEMS document and the incorporated provisional patent application.
[0198] Although particular embodiments of the present invention have been described above in detail, it will be understood that this description is merely for purposes of illustration. Alternative embodiments of those described hereinabove also are within the scope of the present invention. For example, alternative embodiments of the present invention can incorporate any one or more of the steps described with respect to FIGS. 1, 24 , and 25. For example, in one embodiment of the present invention, the lifestyle companion system can permit a user to compile and play back a compilation of activities without the user having to go through an interview and/or without collected data about the user's activities. Also, alternative embodiments of the present invention also can provide any one or more of the screens and user interfaces described herein.
[0199] Furthermore, various embodiments described herein or portions thereof can be combined without departing from the present invention. For example, fitness partners can use the lifestyle companion software described with respect to FIGS. 12-13 to compose separate workout compilations customized for each individual, use their respective portable electronic devices to control and collect data from exercise machines as described with respect to FIG. 22 , and use their respective portable electronic devices to influence operation of each other's portable electronic device as described with respect to FIG. 24 .
[0200] The above described embodiments of the present invention are presented for purposes of illustration and not of limitation, and the present invention is limited only by the claims which follow.
Claims
What is claimed is:
1. A method for a portable electronic device to interact with an exercise machine, the method comprising:
accepting first sensor data with the portable electronic device from at least a first sensor integrated within the exercise machine during use of the exercise machine by a user;
accepting second sensor data with the portable electronic device from at least a second sensor attached to the user during the use of the exercise machine by the user, wherein the second sensor is a duplicative data source for the first sensor for a particular type of data during the use of the exercise machine by the user;
identifying, using the portable electronic device, a particular one of the accepted first sensor data and the accepted second sensor data as the more accurate sensor data for the particular type of data; and
generating, using the portable electronic device, a control signal for influencing operation of the exercise machine based on the identified particular one of the accepted first sensor data and the accepted second sensor data but not based on the other one of the accepted first sensor data and the accepted second sensor data.
2. The method of claim 1, wherein the exercise machine is a treadmill.
3. The method of claim 1, wherein the particular type of data comprises a performance metric of the user during the use of the exercise machine by the user.
4. The method of claim 3, wherein the performance metric comprises a calorie count of the user during the use of the exercise machine by the user.
5. The method of claim 1, wherein the identifying comprises comparing, using the portable electronic device, each one of the accepted first sensor data and the accepted second sensor data to historic data of the user.
6. The method of claim 1, wherein the identifying comprises comparing, using the portable electronic device, each one of the accepted first sensor data and the accepted second sensor data to at least one of a reference value and a calibration value.
7. The method of claim 1, further comprising transmitting the control signal from the portable electronic device to the exercise machine for influencing the operation of the exercise machine during the use of the exercise machine by the user.
8. The method of claim 1, wherein the identifying comprises receiving from the user a selection of the particular one of the accepted first sensor data and the accepted second sensor data as the more accurate sensor data for the particular type of data.
9. The method of claim 1, wherein the identifying comprises the portable electronic device automatically selecting the particular one of the accepted first sensor data and the accepted second sensor data as the more accurate sensor data for the particular type of data.
10. The method of claim 1, wherein the identifying the particular one of the accepted first sensor data and the accepted second sensor data comprises identifying the particular one of the accepted first sensor data and the accepted second sensor data during the use of the exercise machine by the user.
11. The method of claim 10, wherein the generating the control signal comprises generating the control signal during the use of the exercise machine by the user.
12. A portable electronic device comprising:
a communication module configured to:
accept first sensor data from at least a first sensor integrated within an exercise machine during use of the exercise machine by a user; and
accept second sensor data from at least a second sensor that is not integrated within the exercise machine during the use of the exercise machine by the user, wherein the second sensor is a duplicative data source for the first sensor for a particular type of data during the use of the exercise machine by the user; and
a control module configured to:
identify a particular one of the accepted first sensor data and the accepted second sensor data as the more accurate sensor data for the particular type of data; and
generate a control signal for influencing operation of the exercise machine based on the identified particular one of the accepted first sensor data and the accepted second sensor data but not based on the other one of the accepted first sensor data and the accepted second sensor data.
13. The portable electronic device of claim 12, wherein the second sensor is integrated within the portable electronic device.
14. The portable electronic device of claim 12, wherein the communication module is further configured to transmit the control signal from the portable electronic device to the exercise machine for influencing the operation of the exercise machine during the use of the exercise machine by the user.
15. The portable electronic device of claim 12, wherein the particular type of data comprises a performance metric of the user during the use of the exercise machine by the user.
16. The portable electronic device of claim 12, wherein the performance metric comprises a calorie count of the user during the use of the exercise machine by the user.
17. The portable electronic device of claim 12, wherein the control module is configured to identify the particular one of the accepted first sensor data and the accepted second sensor data by comparing each one of the accepted first sensor data and the accepted second sensor data to historic data of the user.
18. The portable electronic device of claim 12, wherein the control module is configured to identify the particular one of the accepted first sensor data and the accepted second sensor data by comparing each one of the accepted first sensor data and the accepted second sensor data to at least one of a reference value and a calibration value.
19. The portable electronic device of claim 12, wherein the control module is configured to identify the particular one of the accepted first sensor data and the accepted second sensor data by receiving from the user a selection of the particular one of the accepted first sensor data and the accepted second sensor data as the more accurate sensor data for the particular type of data.
20. The portable electronic device of claim 12, wherein the control module is configured to identify the particular one of the accepted first sensor data and the accepted second sensor data by automatically selecting the particular one of the accepted first sensor data and the accepted second sensor data as the more accurate sensor data for the particular type of data.
Patent Citations (205)
| Patent | Date | Inventor | Cited By |
|---|---|---|---|
| US3675640(A) | 1972-07-01 | Gatts | Applicant |
| US4649552(A) | 1987-03-01 | Yukawa | Applicant |
| US4907795(A) | 1990-03-01 | Shaw et al. | Applicant |
| US5379057(A) | 1995-01-01 | Clough et al. | Applicant |
| US5412564(A) | 1995-05-01 | Ecer | Applicant |
| US5434913(A) | 1995-07-01 | Tung et al. | Applicant |
| US5452435(A) | 1995-09-01 | Malouf et al. | Applicant |
| US5471405(A) | 1995-11-01 | Marsh | Applicant |
| US5489249(A) | 1996-02-01 | Brewer et al. | Applicant |
| US5490247(A) | 1996-02-01 | Tung et al. | Applicant |
| US5645509(A) | 1997-07-01 | Brewer et al. | Applicant |
| US5673691(A) | 1997-10-01 | Abrams et al. | Applicant |
| US5675362(A) | 1997-10-01 | Clough et al. | Applicant |
| US5794018(A) | 1998-08-01 | Vrvilo et al. | Applicant |
| US5819735(A) | 1998-10-01 | Mansfield et al. | Applicant |
| US5857939(A) | 1999-01-01 | Kaufman | Applicant |
| US5859979(A) | 1999-01-01 | Tung et al. | Applicant |
| US5890995(A) | 1999-04-01 | Bobick et al. | Applicant |
| US5890997(A) | 1999-04-01 | Roth | Applicant |
| US5913062(A) | 1999-06-01 | Vrvilo et al. | Applicant |
| US5976083(A) | 1999-11-01 | Richardson | Applicant |
| US6013007(A) | 2000-01-01 | Root et al. | Applicant |
| US6032108(A) | 2000-02-01 | Seiple et al. | Applicant |
| US6039688(A) | 2000-03-01 | Douglas et al. | Applicant |
| US6077193(A) | 2000-06-01 | Buhler et al. | Applicant |
| US6135951(A) | 2000-10-01 | Richardson et al. | Applicant |
| US6159131(A) | 2000-12-01 | Pfeffer | Applicant |
| US6357147(B1) | 2002-03-01 | Darley et al. | Applicant |
| US6447424(B1) | 2002-09-01 | Ashby et al. | Applicant |
| US6463385(B1) | 2002-10-01 | Fry | Applicant |
| US6527674(B1) | 2003-03-01 | Clem | Applicant |
| US6539336(B1) | 2003-03-01 | Vock et al. | Applicant |
| US6553037(B1) | 2003-04-01 | Pivowar et al. | Applicant |
| US6560903(B1) | 2003-05-01 | Darley | Applicant |
| US6582342(B2) | 2003-06-01 | Kaufman | Applicant |
| US6585622(B1) | 2003-07-01 | Shum et al. | Applicant |
| US6587127(B1) | 2003-07-01 | Leeke et al. | Applicant |
| US6619835(B2) | 2003-09-01 | Kita | Applicant |
| US6623427(B2) | 2003-09-01 | Mandigo | Applicant |
| US6702719(B1) | 2004-03-01 | Brown et al. | Applicant |
| US6716139(B1) | 2004-04-01 | Hosseinzadeh-Dolkhani et al. | Applicant |
| US6725281(B1) | 2004-04-01 | Zintel et al. | Applicant |
| US6749537(B1) | 2004-06-01 | Hickman | Applicant |
| US6790178(B1) | 2004-09-01 | Mault et al. | Applicant |
| US6793607(B2) | 2004-09-01 | Neil | Applicant |
| US6808473(B2) | 2004-10-01 | Hisano et al. | Applicant |
| US6898550(B1) | 2005-05-01 | Blackadar et al. | Applicant |
| US6910068(B2) | 2005-06-01 | Zintel et al. | Applicant |
| US6921351(B1) | 2005-07-01 | Hickman et al. | Applicant |
| US6945911(B2) | 2005-09-01 | Jackowski | Applicant |
| US7030735(B2) | 2006-04-01 | Chen | Applicant |
| US7062225(B2) | 2006-06-01 | White | Applicant |
| US7070539(B2) | 2006-07-01 | Brown et al. | Applicant |
| US7085590(B2) | 2006-08-01 | Kennedy et al. | Applicant |
| US7171331(B2) | 2007-01-01 | Vock et al. | Applicant |
| US7174227(B2) | 2007-02-01 | Kobayashi et al. | Applicant |
| US7192387(B2) | 2007-03-01 | Mendel | Applicant |
| US7200517(B2) | 2007-04-01 | Darley et al. | Applicant |
| US7228168(B2) | 2007-06-01 | Dardik et al. | Applicant |
| US7251454(B2) | 2007-07-01 | White | Applicant |
| US7254516(B2) | 2007-08-01 | Case, Jr. et al. | Applicant |
| US7261690(B2) | 2007-08-01 | Teller et al. | Applicant |
| US7277726(B2) | 2007-10-01 | Ahya et al. | Applicant |
| US7278966(B2) | 2007-10-01 | Hjelt et al. | Applicant |
| US7292867(B2) | 2007-11-01 | Werner et al. | Applicant |
| US7328239(B1) | 2008-02-01 | Berberian et al. | Applicant |
| US7353139(B1) | 2008-04-01 | Burrell et al. | Applicant |
| US7424718(B2) | 2008-09-01 | Dutton | Applicant |
| US7454002(B1) | 2008-11-01 | Gardner et al. | Applicant |
| US7496277(B2) | 2009-02-01 | Ackley et al. | Applicant |
| US7519327(B2) | 2009-04-01 | White | Applicant |
| US7523040(B2) | 2009-04-01 | Kirchhoff et al. | Applicant |
| US7526524(B2) | 2009-04-01 | White | Applicant |
| US7591760(B2) | 2009-09-01 | Gordon et al. | Applicant |
| US7603255(B2) | 2009-10-01 | Case, Jr. et al. | Applicant |
| US7618345(B2) | 2009-11-01 | Corbalis et al. | Applicant |
| US7636754(B2) | 2009-12-01 | Zhu et al. | Applicant |
| US7656824(B2) | 2010-02-01 | Wang et al. | Applicant |
| US7670263(B2) | 2010-03-01 | Ellis et al. | Applicant |
| US7683252(B2) | 2010-03-01 | Oliver et al. | Applicant |
| US7753825(B2) | 2010-07-01 | Jaquish et al. | Applicant |
| US7827039(B2) | 2010-11-01 | Butcher et al. | Applicant |
| US7841967(B1) | 2010-11-01 | Kahn et al. | Applicant |
| US7946959(B2) | 2011-05-01 | Shum et al. | Applicant |
| US7973231(B2) | 2011-07-01 | Bowen | Applicant |
| US8001472(B2) | 2011-08-01 | Gilley et al. | Applicant |
| US8066514(B2) | 2011-11-01 | Clarke | Applicant |
| US8529409(B1) | 2013-09-01 | Lesea-Ames | Applicant |
| US2001/0054180(A1) | 2001-12-01 | Atkinson | Applicant |
| US2002/0007313(A1) | 2002-01-01 | Mai et al. | Applicant |
| US2002/0022551(A1) | 2002-02-01 | Watterson et al. | Examiner |
| US2002/0022774(A1) | 2002-02-01 | Karnieli | Applicant |
| US2002/0033753(A1) | 2002-03-01 | Imbo | Applicant |
| US2002/0072932(A1) | 2002-06-01 | Swamy | Applicant |
| US2002/0077784(A1) | 2002-06-01 | Vock et al. | Applicant |
| US2002/0095460(A1) | 2002-07-01 | Benson | Applicant |
| US2002/0107824(A1) | 2002-08-01 | Ahmed | Applicant |
| US2003/0017914(A1) | 2003-01-01 | Jackowski | Applicant |
| US2003/0028116(A1) | 2003-02-01 | Bimbaum | Applicant |
| US2003/0059747(A1) | 2003-03-01 | Yoshida et al. | Applicant |
| US2003/0097878(A1) | 2003-05-01 | Farringdon et al. | Applicant |
| US2003/0175666(A1) | 2003-09-01 | Tanabe et al. | Applicant |
| US2003/0204412(A1) | 2003-10-01 | Brier | Applicant |
| US2003/0208113(A1) | 2003-11-01 | Mault et al. | Applicant |
| US2003/0220971(A1) | 2003-11-01 | Kressin | Applicant |
| US2003/0224337(A1) | 2003-12-01 | Shum et al. | Applicant |
| US2003/0229900(A1) | 2003-12-01 | Reisman | Applicant |
| US2004/0002041(A1) | 2004-01-01 | Peplinski et al. | Applicant |
| US2004/0029684(A1) | 2004-02-01 | Zarif | Applicant |
| US2004/0091843(A1) | 2004-05-01 | Albro et al. | Applicant |
| US2004/0102931(A1) | 2004-05-01 | Ellis et al. | Applicant |
| US2004/0106449(A1) | 2004-06-01 | Walker et al. | Applicant |
| US2004/0107116(A1) | 2004-06-01 | Brown | Applicant |
| US2004/0143673(A1) | 2004-07-01 | Kristjansson | Applicant |
| US2004/0198555(A1) | 2004-10-01 | Anderson et al. | Applicant |
| US2004/0201595(A1) | 2004-10-01 | Manchester | Applicant |
| US2004/0220017(A1) | 2004-11-01 | Gordon et al. | Applicant |
| US2004/0229729(A1) | 2004-11-01 | Albert et al. | Applicant |
| US2005/0008993(A1) | 2005-01-01 | Bergh et al. | Applicant |
| US2005/0008994(A1) | 2005-01-01 | Bisogno | Applicant |
| US2005/0010638(A1) | 2005-01-01 | Richardson et al. | Applicant |
| US2005/0014113(A1) | 2005-01-01 | Spinner et al. | Applicant |
| US2005/0042582(A1) | 2005-02-01 | Graves | Applicant |
| US2005/0044503(A1) | 2005-02-01 | Richardson et al. | Applicant |
| US2005/0058970(A1) | 2005-03-01 | Perlman et al. | Applicant |
| US2005/0060368(A1) | 2005-03-01 | Wang et al. | Applicant |
| US2005/0070809(A1) | 2005-03-01 | Acres | Applicant |
| US2005/0101314(A1) | 2005-05-01 | Levi | Applicant |
| US2005/0107116(A1) | 2005-05-01 | Yamaguchi | Applicant |
| US2005/0107216(A1) | 2005-05-01 | Lee et al. | Applicant |
| US2005/0113649(A1) | 2005-05-01 | Bergantino | Applicant |
| US2005/0164833(A1) | 2005-07-01 | Florio | Applicant |
| US2005/0172311(A1) | 2005-08-01 | Hjelt et al. | Applicant |
| US2005/0176461(A1) | 2005-08-01 | Bozzone et al. | Applicant |
| US2005/0180341(A1) | 2005-08-01 | Nelson et al. | Applicant |
| US2005/0202934(A1) | 2005-09-01 | Olrik et al. | Applicant |
| US2005/0209050(A1) | 2005-09-01 | Bartels | Applicant |
| US2005/0227811(A1) | 2005-10-01 | Shum et al. | Applicant |
| US2005/0240705(A1) | 2005-10-01 | Novotney et al. | Applicant |
| US2005/0266385(A1) | 2005-12-01 | Bisogno | Applicant |
| US2005/0287499(A1) | 2005-12-01 | Yeager | Applicant |
| US2006/0025282(A1) | 2006-02-01 | Redmann | Examiner |
| US2006/0026052(A1) | 2006-02-01 | Klett et al. | Applicant |
| US2006/0035200(A1) | 2006-02-01 | Pittman | Applicant |
| US2006/0040244(A1) | 2006-02-01 | Kain | Applicant |
| US2006/0047208(A1) | 2006-03-01 | Yoon | Applicant |
| US2006/0063980(A1) | 2006-03-01 | Hwang et al. | Applicant |
| US2006/0085272(A1) | 2006-04-01 | Case et al. | Applicant |
| US2006/0107822(A1) | 2006-05-01 | Bowen | Applicant |
| US2006/0173972(A1) | 2006-08-01 | Jung et al. | Applicant |
| US2006/0197670(A1) | 2006-09-01 | Breibart | Applicant |
| US2006/0197753(A1) | 2006-09-01 | Hotelling | Applicant |
| US2006/0199155(A1) | 2006-09-01 | Mosher | Applicant |
| US2006/0205564(A1) | 2006-09-01 | Peterson | Applicant |
| US2006/0238517(A1) | 2006-10-01 | King et al. | Applicant |
| US2006/0250524(A1) | 2006-11-01 | Roche | Applicant |
| US2006/0253874(A1) | 2006-11-01 | Stark et al. | Applicant |
| US2006/0256130(A1) | 2006-11-01 | Gonzalez | Applicant |
| US2006/0263750(A1) | 2006-11-01 | Gordon | Applicant |
| US2007/0026999(A1) | 2007-02-01 | Merolle et al. | Applicant |
| US2007/0032345(A1) | 2007-02-01 | Padmanabhan et al. | Applicant |
| US2007/0033068(A1) | 2007-02-01 | Rao et al. | Applicant |
| US2007/0033069(A1) | 2007-02-01 | Rao et al. | Applicant |
| US2007/0059672(A1) | 2007-03-01 | Shaw | Applicant |
| US2007/0074619(A1) | 2007-04-01 | Vergo | Applicant |
| US2007/0110074(A1) | 2007-05-01 | Bradley et al. | Applicant |
| US2007/0113726(A1) | 2007-05-01 | Oliver et al. | Examiner |
| US2007/0130476(A1) | 2007-06-01 | Mohanty | Applicant |
| US2007/0135264(A1) | 2007-06-01 | Rosenberg | Applicant |
| US2007/0136093(A1) | 2007-06-01 | Rankin et al. | Applicant |
| US2007/0141540(A1) | 2007-06-01 | Borg | Applicant |
| US2007/0166683(A1) | 2007-07-01 | Chang et al. | Applicant |
| US2007/0219059(A1) | 2007-09-01 | Schwartz et al. | Examiner |
| US2007/0265138(A1) | 2007-11-01 | Ashby | Applicant |
| US2007/0287596(A1) | 2007-12-01 | Case et al. | Examiner |
| US2007/0287597(A1) | 2007-12-01 | Cameron | Applicant |
| US2008/0096726(A1) | 2008-04-01 | Riley et al. | Applicant |
| US2008/0155470(A1) | 2008-06-01 | Khedouri et al. | Applicant |
| US2008/0177860(A1) | 2008-07-01 | Khedouri et al. | Applicant |
| US2008/0195594(A1) | 2008-08-01 | Gerjets et al. | Applicant |
| US2008/0242521(A1) | 2008-10-01 | Einav | Examiner |
| US2009/0047645(A1) | 2009-02-01 | Dibenedetto et al. | Applicant |
| US2009/0087819(A1) | 2009-04-01 | Adachi et al. | Applicant |
| US2009/0312105(A1) | 2009-12-01 | Koplar | Applicant |
| EP1512370 | 2005-03-01 | Applicant | |
| EP1585014 | 2005-10-01 | Applicant | |
| GB2253706 | 1992-09-01 | Applicant | |
| GB2284060 | 1995-05-01 | Applicant | |
| GB2409040 | 2005-06-01 | Applicant | |
| JP2007013228 | 2007-01-01 | Applicant | |
| KR1999-0073234 | 1999-10-01 | Applicant | |
| WO97/14357 | 1997-04-01 | Applicant | |
| WO/52604 | 2000-09-01 | Applicant | |
| WO1/16855 | 2001-03-01 | Applicant | |
| WO2/15986 | 2002-02-01 | Applicant | |
| WO2/062425 | 2002-08-01 | Applicant | |
| WO2/093272 | 2002-11-01 | Applicant | |
| WO2005/032363 | 2005-04-01 | Applicant | |
| WO2005/036918 | 2005-04-01 | Applicant | |
| WO2005/082472 | 2005-09-01 | Applicant | |
| WO2005/087323 | 2005-09-01 | Applicant | |
| WO2005/093633 | 2005-10-01 | Applicant | |
| WO2006/042415 | 2006-04-01 | Applicant | |
| WO2006/079942 | 2006-08-01 | Applicant | |
| WO2007/099206 | 2007-09-01 | Applicant |
Non-Patent Literature (14)
- Pike, Sarah, Weight Watchers On-the-Go, Apr. 12, 2005, PC Magazine, vol. 24, Iss.6; p. 149.Examiner
- Oliver et al. “Enhancing Exercise Performance through Real-time Physiological Monitoring and Music: A User Study.” Pervasive Health Conference and Workshops, pp. 1-10 (2007).Applicant
- “Reinventing the Scroll Wheel,” CNET news.com, Aug. 22, 2006: <http://www.news.com/2300-1041—3-6107951-1.html?tag=ne.gall.pg; http://www.news.com/2300-1041—3-6107951-2.html?tag=ne.gall.pg http://www.news.com/2300-1041—3-6107951-3.html?tag=ne.gall.pg http://www.news.com/2300-1041—3-6107951-4.html?tag=ne.gall.pg.Applicant
- Microsoft Zune Impressions—Part 1, DigitalArts Online Magazine, Dec. 4, 2006: <http://www.digitalartsonline.co.uk/blogs/index.cfm?entryid=184&blogid=2>.Applicant
- Sensei.com, Feb. 10, 2008: <http://www.sensei.com/senseipublic/Inneraspx>.Applicant
- Podfitness Delivers on myMedia Promise, Utah Tech Jobs.com, Nov. 13, 2006: <http://utahtechjobs.com/index.php/2006/11/13/podfitness-delivers-on-mymedia-promise/>.Applicant
- Menta, “1200 Song MP3 Portable is a Milestone Player.” http://www.mp3newswire.net/stories/personaljuke.html (retrieved Jul. 17, 2010).Applicant
- Ericsson Inc. “Cellular Phone With Integrated MP3 Player.” Research Disclosure Journal No. 41815, Research Disclosure Database No. 418015 (Feb. 1999).Applicant
- Creative NOMAD.RTM. Digital Audio Player User Guide, Jun. 1999.Applicant
- Creative NOMAD.RTM. II Getting Started Guide, Jan. 2000.Applicant
- Rio 500 Getting Started Guide, 1999.Applicant
- Rio PMP300 User's Guide (1998).Applicant
- “Statement in Accordance With the Notice From the European Patent Office Dated Oct. 1, 2007 Concerning Business Methods.” Official Journal of the European Patent Office, Nov. 1, 2007.Applicant
- “Notice from the European Patent Office dated Oct. 1, 2007 concerning business methods.” Official Journal of the European Patent Office, vol. 30, No. 7, Nov. 1, 2007.Applicant