Management of physiological and psychological state of an individual using biophilic images

[0002] This application is a Continuation-in-part of U.S. patent application Ser. No. 09/430,580, filed Oct. 20, 1999, inventors Prahbu et al., titled Management of Physiological and Psychological State Of An Individual Using Images—Overall System.

[0003] This invention relates in general to the management of a physiological and/or psychological state of an individual and more particularly to the management of the physiological and/or psychological state of an individual through the use of biophilic images as a function of a sensed physiological parameter of an individual viewing the images.

[0004] The physical, emotional and mental well-being of an individual can contribute greatly to the quality of life of that individual. In our hyperactive, hyperkinetic world, stress results in numerous physical reactions, such as, headache, muscle tension, dizziness or sleeplessness, weight gain, chronic coughing, nervous ticks, stomach upset and shortness of breath. Job stress alone is estimated to cost American business $300,000,000,000 annually. Stress is the response of the body and/or mind to a demand placed upon it. Stress can be caused by major events in one's life, such as, death of a loved one, marital breakup, personal injury or sickness, and job loss. Stress can also result from our day-to-day hectic style of living, where one attempts to excel simultaneously at being a super employee, a super parent, a super spouse, and a super citizen. Unless chronic stress is controlled, one puts oneself at risk for a host of serious problems, such as, heart disease, stroke, migraines, muscle and nerve disorders.

[0005] The typical path to obtain relief from stress is to visit one's doctor. Stress conditions result in up to 70% of all doctor's visits. Typically, drugs are prescribed to relieve stress. One stress reducing medication alone accounts for $6,000,000 per day in sales. Thus, alternative approaches to traditional medicine have become increasingly popular. Resort to Eastern religions, transcendental meditation, and biofeedback techniques have been proposed to empower the individual to reduce stress without the potential deleterious effects of powerful and expensive prescription drugs or invasive surgery.

[0006] It has been proposed to use images for the purpose of optimizing one's physiological and psychological state. There are several reasons for this.

[0007] (1) It has been shown that one can measure a reliable physiological response for images that differ in valence and arousal. It has been demonstrated that images rated differently with respect to perceived activation and pleasantness elicited physiological responses of different magnitude. Thus, magnitude of the skin conductance response correlated with perceived arousal level produced by pictorial stimuli. At the same time heart rate acceleration during first 4 to 5 seconds of image presentation reflected “valence” or degree of perceived pleasantness of an image. Other physiological parameters that reflect an individual's physiological reactions to images have also been demonstrated. These results imply that, for an individual viewer, images can potentially be classified based on one's physiological reactions in terms of emotional arousal.

[0008] (2) Imagery is known to be able to change a person's state. Paintings, movies, pictures are constantly affecting our mood and performance level. Power of visualization and affective content determine effective use of imagery in therapeutic sessions. Experimental research has also shown that presentation of images of similar content may cause significant shifts in physiological reactions.

[0009] (3) Digital imaging technology provides an almost instant access to image databases through the internet. Moreover, the potentially unlimited degree of digital manipulation makes images very attractive means of interaction and communication. Images can be easily transformed to alter or enhance people's preferences, i. e., for hue, saturation, depth, aesthetic feelings, etc. Image transformation by itself can provide biofeedback information to the user to facilitate learning how to control one's physiological and emotional state, e. g., stress.

[0010] Following are several proposals to use images as a means of changing one's state that have not proven to be entirely successful.

[0011] U.S. Pat. No. 5,465,729, issued Nov. 14, 1995, inventors Bittman et al. and U.S. Pat. No. 5,343,871, issued Sep. 6, 1994, inventors Bittman et al., disclose the use of measurements of electrophysiological quantities to control a presentation to a subject of a series of prestored audio-visual sequences.

[0012] U.S. Pat. No. 3,855,998, issued Dec. 24, 1974, inventor Hidalgo-Briceno discloses an entertainment device that includes sensing means connected to the user for sensing galvanic skin response and brain theta waves. According to a given measured state of a user the device provides a given type of predetermined audio-visual stimulation to the user for a timed interval to hold one in or move one toward a desired state. At the end of the interval, the user's state is again measured and a further timed audio-visual response according to the measured state is presented to the user.

[0013] U.S. Pat. No. 5,596,994, issued Jan. 28, 1997, inventor Bro, discloses an automated and interactive positive motivation system that allows a health care professional to produce and send a series of motivational messages to a client to change or reinforce a specific behavioral pattern.

[0014] U.S. Pat. No. 5,304,112, issued Apr. 19, 1994, inventors Mrklas et al., discloses an integrated stress reduction system which detects the stress level of a subject and displays a light pattern reflecting the relationship between the subject's stress level and a target level. The system also provides relaxing visual, audio, tactile, environmental, and other effects to aid the subject in reducing one's stress level to the target level.

[0015] U.S. Pat. No. 4,632,126, issued Dec. 30, 1986, inventor Aguilar, discloses a biofeedback technique which permits simultaneous, preferably redundant, visual and auditory presentation on a color TV of any intrinsically motivating stimuli together with continuous information pertaining to the physiological parameter to be controlled. As the subject changes a certain physiological parameter, the image and sound become clearer if the change occurs in the desired direction.

[0016] U.S. Pat. No. 5,253,168, issued Oct. 12, 1993, inventor Berg, discloses a system for allowing an individual to express one's self in a creative manner by using biofeedback signals to direct imaging and audio devices.

[0017] U.S. Pat. No. 5,676,138, issued Oct. 14, 1997, inventor Zawalinski, discloses a multimedia computerized system for detecting emotional responses of human beings and changes thereof over time.

[0018] U.S. Pat. No. 5,047,930, issued Sep. 10, 1991, inventors Marten, et al., discloses methods of analyzing physiological signals from a subject and analyzing them using pattern recognition techniques to determine a particular sleep state of the subject. Use of any associated feedbacks is not disclosed.

[0019] The following papers discuss various emotional responses and physiological responses of subjects to viewing images.

[0020] Affective judgement and psychophysiological response: dimensional covariation in the evaluation of pictorial stimuli; by: Greenwald, Cook and Lang; Journal of Pyschophysiology 3 (1989), pages 51-64.

[0021] Remembering Pictures: Pleasure and Arousal in Memory, by: Bradley, Greenwald, Petry and Lang; Journal of Experimental Psychology, Learning Memory and Cognition; 1992, Vol. 18, No. 2, pages 379-390.

[0022] Looking at Pictures: Affective, facial, visceral, and behavioral reactions; by: Lang, Greenwald, Bradley, and Hamm, Psychophysiology, 30 (1993), pages 261-273.

[0023] Picture media and emotion: Effects of a sustained affective context; by: Bradley, Cuthbert, and Lang, Psychophysiology, 33 (1996), pages 62-670.

[0024] Emotional arousal and activation of the visual cortex: An fMRI analysis; by: Lang, Bradley, Fitzsimmons, Cuthbert, Scott, Bradley, Moulder, and Nangia; Psychophysiology, 25 (1998), pages 199-210.

[0025] The techniques disclosed in the above references have the following disadvantages.

[0026] 1. Known biofeedback techniques require expensive equipment, a trained instructor, and individual training in order to realize the benefits from the techniques.

[0027] 2. Known biofeedback techniques that use sounds, icons, or indicators that react to a user's physical or mental state have been ineffective in inducing or encouraging a relaxed state in the user.

[0028] According to the present invention, there is provided a solution to the problems of the prior art.

[0029] According to a feature of the present invention, there is provided an apparatus for managing the physiological and/or psychological state of an individual comprising a source of biophilic images; a device for sensing at least one physiological parameter of an individual; and a display, linked to said source and said device, for displaying biophilic images from said source as a function of the sensed physiological parameter in order to manage a physiological or psychological state of the individual.

[0030] It is therefore desirable to provide an improved system that would incorporate biophilic images that respond to the user's mental, physical and physiological state via biofeedback techniques. A simple example of this would be a time-lapse image of a flower budding. The user's monitored physical and mental state would control the time-lapse sequence. As the user became relaxed the rate at which the “budding process” progressed would accelerate. This would provide a non-abstract, non-distracting means to monitor one's own physical and mental state while providing images that induce and encourage relaxation.

[0031] The invention has the following advantages.

[0032] 1. A non-distracting means is provided to monitor one's own mental and physical state.

[0033] 2. Images are used that indicate the status of user's mental and physical state and that also induce and encourage change of physiological and psychological state in a desired direction, e.g., relaxation.

[0034] 3. A more effective biofeedback technique.

[0035] 4. A more intuitive biofeedback technique.

[0036] 5. A dual methodology of using relaxing biophilic image sequences which are controlled by biofeedback.

[0037] FIG. 1 is a graphical representation of a user viewing images on a computer screen while in contact with a physiology monitoring device.

[0038] FIGS. 2a-2fare graphical representations of a series of images depicting flowers blooming. The images progress from FIG. (2a) showing closed flower “buds” to FIG. (2f) showing the same flowers in full bloom. These images are a subset of the actual number incremental images which may be in the thousands.

[0039] FIGS. 3a-3fare graphical representations of a series of images depicting flowers in motion. The images progress from FIG. (3a) showing flowers leaning toward the right side of the frame to FIG. (3d) showing the same flowers leaning toward the left side of the frame and FIG. (3f) showing the same flowers back in their original location on the right side of the frame. These images are a subset of the actual number incremental images which may be in the thousands.

[0040] FIG. 4 is a flow chart documenting the sequence of operations in a biophilic biofeedback session.

[0041] In general, the present invention relates to the management of a physiological and/or psychological state of an individual through the use of biophilic images. Biofeedback has been shown to be an effective means to manage stress. Real world images of fruit, flowers placed in water, contained fire, park-like settings (open green area with scattered trees) and sunsets have been shown to induce relaxation. This effect is called biophilia.

[0042] The biophilia hypothesis asserts the existence of a biologically based, inherent human need to affiliate with life and life-like processes. This proposition suggests that human identity and personal fulfillment somehow depend on our relationship to nature. The human need for nature is linked not just to the material exploitation of the environment, but also to the influence of the natural world on our emotional, cognitive, aesthetic, and even spiritual development. Even the tendency to avoid, reject, and at times, destroy elements of the natural world can be viewed as an extension of an innate need to relate deeply and intimately with the vast spectrum of life about us.

[0043] The hypothesis suggests that the widest valuational affiliation with life and life-like processes (ecological functions and structures, for example) has conferred distinctive advantages in the human evolutionary struggle to adapt, persist, and thrive as individuals and as a species. Conversely, this notion intimates that the degradation of this human dependence on nature brings the increased likelihood of a deprived and diminished existence again, not just materially, but also in a wide variety of affective, cognitive, and evaluative respects. The biophilia notion, therefore, powerfully asserts that much of the human search for a coherent and fulfilling existence is intimately dependent upon our relationship to nature.

[0044] According to the invention, biophilic images are displayed to an individual in response (biofeedback) to sensed physiological parameter(s) of the individual in order to assist the individual in managing a physiological or physical state. Referring to FIG. 1, there is shown implementation of the present invention.

[0045] As shown, an individual user 10 is seated in chair 12 before a table 14. Table 14 supports a computer 20 having a computer monitor display 30. A physiology 20 monitoring device 40 is connected to computer 20. Device 40 senses a physiological parameter of individual user 10. As shown, the hand 16 of user 10 is resting on device 40. The physiological parameter sensed can be one or more of the following, heart rate, body temperature (peripheral, core), blood pressure, skin conductance response, brain waves, electro-myography, eye saccades, etc. The sensed physiological parameter provides a biofeedback signal to computer 30 to display biophilic images on display 30. The displayed images are stored in memory in computer 30.

[0046] The generation of suitable biophilic image sequence can be achieved by making time-lapse image sequences of the following natural events:

[0047] Flowers budding and blooming.

[0048] Flowers budding, blooming and dying.

[0049] The surface of a body of water progressing from “rippled” to “still”.

[0050] Waves dissipating until the body of water becomes still rain falling on a body of water decreasing in intensity until the water becomes still.

[0051] A contained fire with increasing intensity.

[0052] A contained fire with decreasing intensity.

[0053] Clouds dissipating in a clear sky.

[0054] Clouds forming in a clear sky.

[0055] FIGS. 2a-2fillustrate a series of time lapse biophilic images depicting a flower blooming. The images 60-110 respectively progress from FIG. 2ashowing closed flower buds to FIG. 2fshowing the same flowers in full bloom. These images are a subset of the actual number of incremental images which may be in the thousands.

[0056] FIGS. 3a-3fillustrate another series of time lapse biophilic images depicting flowers in motion. The images 120-170 respectively progress from FIG. 3ashowing flowers leaning toward the right side of the frame to FIG. 3dshowing the same flowers leaning toward the left side of the frame and to FIG. 3fshowing the same flowers back in their original location on the right side of the frame. These images are a subset of the actual number of incremental images which may be in the thousands.

[0057] The biophilic images are typically a sequence of scenes from nature that are photographed, digitized and stored in memory. The images can also be created using computer graphical techniques which can produce remarkably life-like scenes. The images can be stored in removable computer storage media such as optical disk or tape, magnetic disk or tape, memory card, or the like. The images can also be stored in a location remote from computer 20 and transmitted to computer 20 by known wireless and wired telecommunication systems (internet, intranet, public telephone network, cable, satellite).

[0058] Referring now to FIG. 4, there will be described the sequence of operations in a biophilic biofeedback session. A user first selects one or more physiology parameter monitoring devices, such as hand temperature (HT), skin conductance level (SCL), heart rate variability (HRV), surface EMG (sEMG) (box 180). The decision is made (diamond 190) whether or not the user's operating characteristics curves (OCC) are available for the selected physiology monitoring device.

[0059] Each individual has a different operating characteristics curve (OCC) for a given physiology measure. For example, though hand temperature usually has a three regions, a slow initial region, a fast rising middle region and a slow end region, the rate of change and range of these regions vary from individual to individual. Also, the amount of efforts needed in each region vary from person to person. In certain regions, the user may have to receive some positive feedback (such as opening of the flower a tidbit to get them out of the valley). The time lapse or any feedback loop image should hence be able to have variable rate of change. The sequence can play forward or backward to match the individual's response.

[0060] The OCC for an individual can be understood through situation specific events such as baseline, a calming or relaxing session using other techniques, an activation session using still image etc. These OCC's can then be mapped to the range of the time lapse image.

[0061] If the decision is no, the user's OCC for the selected physiology device or devices is measured and recorded (box 200). If the decision is yes, the user selects a biophilic image sequence for the desired physiological effect, such as calming, relaxing, or activating (box 210). The selected image sequence is calibrated to the user's OCC (box 220). The user then selects optional audiovisual verbal coaching sounds, visual status indicators (box 230).

[0062] The user initiates the biofeedback session (box 240).

[0063] During the session, the decision is made (diamond 250) whether or not the user's physiological condition as measured by the monitoring device is changing toward the desired goal condition. If no, the rate of image sequence progression remains fixed and an image motion loop is initiated (box 260). If yes, the rate of image sequence progression changes relative to the rate of measured physiological change (box 270).

[0064] The goal physiological condition as measured by the monitoring devices is reached (box 280) and the biofeedback session is concluded (box 290).

[0065] All time lapse images are not the same. The characteristics of these images such as range, speed, rate of change possible is very important to make them suitable for different physiology measures.

[0066] Using image classification scheme disclosed in U.S. patent application, Ser. No. 09/430,580, the best time lapse images can be selected for each individual. For example, if an individual prefers landscapes and up/down motion for activation, we can then pick an image that allow the user to raise into the image.

[0067] The time lapse image range can also be increased by manipulating the image quality features along with the content. For example, let's take a flower opening scene. The close flowers could be less saturated, as the temperature increases, the flower open a little, start adding saturation, opens a little more... and after completely opening, the sharpness or contrast on the image changes. This allows an increased range to map the image to the physiology.

[0068] The image should also be able to show some background motion so that at any point the image does not look completely stagnant.

[0069] The invention has been described in detail with particular reference to certain preferred embodiments thereof, but it will be understood that variations and modifications can be effected within the spirit and scope of the invention.