Methods and devices for reproducing audio signals with a haptic apparatus on acoustic headphones

[0001] This application claims priority to U.S. Provisional Application 61/924,148 filed on Jan. 6, 2014 entitled “Method and Devices for Reproducing Audio Signals with a Haptic Apparatus on Acoustic Headphones”, which is incorporated herein in its entirety.

[0002] The present invention is directed to improving the auditory experience of headphone users with a haptic device and with sound profiles based on user settings, or matched to a specific song, artist, or genre.

[0003] Due to their increased wavelengths, low frequencies usually require large drivers (e.g., subwoofers) to generate higher volume. In vehicle and home stereo applications, large amplifiers are used to drive large drivers (subwoofers), which have become very popular in car audio.

[0004] Many users of mobile devices, such as iPods, tablets, and smartphones, seek an immersive audio experience. Earbuds (i.e., headphones that fit directly in the outer ear) can be power efficient, but often lack drivers sufficiently powerful to create bass. On-ear (i.e., supra-aural) or over-the-ear headphones (i.e., circumaural) can incorporate larger drivers, but can be power hungry. On-ear and over-the-ear headphones can also seal the volume of air between the ear and the headphone to increase the reproduction of bass. Users of these designs perceive a bass experience when higher Sound Pressure Levels (“SPL”) are generated within the headphones by modulating the air volume between the ear and the headphones to recreate low frequency content. This reproduces an audio experience similar to what was initially recorded, but does not reproduce the same effect since the amount of air modulated is limited to that which is within the ear canal.

[0005] Increased SPL may contribute to the masking of certain sounds, thus affecting the overall auditory experience. Increased SPL can also cause temporary or permanent impairment over time.

[0006] The present inventors recognized the need to create an increased bass response in a mobile headphone with minimal power demands and without increasing SPL. Further, the present inventors recognized the need to modify the sound profile of headphones to match a user, genre, artist, or song.

[0007] Various implementations of the subject matter described herein may provide one or more of the following advantages. In one or more implementations, the techniques and apparatus described herein can enhance the bass sensation. The bass sensation can be enhanced without necessarily increasing the SPL. Additionally, in one or more implementations, the techniques and apparatus described herein can operate using less power than conventional means.

[0008] In various implementations the auditory experience can be enhanced by matching the sound profile of the headphones to a particular user, genre, artist, or song.

[0009] These general and specific techniques can be implemented using an apparatus, a method, a system, or any combination of apparatuses, methods, and systems. The details of one or more implementations are set forth in the accompanying drawings and the description below. Further features, aspects, and advantages will become apparent from the description, the drawings, and the claims.

[0017] Like reference symbols indicate like elements throughout the specification and drawings.

[0018] FIG. 1 shows headphones in a user environment 100. User 105 is listening to headphones 120. Headphones 120 can be of the on-the-ear or over-the-ear type. Headphones 120 can be connected to mobile device 110. Mobile device 110 can be a smartphone, portable music player, portable video game or any other type of mobile device capable of generating audio entertainment. In some implementations, mobile device 110 can be connected to headphone 120 using audio cable 130, which allows mobile device 110 to transmit an audio signal to headphones 120. Such cable 130 can be a traditional audio cable that connects to mobile device 110 using a standard headphone jack. The audio signal transmitted over cable 130 can be of sufficient power to drive, i.e., create sound, at headphones 120. In other implementations, mobile device 110 can alternatively connect to headphones 120 using wireless connection 160. Wireless connection 160 can be a Bluetooth, Low Power Bluetooth, or other networking connection. Wireless connection 160 can transmit audio information in a compressed or uncompressed format. The headphones would then provide their own power source to amplify the audio data and drive the headphones.

[0019] Headphones 120 can include stereo speakers including separate drivers for the left and right ear to provide distinct audio to each ear. Headphones 120 can include a haptic device 170 to create a bass sensation by providing vibrations through the top of the headphone band. Headphone 120 can also provide vibrations through the left and right ear cups using the same or other haptic devices. Headphone 120 can include additional circuitry to process audio and drive the haptic device.

[0020] Mobile device 110 can play compressed audio files, such as those encoded in MP3 or AAC format. Mobile device 110 can decode, obtain, and/or recognize metadata for the audio it is playing back, such as through ID3 tags or other metadata. The audio metadata can include the name of the artists performing the music, the genre, and/or the song title. Mobile device 110 can use the metadata to match a particular song, artist, or genre to a predefined sound profile. Such a sound profile can include which frequencies or audio components to enhance or suppress, allowing the alteration of the playback in a way that enhances the auditory experience. The sound profiles can be different for the left and right channel. For example, if a user requires a louder sound in one ear, the sound profile can amplify that channel more. In another example, the immersion experience can be tailored to specific music genres blending the haptic sensation along with audio from the ear cup drivers. Specifically, bass heavy genres (i.e. hip-hop, dance music, and rap) can have enhanced haptic output. Although the immersive initial settings are a unique blending of haptic, audio, and headphone clamping forces, the end user can tune haptic, as well as equalization to suit his or her tastes. Genre-based sound profiles can include rock, pop, classical, hip-hop/rap, and dance music. In another implementation, the sound profile could modify the settings for Alpine's MX algorithm, a proprietary sound enhancement algorithm, or other sound enhancement algorithms known in the art.

[0021] Mobile device 110 can connect to Internet 140 over networking connection 150 to obtain the sound profile. Network connection 150 can be wired or wireless. Mobile device 110 can obtain the sound profiles in real time, such as when mobile device 110 is streaming music, or can download sound profiles in advance for any music or audio stored on mobile device 110. Mobile device 110 can allow users to tune the sound profile of their headphone to their own preferences. For example, mobile device 110 can use Alpine's Tune-It mobile application. Tune-It can allow users quickly modify their headphone devices to suite their individual tastes. Additionally, Tune-It can communicate settings and parameters (meta data) to a server on the Internet, and allow the server to associate sound settings with music genres. These associations and settings can aid in sound tuning for other productions and other modalities, like the automotive environment. For example, in the automotive environment, sound tuning parameters can be output to the vehicle sound system to meet customer sound tastes.

[0022] Audio cable 130 or wireless connection 160 can also transmit non-audio information to headphone 120. The non-audio information can include sound profiles. In other implementations, the non-audio information can include haptic information to create a haptic event using the haptic device. For example, the non-audio information could instruct the headphones to create one or more shaking sensations of particular frequencies and durations when an explosion happens in a game on mobile device 110.

[0023] FIGS. 2A-2B show headphones including a haptic device. In both figures, headphone 200 includes headband 210. Right ear cup 220 is attached to one end of headband 210. Right ear cup 220 can include a driver that pushes a speaker to reproduce audio. Left ear cup 230 is attached to the opposite end of headband 210 and can similarly include a driver that pushes a speaker to reproduce audio. The top of headband 210 can include haptic device 240. Haptic device 240 can be covered by cover 250. Padding 245 can cover the cover 250. Right ear cup 220 can include a power source 270 and recharging jack 295. Left ear cup 230 can include signal processing components 260 inside of it, and headphone jack 280. Left ear cup 230 can have control 290 attached. Headphone jack 280 can accept an audio cable to receive audio signals from a mobile device. Control 290 can be used to adjust audio settings, such as to increase the bass response or the haptic response. In other implementations, the location of power source 270, recharging jack 295, headphone jack 280, and signal processing components 260 can swap ear cups, or be combined into either single ear cup.

[0024] Multiple components are involved in both the haptic and sound profile functions of the headphones. These functions are discussed on a component-by-component basis below.

[0025] Power source 270 can be a battery or other power storage device known in the art. In one implementation it can be one or more batteries that are removable and replaceable. For example, it could be an AAA alkaline battery. In another implementation it could be a rechargeable battery that is not removable. Right ear cup 270 can include recharging jack 295 to recharge the battery. Recharging jack 295 can be in the micro USB format. Power source 270 can provide power to signal processing components 260. Power source 270 can provide power to signal processing components 260. Power source 270 can last at least 10 hours.

[0026] Signal processing components 260 can receive stereo signals from headphone jack 280 or through a wireless networking device, process sound profiles received from headphone jack 280 or through wireless networking, create a mono signal for haptic device 240, and amplify the mono signal to drive haptic device 240. In another implementation, signal processing components 260 can also amplify the right audio channel that drives the driver in the right ear cup and amplify the left audio channel that drives the left audio cup. Signal processing components 260 can deliver a low pass filtered signal to the haptic device that is mono in nature but derived from both channels of the stereo audio signal. Because it can be difficult for users to distinguish the direction or the source of bass in a home or automotive environment, combining the low frequency signals into a mono signal for bass reproduction can simulate a home or car audio environment. In another implementation, signal processing components 260 can deliver stereo low-pass filtered signals to haptic device 240.

[0027] In one implementation, signal processing components 260 can include an analog low-pass filter. The analog low-pass filter can use inductors, resistors, and/or capacitors to attenuate high-frequency signals from the audio. Signal processing components 260 can use analog components to combine the signals from the left and right channels to create a mono signal, and to amplify the low-pass signal sent to haptic device 240.

[0028] In another implementation, signal processing components 260 can be digital. The digital components can receive the audio information, via a network. Alternatively, they can receive the audio information from an analog source, convert the audio to digital, low-pass filter the audio using a digital signal processor, and provide the low-pass filtered audio to a digital amplifier.

[0029] Control 290 can be used to modify the audio experience. In one implementation, control 290 can be used to adjust the volume. In another implementation, control 290 can be used to adjust the bass response or to separately adjust the haptic response. Control 290 can provide an input to signal processing components 260.

[0030] Haptic device 240 can be made from a small transducer (e.g. a motor element) which transmits low frequencies (e.g. 1 Hz-100 Hz) to the headband. The small transducer can be less than 1.5″ in size and can consume less than 1 watt of power. Haptic device 240 can be an off-the shelf haptic device commonly used in touch screens or for exciters to turn glass or plastic into a speaker. Haptic device 240 can use a voice coil or magnet to create the vibrations.

[0031] Haptic device 240 can be positioned so it is displacing directly on the headband 210. This position allows much smaller and thus power efficient transducers to be utilized. The housing assembly for haptic device 240, including cover 250, is free-floating, which can maximize articulation of haptic device 240 and reduces dampening of its signal.

[0032] The weight of haptic device 240 can be selected as a ratio to the mass of the headband 210. The mass of haptic device 240 can be selected directly proportional to the rigid structure to enable sufficient acoustic and mechanical energy to be transmitted to the ear cups. If the mass of haptic device 240 were selected to be significantly lower than the mass of the headband 210, then headband 210 would dampen all mechanical and acoustic energy. Conversely, if the mass of haptic device 240 were significantly higher than the mass of the rigid structure, then the weight of the headphone would be unpleasant for extended usage and may lead to user fatigue. Haptic device 240 is optimally placed in the top of headband 210. This positioning allows the gravity of the headband to generate a downward force that increases the transmission of mechanical vibrations from the haptic device to the user. The top of the head also contains a thinner layer of skin and thus locating haptic device 240 here provides more proximate contact to the skull. The unique position of haptic device 240 can enable the user to experience an immersive experience that is not typically delivered via traditional headphones with drivers located merely in the headphone cups.

[0033] The haptic device can limit its reproduction to low frequency audio content. For example, the audio content can be limited to less than 100 Hz. Vibrations from haptic device 240 can be transmitted from haptic device 240 to the user through three contact points: the top of the skull, the left ear cup, and the right ear cup. This creates an immersive bass experience. Because headphones have limited power storage capacities and thus require higher energy efficiencies to satisfy desired battery life, the use of a single transducer in a location that maximizes transmission across the three contact points also creates a power-efficient bass reproduction.

[0034] Cover 250 can allow haptic device 240 to vibrate freely. Headphone 200 can function without cover 250, but the absence of cover 250 can reduce the intensity of vibrations from haptic device 240 when a user's skull presses too tightly against haptic device 240.

[0035] Padding 245 covers haptic device 240 and cover 250. Depending on its size, shape, and composition, padding 245 can further facilitate the transmission of the audio and mechanical energy from haptic device 240 to the skull of a user. For example, padding 245 can distribute the transmission of audio and mechanical energy across the skull based on its size and shape to increase the immersive audio experience. Padding 245 can also dampen the vibrations from haptic device 240.

[0036] Headband 210 can be a rigid structure, allowing the low frequency energy from haptic device 240 to transfer down the band, through the left ear cup 230 and right ear cup 220 to the user. Forming headband 210 of a rigid material facilitates efficient transmission of low frequency audio to ear cups 230 and 220. For example, headband 210 can be made from hard plastic like polycarbonate or a lightweight metal like aluminum. In another implementation, headband 210 can be made from spring steel. Headband 210 can be made such that the material is optimized for mechanical and acoustic transmissibility through the material. Headband 210 can be made by selecting specific type materials as well as a form factor that maximizes transmission. For example, by utilizing reinforced ribbing in headband 210, the amount of energy dampened by the rigid band can be reduced and enable more efficient transmission of the mechanical and acoustic frequencies to be passed to the ear cups 220 and 230.

[0037] Headband 210 can be made with a clamping force measured between ear cups 220 and 230 such that the clamping force is not so tight as to reduce vibrations and not so loose as to minimize transmission of the vibrations. The clamping force can be in the range of 300 g to 600 g.

[0038] Ear cups 220 and 230 can be designed to fit over the ears and to cover the whole ear. Ear cups 220 and 230 can be designed to couple and transmit the low frequency audio and mechanical energy to the user's head. Ear cups 220 and 230 may be static. In another implementation, ear cups 220 and 230 can swivel, with the cups continuing to be attached to headband 210 such that they transmit audio and mechanical energy from headband 210 to the user regardless of their positioning.

[0039] Vibration and audio can be transmitted to the user via multiple methods including auditory via the ear canal, and bone conduction via the skull of the user. Transmission via bone conduction can occur at the top of the skull and around the ears through ear cups 220 and 230. This feature creates both an aural and tactile experience for the user that is similar to the audio a user experiences when listening to audio from a system that uses a subwoofer. For example, this arrangement can create a headphone environment where the user truly feels the bass.

[0040] FIG. 3 shows a block diagram of a headphone. FIG. 3 presents headphone system 300 that can be used to implement the techniques described herein for an enhanced audio experience. Headphone system 300 can be implemented inside of headphones 200. Headphone system 300 can be part of signal processing components 260. Headphones 200 can include bus 365 that connects the various components. Bus 365 can be composed of multiple channels or wires, and can include one or more physical connections to permit unidirectional or omnidirectional communication between two or more of the components in headphone system 300. Alternatively, components connected to bus 365 can be connected to headphone system 300 through wireless technologies such as Bluetooth, Wifi, or cellular technology.

[0041] An input 340 including one or more input devices can be configured to receive instructions and information. For example, in some implementations input 340 can include a number of buttons. In some other implementations input 340 can include one or more of a touch pad, a touch screen, a cable interface, and any other such input devices known in the art. Input 340 can include knob 290. Further, audio and image signals also can be received by the headphone system 300 through the input 340.

[0042] Headphone jack 310 can be configured to receive audio and/or data information. Audio information can include stereo or other multichannel information. Data information can include metadata or sound profiles. Data information can be sent between segments of audio information, for example between songs, or modulated to inaudible frequencies and transmitted with the audio information.

[0043] Further, headphone system 300 can include network interface 380. Network interface 380 can be wired or wireless. A wireless network interface 380 can include one or more radios for making one or more simultaneous communication connections (e.g., wireless, Bluetooth, low power Bluetooth, cellular systems, PCS systems, or satellite communications). Network interface 380 can receive audio information, including stereo or multichannel audio, or data information, including metadata or sound profiles.

[0044] An audio signal, user input, metadata, other input or any portion or combination thereof, can be processed in headphone system 300 using the processor 350. Processor 350 can be used to perform analysis, processing, editing, playback functions, or to combine various signals, including adding metadata to either or both of audio and image signals. Processor 350 can use memory 360 to aid in the processing of various signals, e.g., by storing intermediate results. Processor 350 can include A/D processors to convert analog audio information to digital information. Processor 350 can also include interfaces to pass digital audio information to amplifier 320. Processor 350 can process the audio information to apply sound profiles, create a mono signal and apply low pass filter. Processor 350 can also apply Alpine's MX algorithm.

[0045] Processor 350 can low pass filter audio information using an active low pass filter to allow for higher performance and the least amount of signal attenuation. The low pass filter can have a cut off of approximately 80 Hz-100 Hz. The cut off frequency can be adjusted based on settings received from input 340 or network 380. Processor 350 can parse metadata and request sound profiles via network 380.

[0046] In another implementation, passive filter 325 can combine the stereo audio signals into a mono signal, apply the low pass filter, and send the mono low pass filter signal to amplifier 320.

[0047] Memory 360 can be volatile or non-volatile memory. Either or both of original and processed signals can be stored in memory 360 for processing or stored in storage 370 for persistent storage. Further, storage 370 can be integrated or removable storage such as Secure Digital, Secure Digital High Capacity, Memory Stick, USB memory, compact flash, xD Picture Card, or a hard drive.

[0048] The audio signals accessible in headphone system 300 can be sent to amplifier 320. Amplifier 320 can separately amplify each stereo channel and the low-pass mono channel. Amplifier 320 can transmit the amplified signals to speakers 390 and haptic device 240. In another implementation, amplifier 320 can solely power haptic device 240. Amplifier 320 can consume less than 2.5 Watts.

[0049] FIG. 4 shows a block diagram of mobile device 110. FIG. 4 presents a computer system 400 that can be used to implement the techniques described herein for sharing digital media. Computer system 400 can be implemented inside of mobile device 110. Bus 465 can include one or more physical connections and can permit unidirectional or omnidirectional communication between two or more of the components in the computer system 400. Alternatively, components connected to bus 465 can be connected to computer system 400 through wireless technologies such as Bluetooth, Wifi, or cellular technology. The computer system 400 can include a microphone 445 for receiving sound and converting it to a digital audio signal. The microphone 445 can be coupled to bus 465, which can transfer the audio signal to one or more other components. Computer system 400 can include a headphone jack 460 for transmitting audio and data information to headphones and other audio devices.

[0050] An input 440 including one or more input devices also can be configured to receive instructions and information. For example, in some implementations input 440 can include a number of buttons. In some other implementations input 440 can include one or more of a mouse, a keyboard, a touch pad, a touch screen, a joystick, a cable interface, and any other such input devices known in the art. Further, audio and image signals also can be received by the computer system 400 through the input 440.

[0051] Further, computer system 400 can include network interface 420. Network interface 420 can be wired or wireless. A wireless network interface 420 can include one or more radios for making one or more simultaneous communication connections (e.g., wireless, Bluetooth, low power Bluetooth, cellular systems, PCS systems, or satellite communications). A wired network interface 420 can be implemented using an Ethernet adapter or other wired infrastructure.

[0052] An audio signal, image signal, user input, metadata, other input or any portion or combination thereof, can be processed in the computer system 400 using the processor 410. Processor 410 can be used to perform analysis, processing, editing, playback functions, or to combine various signals, including parsing metadata to either or both of audio and image signals.

[0053] For example, processor 410 can parse metadata from a song or video stored on computer system 400 or being streamed across network interface 420. Processor 410 can use the metadata to request sound profiles from the Internet through network interface 420 or from storage 430 for the specific song or video based on the artist, genre, or specific song or video. Processor 410 can then use input received from input 440 to modify a sound profile according to a user's preferences. Processor 410 can then transmit the sound profile to a headphone connected through network interface 420 or headphone jack 460 and/or store a new sound profile in storage 430. Processor 410 can run applications on computer system 400 like Alpine's Tune-It mobile application, which can adjust sound profiles. The sound profiles can be used to adjust Alpine's MX algorithm.

[0054] Processor 410 can use memory 415 to aid in the processing of various signals, e.g., by storing intermediate results. Memory 415 can be volatile or non-volatile memory. Either or both of original and processed signals can be stored in memory 415 for processing or stored in storage 430 for persistent storage. Further, storage 430 can be integrated or removable storage such as Secure Digital, Secure Digital High Capacity, Memory Stick, USB memory, compact flash, xD Picture Card, or a hard drive.

[0055] Image signals accessible in computer system 400 can be presented on a display device 435, which can be an LCD display, printer, projector, plasma display, or other display device. Display 435 also can display one or more user interfaces such as an input interface. The audio signals available in computer system 400 also can be presented through output 450. Output device 450 can be a speaker. Headphone jack 460 can also be used to communicate digital or analog information, including audio and sound profiles.

[0056] FIG. 5 shows steps for processing information for reproduction in headphones. Headphones can monitor a connection to determine when audio is received, either through an analog connection or digitally (505). When audio is received, any analog audio can be converted from analog to digital (510) if a digital filter is used. The sound profile can be adjusted according to user input (e.g., a control knob) on the headphones (515). The headphones can apply a sound profile (520). The headphones can then create a mono signal (525) using known mixing techniques. The mono signal can be low-pass filtered (530). The low-pass filtered mono signal can be amplified (535). In some implementations (e.g., when the audio is digital), the stereo audio signal can also be amplified (540). The amplified signals can then be transmitted to their respective drivers (545). For example, the low-pass filtered mono signal can be sent to a haptic device and the amplified left and right channel can be sent to the left and right drivers respectively.

[0057] FIG. 3 shows a system capable of performing these steps. The steps described in FIG. 5 need not be performed in the order recited and two or more steps can be performed in parallel or combined. In some implementations, other types of media also can be shared or manipulated, including audio or video.

[0058] FIG. 6 shows steps for obtaining and applying sound profiles. A mobile device, such as mobile device 110, can wait for media to be selected for playback or loaded onto a mobile device (605). The media can be a song, album, game, or movie. Once the media is selected, metadata for the media is parsed to determine if the media contains music, voice, or a movie, and what additional details are available such as the artist, genre or song name (610). The metadata is used to request a sound profile from a server over a network, such as the Internet, or from local storage (615). For example, Alpine could maintain a database of sound profiles matched to various types of media and matched to a particular model of headphones. The sound profile could contain parameters for increasing or decreasing various frequency bands and other sound parameters for enhancing portions of the audio, such as parameters for modifying Alpine's MX algorithm. The sound profile is received (620) and then adjusted to a particular user's preference (625). The adjusted sound profile is then transmitted (630) to a reproduction device, such as a pair of headphones. The adjusted profile and its associated metadata can also be transmitted (640) to the server where the sound profile, its metadata and the association is stored for later analysis.

[0059] FIG. 4 shows a system capable of performing these steps. The steps described in FIG. 6 could also be performed in headphones connected to a network without the need of an additional mobile device. The steps described in FIG. 6 need not be performed in the order recited and two or more steps can be performed in parallel or combined. In some implementations, other types of media also can be shared or manipulated, including audio or video.

[0060] FIG. 7 shows another headphone including multiple haptic devices. FIG. 7 shows a headphone 700. Headphone 700 can have components similar to headphone 200 and can function similarly. The details regarding headphone 700 are incorporated herein. Headphone 700 can include haptic device 740. Headphone 700 can include a right haptic device 755 attached to right ear cup 720. Headphone 700 can include a left haptic device 735 attached to left ear cup 730. Signal processing components 760 can include additional components to separately process low pass signals for the left and right channels, separately amplify those signals, and provide them to the left and right haptic devices 735 and 755, respectively. Signal processing components 760 must take care to avoid phase issues that can occur in conjunction with the creation of the mono signal. The additional haptic devices can allow for increased bass sensations isolated to an individual ear. The ability to separately generate vibrations for each ear is particularly useful in gaming environments and with signals in the higher end of the low frequency spectrum.

[0061] A number of examples of implementations have been disclosed herein. Other implementations are possible based on what is disclosed and illustrated.