US 8,249,283 B2Grant

Three-dimensional acoustic panning device

Issue Date:2012-08-21

•8 Claims

•10 Drawing Sheets

Abstract

[Problems]

To provide a three-dimensional acoustic panning device enabling a three-dimensional-panning of a sound source as a sound image panning.

[Means for Solving the Problems]

The three-dimensional acoustic panning device 1 includes a sound source acoustic signal acquiring means 11 for acquiring a sound source acoustic signal s(t) radiated from at least one sound source C, a panning information input means 12 for inputting an panning information I_pto pan the sound source C, an sound image forming acoustic signal output means 13 for outputting sound image forming acoustic signals q(t) to form at least one sound image at the position where the sound source C is positioned, an arrangement information storage means 14 for storing an arrangement information I_sof the sound image forming acoustic signal output means 13, and a sound image forming acoustic signal generating means 15 for generating sound image forming acoustic signals q(t) using the sound source acoustic signals s(t), the panning information I_pand the arrangement information I_s.

Metadata

Assignees

Nippon Hoso Kyokai
Fairlight Japan, Inc.
Fairlight AU Pty Ltd.

Inventors

Akio Ando
Mikihiko Okamoto
Kimio Hamasaki

Application Information

Application Number:US 12/160,995

Filing Date:2007-01-19

Priority Date:2006-01-19

Art Unit:2832

Classifications

IPC:

H04R5/02H04R5/00

Patent Drawings (10 sheets)

Description

[0001] This application is a U.S. National Phase under 35 U.S.C. §371, of International Application No. PCT/JP2007/050781, filed Jan. 19, 2007.

TECHNICAL FIELD

[0002] The present invention relates to a three-dimensional acoustic panning device, especially, relates to a three-dimensional acoustic panning device enabling a three-dimensional-panning of a sound source by a three-dimensional panning of a sound image formed by a plurality of acoustic signals from a plurality of loudspeakers regardless of arrangement of loudspeakers.

BACKGROUND OF THE INVENTION

[0003] It is possible for a conventional audio reproduction device such as two-channel audio system, 5.1 channel audio system, etc, to move a sound image horizontally, but difficult to move it vertically and/or anteroposteriorly, because the system moves a sound image by changing each of amplitudes of acoustic waves from a plurality of loudspeakers arranged on the circle centering on a sound receiving point with an operation of a pan-pod on a mixing console.

[0004] Then, a device enabling to move a sound image three-dimensionally, that is, not only horizontally, but also vertically and/or anteroposteriorly has already been proposed. (See Patent Publication 1, Patent Publication 2 and Non-Patent Publication 1)

[0005] The device equipping FIR filters disclosed in Patent Publication 1 makes it possible to move a sound image not only horizontally but also vertically by using two loudspeakers arranged on the same horizontal plane.

[0006] The device disclosed in Patent Publication 2 makes it possible to move a sound image not only horizontally but also vertically by selecting loudspeakers generating an acoustic wave and controlling amplitude of the acoustic wave in accordance with the position (angle and distance) between a listener and the sound source.

[0007] Further, the device disclosed in Non-Patent Publication 1 makes it possible to form a sound image at the same position as a sound source by outputting acoustic waves whose amplitudes are determined based on the lengths of three vectors into which a position vector of the sound source from a sound receiving point is broken.

[0008] A panning device which makes it possible to pan a sound image when a plurality of loudspeakers are arranged along edges of a rectangular filed such as a theater has already been proposed. (See, Patent Publication 3 and Non-Patent Publication 2)

[0009] The device disclosed in Patent Publication 3 makes it possible to move a sound image by delaying an acoustic wave generated from one loudspeaker to another acoustic wave generated from another loudspeaker when a plurality of loudspeakers are arranged along edges of a rectangular filed such as the theater

[0010] Further, the device disclosed in Non-Patent Publication 2 moves a sound image three-dimensionally by applying a vector base amplitude panning method to a plurality of loudspeakers arranged three-dimensionally.

[0011] Patent Publication 1: Japanese Patent Publication No. 3177714 (See [001], FIG. 1)
[0012] Patent Publication 2: Japanese Unexamined Patent Publication (Kokai) No. H06-301390 (See [0010]-[0015], FIG. 1)
[0013] Patent Publication 3:U.S. unexamined Patent Publication No. 20020048380 (See [0026], FIG. 3)
[0014] Non-Patent Publication 1: “Localization of Amplitude-Panned Virtual Sources II: Two- and Three-Dimensional Panning” VILLE PULKKI, J. Audio Eng. Soc. Vol. 49, No. 9, 2001 September
[0015] Non-Patent Publication 1: “Virtual Sound Source Positioning Using Vector Base Amplitude Panning” VILLE PULKKI, J. Audio Eng. Soc. Vol. 45, No. 6, 1997 June

DISCLOSURE OF THE INVENTION

The Problem to be Solved

[0016] The device disclosed in Patent Publication 1, however, has a problem that an anteroposterior panning is difficult. The device disclosed in Patent Publication 2 and Non Patent Publication have a problem that a precise anteroposterior panning is difficult, because the system moves a sound image anteroposteriorly based on the amplitude of the acoustic wave, not based on the phase of the acoustic wave.

[0017] The device disclosed in Patent Publication 3 and Non Patent Publication 2 have a problem that a service area is narrowed at a rectangular acoustic field such as a theater, because it requires arranging a plurality of loudspeakers along a spherical surface centering on a sound receiving point, that is, positions of audience's ears

[0018] The present invention to dissolve the above problems, therefore, aims to provide a three-dimensional acoustic panning device enabling a three-dimensional-panning of a sound source by a three-dimensional panning of a sound image formed by a plurality of acoustic signals from a plurality of loudspeakers regardless of arrangement of loudspeakers

Means to Solve the Problem

[0019] A three-dimensional acoustic panning device according to the first invention comprises

a sound source acoustic signal acquiring means for acquiring a sound source acoustic signal radiated from at least one sound source,

a panning information input means for inputting an panning information to pan said sound source,

a sound image forming acoustic signal output means for outputting sound image forming acoustic signals to form at least one sound image at the position where said sound source is positioned,

an arrangement information storage means for storing an arrangement information of said sound image forming acoustic signal output means, and

a sound image forming acoustic signal generating means for generating sound image forming acoustic signals using said sound source acoustic signals, said panning information and said arrangement information.

[0020] According to the above constitution, it becomes possible to simulate a three-dimensional panning of the sound sources by panning sound images formed by sound image forming acoustic signals output from a plurality of loudspeakers.

[0021] A three-dimensional acoustic panning device according to the second invention provides said panning information input means comprising a directional information input means for inputting at least one set of directional information concerning the direction of said sound sources viewed from a sound receiving point and a distance information input means for inputting at least one set of distance information concerning the distance between said sound receiving point and said sound sources.

[0022] According to the above constitution, it becomes possible to set said panning information as directional information and distance information.

[0023] A three-dimensional acoustic panning device according to the third invention provides said panning information input means having a panning information storage means for storing said panning information.

[0024] According to the above constitution, it becomes possible to store panning information.

[0025] A three-dimensional acoustic panning device according to the fourth invention provides said sound image forming acoustic signal output means having a recording/editing means for recording and editing said sound image forming acoustic signal.

[0026] According to the above constitution, it becomes possible to record and edit said sound image forming acoustic signal.

[0027] A three-dimensional acoustic panning device according to the fifth invention provides said sound image forming acoustic signal generating means comprising a transforming means for Fourier transforming said sound source acoustic signal to a frequency region sound source acoustic signal,

[0028] a frequency region sound image forming acoustic signal generating means for generating a frequency region sound image forming acoustic signal using said frequency region sound source acoustic signal, said panning information, and said arrangement information, and
an inverse transforming means for inverse Fourier transforming said frequency region sound image forming acoustic signal to said sound image forming acoustic signal which is a time region signal.

[0029] According to the above constitution, it becomes possible to generate sound image forming acoustic signals using the sound source acoustic signal, the panning information and the arrangement information.

[0030] A three-dimensional acoustic panning device according to the sixth invention provides said frequency region sound image forming acoustic signal generating means generates said sound image forming acoustic signal which forms a sound image acoustic physical quantity vector at the sound receiving point equal to the sound source acoustic physical quantity vector which is an acoustic physical quantity vector at the sound receiving point formed by panning the sound sources, which radiate the sound source acoustic signals, based on the panning information.

[0031] According to the above constitution, it becomes possible to pan the sound image three-dimensionally regardless the arrangement of loudspeakers.

[0032] A three-dimensional acoustic panning device according to the seventh invention provides said frequency region sound image forming acoustic signal generating means generates said sound image forming acoustic signal which forms a sound image acoustic physical quantity vector at the sound signal receiving area equal to a sound source acoustic physical quantity vector which is an acoustic physical quantity vector at the sound signal receiving area formed by panning the sound sources which radiate the sound source acoustic signals based on the panning information.

[0033] According to the above constitution, it becomes possible to position the sound images for a plurality of audiences.

[0034] A three-dimensional acoustic panning device according to the eighth invention provides a mixing means for mixing the sound source acoustic signals acquired by said sound source acoustic signal acquiring means.

[0035] According to the above constitution, it becomes possible not only to pan the sound source acoustic signals, but also to mix them.

Effect of the Invention

[0036] The present invention can provide a three-dimensional acoustic panning device enabling a three-dimensional-panning of a sound source by a three-dimensional panning of a sound image formed by a plurality of acoustic signals output from a plurality of loudspeakers regardless of arrangement of loudspeakers.

PREFERRED EMBODIMENT FOR CARRYING OUT THE INVENTION

[0037] Hereinafter, preferred embodiments of a three-dimensional acoustic panning device according to the present invention will be concretely described with referent to the drawings.

[0038] In the present description, an acoustic physical quantity vector is defined as an acoustic physical quantity at a sound receiving point where an acoustic signal radiated from a point sound source is received, that is, a vector consisting of at least one of acoustic pressure and acoustic particle velocity, or acoustic intensity vector equal to the value of integral between a predetermined period of the product of the acoustic particle velocity and the acoustic pressure of a scalar.

The First Embodiment

[0039] As shown in the block diagram of FIG. 1, the first embodiment of a three-dimensional acoustic panning device 1 comprises a sound source acoustic signal acquiring means 11 for acquiring a sound source acoustic signal s(t) radiated from at least one sound source C,

a panning information input means 12 for inputting an panning information I_pto pan the sound source C,

an sound image forming acoustic signal output means 13 for outputting sound image forming acoustic signals q(t) to form at least one sound image at the position where the sound source C is positioned,

an arrangement information storage means 14 for storing an arrangement information I_sof the sound image forming acoustic signal output means 13, and

a sound image forming acoustic signal generating means 15 for generating sound image forming acoustic signals q(t) using the sound source acoustic signals s(t), the panning information I_pand the arrangement information I_s.

[0040] And, the panning information input means 12 may include a directional information input means 121 for inputting at least one set of directional information I_pdconcerning the direction of the sound sources C viewed from the sound receiving point G and a distance information input means 122 for inputting at least one set of distance information I_prconcerning the distance between the sound receiving point G and the sound source C.

[0041] The panning information input means 12 may include a panning information storage means 123 for storing the panning information I_p.

[0042] The sound image forming acoustic signal output means 13 may include a recording/editing means 131 for recording and editing the sound image forming acoustic signal q(t).

[0043] The sound image forming acoustic signal generating means 15 comprises

a transforming means 151 for Fourier transforming the sound source acoustic signal s(t) to a frequency region sound source acoustic signal S(ω),

[0044] a frequency region sound image forming acoustic signal generating means 152 for generating a frequency region sound image forming acoustic signal Q(ω) using the frequency region sound source acoustic signal S(ω), the panning information I_pand the arrangement information I_s, and
an inverse transforming means 153 for inverse Fourier transforming the frequency domain sound image forming acoustic signal Q(ω) to the time region sound image forming acoustic signal q(t).

[0045] FIG. 2 is a block diagram showing a hardware configuration of the three-dimensional acoustic panning device according to the invention, and the device is comprised of a bus 20, an analog-digital (A/D) converter 21 for acquiring a sound source acoustic signal s(t) from the sound source, a digital-analog (D/A) converter 22 for outputting a sound image forming acoustic signal q(t), a CPU 23 for executing a three-dimensional acoustic panning program, a memory to store the three-dimensional acoustic panning program, and an interface (I/F) connected with peripheral devices for operating the three-dimensional acoustic panning device.

[0046] I/F 25 is connected to a display panel 261, a key-board 262, a mouse 263, a track ball 27 for inputting a directional information I_pdof the panning information I_pand a pan pod for inputting a distance information I_prof the panning information I_p. Note, a special operating panel may be applied instead of a display panel 261, a key-board 262 and a mouse 263.

[0047] That is, the three-dimensional acoustic panning device according to the invention is configured by installing the three-dimensional panning program to the computer 2.

[0048] FIG. 3 is a perspective view of track ball 27(a), and pan pod 28(b).

[0049] Track ball 27 has a structure that ball 272 is inserted in a recess well formed on track ball base 271, and ball 272 can be rolled to any directions.

[0050] The directional information of the sound source C centering on the sound receiving point G (rotational direction and rotational amount of the sound source) may be set by rotating ball 272 with a finger or a palm.

[0051] Pan pod 28 is a variable resister, for example, and distance information between the sound receiving point G and the sound source C may be set by sliding finger grip 282 on pan pod base 281.

[0052] FIG. 4 is a flowchart of the three-dimensional panning program to be installed in memory 24. At first, CPU 23 fetches the sound source acoustic signal s(t) from the sound source through A/D converter 21 (STEP S41).

[0053] The sound source acoustic signal s(t) from the sound source may be an acoustic signal stored in a storage device such as a hard-disc, or may be a live acoustic signal acquiring by microphones.

[0054] CPU 23 calculates the frequency region sound source acoustic signal S(ω) by Fourier transforming the sound source acoustic signal s(t) (STEP S42).

[0055] CPU 23 calculates the frequency region sound image forming acoustic signal Q(ω) by performing a panning process (STEP S43), and calculates a time domain sound image forming acoustic signal q(t) by inverse Fourier transforming the frequency domain sound image forming acoustic signal Q(ω) (STEP S44).

[0056] The process of STEP S43 will be explained in detail hereafter.

[0057] Finally, CPU 23 terminates this program after outputting the sound image forming acoustic signal q(t) through D/A converter 22 (STEP S45).

[0058] At STEP S43 of the three-dimensional acoustic panning program, CPU 23 generates the sound image forming acoustic signal q(t) which forms the sound image acoustic physical quantity vector V equal to the sound source acoustic physical quantity vector R, that is, an acoustic physical quantity vector formed at the sound receiving point G by panning the sound source C which radiates the sound source acoustic signal s(t) according to the panning information I_p.

[0059] At first, an acoustic physical quantity vector at the sound receiving point will be explained, when one point sound source and one sound receiving point are assumed.

[0060] The acoustic pressure p(t, r) of an acoustic wave radiated from the point sound source positioned at the origin of a three-dimensional space on the spherical surface with r in radius is determined by the wave equation [EQ. 1].

[0061]

\begin{matrix} \frac{\partial^{2}}{\partial t^{2}} (rp) = c^{2} \frac{\partial^{2}}{\partial r^{2}} (rp) Where c^{2} = \frac{K}{ρ} K = bulk modulus of air  ρ = density of air & [EQ . 1] \end{matrix}

[0062] Therefore, the acoustic pressure p(t, r) of an acoustic wave on the spherical surface with r in radius is denoted by [EQ. 2], when the sound source acoustic signal radiated from the point sound source is s(t).

[0063]

\begin{matrix} p (t, r) = \frac{A}{r} s (t - \frac{r}{c}) & [EQ . 2] \end{matrix}

[0064] Where•A=proportional constant determined by the amplitude of input signal and the acoustic pressure at the unit distance

[0065] [EQ. 2] shows that when a sound source acoustic signal s(t) radiated from a point sound source is received at one sound receiving point, an acoustic pressure at the sound receiving point decreases in inverse proportion to the distance between the point sound source and the sound receiving point, and has a delay of the propagation time from the point sound source to the sound receiving point.

[0066] [EQ. 2] is denoted as [EQ. 3] in the frequency region.

[0067]

\begin{matrix} P (ω, r) = \frac{A \cdot ⅇ^{- j kr}}{r} S (ω) = G_{p} (ω, r) \cdot S (ω) Where  j = \sqrt{- 1} k = \frac{ω}{c} = wave number (wavelength constant) ω = angular frequency ⅇ = base of natural logarithm  G_{p} (ω, r) = acoustic pressure transfer function  S (ω) = frequency region sound sorce acoustic signal & [EQ . 3] \end{matrix}

[0068] [EQ. 3] shows that the acoustic pressure at the sound receiving point is calculated by inverse Fourier conversion of a product of the acoustic pressure transfer function G_p(ω, r) which is a function of a distance between the point sound source and the sound receiving point and a frequency region sound source acoustic signal S(ω).

[0069] Because the distance between the point sound source and the sound receiving point, and the propagation time of the sound source acoustic signal is unambiguously determined when the coordinate values of the point sound source and the sound receiving point are determined in any coordinate systems, the acoustic pressure transfer function will be unambiguously determined when the coordinate values of the point sound source and the sound receiving point are determined.

[0070] When particle velocity of the sound source acoustic signal radiated from the point sound source positioned at the origin of the three-dimensional space is denoted by v(r, t)·e_r, (where e_r, is a unit vector of r-direction) the motion equation on the spherical surface with r in radius is denoted by [EQ. 4]

[0071]

\begin{matrix} ρ \frac{\partial v (r, t)}{\partial t} = - \frac{\partial p (t, r)}{\partial r} = - \frac{\partial}{\partial r} {\frac{1}{r} s (t - \frac{r}{c})} & [EQ . 4] \end{matrix}

[0072] The particle velocity v(r) is denoted as [EQ. 5] by solving [EQ. 4].

[0073]

\begin{matrix} v (r, t) = \frac{B}{ρ cr} s (t - \frac{r}{c}) + \frac{B}{ρ r^{2}} \int s (t - \frac{r}{c}) ⅆ (t - \frac{r}{c}) & [EQ . 5] \end{matrix}

[0074] Where B=proportional constant determined by the amplitude of the input signal and the acoustic pressure at the unit distance

[0075] [EQ. 5] is denoted as [EQ. 6] in the frequency region.

[0076]

\begin{matrix} \begin{matrix} V (ω, r) = \frac{B \cdot ⅇ^{- j kr}}{ρ cr} S (ω) + \frac{B \cdot ⅇ^{- j kr}}{j ω ρ r^{2}} S (ω) \\ = \frac{B \cdot ⅇ^{- j kr}}{ρ cr} (1 + \frac{1}{j kr}) S (ω) \\ = G_{v} (ω, r) \cdot S (ω) \end{matrix} & [EQ . 6] \end{matrix}

Where G_v(ω,r)=particle velocity transfer function

[0077] Therefore, the acoustic physical quantity vector P_kconsisting of the acoustic pressure p(t, r) and the particle velocity vector v(t, r)·e_rat the sound receiving point k is defined by [EQ. 7].

[0078]

\begin{matrix} P_{k} = [\begin{matrix} P (ω, r) \\ V_{x} (ω, r) \\ V_{y} (ω, r) \\ V_{z} (ω, r) \end{matrix}] = [\begin{matrix} G_{p} (ω, r) \\ G_{vx} (ω, r) \\ G_{vy} (ω, r) \\ G_{vz} (ω, r) \end{matrix}] S (ω) & [EQ . 7] \end{matrix}

Where, when e_x, e_yand e_zdenote x, y and z components of n unit vector e_rrespectively, the following equations are established.
V_x(ω,r)=V(ω,r)·e_x, V_y(ω,r)=V(ω,r)·e_y, V_z(ω,r)=V(ω,r)·e_z
G_vx(ω,r)=G_v(ω,r)·e_x, G_vy(ω,r)=G_v(ω,r)·e_y, G_vz(ω,r)=G_v(ω,r)·e_z

[0079] The acoustic physical quantity vector P_kmay consist of one of the acoustic pressure p(t, r) and the particle velocity vector v(t, r)·e_r.

[0080] Moreover, the acoustic physical quantity vector P_kmay consist of an instant acoustic intensity II(t, r) which is a product of the acoustic pressure p(t, r) and the particle velocity vector v(t, r)·e_r, or an acoustic intensity I(t, r) which is an integration value of the instant acoustic intensity II(t, r) over some time interval.

[0081] Note, the instant acoustic intensity II(t, r) is defined by [EQ. 8] and the acoustic intensity I(t, r) is defined by [EQ. 9].

[0082]

\begin{matrix} II (t, r) = p (t, r) \cdot v (t, r) \cdot e_{r} & [EQ . 8] \\ I (t, r) = \int_{t_{1}}^{t_{2}} II (t, r) ⅆ t = \int_{t_{1}}^{t_{2}} p (t, r) \cdot v (t, r) \cdot e_{r} ⅆ t & [EQ . 9] \end{matrix}

[0083] The following embodiments use the acoustic pressure as the acoustic physical quantity vector.

[0084] The coordinates of a sound source positioned in the space having the origin at the sound receiving point G is denoted as C(r_c(τ), θ_c(τ), φ_c(τ)), and then the sound source acoustic pressure vector R is defined by [EQ. 10].

[0085]

\begin{matrix} R = [\begin{matrix} R_{x} \\ R_{y} \\ R_{z} \end{matrix}] = - [\begin{matrix} \frac{ⅇ^{- j {kr}_{c} (τ)}}{r_{c} (τ)} \cos ϕ_{c} (τ) \cos θ_{c} (τ) \\ \frac{ⅇ^{- j {kr}_{c} (τ)}}{r_{c} (τ)} \cos ϕ_{c} (τ) \sin θ_{c} (τ) \\ \frac{ⅇ^{- j {kr}_{c} (τ)}}{r_{c} (τ)} \sin ϕ_{c} (τ) \end{matrix}] S (ω) & [EQ . 10] \end{matrix}

Where

- [0086] θ_c(τ)=azimuth of the sound source
- [0087] φ_c(τ)=elevation angle of the sound source
- [0088] r_c(τ)=the distance between the sound source and the sound receiving point
- [0089] τ=time code concerning panning of the sound source

[0090] If a loudspeaker SP_i(i=1, 2 . . . I) working as the sound image forming acoustic signal output means 13 is positioned at SP_i(r_i, θ_i, φ_i), a sound image acoustic pressure vector V which is an acoustic pressure at the origin when the loudspeakers SP; radiate frequency region sound image forming acoustic signals Q_i(ω) (i=1, 2 . . . I) is defined by [EQ. 11].

[0091]

\begin{matrix} V = A \cdot [\begin{matrix} \sum_{i = 1}^{I} \frac{ⅇ^{- j {kr}_{i}}}{r_{i}} \cos ϕ_{i} \cos θ_{i} Q_{i} (ω) \\ \sum_{i = 1}^{I} \frac{ⅇ^{- j {kr}_{i}}}{r_{i}} \cos ϕ_{i} \sin θ_{i} Q_{i} (ω) \\ \sum_{i = 1}^{I} \frac{ⅇ^{- j {kr}_{i}}}{r_{i}} \sin ϕ_{i} Q_{i} (ω) \end{matrix}] & [EQ . 11] \end{matrix}

Where

- [0092] θ_i=azimuth of the loudspeaker S P_i
- [0093] φ_i=elevation angle of the loudspeaker S P_i
- [0094] r_i=distance between the origin and the loudspeaker S P_i

[0095] If Q₁(ω), Q₂(ω) . . . Q_I(ω) are determined so that [EQ. 12] is established, and are output from the loudspeaker after inverse transferring into the time domain, it is realized to reproduce the satiation where the sound source acoustic signal s(t) is being panned by radiating the sound image forming acoustic signal q(t) from the laud speakers positioned at the predetermined positions.
R=V [EQ. 12]

[0096] To determine the sound image forming acoustic signals q₁(t), q₂(t) . . . q_I(t) so that [EQ. 12] is established, these signals are determined so that the square error E between the sound source acoustic pressure vector R and the sound image acoustic pressure vector V denoted by [EQ. 13] becomes minimum.
E=∥R−V∥² [EQ. 13]

[0097] [EQ. 13] is developed to [EQ. 14] by assigning [EQ. 10] and [EQ. 11] to [EQ. 13].

[0098]

\begin{matrix} [EQ . 14] \\ E = [\frac{ⅇ^{- j {kr}_{c} (τ)}}{r_{c} (τ)} \cos ϕ_{c} (τ) \cos θ_{c} (τ) S (ω) - \sum_{i = 1}^{I} \frac{ⅇ^{- j {kr}_{i}}}{r_{i}} \cos ϕ_{i} \cos θ_{i} Q_{i} (ω)] \times \\ {[\frac{ⅇ^{- j {kr}_{c} (τ)}}{r_{c} (τ)} \cos ϕ_{c} (τ) \cos θ_{c} (τ) S (ω) - \sum_{i = 1}^{I} \frac{ⅇ^{- j {kr}_{i}}}{r_{i}} \cos ϕ_{i} \cos θ_{i} Q_{i} (ω)]}^{*} + \\ [\frac{ⅇ^{- j {kr}_{c} (τ)}}{r_{c} (τ)} \cos ϕ_{c} (τ) \sin θ_{c} (τ) S (ω) - \sum_{i = 1}^{I} \frac{ⅇ^{- j {kr}_{i}}}{r_{i}} \cos ϕ_{i} \sin θ_{i} Q_{i} (ω)] \times \\ {[\frac{ⅇ^{- j {kr}_{c} (τ)}}{r_{c} (τ)} \cos ϕ_{c} (τ) \sin θ_{c} (τ) S (ω) - \sum_{i = 1}^{I} \frac{ⅇ^{- j {kr}_{i}}}{r_{i}} \cos ϕ_{i} \sin θ_{i} Q_{i} (ω)]}^{*} + \\ [\frac{ⅇ^{- j {kr}_{c} (τ)}}{r_{c} (τ)} \sin ϕ_{c} (τ) S (ω) - \sum_{i = 1}^{I} \frac{ⅇ^{- j {kr}_{i}}}{r_{i}} \sin ϕ_{i} Q_{i} (ω)] \times \\ {[\frac{ⅇ^{- j {kr}_{c} (τ)}}{r_{c} (τ)} \sin ϕ_{c} (τ) S (ω) - \sum_{i = 1}^{I} \frac{ⅇ^{- j {kr}_{i}}}{r_{i}} \sin ϕ_{i} Q_{i} (ω)]}^{*} \end{matrix}

Where [X]* denotes the conjugate of [X]

[0099] [EQ. 14] is modified to [EQ. 16] by using [EQ. 15].

[0100]

\begin{matrix} \begin{matrix} [EQ . 15] \end{matrix} \\ a = \frac{ⅇ^{- j {kr}_{c} (τ)}}{r_{c} (τ)} \cos ϕ_{c} (τ) \cos θ_{c} (τ) \\ b = \frac{ⅇ^{- j {kr}_{c} (τ)}}{r_{c} (τ)} \cos ϕ_{c} (τ) \sin θ_{c} (τ) \\ c = \frac{ⅇ^{- j {kr}_{c} (τ)}}{r_{c} (τ)} \sin ϕ_{c} (τ) \\ {\tilde{a}}_{i} = \frac{ⅇ^{- j {kr}_{i}}}{r_{i}} \cos ϕ_{i} \cos θ_{i} \\ {\tilde{b}}_{i} = \frac{ⅇ^{- j {kr}_{i}}}{r_{i}} \cos ϕ_{i} \sin θ_{i} \\ {\tilde{c}}_{i} = \frac{ⅇ^{- j {kr}_{i}}}{r_{i}} \sin ϕ_{i} \\ \begin{matrix} [EQ . 16] \end{matrix} \\ \begin{matrix} E = (a \cdot S (ω) - \sum_{i = 1}^{I} {\tilde{a}}_{i} \cdot Q_{i} (ω)) \times {(a \cdot S (ω) - \sum_{i = 1}^{I} {\tilde{a}}_{i} \cdot Q_{i} (ω))}^{*} + \\ (b \cdot S (ω) - \sum_{i = 1}^{I} {\tilde{b}}_{i} \cdot Q_{i} (ω)) \times {(b \cdot S (ω) - \sum_{i = 1}^{I} {\tilde{b}}_{i} \cdot Q_{i} (ω))}^{*} + \\ (c \cdot S (ω) - \sum_{i = 1}^{I} {\tilde{c}}_{i} \cdot Q_{i} (ω)) \times {(c \cdot S (ω) - \sum_{i = 1}^{I} {\tilde{c}}_{i} \cdot Q_{i} (ω))}^{*} \end{matrix} \\ \begin{matrix} = S (ω) (a \cdot a^{*} + b \cdot b^{*} + c \cdot c^{*}) {S (ω)}^{*} + \\ \sum_{i = 1}^{I} \sum_{i^{'} = 1}^{I} Q_{i} (ω) ({\tilde{a}}_{i} \cdot {\tilde{a}}_{i^{'}}^{*} + {\tilde{b}}_{i} \cdot {\tilde{b}}_{i^{'}}^{*} + {\tilde{c}}_{i} \cdot {\tilde{c}}_{i^{'}}) {Q_{i^{'}} (ω)}^{*} - \\ \sum_{i = 1}^{I} Q_{i} (ω) ({\tilde{a}}_{i} \cdot a^{*} + {\tilde{b}}_{i} \cdot b^{*} + {\tilde{c}}_{i} \cdot c^{*}) {S (ω)}^{*} - \\ \sum_{i = 1}^{I} S (ω) ({\tilde{a}}_{i}^{*} \cdot a + {\tilde{b}}_{i}^{*} \cdot b + {\tilde{c}}_{i}^{*} \cdot c) {Q_{i} (ω)}^{*} \end{matrix} \\ \begin{matrix} = S (ω) \cdot h_{0} \cdot {S (ω)}^{*} + {Q (ω)}^{T} \cdot H \cdot {Q (ω)}^{*} - {Q (ω)}^{T} \cdot h \cdot {S (ω)}^{*} - \\ S (ω) \cdot {(h^{*})}^{T} \cdot {Q (ω)}^{*} \end{matrix} \\ Where \\ h_{0} = a \cdot a^{*} + b \cdot b^{*} + c \cdot c^{*} \\ Q (ω) = {[\begin{matrix} Q_{1} (ω) & Q_{2} (ω) & Q_{3} (ω) \end{matrix}]}^{T} \\ h = [\begin{matrix} {\tilde{a}}_{1} \cdot a^{*} + {\tilde{b}}_{1} \cdot b^{*} + {\tilde{c}}_{1} \cdot c^{*} \\ ⋮ \\ {\tilde{a}}_{I} \cdot a^{*} + {\tilde{b}}_{I} \cdot b^{*} + {\tilde{c}}_{I} \cdot c^{*} \end{matrix}] \\ H = [\begin{matrix} {\tilde{a}}_{1} \cdot {\tilde{a}}_{1}^{*} + {\tilde{b}}_{1} \cdot {\tilde{b}}_{1}^{*} + {\tilde{c}}_{1} \cdot {\tilde{c}}_{1}^{*} & \dots & {\tilde{a}}_{1} \cdot {\tilde{a}}_{I}^{*} + {\tilde{b}}_{1} \cdot {\tilde{b}}_{I}^{*} + {\tilde{c}}_{1} \cdot {\tilde{c}}_{I}^{*} \\ ⋮ & ⋱ & ⋮ \\ {\tilde{a}}_{I} \cdot {\tilde{a}}_{1}^{*} + {\tilde{b}}_{I} \cdot {\tilde{b}}_{1}^{*} + {\tilde{c}}_{I} \cdot {\tilde{c}}_{1}^{*} & \dots & {\tilde{a}}_{I} \cdot {\tilde{a}}_{I}^{*} + {\tilde{b}}_{I} \cdot {\tilde{b}}_{I}^{*} + {\tilde{c}}_{I} \cdot {\tilde{c}}_{I}^{*} \end{matrix}] \end{matrix}

[0101] The frequency region sound image forming acoustic signal Q(ω) which makes the square error E minimum is determined by [EQ. 17] showing that E partially differentiated by Q(ω) is zero.

[0102]

\begin{matrix} \frac{\partial E}{\partial Q (ω)} = H \cdot {Q (ω)}^{*} - h \cdot {S (ω)}^{*} = 0 & [EQ.  17] \end{matrix}

[0103] Therefore, [EQ. 18] is established.
Q(ω)*=H⁻¹·h·S(ω)* [EQ. 18]

[0104] Then, the frequency region sound image forming acoustic signal Q(ω) which makes the square error E minimum is calculated from [EQ. 19].

[0105]

\begin{matrix} Q (ω) = [\begin{matrix} Q_{1} (ω) \\ Q_{2} (ω) \\ Q_{3} (ω) \end{matrix}] = {(H^{- 1} \cdot h)}^{*} \cdot S (ω) & [EQ.  19] \end{matrix}

[0106] FIG. 5 is a flowchart of the panning routine executed at STEP S43 of the three dimensional acoustic panning program. At first, CPU 23 fetches the loudspeaker arrangement information (r₁, θ₁, φ₁), (r₂, θ₂, φ₂) . . . (r_I, θ_I, φ_I). (STEP S431)

[0107] Secondly, CPU 23 fetches the panning information consisting the directional information I_pd=(θ(τ), φ(τ)) input by the track ball 27 shown in FIG. 3(a), and the distance information I_pr=r(τ) input by the pan pod 28 shown in FIG. 3(b). (STEP S432)

[0108] Then, CPU 23 calculates the coefficients a, b, c, etc., by [EQ. 15]. (STEP S433)

[0109] CPU 23 calculates the matrix H and the matrix h by [EQ. 16]. (STEP S434)

[0110] Finally, CPU 23 terminates the routine after calculating the frequency region sound image forming acoustic signal Q (ω). (STEP S435)

[0111] At this moment, the condition to placement the sound image applying the acoustic signal radiated by two loudspeakers is considered.

[0112] The sound receiving point J is the origin of X-Y coordinate system, the left side loudspeaker SL is arranged at the position with distance d from the sound receiving point J and with angle 30 degrees from the left side of Y-axis, and the right side loudspeaker is arranged at the position with distance d from the sound receiving point J and with angle 30 degrees from the right side of Y-axis.

[0113] The sound source SS is positioned at the position with distance D from the sound receiving point J and with angle θ from Y-axis. Note, the angle θ is defined by zero when the sound source is positioned on Y axis, by positive value at the right side of Y axis, and by negative value at the left side of Y axis.

[0114] In the above case, the coefficient of [EQ. 15] is defined by [EQ. 20].

[0115]

\begin{matrix} \begin{matrix} a = \frac{- \sin θ}{D} ⅇ^{- j kD} & b = \frac{- \cos θ}{D} ⅇ^{- j kD} & c = 0 \\ {\tilde{a}}_{1} = \frac{1}{2 d} ⅇ^{- j kd} & {\tilde{b}}_{1} = \frac{- \sqrt{3}}{2 d} ⅇ^{- j kd} & {\tilde{c}}_{1} = 0 \\ {\tilde{a}}_{2} = \frac{- 1}{2 d} ⅇ^{- j kd} & {\tilde{b}}_{2} = \frac{- \sqrt{3}}{2 d} ⅇ^{- j kd} & {\tilde{c}}_{2} = 0 \end{matrix} & [EQ.  20] \end{matrix}

Where ã₁, {tilde over (b)}₁, {tilde over (c)}₁are the coefficients concerning the left side loudspeaker SL

- [0116] ã₂, {tilde over (b)}₂, {tilde over (c)}₂are the coefficients concerning the right side loudspeaker SR

[0117] And, [EQ. 16] is defined by [EQ. 21].

[0118]

\begin{matrix} h = [\begin{matrix} \frac{- \sin θ}{2 dD} ⅇ^{- j k (d - D)} + \frac{\sqrt{3} \cos θ}{2 dD} ⅇ^{- j k (d - D)} \\ \frac{\sin θ}{2 dD} ⅇ^{- j k (d - D)} + \frac{\sqrt{3} \cos θ}{2 dD} ⅇ^{- j k (d - D)} \end{matrix}] & [EQ.  21] \\ H = \frac{1}{d^{2}} [\begin{matrix} 1 & \frac{1}{2} \\ \frac{1}{2} & 1 \end{matrix}] \end{matrix}

[0119] Therefore, the output of the left side loudspeaker SL Q₁(ω) and the output of the right side loudspeaker SR Q₂(ω) are determined by [EQ. 22].

[0120]

\begin{matrix} [\begin{matrix} Q_{1} (ω) \\ Q_{2} (ω) \end{matrix}] = [\begin{matrix} \frac{d}{D} \cos {k (d - D)} (- \sin θ + \frac{1}{\sqrt{3}} \cos θ) S (ω) \\ \frac{d}{D} \cos {k (d - D)} (\sin θ + \frac{1}{\sqrt{3}} \cos θ) S (ω) \end{matrix}] & [EQ.  22] \end{matrix}

[0121] When d=D, the panning by [EQ. 22] is identical with the panning by the known tangent law panning, and by the vector base amplitude panning.

[0122] As mentioned above, the first embodiment of the three dimensional acoustic panning device can be applied to the case where d is not equal D, and recognized as the modification of the conventional tangent law panning or the conventional vector base amplitude panning.

The Second Embodiment

[0123] The second embodiment is the case where I=3 in the first embodiment, and makes it possible to pan the sound image in the trigonal pyramid whose ridge lines are lines to connect the sound receiving point with each of the three loudspeakers.

[0124] In this case, the sound image acoustic pressure vector V is denoted by [EQ. 23].

[0125]

\begin{matrix} V = - [\begin{matrix} \sum_{i = 1}^{3} \frac{ⅇ^{- j {kr}_{i}}}{r_{i}} \cos ϕ_{i} \cos θ_{i} Q_{i} (ω) \\ \sum_{i = 1}^{3} \frac{ⅇ^{- j {kr}_{i}}}{r_{i}} \cos ϕ_{i} \sin θ_{i} Q_{i} (ω) \\ \sum_{i = 1}^{3} \frac{ⅇ^{- j {kr}_{i}}}{r_{i}} \sin ϕ_{i} Q_{i} (ω) \end{matrix}] & [EQ.  23] \end{matrix}

Where

- [0126] θ_i=azimuth of the loudspeaker S P_i
- [0127] φ_i=elevation angle of the loudspeaker S P_i
- [0128] r_i=distance between the origin and the loudspeaker S P_i

[0129] The matrix H and the matrix h are denoted by [EQ. 24].

[0130]

\begin{matrix} \begin{matrix} [EQ.  24] \end{matrix} \\ h = [\begin{matrix} {\tilde{a}}_{1} \cdot a^{*} + {\tilde{b}}_{1} \cdot b^{*} + {\tilde{c}}_{1} \cdot c^{*} \\ {\tilde{a}}_{2} \cdot b^{*} + {\tilde{b}}_{2} \cdot b^{*} + {\tilde{c}}_{2} \cdot c^{*} \\ {\tilde{a}}_{3} \cdot a^{*} + {\tilde{b}}_{3} \cdot b^{*} + {\tilde{c}}_{3} \cdot c^{*} \end{matrix}] \\ H = [\begin{matrix} \begin{matrix} {\tilde{a}}_{1} \cdot {\tilde{a}}_{1}^{*} + {\tilde{b}}_{1} \cdot {\tilde{b}}_{1}^{*} + {\tilde{c}}_{1} \cdot {\tilde{c}}_{1}^{*} \\ {\tilde{a}}_{2} \cdot {\tilde{a}}_{1}^{*} + {\tilde{b}}_{2} \cdot {\tilde{b}}_{1}^{*} + {\tilde{c}}_{2} \cdot {\tilde{c}}_{1}^{*} \\ {\tilde{a}}_{3} \cdot {\tilde{a}}_{1}^{*} + {\tilde{b}}_{3} \cdot {\tilde{b}}_{1}^{*} + {\tilde{c}}_{3} \cdot {\tilde{c}}_{1}^{*} \end{matrix} & \begin{matrix} {\tilde{a}}_{1} \cdot {\tilde{a}}_{2}^{*} + {\tilde{b}}_{1} \cdot {\tilde{b}}_{2}^{*} + {\tilde{c}}_{1} \cdot {\tilde{c}}_{2}^{*} \\ {\tilde{a}}_{2} \cdot {\tilde{a}}_{2}^{*} + {\tilde{b}}_{2} \cdot {\tilde{b}}_{2}^{*} + {\tilde{c}}_{2} \cdot {\tilde{c}}_{2}^{*} \\ {\tilde{a}}_{3} \cdot {\tilde{a}}_{2}^{*} + {\tilde{b}}_{3} \cdot {\tilde{b}}_{2}^{*} + {\tilde{c}}_{3} \cdot {\tilde{c}}_{2}^{*} \end{matrix} & \begin{matrix} {\tilde{a}}_{1} \cdot {\tilde{a}}_{3}^{*} + {\tilde{b}}_{1} \cdot {\tilde{b}}_{3}^{*} + {\tilde{c}}_{1} \cdot {\tilde{c}}_{3}^{*} \\ {\tilde{a}}_{2} \cdot {\tilde{a}}_{3}^{*} + {\tilde{b}}_{2} \cdot {\tilde{b}}_{3}^{*} + {\tilde{c}}_{2} \cdot {\tilde{c}}_{3}^{*} \\ {\tilde{a}}_{3} \cdot {\tilde{a}}_{3}^{*} + {\tilde{b}}_{3} \cdot {\tilde{b}}_{3}^{*} + {\tilde{c}}_{3} \cdot {\tilde{c}}_{3}^{*} \end{matrix} \end{matrix}] \end{matrix}

[0131] Then, the time region sound image forming acoustic signal q(t) denoted by [EQ. 25] is determined by inverse Fourier converting the frequency region sound image forming acoustic signal Q(ω).

[0132]

\begin{matrix} \begin{matrix} [EQ.  25] \end{matrix} \\ q_{i} (t, τ) = σ (r_{i}, r_{c} (τ)) Φ_{i} (θ_{1}, θ_{2}, θ_{3}, ϕ_{1}, ϕ_{2}, ϕ_{3}, θ_{c} (τ), ϕ_{c} (τ)) s (t - \frac{r_{c} (τ) - r_{i}}{c}) \\ Where \\ σ (r_{i}, r_{c} (τ)) - \frac{r_{i}}{r_{c} (τ)} \\ Φ_{1} (θ_{1}, θ_{2}, θ_{3}, ϕ_{1}, ϕ_{2}, ϕ_{3}, θ_{c} (τ), ϕ_{c} (τ)) = \frac{N_{1}}{D} \\ Φ_{2} (θ_{1}, θ_{2}, θ_{3}, ϕ_{1}, ϕ_{2}, ϕ_{3}, θ_{c} (τ), ϕ_{c} (τ)) = \frac{N_{2}}{D} \\ Φ_{3} (θ_{1}, θ_{2}, θ_{3}, ϕ_{1}, ϕ_{2}, ϕ_{3}, θ_{c} (τ), ϕ_{c} (τ)) = \frac{N_{3}}{D} \\ N_{1} = \cos ϕ_{2} \sin ϕ_{3} \sin (θ_{2} - θ_{c} (τ)) \cos ϕ_{c} (τ) + \sin ϕ_{2} \cos ϕ_{3} \sin (θ_{c} (τ) - θ_{3}) \cos ϕ_{c} (τ) + \cos ϕ_{2} \cos ϕ_{3} \sin (θ_{3} - θ_{2}) \sin ϕ_{c} (τ) \\ N_{2} = \cos ϕ_{3} \sin ϕ_{1} \sin (θ_{3} - θ_{c} (τ)) \cos ϕ_{c} (τ) + \sin ϕ_{3} \cos ϕ_{1} \sin (θ_{c} (τ) - θ_{1}) \cos ϕ_{c} (τ) + \cos ϕ_{3} \cos ϕ_{1} \sin (θ_{1} - θ_{3}) \sin ϕ_{c} (τ) \\ N_{3} = \cos ϕ_{1} \sin ϕ_{2} \sin (θ_{1} - θ_{c} (τ)) \cos ϕ_{c} (τ) + \sin ϕ_{1} \cos ϕ_{2} \sin (θ_{c} (τ) - θ_{2}) \cos ϕ_{c} (τ) + \cos ϕ_{1} \cos ϕ_{2} \sin (θ_{2} - θ_{1}) \sin ϕ_{c} (τ) \\ D = \sin ϕ_{1} \cos ϕ_{2} \cos ϕ_{3} \sin (θ_{3} - θ_{2}) + \cos ϕ_{1} \sin ϕ_{2} \cos ϕ_{3} \sin (θ_{1} - θ_{3}) + \cos ϕ_{1} \cos θ_{2} \sin ϕ_{3} \sin (θ_{2} - θ_{1}) \end{matrix}

[0133] As described above, the second embodiment makes it possible to pan the sound image within the trigonal pyramid whose ridge lines are lines to connect the sound receiving point with each of the three loudspeakers.

The Third Embodiment

[0134] The third embodiment enables to pan a sound image to an arbitrary position by applying more than 4 loudspeakers.

[0135] FIG. 8 is a perspective view to explain a case of panning a sound image from C₁to C₂by arranging eight loudspeakers SP₁-SP₈, and the sound image is panned from an initial position C₁located in the trigonal pyramid whose ridge lines are lines to connect the sound receiving point G with each of the three loudspeakers SP₂, SP₃and SP₄, to the terminal position C₂located in the trigonal pyramid whose ridge lines are lines to connect the sound receiving point G with each of the three loudspeakers SP₅, SP₆and SP₇.

[0136] Because an intersecting point of the trajectory of the sound image with a surface of the trigonal pyramid can be preliminary calculated, it becomes possible to pan a sound image to an arbitrary position by applying the second embodiment to each of trigonal pyramids.

The Forth Embodiment

[0137] The above embodiments make it possible to pan one sound source, but the present invention makes it possible to simultaneously pan a plurality of sound sources each of which keeps a constant relative position each other.

[0138] When there are M peaces of sound sources, the sound source acoustic pressure vector R generated by the sound source acoustic signals radiated from the M peaces of sound sources at the sound receiving point G is denoted by [EQ. 26] when the position of m-th loudspeaker is denoted by C_m(r_cm(τ), θ_cm(τ), φ_cm(τ)) (1≦m≦M).

[0139]

\begin{matrix} \begin{matrix} R = [\begin{matrix} \sum_{m = 1}^{M} R_{xm} \\ \sum_{m = 1}^{M} R_{ym} \\ \sum_{m = 1}^{M} R_{zm} \end{matrix}] \\ = - [\begin{matrix} \sum_{m = 1}^{M} \frac{ⅇ^{- j {kr}_{c m} (τ)}}{r_{c m} (τ)} \cos ϕ_{c m} (τ) \cos θ_{c m} (τ) S_{m} (ω) \\ \sum_{m = 1}^{M} \frac{ⅇ^{- j {kr}_{c m} (τ)}}{r_{c m} (τ)} \cos ϕ_{c m} (τ) \sin θ_{c m} (τ) S_{m} (ω) \\ \sum_{m = 1}^{M} \frac{ⅇ^{- j {kr}_{c m} (τ)}}{r_{c m} (τ)} \sin ϕ_{c m} (τ) S_{m} (ω) \end{matrix}] \end{matrix} & [EQ . 26] \end{matrix}

[0140] When the positions of three loudspeakers SP_mi(i=1, 2, 3) which generates the acoustic filed where m-th sound source C_mbelongs to, are denoted SP_mi(r_mi, θ_mi, φ_mi), the sound image acoustic pressure vector V_mgenerated by the frequency region sound image forming acoustic signal Q_mi(ω) radiated from the loudspeaker SP_mi, and V being overlapped with V_m, are denoted by [EQ. 27].

[0141]

\begin{matrix} V_{m} = - [\begin{matrix} \sum_{i = 1}^{3} \frac{ⅇ^{- j {kr}_{m i}}}{r_{m i}} \cos ϕ_{m i} \cos θ_{m i} Q_{m i} (ω) \\ \sum_{i = 1}^{3} \frac{ⅇ^{- j {kr}_{m i}}}{r_{m i}} \cos ϕ_{m i} \sin θ_{m i} Q_{m i} (ω) \\ \sum_{i = 1}^{3} \frac{ⅇ^{- j {kr}_{m i}}}{r_{m i}} \sin ϕ_{m i} Q_{m i} (ω) \end{matrix}] & [EQ . 27] \\ V = \sum_{m = 1}^{M} V_{m} \end{matrix}

[0142] Therefore, it becomes possible to simultaneously pan a plurality of sound sources each of which keeps a constant relative position each other by applying [EQ. 25] and [EQ. 26] instead of [EQ. 10] and [EQ. 22].

The Fifth Embodiment

[0143] The fifth embodiment is the three-dimensional acoustic panning device according to the present invention having devices necessary to product radio programs or TV programs, and include a panning information storage means 123 to store the panning information I_p, and a recording/editing means 131 to record and edit the sound image forming acoustic signal q(t).

[0144] The panning information storage means 123 works to store the panning information I_pwhich includes the operation information of track ball 27 and pan pod 28, and makes it possible to repeat the same panning operation to a plurality of the sound sources.

[0145] The recording/editing means 131 works to record a plurality of the sound image forming acoustic signals q(t)'s and overlap them, and make it possible to generate the sound image forming acoustic signal when a plurality of the sound sources are panned respectively.

[0146] Now, the case where N groups of sound source groups each of which contains M_npeaces of sound sources are panned by a unique panning operation respectively is considered.

[0147] When the position of the m_n-th sound source belonging to n-th sound source group is denoted by C_mn(r_cmn, θ_cmn(τ), φ_cmn(τ)), the sound source acoustic pressure vector R_nat the sound receiving point G formed by the sound source acoustic signals radiated from M_npeaces of sound sources, and the sound source acoustic pressure vector R at the sound receiving point formed by the sound source acoustic signals radiated M₁+M₂+ . . . +M_Npeaces of sound sources are denoted by [EQ. 28].

[0148]

\begin{matrix} \begin{matrix} R_{n} = [\begin{matrix} \sum_{mn = 1}^{M_{n}} R_{xmn} \\ \sum_{mn = 1}^{M_{n}} R_{ymn} \\ \sum_{mn = 1}^{M_{n}} R_{zmn} \end{matrix}] \\ = - [\begin{matrix} \sum_{m_{n} = 1}^{M_{n}} \frac{ⅇ^{- j {kr}_{c mn} (τ)}}{r_{c mn}} \cos ϕ_{c mn} (τ) \cos θ_{c mn} (τ) S_{mn} (ω) \\ \sum_{m_{n} = 1}^{M_{n}} \frac{ⅇ^{- j {kr}_{c mn} (τ)}}{r_{c mn}} \cos ϕ_{c mn} (τ) \sin θ_{c mn} (τ) S_{mn} (ω) \\ \sum_{m_{n} = 1}^{M} \frac{ⅇ^{- j {kr}_{c mn}}}{r_{c mn}} \sin ϕ_{c mn} (τ) S_{mn} (ω) \end{matrix}] \end{matrix} R = \sum_{n = 1}^{N} R_{n} & [EQ . 28] \end{matrix}

[0149] When the positions of three loudspeakers SP_mni(i=1, 2, 3) which generates the acoustic filed where m_n-th sound source C_mnin n-th sound source group belongs to, are denoted SP_mni(r_mni, θ_mni, φ_mni), the sound image acoustic pressure vector V_mngenerated by the frequency region sound image forming acoustic signal Q_mni(ω) radiated from the loudspeaker SP_mni, V_nbeing overlapped with V_mn, and V being overlapped with V_nare denoted by [EQ. 29].

[0150]

\begin{matrix} \begin{matrix} V_{mn} = - [\begin{matrix} \sum_{i = 1}^{3} \frac{ⅇ^{- j {kr}_{mni}}}{r_{mni}} \cos ϕ_{mni} \cos θ_{mni} Q_{mni} (ω) \\ \sum_{i = 1}^{3} \frac{ⅇ^{- j {kr}_{mni}}}{r_{mni}} \cos ϕ_{mni} \sin θ_{mni} Q_{mni} (ω) \\ \sum_{i = 1}^{3} \frac{ⅇ^{- j {kr}_{mni}}}{r_{mni}} \sin ϕ_{mni} Q_{mni} (ω) \end{matrix}] \\ V_{n} = \sum_{mn = 1}^{Mn} V_{mn} \\ V = \sum_{n = 1}^{N} V_{n} \end{matrix} & [EQ . 29] \end{matrix}

[0151] Therefore, it becomes possible to simultaneously pan a plurality of sound sources by applying [EQ. 28] and [EQ. 29] instead of [EQ. 10] and [EQ. 22].

The Sixth Embodiment

[0152] The above mentioned embodiment is the case where the sound source acoustic signals are received at one sound receiving point, but the sixth embodiment is the case where the sound source acoustic signals are received at one sound receiving field F.

[0153] Then, the sixth embodiment applies [EQ. 30] as the square error E between the sound source acoustic pressure vector R and the sound image acoustic pressure vector V.

[0154]

\begin{matrix} \begin{matrix} E = \int_{V}  R - V  ⅆ V \\ = S (ω) \cdot h_{o} \cdot {S (ω)}^{*} + {Q (ω)}^{T} \cdot H \cdot {Q (ω)}^{*} - {Q (ω)}^{T} \cdot h \cdot {S (ω)}^{*} - \\ S (ω) \cdot {(h^{*})}^{T} \cdot {Q (ω)}^{*} \end{matrix} h_{0} = \int_{V} (a \cdot a^{*} + b \cdot b^{*} + c \cdot c^{*}) ⅆ V h = [\begin{matrix} \int_{V} (\tilde{a_{1}} \cdot a^{*} + {\tilde{b}}_{1} \cdot b^{*} + {\tilde{c}}_{1} \cdot c^{*}) ⅆ V \\ ⋮ \\ \int_{V} ({\tilde{a}}_{M} \cdot a^{*} + {\tilde{b}}_{M} \cdot b^{*} + {\tilde{c}}_{M} \cdot c^{*}) ⅆ V \end{matrix}] H = [\begin{matrix} \int_{V} (\begin{matrix} \tilde{a_{1}} \cdot {\tilde{a}}_{1}^{*} + {\tilde{b}}_{1} \cdot \\ {\tilde{b}}_{1}^{*} + {\tilde{c}}_{1} \cdot {\tilde{c}}_{1}^{*} \end{matrix}) ⅆ V & \dots & \int_{V} (\begin{matrix} \tilde{a_{1}} \cdot {\tilde{a}}_{M}^{*} + {\tilde{b}}_{1} \cdot \\ {\tilde{b}}_{M}^{*} + {\tilde{c}}_{1} \cdot {\tilde{c}}_{M}^{*} \end{matrix}) ⅆ V \\ ⋮ & ⋱ & ⋮ \\ \int_{V} (\begin{matrix} \tilde{a_{M}} \cdot {\tilde{a}}_{1}^{*} + {\tilde{b}}_{M} \cdot \\ {\tilde{b}}_{1}^{*} + {\tilde{c}}_{M} \cdot {\tilde{c}}_{1}^{*} \end{matrix}) ⅆ V & \dots & \int_{V} (\begin{matrix} \tilde{a_{M}} \cdot {\tilde{a}}_{M}^{*} + {\tilde{b}}_{M} \cdot \\ {\tilde{b}}_{M}^{*} + {\tilde{c}}_{M} \cdot {\tilde{c}}_{M}^{*} \end{matrix}) ⅆ V \end{matrix}] & [EQ . 30] \end{matrix}

[0155] As explained above, it is possible to pan the sound sources in the sound receiving field F by using [EQ. 30] instead of [EQ. 14].

The Seventh Embodiment

[0156] A mixing machine is generally applied to produce one sound source by mixing a plurality of sound sources (for example, narration, background music, sound effect, etc.), and recently digitized.

[0157] Then, it is possible to install the three-dimensional acoustic panning device in a digital mixing machine.

[0158] FIG. 9 is a block diagram of the three-dimensional acoustic panning device 7 installed in the digital mixing machine, the processing unit 70 is configured by CPU and memory 701, hard-disc 702, interface (I/F) 703, and bus 704.

[0159] Display panel 761, operation panel 76 composed of key-board 761 and mouse 763, mixing console 75, track ball 77 and pan pod 78 are connected to I/F 703.

[0160] Operation panel 76 controls and supervises the over all operation of digital mixing machine 7, mixing console 75 determines parameters to mix a plurality of acoustic signals stored in hard disc 702 (amplitude, delay time, equalizing curve, etc.), and track ball 77 and pan pod 78 determine the panning direction and the panning interval of the acoustic signals stored in hard disc 702.

[0161] A mixing engine and a three-dimensional acoustic panning engine are installed in CPU and memory 701.

[0162] The mixing engine may include a delay program to delay specified acoustic signals and an equalizing program to collect a frequency spectrum of specified acoustic signals.

[0163] The three-dimensional acoustic panning engine is the three-dimensional acoustic panning program according to the present invention.

[0164] When mixing a plurality of acoustic signals by applying the digital mixing machine, a mixing engineer delays and equalizes the specific acoustic signals by setting parameters on the mixing console 75, and stores the mixed acoustic signal and the setting parameters on the mixing console 75 in hard disc 702.

[0165] When panning specific sound sources by applying the digital mixing machine, the three-dimensional acoustic panning engine pans the positions of the specific sound sources according to the operation of track ball 77 and pan pod 78, and stores panned acoustic signal and the he operation of track ball 77 and pan pod 78 in hard disc 702.

[0166] According to the above mentioned digital mixing machine, it is easy to mix panned acoustic signals with other acoustic signals, and to pan mixed acoustic signals.

[0167] The above mentioned embodiments execute the panning operation to the frequency region before panning acoustic signal Fourier converted from time region before panning acoustic signal and convert the frequency region after panning acoustic signal to the time region after panning acoustic signal by the inverse Fourier conversion. It is possible, however, to execute the panning operation in the time region by configuring the Fourier conversion means, the down mixing means and the inverse Fourier conversion means with delay units and filters.

INDUSTRIAL APPLICABILITY

[0168] As explained above, the three-dimensional acoustic panning device according to the present invention has effect that it can simulate the three-dimensional panning of the sound source by a plurality of loudspeakers arranged at the pre-determined positions.

BRIEF DESCRIPTION OF THE DRAWINGS

[0169] FIG. 1 is a block diagram of the three-dimensional acoustic panning device according to the present invention,

[0170] FIG. 2 is a block diagram showing the hardware architecture of the three-dimensional acoustic panning device according to the present invention,

[0171] FIG. 3 is a perspective view of the track ball (a) and the pan pad (b) applied in the three-dimensional acoustic panning device according to the present invention,

[0172] FIG. 4 is a flowchart of the three-dimensional acoustic panning program installed in the three-dimensional acoustic panning device according to the present invention,

[0173] FIG. 5 is a flowchart of the panning routine,

[0174] FIG. 6 is a layout drawing of two loudspeakers which form an acoustic field,

[0175] FIG. 7 a layout drawing of three loudspeakers which form an acoustic field,

[0176] FIG. 8 a layout drawing of eight loudspeakers which form an acoustic field, and

[0177] FIG. 9 is a block diagram of the three-dimensional acoustic panning device with a digital mixing function.

EXPLANATION OF NUMERALS

[0178] 11: sound source acoustic signal acquiring means
[0179] 12: panning information input means
[0180] 13: sound image forming acoustic signal output means
[0181] 14: arrangement information storing means
[0182] 15: sound image forming acoustic signal generating means

Claims

What is claimed is:

1. A three-dimensional acoustic panning device comprising:

a sound source acoustic signal acquiring means for acquiring acoustic signals radiated from at least one sound source;

a sound image forming acoustic signal output means for outputting acoustic signals to form sound images;

an arrangement information storage means for storing an arrangement information of said sound image forming acoustic signal output means;

a panning information input means for inputting a panning information consisting of directions centering on the sound receiving point and distances between the sound receiving point and said sound source; and

a sound image forming acoustic signal generating means for generating sound image forming acoustic signals which form sound images at the positions determined by said directions and said distances in said panning information in response to the change of said panning information based on said sound source acoustic signals and said arrangement information, and outputting said sound image forming signal to said image forming acoustic signal output means.

2. The three-dimensional acoustic panning device set forth in claim 1, wherein,

said panning information input means comprising a directional information input means for inputting at least one set of directional information concerning the direction of said sound sources viewed from a sound receiving point and a distance information input means for inputting at least one set of distance information concerning the distance between said sound receiving point and said sound sources.

3. The three-dimensional acoustic panning device set forth in claim 2, wherein, said panning information input means having a panning information storage means for storing said panning information.

4. The three-dimensional acoustic panning device set forth in claim 1 wherein,

said sound image forming acoustic signal output means having a recording/editing means for recording and editing said sound image forming acoustic signal.

5. The three-dimensional acoustic panning device set forth in anyone of claims 1-4, wherein,

said sound image forming acoustic signal generating means comprising a transforming means for Fourier transforming said sound source acoustic signal to a frequency region sound source acoustic signal,

a frequency region sound image forming acoustic signal generating means for generating a frequency region sound image forming acoustic signal using said frequency region sound source acoustic signal, said panning information, and said arrangement information, and

an inverse transforming means for inverse Fourier transforming said frequency region sound image forming acoustic signal to said sound image forming acoustic signal which is a time region signal.

6. The three-dimensional acoustic panning device set forth in claim 5, wherein,

said frequency region sound image forming acoustic signal generating means generates said sound image forming acoustic signal which forms a sound image acoustic physical quantity vector at the sound receiving point equal to the sound source acoustic physical quantity vector which is an acoustic physical quantity vector at the sound receiving point formed by panning the sound sources, which radiate the sound source acoustic signals, based on the panning information.

7. The three-dimensional acoustic panning device set forth in claim 5, wherein,

said frequency region sound image forming acoustic signal generating means forms a sound image acoustic physical quantity vector at the sound signal receiving area equal to a sound source acoustic physical quantity vector which is an acoustic physical quantity vector at the sound signal receiving area formed by panning the sound sources which radiate the sound source acoustic signals based on the panning information.

8. The three-dimensional acoustic panning device set forth in anyone of claims 1-4, further comprising a mixing means for mixing the sound source acoustic signals acquired by said sound source acoustic signal acquiring means.

Patent Citations (35)

Patent	Date	Inventor	Cited By
US5404406(A)	1995-04-01	Fuchigami et al.	Examiner
US5459790(A)	1995-10-01	Scofield et al.	Examiner
US5598478(A)	1997-01-01	Tanaka et al.	Examiner
US5696831(A)	1997-12-01	Inanaga et al.	Applicant
US5822438(A)	1998-10-01	Sekine et al.	Examiner
US6243476(B1)	2001-06-01	Gardner	Examiner
US7027600(B1)	2006-04-01	Kaji et al.	Examiner
US7970144(B1)	2011-06-01	Avendano et al.	Examiner
US2002/0048380(A1)	2002-04-01	McGrath	Applicant
US2003/0086580(A1)	2003-05-01	Hamamatsu	Applicant
US2003/0091204(A1)	2003-05-01	Gibson	Examiner
US2006/0045295(A1)	2006-03-01	Kim	Examiner
US2006/0067541(A1)	2006-03-01	Yamada et al.	Examiner
US2008/0232616(A1)	2008-09-01	Pulkki et al.	Examiner
US2008/0232617(A1)	2008-09-01	Goodwin et al.	Examiner
US2008/0253577(A1)	2008-10-01	Eppolito	Examiner
US2008/0253592(A1)	2008-10-01	Sanders et al.	Examiner
US2009/0046864(A1)	2009-02-01	Mahabub et al.	Examiner
US2009/0144063(A1)	2009-06-01	Beack et al.	Examiner
US2009/0147975(A1)	2009-06-01	Horbach et al.	Examiner
US2010/0111336(A1)	2010-05-01	Jeong et al.	Examiner
US2010/0260342(A1)	2010-10-01	Strub	Examiner
US2011/0013790(A1)	2011-01-01	Hilpert et al.	Examiner
US2011/0116638(A1)	2011-05-01	Son et al.	Examiner
US2011/0222694(A1)	2011-09-01	Del Galdo et al.	Examiner
JP5-303382	1993-11-01		Applicant
JP6-301390	1994-10-01		Applicant
JPA8-9490	1996-01-01		Applicant
JPA8-205298	1996-08-01		Applicant
JP11262097(A)	1999-09-01		Examiner
JP2002159097(A)	2002-05-01		Examiner
JPA2002-159097	2002-05-01		Applicant
JPA2002-165300	2002-06-01		Applicant
JPA2003-134600	2003-05-01		Applicant
JPA2005-249989	2005-09-01		Applicant

Non-Patent Literature (2)

Ville Pulkki; “Localization of Amplitude-Panned Virtual Sources II: Two-and three-Dimensional Panning”; J. Audio Eng. Soc., vol. 49, No. 9; Sep. 2001; pp. 753-767.Applicant
Ville Pulkki; “Virtual Sound Source Positioning Using Vector Base Amplitude Panning”; J. Audio eng. Soc., vol. 45, No. 6; Jun. 1997; pp. 456-466.Applicant

Abstract

[Problems]

To provide a three-dimensional acoustic panning device enabling a three-dimensional-panning of a sound source as a sound image panning.

[Means for Solving the Problems]

Description

[0001] This application is a U.S. National Phase under 35 U.S.C. §371, of International Application No. PCT/JP2007/050781, filed Jan. 19, 2007.

TECHNICAL FIELD

BACKGROUND OF THE INVENTION

[0011] Patent Publication 1: Japanese Patent Publication No. 3177714 (See [001], FIG. 1)
[0012] Patent Publication 2: Japanese Unexamined Patent Publication (Kokai) No. H06-301390 (See [0010]-[0015], FIG. 1)
[0013] Patent Publication 3:U.S. unexamined Patent Publication No. 20020048380 (See [0026], FIG. 3)
[0014] Non-Patent Publication 1: “Localization of Amplitude-Panned Virtual Sources II: Two- and Three-Dimensional Panning” VILLE PULKKI, J. Audio Eng. Soc. Vol. 49, No. 9, 2001 September
[0015] Non-Patent Publication 1: “Virtual Sound Source Positioning Using Vector Base Amplitude Panning” VILLE PULKKI, J. Audio Eng. Soc. Vol. 45, No. 6, 1997 June