US 5,220,642 AGrant
Optical Neurocomputer With Dynamic Weight Matrix
Issue Date:1993-06-15
•19 Claims
•15 Drawing Sheets
Abstract
An optical computer for performing product and/or sum operations on input vector information and matrix information includes an array of light emitting elements, the array having a plurality of columns and a plurality of rows. Input circuitry is provided for supplying input vector information to the array while matrix circuitry is provided for dynamically applying matrix information to the array. Logic circuitry is provided for performing one of a logical product and a logical sum operation on the input vector information and the matrix information and for generating an output thereof.
Metadata
Assignee
- Mitsubishi Denki Kabushiki Kaisha
Inventors
- Masanobu Takahashi
- Shuichi Tai
- Jun Ohta
- Toshio Shinnishi
- Kazuo Kyuma
- Masaya Oita
Application Information
Application Number:US 5136024
Filing Date:1990-04-24
Priority Date:1989-04-28
Art Unit:238
Classifications
IPC:
G06F 15347
Field of Search:
364395357513;713;822;837;8452519
Patent Drawings (15 sheets)
Description
Background of the Invention
The present invention relates to optical computers which imitate nerve networks to realize a neurocomputer which has an association and/or pattern recognition function.
A conventional optical associative neurocomputer such as shown in Denshi Joho Tsushin Gakkai Hikari-Ryoshielectronics Kenkyukai Shiryo OQE87-174 (1988) [Electronic Information Communications Society Opto-Quantum Electronics Study Group Papers] is shown in FIG. 10. This optical neurocomputer consists of a pair of light emitting element (LEE) arrays 1a and 1b; a pair of optical masks 2a and 2b; a pair of light receiving element (LRE) arrays 3a and 3b; differential amplifiers 4; comparators 5; an incomplete information input 6; and a complete information output 7, all interconnected as shown.
In operation, the LEE arrays 1a and 1b emit fan-shaped light beams V.sub.j to the optical masks 2a and 2b. The respective light emitting elements of each LEE array 1a or 1b are turned on or off to represent a logic 1 or 0, thus representing a vector V=(V.sub.1, V.sub.2, . . . , V.sub.i, . . . , V.sub.n). The optical masks 2a and 2b are divided into N.times.N elements each having a different light transmission factor, thus representing a matrix T=[T.sub.ij ] (hereinafter "matrix T.sub.ij "). Each LRE array 3a or 3b represents a vector U=(U.sub.1, U.sub.2, . . . , U.sub.i, . . . U.sub.n). When the j-th light emitting element emits light to the j-th row of the optical mask and the i-th light receiving element receives light from the i-th column of the optical mask, the following vector matrix operation is performed ##EQU1##
This operation will be described in more detail by using FIG. 10, wherein the matrix T.sub.ij has 25 (=5.times.5) elements, and the vector V five elements. ##EQU2## Substituting these into Eq. (1) gives ##EQU3## Transforming Eq. (2) gives ##EQU4##
In Eq. (3), U.sub.i is expanded for i from 1 to 5. That is, for i=1, Eq. (1) is ##EQU5## Expanding Eq. (4) for j from 1 to 5 gives
This is the same equation as the first one of Eq. (3).
In Eq. (5), U.sub.1 is the sum of products of the respective elements (T.sub.11, T.sub.12, T.sub.13, T.sub.14, T.sub.15) of the matrix T.sub.ij and the respective elements (V.sub.1, V.sub.2, V.sub.3, V.sub.4, V.sub.5) of the vector V. That is, U.sub.1 is determined by performing a product and sum operation on the respective elements T.sub.ij of the matrix T.sub.ij and the respective elements of the vector V. By repeating this up to U.sub.5, the vector matrix operation on the matrix T.sub.ij and the vector V is performed.
The fact that the intensity of transmitted light depends on the light transmission factor of T.sub.11 and the intensity of incident light V.sub.1 makes the product operation T.sub.11 V.sub.1 possible. Similarly, the respective products (T.sub.12 V.sub.2, T.sub.13 V.sub.3, T.sub.14 V.sub.4, T.sub.15 V.sub.5) are outputted from the optical mask 2a for the respective light transmission factors T.sub.12, T.sub.13, T.sub.14, T.sub.15 and the respective light intensities V.sub.2, V.sub.3, V.sub.4, V.sub.5. A light receiving element of the LRE array 3a collects these outputs to perform a sum operation for U.sub.1. By repeating this up to U.sub.5, the vector matrix operation is performed.
In contrast to the conventional Neumann type electronic computers which perform respective product operations and sum operations in sequence, the optical computer is able to perform an N.times.N matrix operations in parallel by applying and collecting light as described above. In addition, the computation time of the conventional electronic computer increases with the increasing number of matrix elements, but that of the optical computer remains constant in principle as far as the number of matrix elements is increased.
Before a neurocomputer is described, the function of a neuron will be described briefly with reference to FIGS. 11A-11C. Neurons are considered to be a nonlinear element having a multiple-input/single-output type threshold characteristic. That is, when the membrane potential which is determined by the sum of input signals is below a certain value (threshold value), the output of the neuron is 0 but, when the membrane potential is above the threshold value, it generates a pulse to send a signal to other neurons. There are two types of connection between neurons (synapse connection); i.e., an exciting connection which raises the membrane potential of the other neuron as shown by a black dot in FIG. 11B and a depressing connection which reduces the potential as shown by a white dot in FIG. 11B.
In a mathematical model, it is assumed that the output of a neuron has an analog value ranging from 0 to 1 according to the degree of excitation. The output of the i-th neuron, U.sub.i, is approximately by the following equation ##EQU6## wherein V.sub.j is the output of the j-th neuron connected to the i-th neuron (j=1, 2, . . . , N), T.sub.ij the strength of synapse connection, and I.sub.i the its own threshold value.
The positive and negative values of T.sub.ij, which indicates the degree of an influence of the j-th neuron upon the i-th neuron, represent the exciting and depressing synapse connections, respectively. g is a monotonous saturation function such as a sigmoid function shown below ##EQU7## The function g(x) is shown in FIG. 11C. If x.sub.0 .fwdarw.>0, then g(x) asymptotically approaches a unit step faction. The energy of a network of these N neurons is given by ##EQU8##
As shown in FIG. 12, the network of neurons connected to each other, with the output signal of each neuron fed back to the other neurons, is called "feedback type model." In this model, there is no distinction between signal input neurons and signal output neurons. One representative example of this model is an associative memory. The associative memory herein used means any device which, when incomplete information, part of which is unclear or lost, is inputted, associates the incomplete information with the closest complete information which has been stored and outputs the complete information.
Now, let M be the number of pieces of complete information stored and V(m)=( V1(m), V1(m), . . . , V1(m)) be the binary vector (1, 0) for the neuron state with respect to the m-th complete information. If the correlational matrix T.sub.ij, which represents the synapse connections, is defined by the Hopfield model as follows ##EQU9## it is possible to prove the correspondence between the phenomenon that something has been stored and the stable state of a network or the minimum value of the energy E given by Eq. (8). Consequently, if the stored information is considered to be complete information, when a given incomplete information is inputted as a neuron state vector, the neuron state vector changes through the nonlinear threshold process of Eq. (6) and the feedback to the stored information which is closest to the inputted information so that the vector at the stable point is outputted. This is the principle of an associative memory.
In order to provide precise association, (1) the number of neurons, N, should be sufficiently larger than the number of pieces of information, M; (2) there should be no strong correlation between the respective storage condition vectors V(m) (m=1, 2, . . . , M); and (3) there should be orthogonality. Even if these conditions are met, the nonlinear process by a neuron makes the energy function E have many shallow local valleys or local minima as well as global minima which correspond to the stored information in the N dimensional vector space. The local minima even can trap the global minima under certain initial conditions. In the neurocomputer, information is stored as connection strengths T.sub.ij between respective neurons. These connection strengths T.sub.ij are stored as light transmission factors in terms of light. That is, in the optical associative neurocomputer, information is stored as transmission factors of the optical masks 2a and 2b. The information storage rules are based on the Hopfield model and given by Eq. (9) as follows ##EQU10##
This will be described in more detail with reference to FIGS. 13A and 13B, wherein the connection strengths T.sub.ij are determined from the stored information. In FIG. 13A, if each of the letters A, J, and E is expressed by 32 elements in a 6.times.6 element arrangement except for the four corners, three pieces of the information stored about the letter A, J, and E are given by storage state vectors V(A), V(J), and V(E), respectively, as shown in FIG. 13B. Each vector has 32 binary states, wherein 0 and 1 represent white and black dots, respectively. Since N=32 and M=3, the connection strengths T.sub.ij are given by ##EQU11##
For example, the connection strength T.sub.11 is given by ##EQU12## The value of T.sub.ij calculated in this way is either 0, +1 or +3 for all of i=1-32 and j=1-32. These values represent the connection strengths or transmission factors. The matrix T.sub.ij or optical masks 2a and 2b, which is made in the form of a 5.times.5 array in FIG. 10 for the purposes of simplicity, needs a 32.times.32 array in this example. As a result, the number of signal lines required for the LEE arrays 1a and 1b and the LRE arrays 3a and 3b is 32.
Since optical devices are unable to handle negative values, two optical systems are provided corresponding to the positive values T.sub.ij (+) and negative values T.sub.ij (-) of a matrix T.sub.ij as shown in FIG. 10. The difference in output between the LRE arrays 3a and 3b, U.sub.i, is produced by the differential amplifier 4 as follows
The output is subjected to a threshold process in the comparator 5 as follows ##EQU13## The output is then fed back to the LEE arrays 1a and 1b. Thus, by storing the three of information in the optical masks 2a and 2b corresponding to the letters A, J, and E when incomplete information, such as A', is inputted to the LEE arrays 1a and 1b, the information about A closest to the inputted information about A' is displayed as a complete information output after repeating this feedback. In other words, the system energy takes the minimum value at the stored information about A, J, or E. When incomplete information is given, the entire system changes (the on/off state of the LEE array changes) so as to take the minimum value of energy around the inputted information. This is an associative function.
A basic optical system is shown in FIGS. 14A and 14B. The basic optical system includes a convex lens 26 and slits 27. The respective light beams from the LEE array 1a or 1b are made substantially parallel by the slits 27 and strike the optical mask 2a or 2b which makes a matrix T. The optical mask 2a or 2b is an ordinary emulsion type glass dry plate mask. The connection strength T.sub.ij is expressed in terms of the area of a portion through which light passes. The convex lens 26 collimates the light beams from the optical mask 2a or 2b and collects them on the LRE array 3a or 3b.
In the above conventional optical computer, information is stored as the transmission factors of the optical mask so that when the stored contents are to be changed, it is necessary to change the optical mask itself. That is, it is impossible to change information in a dynamic fashion. In addition, the light beam from the LEE array must be deflected in a fan shape and then collected on the LRE array so that a complex lens system is required.
Summary of the Invention
Accordingly, it is an object of the invention to provide an optical computer which enables one to change the stored information in a dynamic fashion without using a complex lens system such as described above.
According to the invention there is provided an optical computer for performing a product and sum operation, which includes (a) an input unit for supplying input vector information; (b) a matrix unit for dynamically applying matrix information; and (c) an operation unit for performing a product and sum operation on said input vector information and said matrix information.
According to an embodiment of the invention there is provided an optical computer, which includes (a) a rectangular array of a plurality of bistable light emitting elements; (b) a row driver for generating a row signal corresponding to a row of the rectangular array; (c) a column driver for generating a column signal corresponding to a column of the rectangular array; (d) a overlapping unit for generating a product signal of the row signal and the column signal by overlapping one signal upon another at each element of the rectangular array so that each of the light emitting elements emits light based on the product signal; and (e) an array of light receiving elements for receiving light from the rectangular array to produce a product and sum signal.
Since the row driver sequentially inputs signals corresponding to neuron state vectors as an incomplete information input to a row of light emitting elements while the column driver inputs signals corresponding to respective columns of the matrix to respective columns of the light emitting elements in synchronism with the row signals and since the bistable light emitting element at which the logical product conditions are met is turned on so that the light emitting element corresponding to the optical transmittance of the optical mask is turned on, it is possible to dynamically change the interconnection strength and thus the matrix. In addition, with the row driver and the column driver, it is possible to make the electrode structure simpler and the manufacture easier.
According to another embodiment of the invention there is provided an optical computer, which includes (a) a rectangular array of light emitting elements; (b) a row signal unit for outputting a row signal corresponding to a row of the rectangular array; (c) an element signal unit for dynamically outputting an element signal corresponding to each element of the rectangular array; (d) an operation unit for receiving both of the row signal and the element signal and outputting a product signal of the row signal and the element signal to the rectangular array; (e) an array of light receiving elements for receiving light from a column of the rectangular array to produce a product and sum signal.
When a signal corresponding to the interconnection strength of a matrix and a signal corresponding to a neuron state vector are inputted to the operation unit which is connected to a light emitting element of the rectangular array, the light emitting element is turned on when the logical product conditions are met so that the light emitting element corresponding to the transmittance of an optical mask is turned on so that it is possible to dynamically change the matrix. The output signal is pulse modulated with the duty corresponding to the interconnecting strength or light intensity so that it is possible to continuously change the interconnecting strength between neurons corresponding to the transmittance of an optical mask and that it is easy to provide a learning function.
According to still another embodiment of the invention there is provided an optical computer, which includes (a) a first rectangular array of light emitting elements; (b) a second rectangular array of light emitting/receiving elements, each of which is switchable to either a light emitting element or a light receiving element; (c) a bistable spatial light modulator placed between the first rectangular array and the second rectangular array; (d) a recording unit for dynamically recording optical transmittance data in the spatial light modulator by controlling light emission of the light emitting elements and light emitting/receiving elements so that the spatial light modulator controls its light transmission based on the optical transmittance data recorded therein; (e) a production unit for inputting a row signal sent by the first rectangular array to the spatial light modulator and generating an optical product signal of the row signal and the optical transmittance; and (f) a summation unit for receiving the optical product signal from the production means to the second rectangular array and generating a product and sum signal in a column of the light emitting/receiving elements.
The interconnecting strength matrix is stored in the bistable light modulator as transmittance data by controlling light emission of the light emitting elements. A signal corresponding to a vector is inputted to a row of the first rectangular array to emit light and perform a production operation on the interconnecting strengths recorded in the bistable spatial light modulator. A row of the second rectangular array is switched to the light receiving function to produce the sum of products.
In the above embodiments, at least one of the elements is integrated on a semiconductor substrate so that it is possible to provide a very small optical computer.
Other objects, features, and advantages of the invention will be apparent from the following description when taken in conjunction with the following drawings.
Brief Description of the Drawings
FIG. 1 is a schematic diagram of an optical neurocomputer according to an embodiment of the invention;
FIG. 2 is a graph showing the operation of a bistable light emitting element useful for the optical neurocomputer of FIG. 1;
FIG. 3 is a flowchart showing the operational sequence of the optical neurocomputer of FIG. 1;
FIG. 4 is a schematic diagram of an optical neurocomputer according to another embodiment of the invention;
FIG. 5 is a schematic diagram of an optical neurocomputer according to still another embodiment of the invention;
FIG. 6A is a top view of a light emitting/receiving element array useful for the optical neurocomputer of FIG. 5;
FIG. 6B is a sectional view taken along the line VI(b)--VI(b) of FIG. 6A;
FIG. 6C is a sectional view taken along the VI(c)--VI(c) of FIG. 6A;
FIG. 7 is a graph showing the characteristic of a bistable spatial light modulator useful for the optical neurocomputer of FIG. 5;
FIG. 8 is a flowchart showing the operational sequence of the optical neurocomputer of FIG. 5;
FIGS. 9A and 9B are perspective views of the optical systems useful for the optical neurocomputers of FIGS. 1 and 4, respectively;
FIG. 10 is a schematic diagram of a conventional optical neurocomputer;
FIGS. 11A, 11B, and 11C show a neuron, its model, and its function, respectively;
FIG. 12 shows a feedback type model of a neuron network;
FIGS. 13A and 13B show three pieces of the information stored and their vectors;
FIGS. 14A and 14B are top and side views of an optical system for the conventional optical computer; and
FIG. 15 is a flowchart showing the operation sequence for processing a sum and product operation using the optical neurocomputer of FIG. 5.
Description of the Preferred Embodiment
FIG. 1 shows an optical neurocomputer according to an embodiment of the invention, wherein only one optical system for the positive value T.sub.ij (+) or negative value T.sub.ij (-) of a matrix T.sub.ij is shown for the purposes of simplicity. The optical neurocomputer includes an LRE array 3; comparators 5; an incomplete information input (neuron state vector V) 6; a complete information output 7; a bistable LEE rectangular array 8; a row driver 22 for outputting neuron state vectors in sequence; a column driver 20 for outputting respective column components of the matrix T.sub.ij in synchronism with the row driver; and signal electrodes 21, all interconnected as shown.
FIG. 2 shows the characteristic of a light emitting element useful for the above LEE array 8, wherein the horizontal and vertical axes represent the strength of an input signal and the intensity of the emitted light, respectively. The bistable light emitting element is off at a signal strength 38 or the initial value i.sub.B, and still off at a signal strength 39 which is i.sub.S higher than the initial value i.sub.B. Then, it is on at a signal strength 30 which is higher than the initial value i.sub.B and still on at a signal strength 31 which is equal to the initial value i.sub.B. Finally, it is off at a signal strength 32 or the reset value i.sub.E.
In FIG. 1, the neuron state vector V and the transmittance of the matrix T.sub.ij are multiplexed on the bistable LEE array 8. That is, n rows and each element of the bistable LEE array 8 correspond to n light emitting elements and each element of the matrix T.sub.ij, respectively.
FIG. 3 shows the procedure how to retrieve the stored information by inputting incomplete information (neuron state vector V) into the bistable LEE array 8 in H which the connection strengths T.sub.ij have been stored corresponding to the stored information of the matrix T.sub.ij. At a time t.sub.0, each bistable light emitting element of the matrix 8 is put into the initial condition 38 in FIG. 2 (S21). At a time t.sub.1, the row driver 22 inputs to the first row of the bistable LEE array 8 a binary signal which corresponds to the first component V.sub.1 of the neuron state vector V (S22). As shown in FIG. 2, when V.sub.1 is a logic 0, nothing is inputted so that each bistable light emitting element remains at the initial state 38, whereas when V.sub.1 is a logic 1, a signal i.sub.S is inputted so that each bistable light emitting element is at the state 39. At the same time t.sub.1, the column driver 20 inputs a binary signal which corresponds to the first column T.sub.11 of the interconnecting matrix (S23). In this way, a binary signal corresponding to T.sub.i1 (i=1, 2, . . . , n) is inputted to the respective columns of the bistable LEE array 8 either simultaneously or sequentially for i from 1 to n (S24, S25). In FIG. 2, when T.sub.i1 is a logic 0, nothing is inputted, whereas when T.sub.i1 is a logic 1, a signal i.sub.S is inputted. Consequently, when V.sub.1 =1 and T.sub.i1 =1, the bistable light emitting element is at the state 30 or on. When V.sub.1 =1 and T.sub.i1 =0, or V.sub.1 =0 and T.sub.i1 =1, the bistable LEE is at the state 39 or off. When V.sub.1 =0 and T.sub.i1 =0, the bistable LEE is at the state 38 or off.
When the signals from the respective drivers 20 and 22 are removed, the bistable LEE in the on state 30 moves to the on state 31 and remains in the on state, while the bistable LEE in the off state 39 moves to the off state 38. That is, the on/off state is maintained. The above process is repeated up to the n-th row of the bistable LEE array 8 in sequence to turn on or off all the elements of the bistable LEE array 8 corresponding to the product T.sub.ij V.sub.j (S26, S27). The on/off outputs from the light emitting elements are inputted to the light receiving elements (S28). Where the bistable LEE array 8 is changed after completion of the operation, the row driver 22 or the column driver 20 reduces the signal strength from i.sub.B to i.sub.E of the reset state 32 and then raises the signal strength to i.sub.B of the initial state 38.
Thus, the selection of a binary code outputted from the column driver 20 is comparable to the selection of a transmission factor of each element of the optical matrix according to the matrix T.sub.ij or the combination of the light emitting elements and the optical mask. That is, it is possible to change the stored information by merely changing the contents of a binary signal. In addition, the structure of electrodes 21 is so simple that it is easy to make it.
As has been described above, according to this embodiment there is provided an optical neurocomputer which includes a bistable LEE array; a row driver for sequentially outputting a signal to the respective rows of the bistable LEE array corresponding to a neuron state vector V; a column driver for outputting either simultaneously or sequentially in synchronism with the row driver a signal to the respective rows of the bistable LEE array corresponding to a column of the matrix T.sub.ij ; a light receiving element array for receiving light outputted from the light emitting elements of each column of the bistable LEE array to provide a product and sum signal; and comparators in which the respective outputs from the light receiving element array are subjected to a threshold process.
Alternatively, the binary signal for the matrix T.sub.ij in the above embodiment may be a multiple value signal. The signal corresponding to incomplete information, which takes 0 and 1 in the above embodiment, may take multiple values. In this case, the row and column drivers generate multiple value signals, and the bistable LEE array determines the intensity of output light according to the multiple value, and the light receiving element array changes its output according to the output light intensity. The feedback type associative function in the above embodiment may be replaced by a feedforward type function such as back propagation.
FIG. 4 shows an optical neurocomputer according to another embodiment of the invention, wherein only one optical system of the optic neurocomputer corresponding to the positive or negative value T.sub.ij (+) or T.sub.ij (-) of the matrix T.sub.ij is shown for the purposes of simplicity. The optical neurocomputer consists of a light receiving element array 3; comparators 5; an incomplete information input (neuron state vector V) 6; a complete information output 7; AND gates as an operation means 42; a light emitting element rectangular array 43; a matrix information source as an element signal means 41; and pulse modulators 44, all interconnected as shown.
In operation, the neuron state vector V corresponding to the on/off of each light emitting element and the transmittance of the matrix T.sub.ij are multiplexed in the LEE array 43. That is, n rows and respective elements of the LEE array 43 correspond to n light emitting elements and respective elements of the matrix T.sub.ij, respectively. The information to be stored corresponding to the matrix T.sub.ij is inputted in the LEE array 43, and the stored information is retrieved with the neuron state vector V as follows.
First of all, the matrix information source 41 outputs a binary signal, 1 or 0, to one of the two inputs of each AND gate 42 which is connected to a light emitting element of the LEE array 43. The selection of this binary signal is comparable to the selection of the transmission factor of each element of the optical mask according to the matrix T.sub.ij information. However, in this case, it is possible to change the stored information by merely changing the contents of the binary signal. After the binary signal inputted to the AND gate 42 determines the information to be stored, a binary signal corresponding to the neuron state vector V is inputted to the other input of the AND gates which are connected to a row of the LEE array 43. Consequently, some AND gates meet the logical product conditions and the others do not. Their outputs determine the on/off state of each light emitting element of the LEE array 43, and the light receiving elements receive the output light.
More specifically, when an element V.sub.i of the neuron state vector V is a logic 0, all the elements in the i-th row of the LEE array 43 are turned off. When V.sub.i is a logic 1, only the elements at a logic 0 in the i-th row of the LEE array 43 are turned off. This is comparable to the combination of light emitting elements and an optical mask.
However, the above matrix T.sub.ij information corresponding to the transmittance of an optical mask has only 0s and 1s. In order to enhance the function, it is necessary to enable the value of the matrix T.sub.ij to change continuously between 0 and 1. According to the invention, a variable duty pulse modulator 44 is connected between the matrix information source 41 and each AND gate as the additional operation means 42 so that a high or low pulse duty corresponds to a high or low connection strength. By continuously changing the duty of a signal inputted to an input of the AND gate 42, it is possible to continuously change the connection strength. If the bandwidth of an electronic circuit for processing the output signal of the light receiving elements is set at a frequency which is sufficiently lower than that of the modulated pulse, the output is averaged to provide a d-c signal having a strength which is proportional to the pulse duty.
As has been described above, according to this embodiment there is provided an optical neurocomputer for performing a product and sum operation on a neuron state vector V and a matrix T.sub.ij, which includes a LEE rectangular array; AND gates for outputting a driving signal to each light emitting element; an input unit for inputting a signal corresponding to the neuron state vector V to an input of each of the AND gates; a second input unit for inputting a binary signal corresponding to the matrix T.sub.ij to the other input of each of the AND gates; pulse modulators in which the binary signal is subjected to a given duty pulse modulation; a LRE array for receiving light outputted from the light emitting elements in each column of the LEE rectangular array to provide a product and sum signal of the state vector V and the matrix T.sub.ij ; and comparators in which the output of each light receiving element is subjected to a threshold process.
Alternatively, the pulse modulators 44 may be connected between the AND gates 42 and the LEE rectangular array 43. The neurosystem of the feedback type associative function may be replaced by that of the feedforward type function such as back propagation.
FIG. 5 shows an optical neurocomputer according to still another embodiment of the invention, wherein only one optical system corresponding to the positive value T.sub.ij (+) or negative value T.sub.ij (-) of a matrix T.sub.ij is shown for the purposes of simplicity. The optic neurocomputer includes a pair of light emitting/receiving element (LE/RE) rectangular arrays 8a and 8b; a bistable spatial light modulator 9 with input/output surfaces 9a and 9b; a pair of voltage controllers 10a and 10b; and eight switches 11a-11h, all interconnected as shown.
The LE/RE rectangular array 8a or 8b is shown in more detail in FIGS. 6A-6C. The array 8a or 8b has 16 light emitting/receiving elements 12a-12p which are arranged in a plane; four upper electrodes 13a-13d which are brought into contact with part of the upper surface of each row of light emitting/receiving elements such as 12a-12d; four lower electrodes 14a-14d which are brought into contact with the lower surface of each column of light emitting/receiving elements such as 12a, 12e, 12i, and 12m; an insulator 15; p layers 16; i (active) layers 17; and n layers 18.
FIG. 7 shows the characteristic of the bistable spatial light modulator 9 which is composed at least one element, with their light output surfaces bonded together such as described in the 35 the Oyobutsurigaku Kankei Rengo Koenkai Koen Yokooshu, Vol. 3, p. 734, 30p-ZF-3, p, 735, 30p-ZF-4 (March 1988) [Applied Physics Association Meeting Proceedings]. The spatial light modulator 9 shows the same characteristics as those of FIG. 2 with respect to incident light to the light input surface 9a and light output surface 9b. That is, the spatial light modulator 9 has two stable states; the on state in which light is transmitted and the operational point is in a line (a) and the off state in which little light is transmitted and the operational point is in a line (b). When the power density of incident light on the surface 9a is above P.sub.ON, the spatial light modulator 9 is turned on, and when the input power density is below P.sub.OFF, it is turned off.
The operational sequence of this optical neurocomputer is shown in FIG. 8. First of all, it is necessary to write the matrix T.sub.ij information in the bistable spatial light modulator 9 as a transmission/non-transmission pattern. This is done as follows. First, all the switches 11a-11h are turned to the voltage controllers 10a and 10b. All of the upper electrodes 13a-13d and the lower electrodes 14a-14d of the LE/RE arrays 8a and 8b are put at equal potential to make the output power be zero so that the all surfaces of the spatial light modulator 9 are put into an off state 80 (S71). Then, the second voltage controller 10b makes the upper electrodes 13a-13d of the second LE/RE array 8b positive with respect to the lower electrodes 14a-14d to turn on all of the light emitting/receiving elements 12a-12p for applying light to the second i/o surface 9b with optical power density P.sub.B which is higher than P.sub.OFF but lower than P.sub.ON (S72). This puts the modulator 9 in the off state 81.
Based on the matrix T.sub.ij information to be stored, portions of the spatial light modulator 9 which are to be in the transmission state are sequentially put into the on state 84 (S73). For example, when a portion of the spatial light modulator 9 which corresponds to the light emitting/receiving element 12g of the first LE/RE array 8a is made transmissive, the first voltage controller 10a puts all of the upper electrode 13b and the lower electrodes 14a, 14b, 14d at an equal potential V.sub.1 and all of the upper electrodes 13a, 13c, and 13d, and the lower electrode 14c at an equal potential V.sub.2 (V.sub.2 <V.sub.1). At this point, only the light emitting/receiving element 12g among others emits light. The part opposite to the light emitting/receiving element 12g is put into the on state 84 or transmission state by setting the potential difference (V.sub.1 -V.sub.2) such that the power density of incident light on the i/o surface 9a is above P.sub.ON. Once in the on state 84, it holds the on state 87 after the incident light is removed because the optical power P.sub.B which is higher than P.sub.OFF is inputted from the second i/o surface 9b. Thus, by sequentially turning on the light emitting/receiving elements of the first LE/RE array corresponding to the portion of the bistable spatial light modulator 9 which is to be transmissive, the interconnecting matrix information to be stored is written in the bistable spatial light modulator 9 as a transmission/non-transmission pattern (S73).
The operation of an optical associative neurocomputer working on the above principle will be described. For example, three pieces of information about A, J, and E are to be stored in the bistable spatial light modulator 9 as a connecting matrix information in the form of a transmittance pattern based on the Hopfield model. Then, the second LE/RE array 8b is turned on to apply light to the second i/o surface 9b with an optical power density higher than P.sub.OFF while the switches 11a-11d are turned to the incomplete information input 6 and the first voltage controller 10a puts all the lower electrodes 14a-14d at an equal potential V.sub.3. Then, a potential V.sub.4 (V.sub.4 >V.sub.3) for a state 0 is applied as an incomplete information input 6 to turn on all the light emitting/receiving elements 12a-12p of the first LE/RE array 8a (S74). The potential difference (V.sub.4 -V.sub.3) has been set so that the power density Pc of incident light on the portion of the first i/o surface 9a corresponding to the light emitting/receiving elements 12a- 12p is higher than P.sub.OFF but lower than P.sub.ON.
When the switches 11e-11h are turned to the differential amplifiers 4 while the second voltage controller 10b makes the potential of the upper electrodes 13a-13d on the second LE/RE array 8b lower than that of the lower electrodes 14a-14d so that the second LE/RE array 8b acts as an array of light receiving element columns. Although there is no incident light on the second i/o surface 9b, the incident light on the first i/o surface 9a holds the on state so that the transmission/non-transmission pattern written in the bistable spatial light modulator 9 is held in the state 86/state 82.
After passing through the bistable spatial light modulator 9, the optical power on the on state is received by the second LE/RE array 8b to produce a signal proportional to the sum of optical power inputted to each column, which is inputted to the differential amplifier 4 (S75). Since the state vector V of the incomplete information input 6 is (0, 0, 0, 0), the input to the differential amplifier 4 must be 0. For this reason, the differential amplifier 4 is adjusted so that its output is 0 to thereby remove any influence of the optical power Pc on the on state.
When a potential V.sub.5 (V.sub.5 >V.sub.4 >V.sub.3) is applied as an incomplete information input to the portion which corresponds to the state 1, all the light emitting elements in the corresponding row of the first LE/RE array 8a emit light (S76). If the potential difference (V.sub.5-V.sub.3) is set so that the power density P.sub.D of incident light on the first i/o surface 9a does not exceed P.sub.ON, the transmission/non-transmission is held as a state 85/state 83 pattern. The subsequent signal process for providing an associative function is identical with the conventional one except that the output potentials of the comparators 5 corresponding to the states 0 and 1 are set at V.sub.4 and V.sub.5, respectively.
As has been described above, according to this embodiment there is provided an optical neurocomputer which includes a pair of LE/RE rectangular arrays consisting of a plurality of light emitting/receiving elements, rows of upper electrode placed on the top of the light emitting/receiving elements, and columns of lower electrode placed on the back of the light emitting/receiving elements; a bistable spatial light modulator placed between the LE/RE arrays; a pair of voltage controllers for applying separate potentials to the upper and lower electrodes; a plurality of switches for switching input and output signal lines; an array signal output unit for outputting binary signals corresponding to the neuron state vector V to respective rows of the LE/RE array; and a plurality of comparators in which the outputs from respective columns of the other LE/RE array are subjected to a threshold process.
Alternatively, the first LE/RE array 8a may be an array of only light emitting elements. The voltage controller and the switches may be replaced by any device which is able to turn on an array of light emitting elements with upper and lower electrodes.
The structure of an optical system for the optical computer of FIG. 1 is shown in FIG. 9A. The optical system consists of a semiconductor substrate 92; a rectangular array of bistable light emitting elements 93 formed on the substrate 92; signal electrodes 97 for interconnecting the light emitting elements 93; a clear insulating film 94 formed on the LEE array 93; and an array of light receiving elements 95 formed on the insulating film 94. The comparators 5 are either integrated with the optical system on the same substrate or made on a separate substrate and integrated with the optical system as a hybrid.
The structure of an optical system useful for the optical computer of FIG. 4 is shown in FIG. 9B. The optical system consists of a semiconductor substrate 92; a rectangular array of light emitting elements 93 formed on the substrate 92; a clear insulating film 94 formed on the LEE array 93; and an array of light receiving elements 95 formed on the insulating film 94. The comparators 5, the AND gates 42, and the pulse modulators 44 are either integrated with the optical system in the same substrate or integrated on a separate substrate and then integrated with the optical system as a hybrid.
Similarly, the optical system of FIG. 5 may be integrated on a semiconductor substrate.
In the above embodiments, the rows and columns are interchangeable. The size of the matrix T.sub.ij, which is either 4.times.4 or 6.times.6 for simplicity, may be N.times.N wherein N is a given integer. The numbers of rows and columns may be different as N.sub.1 .times.N.sub.2 wherein N.sub.1 and N.sub.2 are given different integers. The optical computer of the invention, which has been applied to the neurocomputer, may be applied to any computer which is able to perform a vector matrix operation.
In addition, by letting all of the T.sub.ij values be 1, it is possible to perform only a sum operation. Moreover, by inputting only a single row of values and the corresponding set of values of T.sub.ij it is possible to perform only a product operation. Thus, the optical computer according to the invention is not a mere dedicated system for performing a product and sum operation but is useful as an ordinary computer system which is able to perform a sum and/or product operation. It also be understood that the application of the invention is not limited to neurocomputers.
As has been described above, according to an aspect of the invention, the vector and the matrix T.sub.ij are multiplexed in a bistable LEE rectangular array so that it is possible to change the stored information by means of a simple optical system. Since the bistable LEE array outputs vectors in sequence, it is possible to make the electrode structure simpler and the manufacture easier. The optical system and the electronic circuitry are integrated on a single chip so that it is possible to provide a very small optical computer.
According to another aspect of the invention, the light emitting elements of a matrix T.sub.ij are modulated with given duty pulses in addition to the multiplex of a vector and a matrix T.sub.ij in the LEE rectangular array so that it possible to continuously change the output signal of the matrix T.sub.ij with a simple optical system and thus the stored information without difficulty. Since the optical system and the electronic circuitry are integrated on the same substrate, a very small optical computer is provided.
According to still another aspect of the invention, a bistable spatial light modulator is placed between the LEE rectangular array and the LE/RE rectangular array so that it is possible to dynamically change the state of a matrix T.sub.ij from the outside and change the stored information without difficulty. The complex lens system is made unnecessary, resulting in the simple optical system.
Claims
We claim:
1. An optical computer comprising: (a) a rectangular array of a plurality of bistable light emitting elements; (b) a row driver means for generating a row signal corresponding to a row of said rectangular array; (c) a column driver means for generating a column signal corresponding to a column of said rectangular array; (d) overlapping means for generating a product signal of said row signal and said column signal by overlapping one signal upon another at each element of said rectangular array so that each of said light emitting elements emits light based on said product signal; and (e) a receiving array of light receiving elements for receiving light from said rectangular array to produce a product and/or sum signal.
2. The optical computer of claim 1, wherein at least one of said rectangular array, row driver, column driver, overlapping means, and receiving array is integrated on a semiconductor substrate to produce a semiconductor chip product.
3. The optical computer of claim 1, wherein said rectangular array comprises: (a) a rectangular array of bistable light emitting elements each having two stable light emission modes with respect to an input signal in a predetermined range; (b) a row signal electrode for connecting all bistable light emitting elements arranged in a row and carrying said row signal outputted by said row driver; and (c) a column signal electrode for connecting all bistable light emitting elements arranged in a column and carrying said column signal outputted by said column driver.
4. An optical neurocomputer for performing a product and sum operation of a neuron state vector having a plurality of vector state signals and a interconnecting matrix consisting of a set of interconnecting signals, comprising: (a) a rectangular array of a plurality of bistable light emitting elements; (b) a row driver for sending each of said neuron state vector signals to a corresponding row of said light emitting elements; (c) a column driver for sending each of said interconnecting signals to a corresponding column of said light emitting elements; (d) overlapping means for generating a product signal of said neuron state vector signals and said interconnecting signals by overlapping one signal upon another at each element of said rectangular array so that each of said light emitting elements emits light corresponding to said product signal; (e) a receiving array of light receiving elements for receiving light from said rectangular array to produce a product and sum signal; and (f) feedback means having a threshold process, for receiving and subjecting said product and sum signal to said threshold process and feeding it back to said row driver.
5. The optical neurocomputer of claim 4, wherein at least one of said rectangular array, row driver, column driver, overlapping means, receiving array, and feedback means is integrated on a semiconductor substrate to form a semiconductor chip product.
6. A method of performing a product and/or sum operation on vector information and matrix information by using a rectangular array of bistable light emitting elements, comprising the steps of: (a) initializing all of said light emitting elements to an initial state; (b) sending a row signal corresponding to said vector information to each row of said light emitting elements; (c) dynamically sending a column signal corresponding to said matrix information to each column of said light emitting elements during said step (b) so that said row signal and said column signal activate a light emitting element at which both of said row signal and said column signal are active; (d) repeating said step (c) for all columns of said rectangular array; (e) repeating said steps (b) through (d) for all rows of said rectangular array; and (f) receiving light from a column of said light emitting elements to produce a product and sum signal.
7. An optical computer comprising: (a) a rectangular array of light emitting elements; (b) row signal generating means for outputting a row signal corresponding to a row of said rectangular array; (c) element signal generating means for dynamically outputting an element signal corresponding to each element of said rectangular array; (d) operation means for receiving said row signal and said element signal and outputting a product signal of said row signal and said element signal to said rectangular array; (e) a receiving array of light receiving elements for receiving light from a column of said rectangular array to produce one of a product and sum signal.
8. The optical computer of claim 7, wherein at least one of said rectangular array, row signal means, element signal means, operation means, and receiving array is integrated on a semiconductor substrate to form a semiconductor chip product.
9. The optical computer of claim 7, wherein said operation means comprises: (a) a pulse modulator for converting said element signal to a pulse signal having a duty determined by an intensity of said element signal; and (b) an AND gate for outputting a logical product signal of said row signal and said pulse signal to said light emitting element.
10. An optical neurocomputer for performing a product and sum operation on a neuron vector of a plurality of vector signals and an interconnecting matrix of a set of interconnecting signal, comprising: (a) a rectangular array of light emitting elements; (b) row signal generating means for outputting a row signal corresponding to a row of said light emitting elements; (c) element signal generating means for dynamically outputting an interconnecting signal corresponding to each element of said rectangular array; (d) means for receiving said row signal and said element signal and outputting a logical product signal to said rectangular array; (e) a receiving array of light receiving elements for receiving light from a column of said light emitting elements to produce a product signal; and (f) feedback means having threshold process, for receiving and subjecting said product signal to said threshold process and feeding it back to said row signal means.
11. The optical neurocomputer of claim 10, wherein at least one of said rectangular array, row signal means, element signal means, operation means, receiving array, and feedback means is integrated on a semiconductor substrate to form a semiconductor chip product.
12. An optical computer comprising: (a) a first rectangular array of light emitting elements; (b) a second rectangular array of light emitting/receiving elements, each of which is switchable to either a light emitting element or a light receiving element; (c) a bistable spatial light modulator placed between said first rectangular array and said second rectangular array; (d) first and second voltage controllers coupled, respectively, to said first and second rectangular arrays for dynamically recording optical transmittance data in said spatial light modulator by controlling light emission of said light emitting elements and light emitting/receiving elements so that said spatial light modulator controls its light transmission based on said optical transmittance data recorded therein; (e) production means for inputting a row signal sent by said first rectangular array to said spatial light modulator and generating an optical product signal of said row signal and said optical transmittance; and (f) summation means for receiving said optical product signal from said production means to said second rectangular array and generating a product and/or sum signal in a column of said light emitting/receiving elements, said summation means comprising a plurality of differential amplifiers for producing said sum signal and a plurality of comparators for producing said product signal.
13. The optical computer of claim 12, wherein at least one of said first rectangular array, second rectangular array, bistable spatial light modulator, recording means, production means, and summation means is integrated on a semiconductor substrate to form a semiconductor chip product.
14. The optical computer of claim 12, wherein said second rectangular array comprises: (a) a rectangular array of light emitting/receiving elements, each of which consists of a p layer, an i layer, and an n layer, placed one upon another in this order; (b) an upper electrode placed on top of a row of said light emitting/receiving elements to carry a signal to said row; and (c) a lower electrode placed on the back of a column of said light emitting/receiving elements to carry a signal to said column.
15. The optical computer of claim 12, wherein said light emitting elements are light emitting/receiving elements.
16. An optical neurocomputer comprising: (a) a first rectangular array of light emitting elements; (b) a second rectangular array of light emitting/receiving elements, each of which is switchable to either a light emitting element or a light receiving element; (c) a bistable spatial light modulator placed between said first rectangular array and said second rectangular array; (d) first and second voltage controllers coupled, respectively, to said first and second rectangular arrays for dynamically recording optical transmittance data in said spatial light modulator by controlling light emission of said light emitting elements and light emitting/receiving elements so that said spatial light modulator controls its light transmission based on said optical transmittance data recorded therein; (e) production means for inputting a row signal sent by said first rectangular array to said spatial light modulator and generating an optical product signal of said row signal and said optical transmittance; and (f) summation means for receiving said optical product signal from said production means to said second rectangular array and generating a product and/or sum signal in a column of said light emitting/receiving elements, said summation means comprising a plurality of differential amplifiers for producing said sum signal and a plurality of comparators for producing said product signal; (g) feedback means having a threshold process, for receiving and subjecting said product and sum signal from said summation means to said threshold process and feeding it back to said production means.
17. The optical neurocomputer of claim 16, wherein at least one of said first rectangular array, second rectangular array, bistable spatial light modulator, recording means, production means, summation means, and feedback means is integrated on a semiconductor substrate to form a semiconductor chip product.
18. A method of performing a product and/or sum operation of a binary vector, consisting of a state 0 and a state 1, and a matrix by using a bistable spatial light modulator placed between a first rectangular array of light emitting elements and a second rectangular array of light emitting/receiving elements and processing circuitry responsive to the second rectangular array, said bistable spatial light modulator having two stable modes; namely, an on state and an off state with respect to an input signal in a predetermined range, and both of said light emitting elements and said light emitting/receiving elements having two modes; namely, an on state and an off state, said method comprising the steps of: (a) dynamically recording optical transmittance data in said bistable spatial light modulator by controlling light emission of said light emitting elements and light emitting/receiving elements so that said bistable spatial light modulator controls its transmission light based on said optical transmittance data recorded therein; (b) setting all rows of said light emitting elements in the first rectangular array to an on state to emit light and setting all light emitting/receiving elements in said second rectangular array to an off state; (c) receiving light emitted from said first rectangular array with said second rectangular array and summing a column of said light to output a state 0 signal; (d) setting rows of said light emitting elements in either an off state or an on state corresponding to a state 0 of a state 1 of said vector; (e) receiving said transmission light emitted from said first rectangular array with said second rectangular array and summing a column of said transmission light to output a mixed state signal; and (f) differentiating, with said processing circuitry, said mixed-state signal and said state 0 signal.
19. A method of dynamically recording matrix information as optical transmittance data by using a bistable spatial light modulator placed between a first rectangular array of light emitting elements and a second rectangular array of light emitting/receiving elements, said bistable spatial light modulator having two stable modes; namely, an on state and an off state for an input signal in a predetermined range, and said light emitting elements and said light emitting/receiving elements having two modes; namely, an off state and an on state, said method comprising the steps of: (a) setting both of said first rectangular array and said second rectangular array in an off state to thereby set said bistable spatial light modulator in an off state; (b) setting said second rectangular array in an on state; (c) setting each element of said first rectangular array in an on or off state based on said matrix information so that an element of said bistable spatial light modulator is put in an on state when both of said light emitting element and said light emitting/receiving element are in an on state; and (d) holding said second rectangular array in an on state so that once it is put in an on state in said step (c), said bistable spatial light modulator keeps said on state.
Patent Citations (24)
| Patent | Date | Inventor | Cited By |
|---|---|---|---|
| US3686661 | 1972-08-01 | Sharpless | |
| US3739371 | 1973-06-01 | Hulyer | |
| US3845241 | 1974-10-01 | Schwartz | |
| US4011558 | 1977-03-01 | Sharpless | |
| US4283659 | 1981-08-01 | Beckerman et al. | |
| US4654649 | 1987-03-01 | Kojima et al. | |
| US4707692 | 1987-11-01 | Higgins et al. | |
| US4771278 | 1988-09-01 | Pooley | |
| US4772886 | 1988-09-01 | Hasegawa | |
| US4809204 | 1989-02-01 | Dagenais et al. | |
| US4849940 | 1989-07-01 | Marks, II et al. | |
| US4860253 | 1989-08-01 | Owechko et al. | |
| US4910571 | 1990-03-01 | Kasahara et al. | |
| US4939682 | 1990-07-01 | Falk | |
| US4995088 | 1991-02-01 | Farhat | |
| US5004309 | 1991-04-01 | Caulfield et al. | |
| US5028969 | 1991-07-01 | Kasahara et al. | |
| US5063531 | 1991-11-01 | Kawai et al. | |
| US5093875 | 1992-03-01 | Ogusa et al. | |
| US5095459 | 1992-03-01 | Ohta et al. | |
| JPX2-59914 | 1990-02-01 | ||
| JPX2-59915 | 1990-02-01 | ||
| JPX2-59916 | 1990-02-01 | ||
| JPX2-61708 | 1990-03-01 |
Non-Patent Literature (10)
- Valentine, E. H., "Memory Systems Utilizing Light-Emitting Diodes and Photodetectors", IBM Technical Disclosure Bulletin, vol. 14, No. 12, May 1972, 3701-3702.
- Takizawa et al., "Bistable Spatial Light Modulator (I) Analysis", Proceedings Applied Physics Association Meeting 1988, 734.
- Takizawa et al., "Bistable Spatial Light Modulator (II) Experimental Results", Proceedings Applied Physics Assoc. Meeting 1988.
- Ohta et al., "Associative Optical Neurocomputer", Electronic Info. Communication Society Opto-quantum Electronic Study Group, 39-45.
- Millman, J., Microelectronics Digital & Analog Circuits & Systems, McGraw-Hill, 1979, 646.
- Murray, A. F., "Pulse Arithmetic in VLSI Neural Networks", IEEE Micro, Dec. 89, pp. 64-74.
- Farhat, N. H., "architectures For Optoelectronic Analogs of Self-organizing Neural Networks", Optics Letters, vol. 12, No. 6, Jun, 87, pp. 448-450.
- Fahrat, N. H., "Optoelectronic Analogs of Self-programing Neural Nets:Architecture and Methodologies for Implementing Fast Stochastic Learning by Simulated Annealing", Applied Optics, vol. 26, No. 23, Dec. 1987, pp. 5093-5103.
- Bell, D. A. Solid State Pulse Circuits, Reston Pub., 1981, 400-402.
- Wagner et al., "Multilayer Optical Learning Networks", Digital Optical Computing, vol. 752, 1987, pp. 86-97.