Communication between processors

[0002] This application is a continuation application of and claims priority to U.S. patent application Ser. No. 09/475,609, filed on Dec. 30, 1999, now U.S. Pat. No. 6,584,522 the entire contents of which are hereby incorporated by reference.

[0003] The invention relates to communication between processors.

[0004] Multi-processor computer systems have more than one processor. Each processor executes a separate stream (“thread”) of instructions. It is sometimes necessary for two processors of a computer system to communicate data between themselves.

[0005] In one general aspect of the invention, a method of communicating between a first and a second processor includes the first processor sending a datum over a common control bus, and the second processor receiving the datum from the common control bus.

[0006] Advantages and other features of the invention will become apparent from the following description and from the claims.

[0007] FIG. 1 shows a computer system that has a first and a second processor.

[0008] FIG. 2A shows a program executed by the first processor of FIG. 1 that includes a GET instruction and a PUT instruction.

[0009] FIG. 2B shows a get FIFO of the first processor of FIG. 1.

[0010] FIG. 2C shows a send FIFO of the second processor of FIG. 1.

[0011] FIG. 3 is a flow chart of the execution of the GET instruction of FIG. 2A.

[0012] FIG. 4A shows the get FIFO of FIG. 2B after the execution of the GET instruction of FIG. 3.

[0013] FIG. 4B shows the send FIFO of FIG. 2C after the execution of the GET instruction of FIG. 3.

[0014] FIG. 5A shows a send FIFO of the first processor of FIG. 1 prior to the PUT instruction of FIG. 2A.

[0015] FIG. 5B shows a get FIFO of the second processor of FIG. 1 prior to the PUT instruction of FIG. 2A.

[0016] FIG. 6 is a flow chart of the execution of the PUT instruction of FIG. 2A.

[0017] FIG. 7A shows the send FIFO of FIG. 5A after the execution of the put instruction of FIG. 6.

[0018] FIG. 7B shows the get FIFO of FIG. 5B after the execution of the put instruction of FIG. 6.

[0019] Referring to FIG. 1, a computer system 26 includes two processors 1, 2. Each processor 1, 2 has a corresponding static random access memory (SRAM) 21, 22 for storing data that needs to be accessed with a low latency and a corresponding synchronous dynamic random access memory (SDRAM) 23, 24 for processing large volumes of data.

[0020] The processors 1, 2 each have an Fbus FIFO 3, 4, which is connected to a 64-bit FIFO bus 25, for communicating to peripheral devices, such as media access controller (MAC) 16. MAC 16 may be a Gigabit Ethernet device that complies with the IEEE 802.3z standard. MAC 16 has two data ports 17, 18. Multiple peripheral devices may be concurrently connected to the FIFO bus 25. Through the FIFO bus 25, each of the processors 1, 2 can communicate with any peripherals 16 connected to the FIFO bus.

[0021] At any time, one processor (“the master”) controls the FIFO bus 25 using signals sent over the Ready Control Bus 14, while the other processor (“the slave”) responds to instructions from the master. In FIG. 1, processor 1 is the master while processor 2 is the slave.

[0022] The master controls communications on the first-in-first-out-buffer (FIFO) bus using signals sent on a 5-bit Ready Control Bus 14. The signals allow the master to directly address a device or a slave processor on the bus and to send a query to determine whether the device is ready to transmit (TRRdy) or receive (RRdy) data on the bus. The computer system may include a decoder 15 for decoding signals from the Ready Control Bus into a single TRRdy signal 19 and a single Rrdy signal 20 for a device 16 on the bus.

[0023] Additionally, the computer system includes an 8-bit Ready Bus 13, which is used by the master processor 1 to control data flow on the devices on the FIFO bus 25. For example, master processor 1 may use the Ready Bus 13 to direct MAC 16 to send data from port 1 instead of sending data from port 2 onto the bus. Each processor 1, 2 has a send FIFO 9, 10 for buffering data elements that are to be sent on the Ready Bus 13, and a get FIFO 11, 12 for buffering data elements that are received from the Ready Bus 13. Each FIFO 9-12 is capable of storing a number of data elements, and each data element may be a byte, a word, a long word, or a quad word. In the example of FIG. 1, the FIFOs 9-12 are configured to store up to eight long words, each of which has 32 bits. Because each data element is 32 bits, it takes four data transfers on the ready bus to transmit a data element from one processor to other. Other implementations with different bus width and data element sizes may take a different number of transfers to transmit a data element.

[0024] Each processor 1, 2 has a Ready Bus controller 5, 6 for controlling the Ready Control Bus 14, the Ready Bus 13 and the FIFO bus 25. The Ready Bus controller 5, 6 may be a microcode program, logic, or a processing unit within the processor. In the embodiment of FIG. 1, the Ready Bus Controller 5, 6 includes a sequencer 5a, 6afor executing a sequence of bus control instructions. The bus control instructions are part of a program 5b, 6b.

[0025] The system 26 provides a way of communicating between processors 1, and 2 over the Ready Bus 13, when the Ready Bus is not being used to communicate data to peripheral devices. Referring to FIG. 2A, processor 1 executes a sequence of instructions contained within program 5b. The instructions include a “GET 6” instruction 32a, which directs the processor 1 to retrieve six data elements from processor 2 and a “PUT 3” instruction, which directs processor 1 to send three data elements to processor 2.

[0026] Referring to FIGS. 2B and 2C, the state, of the get FIFO 11 of processor 1 and the send FIFO 10 of processor 2 prior to the execution of the GET instruction 32a(FIG. 2A) will be described. As shown, get FIFO 11 contains three data elements 30a-cthat were previously retrieved from processor 2. However, the number of data elements is less than the six data elements required by the GET instruction 32a. Send FIFO 10 of processor 2 contains 3 data elements 31a-cthat are to be sent to processor 1. The data 31 in the send FIFO 10 is transferred to the get FIFO 11 by the GET instruction 32aas described below.

[0027] Referring to FIG. 3, communication of data from a slave processor 2 to the master processor 1 over the Ready Bus 13 will be described. Upon decoding 100 a GET instruction, such as instruction 32aof FIG. 2A, processor 1 determines 101 the number of data elements to be retrieved based on an argument to the GET instruction. For instruction 32a, the number of items to be retrieved is six. The processor 1 determines 102 the number of data elements that are already in its get FIFO 11. The number of data elements in the get FIFO 11 of FIG. 2B is three. The processor 1 sets 103 the count of the number of transfers required (transfer count) to four times the difference between the number of data elements to be retrieved and the number of data elements in the get FIFO 11. The number is multiplied by four because the transmission of each 32-bit data element requires four transfers on the 8-bit ready bus. For instruction 32aand the FIFO of FIG. 2B, the number transfer count is twelve, i.e. 4*(6−3). The processor 1 checks 104 whether the transfer count is greater than zero. If it is not then the transfer of data is complete 105. Otherwise if it is, the processor 1 drives 106 the Ready Control Bus 14 with a signal (GET signal) that represents a command to get data.

[0028] Upon receiving 107 the GET signal, the slave processor 2 determines 108 the number of data elements in its send FIFO 10. The number of data elements in the send FIFO of FIG. 2C is 3. If the number of entries is greater than zero, processor 2 drives 110 the Ready Bus 13 with a signal representing the first entry in its send FIFO and removes the entry from the send FIFO. For the send FIFO of FIG. 2C, the first entry is datum 31a. Otherwise if the number of entries is zero, processor 2 drives 111 the Ready Bus 13 with a predetermined signal, such as a signal representing zero, that signifies an empty send FIFO.

[0029] Processor 1 gets 112 a signal representing data from the Ready Bus 13 and decrements the transfer count, to reflect the receipt of a datum. Processor 1 checks 113 whether the received datum is zero, which signifies an empty send FIFO.

[0030] If the received datum is zero, processor 1 sets 104 the transfer count to zero to terminate the transfer of data and proceeds to 104. In instances where each data element is transmitted in multiple transfers because the bus is narrower than the data element (as shown in FIG. 1), it is possible that only part of the required transfers associated with a data element may be completed. For example, in the system of FIGS. 1-2c, the number of transfers may not be a multiple of four, signifying that an incomplete data element has been received. Should that happen, the received data corresponding to the incomplete datum is discarded so that the received data that is processed is a multiple of four.

[0031] Otherwise if the received datum is not zero, the processor stores 115 the received datum in the get FIFO 11 of processor 1 and proceeds to 104. This process is repeated until the number of data elements in the receive FIFO 11 is equal to the argument of the GET command.

[0032] Referring to FIGS. 4A and 4B, the effects of the process of FIG. 3 on the get FIFO 11 and the send FIFO 10 of FIGS. 2B and 2C will be described. The process has transferred data 31 from send FIFO 10 to get FIFO 11. Get FIFO 11 now has six data elements, as specified in the GET instruction 32a(FIG. 2A). Thus, the GET instruction provides a way to communicate data from a slave processor to a master processor using bus signals that are also used to control communication between peripherals.

[0033] Referring to FIGS. 5A and 5B, the state of the send FIFO 9 of processor 1 and the get FIFO 12 of processor 2 prior to the PUT instruction 32b(FIG. 2A) will be described. The send FIFO 9 has three data elements 33a-c. The get FIFO 12 has three data elements 34a-c. The get FIFO 12 also has space 36 for accommodating additional data. The PUT instruction 32btransfers data from the send FIFO 9 to the get FIFO 12 as described below.

[0034] Referring to FIG. 6, upon decoding 200 a PUT instruction, the master processor 1 establishes 201 the number of items (put count) to be sent to the slave processor based on the argument of the PUT instruction. Where each data element is transmitted in multiple transfers, the put count is computed by multiplying the argument with the number of transfers required to transmit a data element. For the PUT instruction 32b(FIG. 2A), the put count is 12, i.e. 3*4. The processor 2 checks 201 whether the put count is greater than zero. If the put count is not greater than zero, the process is done 202 because there are no more data elements to send. Otherwise if the put count is greater than zero, processor 1 sends 203 a signal to processor 2 over the Ready Control Bus 14 querying processor 2 to determine whether the get FIFO 12 of processor 2 is full.

[0035] Upon receiving 204 the query from processor 1, processor 2 checks 205 whether its get FIFO 12 is full. If the get FIFO 12 is full, processor 2 sends a FULL signal over the Ready Bus 13 to indicate to processor 1 that it is not ready to receive any additional data. Otherwise, processor 2 sends a NOTFULL signal over the Ready Bus to processor 1 to indicate that the get FIFO 12 is not full.

[0036] Upon receiving a signal from processor 2, processor 1 checks the signal to determine whether the get FIFO 12 of processor 2 is full. If the get FIFO 12 is full, the process is done 209 and the process terminates. Otherwise if the get FIFO 12 is not full, processor 1 drives 210 the Ready Control Bus 14 with a SEND signal to alert processor 2 that processor 1 is about to send data to processor 2. Processor 1 drives 212 the Ready Bus 13 with a datum that processor 2 stores in its get FIFO 12. Processor 1 removes 212 the sent datum from the send FIFO 9 and decrements 213 the put count, to reflect the sending of the datum. Processor 1 proceeds to 201 and repeats the process until the number of data elements sent is equal to the argument of the put instruction.

[0037] Referring to FIGS. 7A and 7B, the state of the send FIFO 9 (FIG. 5A) of processor 1 and the get FIFO 12 (FIG. 5B) of processor 2 after the process of FIG. 6 will be described. As shown, three data elements 33a-chave been transferred from the send FIFO 9 of processor 1 to the get FIFO 12 of processor 2 in response to the instruction 32b(FIG. 2A). Thus, the put instruction provides a method of transferring data from one processor to another processor using bus signals that are also used to control communication between peripheral devices.

[0038] Other embodiments are within the scope of the following claims. For example, alternative implementations may control data flow using the Ready Control Bus 14 signals, instead of using a separate Ready Bus 13. In these embodiments, the data communicated between the FIFOs would be sent over the Ready Control Bus, instead of the Ready Bus.

[0039] The communication method could also be used between process that share the same SRAM or SDRAM memory, instead of the separate memories shown in FIG. 1. A different kind of memory buffer could be used instead of the send or receive FIFO. For example, a LIFO may be used for the communications on the Ready Bus.

[0040] Commonly known methods may be used to transfer control from processor 1 to processor 2 so that either processor 1 or 2 can become the master as needed.