Processing memory requests in a pipelined memory controller

[0001] This application is a continuation of, and incorporates by reference in its entirety, U.S. patent application Ser. No. 10/464,234, entitled PIPELINED MEMORY CONTROLLER,” filed Jun. 17, 2003, which in turn is a continuation of, and incorporates by reference in its entirety, U.S. patent application Ser. No. 10/195,779, entitled “PIPELINED MEMORY CONTROLLER”, filed Jul. 11, 2002, now U.S. Pat. No. 6,604,180, which in turn is a continuation of, and incorporates by reference in its entirety, U.S. patent application Ser. No. 09/908,784, entitled “PIPELINE MEMORY CONTROLLER”, filed Jul. 18, 2001, now U.S. Pat. No. 6,449,703, which in turn is a continuation of U.S. patent application Ser. No. 09/127,207, entitled, “PIPELINED MEMORY CONTROLLER,” filed on Jul. 31, 1998, now U.S. Pat. No. 6,272,609. U.S. patent application Ser. No. 09/127,282, filed Jul. 31, 1998, now U.S. Pat. No. 6,295,592, entitled, “METHOD OF PROCESSING MEMORY REQUESTS IN A PIPELINED MEMORY CONTROLLER,” and U.S. patent application Ser. No. 09/931,728, filed Aug. 16, 2001, now U.S. Pat. No. 6,622,228, entitled “SYSTEM AND METHOD OF PROCESSING MEMORY REQUESTS IN A PIPELINED MEMORY CONTROLLER” each contains related subject matter and are each incorporated by reference, in their entirety.

[0002] 1. Field of the Invention

[0003] The invention relates generally to memory controllers and more particularly to processing memory requests in a memory controller.

[0004] 2. Description of the Related Technology

[0005] A computer system relies on memory to store instructions and data that are processed by a computer system processor. Breathtaking advances have been made in both the storage capacity and speed of computer memory devices. However, the speed increases of memory devices have not been able to keep pace with the speed increases achieved with current microprocessors. As a result, the speed of current computer systems is limited by the speed in which the data instructions can be accessed from the memory of the computer system.

[0006] The typical memory contains an array of memory cells connected to each other by row and column lines. Each memory cell stores a single bit and is accessed by a memory address that includes a row address that indexes a row of the memory array and a column address that indexes a column of the memory array. Accordingly, each memory address points to the memory cell at the intersection of the row specified by the row address and the column specified by the column address.

[0007] In a typical computer system, the system processor communicates with the computer memory via a processor bus and a memory controller. For example, a central processing unit (CPU) issues a command and an address which are received and translated by the memory controller. The memory controller, in turn, applies appropriate command signals and row and column addresses to the memory device. Examples of such commands include a row address strobe (RAS), column address strobe (CAS), write enable (WE), and possibly a clock signal (CLK). In response to the commands and addresses, data is transferred between the CPU and the memory device.

[0008] The memory device typically includes a dynamic random access memory (DRAM) module such as a single in-line memory module (SIMM) or a dual in-line memory module (DIMM). The memory module typically includes one or more banks of memory chips connected in parallel such that each memory bank stores one word of data per memory address.

[0009] In an attempt to decrease memory access time, an even faster form of memory, referred to as synchronous DRAM (SDRAM), was created. SDRAM transfers data with the use of a clock signal. In contrast, typical DRAM devices are asynchronous because they do not require a clock input signal. The memory controller for synchronous devices receives the system clock signal and operates as a synchronous interface with the CPU so that data is exchanged with the CPU at appropriate edges of the clock signal.

[0010] SDRAMs offer substantial advances in DRAM operating performance, including the ability to synchronously burst data at a high data rate with automatic column-address generation, the ability to interleave between internal data banks in order to hide precharged time, and the capability to change column in addresses on each clock cycle during a burst access.

[0011] Typically SDRAMs are configured to include a pipeline. Pipelining refers to the interlinking or overlapping of input and output data and addresses of consecutive bus cycles. Pipelining increases the throughput of memory transactions. With this pipelined architecture SDRAMs can accept a new column address on every clock cycle.

[0012] As the speed of memory devices such as the SDRAM increases, other bottlenecks arise within computer systems. For example, as SDRAM devices are operated at faster clock rates, the memory controllers to which they are coupled often cannot exchange data between the CPU and the memory device quickly enough. Therefore, manufacturers have found that the memory controller itself needs to be pipelined.

[0013] In view of the above, it is apparent that manufacturers are in need of an efficient pipelined memory controller to facilitate the communication of the memory requests to the memory devices.

[0014] In one embodiment of the invention, there is a method of handling at least one memory request, comprising receiving at least one memory request for digital information from a memory requester, the memory request being received by a memory controller that processes the memory request in a plurality of pipelined stages; in one of the pipelined stages, decoding the at least one memory request; in one of the pipelined stages, sending the at least one memory request to a memory module; and in one of the pipelined stages, communicating the data from the at least one memory request from the memory module to the memory controller.

[0015] In another embodiment of the invention, there is a system comprising at least one memory; and a pipelined memory controller configured to operably control the at least one memory, the pipelined memory controller configured to receive memory requests with respect to the at least one memory, and wherein the pipelined memory controller is configured to process the memory requests in a plurality of concurrently processed pipelined stages.

[0016] In yet another embodiment of the invention, there is a system for processing at least one memory request, the system comprising means for processing the at least one memory request in a plurality of stages, wherein in a first stage, the at least one memory request is received from a memory requester and stored in a request buffer, wherein in a second stage the at least one memory request is decoded, wherein in a third stage the at least one memory request is sent to a memory module, wherein, each of the first, second and third stages are executed in parallel, and wherein the act of processing includes the act of storing the at least one memory request in at least one rotational register contained in the request buffer.

[0027] The following detailed description is directed to certain specific embodiments of the invention. However, the invention can be embodied in a multitude of different ways as defined and covered by the claims. In this description, reference is made to the drawings wherein like parts are designated with like numerals throughout.

[0028] FIG. 1 illustrates a computer system 10 for processing memory requests for access to a memory module 12 with two memory banks 14, 16. The memory module 12 can be any of numerous types of memory modules, such as a double in-line memory module (DIMM). The memory module 12 includes a set of SDRAM memory chips structured to store data and computer instructions. The memory module 12 can include memory other than SDRAM, such as static random access memory (SRAM) or asynchronous DRAM.

[0029] Of course, the memory module 12 can have more or less than the two memory banks 14, 16. The computer system 10 includes a memory controller 18 that controls the manner in which data is written to or read from the memory banks 14, 16 of the memory module 12. The memory controller 18 interfaces the memory module 12 with a computer system processor 20 via a processor bus 22. As is typical, the computer system 10 also includes an extension bus, such as a PCI bus 24, that is coupled to the processor bus 22 by a bus agent 26. Coupled to the extension bus 24 is an input device 28, including such peripherals as a keyboard, mouse, or electronic pen/tablet, and a hard drive 30. The computer system 10 also includes a video monitor 32 coupled to a video controller 34. The video controller 34 is coupled to the memory controller 18 by an accelerated graphics port (AGP) bus 33. The processor 20, input device 28, hard drive 30, and video controller 34, each can be referred to as a memory requester because each can request access to the information stored in the memory module 12.

[0030] In addition, the PCI bus 24 can also be referred to as a memory requester because the input device 28, hard drive 30, and any other devices coupled to the PCI bus 24 all require the PCI bus 24 to transfer memory requests to the memory module 12. In one embodiment, the PCI bus 24 and the video controller 34 are coupled directly to the memory controller 18 to allow direct memory access to the memory module 12 by the PCI bus 24 and the video monitor 32 and the video controller 34. Such direct memory access reduces the data that is carried by the processor bus 22, thereby reducing bottlenecks on the processor bus 22 and increasing the speed of communication between the elements of the computer system 10. In particular the memory controller 18 includes a processor interface 36, coupled to the processor 20 via the processor bus 22; a PCI interface 38 coupled to the PCI bus 24; and a video interface 40 coupled to the video controller 34. Each of the interfaces 36, 38, 40 is responsive to respective read and write control signals received from each of the interfaces 36, 38, 40 and respective memory requesters 20, 24, 34. The memory controller 18 also includes a pipeline controller 42 which handles all of the read and write requests to the memory module 12.

[0031] Referring to FIG. 2, in conjunction with FIG. 1, some of the features of the pipeline controller 42 are illustrated. The pipeline controller 42 has a request buffer 50. The request buffer 50 has a simple rotational set of request registers 52–58 that hold the address, type of transfer and count for each memory request. The number of registers in the request buffer 50 determines how many outstanding requests may be sent to the memory controller 18. In one embodiment of the invention, four registers are used. However, the request buffer 50 may comprise sets of three to five, two to seven, or one to nine registers as well. The pipeline controller 42 also has a decode module 60, a memory address module 62, a data transfer module 64, and a state machine 66.

[0032] Referring to FIG. 3, it is seen that the decode module 60, the memory address module 62, and the data transfer module 64, all contain a unique pointer to the request buffer 50. The state machine 66 controls the pointer updates for decode module, the memory address module 62, and the data transfer module 64. The function and operation of each of the modules 60–64 will be described in greater detail below.

[0033] The pipeline controller 42 uses a pipelined approach to handling a memory request from each of the memory requesters. Each stage in the pipeline is handled by one of the modules 60–64 in the pipeline controller 42. The pipelined approach provides for the simultaneous processing of multiple memory requests. In the embodiment of the invention illustrated in FIG. 2, a three stage pipeline is shown. Each stage of the pipeline is handled by one of the modules 60–64, respectively. In a first stage, the decode module 60 determines whether or not the first memory request was a page hit or a miss, the type of memory that had been requested, which of the memory banks 14, 16 is to be addressed, and the error correction or detection method to be used. In a second stage, the memory address module 62 sends the row and address information of the memory request to the memory. In a third stage, the data transfer module 64 handles the transmission of the data to or from the memory module 12. The decode module 60 and the memory address module 62 may process the same memory request independently of each other. However, the data transfer module 64 needs to wait for the appropriate information to be transferred to the memory module 12 before sending or receiving the data for a memory request.

[0034] It is noted that the number of stages in the state machine 66 may be increased or reduced. For example, a larger pipeline may be implemented by increasing the number steps. The decode stage can be divided into multiple steps. The pipeline controller 42 can have a pipelined stage for each of the major processes in the decode module 60, the memory address module 62 and the data transfer module 64. If the number of stages is increased, the amount of time for each stage is reduced. The state machine 66 will control which phase of a memory cycle is active for each of these phases. Additionally, the state machine 66 will determine when each of the pipeline modules 60–64 pointers are to be incremented.

[0035] Referring to FIG. 4, the receiving process for the request buffer 50 is illustrated. The request buffer 50 holds and queues each of the memory requests for processing for later use by each of the pipeline modules 60–64. Starting at a state 68, the memory controller 18 receives a first request. Moving to a decision state 69, the memory controller 18 determines whether the request buffer 50 is full. If the request buffer 50 is full, the memory controller in a state 70 notifies the memory requester that the request buffer 50 is full. No further requests can be received until one of the memory requests in the request buffer 50 is fully processed. Otherwise, if the request buffer 50 is not full, in a state 71 the memory controller 18 places the memory request in one of the registers 52–58. Moving to a state 72, the memory controller 18 increments the request pointer in the state machine 66 (FIGS. 2, 3) to reference the new memory request. The memory controller 18 returns to the state 68 to process further memory requests.

[0036] Now referring to FIG. 5, the process by which the decode module 60 performs the initial processing for a memory request is described. Starting at a state 73, the state machine 66 assigns the decode pointer to reference the proper memory request in the request buffer 50. Then, in state 74, the decode module 60 determines whether or not the memory request is a page hit or a miss. If the memory request is a hit, the memory reference is of a same type as a previous memory reference. Therefore, no additional decoding is performed and the process flow returns to the state 73. However, if the memory request is a miss, the process proceeds to a state 76. At the state 76, the address of the memory request is compared to a set of bank address registers to determine a bank number for the appropriate memory bank. The bank number is used to reference a plurality of bank descriptor registers. Proceeding to a state 77, the bank descriptor registers are used to determine the memory type of the memory request and the type of error correction that are to be applied upon accessing the memory. The decode module 60 can be programmed to use any of the error correction or detection methods that are known in the art. The process flow then returns to the state 73 to perform additional decoding. The operation of the page hit/miss determination, the bank address comparison, and the bank descriptor lookup may take one or more clock cycles depending on the clock speed of the computer system 10.

[0037] The results of this processing are then saved for use by the other modules 62–64. Upon completion of the decode processing, the state machine 66 increments the decode pointer to the request buffer 50. The decode module 60 now processes the next memory request, if any, in the request buffer 50.

[0038] Referring to FIG. 6, the states of the second stage of the pipeline are described. The second stage of the pipeline process involves memory addressing. Similar to the decode pointer in the decode module 60, the memory address module 62 has an addressing pointer referencing a memory request in the request buffer 50. Starting at a state 80, the state machine 66 updates the addressing pointer. The addressing pointer indicates to the memory address module 62 which memory request needs to be processed. Next, in state 82, the memory address module 62 asserts the row address strobe (RAS) and the column address strobe (CAS) and sends to the memory module 12 the row and column address, respectively, for the address referenced by the addressing pointer. Once the memory address module 62 is complete, the addressing pointer is updated in state 84 so that it points to the next memory request.

[0039] FIG. 7 illustrates the third stage of the pipeline. The third stage is the data phase which is handled by the data transfer module 64. The data transfer module 64 has a data pointer which references the memory request in the request buffer 50 which is to be processed. In state 86, the data pointer is updated by the state machine 66. The data transfer module 64 then transfers the data to the memory module 12 in a state 88. The amount of buffering in the memory controller 18 determines how long this stage is active due to CAS latency. CAS latency is the delay, in clock cycles, between the registration of a request command with a memory device and the availability of the first piece of output data. When the data transfer is complete, the data phase pointer is incremented in state 90 by the state machine 66.

[0040] Referring to FIGS. 8 and 9, the processing steps for two memory requests are illustrated. FIG. 8 is a timing diagram illustrating the significant portions of the memory controller 18, and FIG. 9 is a high level flow diagram showing the processing performed by the memory controller 18 for these requests.

[0041] Starting at a state 120 (FIG. 9), a first memory request is received by the memory controller 18 (clock cycle 100). The memory controller 18 places the first memory request in the request buffer 50. Since the first memory request is the only request in the queue, the memory controller 18 performs the decode and the address functions simultaneously. The decode process is described in greater detail in reference to states 73–77; however, in summation the decode module 60 determines whether or not the first memory request was a page hit or a miss, the type of memory that had been requested, which of the memory banks 14, 16 is to be addressed, and the error correction or detection method to be used. In addition, the memory address module 62 starts sending the address for the first memory request to the memory module 12. The memory address module 62 asserts the row address strobe and sends the row address to the memory module 12 across an address line.

[0042] Next, at a state 122, a second memory request is received (clock cycle 102). The state machine 66 updates the pointer in the decode module 60 to reference the second memory request. Moving to a state 124, the decode module 60 starts processing the second memory request (clock cycle 104). Additionally, the memory address module 62 asserts the column address strobe and sends the appropriate address for the column for the first memory address.

[0043] Continuing to a state 126, the state machine 66 updates the pointer in the memory address module 62 to reference the second memory request (clock cycle 106). The memory address module 62 during clock cycles 108–112 sends the memory module 12 the row and column information for the second memory request.

[0044] Finally, in state 128, the requested data is received or sent to the memory module 12 (clock cycles 110 and beyond). It is noted that while data is being received from the data module, the memory controller 18 can decode and address subsequent memory requests.

[0045] FIG. 10 is a flow diagram illustrating the pipeline process for the state machine 66. Starting at a state 150, the state machine 66 is in an idle state waiting for a memory request. After receiving a memory request, the state machine 66 moves to a state 152 to send the row address to the memory module 12 of the memory referenced by the memory request. Next, at a decision state 154, the state machine 66 requests the memory module 12 to perform a column access. If the memory reference was not in the memory banks 14, 16 of the memory module 12, the state machine 66 returns to state 152 to process further memory requests, if any. If the memory reference was in the memory banks 14, 16, the state machine 66 proceeds to a decision state 156. In this state, an active command may be used to open or activate a row in the memory banks 14, 16 for subsequent memory accesses. At decision state 156, if an active command was initiated, the state machine 66 determines whether the memory request was for burst access or whether there is a pipeline request for a memory cell in the same row as the previous request. If the memory request was for a burst access, the state machine 66 moves to a state 158 and waits for the data. On the other hand, if it is determined in state 156 that a row in the memory banks 14, 16 was made active, in the decision state 156 the state machine 66 processes all of the memory requests for the open row. Moving from the state 156, the state machine 66 moves to a state 160 and activates the precharge command to deactivate any active rows in the memory module 12.

[0046] As is witnessed by the foregoing discussion, the pipeline of the invention increases memory throughput if several memory accesses are executed, one after the other. Based upon the foregoing discussion, it will be appreciated that the invention greatly reduces the number of memory access delays by pipelining the memory requests in the request buffer 50. The invention allows three memory operations to be acted on concurrently. The invention provides the decode module 60, the memory address module 62, and the data transfer module 64 which can each perform the partial processing of a memory request during the same clock cycle. In a non-pipelined memory controller, each memory request waits for the completion of the previous memory request before being processed. However, using the modules 60–64, a second memory request can be processed before the completion of the processing of a first memory request. For example, once the decode module 60 has finished decoding the first memory request, the decode module 60 can start the decode process for the second memory request.

[0047] More significantly, the pipeline for the memory controller 18 is simply and cheaply implemented by using a set of rotational registers 52–58. The registers 52–58 are easily indexed by stages in a pipeline through the use of pointers. The state machine 66 simply updates the pointers for each of the modules 60–64 to step through each of the stages in the pipeline.

[0048] While the above detailed description has shown, described, and pointed out fundamental novel features of the invention as applied to various embodiments, it will be understood that various omissions and substitutions and changes in the form and details of the system illustrated may be made by those skilled in the art, without departing from the intent of the invention. The scope of the invention is indicated by the appended claims rather than by the foregoing description. All changes which come within the meaning and range of equivalency of the claims are to be embraced within their scope.