Loop-Back Memory-Module Extender Card for Self-Testing Fully-Buffered Memory Modules

[0001] This invention relates to memory modules, and more particularly to extender cards for testing memory modules.

[0002] Electronic systems such as personal computers (PC's) often use small printed-circuit board (PCB) daughter cards known as memory modules instead of directly mounting individual memory chips on a motherboard. The memory modules are built to meet specifications set by industry standards, thus ensuring a wide potential market. High-volume production and competition have driven module costs down dramatically, benefiting the PC buyer.

[0003] Memory modules are made in many different sizes and capacities, such as older 30-pin and 72-pin single-inline memory modules (SIMMs) and newer 168-pin, 184-pin, and 240-pin dual inline memory modules (DIMMs). The “pins” were originally pins extending from the module's edge, but now most modules are leadless, having metal contact pads or leads. The modules are small in size, being about 3–5 inches long and about an inch to an inch and a half in height.

[0004] The modules contain a small printed-circuit board substrate, typically a multi-layer board with alternating laminated layers of fiberglass insulation and foil or metal interconnect layers. Surface mounted components such as DRAM chips and capacitors are soldered onto one or both surfaces of the substrate.

[0005] FIG. 1 shows a fully-buffered memory module. Memory module 10 contains a substrate such as a multi-layer printed-circuit board (PCB) with surface-mounted DRAM chips 22 mounted to the front surface or side of the substrate, as shown in FIG. 1, while more DRAM chips 22 are mounted to the back side or surface of the substrate (not shown). Memory module 10 is a fully-buffered dual-inline memory module (FB-DIMM) that is fully buffered by Advanced Memory Buffer (AMB) 24 on memory module 10.

[0006] Metal contact pads 12 are positioned along the bottom edge of the module on both front and back surfaces. Metal contact pads 12 mate with pads on a module socket to electrically connect the module to a PC's motherboard. Holes 16 are present on some kinds of modules to ensure that the module is correctly positioned in the socket. Notches 14 also ensure correct insertion of the module. Capacitors or other discrete components are surface-mounted on the substrate to filter noise from the DRAM chips 22.

[0007] As system clock speeds increase, data must be transmitted and received at ever-increasing rates. Differential signaling techniques are being used to carry data, clock, and commands to and from memory modules. AMB 24 is a chip mounted onto the substrate of memory module 10 to support differential signaling through metal contact pads 12. AMB 24 sends and receives external packets or frames of data and commands to other memory modules in other sockets over differential data lines in metal contact pads 12.

[0008] AMB 24 also extracts data from the external frames and writes the extracted data to DRAM chips 22 on memory module 10. Command frames to read data are decoded by AMB 24. AMB 24 sends addresses and read signals to DRAM chips 22 to read the requested data, and packages the data into external frames that are transmitted from AMB 24 over metal contact pads 12 to other memory modules and eventually to the host processor.

[0009] Memory module 10 is known as a fully-buffered memory module since AMB 24 buffers data from DRAM chips 22 to metal contact pads 12. DRAM chips 22 do not send and receive data directly from metal contact pads 12 as in many prior memory module standards. Since DRAM chips 22 do not directly communicate data with metal contact pads 12, signals on metal contact pads 12 can operate at very high data rates.

[0010] FIG. 2 shows detail of an advanced memory buffer on a fully-buffered memory module. AMB 24 contains DRAM controller 50, which generates DRAM control signals to read and write data to and from DRAM chips 22 on memory module 10. Data is temporarily stored in FIFO 58 during transfers.

[0011] The data from FIFO 58 is encapsulated in frames that are sent over differential lines in metal contact pads 12. Rather than being sent directly to the host central processing unit (CPU), the frames are passed from one memory module to the next memory module until the frame reaches the host CPU. Differential data lines in the direction toward the host CPU are known as northbound lanes, while differential data lines from the CPU toward the memory modules are known as southbound lanes.

[0012] When a frame is sent from the host CPU toward a memory module, the frame is sent over the southbound lanes toward one of the memory modules in the daisy chain. Each memory module passes the frame along to the next memory module in the daisy chain. Southbound lanes that are input to a memory module are buffered by its AMB 24 using re-timing and re-synchronizing buffers 54. Re-timing and re-synchronizing buffers 54 restore the timing of the differential signals prior to retransmission. Input buffers 52 and output buffers 56 contain differential receivers and transmitters for the southbound lanes that are buffered by re-timing and re-synchronizing buffers 54.

[0013] Frames that are destined for the current memory module are copied into FIFO 58 and processed by AMB 24. For example, for a write frame, the data from FIFO 58 is written to DRAM chips 22 on the memory module by AMB 24. For a read, the data read from DRAM chips 22 is stored in FIFO 58. AMB 24 forms a frame and sends the frame to northbound re-timing and re-synchronizing buffers 64 and out over the northbound lanes from differential output buffer 62. Input buffers 66 and output buffers 64 contain differential receivers and transmitters for the northbound lanes that are buffered by re-timing and re-synchronizing buffers 64.

[0014] Self-testing of the memory module is supported by built-in self-test (BIST) controller 60. BIST controller 60 may support a variety of self-test features such as a mode to test DRAM chips 22 on the module and a loop-back test mode to test connections through metal contact pads 12 on memory module 10.

[0015] FIG. 3 shows fully-buffered memory modules daisy chained together. Host CPU 210 on motherboard 28 reads and writes main memory in DRAM chips 22 on memory modules 201–204 through memory controller 220 on motherboard 28. Memory modules 201–204 are inserted into memory module sockets on motherboard 28.

[0016] Rather than read and write DRAM chips 22 directly, host CPU 210 sends read and write commands in packets or frames that are sent over southbound lanes 102. The frame from host CPU 210 is first sent from memory controller 220 to first memory module 201 in the first socket. AMB 24 on first memory module 201 examines the frame to see if it is intended for first memory module 201 and re-buffers and passes the frame on to second memory module 202 over another segment of southbound lanes 102. AMB 24 on second memory module 202 examines the frame and passes the frame on to third memory module 203. AMB 24 on third memory module 203 examines the frame and passes the frame on to fourth memory module 204.

[0017] When data is read, or a reply frame is sent back to host CPU 210, northbound lanes 104 are used. For example, when DRAM chips 22 on third memory module 203 are read, the read data is packaged in a frame by AMB 24 and sent over northbound lanes 104 to second memory module 202, which re-buffers the frame and sends it over another segment of northbound lanes 104 to first memory module 201. First memory module 201 then re-buffers the frame of data and sends it over northbound lanes 104 to memory controller 220 and on to host CPU 210.

[0018] Since northbound lanes 104 and southbound lanes 102 are composed of many point-to-point links between adjacent memory modules, the length and loading of these segments is reduced, allowing for higher speed signaling. Signaling is to AMB 24 on each memory module rather than to DRAM chips 22.

[0019] FIG. 4 shows external loop-back testing of a fully-buffered memory module. BIST controller 60 supports a test mode that activates pattern generator 61 to generate a sequence of test vectors that are written to FIFO 58. The test vectors are then buffered by re-timing and re-synchronizing buffers 54 and transmitted by output buffers 56 over the southbound lanes.

[0020] During the loop-back test mode, the output southbound lanes are connected to the input southbound lanes by external loopback wires 68. The test vectors are then input from external loopback wires 68 by input buffers 52, and are written into FIFO 58 by re-timing and re-synchronizing buffers 54. Comparator 63 in BIST controller 60 then compares the test vectors received through input buffers 52 with the test vectors generated by pattern generator 61. These test vectors should match. A failure is signaled when the text vectors do not match. A mismatch could occur when external loopback wires 68 have a break in them.

[0021] Similar loopback testing of the northbound lanes may also be performed. The test vectors do not have to be stored in FIFO 58, but could be immediately transmitted and checked.

[0022] External loopback wires 68 may be emulated by automated-test-equipment (ATE) that is testing memory modules. Some motherboards may include external loopback wires 68, but this may require muxes or switches on the motherboard that increase loading on the northbound and southbound lanes.

[0023] FIGS. 5A–B show testing a memory module using an extender card. Memory module 10 has DRAM chips 22 mounted thereon. Metal contact pads 12 on the lower edge of memory module 10 are for inserting into test socket 23 on extender card 20. Metal wiring traces on extender card 20 connect signals from test socket 23 to the corresponding signals on lower-edge contact pads 25 so that all signals are passed through unchanged, as shown in FIG. 5B.

[0024] The direct pass-through of signals from lower-edge contact pads 25 to test socket 23 and contact pads 12 allows memory module 10 to be tested just as if memory module 10 were inserted directly into memory module socket 26 on PC motherboard 28. The increased height of test socket 23 above the surface of PC motherboard 28 makes testing easier since test socket 23 is more easily reached by an operator or handler machine.

[0025] During testing of memory module 10 inserted into test socket 23, DRAM controller 38 on PC motherboard 28 receives data from a CPU or bus master and generates control signals to DRAM chips 22 on memory module 10 to write the data. A variety of specialized data patterns may be written to DRAM chips 22 and read back. These specialized data patterns have been developed to detect certain types of errors that can occur in DRAM chips, such as a single memory cell that is stuck high or low, or shorts between adjacent cells. Patterns such as walking-ones, walking-zeros, checkerboard, and inverse checkerboards are often used.

[0026] While fully-buffered memory modules are useful for high-speed systems, the loopback testing mode may require adding switches or muxes to the motherboard. For example, northbound lane outputs from one memory module socket are normally routed to another memory module socket, but for loop-back test mode these northbound lane outputs must be routed back to the northbound lane inputs to the same memory module. Adding switches or muxes increases the cost of the motherboard, and may make PCB trace routing more challenging. Any increase in trace lengths increases loading and delay of the northbound or southbound lanes and is undesirable. Inputs to the switches or muxes also increases lane loading.

[0027] What is desired is to perform loop-back testing of fully-buffered memory modules on a motherboard. It is also desired to perform loop-back testing on a motherboard without switches and muxes for supporting loop-back testing.

[0038] The present invention relates to an improvement in testing of memory modules. The following description is presented to enable one of ordinary skill in the art to make and use the invention as provided in the context of a particular application and its requirements. Various modifications to the preferred embodiment will be apparent to those with skill in the art, and the general principles defined herein may be applied to other embodiments. Therefore, the present invention is not intended to be limited to the particular embodiments shown and described, but is to be accorded the widest scope consistent with the principles and novel features herein disclosed.

[0039] The inventors have discovered that extender cards may be used to support loop-back testing of fully-buffered memory modules. The motherboard does not have to directly support loop-back testing. Muxes and switches for loop-back testing of memory modules do not have to be placed on the motherboard, allowing motherboard traces for northbound and southbound lanes to be as small as possible. Thus high-speed operation of the memory modules is enhanced.

[0040] During testing of fully-buffered memory modules, extender cards are inserted into the memory module sockets on a motherboard. The memory modules being tested are then inserted into the extender cards. However, the extender cards are not standard pass-though extender cards such as shown in FIGS. 5A–B. Instead, these extender cards provide external loopback wires (68 of FIG. 4) for supporting the loop-back test mode. Since the loopback wires are provided on the extender cards, the motherboard does not have to have the external loopback traces. Switches and muxes to support loopback testing are not needed on the motherboard.

[0041] FIG. 6 shows a loop-back extender card for testing fully-buffered memory modules. Loop-back extender card 44 contains test socket 23 that has metal contacts that mate with metal contact pads 12 of memory module 10 when memory module 10 is inserted into test socket 23. Metal wiring traces on loop-back extender card 44 connect pass-through control signals 57 from test socket 23 to the corresponding signals on lower-edge contact pads 25. Pass-through control signals 57 may include clock signal CLK and test-mode control signal CTL for activating the various test modes of memory module 10. Power and ground are also passed through.

[0042] However, rather than pass northbound lanes and southbound lanes through from test socket 23 to lower-edge contact pads 25, loop-back extender card 44 disconnects northbound lanes between test socket 23 and lower-edge contact pads 25. Instead, northbound loopback 82 is formed from traces on loop-back extender card 44. Northbound loopback 82 connects northbound lane outputs of the AMB on the memory module inserted into test socket 23 to the northbound lane inputs of the same AMB on the memory module inserted into test socket 23.

[0043] Likewise, loop-back extender card 44 disconnects southbound lanes between test socket 23 and lower-edge contact pads 25. Southbound loopback 83 is formed from metal traces on loop-back extender card 44. Southbound loopback 83 connects southbound lane outputs of the AMB on the memory module inserted into test socket 23 to the southbound lane inputs of the same AMB on the memory module inserted into test socket 23.

[0044] FIG. 7 show loop-back testing of a fully-buffered memory module using a loop-back extender card on a motherboard. Memory module 10 is inserted into test socket 23 on loop-back extender card 44, and lower-edge contact pads 25 on loop-back extender card 44 are inserted into memory module socket 26 on PC motherboard 28.

[0045] The increased height of test socket 23 above the surface of PC motherboard 28 makes testing easier since test socket 23 is more easily reached by an operator or handler machine.

[0046] During testing of memory module 10 inserted into test socket 23, DRAM controller 38 on PC motherboard 28 receives data from a CPU or bus master and generates control signals in pass-through control signals 57 that are passed through loop-back extender card 44 to memory module 10. Clock generator 35 generates a clock that is also passed through pass-through control signals 57 on loop-back extender card 44 to clock AMB 24 on memory module 10.

[0047] BIST controller 30 on motherboard 28 activates test modes of AMB 24 using pass-through control signals 57. Errors detected by the internal BIST circuitry in AMB 24 can be passed through loop-back extender card 44 to BIST controller 30 to signal an error to an operating system or boot routine running on motherboard 28.

[0048] Rather than pass frames from memory module to memory module, northbound lanes and southbound lanes from memory module 10 are disconnected by loop-back extender card 44 and do not reach motherboard 28. Instead, northbound loopback 82 on loop-back extender card 44 feeds northbound lane outputs of AMB 24 back to AMB 24 as northbound lane inputs. Also, southbound loopback 83 on loop-back extender card 44 feeds southbound lane outputs of AMB 24 back to AMB 24 as southbound lane inputs. The internal BIST controller of AMB 24 generates test patterns that are output on the northbound lane outputs, and compares the generated test patterns to data received on the northbound lane inputs. Data mismatches indicate a loopback failure. Test patterns are likewise output on the southbound lane outputs and received data on southbound lane inputs is compared to detect southbound lane loopback errors.

[0049] A variety of specialized test patterns may be generated for loopback testing. Patterns such as walking-ones, walking-zeros, checkerboard, and inverse checkerboards may be used.

[0050] FIG. 8 is a diagram showing northbound and southbound lane loopback on a loop-back extender card between a memory module and a motherboard. Memory module 10 is a fully-buffered memory module that contains DRAM chips (not shown) that are buffered by AMB 24. Motherboard 28 contains a processor and other logic that generates pass-through control signals such as a differential clock, a reset signal, a system management bus or other control signals applied to serial-presence-detect (SPD) EEPROM 27 and test-mode control lines CTL of AMB 24.

[0051] SPD EEPROM 27 stores configuration information about memory module 10 that is sent over serial data line SPD_D synchronized to SPD clock SPD_CLK. Address inputs to SPD EEPROM 27 are carried from motherboard 28 on address lines SPD_A[2:0], which may be hard wired on motherboard 28. The wiring configuration of SPD_A[2:0] on motherboard 28 determines the device address (memory-module slot number) of memory module 10. Data sent over serial data line SPD_D is a series of frames consisting of device address, device type (AMB 24 or SPD EEPROM 27), register location, and register data. Test mode is activated on AMB 24 by writing to the AMB test-mode control registers. AMB 24 and SPD EEPROM 27 can share clock, address, and serial data lines, but respond to different device types at the same device address.

[0052] Northbound lane inputs NB_IN[13:0], #NB_IN[13:0] to AMB 24 are normally connected to northbound lane motherboard outputs 86, NB_OUT[13:0], #NB_OUT[13:0] on motherboard 28. These 14 northbound lanes carry frames generated by downstream memory modules that are being sent to the processor, perhaps through upstream memory modules (not shown).

[0053] Northbound lane outputs NB_OUT[13:0], #NB_OUT[13:0] from AMB 24 are normally connected to northbound lane motherboard inputs 84 (NB_IN[13:0], #NB_IN[13:0]) on motherboard 28. These 14 northbound lanes carry frames generated by memory module 10 or generated by downstream memory modules that are being sent to the processor. Northbound lane inputs NB_IN[13:0], #NB_IN[13:0] on motherboard 28 could connect to the memory controller and to the processor directly, or could connect to an upstream memory module (not shown).

[0054] However, loop-back extender card 44 breaks these northbound-lane connections between AMB 24 on memory module 10 and motherboard 28. Instead, northbound loopback 82 connects northbound lane outputs NB_OUT[13:0], #NB_OUT[13:0] that are output by AMB 24 back to northbound lane inputs NB_IN[13:0], #NB_IN[13:0] that are inputs to AMB 24. During loop-back test mode, AMB 24 generates test patterns that are output on northbound lane outputs NB_OUT[13:0], #NB_OUT[13:0], and compares the inputs on northbound lane inputs NB_IN[13:0], #NB_IN[13:0] to these generated test patterns. If a break or short occurred on loop-back extender card 44 in northbound loopback 82, or in the northbound-lane traces on memory module 10, or in the internal northbound-lane circuitry on AMB 24, these test patterns would mis-match, and a loopback error would be signaled.

[0055] Northbound lane motherboard outputs 86 and northbound lane motherboard inputs 84 are not connected on loop-back extender card 44 and can be left as opens. Alternately, northbound lane motherboard outputs 86 could be terminated and northbound lane motherboard inputs 84 could be connected to ground or a constant voltage such as the power supply.

[0056] Southbound lane inputs SB_IN[9:0], #SB_IN[9:0] to AMB 24 are normally connected to southbound lane motherboard outputs 87, SB_OUT[9:0], #SB_OUT[9:0] on motherboard 28. These 10 southbound lanes carry frames generated by the processor that are being sent to memory module 10 or to downstream memory modules in the daisy chain.

[0057] Southbound lane outputs SB_OUT[9:0], #SB_OUT[9:0] from AMB 24 are normally connected to southbound lane motherboard inputs 85 (SB_IN[9:0], #SB_IN[9:0]) on motherboard 28. These 10 southbound lanes carry frames generated by the processor that are being sent to downstream memory modules. Southbound lane outputs SB_OUT[9:0], #SB_OUT[9:0] on motherboard 28 could be driven by the memory controller directly, or could connect to an upstream memory module (not shown).

[0058] However, loop-back extender card 44 breaks these southbound-lane connections between AMB 24 on memory module 10 and motherboard 28. Instead, southbound loopback 83 connects southbound lane outputs SB_OUT[9:0], #SB_OUT[9:0] that are output by AMB 24 back to southbound lane inputs SB_IN[9:0], #SB_IN[9:0] that are inputs to AMB 24. During loop-back test mode, AMB 24 generates test patterns that are output on southbound lane outputs SB_OUT[9:0], #SB_OUT[9:0], and compares the inputs on southbound lane inputs SB_IN[9:0], #SB_IN[9:0] to these generated test patterns. If a break or short occurred on loop-back extender card 44 in southbound loopback 83, or in the southbound-lane traces on memory module 10, or in the internal southbound-lane circuitry on AMB 24, these test patterns would mis-match, and a loopback error would be signaled.

[0059] Southbound lane motherboard outputs 87 and southbound lane motherboard inputs 85 are not connected on loop-back extender card 44 and can be left as opens. Alternately, southbound lane motherboard outputs 87 could be terminated and southbound lane motherboard inputs 85 could be connected to ground or a constant voltage such as the power supply.

[0060] FIG. 9 shows a loop-back extender card with long traces for northbound and southbound lane loopback. Northbound loopback 82 is formed by serpentine traces 72. The length of northbound loopback 82 is significantly increased by winding the traces back and forth on loop-back extender card 44 through serpentine traces 72.

[0061] Likewise, Southbound loopback 83 is also formed by serpentine traces 72. The length of southbound loopback 83 is significantly increased by winding the traces back and forth on loop-back extender card 44 through serpentine traces 72.

[0062] Longer traces for northbound loopback 82 and southbound loopback 83 increase the capacitive and resistive loading on the northbound and southbound lane outputs of AMB 24. The differential drivers are driving a larger R-C load and thus are tested more fully. Serpentine traces 72 may be formed in the twisting, snake-like layout as shown, or on multiple layers of the PCB, or in a variety of patterns and layouts.

[0063] FIG. 10 highlights a loop-back extender card with resistive attenuation for northbound and southbound lane loopback. Northbound loopback 82 contains series resistors 92 that are inserted in series between the northbound lane outputs and northbound lane inputs. A total of 28 resistors are needed for the 14 differential pairs.

[0064] Likewise, Southbound loopback 83 also contains series resistors 92 that are inserted in series between the southbound lane outputs and southbound lane inputs. A total of 20 resistors are needed for the 10 differential pairs.

[0065] Adding series resistors 92 to northbound loopback 82 and to southbound loopback 83 increases the R-C delay of the feedback path, delaying the arrival of the feedback signals to the inputs to AMB 24. The resistance value can be adjusted to adjust this delay to a desired value. Adding series resistors 92 can allow for margin testing to ensure that memory module 10 meets or exceeds delay specifications.

[0066] Several other embodiments are contemplated by the inventors. For example the number of northbound and southbound lanes may vary. Different pass-through control signals may be included. A 2-layer printed-circuit board (PCB) or a PCB with more layers may be used for loop-back extender card 44.

[0067] Southbound or northbound loopback traces may be formed from metal traces on surfaces of loop-back extender card 44, or on interior traces on interior layers of a multi-layer PCB. Vias, wire jumpers, or other connections may form part of the electrical path of northbound loopback 82 or southbound loopback 83. The serpentine traces may each be more than double an average length of the pass-through control signal traces.

[0068] Series resistors 92 may be part of a larger resistor pack. The series resistor could have various values, such as 5 to 10 ohms. All series resistors could have the same value, or some series resistors could have different values. Capacitors or more complex filters could be added to loop-back extender card for loopback paths or for other paths. For example, power-to-ground bypass capacitors could be added to loop-back extender card 44.

[0069] Rather than using series resistors 92 in FIG. 10, a shunt resistor may be placed across each differential pair of the northbound and southbound loop-back paths 82 and 83. Whereas a series resistor alters both the amplitude and phase (delay) of the differential signal, a shunt resistor alters only the amplitude without significantly affecting the phase of the differential signal.

[0070] Signals may be half swing with source termination (output buffer) and load termination (input buffer). A series resistor or a shunt resistor in the path attenuates the signal. Shunt resistance may be around 500 ohms with a line impedance of 50 ohms.

[0071] Muxes and switches could be added to the extender cards to allow for loop-back testing as well as standard operation. The extender card could pass northbound and southbound lanes from memory module to the motherboard during normal modes, but loopback the northbound lane outputs to the northbound lane inputs during loopback test mode.

[0072] Future memory module standards and extensions of the fully-buffered DIMM standard could benefit from the invention. Testing of memory modules using motherboard testers may be enhanced by inserting loop-back extender card 44 into memory module sockets on the motherboard. Test socket 23 could be a standard memory module socket or could be a zero-insertion-force (ZIF) or other test socket for testing large numbers of memory modules.

[0073] Any advantages and benefits described may not apply to all embodiments of the invention. When the word “means” is recited in a claim element, Applicant intends for the claim element to fall under 35 USC Sect. 112, paragraph 6. Often a label of one or more words precedes the word “means”. The word or words preceding the word “means” is a label intended to ease referencing of claims elements and is not intended to convey a structural limitation. Such means-plus-function claims are intended to cover not only the structures described herein for performing the function and their structural equivalents, but also equivalent structures. For example, although a nail and a screw have different structures, they are equivalent structures since they both perform the function of fastening. Claims that do not use the word “means” are not intended to fall under 35 USC Sect. 112, paragraph 6. Signals are typically electronic signals, but may be optical signals such as can be carried over a fiber optic line.

[0074] The foregoing description of the embodiments of the invention has been presented for the purposes of illustration and description. It is not intended to be exhaustive or to limit the invention to the precise form disclosed. Many modifications and variations are possible in light of the above teaching. It is intended that the scope of the invention be limited not by this detailed description, but rather by the claims appended hereto.