US 7,194,643 B2Grant
Apparatus and method for an energy efficient clustered micro-architecture
Issue Date:2007-03-20
•17 Claims
•15 Drawing Sheets
Abstract
In some embodiments, a method and apparatus for an energy efficient clustered micro-architecture are disclosed. In one embodiment, the method includes the computation of an energy delay2 product for each active instruction scheduler and one or more associated function blocks of a current architecture configuration over a predetermined period. Once the energy delay2 product is computed, the computed product is compared against an energy delay2 product calculated for a prior architecture configuration to determine an effectiveness of the current architecture configuration. Based on the effectiveness of the current architecture configuration, a number of active instruction schedulers and one or more associated functional blocks within the current architecture configuration is adjusted. In one embodiment, the number of active instruction schedulers and one or more associated functional blocks may be increased or decreased to improve power efficiency of the cluster micro-architecture. Other embodiments are described and claimed.
Metadata
Assignee
- Intel Corporation
Inventors
- Jose Gonzalez
- Antonio Gonzalez
Application Information
Application Number:US 10/673,955
Filing Date:2003-09-29
Priority Date:2003-09-29
Art Unit:2116
Classifications
IPC:
G06F1/32
Patent Drawings (15 sheets)
Description
Field of the Invention
[0001] One or more embodiments of the invention relate generally to the field of processor architecture design More particularly, one or more of the embodiments of the invention relates to a method and apparatus for an energy efficient clustered micro-architecture.
Background of the Invention
[0002] Larger and wider instruction windows, combined with out-of-order execution, have facilitated the exploitation of instruction level parallelism (ILP) over the past decade. Super scalar architectures have evolved towards higher issue widths and longer instruction windows in order to achieve higher instruction throughput by taking advantage of the ever-increasing availability of on-chip transistors. These trends are likely to continue with next generation multi-threaded processors, which allow for much better utilization of the resources in a wide issue super-scalar core. However, increasing the window size (e.g., going from a four-way issue to an eight-way issue processor) is not a trivial issue; it involves a lot of design and verification challenges.
[0003] It is well-known that current super-scalar organizations are approaching a point of diminishing returns. It is not trivial to change from a four-way issue to an eight-way issue architecture due to hardware complexity and implications in the cycle time. Nevertheless, the ILP that an eight-way issue processor can exploit far exceeds that provided by a four-way issue processor. In addition, the impact of wire delays, the increasing complexity of processor components, as well as power dissipation, constitute three important barriers for scaling up current super-scalar micro-architectures. Furthermore, the increasing complexity of some critical components, such as issue logic, bypass, register file and renaming logic, may have a direct influence on clock cycle time.
[0004] One of the proposed solutions to this problems is a technique referred to as clustering. In a clustered micro-architecture, some of the critical components are partitioned into simpler structures to reduce the impact of wire delays as far as signals that are kept within the clusters. Clusters offer the advantages of partitioned schemes where one can achieve higher rates of ILP and sustain a high clock rate. The partitioned architecture tends to make hardware simpler and control and datapaths faster. For instance, a partitioned architecture has fewer register file parts, fewer data bus sources/destinations and fewer alternatives for many control decisions.
[0005] Accordingly, clustering provides an alternative to designing wide and deep super-scalar processors by replacing them with a collection of smaller windows and associated functional unit clusters. Each cluster issues next execute instructions that are directed to it. Values produced within a cluster become available to a consumer within the cluster faster than to a consumer in another cluster. For remote clusters, a delay, called the “inter-cluster bypass latency” (ICBL), is paid. This latency across clusters is present due to the age wire delays that exist across current chips.
[0006] The processor resources required for an effective execution of a given application vary across different applications, and they also vary across different sections of the same application. As a result, certain applications will not utilize all processor resources, while such processor resources continue to consume power. As a result, clustered micro-architectures may consume inordinate amounts of power, which render such micro-architectures infeasible within energy-sensitive devices, such as portable or hand-held devices, which rely on an on-board power supply for operation. Therefore, there remains a need to overcome one or more of the limitations in the above-described, existing art.
Brief Description of the Drawings
[0007] The various embodiments of the present invention are illustrated by way of example, and not by way of limitation, in the figures of the accompanying drawings and in which:
[0008] FIG. 1 is a block diagram illustrating a computer system, including an energy efficient clustered micro-architecture, in accordance with one embodiment of the invention.
[0009] FIG. 2 is a block diagram further illustrating the clustered micro-architecture of FIG. 1 , in accordance with one embodiment of the invention.
[0010] FIG. 3 is a block diagram further illustrating in-order core and out-of-order core of clustered micro-architecture of FIG. 2 , in accordance with a further embodiment of the invention.
[0011] FIG. 4 is a block diagram illustrating a clustered component of the clustered micro-architecture of FIG. 3 , in accordance with one embodiment of the invention.
[0012] FIG. 5 is a block diagram illustrating a clustered component of the clustered micro-architecture of FIG. 3 , in accordance with one embodiment of the invention.
[0013] FIG. 6 is a block diagram illustrating consumed energy logic, in accordance with one embodiment of the invention.
[0014] FIG. 7 is a block diagram illustrating a resizing circuit for increasing/decreasing a number of active instruction schedulers within a clustered micro-architecture, in accordance with one embodiment of the invention.
[0015] FIG. 8 is a flowchart illustrating a method for implementing an energy-efficient clustered micro-architecture, in accordance with one embodiment of the invention.
[0016] FIG. 9 is a flowchart illustrating a method for computing an energy-consumption value to determine an energy effectiveness of the current architecture configuration, in accordance with one embodiment of the invention.
[0017] FIG. 10 is a flowchart illustrating a method for comparing an energy delay2 product value to identify a decrease or increase in the energy effectiveness of the current architecture configuration, in accordance with one embodiment of the invention.
[0018] FIG. 11 is a flowchart illustrating a method for adjusting a number of active instruction schedulers of an architecture configuration, in accordance with one embodiment of the invention.
[0019] FIG. 12 is a flowchart illustrating a method for adjusting a number of active instruction schedulers of the current architecture configuration, in accordance with a further embodiment of the invention.
[0020] FIG. 13 is a flowchart illustrating a method for enabling or disabling a number of active instruction schedulers of the current architecture configuration, in accordance with one embodiment of the invention.
[0021] FIG. 14 is a flowchart illustrating a method for further adjusting a number of active instruction schedulers in a current architecture configuration, in accordance with one embodiment of the invention.
[0022] FIG. 15 is a block diagram illustrating various design representations or formats for simulation, emulation and fabrication of a design using the disclosed techniques.
Detailed Description
[0023] A method and apparatus for an energy efficient clustered micro-architecture is described. In one embodiment, the method includes the computation of an energy delay2 product for each active instruction scheduler of a current architecture configuration over a predetermined period. Once the energy delay2 product is computed, the computed product is compared against an energy delay2 product calculated for a prior architecture configuration to determine an effectiveness of the current architecture configuration. Based on the effectiveness of the current architecture configuration, a number of active instruction schedulers within the current architecture configuration is adjusted. In one embodiment, the number of active instruction schedulers may be increased or decreased to improve power efficiency of the cluster micro-architecture.
[0024] FIG. 1 is a block diagram illustrating a computer system 100 including a processor 110 having micro-architecture 200, in accordance with one embodiment of the invention. In one embodiment, micro-architecture 200 is configured as an energy efficient clustered micro-architecture, in accordance with one embodiment of the invention. Computer system 100 comprises a processor system bus (front side bus (FSB)) 102 for communicating information between the processor (CPU) 110 and a chipset 180 coupled together via FSB 102.
[0025] As described herein, the term “chipset” is used in a manner well-known to those skilled in the art to describe collectively the various devices coupled to CPU 110 to perform desired system functionality. Chipset 180 is comprised of a memory controller or memory controller hub (MCH) 120, as well as an input/output (I/O) controller or I/O controller hub (ICH) 130. Memory controller 120 of chipset 180 is coupled to main memory 140 and one or more graphics devices or graphics controller 160.
[0026] In one embodiment, main memory 110 is volatile memory, including but not limited to, random access memory (RAM), synchronous RAM (SRAM), double data rate (DDR) S-dynamic RAM (SDRAM), rambus dynamic-RAM (RDRAM), or the like. In addition, hard disk drive devices (HDD) 150, as well as one or more I/O devices 170 (170-1, . . . , 170-N) are coupled to I/O controller 130 of chipset 180. As illustrated, CPU 110 includes micro-architecture 200 for power optimized replay of blocked uOPs, which is further illustrated with reference to FIG. 2 .
[0027] It should be understood that embodiments of the invention may be used in any apparatus having a processor. Although embodiments of system 100 are not limited in this respect, system 100 may be a portable device that includes a self contained power supply (source) 104, such as a battery. A non-exhaustive list of examples of such portable devices includes laptop and notebook computers, mobile telephones, personal digital assistants (PDAs), and the like. Alternatively, system 100 may be a non-portable device, such as, for example, a desktop computer or a server computer not including optional source 104.
[0028] FIG. 2 illustrates micro-architecture 200 of CPU 110, which may be configured as an energy efficient clustered micro-architecture, in accordance with one embodiment of the invention. In the embodiment illustrated, micro-architecture 200 is configured to perform dynamic execution. As described herein, dynamic execution refers to the use of front-end logic 300 to fetch the next instructions according to program order and prepare the instructions for subsequent execution in the system pipeline. As illustrated, front-end logic 300 is comprised of an instruction-fetch unit 310 (FIG. 3 ) which fetches upcoming program instructions for execution and prepares the instructions for future use within the system pipeline.
[0029] In effect, front-end logic 300 supplies a high bandwidth stream of decoded macro-instructions, referred to herein as “micro-operations” (uOPs), to out-of-order (OOO) core 400, which directs the execution (the actual completion) of the uOPs. To execute instructions in the most efficient manner, front-end logic 300 may utilize highly accurate branch prediction logic (not shown) to speculate where a program will execute next to enable performance of dynamic execution. Once uOPs are received by OOO core 400, the uOPs are scheduled to avoid stalling when following delayed instructions. In other words, uOPs are executed in an out-of-order execution fashion when required to ensure the most efficient use of available processor resources.
[0030] Accordingly, front-end logic 300 may fetch macro-instructions from, for example, level 2 cache (L2) 250 via bus interface unit (BIU) 210. Once the instructions are fetched, the instructions are decoded into basic operations or uOPs. Accordingly, in-order core 300 provides a stream of decoded macro-instructions or uOPs to OOO core 400, which may schedule execution of the uOPs via execution units (EU) 230. In accordance with one embodiment, OOO core 400 may be configured as one or more clustered logic units, for example, as illustrated with reference to FIG. 3 .
[0031] FIG. 3 illustrates micro-architecture 200 configured according to an energy efficient clustered micro-architecture configuration, in accordance with one embodiment of the invention. In-order core 300 is comprised of instruction fetch unit 310 to fetch macro-instructions from, for example, an L2 cache (not shown), which are provided to instruction decoder 320. Instruction decoder 320 decodes received macro-instructions into uOPs, which are provided to trace cache 330. Once decoded, uOPs may be placed within uOP queue 340 and provided as a high bandwidth stream to OOO core 400.
[0032] As illustrated, OOO core 400 is comprised of logic components for allocation, renaming and scheduling functions. Using the various logic, OOO core 400 reorders uOPs to allow them to execute as quickly as their input operands are ready. OOO core 400 includes several buffers to perform reordering, tracking and sequencing of operations (or uOPs), which are allocated via allocator logic 410. When resources become available, allocator 410 assigns the resources to requesting uOPs and allows the satisfied uOPs to flow down the pipeline for execution.
[0033] Register renamer logic 410 renames logical operands of received uOPs onto an N-entry physical register file. As a result, architecturally defined registers are expanded to physical registers available within micro-architecture 200. Once renaming of the logical operands of the uOPs to physical registers within a physical register file is completed, the uOPs are provided to steering unit 420 to dispatch uOPs to the proper cluster according to the steering policy. Steering unit 420 is configured to distribute received uOPs among the various clusters 430 (430-1, . . . , 430-N) to expedite scheduling and execution of the various uOPs.
[0034] In one embodiment, each cluster 430 may include one or more instruction schedulers (IS) 432 (432-1, . . . , 432-N). Instruction schedulers 432 receive and store uOPs assigned thereto from steering unit 420. Once all source operands of the uOP are available, instruction scheduler 432 issues the uOP for execution. In one embodiment, each cluster includes an instruction scheduler 432 for each uOP instruction type, including, for example, integer uOPs, floating point uOPs, memory uOPs, copy uOPs or the like.
[0035] By enabling each instruction scheduler of each cluster 430 as active, steering unit 420 may assign the various received uOPs to a cluster to enable scheduling and subsequent execution of the uOPs. However, processor resources required for an effective execution of an application vary across different sections of the application itself and across different applications as well. As such, depending on the stage of execution or application, energy is consumed by each active instruction scheduler of each cluster, although the scheduler is not necessarily processing uOPs. Conversely, execution delays may result when too few instructions schedulers 432 are active.
[0036] Accordingly, in one embodiment, clusters 430 are configured to enable or disable resources within clusters 430 that do not contribute to or improve performance. By enabling or disabling processor or cluster instruction schedulers, micro-architecture 200 may be configured as a power efficient clustered micro-architecture. In one embodiment, an amount of energy consumed by each instruction scheduler (IS) of a cluster is computed during a particular time interval. This estimation is used to compute the energy effectiveness of the current configuration and decide whether to decrease or increase the number of active IS (AIS). In one embodiment, the performance metric used to compute the energy effectiveness of a configuration is an estimated Energy Delay2 Product (ED2P) metric as an input to resizing schemes described below for increasing or decreasing a number of AIS. Furthermore, Energy Delay Product or simply Energy could be used as metrics to measure the effectiveness of an energy-aware architecture.
[0037] FIG. 4 further illustrates clustered micro-architecture 200, in accordance with one embodiment of the invention. The various clusters are provided with four different types of global interconnections. In one embodiment, control buses 350 are provided to send instructions and control signals from in-order core 300 to the various clusters 430. A disambiguation bus 360 is also provided for broadcasting the effective address of store instructions. A memory bus 370 is provided for bringing data back to and from to L2 cache and for invalidations. Likewise, point-to-point links 380 are provided and used to communicate values among the different register files (not shown). In one embodiment, the steering unit 420 steers or issues uOPs according to a communications aware steering policy, which sends the instruction to the cluster that has most of the inputs, and in the case of a tie, to the least loaded cluster.
[0038] FIG. 4 also illustrates resizing circuit 500 coupled to a control bus 350. In one embodiment, resizing circuit 500 is configured to determine an energy efficiency of each cluster 430. In one embodiment, an energy effectiveness is determined for each IS type within micro-architecture 300. For example, resizing circuit 500 may determine a configuration effectiveness for the floating point (FP) IS (FPIS) type. According to a number of active FPIS, an energy performance metric, such as, for example, ED2P product is calculated and compared to a previously-calculated ED2P product. If a decrease in the computer product is identified, then a current configuration exhibits additional energy effectiveness. Conversely, if an increase in the computed product is detected, a current configuration has a reduced energy effectiveness. As such, based on the energy effectiveness, the number of active FPIS may be either increased or decreased, as described in further detail below.
[0039] As illustrated with reference to FIG. 5 , in one embodiment, uOPs (instructions) enter one of integer instruction scheduler (ISched) 440, memory instruction scheduler (MSched) 450, copy instruction scheduler (CSched) 460 and floating point scheduler (FSched) 470 once steered by steering unit 420 (FIG. 3 ) and remain therein until all source operands are available. At that time, and according to availability of different resources (ports, functional units, etc.), instructions are issued for execution, leaving the corresponding scheduler.
[0040] In one embodiment, one or more logic components are associated with each instruction scheduler (440, 450, 460 and 470) to execute the instruction once all source operands of the instruction are available. In one embodiment, logic components of the cluster 430 may include register files (RF) (Integer Register File 444, and Floating Point Register File 480) responsible for storing the values computed by operations. In addition, functional units (FU) (442, 452, 472) may be provided to execute integer, floating point, load/store and copy uOPs.
[0041] In one embodiment, memory instruction scheduler 450 interacts with functional unit 452, register files (RF) (444, 480), as well as data cache (DLO) 454 and data table (DTLB) 456 in order to execute load uOPs, as well as store uOPs. Likewise, floating point scheduler 470 interacts with functional unit 472 for executing floating point instructions. In addition, register file 480 is provided to include, for example, single instruction multiple data (SIMD) extensions to (SSE2) registers while FP RF 474 may include SIMD extension type data operands. Finally, integer scheduler interacts with functional unit 442 for executing integer instructions and integer register file 444.
[0042] In the embodiment illustrated, each data cache can hold any memory line (i.e., the memory address space is not partitioned). Loads can be steered to any cluster, and in the case of a miss, L2 250 (FIG. 3 ) is accessed and the line is brought to the cluster. Finally, copy scheduler 450 provides communication to enable exchange of register values among clusters 430. In one embodiment, dynamic estimation of energy consumed by a particular processor block, such as, for example, within each cluster block, is performed by using logic 550, which is illustrated with reference to FIG. 6 .
[0043] As illustrated with reference to FIG. 6 , each functional block includes an activity counter (AC) 560, which is usually present for performance monitoring. A second component of logic 550 is a constant value that is set up at design time and represents the energy consumed per access of the particular block. In one embodiment, the constant value is stored within energy per access register (EAR) 570. AC 560 is updated every cycle according to the number of accesses to the particular block. In one embodiment, the total energy consumed by a block is computed by multiplying AC 560 by EAR 570 for a respective interval and storing the result in the consumption energy register (CER) 590.
[0044] As illustrated with reference to FIG. 7 , a current architecture configuration will include a current number of active instruction schedulers (CNS) 502. Likewise, the resizing circuit 500 may receive a current interval type (CIT) 504, as well as a current Energy Delay2 Product value (ED2P) 506. In one embodiment, the ED2P value is formed by, or as a product of, a value contained within CER register 590 of all components associated to each particular scheduler and multiplied by a square of the CIT 504.
[0045] Accordingly, in one embodiment, resizing circuit 500 of clustered micro-architecture 200 dynamically adjusts the number of active IS according to an energy effectiveness computed according to a metric, such as ED2P. In one embodiment, each cluster has, for example, four IS: INT, FP, CP and MEM. In alternative embodiments, the number of IS types may vary and include one or more of the indicated IS type as well as other like IS types. In the one embodiment, and as illustrated with reference to FIG. 6 , based on the values taken from CER register 590 of logic within each component of cluster 430, resizing circuit 500 directs enable/disable logic 520 (FIG. 5 ) to increase or decrease the number of active IS of each cluster within micro-architecture 200. Procedural methods for implementing embodiments of the present invention are now described.
Operation
[0046] FIG. 8 is a flowchart illustrating a method 600 for implementing an energy-efficient clustered micro-architecture, for example, as shown in FIGS. 3–7 , in accordance with one embodiment of the invention. For example, as illustrated with reference to FIG. 3 , OOO core 400 may be configured as a four-cluster architecture. As illustrated, each cluster includes a floating point 470, integer 440, a memory 450 and copy 460 instruction schedulers. As a result, when each instruction scheduler of each cluster 430 is active, steering unit 420 may select between four distinct instruction schedulers for each instruction scheduler type. However, depending on the intricacies of a currently running program, having each instruction scheduler active without effectively using each active instruction scheduler may needlessly dissipate power.
[0047] Accordingly, in one embodiment, at process block 602, an energy delay2 value for a current architecture configuration is computed over a predetermined period of time, such as, for example, 256 kilo (K) cycles. In one embodiment, the computed energy consumption value is performed using logic 550, as depicted with reference to FIGS. 5 and 6 . As illustrated, consumed energy register or CER 590 includes a product of an activity counter 560 and an EAR register 570.
[0048] At process block 620, the computed energy delay2 value is compared to an energy delay2 value of a prior architecture configuration to determine an energy effectiveness of the current architecture configuration. In one embodiment, this is performed using resizing circuit 500, as depicted with reference to FIGS. 4 and 7 . At process block 640, a number of active instruction schedulers of the current architecture configuration is adjusted according to the energy effectiveness of the current architecture configuration. For example, as depicted with reference to FIG. 7 , resizing circuit 500 will generate a number of instruction schedulers (NIS) 508, which may either decrease or increase the number of active instruction schedulers for the architecture configuration.
[0049] FIG. 9 is a flowchart illustrating a method 604 for computing the energy value of process block 602 of FIG. 8 , in accordance with one embodiment of the invention. At process block 606, an active instruction scheduler matching a selected instruction scheduler type is selected. For example, as illustrated with reference to FIG. 3 , in one embodiment, resizing circuit may initially select an FP instruction scheduler type. Once selected, active instruction schedulers of each cluster matching the instruction scheduler type are queried. At process block 608, an energy consumption value for the selected instruction scheduler is computed as a product of an access count and a predetermined energy access amount of the selected instruction scheduler.
[0050] For example, as illustrated with reference to FIGS. 5 and 6 , each logic component of, for example, Fscheduler1 470 is queried. Specifically, a CER register 590 of each component of the floating point instruction scheduler is queried to determine an energy consumption value. Once determined, in one embodiment, for example, the resizing circuit squares the predetermined period of time and multiplies the squared predetermined period of time by the computed energy consumption value to form an ED2P product.
[0051] In an alternate embodiment, the ED2P product is calculated by logic 550 and stored in CER 590. At process block 610, process blocks 606 and 608 are repeated for each additional active and matching instruction scheduler. Accordingly, an energy delay2 product or ED2P product for each floating point instruction scheduler is computed to form a consumed energy product sum for the selected instruction scheduler type at process block 612. Once formed, at process block 614, process blocks 606 through 612 are repeated for each additional instruction scheduler type.
[0052] Finally, at process block 612, an energy consumption metric of the current architecture configuration is stored for each instruction scheduler type. As such, in the embodiment described, an energy consumption product is computed for each instruction scheduler type, such as, for example, for floating point instructions. In one embodiment, an energy consumption value consumed by each floating point instruction scheduler is calculated and summed to compute an ED2P value product for floating point instruction schedulers. In one embodiment, this process is repeated for integer instruction schedulers, memory instruction schedulers and copy instruction schedulers.
[0053] FIG. 10 is a flowchart illustrating a method 622 for comparing the computed energy consumption value of process block 620 of FIG. 8 , in accordance with one embodiment of the invention. At process block 624, an instruction scheduler type of the current architecture configuration is selected. Once selected, a computed energy delay2 product for the selected instruction scheduler type is determined. In one embodiment, this is performed by taking a sum of the value contained within CER register 590 for each logic component associated with the selected instruction scheduler type and multiplying the this value by the square of the interval time. At process block 628, the computed energy delay2 product of the selected instruction scheduler is compared to a previously computed energy delay2 product value.
[0054] In one embodiment, the current architecture configuration will generally have either an increased number or decreased number of active instruction schedulers. At process block 630, it is determined whether the computed energy delay2 product is less than the previously-computed energy delay2 product. When such is the case, at process block 632, a decrease in the effectiveness of the current architecture configuration is identified. Otherwise, at process block 634, an increase in the effectiveness of the current architecture configuration is identified.
[0055] FIG. 11 is a flowchart illustrating a method 642 for adjusting the number of active instruction schedulers of process block 640 of FIG. 8 , in accordance with one embodiment of the invention. At process block 644, an increase in the effectiveness of the current architecture configuration is identified. Once identified, at process block 646, a direction indicator state for an instruction scheduler type of the current architecture configuration is identified as either one of an increased state or a decreased state. In other words, the current architecture configuration will either have increased or decreased the number of active instruction schedulers.
[0056] At process block 648, it is determined whether the direction indicator is in increased state. When such is the case, at process block 650, the number of active instruction schedulers for the current architecture information is reduced. Otherwise, at process block 652, a number of active instruction schedulers for the current architecture configuration is increased. At process block 654, the direction indicator state is maintained since an increase in the energy effectiveness of the configuration was achieved.
[0057] FIG. 12 is a block diagram illustrating a method 656 for adjusting a number of active instruction schedulers of process block 640 of FIG. 6 , in accordance with one embodiment of the invention. At process block 658, a decrease in the effectiveness of the current architecture configuration is identified. In other words, in one embodiment, a decrease is identified when an ED2P for the current architecture configuration is greater than any ED2P product for a prior configuration. In other words, when a decrease in the effectiveness of the current architecture configuration is identified, a choice to either reduce or increase (direction indicator state) the number of active instruction schedulers from the prior configuration was incorrect.
[0058] Accordingly, at process block 660, a direction indicator for state for an instruction scheduler type of the current architecture configuration is identified as one of an increased state and a decreased state. Once identified, at process block 662, it is determined whether the direction indicator is in an increased state. When such is the case, at process block 664, the number of active instruction schedulers for the current architecture configuration is reduced. Conversely, at process block 665, the number of active instruction schedulers is increased.
[0059] At process block 668, a state of the direction indicator for the selected instruction scheduler type is switched in order to achieve an improved energy effectiveness for the new architecture configuration. In one embodiment, increasing of the number of active instruction schedulers is performed by selecting a disabled instruction scheduler matching an instruction scheduler type of the current architecture configuration. Once selected, a clock input to all elements associated with the scheduler is enabled to re-enable the instruction schedulers. Conversely, when a reduction of the number of active instruction schedulers is desired, a clock input to a selected instruction scheduler and its associated elements are disabled.
[0060] FIG. 13 is a flowchart illustrating a method 670 for enabling or disabling a number of active instruction schedulers for a current architecture configuration, in accordance with one embodiment of the invention. At process block 672, an adjusted architecture configuration is executed over a predetermined interval of time. At process block 674, an energy delay2 product is computed for the adjusted architecture configuration consumed during execution over the predetermined interval. At process block 676, an energy delay2 product for an increased architecture configuration is computed based on energy consumed during execution over a reduced time interval. At process block 678, an energy delay2 product consumed by a decreased architecture configuration is computed based on energy consumed over the reduced interval of time.
[0061] In other words, in one embodiment, an adjusted architecture configuration may include, for example, N active instruction schedulers, which is referred to as the adjusted architecture configuration. An energy delay2 product for the adjusted architecture configuration is computed while the adjusted architecture configuration executes over the predetermined interval, which may be, for example, 256 K cycles. Next, the increased architecture configuration, which includes N+1 active instruction schedulers, is executed over a reduced time interval, such as, for example, 16 K cycles and an energy delay2 product is determined for the interval. This is repeated for the decreased architecture configuration, which may include N−1 active instruction schedulers.
[0062] At process block 680, the computed energy delay2 products for the increased and decreased architecture configurations are normalized to the energy delay2 product for the adjusted architecture configuration to account for the predetermined interval of time, which is greater than the reduced time intervals. At process block 682, an architecture configuration having a lowest energy delay2 product is identified. Once identified, at process block 684, the selected identified architecture configuration is selected as a current architecture configuration.
[0063] In other words, a base architecture configuration will include N active instruction schedulers and be allowed to run over a predetermined or large interval (LI). This configuration is then increased to N+1 active instruction schedulers and executed over a small interval (SI) for which an ED2P product is calculated. Next, an architecture and configuration having N−1 active instruction schedulers is also executed over the SI interval for which an ED2P product is also calculated. Finally, the energy delay2 products are compared to identify the configuration having the lowest energy delay2 value, which is clearly the configuration which is most energy effective.
[0064] FIG. 14 is a flowchart illustrating a method 682 further supplementing method 670 of FIG. 13 in accordance with the further embodiment of the invention. At process block 686, it is determined whether the increased architecture configuration is detected as having the lowest energy delay2 product. When such is the case, method 670 of FIG. 13 is repeated with the increased architecture configuration as the adjusted architecture configuration. Otherwise, at process block 686, it is determined whether the decreased architecture configuration is identified as having the lowest energy delay2 product. When such is the case, the method of 670 of FIG. 13 is repeated with the decreased architecture configuration as the adjusted architecture configuration.
[0065] In one embodiment, if the increased architecture configuration provides the lowest ED2P value, a processor may run during consecutive SI and increase the number of schedulers by one until the maximum number of schedulers is reached or the last configuration does not decrease the ED2P metric. The processor then runs for the LI with the configuration that provides the best ED2P product. Conversely, if the decreased architecture configuration provides a lower ED2P product, the processor runs during consecutive SI and decreases the number of schedulers by one until a minimum number of schedulers is reached or the last configuration executed does not decrease the ED2P metric. From this embodiment, the processor runs for an LI with the configuration that provides the best ED2P metric.
[0066] Power dissipation is one of the major hurdles for the design of future microprocessors and all segments from high end servers to mobile computers and program digital assistance. Power dissipation requires resolution from the earliest stages of processor design. Conversely, different sections of code and different sections of applications may have varying characteristics. Accordingly, in one embodiment, the mechanism described for adjusting the number of active instruction schedulers is able to dynamically reconfigure the micro-architecture configuration to optimize power and performance. In one embodiment, an optimization metric is used by calculating the Energy Delay2 Product metric. However, in alternate embodiments, the energy delay2 metric can be generalized for other power efficiency metrics, for example, by simply calculating an energy delay product for, for example, mobile devices.
[0067] FIG. 15 is a block diagram illustrating various representations or formats for simulation, emulation and fabrication of a design using the disclosed techniques. Data representing a design may represent the design in a number of manners. First, as is useful in simulations, the hardware may be represented using a hardware description language, or another functional description language, which essentially provides a computerized model of how the designed hardware is expected to perform. The hardware model 710 may be stored in a storage medium 700, such as a computer memory, so that the model may be simulated using simulation software 720 that applies a particular test suite 730 to the hardware model to determine if it indeed functions as intended. In some embodiments, the simulation software is not recorded, captured or contained in the medium.
[0068] In any representation of the design, the data may be stored in any form of a machine readable medium. An optical or electrical wave 760 modulated or otherwise generated to transport such information, a memory 750 or a magnetic or optical storage 740, such as a disk, may be the machine readable medium. Any of these mediums may carry the design information. The term “carry” (e.g., a machine readable medium carrying information) thus covers information stored on a storage device or information encoded or modulated into or onto a carrier wave. The set of bits describing the design or a particular of the design are (when embodied in a machine readable medium, such as a carrier or a storage medium) an article that may be sealed in and out of itself, or used by others for further design or fabrication.
Alternate Embodiments
[0069] It will be appreciated that, for other embodiments, a different system configuration may be used. For example, while the system 100 includes a single CPU 110, for other embodiments, a multiprocessor system (where one or more processors may be similar in configuration and operation to the CPU 110 described above) may benefit from the energy efficient cluster micro-architecture of various embodiments. Further different type of system or different type of computer system such as, for example, a server, a workstation, a desktop computer system, a gaming system, an embedded computer system, a blade server, etc., may be used for other embodiments.
[0070] Having disclosed exemplary embodiments and the best mode, modifications and variations may be made to the disclosed embodiments while remaining within the scope of the embodiments of the invention as defined by the following claims.
Claims
Certificate of Correction present
The claims shown below may not include correction changes. Use the corrected PDF for authoritative text.
What is claimed is:
1. A method comprising:
computing an energy delay2 product metric for a current architecture configuration over a predetermined period of time;
comparing the computed energy delay2 product metric to an energy delay2 product metric of a prior architecture configuration to determine an energy effectiveness of the current architecture configuration; and
adjusting a number of active instruction schedulers of the current architecture configuration according to the energy effectiveness of the current architecture configuration.
2. The method of claim 1, wherein computing the energy delay2 product metric comprises:
selecting an active instruction scheduler from one or more active instruction schedulers of the current architecture configuration matching a selected instruction scheduler type;
computing an energy consumption value for the selected instruction scheduler and one or more associated logic elements as a product of an access count and a predetermined energy per access amount of the selected instruction scheduler and the predetermined period of the time squared;
repeating selecting of the instruction scheduler, computing of the energy consumption value and storing of the energy consumption value for each instruction scheduler of the current architecture configuration matching the selected instruction scheduler type to form an energy consumption sum;
storing the energy consumption product sum for the instruction selected scheduler type; and
repeating the selecting the active instruction scheduler, computing of the energy consumption product, repeating, and storing the energy consumption product for each instruction scheduler type of the current architecture configuration to form the energy consumption value of the current architecture configuration.
3. The method of claim 2, wherein computing the energy consumption value comprises:
calculating an energy consumption value for one or more functional units associated with the selected instruction scheduler;
calculating an energy consumption value for a register file associated with the selected instruction scheduler;
calculating an energy consumption value for each component the selected instruction scheduler;
summing the energy consumption values of the instruction scheduler, functional units and register file; and
computing the energy delay2 product as a product of the energy consumption sum and a square of the predetermined time interval.
4. The method of claim 1, wherein comparing the computed energy delay2 product value comprises:
selecting an instruction scheduler type of the current architecture configuration;
determining a computed energy consumption product for the selected instruction scheduler type;
comparing the computed energy delay2 product of the selected instruction scheduler type to a previously computed energy delay2 product value;
identifying a decrease in the effectiveness of the current architecture configuration if the computed energy delay2 product is less than the previously computed energy consumption product; and
identifying an increase in the effectiveness of the current architecture configuration if the computed energy delay2 product is greater than the previously computed energy delay2 product.
5. The method of claim 1, wherein adjusting comprises:
identifying an increase in the effectiveness of the current architecture configuration;
identifying a direction indicator state for an instruction scheduler type of the current architecture configuration as one of an increased state and a decreased state;
increasing the number of active instruction schedulers for the current architecture configuration if the direction indicator is in an increased state;
reducing the number of active instruction schedulers for the current architecture configuration if the direction indicator is in a decreased state; and
maintaining a state of the direction indicator for the selected instruction scheduler type.
6. The method of claim 1, wherein adjusting comprises:
identifying a decrease in the effectiveness of the current architecture configuration;
identifying a direction indicator state for an instruction scheduler type of the current architecture configuration as one of an increased state and a decreased state;
reducing the number of active instruction schedulers for the current architecture configuration if the direction indicator is in an increased state;
increasing the number of active instruction schedulers for the current architecture configuration if the direction indicator is in a decreased state; and
switching a state of the direction indicator for the selected instruction scheduler type.
7. The method of claim 6, wherein increasing the number of active instruction schedulers comprises:
selecting a disabled instruction scheduler of the current architecture configuration; and
enabling a clock input to the instruction scheduler and one or more associated functional blocks.
8. The method of claim 6, wherein decreasing the number of active instruction schedulers comprises:
selecting an active instruction scheduler of the current architecture configuration; and
disabling a clock input to the instruction scheduler and one or more associated functional units.
9. The method of claim 1, further comprising:
executing an adjusted architecture configuration over a predetermined interval;
computing an energy delay2 product for the adjusted architecture configuration consumed during execution over the predetermined interval;
computing an energy delay2 product for an increased architecture configuration having one or more additional active instruction schedulers than the adjusted configuration architecture consumed during execution over a reduced time interval;
computing an energy delay2 product consumed by a decreased architecture configuration having a reduced number of active instruction schedulers than the adjusted configuration architecture consumed during over the reduced interval of time;
normalizing the computed energy delay2 products for the increased and decreased architecture configurations;
identifying an architecture configuration having a lowest energy delay2 product; and
selecting the identified architecture configuration as a current architecture configuration.
10. The method of claim 9, further comprising:
detecting one of the increased architecture configuration or decreased architecture configuration as having the lowest energy delay2 product;
performing the method of claim 8 with the detected architecture configuration as the adjusted architecture configuration.
11. An article of manufacture including a machine readable storage medium having stored thereon instructions which may be used to program a system to perform a method, comprising: computing an energy delay2 product value for a current architecture configuration over a
predetermined period of time;
comparing the computed energy delay2 product value to an energy consumption value of a prior architecture configuration to determine an energy effectiveness of the current architecture configuration; and
adjusting a number of active instruction schedulers of the current architecture configuration according to the energy effectiveness of the current architecture configuration.
12. The article of manufacture of claim 11, wherein computing the delay2 product value comprises:
selecting an active instruction scheduler from one or more active instruction schedulers of the current architecture configuration matching a selected instruction scheduler type;
computing an energy consumption value for the selected instruction scheduler and one or more associated logic elements as a product of an access count and a predetermined energy per access amount of the selected insinjotion scheduler and the predetermined period of the time squared;
repeating selecting of the instruction scheduler, computing of the energy consumption value and storing of the energy consumption value for each instruction scheduler of the current architecture configuration matching the selected instruction scheduler type to form an energy consumption sum;
storing the energy consumption product sum for the instruction selected scheduler type; and
repeating the selecting the active instruction scheduler, computing of the energy consumption value, repeating, and storing the energy consumption value for each instruction scheduler type of the current architecture configuration to form the energy consumption value of the current architecture configuration.
13. The article of manufacture of claim 12, wherein computing the energy delay2 product comprises:
calculating an energy consumption value for one or more functional units associated with the selected instruction scheduler,
calculating an energy consumption value for a register file associated with the selected instruction scheduler;
calculating an energy consumption value for each component of the selected instruction scheduler;
summing die energy consumption values of the instruction scheduler, functional units and the register file; and
computing the energy delay2 product as a product of the energy consumption sum and a square of the predetermined time interval.
14. The article of manufacture of claim 11, wherein comparing the computed energy delay2 product value comprises:
selecting an instruction scheduler type of the current architecture configuration;
determining a computed energy delay2 product for the selected instruction scheduler type;
comparing the computed energy delay2 product of the selected instruction scheduler type to a previously computed energy consumption product value;
identifying a decrease in the effectiveness of the current architecture configuration if the computed energy delay2 product is less than the previously computed energy delay2 product; and
identifying an increase in the effectiveness of the current architecture configuration if the computed energy delay2 product is greater than the previously computed energy delay2 product.
15. The article of manufacture of claim 11. wherein adjusting comprises:
identifying an increase in the effectiveness of the current architecture configuration;
identifying a direction indicator stare for an instruction scheduler type of the current architecture configuration as one of an increased state and a decreased state;
increasing the number of active instruction schedulers for the current architecture configuration if the direction indicator is in an increased state;
reducing the number of active instruction schedulers for the current architecture configuration if the direction indicator is in a decreased state; and
maintaining a state of the direction indicator for the selected instruction scheduler type.
16. The article of manufacture of claim 11, further comprising:
executing an adjusted architecture configuration over a predetermined interval;
computing an energy delay2 product for the adjusted architecture configuration consumed during execution over the predetermined interval;
computing an energy delay2 product for an increased architecture configuration having one or more additional active instruction schedulers than the adjusted configuration architecture consumed during execution over a reduced time interval;
computing an energy delay2 product consumed by a decreased architecture configuration having a reduced number of active instruction schedulers than the adjusted configuration architecture consumed during over the reduced interval of time;
normalizing the computed energy delay2 products for the increased and decreased architecture configurations;
identifying an architecture configuration having a lowest energy delay2 product; and
selecting the identified architecture configuration as a current architecture configuration.
17. The article of manufacture of claim 16, further comprising:
detecting one of the increased architecture configuration or decreased architecture configuration as having The lowest energy delay2 product;
performing the method of claim 16 with the detected architecture configuration as the adjusted architecture configuration.
Patent Citations (1)
| Patent | Date | Inventor | Cited By |
|---|---|---|---|
| US6794824(B2) | 2004-09-01 | Song et al. | Examiner |
Non-Patent Literature (4)
- Chung, Wai Man, The Usage of Dual Edge Triggered Flip-flops in Low Power, Low Voltage Applications, Jan. 2003.Examiner
- Stan, Mircea R., Kevin Skadron, Power-Aware Computing, Dec. 2003, IEEE Computer Society.Examiner
- Mathew, Binu K., The Perception Processor, Aug. 2004.Examiner
- Hsu, Chung-Hsing, Wu-chun Feng, Jeremy S. Archuleta, Towards Efficient Supercomputing: A Quest for the Right Metric, Apr. 205, IEEE Workshop on High-Performance, Power-Aware Computing.Examiner